2024-04-16T14:14:26.359 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-16T14:14:26.359 DEBUG:teuthology.run:Teuthology command: teuthology --description orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --verbose --archive /home/teuthworker/archive/adking-2024-04-16_12:53:12-orch:cephadm-wip-adk2-testing-2024-04-15-1136-squid-distro-default-smithi/7658280 --owner scheduled_adking@teuthology --name adking-2024-04-16_12:53:12-orch:cephadm-wip-adk2-testing-2024-04-15-1136-squid-distro-default-smithi -- /home/teuthworker/archive/adking-2024-04-16_12:53:12-orch:cephadm-wip-adk2-testing-2024-04-15-1136-squid-distro-default-smithi/7658280/orig.config.yaml 2024-04-16T14:14:26.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T14:14:26.519 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/adking-2024-04-16_12:53:12-orch:cephadm-wip-adk2-testing-2024-04-15-1136-squid-distro-default-smithi/7658280 branch: wip-adk2-testing-2024-04-15-1136-squid description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: adking@redhat.com first_in_suite: false job_id: '7658280' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: adking-2024-04-16_12:53:12-orch:cephadm-wip-adk2-testing-2024-04-15-1136-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-adk2-testing-2024-04-15-1136-squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN sha1: 36befe5d41ee8a6ea2e60983e763134278d506cf ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 36befe5d41ee8a6ea2e60983e763134278d506cf kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-adk2-testing-2024-04-15-1136-squid sha1: 36befe5d41ee8a6ea2e60983e763134278d506cf owner: scheduled_adking@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 5433 sha1: 36befe5d41ee8a6ea2e60983e763134278d506cf sleep_before_teardown: 0 subset: 1/16 suite: orch:cephadm suite_branch: wip-adk2-testing-2024-04-15-1136-squid suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_36befe5d41ee8a6ea2e60983e763134278d506cf/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 36befe5d41ee8a6ea2e60983e763134278d506cf targets: smithi005.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ7lLiE9bClcAqjQWWvUy8YU4ywbi++5z6wfZJWbqZZkhZDGv7ufEm9QbzBTrNEQUBQPrGx4dqCYGkbyI4Hlg2w= smithi115.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO3S1HLQOcLTWViFwwJgSIXL5mlYnz+idfUF2zvoAMcGAKsm0UqrUk8dLQR1b2VTzGM2d2Ep49crs3gu1rhnpBw= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /cephfs/home/adking/src/git.ceph.com_ceph-c_wip-adk2-testing-2024-04-15-1136-squid/qa/suites/orch/cephadm/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-16_12:53:12 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: adking verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-04-16T14:14:26.519 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_36befe5d41ee8a6ea2e60983e763134278d506cf/qa; will attempt to use it 2024-04-16T14:14:26.520 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_36befe5d41ee8a6ea2e60983e763134278d506cf/qa/tasks 2024-04-16T14:14:26.520 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-16T14:14:26.522 INFO:teuthology.task.internal:Checking packages... 2024-04-16T14:14:26.547 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '36befe5d41ee8a6ea2e60983e763134278d506cf' 2024-04-16T14:14:26.547 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-16T14:14:26.547 INFO:teuthology.packaging:ref: None 2024-04-16T14:14:26.547 INFO:teuthology.packaging:tag: None 2024-04-16T14:14:26.547 INFO:teuthology.packaging:branch: wip-adk2-testing-2024-04-15-1136-squid 2024-04-16T14:14:26.547 INFO:teuthology.packaging:sha1: 36befe5d41ee8a6ea2e60983e763134278d506cf 2024-04-16T14:14:26.547 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-adk2-testing-2024-04-15-1136-squid 2024-04-16T14:14:26.687 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2204.g36befe5d 2024-04-16T14:14:26.688 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-16T14:14:26.695 INFO:teuthology.task.internal:no buildpackages task found 2024-04-16T14:14:26.695 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-16T14:14:26.716 INFO:teuthology.task.internal:Saving configuration 2024-04-16T14:14:26.736 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-16T14:14:26.742 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-16T14:14:26.762 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2024-04-16_12:53:12-orch:cephadm-wip-adk2-testing-2024-04-15-1136-squid-distro-default-smithi/7658280', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 14:09:01.774331', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ7lLiE9bClcAqjQWWvUy8YU4ywbi++5z6wfZJWbqZZkhZDGv7ufEm9QbzBTrNEQUBQPrGx4dqCYGkbyI4Hlg2w='} 2024-04-16T14:14:26.781 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2024-04-16_12:53:12-orch:cephadm-wip-adk2-testing-2024-04-15-1136-squid-distro-default-smithi/7658280', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 14:09:01.772546', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO3S1HLQOcLTWViFwwJgSIXL5mlYnz+idfUF2zvoAMcGAKsm0UqrUk8dLQR1b2VTzGM2d2Ep49crs3gu1rhnpBw='} 2024-04-16T14:14:26.781 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-16T14:14:26.788 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-04-16T14:14:26.788 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-04-16T14:14:26.788 INFO:teuthology.run_tasks:Running task console_log... 2024-04-16T14:14:26.878 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd0d29540d0>, signals=[15]) 2024-04-16T14:14:26.879 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-16T14:14:26.885 INFO:teuthology.task.internal:Opening connections... 2024-04-16T14:14:26.886 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi005.front.sepia.ceph.com 2024-04-16T14:14:26.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T14:14:26.992 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi115.front.sepia.ceph.com 2024-04-16T14:14:26.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T14:14:27.078 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-16T14:14:27.085 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2024-04-16T14:14:27.103 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2024-04-16T14:14:27.103 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-04-16T14:14:27.162 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2024-04-16T14:14:27.162 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="9" 2024-04-16T14:14:27.162 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2024-04-16T14:14:27.162 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2024-04-16T14:14:27.162 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="9" 2024-04-16T14:14:27.162 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el9" 2024-04-16T14:14:27.162 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-16T14:14:27.162 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2024-04-16T14:14:27.162 INFO:teuthology.orchestra.run.smithi005.stdout:LOGO="fedora-logo-icon" 2024-04-16T14:14:27.162 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-16T14:14:27.162 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2024-04-16T14:14:27.163 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-16T14:14:27.163 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-16T14:14:27.163 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-16T14:14:27.163 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-04-16T14:14:27.185 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2024-04-16T14:14:27.202 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2024-04-16T14:14:27.203 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-04-16T14:14:27.259 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2024-04-16T14:14:27.259 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9" 2024-04-16T14:14:27.260 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2024-04-16T14:14:27.260 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2024-04-16T14:14:27.260 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9" 2024-04-16T14:14:27.260 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9" 2024-04-16T14:14:27.260 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-16T14:14:27.260 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-04-16T14:14:27.260 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon" 2024-04-16T14:14:27.260 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-16T14:14:27.260 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2024-04-16T14:14:27.260 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-16T14:14:27.260 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-16T14:14:27.260 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-16T14:14:27.261 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-04-16T14:14:27.284 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-16T14:14:27.294 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-16T14:14:27.313 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-16T14:14:27.313 DEBUG:teuthology.orchestra.run.smithi005:> test '!' -e /home/ubuntu/cephtest 2024-04-16T14:14:27.316 DEBUG:teuthology.orchestra.run.smithi115:> test '!' -e /home/ubuntu/cephtest 2024-04-16T14:14:27.331 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-16T14:14:27.337 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-16T14:14:27.338 DEBUG:teuthology.orchestra.run.smithi005:> test -z $(ls -A /var/lib/ceph) 2024-04-16T14:14:27.373 DEBUG:teuthology.orchestra.run.smithi115:> test -z $(ls -A /var/lib/ceph) 2024-04-16T14:14:27.475 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-16T14:14:27.526 INFO:teuthology.run_tasks:Running task kernel... 2024-04-16T14:14:27.541 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-16T14:14:27.541 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-16T14:14:27.542 DEBUG:teuthology.orchestra.run.smithi005:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-16T14:14:27.542 DEBUG:teuthology.orchestra.run.smithi115:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-16T14:14:27.559 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T14:14:27.559 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-16T14:14:27.561 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T14:14:27.561 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-04-16T14:14:27.618 INFO:teuthology.orchestra.run.smithi115.stdout:5.14.0-361.el9.x86_64 2024-04-16T14:14:27.619 INFO:teuthology.task.kernel:Running kernel on smithi115: 5.14.0-361.el9.x86_64 2024-04-16T14:14:27.619 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum install -y kernel 2024-04-16T14:14:27.620 INFO:teuthology.orchestra.run.smithi005.stdout:5.14.0-361.el9.x86_64 2024-04-16T14:14:27.620 INFO:teuthology.task.kernel:Running kernel on smithi005: 5.14.0-361.el9.x86_64 2024-04-16T14:14:27.620 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum install -y kernel 2024-04-16T14:14:29.724 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS-9 - AppStream 14 MB/s | 6.7 MB 00:00 2024-04-16T14:14:29.740 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS-9 - AppStream 15 MB/s | 6.7 MB 00:00 2024-04-16T14:14:31.175 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS-9 - BaseOS 7.4 MB/s | 2.0 MB 00:00 2024-04-16T14:14:31.482 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS-9 - BaseOS 2.9 MB/s | 2.0 MB 00:00 2024-04-16T14:14:33.290 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.0 MB 00:01 2024-04-16T14:14:33.639 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.0 MB 00:01 2024-04-16T14:14:36.081 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - AppStream 14 MB/s | 19 MB 00:01 2024-04-16T14:14:37.866 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - AppStream 5.6 MB/s | 19 MB 00:03 2024-04-16T14:14:40.365 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-04-16T14:14:41.990 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 16 kB 00:00 2024-04-16T14:14:42.917 INFO:teuthology.orchestra.run.smithi115.stdout:Extra Packages for Enterprise Linux 27 MB/s | 21 MB 00:00 2024-04-16T14:14:43.308 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.2 MB 00:01 2024-04-16T14:14:44.934 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 16 kB 00:00 2024-04-16T14:14:46.838 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-04-16T14:14:47.908 INFO:teuthology.orchestra.run.smithi115.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-04-16T14:14:50.265 INFO:teuthology.orchestra.run.smithi115.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-16T14:14:50.265 INFO:teuthology.orchestra.run.smithi115.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-16T14:14:50.365 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-16T14:14:50.381 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:14:50.382 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-04-16T14:14:50.382 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:14:50.382 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-04-16T14:14:50.382 INFO:teuthology.orchestra.run.smithi115.stdout: kernel x86_64 5.14.0-438.el9 CentOS-BaseOS 277 k 2024-04-16T14:14:50.382 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-04-16T14:14:50.382 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-core x86_64 5.14.0-438.el9 CentOS-BaseOS 15 M 2024-04-16T14:14:50.382 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-modules x86_64 5.14.0-438.el9 CentOS-BaseOS 34 M 2024-04-16T14:14:50.382 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-modules-core x86_64 5.14.0-438.el9 CentOS-BaseOS 28 M 2024-04-16T14:14:50.382 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:14:50.382 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-04-16T14:14:50.382 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:14:50.382 INFO:teuthology.orchestra.run.smithi115.stdout:Install 4 Packages 2024-04-16T14:14:50.382 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:14:50.383 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 77 M 2024-04-16T14:14:50.383 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 123 M 2024-04-16T14:14:50.383 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-04-16T14:14:50.559 INFO:teuthology.orchestra.run.smithi115.stdout:(1/4): kernel-5.14.0-438.el9.x86_64.rpm 1.5 MB/s | 277 kB 00:00 2024-04-16T14:14:51.051 INFO:teuthology.orchestra.run.smithi115.stdout:(2/4): kernel-core-5.14.0-438.el9.x86_64.rpm 23 MB/s | 15 MB 00:00 2024-04-16T14:14:51.618 INFO:teuthology.orchestra.run.smithi115.stdout:(3/4): kernel-modules-core-5.14.0-438.el9.x86_6 26 MB/s | 28 MB 00:01 2024-04-16T14:14:52.027 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-04-16T14:14:52.051 INFO:teuthology.orchestra.run.smithi115.stdout:(4/4): kernel-modules-5.14.0-438.el9.x86_64.rpm 20 MB/s | 34 MB 00:01 2024-04-16T14:14:52.055 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:14:52.055 INFO:teuthology.orchestra.run.smithi115.stdout:Total 46 MB/s | 77 MB 00:01 2024-04-16T14:14:52.055 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-04-16T14:14:52.432 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-04-16T14:14:52.432 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-04-16T14:14:53.266 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-04-16T14:14:53.266 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-04-16T14:14:54.442 INFO:teuthology.orchestra.run.smithi005.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-16T14:14:54.442 INFO:teuthology.orchestra.run.smithi005.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-16T14:14:54.533 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-16T14:14:54.542 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:14:54.542 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-04-16T14:14:54.542 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:14:54.542 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-04-16T14:14:54.542 INFO:teuthology.orchestra.run.smithi005.stdout: kernel x86_64 5.14.0-438.el9 CentOS-BaseOS 277 k 2024-04-16T14:14:54.542 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-04-16T14:14:54.543 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-core x86_64 5.14.0-438.el9 CentOS-BaseOS 15 M 2024-04-16T14:14:54.543 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules x86_64 5.14.0-438.el9 CentOS-BaseOS 34 M 2024-04-16T14:14:54.543 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules-core x86_64 5.14.0-438.el9 CentOS-BaseOS 28 M 2024-04-16T14:14:54.543 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:14:54.543 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-04-16T14:14:54.543 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:14:54.543 INFO:teuthology.orchestra.run.smithi005.stdout:Install 4 Packages 2024-04-16T14:14:54.543 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:14:54.544 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 77 M 2024-04-16T14:14:54.544 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 123 M 2024-04-16T14:14:54.544 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-04-16T14:14:54.745 INFO:teuthology.orchestra.run.smithi005.stdout:(1/4): kernel-5.14.0-438.el9.x86_64.rpm 1.3 MB/s | 277 kB 00:00 2024-04-16T14:14:55.437 INFO:teuthology.orchestra.run.smithi005.stdout:(2/4): kernel-core-5.14.0-438.el9.x86_64.rpm 17 MB/s | 15 MB 00:00 2024-04-16T14:14:55.572 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-04-16T14:14:56.328 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : kernel-modules-core-5.14.0-438.el9.x86_64 1/4 2024-04-16T14:14:56.354 INFO:teuthology.orchestra.run.smithi005.stdout:(3/4): kernel-modules-5.14.0-438.el9.x86_64.rpm 19 MB/s | 34 MB 00:01 2024-04-16T14:14:56.410 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T14:14:57.920 INFO:teuthology.orchestra.run.smithi005.stdout:(4/4): kernel-modules-core-5.14.0-438.el9.x86_6 8.7 MB/s | 28 MB 00:03 2024-04-16T14:14:57.924 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:14:57.924 INFO:teuthology.orchestra.run.smithi005.stdout:Total 23 MB/s | 77 MB 00:03 2024-04-16T14:14:57.924 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-04-16T14:14:58.364 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-04-16T14:14:58.364 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-04-16T14:14:59.140 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T14:14:59.249 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-04-16T14:14:59.250 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-04-16T14:14:59.270 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T14:15:01.684 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-04-16T14:15:02.301 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-modules-core-5.14.0-438.el9.x86_64 1/4 2024-04-16T14:15:02.396 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T14:15:04.003 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T14:15:04.047 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T14:15:05.292 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T14:15:05.430 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T14:15:08.866 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T14:15:10.507 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T14:15:10.548 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T14:15:15.644 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T14:15:38.280 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T14:15:38.280 INFO:teuthology.orchestra.run.smithi115.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-16T14:15:38.280 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:15:38.324 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 4/4 2024-04-16T14:15:38.667 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T14:15:38.667 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : kernel-5.14.0-438.el9.x86_64 1/4 2024-04-16T14:15:38.668 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T14:15:38.668 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T14:15:39.128 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T14:15:39.128 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:15:39.128 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-04-16T14:15:39.128 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-5.14.0-438.el9.x86_64 2024-04-16T14:15:39.128 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-core-5.14.0-438.el9.x86_64 2024-04-16T14:15:39.128 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-modules-5.14.0-438.el9.x86_64 2024-04-16T14:15:39.129 INFO:teuthology.orchestra.run.smithi115.stdout: kernel-modules-core-5.14.0-438.el9.x86_64 2024-04-16T14:15:39.129 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:15:39.129 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-16T14:15:39.450 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T14:15:39.559 INFO:teuthology.orchestra.run.smithi115.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T14:15:39.560 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T14:15:39.560 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-438.el9.x86_64 2024-04-16T14:15:39.560 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-16T14:15:39.560 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-16T14:15:39.561 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-04-16T14:15:39.561 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi115.front.sepia.ceph.com, path=None, version=distro) 2024-04-16T14:15:39.561 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T14:15:39.640 INFO:teuthology.orchestra.run.smithi115.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T14:15:39.640 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T14:15:39.641 DEBUG:teuthology.orchestra.run.smithi115:> sudo rpm -qi grub2-tools 2024-04-16T14:15:39.681 INFO:teuthology.orchestra.run.smithi115.stdout:Name : grub2-tools 2024-04-16T14:15:39.681 INFO:teuthology.orchestra.run.smithi115.stdout:Epoch : 1 2024-04-16T14:15:39.681 INFO:teuthology.orchestra.run.smithi115.stdout:Version : 2.06 2024-04-16T14:15:39.681 INFO:teuthology.orchestra.run.smithi115.stdout:Release : 68.el9 2024-04-16T14:15:39.681 INFO:teuthology.orchestra.run.smithi115.stdout:Architecture: x86_64 2024-04-16T14:15:39.681 INFO:teuthology.orchestra.run.smithi115.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-16T14:15:39.681 INFO:teuthology.orchestra.run.smithi115.stdout:Group : Unspecified 2024-04-16T14:15:39.681 INFO:teuthology.orchestra.run.smithi115.stdout:Size : 8264254 2024-04-16T14:15:39.681 INFO:teuthology.orchestra.run.smithi115.stdout:License : GPLv3+ 2024-04-16T14:15:39.682 INFO:teuthology.orchestra.run.smithi115.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-16T14:15:39.682 INFO:teuthology.orchestra.run.smithi115.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-16T14:15:39.682 INFO:teuthology.orchestra.run.smithi115.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-16T14:15:39.682 INFO:teuthology.orchestra.run.smithi115.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-16T14:15:39.682 INFO:teuthology.orchestra.run.smithi115.stdout:Packager : builder@centos.org 2024-04-16T14:15:39.682 INFO:teuthology.orchestra.run.smithi115.stdout:Vendor : CentOS 2024-04-16T14:15:39.682 INFO:teuthology.orchestra.run.smithi115.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-16T14:15:39.682 INFO:teuthology.orchestra.run.smithi115.stdout:Summary : Support tools for GRUB. 2024-04-16T14:15:39.682 INFO:teuthology.orchestra.run.smithi115.stdout:Description : 2024-04-16T14:15:39.682 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:15:39.682 INFO:teuthology.orchestra.run.smithi115.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-16T14:15:39.682 INFO:teuthology.orchestra.run.smithi115.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-16T14:15:39.682 INFO:teuthology.orchestra.run.smithi115.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-16T14:15:39.682 INFO:teuthology.orchestra.run.smithi115.stdout:hardware devices. 2024-04-16T14:15:39.682 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:15:39.682 INFO:teuthology.orchestra.run.smithi115.stdout:This subpackage provides tools for support of all platforms. 2024-04-16T14:15:39.683 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-16T14:15:39.683 INFO:teuthology.task.kernel:Updating grub on smithi115 to boot 5.14.0-438.el9.x86_64 2024-04-16T14:15:39.683 DEBUG:teuthology.orchestra.run.smithi115:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-16T14:15:40.323 INFO:teuthology.orchestra.run.smithi115.stderr:Generating grub configuration file ... 2024-04-16T14:15:41.699 INFO:teuthology.orchestra.run.smithi115.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-16T14:15:41.736 INFO:teuthology.orchestra.run.smithi115.stderr:done 2024-04-16T14:15:41.738 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2024-04-16T14:15:41.753 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.Sq4zU7vsot 2024-04-16T14:15:41.753 DEBUG:teuthology.orchestra.run.smithi115:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Sq4zU7vsot 2024-04-16T14:15:41.832 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.Sq4zU7vsot 2024-04-16T14:15:41.974 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.Sq4zU7vsot is 6KB 2024-04-16T14:15:42.023 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.Sq4zU7vsot 2024-04-16T14:15:42.037 DEBUG:teuthology.orchestra.run.smithi115:> sudo /bin/ls /boot/loader/entries || true 2024-04-16T14:15:42.102 INFO:teuthology.orchestra.run.smithi115.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-16T14:15:42.102 INFO:teuthology.orchestra.run.smithi115.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-16T14:15:42.102 INFO:teuthology.orchestra.run.smithi115.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-16T14:15:42.102 INFO:teuthology.orchestra.run.smithi115.stdout:15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64.conf 2024-04-16T14:15:42.103 DEBUG:teuthology.orchestra.run.smithi115:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64 2024-04-16T14:15:42.259 DEBUG:teuthology.orchestra.run.smithi115:> sudo shutdown -r now 2024-04-16T14:15:46.498 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T14:15:46.498 INFO:teuthology.orchestra.run.smithi005.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-16T14:15:46.498 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:15:46.543 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 4/4 2024-04-16T14:15:46.896 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T14:15:46.896 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-5.14.0-438.el9.x86_64 1/4 2024-04-16T14:15:46.896 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T14:15:46.896 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T14:15:47.342 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T14:15:47.343 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:15:47.343 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-04-16T14:15:47.343 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-5.14.0-438.el9.x86_64 2024-04-16T14:15:47.343 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-core-5.14.0-438.el9.x86_64 2024-04-16T14:15:47.343 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules-5.14.0-438.el9.x86_64 2024-04-16T14:15:47.343 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules-core-5.14.0-438.el9.x86_64 2024-04-16T14:15:47.343 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:15:47.343 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-16T14:15:47.712 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T14:15:47.808 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T14:15:47.808 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T14:15:47.808 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-438.el9.x86_64 2024-04-16T14:15:47.808 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-16T14:15:47.809 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-16T14:15:47.809 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-04-16T14:15:47.809 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi005.front.sepia.ceph.com, path=None, version=distro) 2024-04-16T14:15:47.809 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T14:15:47.894 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T14:15:47.894 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T14:15:47.894 DEBUG:teuthology.orchestra.run.smithi005:> sudo rpm -qi grub2-tools 2024-04-16T14:15:47.932 INFO:teuthology.orchestra.run.smithi005.stdout:Name : grub2-tools 2024-04-16T14:15:47.932 INFO:teuthology.orchestra.run.smithi005.stdout:Epoch : 1 2024-04-16T14:15:47.932 INFO:teuthology.orchestra.run.smithi005.stdout:Version : 2.06 2024-04-16T14:15:47.932 INFO:teuthology.orchestra.run.smithi005.stdout:Release : 68.el9 2024-04-16T14:15:47.932 INFO:teuthology.orchestra.run.smithi005.stdout:Architecture: x86_64 2024-04-16T14:15:47.932 INFO:teuthology.orchestra.run.smithi005.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-16T14:15:47.932 INFO:teuthology.orchestra.run.smithi005.stdout:Group : Unspecified 2024-04-16T14:15:47.932 INFO:teuthology.orchestra.run.smithi005.stdout:Size : 8264254 2024-04-16T14:15:47.932 INFO:teuthology.orchestra.run.smithi005.stdout:License : GPLv3+ 2024-04-16T14:15:47.932 INFO:teuthology.orchestra.run.smithi005.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-16T14:15:47.932 INFO:teuthology.orchestra.run.smithi005.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-16T14:15:47.932 INFO:teuthology.orchestra.run.smithi005.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-16T14:15:47.933 INFO:teuthology.orchestra.run.smithi005.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-16T14:15:47.933 INFO:teuthology.orchestra.run.smithi005.stdout:Packager : builder@centos.org 2024-04-16T14:15:47.933 INFO:teuthology.orchestra.run.smithi005.stdout:Vendor : CentOS 2024-04-16T14:15:47.933 INFO:teuthology.orchestra.run.smithi005.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-16T14:15:47.933 INFO:teuthology.orchestra.run.smithi005.stdout:Summary : Support tools for GRUB. 2024-04-16T14:15:47.933 INFO:teuthology.orchestra.run.smithi005.stdout:Description : 2024-04-16T14:15:47.933 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:15:47.933 INFO:teuthology.orchestra.run.smithi005.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-16T14:15:47.933 INFO:teuthology.orchestra.run.smithi005.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-16T14:15:47.933 INFO:teuthology.orchestra.run.smithi005.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-16T14:15:47.933 INFO:teuthology.orchestra.run.smithi005.stdout:hardware devices. 2024-04-16T14:15:47.933 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:15:47.933 INFO:teuthology.orchestra.run.smithi005.stdout:This subpackage provides tools for support of all platforms. 2024-04-16T14:15:47.934 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-16T14:15:47.935 INFO:teuthology.task.kernel:Updating grub on smithi005 to boot 5.14.0-438.el9.x86_64 2024-04-16T14:15:47.935 DEBUG:teuthology.orchestra.run.smithi005:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-16T14:15:48.571 INFO:teuthology.orchestra.run.smithi005.stderr:Generating grub configuration file ... 2024-04-16T14:15:49.938 INFO:teuthology.orchestra.run.smithi005.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-16T14:15:49.971 INFO:teuthology.orchestra.run.smithi005.stderr:done 2024-04-16T14:15:49.973 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-04-16T14:15:49.989 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.pZeKuRrAE7 2024-04-16T14:15:49.989 DEBUG:teuthology.orchestra.run.smithi005:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.pZeKuRrAE7 2024-04-16T14:15:50.061 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.pZeKuRrAE7 2024-04-16T14:15:50.208 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.pZeKuRrAE7 is 6KB 2024-04-16T14:15:50.229 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.pZeKuRrAE7 2024-04-16T14:15:50.244 DEBUG:teuthology.orchestra.run.smithi005:> sudo /bin/ls /boot/loader/entries || true 2024-04-16T14:15:50.313 INFO:teuthology.orchestra.run.smithi005.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-16T14:15:50.313 INFO:teuthology.orchestra.run.smithi005.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-16T14:15:50.313 INFO:teuthology.orchestra.run.smithi005.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-16T14:15:50.313 INFO:teuthology.orchestra.run.smithi005.stdout:15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64.conf 2024-04-16T14:15:50.314 DEBUG:teuthology.orchestra.run.smithi005:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64 2024-04-16T14:15:50.462 DEBUG:teuthology.orchestra.run.smithi005:> sudo shutdown -r now 2024-04-16T14:16:12.282 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-04-16T14:16:12.283 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-16T14:16:12.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T14:16:20.470 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-04-16T14:16:20.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-04-16T14:16:20.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T14:16:30.750 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-16T14:16:38.942 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-04-16T14:16:39.752 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-16T14:16:39.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T14:16:42.814 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-16T14:16:47.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-04-16T14:16:47.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T14:16:54.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-16T14:16:54.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T14:17:13.247 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-16T14:17:28.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-16T14:17:28.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T14:17:28.617 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-16T14:17:29.051 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-16T14:17:29.051 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-438.el9.x86_64"... 2024-04-16T14:17:29.051 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-04-16T14:17:29.067 INFO:teuthology.orchestra.run.smithi115.stdout:5.14.0-438.el9.x86_64 2024-04-16T14:17:29.067 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-438.el9.x86_64 vs 5.14.0-438.el9.x86_64 2024-04-16T14:17:29.067 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-16T14:17:29.067 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-16T14:17:30.068 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-04-16T14:17:30.068 DEBUG:teuthology.orchestra.run.smithi115:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-16T14:17:30.161 INFO:teuthology.orchestra.run.smithi115.stdout:ttyS1 2024-04-16T14:17:30.202 DEBUG:teuthology.parallel:result is None 2024-04-16T14:17:47.949 DEBUG:teuthology.orchestra.remote:timed out 2024-04-16T14:17:59.951 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-04-16T14:17:59.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T14:18:00.270 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-04-16T14:18:00.603 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-04-16T14:18:00.603 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-438.el9.x86_64"... 2024-04-16T14:18:00.603 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-04-16T14:18:00.623 INFO:teuthology.orchestra.run.smithi005.stdout:5.14.0-438.el9.x86_64 2024-04-16T14:18:00.623 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-438.el9.x86_64 vs 5.14.0-438.el9.x86_64 2024-04-16T14:18:00.624 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-16T14:18:00.624 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-16T14:18:01.624 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-04-16T14:18:01.625 DEBUG:teuthology.orchestra.run.smithi005:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-16T14:18:01.711 INFO:teuthology.orchestra.run.smithi005.stdout:ttyS1 2024-04-16T14:18:01.738 DEBUG:teuthology.parallel:result is None 2024-04-16T14:18:01.738 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-16T14:18:01.746 INFO:teuthology.task.internal:Creating test directory... 2024-04-16T14:18:01.746 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-16T14:18:01.748 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-16T14:18:01.768 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-16T14:18:01.804 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-16T14:18:01.816 INFO:teuthology.task.internal:Creating archive directory... 2024-04-16T14:18:01.817 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-16T14:18:01.819 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-16T14:18:01.854 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-16T14:18:01.860 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-16T14:18:01.861 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-16T14:18:01.882 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-16T14:18:01.917 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T14:18:01.931 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T14:18:01.932 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T14:18:01.945 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T14:18:01.947 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-16T14:18:01.954 INFO:teuthology.task.internal:Configuring sudo... 2024-04-16T14:18:01.954 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-16T14:18:01.976 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-16T14:18:02.018 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-16T14:18:02.027 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-16T14:18:02.028 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-16T14:18:02.046 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-16T14:18:02.075 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T14:18:02.145 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T14:18:02.195 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T14:18:02.282 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T14:18:02.323 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-16T14:18:02.323 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-16T14:18:02.391 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T14:18:02.431 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T14:18:02.497 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T14:18:02.541 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T14:18:02.584 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-16T14:18:02.585 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-16T14:18:02.654 DEBUG:teuthology.orchestra.run.smithi005:> sudo service rsyslog restart 2024-04-16T14:18:02.657 DEBUG:teuthology.orchestra.run.smithi115:> sudo service rsyslog restart 2024-04-16T14:18:02.698 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T14:18:02.756 INFO:teuthology.orchestra.run.smithi115.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T14:18:03.011 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-16T14:18:03.019 INFO:teuthology.task.internal:Starting timer... 2024-04-16T14:18:03.019 INFO:teuthology.run_tasks:Running task pcp... 2024-04-16T14:18:03.043 INFO:teuthology.run_tasks:Running task selinux... 2024-04-16T14:18:03.062 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-16T14:18:03.063 DEBUG:teuthology.orchestra.run.smithi005:> sudo service auditd rotate 2024-04-16T14:18:03.119 INFO:teuthology.orchestra.run.smithi005.stdout:Rotating logs: 2024-04-16T14:18:03.121 DEBUG:teuthology.orchestra.run.smithi115:> sudo service auditd rotate 2024-04-16T14:18:03.170 INFO:teuthology.orchestra.run.smithi115.stdout:Rotating logs: 2024-04-16T14:18:03.172 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-16T14:18:03.172 DEBUG:teuthology.orchestra.run.smithi005:> /usr/sbin/getenforce 2024-04-16T14:18:03.202 INFO:teuthology.orchestra.run.smithi005.stdout:Permissive 2024-04-16T14:18:03.202 DEBUG:teuthology.orchestra.run.smithi115:> /usr/sbin/getenforce 2024-04-16T14:18:03.229 INFO:teuthology.orchestra.run.smithi115.stdout:Permissive 2024-04-16T14:18:03.229 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi005.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi115.front.sepia.ceph.com': 'permissive'} 2024-04-16T14:18:03.230 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T14:18:03.271 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T14:18:03.272 DEBUG:teuthology.orchestra.run.smithi115:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T14:18:03.301 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T14:18:03.301 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-16T14:18:03.301 DEBUG:teuthology.orchestra.run.smithi005:> sudo /usr/sbin/setenforce permissive 2024-04-16T14:18:03.350 DEBUG:teuthology.orchestra.run.smithi115:> sudo /usr/sbin/setenforce permissive 2024-04-16T14:18:03.381 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-16T14:18:03.391 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-16T14:18:03.409 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-16T14:18:03.411 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi005.front.sepia.ceph.com,smithi115.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-16T14:22:23.860 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi005.front.sepia.ceph.com'), Remote(name='ubuntu@smithi115.front.sepia.ceph.com')] 2024-04-16T14:22:23.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-04-16T14:22:23.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T14:22:23.955 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-04-16T14:22:24.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-04-16T14:22:24.034 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-16T14:22:24.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T14:22:24.123 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-16T14:22:24.199 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-16T14:22:24.200 INFO:teuthology.run_tasks:Running task clock... 2024-04-16T14:22:24.212 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-16T14:22:24.212 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-16T14:22:24.213 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T14:22:24.215 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-16T14:22:24.215 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T14:22:24.246 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-16T14:22:24.264 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-16T14:22:24.274 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-16T14:22:24.292 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-16T14:22:24.295 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: ntpd: command not found 2024-04-16T14:22:24.310 INFO:teuthology.orchestra.run.smithi005.stdout:506 Cannot talk to daemon 2024-04-16T14:22:24.325 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: ntpd: command not found 2024-04-16T14:22:24.327 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-16T14:22:24.339 INFO:teuthology.orchestra.run.smithi115.stdout:506 Cannot talk to daemon 2024-04-16T14:22:24.345 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-16T14:22:24.357 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-16T14:22:24.374 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-16T14:22:24.408 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: ntpq: command not found 2024-04-16T14:22:24.411 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T14:22:24.411 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-04-16T14:22:24.411 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T14:22:24.412 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T14:22:24.412 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T14:22:24.412 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T14:22:24.429 INFO:teuthology.orchestra.run.smithi115.stderr:bash: line 1: ntpq: command not found 2024-04-16T14:22:24.432 INFO:teuthology.orchestra.run.smithi115.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T14:22:24.432 INFO:teuthology.orchestra.run.smithi115.stdout:=============================================================================== 2024-04-16T14:22:24.432 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T14:22:24.432 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T14:22:24.432 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T14:22:24.432 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T14:22:24.433 INFO:teuthology.run_tasks:Running task install... 2024-04-16T14:22:24.451 DEBUG:teuthology.task.install:project ceph 2024-04-16T14:22:24.451 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '36befe5d41ee8a6ea2e60983e763134278d506cf'}} 2024-04-16T14:22:24.451 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '36befe5d41ee8a6ea2e60983e763134278d506cf'} 2024-04-16T14:22:24.451 INFO:teuthology.task.install:Using flavor: default 2024-04-16T14:22:24.457 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-16T14:22:24.458 INFO:teuthology.task.install:extra packages: [] 2024-04-16T14:22:24.458 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '36befe5d41ee8a6ea2e60983e763134278d506cf', 'tag': None, 'wait_for_package': False} 2024-04-16T14:22:24.458 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-16T14:22:24.458 INFO:teuthology.packaging:ref: None 2024-04-16T14:22:24.458 INFO:teuthology.packaging:tag: None 2024-04-16T14:22:24.458 INFO:teuthology.packaging:branch: quincy 2024-04-16T14:22:24.458 INFO:teuthology.packaging:sha1: 36befe5d41ee8a6ea2e60983e763134278d506cf 2024-04-16T14:22:24.459 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-16T14:22:24.461 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '36befe5d41ee8a6ea2e60983e763134278d506cf', 'tag': None, 'wait_for_package': False} 2024-04-16T14:22:24.461 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-16T14:22:24.461 INFO:teuthology.packaging:ref: None 2024-04-16T14:22:24.461 INFO:teuthology.packaging:tag: None 2024-04-16T14:22:24.462 INFO:teuthology.packaging:branch: quincy 2024-04-16T14:22:24.462 INFO:teuthology.packaging:sha1: 36befe5d41ee8a6ea2e60983e763134278d506cf 2024-04-16T14:22:24.462 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-16T14:22:24.773 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/quincy/412a55265f2f22574094a21d5a03e20633d86ce0/centos/9/flavors/default/ 2024-04-16T14:22:24.774 INFO:teuthology.task.install.rpm:Package version is 17.2.7-868.g412a5526 2024-04-16T14:22:24.809 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/quincy/412a55265f2f22574094a21d5a03e20633d86ce0/centos/9/flavors/default/ 2024-04-16T14:22:24.810 INFO:teuthology.task.install.rpm:Package version is 17.2.7-868.g412a5526 2024-04-16T14:22:24.888 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/quincy/412a55265f2f22574094a21d5a03e20633d86ce0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/412a55265f2f22574094a21d5a03e20633d86ce0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/412a55265f2f22574094a21d5a03e20633d86ce0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-16T14:22:24.888 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-16T14:22:24.888 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-16T14:22:24.918 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/quincy/412a55265f2f22574094a21d5a03e20633d86ce0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/412a55265f2f22574094a21d5a03e20633d86ce0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/412a55265f2f22574094a21d5a03e20633d86ce0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-16T14:22:24.918 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-16T14:22:24.918 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-16T14:22:24.919 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-16T14:22:24.920 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-16T14:22:24.920 INFO:teuthology.packaging:ref: None 2024-04-16T14:22:24.920 INFO:teuthology.packaging:tag: None 2024-04-16T14:22:24.920 INFO:teuthology.packaging:branch: quincy 2024-04-16T14:22:24.920 INFO:teuthology.packaging:sha1: 36befe5d41ee8a6ea2e60983e763134278d506cf 2024-04-16T14:22:24.920 DEBUG:teuthology.orchestra.run.smithi005:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-16T14:22:24.948 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-16T14:22:24.949 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-16T14:22:24.949 INFO:teuthology.packaging:ref: None 2024-04-16T14:22:24.949 INFO:teuthology.packaging:tag: None 2024-04-16T14:22:24.949 INFO:teuthology.packaging:branch: quincy 2024-04-16T14:22:24.949 INFO:teuthology.packaging:sha1: 36befe5d41ee8a6ea2e60983e763134278d506cf 2024-04-16T14:22:24.949 DEBUG:teuthology.orchestra.run.smithi115:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-16T14:22:24.991 DEBUG:teuthology.orchestra.run.smithi005:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-16T14:22:25.019 DEBUG:teuthology.orchestra.run.smithi115:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-16T14:22:25.074 DEBUG:teuthology.orchestra.run.smithi005:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-16T14:22:25.102 DEBUG:teuthology.orchestra.run.smithi115:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-16T14:22:25.142 INFO:teuthology.orchestra.run.smithi005.stdout:check_obsoletes = 1 2024-04-16T14:22:25.144 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum clean all 2024-04-16T14:22:25.171 INFO:teuthology.orchestra.run.smithi115.stdout:check_obsoletes = 1 2024-04-16T14:22:25.173 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum clean all 2024-04-16T14:22:25.397 INFO:teuthology.orchestra.run.smithi005.stdout:74 files removed 2024-04-16T14:22:25.412 INFO:teuthology.orchestra.run.smithi115.stdout:74 files removed 2024-04-16T14:22:25.427 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-radosgw 2024-04-16T14:22:25.439 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-radosgw 2024-04-16T14:22:26.132 INFO:teuthology.orchestra.run.smithi115.stdout:ceph packages for x86_64 197 kB/s | 77 kB 00:00 2024-04-16T14:22:26.202 INFO:teuthology.orchestra.run.smithi005.stdout:ceph packages for x86_64 166 kB/s | 77 kB 00:00 2024-04-16T14:22:26.516 INFO:teuthology.orchestra.run.smithi115.stdout:ceph noarch packages 32 kB/s | 11 kB 00:00 2024-04-16T14:22:26.527 INFO:teuthology.orchestra.run.smithi005.stdout:ceph noarch packages 39 kB/s | 11 kB 00:00 2024-04-16T14:22:26.853 INFO:teuthology.orchestra.run.smithi005.stdout:ceph source packages 6.3 kB/s | 1.8 kB 00:00 2024-04-16T14:22:26.892 INFO:teuthology.orchestra.run.smithi115.stdout:ceph source packages 5.3 kB/s | 1.8 kB 00:00 2024-04-16T14:22:27.378 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS-9 - AppStream 15 MB/s | 6.7 MB 00:00 2024-04-16T14:22:27.530 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS-9 - AppStream 10 MB/s | 6.7 MB 00:00 2024-04-16T14:22:28.780 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS-9 - BaseOS 7.1 MB/s | 2.0 MB 00:00 2024-04-16T14:22:28.989 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS-9 - BaseOS 7.4 MB/s | 2.0 MB 00:00 2024-04-16T14:22:29.612 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-04-16T14:22:31.055 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.0 MB 00:01 2024-04-16T14:22:33.056 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-04-16T14:22:34.279 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - AppStream 5.3 MB/s | 19 MB 00:03 2024-04-16T14:22:37.307 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - CRB 9.7 MB/s | 6.2 MB 00:00 2024-04-16T14:22:38.205 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.2 MB 00:00 2024-04-16T14:22:39.058 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 16 kB 00:00 2024-04-16T14:22:39.881 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 16 kB 00:00 2024-04-16T14:22:40.603 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-16T14:22:41.343 INFO:teuthology.orchestra.run.smithi115.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-16T14:22:45.818 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-04-16T14:22:46.390 INFO:teuthology.orchestra.run.smithi115.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-16T14:22:48.691 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-16T14:22:48.695 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:22:48.695 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-04-16T14:22:48.695 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:22:48.695 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-04-16T14:22:48.695 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw x86_64 2:17.2.7-868.g412a5526.el9 ceph 14 M 2024-04-16T14:22:48.695 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrading: 2024-04-16T14:22:48.695 INFO:teuthology.orchestra.run.smithi005.stdout: librados2 x86_64 2:17.2.7-868.g412a5526.el9 ceph 3.1 M 2024-04-16T14:22:48.695 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1 x86_64 2:17.2.7-868.g412a5526.el9 ceph 2.9 M 2024-04-16T14:22:48.695 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-04-16T14:22:48.695 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base x86_64 2:17.2.7-868.g412a5526.el9 ceph 5.0 M 2024-04-16T14:22:48.696 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common x86_64 2:17.2.7-868.g412a5526.el9 ceph 22 M 2024-04-16T14:22:48.696 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux x86_64 2:17.2.7-868.g412a5526.el9 ceph 25 k 2024-04-16T14:22:48.696 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-16T14:22:48.696 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2 x86_64 2:17.2.7-868.g412a5526.el9 ceph 637 k 2024-04-16T14:22:48.696 INFO:teuthology.orchestra.run.smithi005.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-16T14:22:48.696 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-16T14:22:48.696 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-16T14:22:48.696 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1 x86_64 2:17.2.7-868.g412a5526.el9 ceph 457 k 2024-04-16T14:22:48.696 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-16T14:22:48.696 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2 x86_64 2:17.2.7-868.g412a5526.el9 ceph 4.9 M 2024-04-16T14:22:48.696 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-16T14:22:48.696 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-16T14:22:48.696 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse x86_64 2:17.2.7-868.g412a5526.el9 ceph 45 k 2024-04-16T14:22:48.697 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common x86_64 2:17.2.7-868.g412a5526.el9 ceph 118 k 2024-04-16T14:22:48.697 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs x86_64 2:17.2.7-868.g412a5526.el9 ceph 156 k 2024-04-16T14:22:48.697 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-16T14:22:48.697 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados x86_64 2:17.2.7-868.g412a5526.el9 ceph 321 k 2024-04-16T14:22:48.697 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd x86_64 2:17.2.7-868.g412a5526.el9 ceph 292 k 2024-04-16T14:22:48.697 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw x86_64 2:17.2.7-868.g412a5526.el9 ceph 99 k 2024-04-16T14:22:48.697 INFO:teuthology.orchestra.run.smithi005.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-16T14:22:48.697 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:22:48.697 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-04-16T14:22:48.697 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:22:48.697 INFO:teuthology.orchestra.run.smithi005.stdout:Install 22 Packages 2024-04-16T14:22:48.697 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrade 2 Packages 2024-04-16T14:22:48.697 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:22:48.698 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 58 M 2024-04-16T14:22:48.698 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-04-16T14:22:49.178 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-16T14:22:49.184 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:22:49.184 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-04-16T14:22:49.185 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:22:49.185 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-04-16T14:22:49.185 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw x86_64 2:17.2.7-868.g412a5526.el9 ceph 14 M 2024-04-16T14:22:49.185 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrading: 2024-04-16T14:22:49.185 INFO:teuthology.orchestra.run.smithi115.stdout: librados2 x86_64 2:17.2.7-868.g412a5526.el9 ceph 3.1 M 2024-04-16T14:22:49.185 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1 x86_64 2:17.2.7-868.g412a5526.el9 ceph 2.9 M 2024-04-16T14:22:49.185 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-04-16T14:22:49.185 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base x86_64 2:17.2.7-868.g412a5526.el9 ceph 5.0 M 2024-04-16T14:22:49.185 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common x86_64 2:17.2.7-868.g412a5526.el9 ceph 22 M 2024-04-16T14:22:49.185 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux x86_64 2:17.2.7-868.g412a5526.el9 ceph 25 k 2024-04-16T14:22:49.185 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-16T14:22:49.185 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2 x86_64 2:17.2.7-868.g412a5526.el9 ceph 637 k 2024-04-16T14:22:49.185 INFO:teuthology.orchestra.run.smithi115.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-16T14:22:49.185 INFO:teuthology.orchestra.run.smithi115.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-16T14:22:49.186 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-16T14:22:49.186 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1 x86_64 2:17.2.7-868.g412a5526.el9 ceph 457 k 2024-04-16T14:22:49.186 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-16T14:22:49.186 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2 x86_64 2:17.2.7-868.g412a5526.el9 ceph 4.9 M 2024-04-16T14:22:49.186 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-16T14:22:49.186 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-16T14:22:49.186 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse x86_64 2:17.2.7-868.g412a5526.el9 ceph 45 k 2024-04-16T14:22:49.186 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common x86_64 2:17.2.7-868.g412a5526.el9 ceph 118 k 2024-04-16T14:22:49.186 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs x86_64 2:17.2.7-868.g412a5526.el9 ceph 156 k 2024-04-16T14:22:49.186 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-16T14:22:49.186 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados x86_64 2:17.2.7-868.g412a5526.el9 ceph 321 k 2024-04-16T14:22:49.186 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd x86_64 2:17.2.7-868.g412a5526.el9 ceph 292 k 2024-04-16T14:22:49.186 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw x86_64 2:17.2.7-868.g412a5526.el9 ceph 99 k 2024-04-16T14:22:49.186 INFO:teuthology.orchestra.run.smithi115.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-16T14:22:49.187 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:22:49.187 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-04-16T14:22:49.187 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:22:49.187 INFO:teuthology.orchestra.run.smithi115.stdout:Install 22 Packages 2024-04-16T14:22:49.187 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrade 2 Packages 2024-04-16T14:22:49.187 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:22:49.187 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 58 M 2024-04-16T14:22:49.187 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-04-16T14:22:49.702 INFO:teuthology.orchestra.run.smithi005.stdout:(1/24): ceph-base-17.2.7-868.g412a5526.el9.x86_ 5.8 MB/s | 5.0 MB 00:00 2024-04-16T14:22:49.753 INFO:teuthology.orchestra.run.smithi005.stdout:(2/24): ceph-selinux-17.2.7-868.g412a5526.el9.x 503 kB/s | 25 kB 00:00 2024-04-16T14:22:49.878 INFO:teuthology.orchestra.run.smithi005.stdout:(3/24): libcephfs2-17.2.7-868.g412a5526.el9.x86 5.0 MB/s | 637 kB 00:00 2024-04-16T14:22:50.022 INFO:teuthology.orchestra.run.smithi005.stdout:(4/24): libradosstriper1-17.2.7-868.g412a5526.e 3.1 MB/s | 457 kB 00:00 2024-04-16T14:22:50.845 INFO:teuthology.orchestra.run.smithi005.stdout:(5/24): ceph-radosgw-17.2.7-868.g412a5526.el9.x 7.0 MB/s | 14 MB 00:02 2024-04-16T14:22:50.912 INFO:teuthology.orchestra.run.smithi005.stdout:(6/24): librgw2-17.2.7-868.g412a5526.el9.x86_64 5.5 MB/s | 4.9 MB 00:00 2024-04-16T14:22:50.929 INFO:teuthology.orchestra.run.smithi005.stdout:(7/24): python3-ceph-argparse-17.2.7-868.g412a5 541 kB/s | 45 kB 00:00 2024-04-16T14:22:50.979 INFO:teuthology.orchestra.run.smithi005.stdout:(8/24): python3-ceph-common-17.2.7-868.g412a552 1.7 MB/s | 118 kB 00:00 2024-04-16T14:22:51.004 INFO:teuthology.orchestra.run.smithi005.stdout:(9/24): python3-cephfs-17.2.7-868.g412a5526.el9 2.0 MB/s | 156 kB 00:00 2024-04-16T14:22:51.063 INFO:teuthology.orchestra.run.smithi005.stdout:(10/24): python3-rados-17.2.7-868.g412a5526.el9 3.7 MB/s | 321 kB 00:00 2024-04-16T14:22:51.097 INFO:teuthology.orchestra.run.smithi005.stdout:(11/24): python3-rbd-17.2.7-868.g412a5526.el9.x 3.1 MB/s | 292 kB 00:00 2024-04-16T14:22:51.156 INFO:teuthology.orchestra.run.smithi005.stdout:(12/24): python3-rgw-17.2.7-868.g412a5526.el9.x 1.1 MB/s | 99 kB 00:00 2024-04-16T14:22:51.206 INFO:teuthology.orchestra.run.smithi005.stdout:(13/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 912 kB/s | 44 kB 00:00 2024-04-16T14:22:51.231 INFO:teuthology.orchestra.run.smithi005.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 159 kB 00:00 2024-04-16T14:22:51.273 INFO:teuthology.orchestra.run.smithi005.stdout:(15/24): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 661 kB 00:00 2024-04-16T14:22:51.307 INFO:teuthology.orchestra.run.smithi005.stdout:(16/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2024-04-16T14:22:51.332 INFO:teuthology.orchestra.run.smithi005.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 706 kB/s | 41 kB 00:00 2024-04-16T14:22:51.441 INFO:teuthology.orchestra.run.smithi005.stdout:(18/24): liboath-2.6.7-2.el9.x86_64.rpm 448 kB/s | 49 kB 00:00 2024-04-16T14:22:51.507 INFO:teuthology.orchestra.run.smithi005.stdout:(19/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.5 MB/s | 309 kB 00:00 2024-04-16T14:22:51.533 INFO:teuthology.orchestra.run.smithi005.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 733 kB/s | 67 kB 00:00 2024-04-16T14:22:51.742 INFO:teuthology.orchestra.run.smithi005.stdout:(21/24): ceph-common-17.2.7-868.g412a5526.el9.x 7.8 MB/s | 22 MB 00:02 2024-04-16T14:22:51.857 INFO:teuthology.orchestra.run.smithi115.stdout:(1/24): ceph-base-17.2.7-868.g412a5526.el9.x86_ 2.0 MB/s | 5.0 MB 00:02 2024-04-16T14:22:51.934 INFO:teuthology.orchestra.run.smithi005.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2024-04-16T14:22:51.965 INFO:teuthology.orchestra.run.smithi115.stdout:(2/24): ceph-selinux-17.2.7-868.g412a5526.el9.x 233 kB/s | 25 kB 00:00 2024-04-16T14:22:52.059 INFO:teuthology.orchestra.run.smithi005.stdout:(23/24): librados2-17.2.7-868.g412a5526.el9.x86 5.9 MB/s | 3.1 MB 00:00 2024-04-16T14:22:52.226 INFO:teuthology.orchestra.run.smithi005.stdout:(24/24): librbd1-17.2.7-868.g412a5526.el9.x86_6 6.1 MB/s | 2.9 MB 00:00 2024-04-16T14:22:52.229 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:22:52.229 INFO:teuthology.orchestra.run.smithi005.stdout:Total 16 MB/s | 58 MB 00:03 2024-04-16T14:22:52.230 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-04-16T14:22:52.240 INFO:teuthology.orchestra.run.smithi115.stdout:(3/24): libcephfs2-17.2.7-868.g412a5526.el9.x86 2.3 MB/s | 637 kB 00:00 2024-04-16T14:22:52.266 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-04-16T14:22:52.267 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-04-16T14:22:52.416 INFO:teuthology.orchestra.run.smithi115.stdout:(4/24): libradosstriper1-17.2.7-868.g412a5526.e 2.6 MB/s | 457 kB 00:00 2024-04-16T14:22:52.650 INFO:teuthology.orchestra.run.smithi115.stdout:(5/24): ceph-common-17.2.7-868.g412a5526.el9.x8 6.9 MB/s | 22 MB 00:03 2024-04-16T14:22:52.700 INFO:teuthology.orchestra.run.smithi115.stdout:(6/24): python3-ceph-argparse-17.2.7-868.g412a5 908 kB/s | 45 kB 00:00 2024-04-16T14:22:52.738 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-04-16T14:22:52.739 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-04-16T14:22:52.858 INFO:teuthology.orchestra.run.smithi115.stdout:(7/24): ceph-radosgw-17.2.7-868.g412a5526.el9.x 4.0 MB/s | 14 MB 00:03 2024-04-16T14:22:52.875 INFO:teuthology.orchestra.run.smithi115.stdout:(8/24): python3-ceph-common-17.2.7-868.g412a552 671 kB/s | 118 kB 00:00 2024-04-16T14:22:52.925 INFO:teuthology.orchestra.run.smithi115.stdout:(9/24): python3-cephfs-17.2.7-868.g412a5526.el9 2.3 MB/s | 156 kB 00:00 2024-04-16T14:22:52.959 INFO:teuthology.orchestra.run.smithi115.stdout:(10/24): python3-rados-17.2.7-868.g412a5526.el9 3.7 MB/s | 321 kB 00:00 2024-04-16T14:22:52.984 INFO:teuthology.orchestra.run.smithi115.stdout:(11/24): python3-rbd-17.2.7-868.g412a5526.el9.x 4.9 MB/s | 292 kB 00:00 2024-04-16T14:22:53.051 INFO:teuthology.orchestra.run.smithi115.stdout:(12/24): python3-rgw-17.2.7-868.g412a5526.el9.x 1.1 MB/s | 99 kB 00:00 2024-04-16T14:22:53.093 INFO:teuthology.orchestra.run.smithi115.stdout:(13/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 44 kB 00:00 2024-04-16T14:22:53.118 INFO:teuthology.orchestra.run.smithi115.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 159 kB 00:00 2024-04-16T14:22:53.161 INFO:teuthology.orchestra.run.smithi115.stdout:(15/24): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 661 kB 00:00 2024-04-16T14:22:53.186 INFO:teuthology.orchestra.run.smithi115.stdout:(16/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.2 MB/s | 282 kB 00:00 2024-04-16T14:22:53.202 INFO:teuthology.orchestra.run.smithi115.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 41 kB 00:00 2024-04-16T14:22:53.336 INFO:teuthology.orchestra.run.smithi115.stdout:(18/24): liboath-2.6.7-2.el9.x86_64.rpm 364 kB/s | 49 kB 00:00 2024-04-16T14:22:53.561 INFO:teuthology.orchestra.run.smithi115.stdout:(19/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 823 kB/s | 309 kB 00:00 2024-04-16T14:22:53.587 INFO:teuthology.orchestra.run.smithi115.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 269 kB/s | 67 kB 00:00 2024-04-16T14:22:53.670 INFO:teuthology.orchestra.run.smithi115.stdout:(21/24): librgw2-17.2.7-868.g412a5526.el9.x86_6 3.9 MB/s | 4.9 MB 00:01 2024-04-16T14:22:53.770 INFO:teuthology.orchestra.run.smithi115.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 7.6 MB/s | 1.6 MB 00:00 2024-04-16T14:22:53.871 INFO:teuthology.orchestra.run.smithi115.stdout:(23/24): librados2-17.2.7-868.g412a5526.el9.x86 11 MB/s | 3.1 MB 00:00 2024-04-16T14:22:54.008 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-04-16T14:22:54.213 INFO:teuthology.orchestra.run.smithi115.stdout:(24/24): librbd1-17.2.7-868.g412a5526.el9.x86_6 5.4 MB/s | 2.9 MB 00:00 2024-04-16T14:22:54.216 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:22:54.216 INFO:teuthology.orchestra.run.smithi115.stdout:Total 11 MB/s | 58 MB 00:05 2024-04-16T14:22:54.216 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-04-16T14:22:54.250 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-04-16T14:22:54.250 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-04-16T14:22:54.354 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-04-16T14:22:54.403 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librados2-2:17.2.7-868.g412a5526.el9.x86_64 2/26 2024-04-16T14:22:54.496 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:17.2.7-868.g412a5526.el9.x86_64 2/26 2024-04-16T14:22:54.576 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rados-2:17.2.7-868.g412a5526.el9.x86_64 3/26 2024-04-16T14:22:54.613 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs2-2:17.2.7-868.g412a5526.el9.x86_64 4/26 2024-04-16T14:22:54.684 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephfs2-2:17.2.7-868.g412a5526.el9.x86_64 4/26 2024-04-16T14:22:54.712 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-04-16T14:22:54.712 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-04-16T14:22:54.739 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-04-16T14:22:54.767 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-04-16T14:22:55.224 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-04-16T14:22:55.249 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librgw2-2:17.2.7-868.g412a5526.el9.x86_64 8/26 2024-04-16T14:22:55.297 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librgw2-2:17.2.7-868.g412a5526.el9.x86_64 8/26 2024-04-16T14:22:55.332 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-04-16T14:22:55.376 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-argparse-2:17.2.7-868.g412a5526.el9.x 10/26 2024-04-16T14:22:55.421 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cephfs-2:17.2.7-868.g412a5526.el9.x86_64 11/26 2024-04-16T14:22:55.493 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rgw-2:17.2.7-868.g412a5526.el9.x86_64 12/26 2024-04-16T14:22:55.518 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libradosstriper1-2:17.2.7-868.g412a5526.el9.x86_64 13/26 2024-04-16T14:22:55.585 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libradosstriper1-2:17.2.7-868.g412a5526.el9.x86_64 13/26 2024-04-16T14:22:55.631 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-04-16T14:22:55.668 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-04-16T14:22:55.701 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-04-16T14:22:55.938 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-04-16T14:22:56.011 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-04-16T14:22:56.056 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librbd1-2:17.2.7-868.g412a5526.el9.x86_64 18/26 2024-04-16T14:22:56.129 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:17.2.7-868.g412a5526.el9.x86_64 18/26 2024-04-16T14:22:56.204 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rbd-2:17.2.7-868.g412a5526.el9.x86_64 19/26 2024-04-16T14:22:56.233 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-common-2:17.2.7-868.g412a5526.el9.x86 20/26 2024-04-16T14:22:56.282 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-04-16T14:22:56.341 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librados2-2:17.2.7-868.g412a5526.el9.x86_64 2/26 2024-04-16T14:22:56.439 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-2:17.2.7-868.g412a5526.el9.x86_64 2/26 2024-04-16T14:22:56.518 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rados-2:17.2.7-868.g412a5526.el9.x86_64 3/26 2024-04-16T14:22:56.549 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs2-2:17.2.7-868.g412a5526.el9.x86_64 4/26 2024-04-16T14:22:56.638 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephfs2-2:17.2.7-868.g412a5526.el9.x86_64 4/26 2024-04-16T14:22:56.692 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-04-16T14:22:56.729 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-04-16T14:22:57.160 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-04-16T14:22:57.185 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librgw2-2:17.2.7-868.g412a5526.el9.x86_64 8/26 2024-04-16T14:22:57.239 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librgw2-2:17.2.7-868.g412a5526.el9.x86_64 8/26 2024-04-16T14:22:57.268 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-04-16T14:22:57.311 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-argparse-2:17.2.7-868.g412a5526.el9.x 10/26 2024-04-16T14:22:57.350 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cephfs-2:17.2.7-868.g412a5526.el9.x86_64 11/26 2024-04-16T14:22:57.410 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rgw-2:17.2.7-868.g412a5526.el9.x86_64 12/26 2024-04-16T14:22:57.430 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libradosstriper1-2:17.2.7-868.g412a5526.el9.x86_64 13/26 2024-04-16T14:22:57.487 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libradosstriper1-2:17.2.7-868.g412a5526.el9.x86_64 13/26 2024-04-16T14:22:57.538 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-04-16T14:22:57.571 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-04-16T14:22:57.604 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-04-16T14:22:57.899 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-04-16T14:22:57.925 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librbd1-2:17.2.7-868.g412a5526.el9.x86_64 18/26 2024-04-16T14:22:58.015 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-2:17.2.7-868.g412a5526.el9.x86_64 18/26 2024-04-16T14:22:58.088 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rbd-2:17.2.7-868.g412a5526.el9.x86_64 19/26 2024-04-16T14:22:58.119 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-common-2:17.2.7-868.g412a5526.el9.x86 20/26 2024-04-16T14:22:58.706 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:17.2.7-868.g412a5526.el9.x86_64 21/26 2024-04-16T14:22:58.763 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-common-2:17.2.7-868.g412a5526.el9.x86_64 21/26 2024-04-16T14:22:59.311 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:17.2.7-868.g412a5526.el9.x86_64 21/26 2024-04-16T14:22:59.350 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-base-2:17.2.7-868.g412a5526.el9.x86_64 22/26 2024-04-16T14:22:59.433 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-base-2:17.2.7-868.g412a5526.el9.x86_64 22/26 2024-04-16T14:22:59.433 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-16T14:22:59.433 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-16T14:22:59.433 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:22:59.468 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-selinux-2:17.2.7-868.g412a5526.el9.x86_64 23/26 2024-04-16T14:23:00.546 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:17.2.7-868.g412a5526.el9.x86_64 21/26 2024-04-16T14:23:00.582 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-common-2:17.2.7-868.g412a5526.el9.x86_64 21/26 2024-04-16T14:23:01.111 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:17.2.7-868.g412a5526.el9.x86_64 21/26 2024-04-16T14:23:01.143 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-base-2:17.2.7-868.g412a5526.el9.x86_64 22/26 2024-04-16T14:23:01.231 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-base-2:17.2.7-868.g412a5526.el9.x86_64 22/26 2024-04-16T14:23:01.232 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-16T14:23:01.232 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-16T14:23:01.232 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:01.261 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-selinux-2:17.2.7-868.g412a5526.el9.x86_64 23/26 2024-04-16T14:23:09.653 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-selinux-2:17.2.7-868.g412a5526.el9.x86_64 23/26 2024-04-16T14:23:09.653 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /sys 2024-04-16T14:23:09.653 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /proc 2024-04-16T14:23:09.653 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /mnt 2024-04-16T14:23:09.653 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /var/tmp 2024-04-16T14:23:09.653 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /home 2024-04-16T14:23:09.653 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /root 2024-04-16T14:23:09.653 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /tmp 2024-04-16T14:23:09.653 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:10.931 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-selinux-2:17.2.7-868.g412a5526.el9.x86_64 23/26 2024-04-16T14:23:10.931 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /sys 2024-04-16T14:23:10.931 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /proc 2024-04-16T14:23:10.931 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /mnt 2024-04-16T14:23:10.931 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /var/tmp 2024-04-16T14:23:10.932 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /home 2024-04-16T14:23:10.932 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /root 2024-04-16T14:23:10.932 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /tmp 2024-04-16T14:23:10.932 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:10.973 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-radosgw-2:17.2.7-868.g412a5526.el9.x86_64 24/26 2024-04-16T14:23:11.043 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-868.g412a5526.el9.x86_64 24/26 2024-04-16T14:23:11.044 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T14:23:11.044 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-16T14:23:11.044 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T14:23:11.044 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T14:23:11.044 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:11.045 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-16T14:23:11.126 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-16T14:23:11.127 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-16T14:23:12.175 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-radosgw-2:17.2.7-868.g412a5526.el9.x86_64 24/26 2024-04-16T14:23:12.250 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-868.g412a5526.el9.x86_64 24/26 2024-04-16T14:23:12.250 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T14:23:12.250 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-16T14:23:12.250 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T14:23:12.250 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T14:23:12.251 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:12.252 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-16T14:23:12.354 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-16T14:23:12.354 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-16T14:23:12.411 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-16T14:23:12.411 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-base-2:17.2.7-868.g412a5526.el9.x86_64 1/26 2024-04-16T14:23:12.411 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-common-2:17.2.7-868.g412a5526.el9.x86_64 2/26 2024-04-16T14:23:12.411 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-radosgw-2:17.2.7-868.g412a5526.el9.x86_64 3/26 2024-04-16T14:23:12.411 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-selinux-2:17.2.7-868.g412a5526.el9.x86_64 4/26 2024-04-16T14:23:12.412 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs2-2:17.2.7-868.g412a5526.el9.x86_64 5/26 2024-04-16T14:23:12.412 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libradosstriper1-2:17.2.7-868.g412a5526.el9.x86_64 6/26 2024-04-16T14:23:12.412 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librgw2-2:17.2.7-868.g412a5526.el9.x86_64 7/26 2024-04-16T14:23:12.412 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-argparse-2:17.2.7-868.g412a5526.el9.x 8/26 2024-04-16T14:23:12.412 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-common-2:17.2.7-868.g412a5526.el9.x86 9/26 2024-04-16T14:23:12.412 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cephfs-2:17.2.7-868.g412a5526.el9.x86_64 10/26 2024-04-16T14:23:12.413 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rados-2:17.2.7-868.g412a5526.el9.x86_64 11/26 2024-04-16T14:23:12.413 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rbd-2:17.2.7-868.g412a5526.el9.x86_64 12/26 2024-04-16T14:23:12.413 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rgw-2:17.2.7-868.g412a5526.el9.x86_64 13/26 2024-04-16T14:23:12.413 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-04-16T14:23:12.413 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-04-16T14:23:12.414 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-04-16T14:23:12.414 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-04-16T14:23:12.414 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-04-16T14:23:12.414 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-04-16T14:23:12.414 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-04-16T14:23:12.415 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-04-16T14:23:12.415 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-04-16T14:23:12.415 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:17.2.7-868.g412a5526.el9.x86_64 23/26 2024-04-16T14:23:12.415 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-04-16T14:23:12.415 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:17.2.7-868.g412a5526.el9.x86_64 25/26 2024-04-16T14:23:13.447 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-04-16T14:23:13.447 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:13.447 INFO:teuthology.orchestra.run.smithi005.stdout:Upgraded: 2024-04-16T14:23:13.447 INFO:teuthology.orchestra.run.smithi005.stdout: librados2-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:13.447 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:13.447 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-04-16T14:23:13.447 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:13.447 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:13.447 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:13.447 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:13.448 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-16T14:23:13.448 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:13.448 INFO:teuthology.orchestra.run.smithi005.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-16T14:23:13.448 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-16T14:23:13.448 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-16T14:23:13.448 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:13.448 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-16T14:23:13.448 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:13.448 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-16T14:23:13.448 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-16T14:23:13.448 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:13.448 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:13.448 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:13.448 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-16T14:23:13.449 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:13.449 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:13.449 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:13.449 INFO:teuthology.orchestra.run.smithi005.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-16T14:23:13.449 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:13.449 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-16T14:23:13.546 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-16T14:23:13.546 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-base-2:17.2.7-868.g412a5526.el9.x86_64 1/26 2024-04-16T14:23:13.546 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-common-2:17.2.7-868.g412a5526.el9.x86_64 2/26 2024-04-16T14:23:13.546 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-radosgw-2:17.2.7-868.g412a5526.el9.x86_64 3/26 2024-04-16T14:23:13.546 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-selinux-2:17.2.7-868.g412a5526.el9.x86_64 4/26 2024-04-16T14:23:13.546 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs2-2:17.2.7-868.g412a5526.el9.x86_64 5/26 2024-04-16T14:23:13.546 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libradosstriper1-2:17.2.7-868.g412a5526.el9.x86_64 6/26 2024-04-16T14:23:13.546 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librgw2-2:17.2.7-868.g412a5526.el9.x86_64 7/26 2024-04-16T14:23:13.546 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-argparse-2:17.2.7-868.g412a5526.el9.x 8/26 2024-04-16T14:23:13.546 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-common-2:17.2.7-868.g412a5526.el9.x86 9/26 2024-04-16T14:23:13.546 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cephfs-2:17.2.7-868.g412a5526.el9.x86_64 10/26 2024-04-16T14:23:13.546 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rados-2:17.2.7-868.g412a5526.el9.x86_64 11/26 2024-04-16T14:23:13.547 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rbd-2:17.2.7-868.g412a5526.el9.x86_64 12/26 2024-04-16T14:23:13.547 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rgw-2:17.2.7-868.g412a5526.el9.x86_64 13/26 2024-04-16T14:23:13.547 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-04-16T14:23:13.547 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-04-16T14:23:13.547 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-04-16T14:23:13.547 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-04-16T14:23:13.547 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-04-16T14:23:13.547 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-04-16T14:23:13.547 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-04-16T14:23:13.547 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-04-16T14:23:13.547 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-04-16T14:23:13.547 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-2:17.2.7-868.g412a5526.el9.x86_64 23/26 2024-04-16T14:23:13.547 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-04-16T14:23:13.547 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-2:17.2.7-868.g412a5526.el9.x86_64 25/26 2024-04-16T14:23:13.790 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-test 2024-04-16T14:23:14.384 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:29 ago on Tue 16 Apr 2024 02:22:45 PM UTC. 2024-04-16T14:23:14.468 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-04-16T14:23:14.468 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:14.468 INFO:teuthology.orchestra.run.smithi115.stdout:Upgraded: 2024-04-16T14:23:14.468 INFO:teuthology.orchestra.run.smithi115.stdout: librados2-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:14.468 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:14.469 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-04-16T14:23:14.469 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:14.469 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:14.469 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:14.469 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:14.469 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-16T14:23:14.469 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:14.469 INFO:teuthology.orchestra.run.smithi115.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-16T14:23:14.469 INFO:teuthology.orchestra.run.smithi115.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-16T14:23:14.469 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-16T14:23:14.469 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:14.469 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-16T14:23:14.469 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:14.469 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-16T14:23:14.470 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-16T14:23:14.470 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:14.470 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:14.470 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:14.470 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-16T14:23:14.470 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:14.470 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:14.470 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:14.470 INFO:teuthology.orchestra.run.smithi115.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-16T14:23:14.470 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:14.470 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-16T14:23:14.545 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-16T14:23:14.546 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:23:14.546 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-04-16T14:23:14.546 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:23:14.546 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-04-16T14:23:14.546 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test x86_64 2:17.2.7-868.g412a5526.el9 ceph 48 M 2024-04-16T14:23:14.546 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-04-16T14:23:14.547 INFO:teuthology.orchestra.run.smithi005.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-16T14:23:14.547 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite x86_64 2:17.2.7-868.g412a5526.el9 ceph 163 k 2024-04-16T14:23:14.547 INFO:teuthology.orchestra.run.smithi005.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-16T14:23:14.547 INFO:teuthology.orchestra.run.smithi005.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-16T14:23:14.547 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-16T14:23:14.547 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:14.547 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-04-16T14:23:14.547 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:23:14.547 INFO:teuthology.orchestra.run.smithi005.stdout:Install 6 Packages 2024-04-16T14:23:14.547 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:14.548 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 49 M 2024-04-16T14:23:14.548 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 193 M 2024-04-16T14:23:14.548 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-04-16T14:23:14.851 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-test 2024-04-16T14:23:15.040 INFO:teuthology.orchestra.run.smithi005.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 946 kB/s | 217 kB 00:00 2024-04-16T14:23:15.124 INFO:teuthology.orchestra.run.smithi005.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 3.5 MB/s | 300 kB 00:00 2024-04-16T14:23:15.174 INFO:teuthology.orchestra.run.smithi005.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-04-16T14:23:15.291 INFO:teuthology.orchestra.run.smithi005.stdout:(4/6): libcephsqlite-17.2.7-868.g412a5526.el9.x 339 kB/s | 163 kB 00:00 2024-04-16T14:23:15.316 INFO:teuthology.orchestra.run.smithi005.stdout:(5/6): jq-1.6-16.el9.x86_64.rpm 1.3 MB/s | 187 kB 00:00 2024-04-16T14:23:15.433 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:00:29 ago on Tue 16 Apr 2024 02:22:46 PM UTC. 2024-04-16T14:23:15.589 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-16T14:23:15.589 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:23:15.589 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-04-16T14:23:15.590 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:23:15.590 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-04-16T14:23:15.590 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test x86_64 2:17.2.7-868.g412a5526.el9 ceph 48 M 2024-04-16T14:23:15.590 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-04-16T14:23:15.590 INFO:teuthology.orchestra.run.smithi115.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-16T14:23:15.590 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite x86_64 2:17.2.7-868.g412a5526.el9 ceph 163 k 2024-04-16T14:23:15.590 INFO:teuthology.orchestra.run.smithi115.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-16T14:23:15.590 INFO:teuthology.orchestra.run.smithi115.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-16T14:23:15.590 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-16T14:23:15.590 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:15.590 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-04-16T14:23:15.590 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:23:15.590 INFO:teuthology.orchestra.run.smithi115.stdout:Install 6 Packages 2024-04-16T14:23:15.591 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:15.591 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 49 M 2024-04-16T14:23:15.591 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 193 M 2024-04-16T14:23:15.591 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-04-16T14:23:15.884 INFO:teuthology.orchestra.run.smithi115.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.4 MB/s | 217 kB 00:00 2024-04-16T14:23:15.934 INFO:teuthology.orchestra.run.smithi115.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 300 kB 00:00 2024-04-16T14:23:15.967 INFO:teuthology.orchestra.run.smithi115.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 63 kB 00:00 2024-04-16T14:23:16.034 INFO:teuthology.orchestra.run.smithi115.stdout:(4/6): libcephsqlite-17.2.7-868.g412a5526.el9.x 542 kB/s | 163 kB 00:00 2024-04-16T14:23:16.143 INFO:teuthology.orchestra.run.smithi115.stdout:(5/6): jq-1.6-16.el9.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2024-04-16T14:23:17.658 INFO:teuthology.orchestra.run.smithi005.stdout:(6/6): ceph-test-17.2.7-868.g412a5526.el9.x86_6 17 MB/s | 48 MB 00:02 2024-04-16T14:23:17.661 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:23:17.661 INFO:teuthology.orchestra.run.smithi005.stdout:Total 16 MB/s | 49 MB 00:03 2024-04-16T14:23:17.676 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-04-16T14:23:17.698 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-04-16T14:23:17.698 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-04-16T14:23:18.101 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-04-16T14:23:18.101 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-04-16T14:23:18.697 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-04-16T14:23:18.785 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-04-16T14:23:18.836 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-04-16T14:23:18.876 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-16T14:23:18.918 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-04-16T14:23:18.945 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephsqlite-2:17.2.7-868.g412a5526.el9.x86_64 5/6 2024-04-16T14:23:20.251 INFO:teuthology.orchestra.run.smithi115.stdout:(6/6): ceph-test-17.2.7-868.g412a5526.el9.x86_6 11 MB/s | 48 MB 00:04 2024-04-16T14:23:20.254 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:23:20.254 INFO:teuthology.orchestra.run.smithi115.stdout:Total 10 MB/s | 49 MB 00:04 2024-04-16T14:23:20.269 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-04-16T14:23:20.289 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-04-16T14:23:20.289 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-04-16T14:23:20.676 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-04-16T14:23:20.676 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-04-16T14:23:21.259 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-04-16T14:23:21.326 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-04-16T14:23:21.368 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-04-16T14:23:21.402 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-16T14:23:21.443 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-04-16T14:23:21.470 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephsqlite-2:17.2.7-868.g412a5526.el9.x86_64 5/6 2024-04-16T14:23:23.583 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephsqlite-2:17.2.7-868.g412a5526.el9.x86_64 5/6 2024-04-16T14:23:23.664 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-test-2:17.2.7-868.g412a5526.el9.x86_64 6/6 2024-04-16T14:23:25.978 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-test-2:17.2.7-868.g412a5526.el9.x86_64 6/6 2024-04-16T14:23:25.978 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-test-2:17.2.7-868.g412a5526.el9.x86_64 1/6 2024-04-16T14:23:25.978 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephsqlite-2:17.2.7-868.g412a5526.el9.x86_64 2/6 2024-04-16T14:23:25.978 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-16T14:23:25.979 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-04-16T14:23:25.979 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-04-16T14:23:25.991 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephsqlite-2:17.2.7-868.g412a5526.el9.x86_64 5/6 2024-04-16T14:23:26.069 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-test-2:17.2.7-868.g412a5526.el9.x86_64 6/6 2024-04-16T14:23:26.351 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-04-16T14:23:26.351 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:26.351 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-04-16T14:23:26.351 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:26.351 INFO:teuthology.orchestra.run.smithi005.stdout: jq-1.6-16.el9.x86_64 2024-04-16T14:23:26.351 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:26.351 INFO:teuthology.orchestra.run.smithi005.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-16T14:23:26.351 INFO:teuthology.orchestra.run.smithi005.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-16T14:23:26.352 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-16T14:23:26.352 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:26.352 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-16T14:23:26.674 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph 2024-04-16T14:23:27.284 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:42 ago on Tue 16 Apr 2024 02:22:45 PM UTC. 2024-04-16T14:23:27.450 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-16T14:23:27.454 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================== 2024-04-16T14:23:27.454 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-04-16T14:23:27.454 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================== 2024-04-16T14:23:27.454 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-04-16T14:23:27.454 INFO:teuthology.orchestra.run.smithi005.stdout: ceph x86_64 2:17.2.7-868.g412a5526.el9 ceph 6.5 k 2024-04-16T14:23:27.454 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-04-16T14:23:27.455 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds x86_64 2:17.2.7-868.g412a5526.el9 ceph 2.1 M 2024-04-16T14:23:27.455 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr x86_64 2:17.2.7-868.g412a5526.el9 ceph 1.4 M 2024-04-16T14:23:27.455 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core noarch 2:17.2.7-868.g412a5526.el9 ceph-noarch 240 k 2024-04-16T14:23:27.455 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon x86_64 2:17.2.7-868.g412a5526.el9 ceph 3.9 M 2024-04-16T14:23:27.455 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd x86_64 2:17.2.7-868.g412a5526.el9 ceph 15 M 2024-04-16T14:23:27.455 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-16T14:23:27.455 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-16T14:23:27.455 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-16T14:23:27.455 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-16T14:23:27.455 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-16T14:23:27.455 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-16T14:23:27.456 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-16T14:23:27.456 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-16T14:23:27.456 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-16T14:23:27.456 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-16T14:23:27.456 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-16T14:23:27.456 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-16T14:23:27.457 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-16T14:23:27.457 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-16T14:23:27.457 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-16T14:23:27.457 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-16T14:23:27.457 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-16T14:23:27.457 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-16T14:23:27.457 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-16T14:23:27.457 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-16T14:23:27.457 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-16T14:23:27.457 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-16T14:23:27.458 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-16T14:23:27.458 INFO:teuthology.orchestra.run.smithi005.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-16T14:23:27.458 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-16T14:23:27.458 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-16T14:23:27.458 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-16T14:23:27.458 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:27.458 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-04-16T14:23:27.458 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================== 2024-04-16T14:23:27.458 INFO:teuthology.orchestra.run.smithi005.stdout:Install 33 Packages 2024-04-16T14:23:27.458 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:27.458 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 27 M 2024-04-16T14:23:27.458 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 96 M 2024-04-16T14:23:27.458 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-04-16T14:23:28.286 INFO:teuthology.orchestra.run.smithi005.stdout:(1/33): ceph-17.2.7-868.g412a5526.el9.x86_64.rp 33 kB/s | 6.5 kB 00:00 2024-04-16T14:23:28.380 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-test-2:17.2.7-868.g412a5526.el9.x86_64 6/6 2024-04-16T14:23:28.380 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-test-2:17.2.7-868.g412a5526.el9.x86_64 1/6 2024-04-16T14:23:28.380 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephsqlite-2:17.2.7-868.g412a5526.el9.x86_64 2/6 2024-04-16T14:23:28.380 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-16T14:23:28.380 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-04-16T14:23:28.381 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-04-16T14:23:28.461 INFO:teuthology.orchestra.run.smithi005.stdout:(2/33): ceph-mds-17.2.7-868.g412a5526.el9.x86_6 5.6 MB/s | 2.1 MB 00:00 2024-04-16T14:23:28.768 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-04-16T14:23:28.768 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:28.769 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-04-16T14:23:28.769 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:28.769 INFO:teuthology.orchestra.run.smithi115.stdout: jq-1.6-16.el9.x86_64 2024-04-16T14:23:28.770 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:28.770 INFO:teuthology.orchestra.run.smithi115.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-16T14:23:28.770 INFO:teuthology.orchestra.run.smithi115.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-16T14:23:28.771 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-16T14:23:28.771 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:28.771 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-16T14:23:29.068 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph 2024-04-16T14:23:29.167 INFO:teuthology.orchestra.run.smithi005.stdout:(3/33): ceph-mgr-17.2.7-868.g412a5526.el9.x86_6 1.4 MB/s | 1.4 MB 00:00 2024-04-16T14:23:29.303 INFO:teuthology.orchestra.run.smithi005.stdout:(4/33): ceph-osd-17.2.7-868.g412a5526.el9.x86_6 18 MB/s | 15 MB 00:00 2024-04-16T14:23:29.328 INFO:teuthology.orchestra.run.smithi005.stdout:(5/33): ceph-mgr-modules-core-17.2.7-868.g412a5 929 kB/s | 240 kB 00:00 2024-04-16T14:23:29.412 INFO:teuthology.orchestra.run.smithi005.stdout:(6/33): ceph-mon-17.2.7-868.g412a5526.el9.x86_6 3.5 MB/s | 3.9 MB 00:01 2024-04-16T14:23:29.487 INFO:teuthology.orchestra.run.smithi005.stdout:(7/33): python3-mako-1.1.4-6.el9.noarch.rpm 785 kB/s | 144 kB 00:00 2024-04-16T14:23:29.504 INFO:teuthology.orchestra.run.smithi005.stdout:(8/33): python3-markupsafe-1.1.1-12.el9.x86_64. 210 kB/s | 32 kB 00:00 2024-04-16T14:23:29.521 INFO:teuthology.orchestra.run.smithi005.stdout:(9/33): python3-pytz-2021.1-5.el9.noarch.rpm 567 kB/s | 47 kB 00:00 2024-04-16T14:23:29.538 INFO:teuthology.orchestra.run.smithi005.stdout:(10/33): python3-toml-0.10.2-6.el9.noarch.rpm 767 kB/s | 39 kB 00:00 2024-04-16T14:23:29.580 INFO:teuthology.orchestra.run.smithi005.stdout:(11/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.0 MB/s | 241 kB 00:00 2024-04-16T14:23:29.699 INFO:teuthology.orchestra.run.smithi005.stdout:(12/33): python3-cryptography-36.0.1-4.el9.x86_ 6.5 MB/s | 1.1 MB 00:00 2024-04-16T14:23:29.724 INFO:teuthology.orchestra.run.smithi005.stdout:(13/33): python3-ply-3.11-14.el9.noarch.rpm 553 kB/s | 103 kB 00:00 2024-04-16T14:23:29.749 INFO:teuthology.orchestra.run.smithi005.stdout:(14/33): python3-pycparser-2.20-6.el9.noarch.rp 733 kB/s | 124 kB 00:00 2024-04-16T14:23:29.775 INFO:teuthology.orchestra.run.smithi005.stdout:(15/33): python3-urllib3-1.26.5-5.el9.noarch.rp 2.4 MB/s | 187 kB 00:00 2024-04-16T14:23:29.788 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:00:43 ago on Tue 16 Apr 2024 02:22:46 PM UTC. 2024-04-16T14:23:29.956 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-16T14:23:29.958 INFO:teuthology.orchestra.run.smithi005.stdout:(16/33): python3-requests-2.25.1-8.el9.noarch.r 600 kB/s | 125 kB 00:00 2024-04-16T14:23:29.958 INFO:teuthology.orchestra.run.smithi115.stdout:======================================================================================== 2024-04-16T14:23:29.958 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-04-16T14:23:29.959 INFO:teuthology.orchestra.run.smithi115.stdout:======================================================================================== 2024-04-16T14:23:29.959 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-04-16T14:23:29.959 INFO:teuthology.orchestra.run.smithi115.stdout: ceph x86_64 2:17.2.7-868.g412a5526.el9 ceph 6.5 k 2024-04-16T14:23:29.959 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-04-16T14:23:29.959 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds x86_64 2:17.2.7-868.g412a5526.el9 ceph 2.1 M 2024-04-16T14:23:29.959 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr x86_64 2:17.2.7-868.g412a5526.el9 ceph 1.4 M 2024-04-16T14:23:29.959 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core noarch 2:17.2.7-868.g412a5526.el9 ceph-noarch 240 k 2024-04-16T14:23:29.959 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon x86_64 2:17.2.7-868.g412a5526.el9 ceph 3.9 M 2024-04-16T14:23:29.959 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd x86_64 2:17.2.7-868.g412a5526.el9 ceph 15 M 2024-04-16T14:23:29.959 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-16T14:23:29.959 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-16T14:23:29.959 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-16T14:23:29.959 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-16T14:23:29.960 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-16T14:23:29.960 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-16T14:23:29.960 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-16T14:23:29.960 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-16T14:23:29.960 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-16T14:23:29.960 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-16T14:23:29.960 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-16T14:23:29.960 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-16T14:23:29.960 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-16T14:23:29.960 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-16T14:23:29.960 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-16T14:23:29.961 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-16T14:23:29.961 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-16T14:23:29.961 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-16T14:23:29.961 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-16T14:23:29.961 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-16T14:23:29.961 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-16T14:23:29.961 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-16T14:23:29.961 INFO:teuthology.orchestra.run.smithi115.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-16T14:23:29.961 INFO:teuthology.orchestra.run.smithi115.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-16T14:23:29.961 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-16T14:23:29.961 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-16T14:23:29.961 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-16T14:23:29.961 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:29.961 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-04-16T14:23:29.961 INFO:teuthology.orchestra.run.smithi115.stdout:======================================================================================== 2024-04-16T14:23:29.962 INFO:teuthology.orchestra.run.smithi115.stdout:Install 33 Packages 2024-04-16T14:23:29.962 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:29.962 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 27 M 2024-04-16T14:23:29.962 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 96 M 2024-04-16T14:23:29.962 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-04-16T14:23:30.034 INFO:teuthology.orchestra.run.smithi005.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 153 kB/s | 43 kB 00:00 2024-04-16T14:23:30.059 INFO:teuthology.orchestra.run.smithi005.stdout:(18/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 605 kB/s | 172 kB 00:00 2024-04-16T14:23:30.084 INFO:teuthology.orchestra.run.smithi005.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 217 kB/s | 11 kB 00:00 2024-04-16T14:23:30.109 INFO:teuthology.orchestra.run.smithi005.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 353 kB/s | 18 kB 00:00 2024-04-16T14:23:30.134 INFO:teuthology.orchestra.run.smithi005.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-04-16T14:23:30.160 INFO:teuthology.orchestra.run.smithi005.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-04-16T14:23:30.185 INFO:teuthology.orchestra.run.smithi005.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 390 kB/s | 20 kB 00:00 2024-04-16T14:23:30.219 INFO:teuthology.orchestra.run.smithi005.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 792 kB/s | 46 kB 00:00 2024-04-16T14:23:30.244 INFO:teuthology.orchestra.run.smithi005.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.3 MB/s | 79 kB 00:00 2024-04-16T14:23:30.269 INFO:teuthology.orchestra.run.smithi005.stdout:(26/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.1 MB/s | 358 kB 00:00 2024-04-16T14:23:30.294 INFO:teuthology.orchestra.run.smithi005.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 329 kB/s | 16 kB 00:00 2024-04-16T14:23:30.320 INFO:teuthology.orchestra.run.smithi005.stdout:(28/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-04-16T14:23:30.344 INFO:teuthology.orchestra.run.smithi115.stdout:(1/33): ceph-17.2.7-868.g412a5526.el9.x86_64.rp 37 kB/s | 6.5 kB 00:00 2024-04-16T14:23:30.345 INFO:teuthology.orchestra.run.smithi005.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-04-16T14:23:30.370 INFO:teuthology.orchestra.run.smithi005.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 473 kB/s | 36 kB 00:00 2024-04-16T14:23:30.404 INFO:teuthology.orchestra.run.smithi005.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-04-16T14:23:30.429 INFO:teuthology.orchestra.run.smithi005.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 342 kB/s | 20 kB 00:00 2024-04-16T14:23:30.479 INFO:teuthology.orchestra.run.smithi005.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.1 MB/s | 427 kB 00:00 2024-04-16T14:23:30.485 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:23:30.485 INFO:teuthology.orchestra.run.smithi005.stdout:Total 8.9 MB/s | 27 MB 00:03 2024-04-16T14:23:30.498 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-04-16T14:23:30.536 INFO:teuthology.orchestra.run.smithi115.stdout:(2/33): ceph-mds-17.2.7-868.g412a5526.el9.x86_6 5.6 MB/s | 2.1 MB 00:00 2024-04-16T14:23:30.538 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-04-16T14:23:30.538 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-04-16T14:23:30.896 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-04-16T14:23:30.897 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-04-16T14:23:31.153 INFO:teuthology.orchestra.run.smithi115.stdout:(3/33): ceph-mgr-17.2.7-868.g412a5526.el9.x86_6 1.4 MB/s | 1.4 MB 00:00 2024-04-16T14:23:31.328 INFO:teuthology.orchestra.run.smithi115.stdout:(4/33): ceph-osd-17.2.7-868.g412a5526.el9.x86_6 19 MB/s | 15 MB 00:00 2024-04-16T14:23:31.353 INFO:teuthology.orchestra.run.smithi115.stdout:(5/33): ceph-mgr-modules-core-17.2.7-868.g412a5 1.2 MB/s | 240 kB 00:00 2024-04-16T14:23:31.437 INFO:teuthology.orchestra.run.smithi115.stdout:(6/33): ceph-mon-17.2.7-868.g412a5526.el9.x86_6 3.6 MB/s | 3.9 MB 00:01 2024-04-16T14:23:31.529 INFO:teuthology.orchestra.run.smithi115.stdout:(7/33): python3-mako-1.1.4-6.el9.noarch.rpm 720 kB/s | 144 kB 00:00 2024-04-16T14:23:31.546 INFO:teuthology.orchestra.run.smithi115.stdout:(8/33): python3-markupsafe-1.1.1-12.el9.x86_64. 187 kB/s | 32 kB 00:00 2024-04-16T14:23:31.563 INFO:teuthology.orchestra.run.smithi115.stdout:(9/33): python3-pytz-2021.1-5.el9.noarch.rpm 471 kB/s | 47 kB 00:00 2024-04-16T14:23:31.579 INFO:teuthology.orchestra.run.smithi115.stdout:(10/33): python3-toml-0.10.2-6.el9.noarch.rpm 768 kB/s | 39 kB 00:00 2024-04-16T14:23:31.622 INFO:teuthology.orchestra.run.smithi115.stdout:(11/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.0 MB/s | 241 kB 00:00 2024-04-16T14:23:31.705 INFO:teuthology.orchestra.run.smithi115.stdout:(12/33): python3-cryptography-36.0.1-4.el9.x86_ 8.0 MB/s | 1.1 MB 00:00 2024-04-16T14:23:31.732 INFO:teuthology.orchestra.run.smithi115.stdout:(13/33): python3-ply-3.11-14.el9.noarch.rpm 682 kB/s | 103 kB 00:00 2024-04-16T14:23:31.759 INFO:teuthology.orchestra.run.smithi115.stdout:(14/33): python3-pycparser-2.20-6.el9.noarch.rp 932 kB/s | 124 kB 00:00 2024-04-16T14:23:31.781 INFO:teuthology.orchestra.run.smithi115.stdout:(15/33): python3-urllib3-1.26.5-5.el9.noarch.rp 2.4 MB/s | 187 kB 00:00 2024-04-16T14:23:31.906 INFO:teuthology.orchestra.run.smithi115.stdout:(16/33): python3-requests-2.25.1-8.el9.noarch.r 832 kB/s | 125 kB 00:00 2024-04-16T14:23:31.931 INFO:teuthology.orchestra.run.smithi115.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 248 kB/s | 43 kB 00:00 2024-04-16T14:23:31.974 INFO:teuthology.orchestra.run.smithi115.stdout:(18/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 893 kB/s | 172 kB 00:00 2024-04-16T14:23:31.999 INFO:teuthology.orchestra.run.smithi115.stdout:(19/33): python3-cherrypy-18.6.1-2.el9.noarch.r 3.8 MB/s | 358 kB 00:00 2024-04-16T14:23:32.024 INFO:teuthology.orchestra.run.smithi115.stdout:(20/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 116 kB/s | 11 kB 00:00 2024-04-16T14:23:32.049 INFO:teuthology.orchestra.run.smithi115.stdout:(21/33): python3-jaraco-classes-3.2.1-5.el9.noa 235 kB/s | 18 kB 00:00 2024-04-16T14:23:32.074 INFO:teuthology.orchestra.run.smithi115.stdout:(22/33): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-04-16T14:23:32.099 INFO:teuthology.orchestra.run.smithi115.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 258 kB/s | 19 kB 00:00 2024-04-16T14:23:32.125 INFO:teuthology.orchestra.run.smithi115.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 261 kB/s | 20 kB 00:00 2024-04-16T14:23:32.145 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-04-16T14:23:32.150 INFO:teuthology.orchestra.run.smithi115.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 929 kB/s | 46 kB 00:00 2024-04-16T14:23:32.175 INFO:teuthology.orchestra.run.smithi115.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-04-16T14:23:32.199 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-04-16T14:23:32.200 INFO:teuthology.orchestra.run.smithi115.stdout:(27/33): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-04-16T14:23:32.217 INFO:teuthology.orchestra.run.smithi115.stdout:(28/33): python3-portend-3.1.0-2.el9.noarch.rpm 394 kB/s | 16 kB 00:00 2024-04-16T14:23:32.232 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-04-16T14:23:32.242 INFO:teuthology.orchestra.run.smithi115.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2024-04-16T14:23:32.259 INFO:teuthology.orchestra.run.smithi115.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 612 kB/s | 36 kB 00:00 2024-04-16T14:23:32.273 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-04-16T14:23:32.293 INFO:teuthology.orchestra.run.smithi115.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-04-16T14:23:32.348 INFO:teuthology.orchestra.run.smithi115.stdout:(32/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.0 MB/s | 427 kB 00:00 2024-04-16T14:23:32.368 INFO:teuthology.orchestra.run.smithi115.stdout:(33/33): python3-zc-lockfile-2.0-10.el9.noarch. 184 kB/s | 20 kB 00:00 2024-04-16T14:23:32.374 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:23:32.374 INFO:teuthology.orchestra.run.smithi115.stdout:Total 11 MB/s | 27 MB 00:02 2024-04-16T14:23:32.376 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-04-16T14:23:32.387 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-04-16T14:23:32.423 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-04-16T14:23:32.423 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-04-16T14:23:32.455 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-04-16T14:23:32.502 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-04-16T14:23:32.576 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-04-16T14:23:32.753 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 8/33 2024-04-16T14:23:32.763 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-04-16T14:23:32.763 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-04-16T14:23:32.790 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 9/33 2024-04-16T14:23:32.857 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2024-04-16T14:23:32.922 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2024-04-16T14:23:33.129 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2024-04-16T14:23:33.178 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2024-04-16T14:23:33.217 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2024-04-16T14:23:33.251 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2024-04-16T14:23:33.289 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2024-04-16T14:23:33.368 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2024-04-16T14:23:33.400 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-16T14:23:33.433 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2024-04-16T14:23:33.474 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2024-04-16T14:23:33.518 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2024-04-16T14:23:33.552 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2024-04-16T14:23:33.644 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2024-04-16T14:23:33.800 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2024-04-16T14:23:33.874 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2024-04-16T14:23:33.993 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-04-16T14:23:34.025 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2024-04-16T14:23:34.054 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-04-16T14:23:34.086 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-04-16T14:23:34.128 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-04-16T14:23:34.157 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-16T14:23:34.219 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-04-16T14:23:34.308 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-04-16T14:23:34.321 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-868.g412a5526.el9.n 28/33 2024-04-16T14:23:34.345 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-2:17.2.7-868.g412a5526.el9.x86_64 29/33 2024-04-16T14:23:34.358 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-04-16T14:23:34.372 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-2:17.2.7-868.g412a5526.el9.x86_64 29/33 2024-04-16T14:23:34.372 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T14:23:34.372 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-16T14:23:34.372 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T14:23:34.372 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T14:23:34.372 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:34.438 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-04-16T14:23:34.492 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 8/33 2024-04-16T14:23:34.530 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 9/33 2024-04-16T14:23:34.579 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2024-04-16T14:23:34.641 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2024-04-16T14:23:34.829 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2024-04-16T14:23:34.876 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2024-04-16T14:23:34.914 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2024-04-16T14:23:34.949 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2024-04-16T14:23:34.979 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2024-04-16T14:23:35.056 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2024-04-16T14:23:35.089 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-16T14:23:35.123 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2024-04-16T14:23:35.163 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2024-04-16T14:23:35.198 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2024-04-16T14:23:35.233 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2024-04-16T14:23:35.322 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2024-04-16T14:23:35.364 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2024-04-16T14:23:35.437 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2024-04-16T14:23:35.573 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2024-04-16T14:23:35.698 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-16T14:23:35.771 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-osd-2:17.2.7-868.g412a5526.el9.x86_64 30/33 2024-04-16T14:23:35.799 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-osd-2:17.2.7-868.g412a5526.el9.x86_64 30/33 2024-04-16T14:23:35.799 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T14:23:35.799 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-16T14:23:35.800 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T14:23:35.800 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T14:23:35.800 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:35.857 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-868.g412a5526.el9.n 28/33 2024-04-16T14:23:35.885 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-2:17.2.7-868.g412a5526.el9.x86_64 29/33 2024-04-16T14:23:35.912 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-2:17.2.7-868.g412a5526.el9.x86_64 29/33 2024-04-16T14:23:35.912 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T14:23:35.912 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-16T14:23:35.912 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T14:23:35.912 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T14:23:35.913 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:36.189 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mon-2:17.2.7-868.g412a5526.el9.x86_64 31/33 2024-04-16T14:23:36.213 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mon-2:17.2.7-868.g412a5526.el9.x86_64 31/33 2024-04-16T14:23:36.213 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T14:23:36.213 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-16T14:23:36.213 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T14:23:36.213 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T14:23:36.213 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:36.423 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mds-2:17.2.7-868.g412a5526.el9.x86_64 32/33 2024-04-16T14:23:36.447 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mds-2:17.2.7-868.g412a5526.el9.x86_64 32/33 2024-04-16T14:23:36.447 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T14:23:36.447 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-16T14:23:36.447 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T14:23:36.447 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T14:23:36.447 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:36.515 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-2:17.2.7-868.g412a5526.el9.x86_64 33/33 2024-04-16T14:23:37.219 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-osd-2:17.2.7-868.g412a5526.el9.x86_64 30/33 2024-04-16T14:23:37.247 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-osd-2:17.2.7-868.g412a5526.el9.x86_64 30/33 2024-04-16T14:23:37.247 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T14:23:37.247 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-16T14:23:37.247 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T14:23:37.248 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T14:23:37.248 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:37.612 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mon-2:17.2.7-868.g412a5526.el9.x86_64 31/33 2024-04-16T14:23:37.636 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mon-2:17.2.7-868.g412a5526.el9.x86_64 31/33 2024-04-16T14:23:37.636 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T14:23:37.636 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-16T14:23:37.636 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T14:23:37.636 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T14:23:37.636 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:37.829 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mds-2:17.2.7-868.g412a5526.el9.x86_64 32/33 2024-04-16T14:23:37.853 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mds-2:17.2.7-868.g412a5526.el9.x86_64 32/33 2024-04-16T14:23:37.853 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T14:23:37.853 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-16T14:23:37.853 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T14:23:37.853 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T14:23:37.853 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:37.918 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-2:17.2.7-868.g412a5526.el9.x86_64 33/33 2024-04-16T14:23:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-2:17.2.7-868.g412a5526.el9.x86_64 33/33 2024-04-16T14:23:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-2:17.2.7-868.g412a5526.el9.x86_64 1/33 2024-04-16T14:23:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mds-2:17.2.7-868.g412a5526.el9.x86_64 2/33 2024-04-16T14:23:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-2:17.2.7-868.g412a5526.el9.x86_64 3/33 2024-04-16T14:23:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mon-2:17.2.7-868.g412a5526.el9.x86_64 4/33 2024-04-16T14:23:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-osd-2:17.2.7-868.g412a5526.el9.x86_64 5/33 2024-04-16T14:23:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-868.g412a5526.el9.n 6/33 2024-04-16T14:23:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2024-04-16T14:23:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2024-04-16T14:23:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2024-04-16T14:23:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2024-04-16T14:23:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2024-04-16T14:23:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2024-04-16T14:23:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2024-04-16T14:23:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2024-04-16T14:23:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 15/33 2024-04-16T14:23:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 16/33 2024-04-16T14:23:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-04-16T14:23:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-16T14:23:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-04-16T14:23:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-04-16T14:23:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-04-16T14:23:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-04-16T14:23:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-04-16T14:23:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-04-16T14:23:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-04-16T14:23:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-04-16T14:23:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-16T14:23:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-04-16T14:23:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-04-16T14:23:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-04-16T14:23:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-04-16T14:23:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-04-16T14:23:39.259 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-04-16T14:23:39.259 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:39.259 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-04-16T14:23:39.259 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:39.260 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:39.260 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:39.260 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core-2:17.2.7-868.g412a5526.el9.noarch 2024-04-16T14:23:39.260 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:39.260 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:39.260 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-16T14:23:39.260 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-16T14:23:39.260 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-16T14:23:39.260 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-16T14:23:39.260 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-16T14:23:39.260 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-16T14:23:39.260 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-16T14:23:39.260 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-16T14:23:39.260 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-16T14:23:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-16T14:23:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-16T14:23:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-16T14:23:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-16T14:23:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-16T14:23:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-16T14:23:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ply-3.11-14.el9.noarch 2024-04-16T14:23:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-16T14:23:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-16T14:23:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-16T14:23:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-16T14:23:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-16T14:23:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-16T14:23:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-16T14:23:39.261 INFO:teuthology.orchestra.run.smithi005.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-16T14:23:39.262 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-16T14:23:39.262 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-16T14:23:39.262 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-16T14:23:39.262 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:39.262 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-16T14:23:39.549 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-2:17.2.7-868.g412a5526.el9.x86_64 33/33 2024-04-16T14:23:39.550 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-2:17.2.7-868.g412a5526.el9.x86_64 1/33 2024-04-16T14:23:39.550 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mds-2:17.2.7-868.g412a5526.el9.x86_64 2/33 2024-04-16T14:23:39.550 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-2:17.2.7-868.g412a5526.el9.x86_64 3/33 2024-04-16T14:23:39.550 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mon-2:17.2.7-868.g412a5526.el9.x86_64 4/33 2024-04-16T14:23:39.550 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-osd-2:17.2.7-868.g412a5526.el9.x86_64 5/33 2024-04-16T14:23:39.550 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-868.g412a5526.el9.n 6/33 2024-04-16T14:23:39.550 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2024-04-16T14:23:39.550 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2024-04-16T14:23:39.550 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2024-04-16T14:23:39.550 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2024-04-16T14:23:39.550 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2024-04-16T14:23:39.550 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2024-04-16T14:23:39.551 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2024-04-16T14:23:39.551 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2024-04-16T14:23:39.551 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 15/33 2024-04-16T14:23:39.551 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 16/33 2024-04-16T14:23:39.551 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-04-16T14:23:39.551 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-16T14:23:39.551 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-04-16T14:23:39.551 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-04-16T14:23:39.551 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-04-16T14:23:39.551 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-04-16T14:23:39.551 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-04-16T14:23:39.551 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-04-16T14:23:39.551 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-04-16T14:23:39.552 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-04-16T14:23:39.552 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-16T14:23:39.552 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-04-16T14:23:39.552 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-04-16T14:23:39.552 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-04-16T14:23:39.553 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-04-16T14:23:39.553 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-04-16T14:23:39.618 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-base 2024-04-16T14:23:40.222 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:55 ago on Tue 16 Apr 2024 02:22:45 PM UTC. 2024-04-16T14:23:40.325 INFO:teuthology.orchestra.run.smithi005.stdout:Package ceph-base-2:17.2.7-868.g412a5526.el9.x86_64 is already installed. 2024-04-16T14:23:40.379 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-16T14:23:40.380 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-04-16T14:23:40.380 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-16T14:23:40.447 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install cephadm 2024-04-16T14:23:40.506 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-04-16T14:23:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:40.507 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-04-16T14:23:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core-2:17.2.7-868.g412a5526.el9.noarch 2024-04-16T14:23:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-16T14:23:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-16T14:23:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-16T14:23:40.507 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-16T14:23:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-16T14:23:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-16T14:23:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-16T14:23:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-16T14:23:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-16T14:23:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-16T14:23:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-16T14:23:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-16T14:23:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-16T14:23:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-16T14:23:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-16T14:23:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ply-3.11-14.el9.noarch 2024-04-16T14:23:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-16T14:23:40.508 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-16T14:23:40.509 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-16T14:23:40.509 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-16T14:23:40.509 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-16T14:23:40.509 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-16T14:23:40.509 INFO:teuthology.orchestra.run.smithi115.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-16T14:23:40.509 INFO:teuthology.orchestra.run.smithi115.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-16T14:23:40.509 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-16T14:23:40.509 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-16T14:23:40.509 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-16T14:23:40.509 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:40.509 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-16T14:23:40.895 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-base 2024-04-16T14:23:41.044 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:56 ago on Tue 16 Apr 2024 02:22:45 PM UTC. 2024-04-16T14:23:41.204 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-16T14:23:41.204 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:23:41.204 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-04-16T14:23:41.204 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:23:41.204 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-04-16T14:23:41.204 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm noarch 2:17.2.7-868.g412a5526.el9 ceph-noarch 82 k 2024-04-16T14:23:41.205 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:41.205 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-04-16T14:23:41.205 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:23:41.205 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2024-04-16T14:23:41.205 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:41.205 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 82 k 2024-04-16T14:23:41.205 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 372 k 2024-04-16T14:23:41.206 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-04-16T14:23:41.409 INFO:teuthology.orchestra.run.smithi005.stdout:cephadm-17.2.7-868.g412a5526.el9.noarch.rpm 404 kB/s | 82 kB 00:00 2024-04-16T14:23:41.410 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:23:41.410 INFO:teuthology.orchestra.run.smithi005.stdout:Total 401 kB/s | 82 kB 00:00 2024-04-16T14:23:41.410 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-04-16T14:23:41.415 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-04-16T14:23:41.415 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-04-16T14:23:41.417 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-04-16T14:23:41.418 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-04-16T14:23:41.495 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-04-16T14:23:41.506 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:00:55 ago on Tue 16 Apr 2024 02:22:46 PM UTC. 2024-04-16T14:23:41.611 INFO:teuthology.orchestra.run.smithi115.stdout:Package ceph-base-2:17.2.7-868.g412a5526.el9.x86_64 is already installed. 2024-04-16T14:23:41.662 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-16T14:23:41.663 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-04-16T14:23:41.663 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-16T14:23:41.728 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install cephadm 2024-04-16T14:23:41.943 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephadm-2:17.2.7-868.g412a5526.el9.noarch 1/1 2024-04-16T14:23:42.057 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephadm-2:17.2.7-868.g412a5526.el9.noarch 1/1 2024-04-16T14:23:42.313 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:00:56 ago on Tue 16 Apr 2024 02:22:46 PM UTC. 2024-04-16T14:23:42.448 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephadm-2:17.2.7-868.g412a5526.el9.noarch 1/1 2024-04-16T14:23:42.465 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-16T14:23:42.466 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:23:42.466 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-04-16T14:23:42.466 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:23:42.466 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-04-16T14:23:42.466 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm noarch 2:17.2.7-868.g412a5526.el9 ceph-noarch 82 k 2024-04-16T14:23:42.466 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:42.466 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-04-16T14:23:42.466 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:23:42.466 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-04-16T14:23:42.466 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:42.467 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 82 k 2024-04-16T14:23:42.467 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 372 k 2024-04-16T14:23:42.467 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-04-16T14:23:42.729 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephadm-2:17.2.7-868.g412a5526.el9.noarch 1/1 2024-04-16T14:23:42.729 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:42.729 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-04-16T14:23:42.729 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm-2:17.2.7-868.g412a5526.el9.noarch 2024-04-16T14:23:42.729 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:42.729 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-16T14:23:42.787 INFO:teuthology.orchestra.run.smithi115.stdout:cephadm-17.2.7-868.g412a5526.el9.noarch.rpm 257 kB/s | 82 kB 00:00 2024-04-16T14:23:42.787 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:23:42.788 INFO:teuthology.orchestra.run.smithi115.stdout:Total 255 kB/s | 82 kB 00:00 2024-04-16T14:23:42.788 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-04-16T14:23:42.793 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-04-16T14:23:42.793 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-04-16T14:23:42.795 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-04-16T14:23:42.798 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-04-16T14:23:42.864 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-04-16T14:23:42.916 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-immutable-object-cache 2024-04-16T14:23:43.311 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: cephadm-2:17.2.7-868.g412a5526.el9.noarch 1/1 2024-04-16T14:23:43.400 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephadm-2:17.2.7-868.g412a5526.el9.noarch 1/1 2024-04-16T14:23:43.514 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:58 ago on Tue 16 Apr 2024 02:22:45 PM UTC. 2024-04-16T14:23:43.673 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-16T14:23:43.674 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:23:43.674 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2024-04-16T14:23:43.674 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:23:43.674 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-04-16T14:23:43.674 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-868.g412a5526.el9 ceph 137 k 2024-04-16T14:23:43.674 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:43.674 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-04-16T14:23:43.674 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:23:43.675 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2024-04-16T14:23:43.675 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:43.675 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 137 k 2024-04-16T14:23:43.675 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 379 k 2024-04-16T14:23:43.675 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-04-16T14:23:43.775 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: cephadm-2:17.2.7-868.g412a5526.el9.noarch 1/1 2024-04-16T14:23:44.008 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-immutable-object-cache-17.2.7-868.g412a552 413 kB/s | 137 kB 00:00 2024-04-16T14:23:44.008 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:23:44.008 INFO:teuthology.orchestra.run.smithi005.stdout:Total 411 kB/s | 137 kB 00:00 2024-04-16T14:23:44.009 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-04-16T14:23:44.017 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-04-16T14:23:44.017 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-04-16T14:23:44.072 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-04-16T14:23:44.072 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-04-16T14:23:44.072 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephadm-2:17.2.7-868.g412a5526.el9.noarch 1/1 2024-04-16T14:23:44.072 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:44.073 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-04-16T14:23:44.073 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm-2:17.2.7-868.g412a5526.el9.noarch 2024-04-16T14:23:44.073 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:44.073 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-16T14:23:44.222 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-04-16T14:23:44.283 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-868.g412a5526.e 1/1 2024-04-16T14:23:44.291 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-immutable-object-cache 2024-04-16T14:23:44.307 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-868.g412a5526.e 1/1 2024-04-16T14:23:44.307 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T14:23:44.307 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-16T14:23:44.307 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:44.887 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:00:58 ago on Tue 16 Apr 2024 02:22:46 PM UTC. 2024-04-16T14:23:45.045 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-16T14:23:45.046 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:23:45.046 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repo Size 2024-04-16T14:23:45.046 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:23:45.046 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-04-16T14:23:45.046 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-868.g412a5526.el9 ceph 137 k 2024-04-16T14:23:45.046 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:45.047 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-04-16T14:23:45.047 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:23:45.047 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-04-16T14:23:45.047 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:45.047 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 137 k 2024-04-16T14:23:45.047 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 379 k 2024-04-16T14:23:45.047 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-04-16T14:23:45.263 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-immutable-object-cache-17.2.7-868.g412a552 640 kB/s | 137 kB 00:00 2024-04-16T14:23:45.263 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:23:45.263 INFO:teuthology.orchestra.run.smithi115.stdout:Total 636 kB/s | 137 kB 00:00 2024-04-16T14:23:45.263 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-04-16T14:23:45.270 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-04-16T14:23:45.270 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-04-16T14:23:45.276 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-868.g412a5526.e 1/1 2024-04-16T14:23:45.276 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:45.276 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-04-16T14:23:45.276 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:45.276 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:45.277 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-16T14:23:45.323 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-04-16T14:23:45.323 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-04-16T14:23:45.474 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-04-16T14:23:45.544 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mgr 2024-04-16T14:23:45.546 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-868.g412a5526.e 1/1 2024-04-16T14:23:45.571 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-868.g412a5526.e 1/1 2024-04-16T14:23:45.571 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T14:23:45.571 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-16T14:23:45.571 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:46.145 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:01 ago on Tue 16 Apr 2024 02:22:45 PM UTC. 2024-04-16T14:23:46.252 INFO:teuthology.orchestra.run.smithi005.stdout:Package ceph-mgr-2:17.2.7-868.g412a5526.el9.x86_64 is already installed. 2024-04-16T14:23:46.306 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-16T14:23:46.307 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-04-16T14:23:46.307 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-16T14:23:46.380 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mgr-dashboard 2024-04-16T14:23:46.526 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-868.g412a5526.e 1/1 2024-04-16T14:23:46.526 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:46.527 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-04-16T14:23:46.527 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:23:46.527 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:46.527 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-16T14:23:46.785 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-mgr 2024-04-16T14:23:46.983 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:01 ago on Tue 16 Apr 2024 02:22:45 PM UTC. 2024-04-16T14:23:47.145 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-16T14:23:47.145 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:23:47.145 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-04-16T14:23:47.146 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:23:47.146 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-04-16T14:23:47.146 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard noarch 2:17.2.7-868.g412a5526.el9 ceph-noarch 3.4 M 2024-04-16T14:23:47.146 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-04-16T14:23:47.146 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards noarch 2:17.2.7-868.g412a5526.el9 ceph-noarch 24 k 2024-04-16T14:23:47.146 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts noarch 2:17.2.7-868.g412a5526.el9 ceph-noarch 15 k 2024-04-16T14:23:47.146 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-04-16T14:23:47.146 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-16T14:23:47.146 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-16T14:23:47.146 INFO:teuthology.orchestra.run.smithi005.stdout:Installing weak dependencies: 2024-04-16T14:23:47.146 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-04-16T14:23:47.147 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:47.147 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-04-16T14:23:47.147 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:23:47.147 INFO:teuthology.orchestra.run.smithi005.stdout:Install 7 Packages 2024-04-16T14:23:47.147 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:47.147 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 3.7 M 2024-04-16T14:23:47.147 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 80 M 2024-04-16T14:23:47.148 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-04-16T14:23:47.382 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:01 ago on Tue 16 Apr 2024 02:22:46 PM UTC. 2024-04-16T14:23:47.484 INFO:teuthology.orchestra.run.smithi115.stdout:Package ceph-mgr-2:17.2.7-868.g412a5526.el9.x86_64 is already installed. 2024-04-16T14:23:47.511 INFO:teuthology.orchestra.run.smithi005.stdout:(1/7): ceph-grafana-dashboards-17.2.7-868.g412a 87 kB/s | 24 kB 00:00 2024-04-16T14:23:47.534 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-16T14:23:47.535 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-04-16T14:23:47.536 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-16T14:23:47.536 INFO:teuthology.orchestra.run.smithi005.stdout:(2/7): ceph-prometheus-alerts-17.2.7-868.g412a5 48 kB/s | 15 kB 00:00 2024-04-16T14:23:47.607 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-mgr-dashboard 2024-04-16T14:23:47.645 INFO:teuthology.orchestra.run.smithi005.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 68 kB/s | 9.0 kB 00:00 2024-04-16T14:23:47.714 INFO:teuthology.orchestra.run.smithi005.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 233 kB/s | 41 kB 00:00 2024-04-16T14:23:47.746 INFO:teuthology.orchestra.run.smithi005.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 307 kB/s | 31 kB 00:00 2024-04-16T14:23:47.854 INFO:teuthology.orchestra.run.smithi005.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 1.3 MB/s | 188 kB 00:00 2024-04-16T14:23:48.197 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:02 ago on Tue 16 Apr 2024 02:22:46 PM UTC. 2024-04-16T14:23:48.263 INFO:teuthology.orchestra.run.smithi005.stdout:(7/7): ceph-mgr-dashboard-17.2.7-868.g412a5526. 3.2 MB/s | 3.4 MB 00:01 2024-04-16T14:23:48.265 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:23:48.265 INFO:teuthology.orchestra.run.smithi005.stdout:Total 3.3 MB/s | 3.7 MB 00:01 2024-04-16T14:23:48.265 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-04-16T14:23:48.275 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-04-16T14:23:48.275 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-04-16T14:23:48.350 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-16T14:23:48.350 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:23:48.350 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-04-16T14:23:48.351 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:23:48.351 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-04-16T14:23:48.351 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard noarch 2:17.2.7-868.g412a5526.el9 ceph-noarch 3.4 M 2024-04-16T14:23:48.351 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-04-16T14:23:48.351 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards noarch 2:17.2.7-868.g412a5526.el9 ceph-noarch 24 k 2024-04-16T14:23:48.351 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts noarch 2:17.2.7-868.g412a5526.el9 ceph-noarch 15 k 2024-04-16T14:23:48.351 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-04-16T14:23:48.352 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-16T14:23:48.352 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-16T14:23:48.352 INFO:teuthology.orchestra.run.smithi115.stdout:Installing weak dependencies: 2024-04-16T14:23:48.352 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-04-16T14:23:48.353 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:48.353 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-04-16T14:23:48.353 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:23:48.353 INFO:teuthology.orchestra.run.smithi115.stdout:Install 7 Packages 2024-04-16T14:23:48.353 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:48.354 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 3.7 M 2024-04-16T14:23:48.354 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 80 M 2024-04-16T14:23:48.354 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-04-16T14:23:48.356 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-04-16T14:23:48.357 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-04-16T14:23:48.641 INFO:teuthology.orchestra.run.smithi115.stdout:(1/7): ceph-grafana-dashboards-17.2.7-868.g412a 122 kB/s | 24 kB 00:00 2024-04-16T14:23:48.658 INFO:teuthology.orchestra.run.smithi115.stdout:(2/7): ceph-prometheus-alerts-17.2.7-868.g412a5 67 kB/s | 15 kB 00:00 2024-04-16T14:23:48.681 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-04-16T14:23:48.741 INFO:teuthology.orchestra.run.smithi115.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 90 kB/s | 9.0 kB 00:00 2024-04-16T14:23:48.747 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-04-16T14:23:48.782 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-04-16T14:23:48.800 INFO:teuthology.orchestra.run.smithi115.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 289 kB/s | 41 kB 00:00 2024-04-16T14:23:48.825 INFO:teuthology.orchestra.run.smithi115.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 367 kB/s | 31 kB 00:00 2024-04-16T14:23:48.838 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-04-16T14:23:48.877 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-04-16T14:23:48.900 INFO:teuthology.orchestra.run.smithi115.stdout:(6/7): ceph-mgr-dashboard-17.2.7-868.g412a5526. 7.3 MB/s | 3.4 MB 00:00 2024-04-16T14:23:48.906 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-868.g412a5526.el9.no 5/7 2024-04-16T14:23:48.984 INFO:teuthology.orchestra.run.smithi115.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 1.0 MB/s | 188 kB 00:00 2024-04-16T14:23:48.986 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:23:48.986 INFO:teuthology.orchestra.run.smithi115.stdout:Total 5.8 MB/s | 3.7 MB 00:00 2024-04-16T14:23:48.987 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-04-16T14:23:48.995 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-04-16T14:23:48.995 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-04-16T14:23:49.069 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-04-16T14:23:49.069 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-04-16T14:23:49.368 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-04-16T14:23:49.418 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-04-16T14:23:49.452 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-04-16T14:23:49.499 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-04-16T14:23:49.539 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-04-16T14:23:49.568 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-868.g412a5526.el9.no 5/7 2024-04-16T14:23:49.955 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-868.g412a5526.el9.n 6/7 2024-04-16T14:23:49.993 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-868.g412a5526.el9.noarch 7/7 2024-04-16T14:23:50.563 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-868.g412a5526.el9.n 6/7 2024-04-16T14:23:50.605 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-868.g412a5526.el9.noarch 7/7 2024-04-16T14:23:51.103 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-868.g412a5526.el9.noarch 7/7 2024-04-16T14:23:51.103 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-868.g412a5526.el9.n 1/7 2024-04-16T14:23:51.103 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-868.g412a5526.el9.noarch 2/7 2024-04-16T14:23:51.103 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-868.g412a5526.el9.no 3/7 2024-04-16T14:23:51.103 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-04-16T14:23:51.104 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-04-16T14:23:51.104 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-04-16T14:23:51.410 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-04-16T14:23:51.410 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:51.410 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-04-16T14:23:51.410 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards-2:17.2.7-868.g412a5526.el9.noarch 2024-04-16T14:23:51.411 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard-2:17.2.7-868.g412a5526.el9.noarch 2024-04-16T14:23:51.411 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts-2:17.2.7-868.g412a5526.el9.noarch 2024-04-16T14:23:51.411 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-04-16T14:23:51.411 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-04-16T14:23:51.411 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-16T14:23:51.411 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-16T14:23:51.411 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:51.411 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-16T14:23:51.654 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-16T14:23:51.693 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-868.g412a5526.el9.noarch 7/7 2024-04-16T14:23:51.693 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-868.g412a5526.el9.n 1/7 2024-04-16T14:23:51.693 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-868.g412a5526.el9.noarch 2/7 2024-04-16T14:23:51.693 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-868.g412a5526.el9.no 3/7 2024-04-16T14:23:51.693 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-04-16T14:23:51.693 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-04-16T14:23:51.693 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-04-16T14:23:52.013 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-04-16T14:23:52.014 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:52.014 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-04-16T14:23:52.014 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards-2:17.2.7-868.g412a5526.el9.noarch 2024-04-16T14:23:52.014 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard-2:17.2.7-868.g412a5526.el9.noarch 2024-04-16T14:23:52.014 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts-2:17.2.7-868.g412a5526.el9.noarch 2024-04-16T14:23:52.014 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-04-16T14:23:52.014 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-04-16T14:23:52.014 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-16T14:23:52.014 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-16T14:23:52.014 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:52.014 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-16T14:23:52.238 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-16T14:23:52.253 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:07 ago on Tue 16 Apr 2024 02:22:45 PM UTC. 2024-04-16T14:23:52.416 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-16T14:23:52.416 INFO:teuthology.orchestra.run.smithi005.stdout:=========================================================================================== 2024-04-16T14:23:52.416 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-04-16T14:23:52.416 INFO:teuthology.orchestra.run.smithi005.stdout:=========================================================================================== 2024-04-16T14:23:52.416 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-04-16T14:23:52.416 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-868.g412a5526.el9 ceph-noarch 7.4 M 2024-04-16T14:23:52.416 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-04-16T14:23:52.417 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-16T14:23:52.417 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-16T14:23:52.417 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-16T14:23:52.417 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-16T14:23:52.417 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-16T14:23:52.417 INFO:teuthology.orchestra.run.smithi005.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-16T14:23:52.417 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-16T14:23:52.417 INFO:teuthology.orchestra.run.smithi005.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-16T14:23:52.417 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-16T14:23:52.417 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-16T14:23:52.417 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-16T14:23:52.417 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:52.417 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-04-16T14:23:52.417 INFO:teuthology.orchestra.run.smithi005.stdout:=========================================================================================== 2024-04-16T14:23:52.418 INFO:teuthology.orchestra.run.smithi005.stdout:Install 12 Packages 2024-04-16T14:23:52.418 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:23:52.418 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 37 M 2024-04-16T14:23:52.418 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 209 M 2024-04-16T14:23:52.418 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-04-16T14:23:52.829 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:06 ago on Tue 16 Apr 2024 02:22:46 PM UTC. 2024-04-16T14:23:52.913 INFO:teuthology.orchestra.run.smithi005.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 212 kB/s | 32 kB 00:00 2024-04-16T14:23:52.947 INFO:teuthology.orchestra.run.smithi005.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 535 kB/s | 17 kB 00:00 2024-04-16T14:23:52.984 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-16T14:23:52.986 INFO:teuthology.orchestra.run.smithi115.stdout:=========================================================================================== 2024-04-16T14:23:52.986 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-04-16T14:23:52.986 INFO:teuthology.orchestra.run.smithi115.stdout:=========================================================================================== 2024-04-16T14:23:52.986 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-04-16T14:23:52.986 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-868.g412a5526.el9 ceph-noarch 7.4 M 2024-04-16T14:23:52.986 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-04-16T14:23:52.986 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-16T14:23:52.986 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-16T14:23:52.986 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-16T14:23:52.987 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-16T14:23:52.987 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-16T14:23:52.987 INFO:teuthology.orchestra.run.smithi115.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-16T14:23:52.987 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-16T14:23:52.987 INFO:teuthology.orchestra.run.smithi115.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-16T14:23:52.987 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-16T14:23:52.987 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-16T14:23:52.987 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-16T14:23:52.987 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:52.987 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-04-16T14:23:52.987 INFO:teuthology.orchestra.run.smithi115.stdout:=========================================================================================== 2024-04-16T14:23:52.987 INFO:teuthology.orchestra.run.smithi115.stdout:Install 12 Packages 2024-04-16T14:23:52.987 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:23:52.987 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 37 M 2024-04-16T14:23:52.988 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 209 M 2024-04-16T14:23:52.988 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-04-16T14:23:52.989 INFO:teuthology.orchestra.run.smithi005.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 841 kB/s | 34 kB 00:00 2024-04-16T14:23:53.039 INFO:teuthology.orchestra.run.smithi005.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2024-04-16T14:23:53.381 INFO:teuthology.orchestra.run.smithi005.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 12 MB/s | 4.7 MB 00:00 2024-04-16T14:23:53.448 INFO:teuthology.orchestra.run.smithi005.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 4.8 MB 00:00 2024-04-16T14:23:53.482 INFO:teuthology.orchestra.run.smithi005.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.2 MB/s | 217 kB 00:00 2024-04-16T14:23:53.642 INFO:teuthology.orchestra.run.smithi115.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 143 kB/s | 32 kB 00:00 2024-04-16T14:23:53.700 INFO:teuthology.orchestra.run.smithi115.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 295 kB/s | 17 kB 00:00 2024-04-16T14:23:53.792 INFO:teuthology.orchestra.run.smithi115.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 372 kB/s | 34 kB 00:00 2024-04-16T14:23:54.049 INFO:teuthology.orchestra.run.smithi005.stdout:(8/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 803 kB 00:00 2024-04-16T14:23:54.216 INFO:teuthology.orchestra.run.smithi005.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-04-16T14:23:54.241 INFO:teuthology.orchestra.run.smithi005.stdout:(10/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 195 kB 00:00 2024-04-16T14:23:54.276 INFO:teuthology.orchestra.run.smithi115.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.5 MB/s | 3.0 MB 00:00 2024-04-16T14:23:54.358 INFO:teuthology.orchestra.run.smithi005.stdout:(11/12): python3-devel-3.9.17-2.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-04-16T14:23:55.293 INFO:teuthology.orchestra.run.smithi115.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 3.2 MB/s | 4.7 MB 00:01 2024-04-16T14:23:55.584 INFO:teuthology.orchestra.run.smithi115.stdout:(6/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 747 kB/s | 217 kB 00:00 2024-04-16T14:23:55.710 INFO:teuthology.orchestra.run.smithi115.stdout:(7/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.3 MB/s | 4.8 MB 00:01 2024-04-16T14:23:55.893 INFO:teuthology.orchestra.run.smithi115.stdout:(8/12): libgfortran-11.4.1-3.el9.x86_64.rpm 4.3 MB/s | 803 kB 00:00 2024-04-16T14:23:55.943 INFO:teuthology.orchestra.run.smithi115.stdout:(9/12): libquadmath-11.4.1-3.el9.x86_64.rpm 3.9 MB/s | 195 kB 00:00 2024-04-16T14:23:56.069 INFO:teuthology.orchestra.run.smithi115.stdout:(10/12): python3-devel-3.9.17-2.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-04-16T14:23:57.177 INFO:teuthology.orchestra.run.smithi115.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 9.8 MB/s | 16 MB 00:01 2024-04-16T14:23:57.808 INFO:teuthology.orchestra.run.smithi005.stdout:(12/12): ceph-mgr-diskprediction-local-17.2.7-8 1.5 MB/s | 7.4 MB 00:05 2024-04-16T14:23:57.811 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:23:57.811 INFO:teuthology.orchestra.run.smithi005.stdout:Total 6.9 MB/s | 37 MB 00:05 2024-04-16T14:23:57.856 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-04-16T14:23:57.882 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-04-16T14:23:57.882 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-04-16T14:23:58.324 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-04-16T14:23:58.324 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-04-16T14:23:58.402 INFO:teuthology.orchestra.run.smithi115.stdout:(12/12): ceph-mgr-diskprediction-local-17.2.7-8 1.5 MB/s | 7.4 MB 00:04 2024-04-16T14:23:58.404 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:23:58.405 INFO:teuthology.orchestra.run.smithi115.stdout:Total 6.8 MB/s | 37 MB 00:05 2024-04-16T14:23:58.450 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-04-16T14:23:58.475 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-04-16T14:23:58.476 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-04-16T14:23:58.913 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-04-16T14:23:58.914 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-04-16T14:23:59.040 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-04-16T14:23:59.129 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-04-16T14:23:59.163 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-16T14:23:59.263 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-04-16T14:23:59.307 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-04-16T14:23:59.501 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-16T14:23:59.540 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-16T14:23:59.619 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-16T14:23:59.624 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-04-16T14:23:59.710 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-04-16T14:23:59.748 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-16T14:23:59.849 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-04-16T14:23:59.901 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-04-16T14:24:00.086 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-16T14:24:00.125 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-16T14:24:00.202 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-16T14:24:00.314 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-16T14:24:00.431 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-16T14:24:00.835 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-16T14:24:00.937 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-16T14:24:01.733 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-16T14:24:02.174 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-16T14:24:02.808 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-16T14:24:02.840 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-868.g412a55 12/12 2024-04-16T14:24:03.193 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-16T14:24:03.225 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-868.g412a55 12/12 2024-04-16T14:24:05.353 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-868.g412a55 12/12 2024-04-16T14:24:05.353 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-868.g412a55 1/12 2024-04-16T14:24:05.353 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-04-16T14:24:05.353 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-04-16T14:24:05.353 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-04-16T14:24:05.353 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-16T14:24:05.353 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-16T14:24:05.353 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-04-16T14:24:05.353 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-04-16T14:24:05.354 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-04-16T14:24:05.354 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-04-16T14:24:05.354 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-04-16T14:24:05.782 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-868.g412a55 12/12 2024-04-16T14:24:05.782 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-868.g412a55 1/12 2024-04-16T14:24:05.783 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-04-16T14:24:05.783 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-04-16T14:24:05.783 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-04-16T14:24:05.783 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-16T14:24:05.783 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-16T14:24:05.783 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-04-16T14:24:05.783 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-04-16T14:24:05.784 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-04-16T14:24:05.784 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-04-16T14:24:05.784 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-04-16T14:24:05.785 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-04-16T14:24:05.785 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:05.785 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-04-16T14:24:05.785 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local-2:17.2.7-868.g412a5526.el9.noarch 2024-04-16T14:24:05.785 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-16T14:24:05.785 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-16T14:24:05.785 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-16T14:24:05.785 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-16T14:24:05.786 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-16T14:24:05.786 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-16T14:24:05.786 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-16T14:24:05.786 INFO:teuthology.orchestra.run.smithi005.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-16T14:24:05.786 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-16T14:24:05.786 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-16T14:24:05.786 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-16T14:24:05.786 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:05.787 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-16T14:24:06.179 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mgr-rook 2024-04-16T14:24:06.229 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-04-16T14:24:06.229 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:06.229 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-04-16T14:24:06.229 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local-2:17.2.7-868.g412a5526.el9.noarch 2024-04-16T14:24:06.230 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-16T14:24:06.230 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-16T14:24:06.230 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-16T14:24:06.230 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-16T14:24:06.230 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-16T14:24:06.230 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-16T14:24:06.230 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-16T14:24:06.230 INFO:teuthology.orchestra.run.smithi115.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-16T14:24:06.230 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-16T14:24:06.230 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-16T14:24:06.230 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-16T14:24:06.230 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:06.230 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-16T14:24:06.612 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-mgr-rook 2024-04-16T14:24:06.786 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:21 ago on Tue 16 Apr 2024 02:22:45 PM UTC. 2024-04-16T14:24:06.948 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-16T14:24:06.949 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-04-16T14:24:06.950 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-04-16T14:24:06.950 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-04-16T14:24:06.950 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-04-16T14:24:06.950 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook noarch 2:17.2.7-868.g412a5526.el9 ceph-noarch 47 k 2024-04-16T14:24:06.950 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-04-16T14:24:06.950 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-16T14:24:06.950 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-16T14:24:06.950 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-16T14:24:06.950 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-16T14:24:06.950 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-16T14:24:06.950 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-16T14:24:06.950 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-16T14:24:06.950 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-16T14:24:06.950 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-16T14:24:06.951 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-16T14:24:06.951 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-16T14:24:06.951 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-16T14:24:06.951 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:06.951 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-04-16T14:24:06.951 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-04-16T14:24:06.951 INFO:teuthology.orchestra.run.smithi005.stdout:Install 13 Packages 2024-04-16T14:24:06.951 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:06.952 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 2.0 M 2024-04-16T14:24:06.952 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 26 M 2024-04-16T14:24:06.952 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-04-16T14:24:07.212 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:21 ago on Tue 16 Apr 2024 02:22:46 PM UTC. 2024-04-16T14:24:07.242 INFO:teuthology.orchestra.run.smithi005.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 146 kB/s | 18 kB 00:00 2024-04-16T14:24:07.267 INFO:teuthology.orchestra.run.smithi005.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 164 kB/s | 24 kB 00:00 2024-04-16T14:24:07.317 INFO:teuthology.orchestra.run.smithi005.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.3 MB/s | 174 kB 00:00 2024-04-16T14:24:07.342 INFO:teuthology.orchestra.run.smithi005.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-04-16T14:24:07.367 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-16T14:24:07.368 INFO:teuthology.orchestra.run.smithi115.stdout:======================================================================================= 2024-04-16T14:24:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-04-16T14:24:07.368 INFO:teuthology.orchestra.run.smithi115.stdout:======================================================================================= 2024-04-16T14:24:07.368 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-04-16T14:24:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook noarch 2:17.2.7-868.g412a5526.el9 ceph-noarch 47 k 2024-04-16T14:24:07.368 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-04-16T14:24:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-16T14:24:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-16T14:24:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-16T14:24:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-16T14:24:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-16T14:24:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-16T14:24:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-16T14:24:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-16T14:24:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-16T14:24:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-16T14:24:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-16T14:24:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-16T14:24:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:07.369 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-04-16T14:24:07.370 INFO:teuthology.orchestra.run.smithi115.stdout:======================================================================================= 2024-04-16T14:24:07.370 INFO:teuthology.orchestra.run.smithi115.stdout:Install 13 Packages 2024-04-16T14:24:07.370 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:07.370 INFO:teuthology.orchestra.run.smithi005.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2024-04-16T14:24:07.371 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 2.0 M 2024-04-16T14:24:07.371 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 26 M 2024-04-16T14:24:07.371 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-04-16T14:24:07.385 INFO:teuthology.orchestra.run.smithi005.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 43 kB 00:00 2024-04-16T14:24:07.402 INFO:teuthology.orchestra.run.smithi005.stdout:(7/13): ceph-mgr-rook-17.2.7-868.g412a5526.el9. 167 kB/s | 47 kB 00:00 2024-04-16T14:24:07.619 INFO:teuthology.orchestra.run.smithi005.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 128 kB/s | 32 kB 00:00 2024-04-16T14:24:07.636 INFO:teuthology.orchestra.run.smithi005.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 60 kB/s | 15 kB 00:00 2024-04-16T14:24:07.684 INFO:teuthology.orchestra.run.smithi115.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 161 kB/s | 18 kB 00:00 2024-04-16T14:24:07.701 INFO:teuthology.orchestra.run.smithi115.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 189 kB/s | 24 kB 00:00 2024-04-16T14:24:07.768 INFO:teuthology.orchestra.run.smithi115.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 174 kB 00:00 2024-04-16T14:24:07.786 INFO:teuthology.orchestra.run.smithi005.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 394 kB/s | 59 kB 00:00 2024-04-16T14:24:07.793 INFO:teuthology.orchestra.run.smithi115.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 132 kB 00:00 2024-04-16T14:24:07.818 INFO:teuthology.orchestra.run.smithi115.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2024-04-16T14:24:07.844 INFO:teuthology.orchestra.run.smithi115.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 859 kB/s | 43 kB 00:00 2024-04-16T14:24:07.844 INFO:teuthology.orchestra.run.smithi005.stdout:(11/13): python3-google-auth-2.28.2-1.el9.noarc 458 kB/s | 203 kB 00:00 2024-04-16T14:24:07.869 INFO:teuthology.orchestra.run.smithi115.stdout:(7/13): ceph-mgr-rook-17.2.7-868.g412a5526.el9. 160 kB/s | 47 kB 00:00 2024-04-16T14:24:07.903 INFO:teuthology.orchestra.run.smithi005.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 766 kB/s | 90 kB 00:00 2024-04-16T14:24:08.078 INFO:teuthology.orchestra.run.smithi005.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.2 MB/s | 1.0 MB 00:00 2024-04-16T14:24:08.083 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:24:08.083 INFO:teuthology.orchestra.run.smithi005.stdout:Total 1.8 MB/s | 2.0 MB 00:01 2024-04-16T14:24:08.084 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-04-16T14:24:08.098 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-04-16T14:24:08.099 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-04-16T14:24:08.196 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-04-16T14:24:08.198 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-04-16T14:24:08.294 INFO:teuthology.orchestra.run.smithi115.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 33 kB/s | 15 kB 00:00 2024-04-16T14:24:08.319 INFO:teuthology.orchestra.run.smithi115.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 64 kB/s | 32 kB 00:00 2024-04-16T14:24:08.511 INFO:teuthology.orchestra.run.smithi115.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 308 kB/s | 59 kB 00:00 2024-04-16T14:24:08.703 INFO:teuthology.orchestra.run.smithi115.stdout:(11/13): python3-google-auth-2.28.2-1.el9.noarc 243 kB/s | 203 kB 00:00 2024-04-16T14:24:08.724 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-04-16T14:24:08.729 INFO:teuthology.orchestra.run.smithi115.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 413 kB/s | 90 kB 00:00 2024-04-16T14:24:08.892 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-16T14:24:08.949 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-16T14:24:09.020 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-16T14:24:09.064 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-16T14:24:09.115 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-16T14:24:09.213 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-16T14:24:09.330 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-04-16T14:24:09.392 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-16T14:24:10.003 INFO:teuthology.orchestra.run.smithi115.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 612 kB/s | 1.0 MB 00:01 2024-04-16T14:24:10.007 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:24:10.008 INFO:teuthology.orchestra.run.smithi115.stdout:Total 793 kB/s | 2.0 MB 00:02 2024-04-16T14:24:10.008 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-04-16T14:24:10.023 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-04-16T14:24:10.023 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-04-16T14:24:10.121 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-04-16T14:24:10.137 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-04-16T14:24:10.162 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-16T14:24:10.213 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-16T14:24:10.264 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-16T14:24:10.310 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-16T14:24:10.333 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-rook-2:17.2.7-868.g412a5526.el9.noarch 13/13 2024-04-16T14:24:10.651 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-04-16T14:24:10.834 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-16T14:24:10.888 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-16T14:24:10.943 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-16T14:24:10.981 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-16T14:24:11.022 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-16T14:24:11.098 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-868.g412a5526.el9.noarch 13/13 2024-04-16T14:24:11.099 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-rook-2:17.2.7-868.g412a5526.el9.noarch 1/13 2024-04-16T14:24:11.099 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-16T14:24:11.099 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-16T14:24:11.099 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-16T14:24:11.099 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-16T14:24:11.099 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-16T14:24:11.099 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-16T14:24:11.099 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-16T14:24:11.099 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-16T14:24:11.099 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-04-16T14:24:11.099 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-16T14:24:11.099 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-16T14:24:11.115 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-16T14:24:11.224 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-04-16T14:24:11.273 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-16T14:24:11.451 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-16T14:24:11.451 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:11.451 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-04-16T14:24:11.451 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook-2:17.2.7-868.g412a5526.el9.noarch 2024-04-16T14:24:11.451 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-16T14:24:11.451 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-16T14:24:11.451 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-16T14:24:11.452 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-16T14:24:11.452 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-16T14:24:11.452 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-16T14:24:11.452 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-16T14:24:11.452 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-16T14:24:11.452 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-16T14:24:11.452 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-16T14:24:11.452 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-16T14:24:11.453 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-16T14:24:11.453 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:11.453 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-16T14:24:11.688 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mgr-cephadm 2024-04-16T14:24:11.993 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-16T14:24:12.046 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-16T14:24:12.080 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-16T14:24:12.125 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-16T14:24:12.150 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-rook-2:17.2.7-868.g412a5526.el9.noarch 13/13 2024-04-16T14:24:12.288 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:27 ago on Tue 16 Apr 2024 02:22:45 PM UTC. 2024-04-16T14:24:12.446 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-16T14:24:12.446 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-04-16T14:24:12.447 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-04-16T14:24:12.447 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-04-16T14:24:12.447 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-04-16T14:24:12.447 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm noarch 2:17.2.7-868.g412a5526.el9 ceph-noarch 123 k 2024-04-16T14:24:12.447 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-04-16T14:24:12.447 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-16T14:24:12.447 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-16T14:24:12.447 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-16T14:24:12.447 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-16T14:24:12.447 INFO:teuthology.orchestra.run.smithi005.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-16T14:24:12.447 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:12.447 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-04-16T14:24:12.447 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-04-16T14:24:12.448 INFO:teuthology.orchestra.run.smithi005.stdout:Install 6 Packages 2024-04-16T14:24:12.448 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:12.448 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 6.8 M 2024-04-16T14:24:12.448 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 33 M 2024-04-16T14:24:12.448 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-04-16T14:24:12.806 INFO:teuthology.orchestra.run.smithi005.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.6 MB/s | 248 kB 00:00 2024-04-16T14:24:12.970 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-868.g412a5526.el9.noarch 13/13 2024-04-16T14:24:12.970 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-rook-2:17.2.7-868.g412a5526.el9.noarch 1/13 2024-04-16T14:24:12.971 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-16T14:24:12.971 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-16T14:24:12.971 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-16T14:24:12.971 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-16T14:24:12.971 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-16T14:24:12.971 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-16T14:24:12.971 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-16T14:24:12.971 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-16T14:24:12.971 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-04-16T14:24:12.971 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-16T14:24:12.971 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-16T14:24:12.973 INFO:teuthology.orchestra.run.smithi005.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 5.8 MB 00:00 2024-04-16T14:24:13.074 INFO:teuthology.orchestra.run.smithi005.stdout:(3/6): ceph-mgr-cephadm-17.2.7-868.g412a5526.el 291 kB/s | 123 kB 00:00 2024-04-16T14:24:13.327 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-16T14:24:13.328 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:13.328 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-04-16T14:24:13.328 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook-2:17.2.7-868.g412a5526.el9.noarch 2024-04-16T14:24:13.328 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-16T14:24:13.328 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-16T14:24:13.328 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-16T14:24:13.329 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-16T14:24:13.329 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-16T14:24:13.329 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-16T14:24:13.329 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-16T14:24:13.329 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-16T14:24:13.329 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-16T14:24:13.329 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-16T14:24:13.329 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-16T14:24:13.329 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-16T14:24:13.329 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:13.329 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-16T14:24:13.424 INFO:teuthology.orchestra.run.smithi005.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 135 kB/s | 58 kB 00:00 2024-04-16T14:24:13.532 INFO:teuthology.orchestra.run.smithi005.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 117 kB/s | 51 kB 00:00 2024-04-16T14:24:13.560 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-mgr-cephadm 2024-04-16T14:24:13.583 INFO:teuthology.orchestra.run.smithi005.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 708 kB/s | 548 kB 00:00 2024-04-16T14:24:13.586 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:24:13.587 INFO:teuthology.orchestra.run.smithi005.stdout:Total 6.0 MB/s | 6.8 MB 00:01 2024-04-16T14:24:13.600 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-04-16T14:24:13.611 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-04-16T14:24:13.611 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-04-16T14:24:13.703 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-04-16T14:24:13.703 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-04-16T14:24:13.999 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-04-16T14:24:14.148 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:28 ago on Tue 16 Apr 2024 02:22:46 PM UTC. 2024-04-16T14:24:14.174 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-16T14:24:14.227 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-16T14:24:14.300 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-16T14:24:14.301 INFO:teuthology.orchestra.run.smithi115.stdout:======================================================================================= 2024-04-16T14:24:14.301 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-04-16T14:24:14.301 INFO:teuthology.orchestra.run.smithi115.stdout:======================================================================================= 2024-04-16T14:24:14.301 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-04-16T14:24:14.301 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm noarch 2:17.2.7-868.g412a5526.el9 ceph-noarch 123 k 2024-04-16T14:24:14.301 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-04-16T14:24:14.301 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-16T14:24:14.301 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-16T14:24:14.301 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-16T14:24:14.301 INFO:teuthology.orchestra.run.smithi115.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-16T14:24:14.302 INFO:teuthology.orchestra.run.smithi115.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-16T14:24:14.302 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:14.302 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-04-16T14:24:14.302 INFO:teuthology.orchestra.run.smithi115.stdout:======================================================================================= 2024-04-16T14:24:14.302 INFO:teuthology.orchestra.run.smithi115.stdout:Install 6 Packages 2024-04-16T14:24:14.302 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:14.302 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 6.8 M 2024-04-16T14:24:14.303 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 33 M 2024-04-16T14:24:14.303 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-04-16T14:24:14.790 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-16T14:24:14.873 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-16T14:24:14.936 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-16T14:24:14.964 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-868.g412a5526.el9.noarch 6/6 2024-04-16T14:24:14.989 INFO:teuthology.orchestra.run.smithi115.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.2 MB/s | 248 kB 00:00 2024-04-16T14:24:15.081 INFO:teuthology.orchestra.run.smithi115.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 5.8 MB 00:00 2024-04-16T14:24:15.106 INFO:teuthology.orchestra.run.smithi115.stdout:(3/6): ceph-mgr-cephadm-17.2.7-868.g412a5526.el 386 kB/s | 123 kB 00:00 2024-04-16T14:24:15.348 INFO:teuthology.orchestra.run.smithi115.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 216 kB/s | 58 kB 00:00 2024-04-16T14:24:15.373 INFO:teuthology.orchestra.run.smithi115.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 191 kB/s | 51 kB 00:00 2024-04-16T14:24:15.490 INFO:teuthology.orchestra.run.smithi115.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.1 MB/s | 548 kB 00:00 2024-04-16T14:24:15.494 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:24:15.494 INFO:teuthology.orchestra.run.smithi115.stdout:Total 5.7 MB/s | 6.8 MB 00:01 2024-04-16T14:24:15.507 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-04-16T14:24:15.517 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-04-16T14:24:15.518 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-04-16T14:24:15.607 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-04-16T14:24:15.607 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-04-16T14:24:15.746 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-868.g412a5526.el9.noarch 6/6 2024-04-16T14:24:15.746 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-868.g412a5526.el9.noarch 1/6 2024-04-16T14:24:15.746 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-16T14:24:15.746 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-16T14:24:15.747 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-16T14:24:15.747 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-16T14:24:15.944 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-04-16T14:24:16.051 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-16T14:24:16.051 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:16.051 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-04-16T14:24:16.052 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm-2:17.2.7-868.g412a5526.el9.noarch 2024-04-16T14:24:16.052 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-16T14:24:16.053 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-16T14:24:16.053 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-16T14:24:16.053 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-16T14:24:16.053 INFO:teuthology.orchestra.run.smithi005.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-16T14:24:16.053 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:16.053 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-16T14:24:16.104 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-16T14:24:16.158 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-16T14:24:16.319 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-fuse 2024-04-16T14:24:16.674 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-16T14:24:16.760 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-16T14:24:16.816 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-16T14:24:16.846 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-868.g412a5526.el9.noarch 6/6 2024-04-16T14:24:16.925 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:31 ago on Tue 16 Apr 2024 02:22:45 PM UTC. 2024-04-16T14:24:17.087 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-16T14:24:17.088 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:24:17.088 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-04-16T14:24:17.088 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:24:17.089 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-04-16T14:24:17.089 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse x86_64 2:17.2.7-868.g412a5526.el9 ceph 813 k 2024-04-16T14:24:17.089 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-04-16T14:24:17.089 INFO:teuthology.orchestra.run.smithi005.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-16T14:24:17.089 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:17.089 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-04-16T14:24:17.089 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:24:17.089 INFO:teuthology.orchestra.run.smithi005.stdout:Install 2 Packages 2024-04-16T14:24:17.089 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:17.089 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 892 k 2024-04-16T14:24:17.089 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 2.6 M 2024-04-16T14:24:17.089 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-04-16T14:24:17.210 INFO:teuthology.orchestra.run.smithi005.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 653 kB/s | 79 kB 00:00 2024-04-16T14:24:17.527 INFO:teuthology.orchestra.run.smithi005.stdout:(2/2): ceph-fuse-17.2.7-868.g412a5526.el9.x86_6 1.8 MB/s | 813 kB 00:00 2024-04-16T14:24:17.528 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:24:17.528 INFO:teuthology.orchestra.run.smithi005.stdout:Total 2.0 MB/s | 892 kB 00:00 2024-04-16T14:24:17.528 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-04-16T14:24:17.550 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-04-16T14:24:17.550 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-04-16T14:24:17.623 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-04-16T14:24:17.624 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-04-16T14:24:17.627 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-868.g412a5526.el9.noarch 6/6 2024-04-16T14:24:17.627 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-868.g412a5526.el9.noarch 1/6 2024-04-16T14:24:17.627 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-16T14:24:17.627 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-16T14:24:17.627 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-16T14:24:17.627 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-16T14:24:17.809 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-04-16T14:24:17.935 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-16T14:24:17.948 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-16T14:24:17.949 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:17.949 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-04-16T14:24:17.949 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm-2:17.2.7-868.g412a5526.el9.noarch 2024-04-16T14:24:17.949 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-16T14:24:17.949 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-16T14:24:17.949 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-16T14:24:17.949 INFO:teuthology.orchestra.run.smithi115.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-16T14:24:17.949 INFO:teuthology.orchestra.run.smithi115.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-16T14:24:17.949 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:17.950 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-16T14:24:18.021 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-fuse-2:17.2.7-868.g412a5526.el9.x86_64 2/2 2024-04-16T14:24:18.198 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-fuse 2024-04-16T14:24:18.707 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-fuse-2:17.2.7-868.g412a5526.el9.x86_64 2/2 2024-04-16T14:24:18.707 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-fuse-2:17.2.7-868.g412a5526.el9.x86_64 1/2 2024-04-16T14:24:18.791 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:32 ago on Tue 16 Apr 2024 02:22:46 PM UTC. 2024-04-16T14:24:18.947 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-16T14:24:18.948 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:24:18.948 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-04-16T14:24:18.948 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:24:18.948 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-04-16T14:24:18.948 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse x86_64 2:17.2.7-868.g412a5526.el9 ceph 813 k 2024-04-16T14:24:18.948 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-04-16T14:24:18.948 INFO:teuthology.orchestra.run.smithi115.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-16T14:24:18.948 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:18.948 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-04-16T14:24:18.948 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:24:18.948 INFO:teuthology.orchestra.run.smithi115.stdout:Install 2 Packages 2024-04-16T14:24:18.948 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:18.949 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 892 k 2024-04-16T14:24:18.949 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 2.6 M 2024-04-16T14:24:18.949 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-04-16T14:24:19.014 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-16T14:24:19.015 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:19.015 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-04-16T14:24:19.015 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse-2:17.2.7-868.g412a5526.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-16T14:24:19.015 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:19.015 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-16T14:24:19.075 INFO:teuthology.orchestra.run.smithi115.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 627 kB/s | 79 kB 00:00 2024-04-16T14:24:19.326 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install librados-devel 2024-04-16T14:24:19.392 INFO:teuthology.orchestra.run.smithi115.stdout:(2/2): ceph-fuse-17.2.7-868.g412a5526.el9.x86_6 1.8 MB/s | 813 kB 00:00 2024-04-16T14:24:19.393 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:24:19.393 INFO:teuthology.orchestra.run.smithi115.stdout:Total 2.0 MB/s | 892 kB 00:00 2024-04-16T14:24:19.393 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-04-16T14:24:19.414 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-04-16T14:24:19.414 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-04-16T14:24:19.486 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-04-16T14:24:19.486 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-04-16T14:24:19.665 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-04-16T14:24:19.796 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-16T14:24:19.868 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-fuse-2:17.2.7-868.g412a5526.el9.x86_64 2/2 2024-04-16T14:24:19.935 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:34 ago on Tue 16 Apr 2024 02:22:45 PM UTC. 2024-04-16T14:24:20.094 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-16T14:24:20.095 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:24:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2024-04-16T14:24:20.096 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:24:20.096 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-04-16T14:24:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel x86_64 2:17.2.7-868.g412a5526.el9 ceph 126 k 2024-04-16T14:24:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:20.096 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-04-16T14:24:20.096 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:24:20.097 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2024-04-16T14:24:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:20.097 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 126 k 2024-04-16T14:24:20.097 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 448 k 2024-04-16T14:24:20.097 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-04-16T14:24:20.482 INFO:teuthology.orchestra.run.smithi005.stdout:librados-devel-17.2.7-868.g412a5526.el9.x86_64. 326 kB/s | 126 kB 00:00 2024-04-16T14:24:20.483 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:24:20.483 INFO:teuthology.orchestra.run.smithi005.stdout:Total 325 kB/s | 126 kB 00:00 2024-04-16T14:24:20.483 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-04-16T14:24:20.489 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-04-16T14:24:20.489 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-04-16T14:24:20.547 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-04-16T14:24:20.547 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-04-16T14:24:20.565 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-fuse-2:17.2.7-868.g412a5526.el9.x86_64 2/2 2024-04-16T14:24:20.565 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-fuse-2:17.2.7-868.g412a5526.el9.x86_64 1/2 2024-04-16T14:24:20.701 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-04-16T14:24:20.825 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librados-devel-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:20.851 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-16T14:24:20.851 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:20.851 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-04-16T14:24:20.851 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse-2:17.2.7-868.g412a5526.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-16T14:24:20.851 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:20.851 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-16T14:24:21.100 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install librados-devel 2024-04-16T14:24:21.249 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados-devel-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados-devel-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:21.506 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-04-16T14:24:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:24:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:21.506 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-16T14:24:21.704 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:35 ago on Tue 16 Apr 2024 02:22:46 PM UTC. 2024-04-16T14:24:21.768 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install libcephfs2 2024-04-16T14:24:21.857 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-16T14:24:21.857 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:24:21.857 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repo Size 2024-04-16T14:24:21.857 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:24:21.857 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-04-16T14:24:21.857 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel x86_64 2:17.2.7-868.g412a5526.el9 ceph 126 k 2024-04-16T14:24:21.857 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:21.857 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-04-16T14:24:21.858 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:24:21.858 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-04-16T14:24:21.858 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:21.858 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 126 k 2024-04-16T14:24:21.858 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 448 k 2024-04-16T14:24:21.858 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-04-16T14:24:22.205 INFO:teuthology.orchestra.run.smithi115.stdout:librados-devel-17.2.7-868.g412a5526.el9.x86_64. 364 kB/s | 126 kB 00:00 2024-04-16T14:24:22.206 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:24:22.206 INFO:teuthology.orchestra.run.smithi115.stdout:Total 362 kB/s | 126 kB 00:00 2024-04-16T14:24:22.212 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-04-16T14:24:22.213 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-04-16T14:24:22.213 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-04-16T14:24:22.266 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-04-16T14:24:22.266 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-04-16T14:24:22.374 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:37 ago on Tue 16 Apr 2024 02:22:45 PM UTC. 2024-04-16T14:24:22.402 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-04-16T14:24:22.479 INFO:teuthology.orchestra.run.smithi005.stdout:Package libcephfs2-2:17.2.7-868.g412a5526.el9.x86_64 is already installed. 2024-04-16T14:24:22.515 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librados-devel-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:22.536 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-16T14:24:22.536 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-04-16T14:24:22.536 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-16T14:24:22.604 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install libcephfs-devel 2024-04-16T14:24:22.937 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados-devel-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:23.202 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:38 ago on Tue 16 Apr 2024 02:22:45 PM UTC. 2024-04-16T14:24:23.248 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados-devel-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:23.248 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:23.248 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-04-16T14:24:23.248 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:24:23.248 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:23.248 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-16T14:24:23.361 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-16T14:24:23.361 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:24:23.361 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2024-04-16T14:24:23.361 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:24:23.361 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-04-16T14:24:23.362 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel x86_64 2:17.2.7-868.g412a5526.el9 ceph 25 k 2024-04-16T14:24:23.362 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:23.362 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-04-16T14:24:23.362 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:24:23.362 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2024-04-16T14:24:23.362 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:23.363 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 25 k 2024-04-16T14:24:23.363 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 110 k 2024-04-16T14:24:23.363 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-04-16T14:24:23.519 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install libcephfs2 2024-04-16T14:24:23.528 INFO:teuthology.orchestra.run.smithi005.stdout:libcephfs-devel-17.2.7-868.g412a5526.el9.x86_64 151 kB/s | 25 kB 00:00 2024-04-16T14:24:23.528 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:24:23.529 INFO:teuthology.orchestra.run.smithi005.stdout:Total 150 kB/s | 25 kB 00:00 2024-04-16T14:24:23.529 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-04-16T14:24:23.532 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-04-16T14:24:23.532 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-04-16T14:24:23.534 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-04-16T14:24:23.534 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-04-16T14:24:23.617 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-04-16T14:24:23.736 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs-devel-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:24.096 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:24.118 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:38 ago on Tue 16 Apr 2024 02:22:46 PM UTC. 2024-04-16T14:24:24.223 INFO:teuthology.orchestra.run.smithi115.stdout:Package libcephfs2-2:17.2.7-868.g412a5526.el9.x86_64 is already installed. 2024-04-16T14:24:24.277 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-16T14:24:24.278 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-04-16T14:24:24.278 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-16T14:24:24.348 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install libcephfs-devel 2024-04-16T14:24:24.364 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs-devel-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:24.365 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:24.365 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-04-16T14:24:24.365 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:24:24.365 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:24.365 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-16T14:24:24.530 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install librados2 2024-04-16T14:24:24.935 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:38 ago on Tue 16 Apr 2024 02:22:46 PM UTC. 2024-04-16T14:24:25.086 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-16T14:24:25.087 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:24:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repo Size 2024-04-16T14:24:25.087 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:24:25.087 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-04-16T14:24:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel x86_64 2:17.2.7-868.g412a5526.el9 ceph 25 k 2024-04-16T14:24:25.087 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:25.087 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-04-16T14:24:25.087 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:24:25.088 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-04-16T14:24:25.088 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:25.088 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 25 k 2024-04-16T14:24:25.088 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 110 k 2024-04-16T14:24:25.088 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-04-16T14:24:25.133 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:40 ago on Tue 16 Apr 2024 02:22:45 PM UTC. 2024-04-16T14:24:25.238 INFO:teuthology.orchestra.run.smithi005.stdout:Package librados2-2:17.2.7-868.g412a5526.el9.x86_64 is already installed. 2024-04-16T14:24:25.258 INFO:teuthology.orchestra.run.smithi115.stdout:libcephfs-devel-17.2.7-868.g412a5526.el9.x86_64 146 kB/s | 25 kB 00:00 2024-04-16T14:24:25.259 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:24:25.259 INFO:teuthology.orchestra.run.smithi115.stdout:Total 145 kB/s | 25 kB 00:00 2024-04-16T14:24:25.259 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-04-16T14:24:25.263 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-04-16T14:24:25.263 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-04-16T14:24:25.264 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-04-16T14:24:25.264 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-04-16T14:24:25.295 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-16T14:24:25.296 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-04-16T14:24:25.296 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-16T14:24:25.348 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-04-16T14:24:25.361 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install librbd1 2024-04-16T14:24:25.456 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs-devel-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:25.799 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:25.963 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:40 ago on Tue 16 Apr 2024 02:22:45 PM UTC. 2024-04-16T14:24:26.064 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs-devel-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:26.064 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:26.064 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-04-16T14:24:26.064 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:24:26.065 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:26.065 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-16T14:24:26.070 INFO:teuthology.orchestra.run.smithi005.stdout:Package librbd1-2:17.2.7-868.g412a5526.el9.x86_64 is already installed. 2024-04-16T14:24:26.126 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-16T14:24:26.128 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-04-16T14:24:26.128 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-16T14:24:26.195 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install python3-rados 2024-04-16T14:24:26.243 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install librados2 2024-04-16T14:24:26.797 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:41 ago on Tue 16 Apr 2024 02:22:45 PM UTC. 2024-04-16T14:24:26.833 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:40 ago on Tue 16 Apr 2024 02:22:46 PM UTC. 2024-04-16T14:24:26.902 INFO:teuthology.orchestra.run.smithi005.stdout:Package python3-rados-2:17.2.7-868.g412a5526.el9.x86_64 is already installed. 2024-04-16T14:24:26.936 INFO:teuthology.orchestra.run.smithi115.stdout:Package librados2-2:17.2.7-868.g412a5526.el9.x86_64 is already installed. 2024-04-16T14:24:26.958 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-16T14:24:26.960 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-04-16T14:24:26.960 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-16T14:24:26.987 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-16T14:24:26.988 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-04-16T14:24:26.988 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-16T14:24:27.033 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install python3-rgw 2024-04-16T14:24:27.061 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install librbd1 2024-04-16T14:24:27.639 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:42 ago on Tue 16 Apr 2024 02:22:45 PM UTC. 2024-04-16T14:24:27.650 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:41 ago on Tue 16 Apr 2024 02:22:46 PM UTC. 2024-04-16T14:24:27.738 INFO:teuthology.orchestra.run.smithi005.stdout:Package python3-rgw-2:17.2.7-868.g412a5526.el9.x86_64 is already installed. 2024-04-16T14:24:27.751 INFO:teuthology.orchestra.run.smithi115.stdout:Package librbd1-2:17.2.7-868.g412a5526.el9.x86_64 is already installed. 2024-04-16T14:24:27.794 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-16T14:24:27.795 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-04-16T14:24:27.795 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-16T14:24:27.803 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-16T14:24:27.804 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-04-16T14:24:27.804 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-16T14:24:27.870 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install python3-cephfs 2024-04-16T14:24:27.877 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install python3-rados 2024-04-16T14:24:28.461 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:42 ago on Tue 16 Apr 2024 02:22:46 PM UTC. 2024-04-16T14:24:28.470 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:43 ago on Tue 16 Apr 2024 02:22:45 PM UTC. 2024-04-16T14:24:28.563 INFO:teuthology.orchestra.run.smithi115.stdout:Package python3-rados-2:17.2.7-868.g412a5526.el9.x86_64 is already installed. 2024-04-16T14:24:28.573 INFO:teuthology.orchestra.run.smithi005.stdout:Package python3-cephfs-2:17.2.7-868.g412a5526.el9.x86_64 is already installed. 2024-04-16T14:24:28.616 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-16T14:24:28.617 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-04-16T14:24:28.617 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-16T14:24:28.629 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-16T14:24:28.630 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-04-16T14:24:28.630 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-16T14:24:28.689 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install python3-rgw 2024-04-16T14:24:28.703 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install python3-rbd 2024-04-16T14:24:29.270 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:43 ago on Tue 16 Apr 2024 02:22:46 PM UTC. 2024-04-16T14:24:29.300 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:44 ago on Tue 16 Apr 2024 02:22:45 PM UTC. 2024-04-16T14:24:29.370 INFO:teuthology.orchestra.run.smithi115.stdout:Package python3-rgw-2:17.2.7-868.g412a5526.el9.x86_64 is already installed. 2024-04-16T14:24:29.405 INFO:teuthology.orchestra.run.smithi005.stdout:Package python3-rbd-2:17.2.7-868.g412a5526.el9.x86_64 is already installed. 2024-04-16T14:24:29.423 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-16T14:24:29.424 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-04-16T14:24:29.424 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-16T14:24:29.460 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-16T14:24:29.462 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-04-16T14:24:29.462 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-16T14:24:29.502 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install python3-cephfs 2024-04-16T14:24:29.536 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install rbd-fuse 2024-04-16T14:24:30.086 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:44 ago on Tue 16 Apr 2024 02:22:46 PM UTC. 2024-04-16T14:24:30.142 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:45 ago on Tue 16 Apr 2024 02:22:45 PM UTC. 2024-04-16T14:24:30.182 INFO:teuthology.orchestra.run.smithi115.stdout:Package python3-cephfs-2:17.2.7-868.g412a5526.el9.x86_64 is already installed. 2024-04-16T14:24:30.234 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-16T14:24:30.235 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-04-16T14:24:30.235 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-16T14:24:30.301 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install python3-rbd 2024-04-16T14:24:30.303 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-16T14:24:30.305 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:24:30.305 INFO:teuthology.orchestra.run.smithi005.stdout: Package Architecture Version Repository Size 2024-04-16T14:24:30.305 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:24:30.305 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-04-16T14:24:30.305 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse x86_64 2:17.2.7-868.g412a5526.el9 ceph 82 k 2024-04-16T14:24:30.305 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:30.305 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-04-16T14:24:30.305 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:24:30.305 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2024-04-16T14:24:30.305 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:30.305 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 82 k 2024-04-16T14:24:30.305 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 222 k 2024-04-16T14:24:30.306 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-04-16T14:24:30.640 INFO:teuthology.orchestra.run.smithi005.stdout:rbd-fuse-17.2.7-868.g412a5526.el9.x86_64.rpm 244 kB/s | 82 kB 00:00 2024-04-16T14:24:30.641 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:24:30.641 INFO:teuthology.orchestra.run.smithi005.stdout:Total 243 kB/s | 82 kB 00:00 2024-04-16T14:24:30.641 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-04-16T14:24:30.648 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-04-16T14:24:30.648 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-04-16T14:24:30.708 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-04-16T14:24:30.709 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-04-16T14:24:30.851 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-04-16T14:24:30.954 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:44 ago on Tue 16 Apr 2024 02:22:46 PM UTC. 2024-04-16T14:24:30.966 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-fuse-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:30.989 INFO:teuthology.orchestra.run.smithi115.stdout:Package python3-rbd-2:17.2.7-868.g412a5526.el9.x86_64 is already installed. 2024-04-16T14:24:31.041 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-16T14:24:31.043 INFO:teuthology.orchestra.run.smithi115.stdout:Nothing to do. 2024-04-16T14:24:31.043 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-16T14:24:31.119 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install rbd-fuse 2024-04-16T14:24:31.346 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-fuse-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:31.664 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-fuse-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:31.664 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:31.664 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-04-16T14:24:31.664 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:24:31.664 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:31.664 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-16T14:24:31.712 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:45 ago on Tue 16 Apr 2024 02:22:46 PM UTC. 2024-04-16T14:24:31.866 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-16T14:24:31.867 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:24:31.867 INFO:teuthology.orchestra.run.smithi115.stdout: Package Architecture Version Repository Size 2024-04-16T14:24:31.867 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:24:31.867 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-04-16T14:24:31.867 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse x86_64 2:17.2.7-868.g412a5526.el9 ceph 82 k 2024-04-16T14:24:31.867 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:31.867 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-04-16T14:24:31.867 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:24:31.867 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-04-16T14:24:31.868 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:31.868 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 82 k 2024-04-16T14:24:31.868 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 222 k 2024-04-16T14:24:31.868 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-04-16T14:24:31.897 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install rbd-mirror 2024-04-16T14:24:32.086 INFO:teuthology.orchestra.run.smithi115.stdout:rbd-fuse-17.2.7-868.g412a5526.el9.x86_64.rpm 374 kB/s | 82 kB 00:00 2024-04-16T14:24:32.087 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:24:32.087 INFO:teuthology.orchestra.run.smithi115.stdout:Total 372 kB/s | 82 kB 00:00 2024-04-16T14:24:32.087 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-04-16T14:24:32.094 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-04-16T14:24:32.094 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-04-16T14:24:32.148 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-04-16T14:24:32.148 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-04-16T14:24:32.278 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-04-16T14:24:32.375 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-fuse-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:32.501 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:47 ago on Tue 16 Apr 2024 02:22:45 PM UTC. 2024-04-16T14:24:32.664 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-16T14:24:32.665 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:24:32.665 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2024-04-16T14:24:32.665 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:24:32.665 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-04-16T14:24:32.666 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror x86_64 2:17.2.7-868.g412a5526.el9 ceph 2.9 M 2024-04-16T14:24:32.666 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:32.666 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-04-16T14:24:32.666 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:24:32.666 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2024-04-16T14:24:32.666 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:32.666 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 2.9 M 2024-04-16T14:24:32.666 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 12 M 2024-04-16T14:24:32.666 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-04-16T14:24:32.759 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: rbd-fuse-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:33.032 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-fuse-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:33.033 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:33.033 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-04-16T14:24:33.033 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:24:33.033 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:33.033 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-16T14:24:33.261 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install rbd-mirror 2024-04-16T14:24:33.860 INFO:teuthology.orchestra.run.smithi005.stdout:rbd-mirror-17.2.7-868.g412a5526.el9.x86_64.rpm 2.5 MB/s | 2.9 MB 00:01 2024-04-16T14:24:33.861 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:24:33.862 INFO:teuthology.orchestra.run.smithi005.stdout:Total 2.5 MB/s | 2.9 MB 00:01 2024-04-16T14:24:33.862 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-04-16T14:24:33.862 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:47 ago on Tue 16 Apr 2024 02:22:46 PM UTC. 2024-04-16T14:24:33.873 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-04-16T14:24:33.874 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-04-16T14:24:33.952 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-04-16T14:24:33.952 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-04-16T14:24:34.027 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-16T14:24:34.028 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:24:34.028 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repo Size 2024-04-16T14:24:34.028 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:24:34.028 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-04-16T14:24:34.028 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror x86_64 2:17.2.7-868.g412a5526.el9 ceph 2.9 M 2024-04-16T14:24:34.029 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:34.029 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-04-16T14:24:34.029 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:24:34.029 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-04-16T14:24:34.029 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:34.029 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 2.9 M 2024-04-16T14:24:34.029 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 12 M 2024-04-16T14:24:34.029 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-04-16T14:24:34.379 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-04-16T14:24:34.478 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-mirror-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:34.502 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-mirror-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:34.502 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T14:24:34.502 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-16T14:24:34.502 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T14:24:34.503 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T14:24:34.503 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:35.673 INFO:teuthology.orchestra.run.smithi115.stdout:rbd-mirror-17.2.7-868.g412a5526.el9.x86_64.rpm 1.8 MB/s | 2.9 MB 00:01 2024-04-16T14:24:35.674 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:24:35.674 INFO:teuthology.orchestra.run.smithi115.stdout:Total 1.8 MB/s | 2.9 MB 00:01 2024-04-16T14:24:35.674 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-04-16T14:24:35.684 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-04-16T14:24:35.684 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-04-16T14:24:35.722 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-mirror-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:35.722 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:35.722 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-04-16T14:24:35.722 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:24:35.722 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:35.722 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-16T14:24:35.756 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-04-16T14:24:35.757 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-04-16T14:24:35.944 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install rbd-nbd 2024-04-16T14:24:36.165 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-04-16T14:24:36.223 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-mirror-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:36.250 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: rbd-mirror-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:36.250 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T14:24:36.250 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-16T14:24:36.250 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T14:24:36.250 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T14:24:36.250 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:36.558 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:51 ago on Tue 16 Apr 2024 02:22:45 PM UTC. 2024-04-16T14:24:36.718 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-04-16T14:24:36.718 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:24:36.718 INFO:teuthology.orchestra.run.smithi005.stdout: Package Architecture Version Repository Size 2024-04-16T14:24:36.719 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:24:36.719 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-04-16T14:24:36.719 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd x86_64 2:17.2.7-868.g412a5526.el9 ceph 165 k 2024-04-16T14:24:36.719 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:36.719 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-04-16T14:24:36.719 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-04-16T14:24:36.719 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2024-04-16T14:24:36.719 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:36.719 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 165 k 2024-04-16T14:24:36.719 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 477 k 2024-04-16T14:24:36.719 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-04-16T14:24:36.949 INFO:teuthology.orchestra.run.smithi005.stdout:rbd-nbd-17.2.7-868.g412a5526.el9.x86_64.rpm 717 kB/s | 165 kB 00:00 2024-04-16T14:24:36.950 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:24:36.950 INFO:teuthology.orchestra.run.smithi005.stdout:Total 712 kB/s | 165 kB 00:00 2024-04-16T14:24:36.950 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-04-16T14:24:36.960 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-04-16T14:24:36.960 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-04-16T14:24:37.017 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-04-16T14:24:37.017 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-04-16T14:24:37.168 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-04-16T14:24:37.284 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-nbd-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:37.422 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-mirror-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:37.422 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:37.422 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-04-16T14:24:37.422 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:24:37.422 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:37.422 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-16T14:24:37.659 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install rbd-nbd 2024-04-16T14:24:37.710 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-nbd-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:38.002 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-nbd-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:38.002 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:38.002 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-04-16T14:24:38.002 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:24:38.003 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:24:38.003 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-04-16T14:24:38.222 DEBUG:teuthology.parallel:result is None 2024-04-16T14:24:38.261 INFO:teuthology.orchestra.run.smithi115.stdout:Last metadata expiration check: 0:01:52 ago on Tue 16 Apr 2024 02:22:46 PM UTC. 2024-04-16T14:24:38.416 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-04-16T14:24:38.416 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:24:38.417 INFO:teuthology.orchestra.run.smithi115.stdout: Package Architecture Version Repository Size 2024-04-16T14:24:38.417 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:24:38.417 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-04-16T14:24:38.417 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd x86_64 2:17.2.7-868.g412a5526.el9 ceph 165 k 2024-04-16T14:24:38.417 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:38.417 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-04-16T14:24:38.417 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2024-04-16T14:24:38.417 INFO:teuthology.orchestra.run.smithi115.stdout:Install 1 Package 2024-04-16T14:24:38.417 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:38.418 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 165 k 2024-04-16T14:24:38.418 INFO:teuthology.orchestra.run.smithi115.stdout:Installed size: 477 k 2024-04-16T14:24:38.418 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-04-16T14:24:38.836 INFO:teuthology.orchestra.run.smithi115.stdout:rbd-nbd-17.2.7-868.g412a5526.el9.x86_64.rpm 395 kB/s | 165 kB 00:00 2024-04-16T14:24:38.837 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:24:38.837 INFO:teuthology.orchestra.run.smithi115.stdout:Total 393 kB/s | 165 kB 00:00 2024-04-16T14:24:38.837 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-04-16T14:24:38.845 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-04-16T14:24:38.845 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-04-16T14:24:38.901 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-04-16T14:24:38.901 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-04-16T14:24:39.052 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-04-16T14:24:39.158 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-nbd-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:39.550 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: rbd-nbd-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:39.844 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-nbd-2:17.2.7-868.g412a5526.el9.x86_64 1/1 2024-04-16T14:24:39.844 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:39.844 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-04-16T14:24:39.844 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd-2:17.2.7-868.g412a5526.el9.x86_64 2024-04-16T14:24:39.844 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:24:39.844 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-04-16T14:24:40.110 DEBUG:teuthology.parallel:result is None 2024-04-16T14:24:40.111 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-16T14:24:40.111 INFO:teuthology.packaging:ref: None 2024-04-16T14:24:40.111 INFO:teuthology.packaging:tag: None 2024-04-16T14:24:40.111 INFO:teuthology.packaging:branch: quincy 2024-04-16T14:24:40.111 INFO:teuthology.packaging:sha1: 36befe5d41ee8a6ea2e60983e763134278d506cf 2024-04-16T14:24:40.112 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-16T14:24:40.413 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-16T14:24:40.439 INFO:teuthology.orchestra.run.smithi005.stdout:17.2.7-868.g412a5526.el9 2024-04-16T14:24:40.439 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-868.g412a5526.el9 2024-04-16T14:24:40.440 INFO:teuthology.task.install:The correct ceph version 17.2.7-868.g412a5526 is installed. 2024-04-16T14:24:40.441 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-16T14:24:40.441 INFO:teuthology.packaging:ref: None 2024-04-16T14:24:40.441 INFO:teuthology.packaging:tag: None 2024-04-16T14:24:40.441 INFO:teuthology.packaging:branch: quincy 2024-04-16T14:24:40.442 INFO:teuthology.packaging:sha1: 36befe5d41ee8a6ea2e60983e763134278d506cf 2024-04-16T14:24:40.442 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-16T14:24:40.646 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-16T14:24:40.669 INFO:teuthology.orchestra.run.smithi115.stdout:17.2.7-868.g412a5526.el9 2024-04-16T14:24:40.670 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-868.g412a5526.el9 2024-04-16T14:24:40.670 INFO:teuthology.task.install:The correct ceph version 17.2.7-868.g412a5526 is installed. 2024-04-16T14:24:40.672 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-16T14:24:40.672 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-16T14:24:40.672 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-16T14:24:40.706 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-16T14:24:40.706 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-16T14:24:40.738 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-16T14:24:40.738 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-16T14:24:40.738 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/daemon-helper 2024-04-16T14:24:40.779 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-16T14:24:40.851 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-16T14:24:40.851 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/daemon-helper 2024-04-16T14:24:40.880 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-16T14:24:40.948 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-16T14:24:40.948 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-16T14:24:40.948 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-16T14:24:40.980 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-16T14:24:41.051 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-16T14:24:41.051 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-16T14:24:41.080 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-16T14:24:41.150 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-16T14:24:41.151 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-16T14:24:41.151 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/stdin-killer 2024-04-16T14:24:41.181 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-16T14:24:41.252 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-16T14:24:41.252 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/stdin-killer 2024-04-16T14:24:41.280 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-16T14:24:41.348 INFO:teuthology.run_tasks:Running task print... 2024-04-16T14:24:41.358 INFO:teuthology.task.print:**** done install task... 2024-04-16T14:24:41.358 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-16T14:24:41.512 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': '36befe5d41ee8a6ea2e60983e763134278d506cf'} 2024-04-16T14:24:41.512 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-04-16T14:24:41.512 INFO:tasks.cephadm:Cluster fsid is 10609bfa-fbfd-11ee-bc90-c7b262605968 2024-04-16T14:24:41.513 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-16T14:24:41.513 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-04-16T14:24:41.513 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi005': '172.21.15.5', 'mon.smithi115': '172.21.15.115'} 2024-04-16T14:24:41.513 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-16T14:24:41.513 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname $(hostname -s) 2024-04-16T14:24:41.545 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname $(hostname -s) 2024-04-16T14:24:41.573 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-04-16T14:24:41.574 DEBUG:teuthology.orchestra.run.smithi005:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-16T14:24:41.846 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r--. 1 ubuntu ubuntu 375153 Apr 16 14:24 /home/ubuntu/cephtest/cephadm 2024-04-16T14:24:41.846 DEBUG:teuthology.orchestra.run.smithi115:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-16T14:24:42.074 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r--. 1 ubuntu ubuntu 375153 Apr 16 14:24 /home/ubuntu/cephtest/cephadm 2024-04-16T14:24:42.074 DEBUG:teuthology.orchestra.run.smithi005:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-16T14:24:42.093 DEBUG:teuthology.orchestra.run.smithi115:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-16T14:24:42.120 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-04-16T14:24:42.120 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-04-16T14:24:42.136 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-04-16T14:24:43.027 INFO:teuthology.orchestra.run.smithi005.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-16T14:24:43.096 INFO:teuthology.orchestra.run.smithi115.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-16T14:25:32.223 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:25:32.224 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)", 2024-04-16T14:25:32.224 INFO:teuthology.orchestra.run.smithi005.stdout: "image_id": "b04d96489b7caae41247d23636ddaa80f54b8d6ea9d961629a77038693cd9669", 2024-04-16T14:25:32.224 INFO:teuthology.orchestra.run.smithi005.stdout: "repo_digests": [ 2024-04-16T14:25:32.224 INFO:teuthology.orchestra.run.smithi005.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:15b9a118425d53cc97d2f7bc08f63df1d8bfa1149df59d4de72a305b04501998" 2024-04-16T14:25:32.224 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-04-16T14:25:32.224 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:25:36.111 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-04-16T14:25:36.111 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_version": "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)", 2024-04-16T14:25:36.111 INFO:teuthology.orchestra.run.smithi115.stdout: "image_id": "b04d96489b7caae41247d23636ddaa80f54b8d6ea9d961629a77038693cd9669", 2024-04-16T14:25:36.111 INFO:teuthology.orchestra.run.smithi115.stdout: "repo_digests": [ 2024-04-16T14:25:36.111 INFO:teuthology.orchestra.run.smithi115.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:15b9a118425d53cc97d2f7bc08f63df1d8bfa1149df59d4de72a305b04501998" 2024-04-16T14:25:36.112 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-04-16T14:25:36.112 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-04-16T14:25:36.131 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph 2024-04-16T14:25:36.168 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /etc/ceph 2024-04-16T14:25:36.200 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 777 /etc/ceph 2024-04-16T14:25:36.240 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 777 /etc/ceph 2024-04-16T14:25:36.268 INFO:tasks.cephadm:Writing seed config... 2024-04-16T14:25:36.269 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-04-16T14:25:36.269 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-04-16T14:25:36.269 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-04-16T14:25:36.269 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-04-16T14:25:36.269 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-04-16T14:25:36.269 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-16T14:25:36.269 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-16T14:25:36.269 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-04-16T14:25:36.269 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-04-16T14:25:36.270 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-16T14:25:36.270 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-16T14:25:36.270 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-04-16T14:25:36.270 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-16T14:25:36.270 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-16T14:25:36.270 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-16T14:25:36.270 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-16T14:25:36.270 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-16T14:25:36.270 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-16T14:25:36.270 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-16T14:25:36.270 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-16T14:25:36.270 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-16T14:25:36.270 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-16T14:25:36.270 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-16T14:25:36.270 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-04-16T14:25:36.271 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-16T14:25:36.271 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-16T14:25:36.271 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-16T14:25:36.271 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-16T14:25:36.271 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-16T14:25:36.271 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-16T14:25:36.271 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-16T14:25:36.271 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-16T14:25:36.271 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-16T14:25:36.271 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-16T14:25:36.271 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-04-16T14:25:36.271 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-16T14:25:36.271 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-16T14:25:36.271 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-16T14:25:36.271 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-16T14:25:36.272 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-16T14:25:36.272 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-04-16T14:25:36.272 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-16T14:25:36.272 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-16T14:25:36.272 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-16T14:25:36.297 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 10609bfa-fbfd-11ee-bc90-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-16T14:25:36.297 DEBUG:teuthology.orchestra.run.smithi005:mon.smithi005> sudo journalctl -f -n 0 -u ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@mon.smithi005.service 2024-04-16T14:25:36.339 INFO:tasks.cephadm:Bootstrapping... 2024-04-16T14:25:36.339 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.5 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-16T14:25:36.556 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-04-16T14:25:36.556 INFO:teuthology.orchestra.run.smithi005.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '10609bfa-fbfd-11ee-bc90-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.5', '--skip-admin-label'] 2024-04-16T14:25:36.582 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-16T14:25:36.582 INFO:teuthology.orchestra.run.smithi005.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-16T14:25:36.583 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying podman|docker is present... 2024-04-16T14:25:36.606 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-16T14:25:36.606 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying lvm2 is present... 2024-04-16T14:25:36.606 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying time synchronization is in place... 2024-04-16T14:25:36.614 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-16T14:25:36.615 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-16T14:25:36.621 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-16T14:25:36.621 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-04-16T14:25:36.628 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout enabled 2024-04-16T14:25:36.634 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout active 2024-04-16T14:25:36.634 INFO:teuthology.orchestra.run.smithi005.stdout:Unit chronyd.service is enabled and running 2024-04-16T14:25:36.634 INFO:teuthology.orchestra.run.smithi005.stdout:Repeating the final host check... 2024-04-16T14:25:36.658 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-16T14:25:36.658 INFO:teuthology.orchestra.run.smithi005.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-16T14:25:36.658 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl is present 2024-04-16T14:25:36.658 INFO:teuthology.orchestra.run.smithi005.stdout:lvcreate is present 2024-04-16T14:25:36.665 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-16T14:25:36.665 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-16T14:25:36.671 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-16T14:25:36.671 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-04-16T14:25:36.678 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout enabled 2024-04-16T14:25:36.684 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout active 2024-04-16T14:25:36.685 INFO:teuthology.orchestra.run.smithi005.stdout:Unit chronyd.service is enabled and running 2024-04-16T14:25:36.685 INFO:teuthology.orchestra.run.smithi005.stdout:Host looks OK 2024-04-16T14:25:36.685 INFO:teuthology.orchestra.run.smithi005.stdout:Cluster fsid: 10609bfa-fbfd-11ee-bc90-c7b262605968 2024-04-16T14:25:36.685 INFO:teuthology.orchestra.run.smithi005.stdout:Acquiring lock 140257777931360 on /run/cephadm/10609bfa-fbfd-11ee-bc90-c7b262605968.lock 2024-04-16T14:25:36.685 INFO:teuthology.orchestra.run.smithi005.stdout:Lock 140257777931360 acquired on /run/cephadm/10609bfa-fbfd-11ee-bc90-c7b262605968.lock 2024-04-16T14:25:36.686 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying IP 172.21.15.5 port 3300 ... 2024-04-16T14:25:36.686 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying IP 172.21.15.5 port 6789 ... 2024-04-16T14:25:36.686 INFO:teuthology.orchestra.run.smithi005.stdout:Base mon IP(s) is [172.21.15.5:3300, 172.21.15.5:6789], mon addrv is [v2:172.21.15.5:3300,v1:172.21.15.5:6789] 2024-04-16T14:25:36.689 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.5 metric 100 2024-04-16T14:25:36.689 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.5 metric 100 2024-04-16T14:25:36.692 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-16T14:25:36.692 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-04-16T14:25:36.692 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-04-16T14:25:36.695 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-16T14:25:36.695 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-16T14:25:36.695 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-16T14:25:36.695 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-04-16T14:25:36.695 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1442/64 scope link noprefixroute 2024-04-16T14:25:36.695 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-16T14:25:36.696 INFO:teuthology.orchestra.run.smithi005.stdout:Mon IP `172.21.15.5` is in CIDR network `172.21.0.0/20` 2024-04-16T14:25:36.696 INFO:teuthology.orchestra.run.smithi005.stdout:Mon IP `172.21.15.5` is in CIDR network `172.21.0.0/20` 2024-04-16T14:25:36.696 INFO:teuthology.orchestra.run.smithi005.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-16T14:25:36.696 INFO:teuthology.orchestra.run.smithi005.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-16T14:25:36.697 INFO:teuthology.orchestra.run.smithi005.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-16T14:25:37.182 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stdout b04d96489b7caae41247d23636ddaa80f54b8d6ea9d961629a77038693cd9669 2024-04-16T14:25:37.182 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-16T14:25:37.182 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Getting image source signatures 2024-04-16T14:25:37.182 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Copying blob sha256:8302116ad2286396ce0342c687a68abc8f9f5d182a28dc8f39ad1b135fc56f5f 2024-04-16T14:25:37.182 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Copying blob sha256:9793b5b5582798bde394f4383d142e9f248a25e4ebfd72ee05ea9ec6251a877d 2024-04-16T14:25:37.183 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Copying config sha256:b04d96489b7caae41247d23636ddaa80f54b8d6ea9d961629a77038693cd9669 2024-04-16T14:25:37.183 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-16T14:25:38.103 INFO:teuthology.orchestra.run.smithi005.stdout:ceph: stdout ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable) 2024-04-16T14:25:38.104 INFO:teuthology.orchestra.run.smithi005.stdout:Ceph version: ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable) 2024-04-16T14:25:38.104 INFO:teuthology.orchestra.run.smithi005.stdout:Extracting ceph user uid/gid from container image... 2024-04-16T14:25:39.018 INFO:teuthology.orchestra.run.smithi005.stdout:stat: stdout 167 167 2024-04-16T14:25:39.018 INFO:teuthology.orchestra.run.smithi005.stdout:Creating initial keys... 2024-04-16T14:25:39.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-authtool: stdout AQBjih5mLI4aFxAA1sCJjFOip5liM7HYPUcNnw== 2024-04-16T14:25:40.904 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-authtool: stdout AQBkih5mVQRzEhAAJQLfT/zEN8i19OZTMpKYYw== 2024-04-16T14:25:41.885 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-authtool: stdout AQBlih5mu9TGDRAAAKmj3E2oI6B/NfCVfiIoLw== 2024-04-16T14:25:41.885 INFO:teuthology.orchestra.run.smithi005.stdout:Creating initial monmap... 2024-04-16T14:25:42.891 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-16T14:25:42.891 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-04-16T14:25:42.891 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 10609bfa-fbfd-11ee-bc90-c7b262605968 2024-04-16T14:25:42.891 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-16T14:25:42.892 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool for smithi005 [v2:172.21.15.5:3300,v1:172.21.15.5:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-16T14:25:42.892 INFO:teuthology.orchestra.run.smithi005.stdout:setting min_mon_release = octopus 2024-04-16T14:25:42.892 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: set fsid to 10609bfa-fbfd-11ee-bc90-c7b262605968 2024-04-16T14:25:42.892 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-16T14:25:42.892 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:25:42.892 INFO:teuthology.orchestra.run.smithi005.stdout:Creating mon... 2024-04-16T14:25:43.831 INFO:teuthology.orchestra.run.smithi005.stdout:create mon.smithi005 on 2024-04-16T14:25:44.030 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-04-16T14:25:44.192 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-16T14:25:44.348 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-10609bfa-fbfd-11ee-bc90-c7b262605968.target → /etc/systemd/system/ceph-10609bfa-fbfd-11ee-bc90-c7b262605968.target. 2024-04-16T14:25:44.348 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-10609bfa-fbfd-11ee-bc90-c7b262605968.target → /etc/systemd/system/ceph-10609bfa-fbfd-11ee-bc90-c7b262605968.target. 2024-04-16T14:25:44.538 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@mon.smithi005 2024-04-16T14:25:44.539 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to reset failed state of unit ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@mon.smithi005.service: Unit ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@mon.smithi005.service not loaded. 2024-04-16T14:25:44.706 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-10609bfa-fbfd-11ee-bc90-c7b262605968.target.wants/ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@mon.smithi005.service → /etc/systemd/system/ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@.service. 2024-04-16T14:25:45.221 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-16T14:25:45.221 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2024-04-16T14:25:45.228 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-16T14:25:45.229 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-04-16T14:25:45.229 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2024-04-16T14:25:45.229 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to enable service . firewalld.service is not available 2024-04-16T14:25:45.229 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mon to start... 2024-04-16T14:25:45.229 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mon... 2024-04-16T14:25:45.349 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:45 smithi005 systemd[1]: Started Ceph mon.smithi005 for 10609bfa-fbfd-11ee-bc90-c7b262605968. 2024-04-16T14:25:46.314 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout cluster: 2024-04-16T14:25:46.314 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout id: 10609bfa-fbfd-11ee-bc90-c7b262605968 2024-04-16T14:25:46.314 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-16T14:25:46.314 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-04-16T14:25:46.314 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout services: 2024-04-16T14:25:46.314 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi005 (age 0.549114s) 2024-04-16T14:25:46.315 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-16T14:25:46.315 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-16T14:25:46.315 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-04-16T14:25:46.315 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout data: 2024-04-16T14:25:46.315 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-16T14:25:46.315 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-16T14:25:46.315 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-16T14:25:46.315 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout pgs: 2024-04-16T14:25:46.315 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-04-16T14:25:46.315 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.659+0000 7f396cca0700 1 Processor -- start 2024-04-16T14:25:46.315 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.659+0000 7f396cca0700 1 -- start start 2024-04-16T14:25:46.316 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.660+0000 7f396cca0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3968102980 0x7f3968102d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:25:46.316 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.660+0000 7f396cca0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39681032d0 con 0x7f3968102980 2024-04-16T14:25:46.316 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.660+0000 7f396659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3968102980 0x7f3968102d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:25:46.316 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.660+0000 7f396659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3968102980 0x7f3968102d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57646/0 (socket says 172.21.15.5:57646) 2024-04-16T14:25:46.316 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.660+0000 7f396659c700 1 -- 172.21.15.5:0/1355238653 learned_addr learned my addr 172.21.15.5:0/1355238653 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:25:46.316 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.660+0000 7f396659c700 1 -- 172.21.15.5:0/1355238653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3968103410 con 0x7f3968102980 2024-04-16T14:25:46.316 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.661+0000 7f396659c700 1 --2- 172.21.15.5:0/1355238653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3968102980 0x7f3968102d90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3958009e50 tx=0x7f3958009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=532accae711dd1d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:25:46.316 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.661+0000 7f396559a700 1 -- 172.21.15.5:0/1355238653 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f39580092e0 con 0x7f3968102980 2024-04-16T14:25:46.316 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.661+0000 7f396559a700 1 -- 172.21.15.5:0/1355238653 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395800bab0 con 0x7f3968102980 2024-04-16T14:25:46.316 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.661+0000 7f396559a700 1 -- 172.21.15.5:0/1355238653 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f395800bdc0 con 0x7f3968102980 2024-04-16T14:25:46.316 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.661+0000 7f396cca0700 1 -- 172.21.15.5:0/1355238653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3968102980 msgr2=0x7f3968102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:25:46.316 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.661+0000 7f396cca0700 1 --2- 172.21.15.5:0/1355238653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3968102980 0x7f3968102d90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3958009e50 tx=0x7f3958009840 comp rx=0 tx=0).stop 2024-04-16T14:25:46.316 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.661+0000 7f396cca0700 1 -- 172.21.15.5:0/1355238653 shutdown_connections 2024-04-16T14:25:46.316 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.661+0000 7f396cca0700 1 --2- 172.21.15.5:0/1355238653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3968102980 0x7f3968102d90 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:25:46.317 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.661+0000 7f396cca0700 1 -- 172.21.15.5:0/1355238653 >> 172.21.15.5:0/1355238653 conn(0x7f39680fe0a0 msgr2=0x7f3968100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:25:46.317 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.662+0000 7f396cca0700 1 -- 172.21.15.5:0/1355238653 shutdown_connections 2024-04-16T14:25:46.317 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.662+0000 7f396cca0700 1 -- 172.21.15.5:0/1355238653 wait complete. 2024-04-16T14:25:46.317 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.662+0000 7f396cca0700 1 Processor -- start 2024-04-16T14:25:46.317 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.662+0000 7f396cca0700 1 -- start start 2024-04-16T14:25:46.317 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.662+0000 7f396cca0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3968102980 0x7f3968110f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:25:46.317 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.662+0000 7f396cca0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3968111440 con 0x7f3968102980 2024-04-16T14:25:46.317 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.662+0000 7f396659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3968102980 0x7f3968110f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:25:46.317 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.662+0000 7f396659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3968102980 0x7f3968110f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57660/0 (socket says 172.21.15.5:57660) 2024-04-16T14:25:46.317 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.662+0000 7f396659c700 1 -- 172.21.15.5:0/3735696619 learned_addr learned my addr 172.21.15.5:0/3735696619 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:25:46.317 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.663+0000 7f396659c700 1 -- 172.21.15.5:0/3735696619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3958009ae0 con 0x7f3968102980 2024-04-16T14:25:46.317 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.663+0000 7f396659c700 1 --2- 172.21.15.5:0/3735696619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3968102980 0x7f3968110f00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f39681036c0 tx=0x7f3958017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:25:46.317 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.663+0000 7f395effd700 1 -- 172.21.15.5:0/3735696619 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3958012cf0 con 0x7f3968102980 2024-04-16T14:25:46.317 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.663+0000 7f395effd700 1 -- 172.21.15.5:0/3735696619 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3958012e70 con 0x7f3968102980 2024-04-16T14:25:46.318 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.663+0000 7f396cca0700 1 -- 172.21.15.5:0/3735696619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3968111640 con 0x7f3968102980 2024-04-16T14:25:46.318 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.663+0000 7f395effd700 1 -- 172.21.15.5:0/3735696619 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f395801e580 con 0x7f3968102980 2024-04-16T14:25:46.318 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.663+0000 7f396cca0700 1 -- 172.21.15.5:0/3735696619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39681121b0 con 0x7f3968102980 2024-04-16T14:25:46.318 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.663+0000 7f395effd700 1 -- 172.21.15.5:0/3735696619 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f3958019030 con 0x7f3968102980 2024-04-16T14:25:46.318 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.663+0000 7f395effd700 1 -- 172.21.15.5:0/3735696619 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3958026450 con 0x7f3968102980 2024-04-16T14:25:46.318 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.664+0000 7f396cca0700 1 -- 172.21.15.5:0/3735696619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f396805f5f0 con 0x7f3968102980 2024-04-16T14:25:46.318 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.666+0000 7f395effd700 1 -- 172.21.15.5:0/3735696619 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f3958045790 con 0x7f3968102980 2024-04-16T14:25:46.318 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.738+0000 7f396cca0700 1 -- 172.21.15.5:0/3735696619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f3968112bf0 con 0x7f3968102980 2024-04-16T14:25:46.318 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.738+0000 7f395effd700 1 -- 172.21.15.5:0/3735696619 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f3958034070 con 0x7f3968102980 2024-04-16T14:25:46.318 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.739+0000 7f396cca0700 1 -- 172.21.15.5:0/3735696619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3968102980 msgr2=0x7f3968110f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:25:46.318 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.739+0000 7f396cca0700 1 --2- 172.21.15.5:0/3735696619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3968102980 0x7f3968110f00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f39681036c0 tx=0x7f3958017000 comp rx=0 tx=0).stop 2024-04-16T14:25:46.319 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.739+0000 7f396cca0700 1 -- 172.21.15.5:0/3735696619 shutdown_connections 2024-04-16T14:25:46.319 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.739+0000 7f396cca0700 1 --2- 172.21.15.5:0/3735696619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3968102980 0x7f3968110f00 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:25:46.319 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.739+0000 7f396cca0700 1 -- 172.21.15.5:0/3735696619 >> 172.21.15.5:0/3735696619 conn(0x7f39680fe0a0 msgr2=0x7f3968107db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:25:46.319 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.739+0000 7f396cca0700 1 -- 172.21.15.5:0/3735696619 shutdown_connections 2024-04-16T14:25:46.319 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:45.739+0000 7f396cca0700 1 -- 172.21.15.5:0/3735696619 wait complete. 2024-04-16T14:25:46.319 INFO:teuthology.orchestra.run.smithi005.stdout:mon is available 2024-04-16T14:25:46.319 INFO:teuthology.orchestra.run.smithi005.stdout:Assimilating anything we can from ceph.conf... 2024-04-16T14:25:46.414 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:46 smithi005 ceph-mon[28588]: mon.smithi005 is new leader, mons smithi005 in quorum (ranks 0) 2024-04-16T14:25:46.415 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:46 smithi005 ceph-mon[28588]: monmap e1: 1 mons at {smithi005=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-16T14:25:46.415 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:46 smithi005 ceph-mon[28588]: fsmap 2024-04-16T14:25:46.415 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:46 smithi005 ceph-mon[28588]: osdmap e1: 0 total, 0 up, 0 in 2024-04-16T14:25:46.415 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:46 smithi005 ceph-mon[28588]: mgrmap e1: no daemons active 2024-04-16T14:25:46.415 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:46 smithi005 ceph-mon[28588]: from='client.? 172.21.15.5:0/3735696619' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-16T14:25:47.369 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:47 smithi005 ceph-mon[28588]: from='client.? 172.21.15.5:0/3257459097' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-16T14:25:47.370 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:47 smithi005 ceph-mon[28588]: from='client.? 172.21.15.5:0/3257459097' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-16T14:25:47.378 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-04-16T14:25:47.379 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [global] 2024-04-16T14:25:47.379 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout fsid = 10609bfa-fbfd-11ee-bc90-c7b262605968 2024-04-16T14:25:47.379 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.5:3300,v1:172.21.15.5:6789] 2024-04-16T14:25:47.379 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-16T14:25:47.379 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-16T14:25:47.379 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-16T14:25:47.379 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-16T14:25:47.379 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-04-16T14:25:47.379 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-16T14:25:47.379 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-16T14:25:47.379 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-04-16T14:25:47.379 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [osd] 2024-04-16T14:25:47.379 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-16T14:25:47.380 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-16T14:25:47.380 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-16T14:25:47.380 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-16T14:25:47.380 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-16T14:25:47.380 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.746+0000 7f44b1bc3700 1 Processor -- start 2024-04-16T14:25:47.380 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.746+0000 7f44b1bc3700 1 -- start start 2024-04-16T14:25:47.380 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.747+0000 7f44b1bc3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac071290 0x7f44ac1054f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:25:47.380 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.747+0000 7f44b1bc3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac0716a0 con 0x7f44ac071290 2024-04-16T14:25:47.380 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.747+0000 7f44ab7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac071290 0x7f44ac1054f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:25:47.380 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.747+0000 7f44ab7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac071290 0x7f44ac1054f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57662/0 (socket says 172.21.15.5:57662) 2024-04-16T14:25:47.380 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.747+0000 7f44ab7fe700 1 -- 172.21.15.5:0/499656567 learned_addr learned my addr 172.21.15.5:0/499656567 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:25:47.380 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.747+0000 7f44ab7fe700 1 -- 172.21.15.5:0/499656567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ac105a30 con 0x7f44ac071290 2024-04-16T14:25:47.380 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.747+0000 7f44ab7fe700 1 --2- 172.21.15.5:0/499656567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac071290 0x7f44ac1054f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f449c0098e0 tx=0x7f449c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f545681d6a63b6d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:25:47.380 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.747+0000 7f44aa7fc700 1 -- 172.21.15.5:0/499656567 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f449c00b860 con 0x7f44ac071290 2024-04-16T14:25:47.381 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.747+0000 7f44aa7fc700 1 -- 172.21.15.5:0/499656567 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449c00b9c0 con 0x7f44ac071290 2024-04-16T14:25:47.381 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.747+0000 7f44aa7fc700 1 -- 172.21.15.5:0/499656567 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f449c00bc90 con 0x7f44ac071290 2024-04-16T14:25:47.381 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.748+0000 7f44b1bc3700 1 -- 172.21.15.5:0/499656567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac071290 msgr2=0x7f44ac1054f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:25:47.381 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.748+0000 7f44b1bc3700 1 --2- 172.21.15.5:0/499656567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac071290 0x7f44ac1054f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f449c0098e0 tx=0x7f449c009250 comp rx=0 tx=0).stop 2024-04-16T14:25:47.381 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.748+0000 7f44b1bc3700 1 -- 172.21.15.5:0/499656567 shutdown_connections 2024-04-16T14:25:47.381 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.748+0000 7f44b1bc3700 1 --2- 172.21.15.5:0/499656567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac071290 0x7f44ac1054f0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:25:47.381 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.748+0000 7f44b1bc3700 1 -- 172.21.15.5:0/499656567 >> 172.21.15.5:0/499656567 conn(0x7f44ac0fcf80 msgr2=0x7f44ac0ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:25:47.381 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.748+0000 7f44b1bc3700 1 -- 172.21.15.5:0/499656567 shutdown_connections 2024-04-16T14:25:47.381 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.748+0000 7f44b1bc3700 1 -- 172.21.15.5:0/499656567 wait complete. 2024-04-16T14:25:47.381 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.748+0000 7f44b1bc3700 1 Processor -- start 2024-04-16T14:25:47.381 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.749+0000 7f44b1bc3700 1 -- start start 2024-04-16T14:25:47.381 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.749+0000 7f44b1bc3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac071290 0x7f44ac102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:25:47.381 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.749+0000 7f44b1bc3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac103380 con 0x7f44ac071290 2024-04-16T14:25:47.381 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.749+0000 7f44ab7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac071290 0x7f44ac102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:25:47.381 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.749+0000 7f44ab7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac071290 0x7f44ac102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57676/0 (socket says 172.21.15.5:57676) 2024-04-16T14:25:47.382 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.749+0000 7f44ab7fe700 1 -- 172.21.15.5:0/3257459097 learned_addr learned my addr 172.21.15.5:0/3257459097 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:25:47.382 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.749+0000 7f44ab7fe700 1 -- 172.21.15.5:0/3257459097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c0094f0 con 0x7f44ac071290 2024-04-16T14:25:47.382 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.749+0000 7f44ab7fe700 1 --2- 172.21.15.5:0/3257459097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac071290 0x7f44ac102e40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f449c009290 tx=0x7f449c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:25:47.382 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.749+0000 7f4493fff700 1 -- 172.21.15.5:0/3257459097 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f449c01c5c0 con 0x7f44ac071290 2024-04-16T14:25:47.382 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.749+0000 7f4493fff700 1 -- 172.21.15.5:0/3257459097 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449c01c740 con 0x7f44ac071290 2024-04-16T14:25:47.382 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.749+0000 7f44b1bc3700 1 -- 172.21.15.5:0/3257459097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44ac1013f0 con 0x7f44ac071290 2024-04-16T14:25:47.382 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.750+0000 7f4493fff700 1 -- 172.21.15.5:0/3257459097 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f449c01ca50 con 0x7f44ac071290 2024-04-16T14:25:47.382 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.750+0000 7f44b1bc3700 1 -- 172.21.15.5:0/3257459097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44ac1018e0 con 0x7f44ac071290 2024-04-16T14:25:47.382 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.750+0000 7f4493fff700 1 -- 172.21.15.5:0/3257459097 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f449c01cbb0 con 0x7f44ac071290 2024-04-16T14:25:47.382 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.750+0000 7f4493fff700 1 -- 172.21.15.5:0/3257459097 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f449c01ac30 con 0x7f44ac071290 2024-04-16T14:25:47.382 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.751+0000 7f44b1bc3700 1 -- 172.21.15.5:0/3257459097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44ac04bed0 con 0x7f44ac071290 2024-04-16T14:25:47.382 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.753+0000 7f4493fff700 1 -- 172.21.15.5:0/3257459097 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f449c01adf0 con 0x7f44ac071290 2024-04-16T14:25:47.382 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.823+0000 7f44b1bc3700 1 -- 172.21.15.5:0/3257459097 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f44ac105da0 con 0x7f44ac071290 2024-04-16T14:25:47.382 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.826+0000 7f4493fff700 1 -- 172.21.15.5:0/3257459097 <== mon.0 v2:172.21.15.5:3300/0 7 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f449c01a450 con 0x7f44ac071290 2024-04-16T14:25:47.383 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.826+0000 7f4493fff700 1 -- 172.21.15.5:0/3257459097 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+427 (secure 0 0 0) 0x7f449c024560 con 0x7f44ac071290 2024-04-16T14:25:47.383 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.827+0000 7f44b1bc3700 1 -- 172.21.15.5:0/3257459097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac071290 msgr2=0x7f44ac102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:25:47.383 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.827+0000 7f44b1bc3700 1 --2- 172.21.15.5:0/3257459097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac071290 0x7f44ac102e40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f449c009290 tx=0x7f449c016000 comp rx=0 tx=0).stop 2024-04-16T14:25:47.383 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.827+0000 7f44b1bc3700 1 -- 172.21.15.5:0/3257459097 shutdown_connections 2024-04-16T14:25:47.383 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.827+0000 7f44b1bc3700 1 --2- 172.21.15.5:0/3257459097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac071290 0x7f44ac102e40 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:25:47.383 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.827+0000 7f44b1bc3700 1 -- 172.21.15.5:0/3257459097 >> 172.21.15.5:0/3257459097 conn(0x7f44ac0fcf80 msgr2=0x7f44ac0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:25:47.383 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.827+0000 7f44b1bc3700 1 -- 172.21.15.5:0/3257459097 shutdown_connections 2024-04-16T14:25:47.383 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:46.827+0000 7f44b1bc3700 1 -- 172.21.15.5:0/3257459097 wait complete. 2024-04-16T14:25:47.383 INFO:teuthology.orchestra.run.smithi005.stdout:Generating new minimal ceph.conf... 2024-04-16T14:25:49.223 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:48 smithi005 ceph-mon[28588]: from='client.? 172.21.15.5:0/3415869813' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:25:54.762 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.859+0000 7ff7122b6700 1 Processor -- start 2024-04-16T14:25:54.762 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.859+0000 7ff7122b6700 1 -- start start 2024-04-16T14:25:54.763 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.859+0000 7ff7122b6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff70c102940 0x7ff70c102d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:25:54.763 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.859+0000 7ff7122b6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70c103290 con 0x7ff70c102940 2024-04-16T14:25:54.763 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.860+0000 7ff70bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff70c102940 0x7ff70c102d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:25:54.763 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.860+0000 7ff70bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff70c102940 0x7ff70c102d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36160/0 (socket says 172.21.15.5:36160) 2024-04-16T14:25:54.763 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.860+0000 7ff70bfff700 1 -- 172.21.15.5:0/1739904811 learned_addr learned my addr 172.21.15.5:0/1739904811 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:25:54.763 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.860+0000 7ff70bfff700 1 -- 172.21.15.5:0/1739904811 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70c1033d0 con 0x7ff70c102940 2024-04-16T14:25:54.763 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.860+0000 7ff70bfff700 1 --2- 172.21.15.5:0/1739904811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff70c102940 0x7ff70c102d50 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0098e0 tx=0x7ff6fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc566058e448d73a server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:25:54.763 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.860+0000 7ff70b7fe700 1 -- 172.21.15.5:0/1739904811 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6fc00b860 con 0x7ff70c102940 2024-04-16T14:25:54.763 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.860+0000 7ff70b7fe700 1 -- 172.21.15.5:0/1739904811 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ff6fc00be50 con 0x7ff70c102940 2024-04-16T14:25:54.763 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.860+0000 7ff70b7fe700 1 -- 172.21.15.5:0/1739904811 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6fc010380 con 0x7ff70c102940 2024-04-16T14:25:54.763 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.861+0000 7ff7122b6700 1 -- 172.21.15.5:0/1739904811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff70c102940 msgr2=0x7ff70c102d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:25:54.763 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.861+0000 7ff7122b6700 1 --2- 172.21.15.5:0/1739904811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff70c102940 0x7ff70c102d50 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0098e0 tx=0x7ff6fc009250 comp rx=0 tx=0).stop 2024-04-16T14:25:54.763 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.861+0000 7ff7122b6700 1 -- 172.21.15.5:0/1739904811 shutdown_connections 2024-04-16T14:25:54.763 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.861+0000 7ff7122b6700 1 --2- 172.21.15.5:0/1739904811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff70c102940 0x7ff70c102d50 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:25:54.764 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.861+0000 7ff7122b6700 1 -- 172.21.15.5:0/1739904811 >> 172.21.15.5:0/1739904811 conn(0x7ff70c0fe0e0 msgr2=0x7ff70c1004f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:25:54.764 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.861+0000 7ff7122b6700 1 -- 172.21.15.5:0/1739904811 shutdown_connections 2024-04-16T14:25:54.764 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.861+0000 7ff7122b6700 1 -- 172.21.15.5:0/1739904811 wait complete. 2024-04-16T14:25:54.764 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.862+0000 7ff7122b6700 1 Processor -- start 2024-04-16T14:25:54.764 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.862+0000 7ff7122b6700 1 -- start start 2024-04-16T14:25:54.764 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.862+0000 7ff7122b6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff70c102940 0x7ff70c1116e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:25:54.764 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.862+0000 7ff7122b6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70c111c20 con 0x7ff70c102940 2024-04-16T14:25:54.764 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.862+0000 7ff70bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff70c102940 0x7ff70c1116e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:25:54.764 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.862+0000 7ff70bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff70c102940 0x7ff70c1116e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36166/0 (socket says 172.21.15.5:36166) 2024-04-16T14:25:54.764 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.862+0000 7ff70bfff700 1 -- 172.21.15.5:0/3415869813 learned_addr learned my addr 172.21.15.5:0/3415869813 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:25:54.764 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.862+0000 7ff70bfff700 1 -- 172.21.15.5:0/3415869813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc0094f0 con 0x7ff70c102940 2024-04-16T14:25:54.764 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.862+0000 7ff70bfff700 1 --2- 172.21.15.5:0/3415869813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff70c102940 0x7ff70c1116e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00ba90 tx=0x7ff6fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:25:54.764 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.862+0000 7ff7097fa700 1 -- 172.21.15.5:0/3415869813 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6fc0107c0 con 0x7ff70c102940 2024-04-16T14:25:54.764 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.862+0000 7ff7097fa700 1 -- 172.21.15.5:0/3415869813 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ff6fc010db0 con 0x7ff70c102940 2024-04-16T14:25:54.764 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.862+0000 7ff7122b6700 1 -- 172.21.15.5:0/3415869813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff70c111e20 con 0x7ff70c102940 2024-04-16T14:25:54.765 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.862+0000 7ff7097fa700 1 -- 172.21.15.5:0/3415869813 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6fc01add0 con 0x7ff70c102940 2024-04-16T14:25:54.765 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.863+0000 7ff7122b6700 1 -- 172.21.15.5:0/3415869813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff70c112990 con 0x7ff70c102940 2024-04-16T14:25:54.765 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.863+0000 7ff7097fa700 1 -- 172.21.15.5:0/3415869813 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7ff6fc02e440 con 0x7ff70c102940 2024-04-16T14:25:54.765 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.863+0000 7ff7097fa700 1 -- 172.21.15.5:0/3415869813 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff6fc024740 con 0x7ff70c102940 2024-04-16T14:25:54.765 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.864+0000 7ff7122b6700 1 -- 172.21.15.5:0/3415869813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff70c05f5f0 con 0x7ff70c102940 2024-04-16T14:25:54.765 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.866+0000 7ff7097fa700 1 -- 172.21.15.5:0/3415869813 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7ff6fc029070 con 0x7ff70c102940 2024-04-16T14:25:54.765 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.935+0000 7ff7122b6700 1 -- 172.21.15.5:0/3415869813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7ff70c1046c0 con 0x7ff70c102940 2024-04-16T14:25:54.765 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.936+0000 7ff7097fa700 1 -- 172.21.15.5:0/3415869813 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+173 (secure 0 0 0) 0x7ff6fc01a430 con 0x7ff70c102940 2024-04-16T14:25:54.765 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.936+0000 7ff7122b6700 1 -- 172.21.15.5:0/3415869813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff70c102940 msgr2=0x7ff70c1116e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:25:54.765 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.936+0000 7ff7122b6700 1 --2- 172.21.15.5:0/3415869813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff70c102940 0x7ff70c1116e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00ba90 tx=0x7ff6fc009250 comp rx=0 tx=0).stop 2024-04-16T14:25:54.765 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.936+0000 7ff7122b6700 1 -- 172.21.15.5:0/3415869813 shutdown_connections 2024-04-16T14:25:54.765 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.936+0000 7ff7122b6700 1 --2- 172.21.15.5:0/3415869813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff70c102940 0x7ff70c1116e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:25:54.765 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.936+0000 7ff7122b6700 1 -- 172.21.15.5:0/3415869813 >> 172.21.15.5:0/3415869813 conn(0x7ff70c0fe0e0 msgr2=0x7ff70c0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:25:54.765 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.937+0000 7ff7122b6700 1 -- 172.21.15.5:0/3415869813 shutdown_connections 2024-04-16T14:25:54.765 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:48.937+0000 7ff7122b6700 1 -- 172.21.15.5:0/3415869813 wait complete. 2024-04-16T14:25:54.766 INFO:teuthology.orchestra.run.smithi005.stdout:Restarting the monitor... 2024-04-16T14:25:55.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:54 smithi005 systemd[1]: Stopping Ceph mon.smithi005 for 10609bfa-fbfd-11ee-bc90-c7b262605968... 2024-04-16T14:25:55.422 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:55 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi005[28584]: 2024-04-16T14:25:55.052+0000 7fa56965b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi005 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-16T14:25:55.422 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:55 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi005[28584]: 2024-04-16T14:25:55.052+0000 7fa56965b700 -1 mon.smithi005@0(leader) e1 *** Got Signal Terminated *** 2024-04-16T14:25:55.422 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:55 smithi005 podman[28837]: 2024-04-16 14:25:55.289152176 +0000 UTC m=+0.346628319 container died db86f1be9debaa6da95132f19c5e2a1c41528e6ef63acc48d322d9929d69cc47 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi005, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, RELEASE=quincy-412a552, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-16T14:25:55.723 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:55 smithi005 podman[28837]: 2024-04-16 14:25:55.652511027 +0000 UTC m=+0.709987178 container cleanup db86f1be9debaa6da95132f19c5e2a1c41528e6ef63acc48d322d9929d69cc47 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi005, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-412a552, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-16T14:25:55.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:55 smithi005 bash[28837]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi005 2024-04-16T14:25:56.223 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:55 smithi005 podman[28851]: 2024-04-16 14:25:55.912203648 +0000 UTC m=+0.620529360 container remove db86f1be9debaa6da95132f19c5e2a1c41528e6ef63acc48d322d9929d69cc47 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi005, ceph=True, org.label-schema.license=GPLv2, RELEASE=quincy-412a552, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-16T14:25:56.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 systemd[1]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@mon.smithi005.service: Deactivated successfully. 2024-04-16T14:25:56.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 systemd[1]: Stopped Ceph mon.smithi005 for 10609bfa-fbfd-11ee-bc90-c7b262605968. 2024-04-16T14:25:56.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 systemd[1]: Starting Ceph mon.smithi005 for 10609bfa-fbfd-11ee-bc90-c7b262605968... 2024-04-16T14:25:56.537 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 podman[28946]: 2024-04-16 14:25:56.271452946 +0000 UTC m=+0.104003499 container create 764b6a128874cb1072148ccbda3e07c85813464108a9a0c47db04d2ed4aac488 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi005, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, RELEASE=quincy-412a552, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, ceph=True) 2024-04-16T14:25:56.537 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 podman[28946]: 2024-04-16 14:25:56.185433883 +0000 UTC m=+0.017984423 image pull b04d96489b7caae41247d23636ddaa80f54b8d6ea9d961629a77038693cd9669 quay.ceph.io/ceph-ci/ceph:quincy 2024-04-16T14:25:56.537 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 podman[28946]: 2024-04-16 14:25:56.46512468 +0000 UTC m=+0.297675193 container init 764b6a128874cb1072148ccbda3e07c85813464108a9a0c47db04d2ed4aac488 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi005, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=quincy-412a552, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-16T14:25:56.537 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 podman[28946]: 2024-04-16 14:25:56.468067959 +0000 UTC m=+0.300618473 container start 764b6a128874cb1072148ccbda3e07c85813464108a9a0c47db04d2ed4aac488 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi005, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=quincy-412a552, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-16T14:25:56.537 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: set uid:gid to 167:167 (ceph:ceph) 2024-04-16T14:25:56.537 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable), process ceph-mon, pid 2 2024-04-16T14:25:56.537 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: pidfile_write: ignore empty --pid-file 2024-04-16T14:25:56.537 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: load: jerasure load: lrc 2024-04-16T14:25:56.537 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: RocksDB version: 6.15.5 2024-04-16T14:25:56.538 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-04-16T14:25:56.538 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Compile date Apr 15 2024 2024-04-16T14:25:56.538 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: DB SUMMARY 2024-04-16T14:25:56.538 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: DB Session ID: DZVB1VAQ76MUX4Y7WLLB 2024-04-16T14:25:56.538 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: CURRENT file: CURRENT 2024-04-16T14:25:56.538 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: IDENTITY file: IDENTITY 2024-04-16T14:25:56.538 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-04-16T14:25:56.538 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi005/store.db dir, Total Num: 1, files: 000008.sst 2024-04-16T14:25:56.538 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi005/store.db: 000010.log size: 98138 ; 2024-04-16T14:25:56.538 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.error_if_exists: 0 2024-04-16T14:25:56.538 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.create_if_missing: 0 2024-04-16T14:25:56.538 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.paranoid_checks: 1 2024-04-16T14:25:56.540 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-16T14:25:56.540 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.env: 0x5583bec61b00 2024-04-16T14:25:56.540 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.fs: Posix File System 2024-04-16T14:25:56.540 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.info_log: 0x5583c126fc00 2024-04-16T14:25:56.540 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.max_file_opening_threads: 16 2024-04-16T14:25:56.540 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.statistics: (nil) 2024-04-16T14:25:56.540 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.use_fsync: 0 2024-04-16T14:25:56.540 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.max_log_file_size: 0 2024-04-16T14:25:56.540 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-16T14:25:56.541 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-16T14:25:56.541 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.keep_log_file_num: 1000 2024-04-16T14:25:56.541 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.recycle_log_file_num: 0 2024-04-16T14:25:56.541 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.allow_fallocate: 1 2024-04-16T14:25:56.541 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.allow_mmap_reads: 0 2024-04-16T14:25:56.541 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.allow_mmap_writes: 0 2024-04-16T14:25:56.541 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.use_direct_reads: 0 2024-04-16T14:25:56.541 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-16T14:25:56.541 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.create_missing_column_families: 0 2024-04-16T14:25:56.541 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.db_log_dir: 2024-04-16T14:25:56.541 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi005/store.db 2024-04-16T14:25:56.541 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-16T14:25:56.541 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-16T14:25:56.541 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-16T14:25:56.541 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-16T14:25:56.542 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-16T14:25:56.542 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-16T14:25:56.542 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.advise_random_on_open: 1 2024-04-16T14:25:56.542 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.db_write_buffer_size: 0 2024-04-16T14:25:56.542 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.write_buffer_manager: 0x5583c1fe4a20 2024-04-16T14:25:56.542 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-16T14:25:56.542 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-04-16T14:25:56.542 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-16T14:25:56.542 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-16T14:25:56.542 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.rate_limiter: (nil) 2024-04-16T14:25:56.542 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-16T14:25:56.542 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.wal_recovery_mode: 2 2024-04-16T14:25:56.542 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.enable_thread_tracking: 0 2024-04-16T14:25:56.542 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.enable_pipelined_write: 0 2024-04-16T14:25:56.542 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.unordered_write: 0 2024-04-16T14:25:56.543 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-16T14:25:56.543 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-16T14:25:56.543 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-16T14:25:56.543 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-16T14:25:56.543 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.row_cache: None 2024-04-16T14:25:56.543 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.wal_filter: None 2024-04-16T14:25:56.543 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-16T14:25:56.543 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.allow_ingest_behind: 0 2024-04-16T14:25:56.543 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.preserve_deletes: 0 2024-04-16T14:25:56.543 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.two_write_queues: 0 2024-04-16T14:25:56.543 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.manual_wal_flush: 0 2024-04-16T14:25:56.543 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.atomic_flush: 0 2024-04-16T14:25:56.543 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-16T14:25:56.543 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-16T14:25:56.544 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-16T14:25:56.544 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.log_readahead_size: 0 2024-04-16T14:25:56.544 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-16T14:25:56.544 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.best_efforts_recovery: 0 2024-04-16T14:25:56.544 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-16T14:25:56.544 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-16T14:25:56.544 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.allow_data_in_errors: 0 2024-04-16T14:25:56.544 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.db_host_id: __hostname__ 2024-04-16T14:25:56.544 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.max_background_jobs: 2 2024-04-16T14:25:56.544 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.max_background_compactions: -1 2024-04-16T14:25:56.544 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.max_subcompactions: 1 2024-04-16T14:25:56.544 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-16T14:25:56.544 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-16T14:25:56.544 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-16T14:25:56.545 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.max_total_wal_size: 0 2024-04-16T14:25:56.545 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-16T14:25:56.545 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-16T14:25:56.545 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-16T14:25:56.545 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-16T14:25:56.545 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.max_open_files: -1 2024-04-16T14:25:56.545 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.bytes_per_sync: 0 2024-04-16T14:25:56.545 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-16T14:25:56.545 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-16T14:25:56.545 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.compaction_readahead_size: 0 2024-04-16T14:25:56.545 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.max_background_flushes: -1 2024-04-16T14:25:56.545 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Compression algorithms supported: 2024-04-16T14:25:56.545 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-16T14:25:56.545 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: kZSTD supported: 0 2024-04-16T14:25:56.545 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: kXpressCompression supported: 0 2024-04-16T14:25:56.546 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: kLZ4HCCompression supported: 1 2024-04-16T14:25:56.546 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: kZlibCompression supported: 1 2024-04-16T14:25:56.546 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: kSnappyCompression supported: 1 2024-04-16T14:25:56.546 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: kLZ4Compression supported: 1 2024-04-16T14:25:56.546 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: kBZip2Compression supported: 0 2024-04-16T14:25:56.546 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-16T14:25:56.546 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi005/store.db/MANIFEST-000009 2024-04-16T14:25:56.546 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-04-16T14:25:56.547 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-16T14:25:56.547 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.merge_operator: 2024-04-16T14:25:56.547 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.compaction_filter: None 2024-04-16T14:25:56.547 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.compaction_filter_factory: None 2024-04-16T14:25:56.547 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.sst_partitioner_factory: None 2024-04-16T14:25:56.547 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-16T14:25:56.547 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-16T14:25:56.547 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5583c12c4f58) 2024-04-16T14:25:56.547 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: cache_index_and_filter_blocks: 1 2024-04-16T14:25:56.547 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-16T14:25:56.547 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-16T14:25:56.547 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: pin_top_level_index_and_filter: 1 2024-04-16T14:25:56.547 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: index_type: 0 2024-04-16T14:25:56.547 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: data_block_index_type: 0 2024-04-16T14:25:56.547 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: index_shortening: 1 2024-04-16T14:25:56.548 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-16T14:25:56.548 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: hash_index_allow_collision: 1 2024-04-16T14:25:56.548 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: checksum: 1 2024-04-16T14:25:56.548 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: no_block_cache: 0 2024-04-16T14:25:56.548 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: block_cache: 0x5583c12f7090 2024-04-16T14:25:56.548 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: block_cache_name: BinnedLRUCache 2024-04-16T14:25:56.548 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: block_cache_options: 2024-04-16T14:25:56.548 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: capacity : 536870912 2024-04-16T14:25:56.548 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: num_shard_bits : 4 2024-04-16T14:25:56.548 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: strict_capacity_limit : 0 2024-04-16T14:25:56.548 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: high_pri_pool_ratio: 0.000 2024-04-16T14:25:56.549 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: block_cache_compressed: (nil) 2024-04-16T14:25:56.549 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: persistent_cache: (nil) 2024-04-16T14:25:56.549 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: block_size: 4096 2024-04-16T14:25:56.549 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: block_size_deviation: 10 2024-04-16T14:25:56.549 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: block_restart_interval: 16 2024-04-16T14:25:56.549 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: index_block_restart_interval: 1 2024-04-16T14:25:56.549 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: metadata_block_size: 4096 2024-04-16T14:25:56.549 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: partition_filters: 0 2024-04-16T14:25:56.549 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: use_delta_encoding: 1 2024-04-16T14:25:56.549 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-04-16T14:25:56.549 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: whole_key_filtering: 1 2024-04-16T14:25:56.549 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: verify_compression: 0 2024-04-16T14:25:56.549 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: read_amp_bytes_per_bit: 0 2024-04-16T14:25:56.549 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: format_version: 4 2024-04-16T14:25:56.549 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: enable_index_compression: 1 2024-04-16T14:25:56.550 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: block_align: 0 2024-04-16T14:25:56.550 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.write_buffer_size: 33554432 2024-04-16T14:25:56.550 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.max_write_buffer_number: 2 2024-04-16T14:25:56.550 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.compression: NoCompression 2024-04-16T14:25:56.550 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.bottommost_compression: Disabled 2024-04-16T14:25:56.550 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.prefix_extractor: nullptr 2024-04-16T14:25:56.550 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-16T14:25:56.550 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.num_levels: 7 2024-04-16T14:25:56.551 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-16T14:25:56.551 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-16T14:25:56.551 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-16T14:25:56.551 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-16T14:25:56.551 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-16T14:25:56.551 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-16T14:25:56.551 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-16T14:25:56.551 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-16T14:25:56.551 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-16T14:25:56.551 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-16T14:25:56.551 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-16T14:25:56.551 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.compression_opts.level: 32767 2024-04-16T14:25:56.551 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.compression_opts.strategy: 0 2024-04-16T14:25:56.551 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-16T14:25:56.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-16T14:25:56.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-16T14:25:56.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.compression_opts.enabled: false 2024-04-16T14:25:56.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-16T14:25:56.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-16T14:25:56.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-16T14:25:56.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.target_file_size_base: 67108864 2024-04-16T14:25:56.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-16T14:25:56.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-16T14:25:56.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-16T14:25:56.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-16T14:25:56.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-16T14:25:56.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-16T14:25:56.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-16T14:25:56.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-16T14:25:56.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-16T14:25:56.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-16T14:25:56.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-16T14:25:56.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-16T14:25:56.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-16T14:25:56.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.arena_block_size: 4194304 2024-04-16T14:25:56.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-16T14:25:56.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-16T14:25:56.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-04-16T14:25:56.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.disable_auto_compactions: 0 2024-04-16T14:25:56.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-16T14:25:56.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-16T14:25:56.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-16T14:25:56.553 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-16T14:25:56.554 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-16T14:25:56.554 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-16T14:25:56.554 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-16T14:25:56.554 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-16T14:25:56.554 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-16T14:25:56.554 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-16T14:25:56.554 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.table_properties_collectors: 2024-04-16T14:25:56.554 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.inplace_update_support: 0 2024-04-16T14:25:56.554 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-16T14:25:56.554 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-16T14:25:56.554 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-16T14:25:56.554 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-16T14:25:56.554 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.bloom_locality: 0 2024-04-16T14:25:56.555 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.max_successive_merges: 0 2024-04-16T14:25:56.555 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-16T14:25:56.555 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.paranoid_file_checks: 0 2024-04-16T14:25:56.555 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.force_consistency_checks: 1 2024-04-16T14:25:56.555 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.report_bg_io_stats: 0 2024-04-16T14:25:56.555 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.ttl: 2592000 2024-04-16T14:25:56.555 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-16T14:25:56.555 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.enable_blob_files: false 2024-04-16T14:25:56.555 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.min_blob_size: 0 2024-04-16T14:25:56.555 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.blob_file_size: 268435456 2024-04-16T14:25:56.555 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-16T14:25:56.555 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-16T14:25:56.555 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-16T14:25:56.555 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi005/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-16T14:25:56.555 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-04-16T14:25:56.556 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-04-16T14:25:56.556 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713277556494237, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-04-16T14:25:56.556 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-04-16T14:25:56.556 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-04-16T14:25:56.556 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713277556495123, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 93344, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91456, "index_size": 248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13576, "raw_average_key_size": 49, "raw_value_size": 84020, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1713277556, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "62aeac96-9084-4444-bd54-fbab2feeec00", "db_session_id": "DZVB1VAQ76MUX4Y7WLLB"}} 2024-04-16T14:25:56.556 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-04-16T14:25:56.556 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713277556495459, "job": 1, "event": "recovery_finished"} 2024-04-16T14:25:56.556 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi005/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-16T14:25:56.556 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x5583c128b180 2024-04-16T14:25:56.556 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: DB pointer 0x5583c1360000 2024-04-16T14:25:56.556 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-04-16T14:25:56.556 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-04-16T14:25:56.556 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: ** DB Stats ** 2024-04-16T14:25:56.556 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-16T14:25:56.557 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-16T14:25:56.557 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-16T14:25:56.557 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-16T14:25:56.557 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-16T14:25:56.557 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-04-16T14:25:56.557 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-16T14:25:56.557 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: 2024-04-16T14:25:56.557 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: ** Compaction Stats [default] ** 2024-04-16T14:25:56.557 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-16T14:25:56.557 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-16T14:25:56.557 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: L0 2/0 92.95 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 140.9 0.00 0.00 1 0.001 0 0 2024-04-16T14:25:56.557 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Sum 2/0 92.95 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 140.9 0.00 0.00 1 0.001 0 0 2024-04-16T14:25:56.557 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 140.9 0.00 0.00 1 0.001 0 0 2024-04-16T14:25:56.558 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: 2024-04-16T14:25:56.558 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: ** Compaction Stats [default] ** 2024-04-16T14:25:56.558 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-16T14:25:56.558 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-16T14:25:56.558 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 140.9 0.00 0.00 1 0.001 0 0 2024-04-16T14:25:56.558 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-16T14:25:56.558 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-16T14:25:56.558 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-16T14:25:56.558 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-16T14:25:56.558 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-16T14:25:56.558 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-16T14:25:56.558 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Cumulative compaction: 0.00 GB write, 28.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-16T14:25:56.558 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Interval compaction: 0.00 GB write, 28.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-16T14:25:56.558 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-16T14:25:56.559 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: 2024-04-16T14:25:56.559 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-16T14:25:56.559 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: 2024-04-16T14:25:56.559 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: ** Compaction Stats [default] ** 2024-04-16T14:25:56.559 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-16T14:25:56.559 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-16T14:25:56.559 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: L0 2/0 92.95 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 140.9 0.00 0.00 1 0.001 0 0 2024-04-16T14:25:56.559 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Sum 2/0 92.95 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 140.9 0.00 0.00 1 0.001 0 0 2024-04-16T14:25:56.559 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-04-16T14:25:56.559 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: 2024-04-16T14:25:56.559 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: ** Compaction Stats [default] ** 2024-04-16T14:25:56.559 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-16T14:25:56.559 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-16T14:25:56.559 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 140.9 0.00 0.00 1 0.001 0 0 2024-04-16T14:25:56.559 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-16T14:25:56.560 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-16T14:25:56.560 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-16T14:25:56.560 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-16T14:25:56.560 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-16T14:25:56.560 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-16T14:25:56.560 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Cumulative compaction: 0.00 GB write, 27.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-16T14:25:56.560 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-16T14:25:56.560 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-16T14:25:56.560 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: 2024-04-16T14:25:56.561 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-16T14:25:56.561 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: starting mon.smithi005 rank 0 at public addrs [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] at bind addrs [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi005 fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 2024-04-16T14:25:56.561 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: mon.smithi005@-1(???) e1 preinit fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 2024-04-16T14:25:56.561 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: mon.smithi005@-1(???).mds e1 new map 2024-04-16T14:25:56.561 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: mon.smithi005@-1(???).mds e1 print_map 2024-04-16T14:25:56.561 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: e1 2024-04-16T14:25:56.561 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:25:56.561 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:25:56.561 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: legacy client fscid: -1 2024-04-16T14:25:56.561 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: 2024-04-16T14:25:56.561 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: No filesystems configured 2024-04-16T14:25:56.561 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: mon.smithi005@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-16T14:25:56.561 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: mon.smithi005@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-16T14:25:56.561 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: mon.smithi005@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-16T14:25:56.561 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: mon.smithi005@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-16T14:25:56.562 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: mon.smithi005@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-16T14:25:56.562 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 bash[28946]: 764b6a128874cb1072148ccbda3e07c85813464108a9a0c47db04d2ed4aac488 2024-04-16T14:25:56.562 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 systemd[1]: Started Ceph mon.smithi005 for 10609bfa-fbfd-11ee-bc90-c7b262605968. 2024-04-16T14:25:56.562 INFO:teuthology.orchestra.run.smithi005.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-16T14:25:56.848 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: mon.smithi005 is new leader, mons smithi005 in quorum (ranks 0) 2024-04-16T14:25:56.849 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: monmap e1: 1 mons at {smithi005=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-16T14:25:56.849 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: fsmap 2024-04-16T14:25:56.849 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: osdmap e1: 0 total, 0 up, 0 in 2024-04-16T14:25:56.849 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:56 smithi005 ceph-mon[28964]: mgrmap e1: no daemons active 2024-04-16T14:25:57.601 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.952+0000 7fd36400e700 1 Processor -- start 2024-04-16T14:25:57.601 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.952+0000 7fd36400e700 1 -- start start 2024-04-16T14:25:57.601 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.952+0000 7fd36400e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd35c102930 0x7fd35c102d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:25:57.601 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.952+0000 7fd36400e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c103280 con 0x7fd35c102930 2024-04-16T14:25:57.601 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.953+0000 7fd361daa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd35c102930 0x7fd35c102d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:25:57.601 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.953+0000 7fd361daa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd35c102930 0x7fd35c102d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36172/0 (socket says 172.21.15.5:36172) 2024-04-16T14:25:57.601 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.953+0000 7fd361daa700 1 -- 172.21.15.5:0/3995191096 learned_addr learned my addr 172.21.15.5:0/3995191096 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:25:57.601 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.953+0000 7fd361daa700 1 -- 172.21.15.5:0/3995191096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35c1033c0 con 0x7fd35c102930 2024-04-16T14:25:57.601 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.953+0000 7fd361daa700 1 --2- 172.21.15.5:0/3995191096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd35c102930 0x7fd35c102d40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd354009e50 tx=0x7fd354009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca12af7df950b5c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:25:57.601 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.953+0000 7fd360da8700 1 -- 172.21.15.5:0/3995191096 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3540092e0 con 0x7fd35c102930 2024-04-16T14:25:57.601 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.954+0000 7fd360da8700 1 -- 172.21.15.5:0/3995191096 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd354012430 con 0x7fd35c102930 2024-04-16T14:25:57.602 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.954+0000 7fd360da8700 1 -- 172.21.15.5:0/3995191096 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3540075c0 con 0x7fd35c102930 2024-04-16T14:25:57.602 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.954+0000 7fd36400e700 1 -- 172.21.15.5:0/3995191096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd35c102930 msgr2=0x7fd35c102d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:25:57.602 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.954+0000 7fd36400e700 1 --2- 172.21.15.5:0/3995191096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd35c102930 0x7fd35c102d40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd354009e50 tx=0x7fd354009840 comp rx=0 tx=0).stop 2024-04-16T14:25:57.602 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.954+0000 7fd36400e700 1 -- 172.21.15.5:0/3995191096 shutdown_connections 2024-04-16T14:25:57.602 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.954+0000 7fd36400e700 1 --2- 172.21.15.5:0/3995191096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd35c102930 0x7fd35c102d40 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:25:57.602 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.954+0000 7fd36400e700 1 -- 172.21.15.5:0/3995191096 >> 172.21.15.5:0/3995191096 conn(0x7fd35c0fe0d0 msgr2=0x7fd35c1004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:25:57.602 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.954+0000 7fd36400e700 1 -- 172.21.15.5:0/3995191096 shutdown_connections 2024-04-16T14:25:57.602 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.954+0000 7fd36400e700 1 -- 172.21.15.5:0/3995191096 wait complete. 2024-04-16T14:25:57.602 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.955+0000 7fd36400e700 1 Processor -- start 2024-04-16T14:25:57.602 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.955+0000 7fd36400e700 1 -- start start 2024-04-16T14:25:57.602 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.955+0000 7fd36400e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd35c102930 0x7fd35c078c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:25:57.602 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.955+0000 7fd36400e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c079180 con 0x7fd35c102930 2024-04-16T14:25:57.602 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.955+0000 7fd361daa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd35c102930 0x7fd35c078c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:25:57.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.955+0000 7fd361daa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd35c102930 0x7fd35c078c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36184/0 (socket says 172.21.15.5:36184) 2024-04-16T14:25:57.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.955+0000 7fd361daa700 1 -- 172.21.15.5:0/2221723609 learned_addr learned my addr 172.21.15.5:0/2221723609 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:25:57.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.955+0000 7fd361daa700 1 -- 172.21.15.5:0/2221723609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd354009ae0 con 0x7fd35c102930 2024-04-16T14:25:57.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.956+0000 7fd361daa700 1 --2- 172.21.15.5:0/2221723609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd35c102930 0x7fd35c078c40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd354012da0 tx=0x7fd354009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:25:57.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.956+0000 7fd35a7fc700 1 -- 172.21.15.5:0/2221723609 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3540092e0 con 0x7fd35c102930 2024-04-16T14:25:57.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.956+0000 7fd35a7fc700 1 -- 172.21.15.5:0/2221723609 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd354007d10 con 0x7fd35c102930 2024-04-16T14:25:57.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.956+0000 7fd36400e700 1 -- 172.21.15.5:0/2221723609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd35c077250 con 0x7fd35c102930 2024-04-16T14:25:57.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.956+0000 7fd35a7fc700 1 -- 172.21.15.5:0/2221723609 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd35401c8c0 con 0x7fd35c102930 2024-04-16T14:25:57.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.956+0000 7fd36400e700 1 -- 172.21.15.5:0/2221723609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35c077740 con 0x7fd35c102930 2024-04-16T14:25:57.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.956+0000 7fd35a7fc700 1 -- 172.21.15.5:0/2221723609 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fd354019070 con 0x7fd35c102930 2024-04-16T14:25:57.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.956+0000 7fd35a7fc700 1 -- 172.21.15.5:0/2221723609 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fd354025ab0 con 0x7fd35c102930 2024-04-16T14:25:57.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.957+0000 7fd36400e700 1 -- 172.21.15.5:0/2221723609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd35c04bed0 con 0x7fd35c102930 2024-04-16T14:25:57.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:56.959+0000 7fd35a7fc700 1 -- 172.21.15.5:0/2221723609 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7fd35402a060 con 0x7fd35c102930 2024-04-16T14:25:57.604 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:57.028+0000 7fd36400e700 1 -- 172.21.15.5:0/2221723609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fd35c1046b0 con 0x7fd35c102930 2024-04-16T14:25:57.604 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:57.030+0000 7fd35a7fc700 1 -- 172.21.15.5:0/2221723609 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fd354020070 con 0x7fd35c102930 2024-04-16T14:25:57.604 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:57.031+0000 7fd36400e700 1 -- 172.21.15.5:0/2221723609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd35c102930 msgr2=0x7fd35c078c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:25:57.604 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:57.031+0000 7fd36400e700 1 --2- 172.21.15.5:0/2221723609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd35c102930 0x7fd35c078c40 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd354012da0 tx=0x7fd354009840 comp rx=0 tx=0).stop 2024-04-16T14:25:57.604 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:57.031+0000 7fd36400e700 1 -- 172.21.15.5:0/2221723609 shutdown_connections 2024-04-16T14:25:57.604 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:57.031+0000 7fd36400e700 1 --2- 172.21.15.5:0/2221723609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd35c102930 0x7fd35c078c40 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:25:57.604 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:57.031+0000 7fd36400e700 1 -- 172.21.15.5:0/2221723609 >> 172.21.15.5:0/2221723609 conn(0x7fd35c0fe0d0 msgr2=0x7fd35c0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:25:57.604 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:57.031+0000 7fd36400e700 1 -- 172.21.15.5:0/2221723609 shutdown_connections 2024-04-16T14:25:57.604 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:57.031+0000 7fd36400e700 1 -- 172.21.15.5:0/2221723609 wait complete. 2024-04-16T14:25:57.604 INFO:teuthology.orchestra.run.smithi005.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-16T14:25:57.604 INFO:teuthology.orchestra.run.smithi005.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-16T14:25:57.604 INFO:teuthology.orchestra.run.smithi005.stdout:Creating mgr... 2024-04-16T14:25:57.604 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying port 9283 ... 2024-04-16T14:25:57.773 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@mgr.smithi005.ipwdkc 2024-04-16T14:25:57.773 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to reset failed state of unit ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@mgr.smithi005.ipwdkc.service: Unit ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@mgr.smithi005.ipwdkc.service not loaded. 2024-04-16T14:25:57.918 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-10609bfa-fbfd-11ee-bc90-c7b262605968.target.wants/ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@mgr.smithi005.ipwdkc.service → /etc/systemd/system/ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@.service. 2024-04-16T14:25:58.223 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:58 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/2221723609' entity='client.admin' 2024-04-16T14:25:58.410 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-16T14:25:58.410 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2024-04-16T14:25:58.417 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-16T14:25:58.417 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-04-16T14:25:58.418 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2024-04-16T14:25:58.418 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to enable service . firewalld.service is not available 2024-04-16T14:25:58.426 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-16T14:25:58.426 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2024-04-16T14:25:58.434 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-16T14:25:58.434 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-04-16T14:25:58.434 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2024-04-16T14:25:58.434 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2024-04-16T14:25:58.434 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr to start... 2024-04-16T14:25:58.434 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr... 2024-04-16T14:25:59.223 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:25:59 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/2250641928' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-16T14:25:59.566 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-04-16T14:25:59.567 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-04-16T14:25:59.567 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsid": "10609bfa-fbfd-11ee-bc90-c7b262605968", 2024-04-16T14:25:59.567 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "health": { 2024-04-16T14:25:59.567 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-16T14:25:59.567 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-16T14:25:59.567 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-16T14:25:59.567 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-04-16T14:25:59.568 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-16T14:25:59.568 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-16T14:25:59.568 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 0 2024-04-16T14:25:59.568 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-04-16T14:25:59.568 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-16T14:25:59.568 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "smithi005" 2024-04-16T14:25:59.568 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-04-16T14:25:59.568 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-04-16T14:25:59.568 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-16T14:25:59.568 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-16T14:25:59.568 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-16T14:25:59.568 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-16T14:25:59.569 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-04-16T14:25:59.569 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-16T14:25:59.569 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-16T14:25:59.569 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-16T14:25:59.569 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-16T14:25:59.569 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-16T14:25:59.580 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-16T14:25:59.580 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-16T14:25:59.580 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-16T14:25:59.581 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-04-16T14:25:59.581 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-16T14:25:59.581 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-16T14:25:59.581 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-16T14:25:59.581 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-16T14:25:59.581 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-16T14:25:59.581 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-16T14:25:59.581 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-16T14:25:59.581 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-16T14:25:59.581 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-16T14:25:59.581 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-04-16T14:25:59.581 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-16T14:25:59.581 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-16T14:25:59.582 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-16T14:25:59.582 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-16T14:25:59.582 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-04-16T14:25:59.582 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-16T14:25:59.582 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-16T14:25:59.582 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-16T14:25:59.582 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-16T14:25:59.582 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-16T14:25:59.582 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-16T14:25:59.582 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "restful" 2024-04-16T14:25:59.582 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-04-16T14:25:59.582 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-16T14:25:59.582 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-04-16T14:25:59.582 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-16T14:25:59.582 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-16T14:25:59.583 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modified": "2024-04-16T14:25:45.191174+0000", 2024-04-16T14:25:59.583 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-16T14:25:59.583 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-04-16T14:25:59.583 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-16T14:25:59.583 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-04-16T14:25:59.583 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.852+0000 7fa57483f700 1 Processor -- start 2024-04-16T14:25:59.583 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.852+0000 7fa57483f700 1 -- start start 2024-04-16T14:25:59.583 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.852+0000 7fa57483f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa570071290 0x7fa5701054f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:25:59.583 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.852+0000 7fa57483f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5700716a0 con 0x7fa570071290 2024-04-16T14:25:59.583 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.852+0000 7fa56e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa570071290 0x7fa5701054f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:25:59.583 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.852+0000 7fa56e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa570071290 0x7fa5701054f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48002/0 (socket says 172.21.15.5:48002) 2024-04-16T14:25:59.583 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.852+0000 7fa56e59c700 1 -- 172.21.15.5:0/2414321626 learned_addr learned my addr 172.21.15.5:0/2414321626 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:25:59.583 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.853+0000 7fa56e59c700 1 -- 172.21.15.5:0/2414321626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa570105a30 con 0x7fa570071290 2024-04-16T14:25:59.583 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.853+0000 7fa56e59c700 1 --2- 172.21.15.5:0/2414321626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa570071290 0x7fa5701054f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa5600098e0 tx=0x7fa560009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f7389679713dc server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:25:59.584 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.853+0000 7fa56d59a700 1 -- 172.21.15.5:0/2414321626 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa56000b860 con 0x7fa570071290 2024-04-16T14:25:59.584 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.853+0000 7fa56d59a700 1 -- 172.21.15.5:0/2414321626 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa56000be50 con 0x7fa570071290 2024-04-16T14:25:59.584 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.853+0000 7fa56d59a700 1 -- 172.21.15.5:0/2414321626 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa560010380 con 0x7fa570071290 2024-04-16T14:25:59.584 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.854+0000 7fa57483f700 1 -- 172.21.15.5:0/2414321626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa570071290 msgr2=0x7fa5701054f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:25:59.584 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.854+0000 7fa57483f700 1 --2- 172.21.15.5:0/2414321626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa570071290 0x7fa5701054f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa5600098e0 tx=0x7fa560009250 comp rx=0 tx=0).stop 2024-04-16T14:25:59.584 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.854+0000 7fa57483f700 1 -- 172.21.15.5:0/2414321626 shutdown_connections 2024-04-16T14:25:59.584 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.854+0000 7fa57483f700 1 --2- 172.21.15.5:0/2414321626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa570071290 0x7fa5701054f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:25:59.584 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.854+0000 7fa57483f700 1 -- 172.21.15.5:0/2414321626 >> 172.21.15.5:0/2414321626 conn(0x7fa5700fcf80 msgr2=0x7fa5700ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:25:59.584 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.854+0000 7fa57483f700 1 -- 172.21.15.5:0/2414321626 shutdown_connections 2024-04-16T14:25:59.584 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.854+0000 7fa57483f700 1 -- 172.21.15.5:0/2414321626 wait complete. 2024-04-16T14:25:59.584 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.855+0000 7fa57483f700 1 Processor -- start 2024-04-16T14:25:59.584 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.855+0000 7fa57483f700 1 -- start start 2024-04-16T14:25:59.584 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.855+0000 7fa57483f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa570071290 0x7fa570111700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:25:59.584 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.855+0000 7fa57483f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa570111c40 con 0x7fa570071290 2024-04-16T14:25:59.584 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.855+0000 7fa56e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa570071290 0x7fa570111700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:25:59.585 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.855+0000 7fa56e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa570071290 0x7fa570111700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48006/0 (socket says 172.21.15.5:48006) 2024-04-16T14:25:59.585 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.855+0000 7fa56e59c700 1 -- 172.21.15.5:0/2250641928 learned_addr learned my addr 172.21.15.5:0/2250641928 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:25:59.585 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.855+0000 7fa56e59c700 1 -- 172.21.15.5:0/2250641928 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5600094f0 con 0x7fa570071290 2024-04-16T14:25:59.585 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.855+0000 7fa56e59c700 1 --2- 172.21.15.5:0/2250641928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa570071290 0x7fa570111700 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa560006b00 tx=0x7fa560009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:25:59.585 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.855+0000 7fa55effd700 1 -- 172.21.15.5:0/2250641928 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa5600107c0 con 0x7fa570071290 2024-04-16T14:25:59.585 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.855+0000 7fa55effd700 1 -- 172.21.15.5:0/2250641928 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa560010db0 con 0x7fa570071290 2024-04-16T14:25:59.585 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.855+0000 7fa57483f700 1 -- 172.21.15.5:0/2250641928 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa570111e40 con 0x7fa570071290 2024-04-16T14:25:59.585 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.855+0000 7fa55effd700 1 -- 172.21.15.5:0/2250641928 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa56001acf0 con 0x7fa570071290 2024-04-16T14:25:59.585 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.856+0000 7fa57483f700 1 -- 172.21.15.5:0/2250641928 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5701129b0 con 0x7fa570071290 2024-04-16T14:25:59.585 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.856+0000 7fa55effd700 1 -- 172.21.15.5:0/2250641928 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fa560024440 con 0x7fa570071290 2024-04-16T14:25:59.585 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.856+0000 7fa55effd700 1 -- 172.21.15.5:0/2250641928 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa560019710 con 0x7fa570071290 2024-04-16T14:25:59.585 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.856+0000 7fa57483f700 1 -- 172.21.15.5:0/2250641928 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa57005f5f0 con 0x7fa570071290 2024-04-16T14:25:59.585 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.859+0000 7fa55effd700 1 -- 172.21.15.5:0/2250641928 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7fa56001a530 con 0x7fa570071290 2024-04-16T14:25:59.585 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.933+0000 7fa57483f700 1 -- 172.21.15.5:0/2250641928 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fa570106870 con 0x7fa570071290 2024-04-16T14:25:59.586 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.933+0000 7fa55effd700 1 -- 172.21.15.5:0/2250641928 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fa560010920 con 0x7fa570071290 2024-04-16T14:25:59.586 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.934+0000 7fa57483f700 1 -- 172.21.15.5:0/2250641928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa570071290 msgr2=0x7fa570111700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:25:59.586 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.934+0000 7fa57483f700 1 --2- 172.21.15.5:0/2250641928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa570071290 0x7fa570111700 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa560006b00 tx=0x7fa560009250 comp rx=0 tx=0).stop 2024-04-16T14:25:59.586 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.934+0000 7fa57483f700 1 -- 172.21.15.5:0/2250641928 shutdown_connections 2024-04-16T14:25:59.586 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.934+0000 7fa57483f700 1 --2- 172.21.15.5:0/2250641928 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa570071290 0x7fa570111700 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:25:59.586 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.934+0000 7fa57483f700 1 -- 172.21.15.5:0/2250641928 >> 172.21.15.5:0/2250641928 conn(0x7fa5700fcf80 msgr2=0x7fa5700fdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:25:59.586 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.934+0000 7fa57483f700 1 -- 172.21.15.5:0/2250641928 shutdown_connections 2024-04-16T14:25:59.586 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:25:58.935+0000 7fa57483f700 1 -- 172.21.15.5:0/2250641928 wait complete. 2024-04-16T14:25:59.586 INFO:teuthology.orchestra.run.smithi005.stdout:mgr not available, waiting (1/15)... 2024-04-16T14:26:04.880 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:04 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/2659003188' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-16T14:26:05.247 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-04-16T14:26:05.247 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-04-16T14:26:05.247 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsid": "10609bfa-fbfd-11ee-bc90-c7b262605968", 2024-04-16T14:26:05.256 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "health": { 2024-04-16T14:26:05.257 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-16T14:26:05.257 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-16T14:26:05.257 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-16T14:26:05.257 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-04-16T14:26:05.257 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-16T14:26:05.257 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-16T14:26:05.257 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 0 2024-04-16T14:26:05.257 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-04-16T14:26:05.257 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-16T14:26:05.257 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "smithi005" 2024-04-16T14:26:05.257 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-04-16T14:26:05.257 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-04-16T14:26:05.257 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-16T14:26:05.257 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-16T14:26:05.258 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-16T14:26:05.258 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-16T14:26:05.258 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-04-16T14:26:05.258 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-16T14:26:05.258 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-16T14:26:05.258 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-16T14:26:05.258 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-16T14:26:05.258 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-16T14:26:05.258 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-16T14:26:05.258 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-16T14:26:05.258 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-16T14:26:05.258 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-04-16T14:26:05.258 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-16T14:26:05.258 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-16T14:26:05.258 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-16T14:26:05.259 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-16T14:26:05.259 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-16T14:26:05.259 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-16T14:26:05.259 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-16T14:26:05.259 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-16T14:26:05.259 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-16T14:26:05.259 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-04-16T14:26:05.259 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-16T14:26:05.259 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-16T14:26:05.259 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-16T14:26:05.259 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-16T14:26:05.259 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-04-16T14:26:05.259 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-16T14:26:05.259 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-16T14:26:05.259 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-16T14:26:05.260 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-16T14:26:05.260 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-16T14:26:05.260 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-16T14:26:05.260 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "restful" 2024-04-16T14:26:05.260 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-04-16T14:26:05.260 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-16T14:26:05.260 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-04-16T14:26:05.260 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-16T14:26:05.260 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-16T14:26:05.260 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modified": "2024-04-16T14:25:45.191174+0000", 2024-04-16T14:26:05.260 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-16T14:26:05.260 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-04-16T14:26:05.260 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-16T14:26:05.260 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-04-16T14:26:05.260 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.599+0000 7f7fa644b700 1 Processor -- start 2024-04-16T14:26:05.261 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.600+0000 7f7fa644b700 1 -- start start 2024-04-16T14:26:05.261 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.600+0000 7f7fa644b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa01029c0 0x7f7fa0102dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:05.261 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.600+0000 7f7fa644b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa0103310 con 0x7f7fa01029c0 2024-04-16T14:26:05.261 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.600+0000 7f7f9ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa01029c0 0x7f7fa0102dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:05.261 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.600+0000 7f7f9ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa01029c0 0x7f7fa0102dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48010/0 (socket says 172.21.15.5:48010) 2024-04-16T14:26:05.261 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.600+0000 7f7f9ffff700 1 -- 172.21.15.5:0/2125422349 learned_addr learned my addr 172.21.15.5:0/2125422349 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:05.261 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.601+0000 7f7f9ffff700 1 -- 172.21.15.5:0/2125422349 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa0103450 con 0x7f7fa01029c0 2024-04-16T14:26:05.261 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.601+0000 7f7f9ffff700 1 --2- 172.21.15.5:0/2125422349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa01029c0 0x7f7fa0102dd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7f900098e0 tx=0x7f7f90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c1c03d27641fde server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:05.261 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.601+0000 7f7f9f7fe700 1 -- 172.21.15.5:0/2125422349 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f9000b8f0 con 0x7f7fa01029c0 2024-04-16T14:26:05.261 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.601+0000 7f7f9f7fe700 1 -- 172.21.15.5:0/2125422349 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7f90011420 con 0x7f7fa01029c0 2024-04-16T14:26:05.261 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.601+0000 7f7f9f7fe700 1 -- 172.21.15.5:0/2125422349 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f90010540 con 0x7f7fa01029c0 2024-04-16T14:26:05.261 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.602+0000 7f7fa644b700 1 -- 172.21.15.5:0/2125422349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa01029c0 msgr2=0x7f7fa0102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:05.261 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.602+0000 7f7fa644b700 1 --2- 172.21.15.5:0/2125422349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa01029c0 0x7f7fa0102dd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7f900098e0 tx=0x7f7f90009250 comp rx=0 tx=0).stop 2024-04-16T14:26:05.261 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.602+0000 7f7fa644b700 1 -- 172.21.15.5:0/2125422349 shutdown_connections 2024-04-16T14:26:05.262 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.602+0000 7f7fa644b700 1 --2- 172.21.15.5:0/2125422349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa01029c0 0x7f7fa0102dd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:05.262 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.602+0000 7f7fa644b700 1 -- 172.21.15.5:0/2125422349 >> 172.21.15.5:0/2125422349 conn(0x7f7fa00fe120 msgr2=0x7f7fa0100550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:05.262 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.602+0000 7f7fa644b700 1 -- 172.21.15.5:0/2125422349 shutdown_connections 2024-04-16T14:26:05.262 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.602+0000 7f7fa644b700 1 -- 172.21.15.5:0/2125422349 wait complete. 2024-04-16T14:26:05.262 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.602+0000 7f7fa644b700 1 Processor -- start 2024-04-16T14:26:05.262 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.602+0000 7f7fa644b700 1 -- start start 2024-04-16T14:26:05.262 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.603+0000 7f7fa644b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa01029c0 0x7f7fa0078c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:05.262 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.603+0000 7f7fa644b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa0079180 con 0x7f7fa01029c0 2024-04-16T14:26:05.262 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.603+0000 7f7f9ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa01029c0 0x7f7fa0078c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:05.262 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.603+0000 7f7f9ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa01029c0 0x7f7fa0078c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48022/0 (socket says 172.21.15.5:48022) 2024-04-16T14:26:05.262 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.603+0000 7f7f9ffff700 1 -- 172.21.15.5:0/2659003188 learned_addr learned my addr 172.21.15.5:0/2659003188 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:05.262 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.603+0000 7f7f9ffff700 1 -- 172.21.15.5:0/2659003188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f900094f0 con 0x7f7fa01029c0 2024-04-16T14:26:05.262 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.603+0000 7f7f9ffff700 1 --2- 172.21.15.5:0/2659003188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa01029c0 0x7f7fa0078c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7f90011ef0 tx=0x7f7f90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:05.262 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.603+0000 7f7f9d7fa700 1 -- 172.21.15.5:0/2659003188 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f90010910 con 0x7f7fa01029c0 2024-04-16T14:26:05.263 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.603+0000 7f7fa644b700 1 -- 172.21.15.5:0/2659003188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa00771f0 con 0x7f7fa01029c0 2024-04-16T14:26:05.263 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.603+0000 7f7f9d7fa700 1 -- 172.21.15.5:0/2659003188 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7f90010f00 con 0x7f7fa01029c0 2024-04-16T14:26:05.263 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.603+0000 7f7f9d7fa700 1 -- 172.21.15.5:0/2659003188 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f9001ae50 con 0x7f7fa01029c0 2024-04-16T14:26:05.263 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.603+0000 7f7fa644b700 1 -- 172.21.15.5:0/2659003188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa00776e0 con 0x7f7fa01029c0 2024-04-16T14:26:05.263 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.604+0000 7f7f9d7fa700 1 -- 172.21.15.5:0/2659003188 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f7f900244f0 con 0x7f7fa01029c0 2024-04-16T14:26:05.263 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.604+0000 7f7f9d7fa700 1 -- 172.21.15.5:0/2659003188 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f7f9002d780 con 0x7f7fa01029c0 2024-04-16T14:26:05.263 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.604+0000 7f7fa644b700 1 -- 172.21.15.5:0/2659003188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa004bed0 con 0x7f7fa01029c0 2024-04-16T14:26:05.263 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.606+0000 7f7f9d7fa700 1 -- 172.21.15.5:0/2659003188 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f7f90029070 con 0x7f7fa01029c0 2024-04-16T14:26:05.263 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.679+0000 7f7fa644b700 1 -- 172.21.15.5:0/2659003188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f7fa0077920 con 0x7f7fa01029c0 2024-04-16T14:26:05.263 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.679+0000 7f7f9d7fa700 1 -- 172.21.15.5:0/2659003188 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f7f9001a430 con 0x7f7fa01029c0 2024-04-16T14:26:05.263 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.680+0000 7f7fa644b700 1 -- 172.21.15.5:0/2659003188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa01029c0 msgr2=0x7f7fa0078c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:05.263 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.680+0000 7f7fa644b700 1 --2- 172.21.15.5:0/2659003188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa01029c0 0x7f7fa0078c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7f90011ef0 tx=0x7f7f90009250 comp rx=0 tx=0).stop 2024-04-16T14:26:05.263 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.680+0000 7f7fa644b700 1 -- 172.21.15.5:0/2659003188 shutdown_connections 2024-04-16T14:26:05.263 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.680+0000 7f7fa644b700 1 --2- 172.21.15.5:0/2659003188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7fa01029c0 0x7f7fa0078c40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:05.263 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.680+0000 7f7fa644b700 1 -- 172.21.15.5:0/2659003188 >> 172.21.15.5:0/2659003188 conn(0x7f7fa00fe120 msgr2=0x7f7fa00fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:05.264 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.681+0000 7f7fa644b700 1 -- 172.21.15.5:0/2659003188 shutdown_connections 2024-04-16T14:26:05.264 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:04.681+0000 7f7fa644b700 1 -- 172.21.15.5:0/2659003188 wait complete. 2024-04-16T14:26:05.264 INFO:teuthology.orchestra.run.smithi005.stdout:mgr not available, waiting (2/15)... 2024-04-16T14:26:06.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:05 smithi005 ceph-mon[28964]: Activating manager daemon smithi005.ipwdkc 2024-04-16T14:26:06.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:05 smithi005 ceph-mon[28964]: mgrmap e2: smithi005.ipwdkc(active, starting, since 0.00287903s) 2024-04-16T14:26:06.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:05 smithi005 ceph-mon[28964]: from='mgr.14100 172.21.15.5:0/3305376982' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-16T14:26:06.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:05 smithi005 ceph-mon[28964]: from='mgr.14100 172.21.15.5:0/3305376982' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-16T14:26:06.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:05 smithi005 ceph-mon[28964]: from='mgr.14100 172.21.15.5:0/3305376982' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-16T14:26:06.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:05 smithi005 ceph-mon[28964]: from='mgr.14100 172.21.15.5:0/3305376982' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-04-16T14:26:06.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:05 smithi005 ceph-mon[28964]: from='mgr.14100 172.21.15.5:0/3305376982' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr metadata", "who": "smithi005.ipwdkc", "id": "smithi005.ipwdkc"}]: dispatch 2024-04-16T14:26:06.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:05 smithi005 ceph-mon[28964]: Manager daemon smithi005.ipwdkc is now available 2024-04-16T14:26:06.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:05 smithi005 ceph-mon[28964]: from='mgr.14100 172.21.15.5:0/3305376982' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi005.ipwdkc/mirror_snapshot_schedule"}]: dispatch 2024-04-16T14:26:06.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:05 smithi005 ceph-mon[28964]: from='mgr.14100 172.21.15.5:0/3305376982' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:26:06.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:05 smithi005 ceph-mon[28964]: from='mgr.14100 172.21.15.5:0/3305376982' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi005.ipwdkc/trash_purge_schedule"}]: dispatch 2024-04-16T14:26:06.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:05 smithi005 ceph-mon[28964]: from='mgr.14100 172.21.15.5:0/3305376982' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:26:06.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:05 smithi005 ceph-mon[28964]: from='mgr.14100 172.21.15.5:0/3305376982' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:26:07.379 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:07 smithi005 ceph-mon[28964]: mgrmap e3: smithi005.ipwdkc(active, since 1.00726s) 2024-04-16T14:26:08.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:08 smithi005 ceph-mon[28964]: mgrmap e4: smithi005.ipwdkc(active, since 2s) 2024-04-16T14:26:08.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:08 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/246888493' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-16T14:26:08.797 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-04-16T14:26:08.797 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-04-16T14:26:08.797 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsid": "10609bfa-fbfd-11ee-bc90-c7b262605968", 2024-04-16T14:26:08.797 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "health": { 2024-04-16T14:26:08.797 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-16T14:26:08.797 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-16T14:26:08.797 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-16T14:26:08.797 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-04-16T14:26:08.798 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-16T14:26:08.798 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-16T14:26:08.798 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 0 2024-04-16T14:26:08.798 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-04-16T14:26:08.798 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-16T14:26:08.798 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "smithi005" 2024-04-16T14:26:08.798 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-04-16T14:26:08.798 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-04-16T14:26:08.798 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-16T14:26:08.798 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-16T14:26:08.798 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-16T14:26:08.798 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-16T14:26:08.798 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-04-16T14:26:08.798 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-16T14:26:08.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-16T14:26:08.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-16T14:26:08.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-16T14:26:08.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-16T14:26:08.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-16T14:26:08.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-16T14:26:08.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-16T14:26:08.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-04-16T14:26:08.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-16T14:26:08.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-16T14:26:08.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-16T14:26:08.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-16T14:26:08.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-16T14:26:08.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-16T14:26:08.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-16T14:26:08.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-16T14:26:08.800 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-16T14:26:08.800 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-04-16T14:26:08.800 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-16T14:26:08.800 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-16T14:26:08.800 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-16T14:26:08.800 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-16T14:26:08.800 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-04-16T14:26:08.800 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-16T14:26:08.800 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-16T14:26:08.800 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-16T14:26:08.800 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-16T14:26:08.800 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-16T14:26:08.800 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-16T14:26:08.800 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "restful" 2024-04-16T14:26:08.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-04-16T14:26:08.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-16T14:26:08.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-04-16T14:26:08.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-16T14:26:08.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-16T14:26:08.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modified": "2024-04-16T14:25:45.191174+0000", 2024-04-16T14:26:08.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-16T14:26:08.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-04-16T14:26:08.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-16T14:26:08.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-04-16T14:26:08.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.659+0000 7fc99f62d700 1 Processor -- start 2024-04-16T14:26:08.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.660+0000 7fc99f62d700 1 -- start start 2024-04-16T14:26:08.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.660+0000 7fc99f62d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc998100c50 0x7fc998101060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:08.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.660+0000 7fc99f62d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9981015a0 con 0x7fc998100c50 2024-04-16T14:26:08.802 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.660+0000 7fc99d3c9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc998100c50 0x7fc998101060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:08.802 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.660+0000 7fc99d3c9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc998100c50 0x7fc998101060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48104/0 (socket says 172.21.15.5:48104) 2024-04-16T14:26:08.802 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.660+0000 7fc99d3c9700 1 -- 172.21.15.5:0/3529991204 learned_addr learned my addr 172.21.15.5:0/3529991204 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:08.802 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.660+0000 7fc99d3c9700 1 -- 172.21.15.5:0/3529991204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9981016e0 con 0x7fc998100c50 2024-04-16T14:26:08.802 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.661+0000 7fc99d3c9700 1 --2- 172.21.15.5:0/3529991204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc998100c50 0x7fc998101060 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0098e0 tx=0x7fc98c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47792d782b4cdc99 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:08.802 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.661+0000 7fc98bfff700 1 -- 172.21.15.5:0/3529991204 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc98c00b860 con 0x7fc998100c50 2024-04-16T14:26:08.802 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.661+0000 7fc98bfff700 1 -- 172.21.15.5:0/3529991204 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fc98c00be50 con 0x7fc998100c50 2024-04-16T14:26:08.802 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.661+0000 7fc98bfff700 1 -- 172.21.15.5:0/3529991204 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc98c010380 con 0x7fc998100c50 2024-04-16T14:26:08.802 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.661+0000 7fc99f62d700 1 -- 172.21.15.5:0/3529991204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc998100c50 msgr2=0x7fc998101060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:08.802 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.661+0000 7fc99f62d700 1 --2- 172.21.15.5:0/3529991204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc998100c50 0x7fc998101060 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0098e0 tx=0x7fc98c009250 comp rx=0 tx=0).stop 2024-04-16T14:26:08.802 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.661+0000 7fc99f62d700 1 -- 172.21.15.5:0/3529991204 shutdown_connections 2024-04-16T14:26:08.802 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.661+0000 7fc99f62d700 1 --2- 172.21.15.5:0/3529991204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc998100c50 0x7fc998101060 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:08.802 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.661+0000 7fc99f62d700 1 -- 172.21.15.5:0/3529991204 >> 172.21.15.5:0/3529991204 conn(0x7fc9980fc770 msgr2=0x7fc9980feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:08.803 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.661+0000 7fc99f62d700 1 -- 172.21.15.5:0/3529991204 shutdown_connections 2024-04-16T14:26:08.803 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.661+0000 7fc99f62d700 1 -- 172.21.15.5:0/3529991204 wait complete. 2024-04-16T14:26:08.803 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.662+0000 7fc99f62d700 1 Processor -- start 2024-04-16T14:26:08.803 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.662+0000 7fc99f62d700 1 -- start start 2024-04-16T14:26:08.803 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.662+0000 7fc99f62d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc998100c50 0x7fc998111940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:08.803 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.662+0000 7fc99f62d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc998111e80 con 0x7fc998100c50 2024-04-16T14:26:08.803 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.662+0000 7fc99d3c9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc998100c50 0x7fc998111940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:08.803 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.662+0000 7fc99d3c9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc998100c50 0x7fc998111940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48114/0 (socket says 172.21.15.5:48114) 2024-04-16T14:26:08.803 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.662+0000 7fc99d3c9700 1 -- 172.21.15.5:0/246888493 learned_addr learned my addr 172.21.15.5:0/246888493 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:08.803 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.663+0000 7fc99d3c9700 1 -- 172.21.15.5:0/246888493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98c0094f0 con 0x7fc998100c50 2024-04-16T14:26:08.803 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.663+0000 7fc99d3c9700 1 --2- 172.21.15.5:0/246888493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc998100c50 0x7fc998111940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc98c006b00 tx=0x7fc98c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:08.803 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.663+0000 7fc989ffb700 1 -- 172.21.15.5:0/246888493 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc98c010760 con 0x7fc998100c50 2024-04-16T14:26:08.803 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.663+0000 7fc99f62d700 1 -- 172.21.15.5:0/246888493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc998112080 con 0x7fc998100c50 2024-04-16T14:26:08.804 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.663+0000 7fc989ffb700 1 -- 172.21.15.5:0/246888493 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fc98c010d50 con 0x7fc998100c50 2024-04-16T14:26:08.804 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.663+0000 7fc989ffb700 1 -- 172.21.15.5:0/246888493 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc98c01ad40 con 0x7fc998100c50 2024-04-16T14:26:08.804 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.663+0000 7fc99f62d700 1 -- 172.21.15.5:0/246888493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc998112bf0 con 0x7fc998100c50 2024-04-16T14:26:08.804 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.664+0000 7fc989ffb700 1 -- 172.21.15.5:0/246888493 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7fc98c02e440 con 0x7fc998100c50 2024-04-16T14:26:08.804 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.664+0000 7fc99f62d700 1 -- 172.21.15.5:0/246888493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc99805f5f0 con 0x7fc998100c50 2024-04-16T14:26:08.804 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.664+0000 7fc989ffb700 1 --2- 172.21.15.5:0/246888493 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7fc984036740 0x7fc984038bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:08.804 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.664+0000 7fc989ffb700 1 -- 172.21.15.5:0/246888493 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc98c04a5e0 con 0x7fc998100c50 2024-04-16T14:26:08.804 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.664+0000 7fc99cbc8700 1 --2- 172.21.15.5:0/246888493 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7fc984036740 0x7fc984038bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:08.804 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.665+0000 7fc99cbc8700 1 --2- 172.21.15.5:0/246888493 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7fc984036740 0x7fc984038bf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc994009990 tx=0x7fc994006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:08.804 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.669+0000 7fc989ffb700 1 -- 172.21.15.5:0/246888493 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc98c018940 con 0x7fc998100c50 2024-04-16T14:26:08.804 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.943+0000 7fc99f62d700 1 -- 172.21.15.5:0/246888493 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fc99804bed0 con 0x7fc998100c50 2024-04-16T14:26:08.804 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.943+0000 7fc989ffb700 1 -- 172.21.15.5:0/246888493 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fc98c018350 con 0x7fc998100c50 2024-04-16T14:26:08.804 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.946+0000 7fc99f62d700 1 -- 172.21.15.5:0/246888493 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7fc984036740 msgr2=0x7fc984038bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:08.805 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.946+0000 7fc99f62d700 1 --2- 172.21.15.5:0/246888493 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7fc984036740 0x7fc984038bf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc994009990 tx=0x7fc994006e40 comp rx=0 tx=0).stop 2024-04-16T14:26:08.805 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.946+0000 7fc99f62d700 1 -- 172.21.15.5:0/246888493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc998100c50 msgr2=0x7fc998111940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:08.805 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.946+0000 7fc99f62d700 1 --2- 172.21.15.5:0/246888493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc998100c50 0x7fc998111940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc98c006b00 tx=0x7fc98c009250 comp rx=0 tx=0).stop 2024-04-16T14:26:08.805 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.946+0000 7fc99f62d700 1 -- 172.21.15.5:0/246888493 shutdown_connections 2024-04-16T14:26:08.805 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.946+0000 7fc99f62d700 1 --2- 172.21.15.5:0/246888493 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7fc984036740 0x7fc984038bf0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:08.805 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.946+0000 7fc99f62d700 1 --2- 172.21.15.5:0/246888493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc998100c50 0x7fc998111940 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:08.805 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.946+0000 7fc99f62d700 1 -- 172.21.15.5:0/246888493 >> 172.21.15.5:0/246888493 conn(0x7fc9980fc770 msgr2=0x7fc9980fd360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:08.805 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.946+0000 7fc99f62d700 1 -- 172.21.15.5:0/246888493 shutdown_connections 2024-04-16T14:26:08.805 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:07.946+0000 7fc99f62d700 1 -- 172.21.15.5:0/246888493 wait complete. 2024-04-16T14:26:08.805 INFO:teuthology.orchestra.run.smithi005.stdout:mgr is available 2024-04-16T14:26:09.713 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:09 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/3509309605' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-16T14:26:09.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-04-16T14:26:09.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [global] 2024-04-16T14:26:09.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout fsid = 10609bfa-fbfd-11ee-bc90-c7b262605968 2024-04-16T14:26:09.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-16T14:26:09.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-16T14:26:09.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-16T14:26:09.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-16T14:26:09.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-04-16T14:26:09.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-16T14:26:09.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-16T14:26:09.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-04-16T14:26:09.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [osd] 2024-04-16T14:26:09.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-16T14:26:09.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-16T14:26:09.986 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-16T14:26:09.986 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-16T14:26:09.986 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-16T14:26:09.986 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.209+0000 7ffb33f48700 1 Processor -- start 2024-04-16T14:26:09.986 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.209+0000 7ffb33f48700 1 -- start start 2024-04-16T14:26:09.986 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.209+0000 7ffb33f48700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb2c1017d0 0x7ffb2c101be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:09.986 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.209+0000 7ffb33f48700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c102120 con 0x7ffb2c1017d0 2024-04-16T14:26:09.986 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.209+0000 7ffb31ce4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb2c1017d0 0x7ffb2c101be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:09.986 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.209+0000 7ffb31ce4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb2c1017d0 0x7ffb2c101be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44124/0 (socket says 172.21.15.5:44124) 2024-04-16T14:26:09.986 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.209+0000 7ffb31ce4700 1 -- 172.21.15.5:0/1916599161 learned_addr learned my addr 172.21.15.5:0/1916599161 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:09.986 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.210+0000 7ffb31ce4700 1 -- 172.21.15.5:0/1916599161 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2c102260 con 0x7ffb2c1017d0 2024-04-16T14:26:09.986 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.210+0000 7ffb31ce4700 1 --2- 172.21.15.5:0/1916599161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb2c1017d0 0x7ffb2c101be0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0098e0 tx=0x7ffb1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a68694ed0129d0c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:09.987 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.210+0000 7ffb30ce2700 1 -- 172.21.15.5:0/1916599161 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb1c00b860 con 0x7ffb2c1017d0 2024-04-16T14:26:09.987 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.210+0000 7ffb30ce2700 1 -- 172.21.15.5:0/1916599161 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ffb1c00be50 con 0x7ffb2c1017d0 2024-04-16T14:26:09.987 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.210+0000 7ffb30ce2700 1 -- 172.21.15.5:0/1916599161 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb1c010380 con 0x7ffb2c1017d0 2024-04-16T14:26:09.987 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.210+0000 7ffb33f48700 1 -- 172.21.15.5:0/1916599161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb2c1017d0 msgr2=0x7ffb2c101be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:09.987 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.210+0000 7ffb33f48700 1 --2- 172.21.15.5:0/1916599161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb2c1017d0 0x7ffb2c101be0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0098e0 tx=0x7ffb1c009250 comp rx=0 tx=0).stop 2024-04-16T14:26:09.987 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.210+0000 7ffb33f48700 1 -- 172.21.15.5:0/1916599161 shutdown_connections 2024-04-16T14:26:09.987 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.210+0000 7ffb33f48700 1 --2- 172.21.15.5:0/1916599161 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb2c1017d0 0x7ffb2c101be0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:09.988 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.210+0000 7ffb33f48700 1 -- 172.21.15.5:0/1916599161 >> 172.21.15.5:0/1916599161 conn(0x7ffb2c0fcfd0 msgr2=0x7ffb2c0ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:09.988 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.211+0000 7ffb33f48700 1 -- 172.21.15.5:0/1916599161 shutdown_connections 2024-04-16T14:26:09.988 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.211+0000 7ffb33f48700 1 -- 172.21.15.5:0/1916599161 wait complete. 2024-04-16T14:26:09.988 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.211+0000 7ffb33f48700 1 Processor -- start 2024-04-16T14:26:09.988 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.211+0000 7ffb33f48700 1 -- start start 2024-04-16T14:26:09.988 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.211+0000 7ffb33f48700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb2c1017d0 0x7ffb2c107a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:09.988 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.211+0000 7ffb33f48700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c107f60 con 0x7ffb2c1017d0 2024-04-16T14:26:09.988 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.211+0000 7ffb31ce4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb2c1017d0 0x7ffb2c107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:09.989 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.211+0000 7ffb31ce4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb2c1017d0 0x7ffb2c107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44128/0 (socket says 172.21.15.5:44128) 2024-04-16T14:26:09.989 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.211+0000 7ffb31ce4700 1 -- 172.21.15.5:0/3509309605 learned_addr learned my addr 172.21.15.5:0/3509309605 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:09.989 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.212+0000 7ffb31ce4700 1 -- 172.21.15.5:0/3509309605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c0094f0 con 0x7ffb2c1017d0 2024-04-16T14:26:09.989 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.212+0000 7ffb31ce4700 1 --2- 172.21.15.5:0/3509309605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb2c1017d0 0x7ffb2c107a20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c006b00 tx=0x7ffb1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:09.989 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.212+0000 7ffb2a7fc700 1 -- 172.21.15.5:0/3509309605 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb1c010760 con 0x7ffb2c1017d0 2024-04-16T14:26:09.989 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.212+0000 7ffb2a7fc700 1 -- 172.21.15.5:0/3509309605 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ffb1c010d50 con 0x7ffb2c1017d0 2024-04-16T14:26:09.989 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.212+0000 7ffb33f48700 1 -- 172.21.15.5:0/3509309605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb2c105fd0 con 0x7ffb2c1017d0 2024-04-16T14:26:09.989 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.212+0000 7ffb2a7fc700 1 -- 172.21.15.5:0/3509309605 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb1c01ad40 con 0x7ffb2c1017d0 2024-04-16T14:26:09.989 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.212+0000 7ffb33f48700 1 -- 172.21.15.5:0/3509309605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2c1064c0 con 0x7ffb2c1017d0 2024-04-16T14:26:09.989 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.213+0000 7ffb2a7fc700 1 -- 172.21.15.5:0/3509309605 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7ffb1c02e440 con 0x7ffb2c1017d0 2024-04-16T14:26:09.989 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.213+0000 7ffb33f48700 1 -- 172.21.15.5:0/3509309605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb2c04bed0 con 0x7ffb2c1017d0 2024-04-16T14:26:09.989 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.213+0000 7ffb2a7fc700 1 --2- 172.21.15.5:0/3509309605 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7ffb14036790 0x7ffb14038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:09.989 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.213+0000 7ffb2a7fc700 1 -- 172.21.15.5:0/3509309605 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ffb1c04a700 con 0x7ffb2c1017d0 2024-04-16T14:26:09.989 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.213+0000 7ffb314e3700 1 --2- 172.21.15.5:0/3509309605 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7ffb14036790 0x7ffb14038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:09.990 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.214+0000 7ffb314e3700 1 --2- 172.21.15.5:0/3509309605 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7ffb14036790 0x7ffb14038c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffb20009990 tx=0x7ffb20006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:09.990 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.218+0000 7ffb2a7fc700 1 -- 172.21.15.5:0/3509309605 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ffb1c018710 con 0x7ffb2c1017d0 2024-04-16T14:26:09.990 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.412+0000 7ffb33f48700 1 -- 172.21.15.5:0/3509309605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7ffb2c106940 con 0x7ffb2c1017d0 2024-04-16T14:26:09.990 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.413+0000 7ffb2a7fc700 1 -- 172.21.15.5:0/3509309605 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7ffb1c018350 con 0x7ffb2c1017d0 2024-04-16T14:26:09.990 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.416+0000 7ffb33f48700 1 -- 172.21.15.5:0/3509309605 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7ffb14036790 msgr2=0x7ffb14038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:09.990 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.416+0000 7ffb33f48700 1 --2- 172.21.15.5:0/3509309605 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7ffb14036790 0x7ffb14038c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffb20009990 tx=0x7ffb20006e40 comp rx=0 tx=0).stop 2024-04-16T14:26:09.990 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.416+0000 7ffb33f48700 1 -- 172.21.15.5:0/3509309605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb2c1017d0 msgr2=0x7ffb2c107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:09.990 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.416+0000 7ffb33f48700 1 --2- 172.21.15.5:0/3509309605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb2c1017d0 0x7ffb2c107a20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c006b00 tx=0x7ffb1c009250 comp rx=0 tx=0).stop 2024-04-16T14:26:09.990 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.416+0000 7ffb33f48700 1 -- 172.21.15.5:0/3509309605 shutdown_connections 2024-04-16T14:26:09.991 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.416+0000 7ffb33f48700 1 --2- 172.21.15.5:0/3509309605 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7ffb14036790 0x7ffb14038c40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:09.991 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.416+0000 7ffb33f48700 1 --2- 172.21.15.5:0/3509309605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb2c1017d0 0x7ffb2c107a20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:09.991 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.416+0000 7ffb33f48700 1 -- 172.21.15.5:0/3509309605 >> 172.21.15.5:0/3509309605 conn(0x7ffb2c0fcfd0 msgr2=0x7ffb2c0fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:09.991 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.416+0000 7ffb33f48700 1 -- 172.21.15.5:0/3509309605 shutdown_connections 2024-04-16T14:26:09.991 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:09.416+0000 7ffb33f48700 1 -- 172.21.15.5:0/3509309605 wait complete. 2024-04-16T14:26:09.991 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling cephadm module... 2024-04-16T14:26:10.970 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:10 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/323146213' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-16T14:26:11.249 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.406+0000 7f7de10af700 1 Processor -- start 2024-04-16T14:26:11.250 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.406+0000 7f7de10af700 1 -- start start 2024-04-16T14:26:11.250 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.406+0000 7f7de10af700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ddc1017f0 0x7f7ddc101c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:11.250 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.406+0000 7f7de10af700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc102140 con 0x7f7ddc1017f0 2024-04-16T14:26:11.250 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.406+0000 7f7ddad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ddc1017f0 0x7f7ddc101c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:11.250 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.406+0000 7f7ddad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ddc1017f0 0x7f7ddc101c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44142/0 (socket says 172.21.15.5:44142) 2024-04-16T14:26:11.250 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.406+0000 7f7ddad9d700 1 -- 172.21.15.5:0/1548719223 learned_addr learned my addr 172.21.15.5:0/1548719223 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:11.250 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.407+0000 7f7ddad9d700 1 -- 172.21.15.5:0/1548719223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ddc102280 con 0x7f7ddc1017f0 2024-04-16T14:26:11.251 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.407+0000 7f7ddad9d700 1 --2- 172.21.15.5:0/1548719223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ddc1017f0 0x7f7ddc101c00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc009e50 tx=0x7f7dcc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46c9e7c7c82efdf server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:11.251 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.407+0000 7f7dd9d9b700 1 -- 172.21.15.5:0/1548719223 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7dcc0092e0 con 0x7f7ddc1017f0 2024-04-16T14:26:11.270 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.407+0000 7f7dd9d9b700 1 -- 172.21.15.5:0/1548719223 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7dcc012430 con 0x7f7ddc1017f0 2024-04-16T14:26:11.270 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.407+0000 7f7dd9d9b700 1 -- 172.21.15.5:0/1548719223 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7dcc0075c0 con 0x7f7ddc1017f0 2024-04-16T14:26:11.270 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.407+0000 7f7de10af700 1 -- 172.21.15.5:0/1548719223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ddc1017f0 msgr2=0x7f7ddc101c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:11.270 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.407+0000 7f7de10af700 1 --2- 172.21.15.5:0/1548719223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ddc1017f0 0x7f7ddc101c00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc009e50 tx=0x7f7dcc009840 comp rx=0 tx=0).stop 2024-04-16T14:26:11.270 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.407+0000 7f7de10af700 1 -- 172.21.15.5:0/1548719223 shutdown_connections 2024-04-16T14:26:11.270 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.408+0000 7f7de10af700 1 --2- 172.21.15.5:0/1548719223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ddc1017f0 0x7f7ddc101c00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:11.271 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.408+0000 7f7de10af700 1 -- 172.21.15.5:0/1548719223 >> 172.21.15.5:0/1548719223 conn(0x7f7ddc0fcfd0 msgr2=0x7f7ddc0ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:11.271 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.408+0000 7f7de10af700 1 -- 172.21.15.5:0/1548719223 shutdown_connections 2024-04-16T14:26:11.271 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.408+0000 7f7de10af700 1 -- 172.21.15.5:0/1548719223 wait complete. 2024-04-16T14:26:11.271 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.408+0000 7f7de10af700 1 Processor -- start 2024-04-16T14:26:11.271 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.408+0000 7f7de10af700 1 -- start start 2024-04-16T14:26:11.271 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.408+0000 7f7de10af700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ddc1017f0 0x7f7ddc1079a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:11.271 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.408+0000 7f7de10af700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc107ee0 con 0x7f7ddc1017f0 2024-04-16T14:26:11.271 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.409+0000 7f7ddad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ddc1017f0 0x7f7ddc1079a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:11.271 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.409+0000 7f7ddad9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ddc1017f0 0x7f7ddc1079a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44154/0 (socket says 172.21.15.5:44154) 2024-04-16T14:26:11.271 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.409+0000 7f7ddad9d700 1 -- 172.21.15.5:0/323146213 learned_addr learned my addr 172.21.15.5:0/323146213 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:11.271 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.409+0000 7f7ddad9d700 1 -- 172.21.15.5:0/323146213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dcc009ae0 con 0x7f7ddc1017f0 2024-04-16T14:26:11.271 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.409+0000 7f7ddad9d700 1 --2- 172.21.15.5:0/323146213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ddc1017f0 0x7f7ddc1079a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc012da0 tx=0x7f7dcc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:11.271 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.409+0000 7f7dd37fe700 1 -- 172.21.15.5:0/323146213 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7dcc0092e0 con 0x7f7ddc1017f0 2024-04-16T14:26:11.271 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.409+0000 7f7dd37fe700 1 -- 172.21.15.5:0/323146213 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7dcc007cc0 con 0x7f7ddc1017f0 2024-04-16T14:26:11.271 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.409+0000 7f7de10af700 1 -- 172.21.15.5:0/323146213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ddc105fa0 con 0x7f7ddc1017f0 2024-04-16T14:26:11.272 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.409+0000 7f7dd37fe700 1 -- 172.21.15.5:0/323146213 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7dcc01c910 con 0x7f7ddc1017f0 2024-04-16T14:26:11.272 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.409+0000 7f7de10af700 1 -- 172.21.15.5:0/323146213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ddc106490 con 0x7f7ddc1017f0 2024-04-16T14:26:11.272 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.410+0000 7f7dd37fe700 1 -- 172.21.15.5:0/323146213 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7f7dcc019070 con 0x7f7ddc1017f0 2024-04-16T14:26:11.272 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.410+0000 7f7de10af700 1 -- 172.21.15.5:0/323146213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ddc04bed0 con 0x7f7ddc1017f0 2024-04-16T14:26:11.272 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.410+0000 7f7dd37fe700 1 --2- 172.21.15.5:0/323146213 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7f7dc8036790 0x7f7dc8038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:11.272 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.410+0000 7f7dd37fe700 1 -- 172.21.15.5:0/323146213 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f7dcc049da0 con 0x7f7ddc1017f0 2024-04-16T14:26:11.272 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.411+0000 7f7dda59c700 1 --2- 172.21.15.5:0/323146213 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7f7dc8036790 0x7f7dc8038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:11.272 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.411+0000 7f7dda59c700 1 --2- 172.21.15.5:0/323146213 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7f7dc8036790 0x7f7dc8038c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009990 tx=0x7f7dc4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:11.272 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.415+0000 7f7dd37fe700 1 -- 172.21.15.5:0/323146213 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7dcc011570 con 0x7f7ddc1017f0 2024-04-16T14:26:11.272 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.663+0000 7f7de10af700 1 -- 172.21.15.5:0/323146213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f7ddc10b680 con 0x7f7ddc1017f0 2024-04-16T14:26:11.272 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.715+0000 7f7dd37fe700 1 -- 172.21.15.5:0/323146213 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f7dcc07c250 con 0x7f7ddc1017f0 2024-04-16T14:26:11.272 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.716+0000 7f7dd37fe700 1 -- 172.21.15.5:0/323146213 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f7dcc019790 con 0x7f7ddc1017f0 2024-04-16T14:26:11.272 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.719+0000 7f7de10af700 1 -- 172.21.15.5:0/323146213 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7f7dc8036790 msgr2=0x7f7dc8038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:11.272 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.719+0000 7f7de10af700 1 --2- 172.21.15.5:0/323146213 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7f7dc8036790 0x7f7dc8038c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009990 tx=0x7f7dc4006e40 comp rx=0 tx=0).stop 2024-04-16T14:26:11.273 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.719+0000 7f7de10af700 1 -- 172.21.15.5:0/323146213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ddc1017f0 msgr2=0x7f7ddc1079a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:11.273 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.719+0000 7f7de10af700 1 --2- 172.21.15.5:0/323146213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ddc1017f0 0x7f7ddc1079a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc012da0 tx=0x7f7dcc009840 comp rx=0 tx=0).stop 2024-04-16T14:26:11.273 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.719+0000 7f7de10af700 1 -- 172.21.15.5:0/323146213 shutdown_connections 2024-04-16T14:26:11.273 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.719+0000 7f7de10af700 1 --2- 172.21.15.5:0/323146213 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7f7dc8036790 0x7f7dc8038c40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:11.273 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.719+0000 7f7de10af700 1 --2- 172.21.15.5:0/323146213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7ddc1017f0 0x7f7ddc1079a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:11.273 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.719+0000 7f7de10af700 1 -- 172.21.15.5:0/323146213 >> 172.21.15.5:0/323146213 conn(0x7f7ddc0fcfd0 msgr2=0x7f7ddc0fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:11.273 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.719+0000 7f7de10af700 1 -- 172.21.15.5:0/323146213 shutdown_connections 2024-04-16T14:26:11.273 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:10.719+0000 7f7de10af700 1 -- 172.21.15.5:0/323146213 wait complete. 2024-04-16T14:26:11.877 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:11 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/323146213' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-16T14:26:11.878 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:11 smithi005 ceph-mon[28964]: mgrmap e5: smithi005.ipwdkc(active, since 5s) 2024-04-16T14:26:12.547 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-04-16T14:26:12.547 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-16T14:26:12.547 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-16T14:26:12.548 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "active_name": "smithi005.ipwdkc", 2024-04-16T14:26:12.548 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-16T14:26:12.548 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-04-16T14:26:12.548 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.674+0000 7f77a205e700 1 Processor -- start 2024-04-16T14:26:12.548 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.674+0000 7f77a205e700 1 -- start start 2024-04-16T14:26:12.548 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.674+0000 7f77a205e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f779c1029a0 0x7f779c102db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:12.548 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.674+0000 7f77a205e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c1032f0 con 0x7f779c1029a0 2024-04-16T14:26:12.548 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.674+0000 7f779b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f779c1029a0 0x7f779c102db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:12.548 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.674+0000 7f779b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f779c1029a0 0x7f779c102db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44186/0 (socket says 172.21.15.5:44186) 2024-04-16T14:26:12.549 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.674+0000 7f779b7fe700 1 -- 172.21.15.5:0/1337678334 learned_addr learned my addr 172.21.15.5:0/1337678334 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:12.550 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.675+0000 7f779b7fe700 1 -- 172.21.15.5:0/1337678334 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779c103430 con 0x7f779c1029a0 2024-04-16T14:26:12.550 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.675+0000 7f779b7fe700 1 --2- 172.21.15.5:0/1337678334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f779c1029a0 0x7f779c102db0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f778c0098e0 tx=0x7f778c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54b2468db5d0881 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:12.550 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.675+0000 7f779a7fc700 1 -- 172.21.15.5:0/1337678334 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f778c00b8f0 con 0x7f779c1029a0 2024-04-16T14:26:12.550 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.675+0000 7f779a7fc700 1 -- 172.21.15.5:0/1337678334 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f778c011420 con 0x7f779c1029a0 2024-04-16T14:26:12.550 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.675+0000 7f779a7fc700 1 -- 172.21.15.5:0/1337678334 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f778c010540 con 0x7f779c1029a0 2024-04-16T14:26:12.550 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.676+0000 7f77a205e700 1 -- 172.21.15.5:0/1337678334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f779c1029a0 msgr2=0x7f779c102db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:12.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.676+0000 7f77a205e700 1 --2- 172.21.15.5:0/1337678334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f779c1029a0 0x7f779c102db0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f778c0098e0 tx=0x7f778c009250 comp rx=0 tx=0).stop 2024-04-16T14:26:12.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.676+0000 7f77a205e700 1 -- 172.21.15.5:0/1337678334 shutdown_connections 2024-04-16T14:26:12.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.676+0000 7f77a205e700 1 --2- 172.21.15.5:0/1337678334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f779c1029a0 0x7f779c102db0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:12.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.676+0000 7f77a205e700 1 -- 172.21.15.5:0/1337678334 >> 172.21.15.5:0/1337678334 conn(0x7f779c0fe100 msgr2=0x7f779c100530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:12.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.676+0000 7f77a205e700 1 -- 172.21.15.5:0/1337678334 shutdown_connections 2024-04-16T14:26:12.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.676+0000 7f77a205e700 1 -- 172.21.15.5:0/1337678334 wait complete. 2024-04-16T14:26:12.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.676+0000 7f77a205e700 1 Processor -- start 2024-04-16T14:26:12.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.676+0000 7f77a205e700 1 -- start start 2024-04-16T14:26:12.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.677+0000 7f77a205e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f779c1029a0 0x7f779c077b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:12.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.677+0000 7f77a205e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c078070 con 0x7f779c1029a0 2024-04-16T14:26:12.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.677+0000 7f779b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f779c1029a0 0x7f779c077b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:12.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.677+0000 7f779b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f779c1029a0 0x7f779c077b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44194/0 (socket says 172.21.15.5:44194) 2024-04-16T14:26:12.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.677+0000 7f779b7fe700 1 -- 172.21.15.5:0/2242347941 learned_addr learned my addr 172.21.15.5:0/2242347941 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:12.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.677+0000 7f779b7fe700 1 -- 172.21.15.5:0/2242347941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778c0094f0 con 0x7f779c1029a0 2024-04-16T14:26:12.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.677+0000 7f779b7fe700 1 --2- 172.21.15.5:0/2242347941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f779c1029a0 0x7f779c077b30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f778c010760 tx=0x7f778c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:12.552 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.677+0000 7f7783fff700 1 -- 172.21.15.5:0/2242347941 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f778c010800 con 0x7f779c1029a0 2024-04-16T14:26:12.552 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.677+0000 7f7783fff700 1 -- 172.21.15.5:0/2242347941 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f778c010df0 con 0x7f779c1029a0 2024-04-16T14:26:12.552 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.677+0000 7f77a205e700 1 -- 172.21.15.5:0/2242347941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f779c0760e0 con 0x7f779c1029a0 2024-04-16T14:26:12.552 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.677+0000 7f7783fff700 1 -- 172.21.15.5:0/2242347941 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f778c0193c0 con 0x7f779c1029a0 2024-04-16T14:26:12.552 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.677+0000 7f77a205e700 1 -- 172.21.15.5:0/2242347941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f779c0765d0 con 0x7f779c1029a0 2024-04-16T14:26:12.552 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.678+0000 7f7783fff700 1 -- 172.21.15.5:0/2242347941 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f778c019680 con 0x7f779c1029a0 2024-04-16T14:26:12.552 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.678+0000 7f77a205e700 1 -- 172.21.15.5:0/2242347941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f779c04bed0 con 0x7f779c1029a0 2024-04-16T14:26:12.552 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.678+0000 7f7783fff700 1 --2- 172.21.15.5:0/2242347941 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7f7784036790 0x7f7784038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:12.552 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.678+0000 7f7783fff700 1 -- 172.21.15.5:0/2242347941 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f778c04a670 con 0x7f779c1029a0 2024-04-16T14:26:12.552 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.678+0000 7f779affd700 1 -- 172.21.15.5:0/2242347941 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7f7784036790 msgr2=0x7f7784038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/1086445367 2024-04-16T14:26:12.552 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.679+0000 7f779affd700 1 --2- 172.21.15.5:0/2242347941 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7f7784036790 0x7f7784038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T14:26:12.552 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.683+0000 7f7783fff700 1 -- 172.21.15.5:0/2242347941 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f778c022da0 con 0x7f779c1029a0 2024-04-16T14:26:12.552 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.880+0000 7f779affd700 1 -- 172.21.15.5:0/2242347941 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7f7784036790 msgr2=0x7f7784038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/1086445367 2024-04-16T14:26:12.552 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.880+0000 7f779affd700 1 --2- 172.21.15.5:0/2242347941 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7f7784036790 0x7f7784038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-16T14:26:12.552 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.938+0000 7f77a205e700 1 -- 172.21.15.5:0/2242347941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f779c076c70 con 0x7f779c1029a0 2024-04-16T14:26:12.553 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.938+0000 7f7783fff700 1 -- 172.21.15.5:0/2242347941 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f778c022340 con 0x7f779c1029a0 2024-04-16T14:26:12.553 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.940+0000 7f77a205e700 1 -- 172.21.15.5:0/2242347941 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7f7784036790 msgr2=0x7f7784038c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T14:26:12.553 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.940+0000 7f77a205e700 1 --2- 172.21.15.5:0/2242347941 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7f7784036790 0x7f7784038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:12.553 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.940+0000 7f77a205e700 1 -- 172.21.15.5:0/2242347941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f779c1029a0 msgr2=0x7f779c077b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:12.553 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.940+0000 7f77a205e700 1 --2- 172.21.15.5:0/2242347941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f779c1029a0 0x7f779c077b30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f778c010760 tx=0x7f778c009250 comp rx=0 tx=0).stop 2024-04-16T14:26:12.553 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.940+0000 7f77a205e700 1 -- 172.21.15.5:0/2242347941 shutdown_connections 2024-04-16T14:26:12.553 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.941+0000 7f77a205e700 1 --2- 172.21.15.5:0/2242347941 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7f7784036790 0x7f7784038c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:12.553 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.941+0000 7f77a205e700 1 --2- 172.21.15.5:0/2242347941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f779c1029a0 0x7f779c077b30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:12.553 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.941+0000 7f77a205e700 1 -- 172.21.15.5:0/2242347941 >> 172.21.15.5:0/2242347941 conn(0x7f779c0fe100 msgr2=0x7f779c0fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:12.553 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.941+0000 7f77a205e700 1 -- 172.21.15.5:0/2242347941 shutdown_connections 2024-04-16T14:26:12.553 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:11.941+0000 7f77a205e700 1 -- 172.21.15.5:0/2242347941 wait complete. 2024-04-16T14:26:12.553 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for the mgr to restart... 2024-04-16T14:26:12.553 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr epoch 5... 2024-04-16T14:26:12.822 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:12 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/2242347941' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-16T14:26:17.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:17 smithi005 ceph-mon[28964]: Active manager daemon smithi005.ipwdkc restarted 2024-04-16T14:26:17.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:17 smithi005 ceph-mon[28964]: Activating manager daemon smithi005.ipwdkc 2024-04-16T14:26:17.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:17 smithi005 ceph-mon[28964]: osdmap e2: 0 total, 0 up, 0 in 2024-04-16T14:26:17.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:17 smithi005 ceph-mon[28964]: mgrmap e6: smithi005.ipwdkc(active, starting, since 0.00328569s) 2024-04-16T14:26:17.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:17 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-04-16T14:26:17.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:17 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr metadata", "who": "smithi005.ipwdkc", "id": "smithi005.ipwdkc"}]: dispatch 2024-04-16T14:26:17.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:17 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-16T14:26:17.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:17 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-16T14:26:17.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:17 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-16T14:26:17.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:17 smithi005 ceph-mon[28964]: Manager daemon smithi005.ipwdkc is now available 2024-04-16T14:26:17.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:17 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:26:17.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:17 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:26:17.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:17 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:26:17.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:17 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:26:17.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:17 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:26:17.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:17 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi005.ipwdkc/mirror_snapshot_schedule"}]: dispatch 2024-04-16T14:26:17.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:17 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi005.ipwdkc/trash_purge_schedule"}]: dispatch 2024-04-16T14:26:18.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:18 smithi005 ceph-mon[28964]: Found migration_current of "None". Setting to last migration. 2024-04-16T14:26:18.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:18 smithi005 ceph-mon[28964]: mgrmap e7: smithi005.ipwdkc(active, since 1.00514s) 2024-04-16T14:26:19.028 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-04-16T14:26:19.028 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-16T14:26:19.028 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-16T14:26:19.028 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-04-16T14:26:19.028 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.923+0000 7fa6a7d41700 1 Processor -- start 2024-04-16T14:26:19.028 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.924+0000 7fa6a7d41700 1 -- start start 2024-04-16T14:26:19.028 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.924+0000 7fa6a7d41700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a0076ad0 0x7fa6a01055d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:19.028 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.924+0000 7fa6a7d41700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a0076ee0 con 0x7fa6a0076ad0 2024-04-16T14:26:19.028 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.924+0000 7fa6a5add700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a0076ad0 0x7fa6a01055d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:19.028 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.924+0000 7fa6a5add700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a0076ad0 0x7fa6a01055d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44202/0 (socket says 172.21.15.5:44202) 2024-04-16T14:26:19.028 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.924+0000 7fa6a5add700 1 -- 172.21.15.5:0/2815231681 learned_addr learned my addr 172.21.15.5:0/2815231681 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:19.028 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.924+0000 7fa6a5add700 1 -- 172.21.15.5:0/2815231681 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a0105b10 con 0x7fa6a0076ad0 2024-04-16T14:26:19.029 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.924+0000 7fa6a5add700 1 --2- 172.21.15.5:0/2815231681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a0076ad0 0x7fa6a01055d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa69c0098e0 tx=0x7fa69c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b134afd4af3753e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:19.029 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.925+0000 7fa6a4adb700 1 -- 172.21.15.5:0/2815231681 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa69c00b8f0 con 0x7fa6a0076ad0 2024-04-16T14:26:19.029 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.925+0000 7fa6a4adb700 1 -- 172.21.15.5:0/2815231681 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa69c011420 con 0x7fa6a0076ad0 2024-04-16T14:26:19.029 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.925+0000 7fa6a4adb700 1 -- 172.21.15.5:0/2815231681 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa69c010540 con 0x7fa6a0076ad0 2024-04-16T14:26:19.029 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.925+0000 7fa6a7d41700 1 -- 172.21.15.5:0/2815231681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a0076ad0 msgr2=0x7fa6a01055d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:19.029 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.925+0000 7fa6a7d41700 1 --2- 172.21.15.5:0/2815231681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a0076ad0 0x7fa6a01055d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa69c0098e0 tx=0x7fa69c009250 comp rx=0 tx=0).stop 2024-04-16T14:26:19.029 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.925+0000 7fa6a7d41700 1 -- 172.21.15.5:0/2815231681 shutdown_connections 2024-04-16T14:26:19.029 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.925+0000 7fa6a7d41700 1 --2- 172.21.15.5:0/2815231681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a0076ad0 0x7fa6a01055d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:19.029 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.925+0000 7fa6a7d41700 1 -- 172.21.15.5:0/2815231681 >> 172.21.15.5:0/2815231681 conn(0x7fa6a00fcfe0 msgr2=0x7fa6a00ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:19.029 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.925+0000 7fa6a7d41700 1 -- 172.21.15.5:0/2815231681 shutdown_connections 2024-04-16T14:26:19.029 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.925+0000 7fa6a7d41700 1 -- 172.21.15.5:0/2815231681 wait complete. 2024-04-16T14:26:19.029 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.926+0000 7fa6a7d41700 1 Processor -- start 2024-04-16T14:26:19.029 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.926+0000 7fa6a7d41700 1 -- start start 2024-04-16T14:26:19.029 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.926+0000 7fa6a7d41700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a0076ad0 0x7fa6a01117e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:19.029 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.926+0000 7fa6a7d41700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a0111d20 con 0x7fa6a0076ad0 2024-04-16T14:26:19.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.926+0000 7fa6a5add700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a0076ad0 0x7fa6a01117e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:19.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.926+0000 7fa6a5add700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a0076ad0 0x7fa6a01117e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44216/0 (socket says 172.21.15.5:44216) 2024-04-16T14:26:19.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.926+0000 7fa6a5add700 1 -- 172.21.15.5:0/1856412344 learned_addr learned my addr 172.21.15.5:0/1856412344 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:19.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.927+0000 7fa6a5add700 1 -- 172.21.15.5:0/1856412344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69c0094f0 con 0x7fa6a0076ad0 2024-04-16T14:26:19.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.927+0000 7fa6a5add700 1 --2- 172.21.15.5:0/1856412344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a0076ad0 0x7fa6a01117e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa69c000c00 tx=0x7fa69c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:19.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.927+0000 7fa6927fc700 1 -- 172.21.15.5:0/1856412344 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa69c0107b0 con 0x7fa6a0076ad0 2024-04-16T14:26:19.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.927+0000 7fa6a7d41700 1 -- 172.21.15.5:0/1856412344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6a0111f20 con 0x7fa6a0076ad0 2024-04-16T14:26:19.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.927+0000 7fa6927fc700 1 -- 172.21.15.5:0/1856412344 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fa69c010da0 con 0x7fa6a0076ad0 2024-04-16T14:26:19.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.927+0000 7fa6a7d41700 1 -- 172.21.15.5:0/1856412344 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a0112a40 con 0x7fa6a0076ad0 2024-04-16T14:26:19.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.927+0000 7fa6927fc700 1 -- 172.21.15.5:0/1856412344 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa69c01add0 con 0x7fa6a0076ad0 2024-04-16T14:26:19.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.928+0000 7fa6927fc700 1 -- 172.21.15.5:0/1856412344 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fa69c010910 con 0x7fa6a0076ad0 2024-04-16T14:26:19.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.928+0000 7fa6927fc700 1 --2- 172.21.15.5:0/1856412344 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7fa68c036790 0x7fa68c038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:19.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.928+0000 7fa6927fc700 1 -- 172.21.15.5:0/1856412344 --> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa68c039350 con 0x7fa68c036790 2024-04-16T14:26:19.030 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.928+0000 7fa6a52dc700 1 -- 172.21.15.5:0/1856412344 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7fa68c036790 msgr2=0x7fa68c038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/1086445367 2024-04-16T14:26:19.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.928+0000 7fa6927fc700 1 -- 172.21.15.5:0/1856412344 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa69c04ac60 con 0x7fa6a0076ad0 2024-04-16T14:26:19.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:12.928+0000 7fa6a52dc700 1 --2- 172.21.15.5:0/1856412344 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7fa68c036790 0x7fa68c038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T14:26:19.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:13.129+0000 7fa6a52dc700 1 -- 172.21.15.5:0/1856412344 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7fa68c036790 msgr2=0x7fa68c038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/1086445367 2024-04-16T14:26:19.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:13.129+0000 7fa6a52dc700 1 --2- 172.21.15.5:0/1856412344 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7fa68c036790 0x7fa68c038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-16T14:26:19.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:13.530+0000 7fa6a52dc700 1 -- 172.21.15.5:0/1856412344 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7fa68c036790 msgr2=0x7fa68c038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/1086445367 2024-04-16T14:26:19.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:13.530+0000 7fa6a52dc700 1 --2- 172.21.15.5:0/1856412344 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7fa68c036790 0x7fa68c038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-16T14:26:19.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:14.331+0000 7fa6a52dc700 1 -- 172.21.15.5:0/1856412344 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7fa68c036790 msgr2=0x7fa68c038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/1086445367 2024-04-16T14:26:19.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:14.331+0000 7fa6a52dc700 1 --2- 172.21.15.5:0/1856412344 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7fa68c036790 0x7fa68c038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-16T14:26:19.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:15.932+0000 7fa6a52dc700 1 -- 172.21.15.5:0/1856412344 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7fa68c036790 msgr2=0x7fa68c038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/1086445367 2024-04-16T14:26:19.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:15.932+0000 7fa6a52dc700 1 --2- 172.21.15.5:0/1856412344 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7fa68c036790 0x7fa68c038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-16T14:26:19.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:17.426+0000 7fa6927fc700 1 -- 172.21.15.5:0/1856412344 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mgrmap(e 6) v1 ==== 43143+0+0 (secure 0 0 0) 0x7fa69c02e440 con 0x7fa6a0076ad0 2024-04-16T14:26:19.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:17.426+0000 7fa6927fc700 1 -- 172.21.15.5:0/1856412344 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7fa68c036790 msgr2=0x7fa68c038c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T14:26:19.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:17.426+0000 7fa6927fc700 1 --2- 172.21.15.5:0/1856412344 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7fa68c036790 0x7fa68c038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:19.031 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:18.427+0000 7fa6927fc700 1 -- 172.21.15.5:0/1856412344 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 7) v1 ==== 43270+0+0 (secure 0 0 0) 0x7fa69c02e770 con 0x7fa6a0076ad0 2024-04-16T14:26:19.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:18.428+0000 7fa6927fc700 1 --2- 172.21.15.5:0/1856412344 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fa68c039fc0 0x7fa68c03c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:19.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:18.428+0000 7fa6927fc700 1 -- 172.21.15.5:0/1856412344 --> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa68c039350 con 0x7fa68c039fc0 2024-04-16T14:26:19.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:18.428+0000 7fa6a52dc700 1 --2- 172.21.15.5:0/1856412344 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fa68c039fc0 0x7fa68c03c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:19.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:18.429+0000 7fa6a52dc700 1 --2- 172.21.15.5:0/1856412344 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fa68c039fc0 0x7fa68c03c3a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa6940039d0 tx=0x7fa694009350 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:19.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:18.429+0000 7fa6927fc700 1 -- 172.21.15.5:0/1856412344 <== mgr.14118 v2:172.21.15.5:6800/4088193218 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7fa68c039350 con 0x7fa68c039fc0 2024-04-16T14:26:19.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:18.435+0000 7fa6a7d41700 1 -- 172.21.15.5:0/1856412344 --> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fa6a01123b0 con 0x7fa68c039fc0 2024-04-16T14:26:19.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:18.435+0000 7fa6927fc700 1 -- 172.21.15.5:0/1856412344 <== mgr.14118 v2:172.21.15.5:6800/4088193218 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fa6a01123b0 con 0x7fa68c039fc0 2024-04-16T14:26:19.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:18.436+0000 7fa6a7d41700 1 -- 172.21.15.5:0/1856412344 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fa68c039fc0 msgr2=0x7fa68c03c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:19.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:18.436+0000 7fa6a7d41700 1 --2- 172.21.15.5:0/1856412344 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fa68c039fc0 0x7fa68c03c3a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa6940039d0 tx=0x7fa694009350 comp rx=0 tx=0).stop 2024-04-16T14:26:19.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:18.436+0000 7fa6a7d41700 1 -- 172.21.15.5:0/1856412344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a0076ad0 msgr2=0x7fa6a01117e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:19.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:18.436+0000 7fa6a7d41700 1 --2- 172.21.15.5:0/1856412344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a0076ad0 0x7fa6a01117e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa69c000c00 tx=0x7fa69c009250 comp rx=0 tx=0).stop 2024-04-16T14:26:19.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:18.436+0000 7fa6a7d41700 1 -- 172.21.15.5:0/1856412344 shutdown_connections 2024-04-16T14:26:19.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:18.436+0000 7fa6a7d41700 1 --2- 172.21.15.5:0/1856412344 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fa68c039fc0 0x7fa68c03c3a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:19.032 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:18.436+0000 7fa6a7d41700 1 --2- 172.21.15.5:0/1856412344 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6a0076ad0 0x7fa6a01117e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:19.033 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:18.436+0000 7fa6a7d41700 1 --2- 172.21.15.5:0/1856412344 >> [v2:172.21.15.5:6800/1086445367,v1:172.21.15.5:6801/1086445367] conn(0x7fa68c036790 0x7fa68c038c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:19.033 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:18.436+0000 7fa6a7d41700 1 -- 172.21.15.5:0/1856412344 >> 172.21.15.5:0/1856412344 conn(0x7fa6a00fcfe0 msgr2=0x7fa6a00fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:19.034 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:18.436+0000 7fa6a7d41700 1 -- 172.21.15.5:0/1856412344 shutdown_connections 2024-04-16T14:26:19.034 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:18.436+0000 7fa6a7d41700 1 -- 172.21.15.5:0/1856412344 wait complete. 2024-04-16T14:26:19.034 INFO:teuthology.orchestra.run.smithi005.stdout:mgr epoch 5 is available 2024-04-16T14:26:19.034 INFO:teuthology.orchestra.run.smithi005.stdout:Setting orchestrator backend to cephadm... 2024-04-16T14:26:19.680 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:19 smithi005 ceph-mon[28964]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-16T14:26:19.680 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:19 smithi005 ceph-mon[28964]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-16T14:26:19.680 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:19 smithi005 ceph-mon[28964]: [16/Apr/2024:14:26:18] ENGINE Bus STARTING 2024-04-16T14:26:19.680 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:19 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:26:19.680 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:19 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:26:20.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.464+0000 7f762925e700 1 Processor -- start 2024-04-16T14:26:20.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.464+0000 7f762925e700 1 -- start start 2024-04-16T14:26:20.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.464+0000 7f762925e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7624102930 0x7f7624102d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:20.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.464+0000 7f762925e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7624103280 con 0x7f7624102930 2024-04-16T14:26:20.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.465+0000 7f7622d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7624102930 0x7f7624102d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:20.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.465+0000 7f7622d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7624102930 0x7f7624102d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38854/0 (socket says 172.21.15.5:38854) 2024-04-16T14:26:20.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.465+0000 7f7622d9d700 1 -- 172.21.15.5:0/4210937714 learned_addr learned my addr 172.21.15.5:0/4210937714 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:20.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.465+0000 7f7622d9d700 1 -- 172.21.15.5:0/4210937714 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76241033c0 con 0x7f7624102930 2024-04-16T14:26:20.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.465+0000 7f7622d9d700 1 --2- 172.21.15.5:0/4210937714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7624102930 0x7f7624102d40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f76140098e0 tx=0x7f7614009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4cae62cd672fac5 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:20.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.465+0000 7f7621d9b700 1 -- 172.21.15.5:0/4210937714 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f761400b860 con 0x7f7624102930 2024-04-16T14:26:20.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.465+0000 7f7621d9b700 1 -- 172.21.15.5:0/4210937714 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f761400be50 con 0x7f7624102930 2024-04-16T14:26:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.465+0000 7f7621d9b700 1 -- 172.21.15.5:0/4210937714 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7614010380 con 0x7f7624102930 2024-04-16T14:26:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.466+0000 7f762925e700 1 -- 172.21.15.5:0/4210937714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7624102930 msgr2=0x7f7624102d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.466+0000 7f762925e700 1 --2- 172.21.15.5:0/4210937714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7624102930 0x7f7624102d40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f76140098e0 tx=0x7f7614009250 comp rx=0 tx=0).stop 2024-04-16T14:26:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.466+0000 7f762925e700 1 -- 172.21.15.5:0/4210937714 shutdown_connections 2024-04-16T14:26:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.466+0000 7f762925e700 1 --2- 172.21.15.5:0/4210937714 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7624102930 0x7f7624102d40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.466+0000 7f762925e700 1 -- 172.21.15.5:0/4210937714 >> 172.21.15.5:0/4210937714 conn(0x7f76240fe0d0 msgr2=0x7f76241004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.466+0000 7f762925e700 1 -- 172.21.15.5:0/4210937714 shutdown_connections 2024-04-16T14:26:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.466+0000 7f762925e700 1 -- 172.21.15.5:0/4210937714 wait complete. 2024-04-16T14:26:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.466+0000 7f762925e700 1 Processor -- start 2024-04-16T14:26:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.467+0000 7f762925e700 1 -- start start 2024-04-16T14:26:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.467+0000 7f762925e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7624102930 0x7f7624111710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.467+0000 7f762925e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7624111c50 con 0x7f7624102930 2024-04-16T14:26:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.467+0000 7f7622d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7624102930 0x7f7624111710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.467+0000 7f7622d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7624102930 0x7f7624111710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38868/0 (socket says 172.21.15.5:38868) 2024-04-16T14:26:20.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.467+0000 7f7622d9d700 1 -- 172.21.15.5:0/4001558151 learned_addr learned my addr 172.21.15.5:0/4001558151 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:20.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.467+0000 7f7622d9d700 1 -- 172.21.15.5:0/4001558151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76140094f0 con 0x7f7624102930 2024-04-16T14:26:20.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.467+0000 7f7622d9d700 1 --2- 172.21.15.5:0/4001558151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7624102930 0x7f7624111710 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7614006b00 tx=0x7f7614009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:20.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.467+0000 7f761b7fe700 1 -- 172.21.15.5:0/4001558151 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7614010760 con 0x7f7624102930 2024-04-16T14:26:20.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.467+0000 7f761b7fe700 1 -- 172.21.15.5:0/4001558151 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7614010d50 con 0x7f7624102930 2024-04-16T14:26:20.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.467+0000 7f762925e700 1 -- 172.21.15.5:0/4001558151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7624111e50 con 0x7f7624102930 2024-04-16T14:26:20.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.467+0000 7f761b7fe700 1 -- 172.21.15.5:0/4001558151 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f761401ad40 con 0x7f7624102930 2024-04-16T14:26:20.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.467+0000 7f762925e700 1 -- 172.21.15.5:0/4001558151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76241129c0 con 0x7f7624102930 2024-04-16T14:26:20.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.468+0000 7f761b7fe700 1 -- 172.21.15.5:0/4001558151 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 7) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f76140108c0 con 0x7f7624102930 2024-04-16T14:26:20.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.469+0000 7f762925e700 1 -- 172.21.15.5:0/4001558151 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f762405f5f0 con 0x7f7624102930 2024-04-16T14:26:20.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.469+0000 7f761b7fe700 1 --2- 172.21.15.5:0/4001558151 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f7610036660 0x7f7610038b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:20.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.469+0000 7f761b7fe700 1 -- 172.21.15.5:0/4001558151 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f761404a450 con 0x7f7624102930 2024-04-16T14:26:20.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.469+0000 7f762259c700 1 --2- 172.21.15.5:0/4001558151 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f7610036660 0x7f7610038b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.469+0000 7f762259c700 1 --2- 172.21.15.5:0/4001558151 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f7610036660 0x7f7610038b10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f760c009990 tx=0x7f760c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.474+0000 7f761b7fe700 1 -- 172.21.15.5:0/4001558151 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7614018b40 con 0x7f7624102930 2024-04-16T14:26:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.682+0000 7f762925e700 1 -- 172.21.15.5:0/4001558151 --> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f76240ff3a0 con 0x7f7610036660 2024-04-16T14:26:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.689+0000 7f761b7fe700 1 -- 172.21.15.5:0/4001558151 <== mgr.14118 v2:172.21.15.5:6800/4088193218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f76240ff3a0 con 0x7f7610036660 2024-04-16T14:26:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.691+0000 7f762925e700 1 -- 172.21.15.5:0/4001558151 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f7610036660 msgr2=0x7f7610038b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.691+0000 7f762925e700 1 --2- 172.21.15.5:0/4001558151 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f7610036660 0x7f7610038b10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f760c009990 tx=0x7f760c006e40 comp rx=0 tx=0).stop 2024-04-16T14:26:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.691+0000 7f762925e700 1 -- 172.21.15.5:0/4001558151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7624102930 msgr2=0x7f7624111710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.691+0000 7f762925e700 1 --2- 172.21.15.5:0/4001558151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7624102930 0x7f7624111710 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7614006b00 tx=0x7f7614009250 comp rx=0 tx=0).stop 2024-04-16T14:26:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.691+0000 7f762925e700 1 -- 172.21.15.5:0/4001558151 shutdown_connections 2024-04-16T14:26:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.691+0000 7f762925e700 1 --2- 172.21.15.5:0/4001558151 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f7610036660 0x7f7610038b10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.691+0000 7f762925e700 1 --2- 172.21.15.5:0/4001558151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7624102930 0x7f7624111710 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.691+0000 7f762925e700 1 -- 172.21.15.5:0/4001558151 >> 172.21.15.5:0/4001558151 conn(0x7f76240fe0d0 msgr2=0x7f76240fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.691+0000 7f762925e700 1 -- 172.21.15.5:0/4001558151 shutdown_connections 2024-04-16T14:26:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:19.691+0000 7f762925e700 1 -- 172.21.15.5:0/4001558151 wait complete. 2024-04-16T14:26:20.808 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:20 smithi005 ceph-mon[28964]: [16/Apr/2024:14:26:18] ENGINE Serving on https://172.21.15.5:7150 2024-04-16T14:26:20.808 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:20 smithi005 ceph-mon[28964]: [16/Apr/2024:14:26:18] ENGINE Bus STARTED 2024-04-16T14:26:20.808 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:20 smithi005 ceph-mon[28964]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:26:20.808 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:20 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:26:20.808 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:20 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:26:20.808 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:20 smithi005 ceph-mon[28964]: mgrmap e8: smithi005.ipwdkc(active, since 2s) 2024-04-16T14:26:21.372 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-16T14:26:21.372 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.602+0000 7f0104700700 1 Processor -- start 2024-04-16T14:26:21.372 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.602+0000 7f0104700700 1 -- start start 2024-04-16T14:26:21.372 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.602+0000 7f0104700700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00fc102940 0x7f00fc102d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:21.372 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.602+0000 7f0104700700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc103290 con 0x7f00fc102940 2024-04-16T14:26:21.372 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.602+0000 7f010249c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00fc102940 0x7f00fc102d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:21.372 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.602+0000 7f010249c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00fc102940 0x7f00fc102d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38870/0 (socket says 172.21.15.5:38870) 2024-04-16T14:26:21.372 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.602+0000 7f010249c700 1 -- 172.21.15.5:0/2869363515 learned_addr learned my addr 172.21.15.5:0/2869363515 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:21.372 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.602+0000 7f010249c700 1 -- 172.21.15.5:0/2869363515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00fc1033d0 con 0x7f00fc102940 2024-04-16T14:26:21.372 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.603+0000 7f010249c700 1 --2- 172.21.15.5:0/2869363515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00fc102940 0x7f00fc102d50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f00f80098e0 tx=0x7f00f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd403c66d37d9e36 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:21.373 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.603+0000 7f010149a700 1 -- 172.21.15.5:0/2869363515 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f00f800b860 con 0x7f00fc102940 2024-04-16T14:26:21.373 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.603+0000 7f010149a700 1 -- 172.21.15.5:0/2869363515 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f00f800be50 con 0x7f00fc102940 2024-04-16T14:26:21.373 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.603+0000 7f010149a700 1 -- 172.21.15.5:0/2869363515 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f00f8010380 con 0x7f00fc102940 2024-04-16T14:26:21.373 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.603+0000 7f0104700700 1 -- 172.21.15.5:0/2869363515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00fc102940 msgr2=0x7f00fc102d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:21.373 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.603+0000 7f0104700700 1 --2- 172.21.15.5:0/2869363515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00fc102940 0x7f00fc102d50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f00f80098e0 tx=0x7f00f8009250 comp rx=0 tx=0).stop 2024-04-16T14:26:21.373 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.604+0000 7f0104700700 1 -- 172.21.15.5:0/2869363515 shutdown_connections 2024-04-16T14:26:21.374 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.604+0000 7f0104700700 1 --2- 172.21.15.5:0/2869363515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00fc102940 0x7f00fc102d50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:21.374 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.604+0000 7f0104700700 1 -- 172.21.15.5:0/2869363515 >> 172.21.15.5:0/2869363515 conn(0x7f00fc0fe0e0 msgr2=0x7f00fc1004f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:21.374 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.604+0000 7f0104700700 1 -- 172.21.15.5:0/2869363515 shutdown_connections 2024-04-16T14:26:21.374 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.604+0000 7f0104700700 1 -- 172.21.15.5:0/2869363515 wait complete. 2024-04-16T14:26:21.374 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.604+0000 7f0104700700 1 Processor -- start 2024-04-16T14:26:21.374 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.604+0000 7f0104700700 1 -- start start 2024-04-16T14:26:21.374 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.604+0000 7f0104700700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00fc102940 0x7f00fc1116e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:21.374 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.604+0000 7f0104700700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc111c20 con 0x7f00fc102940 2024-04-16T14:26:21.374 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.604+0000 7f010249c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00fc102940 0x7f00fc1116e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:21.374 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.605+0000 7f010249c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00fc102940 0x7f00fc1116e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38876/0 (socket says 172.21.15.5:38876) 2024-04-16T14:26:21.374 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.605+0000 7f010249c700 1 -- 172.21.15.5:0/1578480833 learned_addr learned my addr 172.21.15.5:0/1578480833 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:21.375 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.605+0000 7f010249c700 1 -- 172.21.15.5:0/1578480833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f80094f0 con 0x7f00fc102940 2024-04-16T14:26:21.375 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.605+0000 7f010249c700 1 --2- 172.21.15.5:0/1578480833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00fc102940 0x7f00fc1116e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f00f800ba90 tx=0x7f00f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:21.375 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.605+0000 7f00f2ffd700 1 -- 172.21.15.5:0/1578480833 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f00f80107c0 con 0x7f00fc102940 2024-04-16T14:26:21.375 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.605+0000 7f00f2ffd700 1 -- 172.21.15.5:0/1578480833 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f00f8010db0 con 0x7f00fc102940 2024-04-16T14:26:21.375 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.605+0000 7f0104700700 1 -- 172.21.15.5:0/1578480833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00fc111e20 con 0x7f00fc102940 2024-04-16T14:26:21.375 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.605+0000 7f00f2ffd700 1 -- 172.21.15.5:0/1578480833 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f00f801add0 con 0x7f00fc102940 2024-04-16T14:26:21.375 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.605+0000 7f0104700700 1 -- 172.21.15.5:0/1578480833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00fc112990 con 0x7f00fc102940 2024-04-16T14:26:21.375 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.606+0000 7f00f2ffd700 1 -- 172.21.15.5:0/1578480833 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f00f802e440 con 0x7f00fc102940 2024-04-16T14:26:21.375 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.606+0000 7f0104700700 1 -- 172.21.15.5:0/1578480833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00fc05f5f0 con 0x7f00fc102940 2024-04-16T14:26:21.375 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.606+0000 7f00f2ffd700 1 --2- 172.21.15.5:0/1578480833 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f00e80367e0 0x7f00e8038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:21.375 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.606+0000 7f00f2ffd700 1 -- 172.21.15.5:0/1578480833 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f00f804a7a0 con 0x7f00fc102940 2024-04-16T14:26:21.375 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.606+0000 7f0101c9b700 1 --2- 172.21.15.5:0/1578480833 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f00e80367e0 0x7f00e8038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:21.375 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.607+0000 7f0101c9b700 1 --2- 172.21.15.5:0/1578480833 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f00e80367e0 0x7f00e8038c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009990 tx=0x7f00ec006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:21.376 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.611+0000 7f00f2ffd700 1 -- 172.21.15.5:0/1578480833 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f00f8018940 con 0x7f00fc102940 2024-04-16T14:26:21.376 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.810+0000 7f0104700700 1 -- 172.21.15.5:0/1578480833 --> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f00fc0ff350 con 0x7f00e80367e0 2024-04-16T14:26:21.376 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.811+0000 7f00f2ffd700 1 -- 172.21.15.5:0/1578480833 <== mgr.14118 v2:172.21.15.5:6800/4088193218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f00fc0ff350 con 0x7f00e80367e0 2024-04-16T14:26:21.376 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.813+0000 7f0104700700 1 -- 172.21.15.5:0/1578480833 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f00e80367e0 msgr2=0x7f00e8038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:21.376 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.813+0000 7f0104700700 1 --2- 172.21.15.5:0/1578480833 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f00e80367e0 0x7f00e8038c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009990 tx=0x7f00ec006e40 comp rx=0 tx=0).stop 2024-04-16T14:26:21.376 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.813+0000 7f0104700700 1 -- 172.21.15.5:0/1578480833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00fc102940 msgr2=0x7f00fc1116e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:21.376 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.813+0000 7f0104700700 1 --2- 172.21.15.5:0/1578480833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00fc102940 0x7f00fc1116e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f00f800ba90 tx=0x7f00f8009250 comp rx=0 tx=0).stop 2024-04-16T14:26:21.376 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.813+0000 7f0104700700 1 -- 172.21.15.5:0/1578480833 shutdown_connections 2024-04-16T14:26:21.376 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.813+0000 7f0104700700 1 --2- 172.21.15.5:0/1578480833 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f00e80367e0 0x7f00e8038c90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:21.376 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.813+0000 7f0104700700 1 --2- 172.21.15.5:0/1578480833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00fc102940 0x7f00fc1116e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:21.376 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.813+0000 7f0104700700 1 -- 172.21.15.5:0/1578480833 >> 172.21.15.5:0/1578480833 conn(0x7f00fc0fe0e0 msgr2=0x7f00fc0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:21.376 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.813+0000 7f0104700700 1 -- 172.21.15.5:0/1578480833 shutdown_connections 2024-04-16T14:26:21.377 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:20.813+0000 7f0104700700 1 -- 172.21.15.5:0/1578480833 wait complete. 2024-04-16T14:26:21.377 INFO:teuthology.orchestra.run.smithi005.stdout:Generating ssh key... 2024-04-16T14:26:21.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:21 smithi005 ceph-mon[28964]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:26:22.978 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.822+0000 7f8e1e0f6700 1 Processor -- start 2024-04-16T14:26:22.978 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.822+0000 7f8e1e0f6700 1 -- start start 2024-04-16T14:26:22.978 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.822+0000 7f8e1e0f6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e18076c20 0x7f8e181054a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:22.978 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.822+0000 7f8e1e0f6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e181059e0 con 0x7f8e18076c20 2024-04-16T14:26:22.978 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.822+0000 7f8e177fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e18076c20 0x7f8e181054a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:22.978 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.822+0000 7f8e177fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e18076c20 0x7f8e181054a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38890/0 (socket says 172.21.15.5:38890) 2024-04-16T14:26:22.978 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.822+0000 7f8e177fe700 1 -- 172.21.15.5:0/1311515372 learned_addr learned my addr 172.21.15.5:0/1311515372 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:22.978 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.822+0000 7f8e177fe700 1 -- 172.21.15.5:0/1311515372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e18105b20 con 0x7f8e18076c20 2024-04-16T14:26:22.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.823+0000 7f8e177fe700 1 --2- 172.21.15.5:0/1311515372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e18076c20 0x7f8e181054a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8e080098e0 tx=0x7f8e08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19eaf978bef98 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:22.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.823+0000 7f8e167fc700 1 -- 172.21.15.5:0/1311515372 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e0800b860 con 0x7f8e18076c20 2024-04-16T14:26:22.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.823+0000 7f8e167fc700 1 -- 172.21.15.5:0/1311515372 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f8e0800be50 con 0x7f8e18076c20 2024-04-16T14:26:22.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.823+0000 7f8e167fc700 1 -- 172.21.15.5:0/1311515372 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e08010380 con 0x7f8e18076c20 2024-04-16T14:26:22.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.823+0000 7f8e1e0f6700 1 -- 172.21.15.5:0/1311515372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e18076c20 msgr2=0x7f8e181054a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:22.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.823+0000 7f8e1e0f6700 1 --2- 172.21.15.5:0/1311515372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e18076c20 0x7f8e181054a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8e080098e0 tx=0x7f8e08009250 comp rx=0 tx=0).stop 2024-04-16T14:26:22.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.823+0000 7f8e1e0f6700 1 -- 172.21.15.5:0/1311515372 shutdown_connections 2024-04-16T14:26:22.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.823+0000 7f8e1e0f6700 1 --2- 172.21.15.5:0/1311515372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e18076c20 0x7f8e181054a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:22.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.823+0000 7f8e1e0f6700 1 -- 172.21.15.5:0/1311515372 >> 172.21.15.5:0/1311515372 conn(0x7f8e180fcfd0 msgr2=0x7f8e180ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:22.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.823+0000 7f8e1e0f6700 1 -- 172.21.15.5:0/1311515372 shutdown_connections 2024-04-16T14:26:22.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.823+0000 7f8e1e0f6700 1 -- 172.21.15.5:0/1311515372 wait complete. 2024-04-16T14:26:22.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.824+0000 7f8e1e0f6700 1 Processor -- start 2024-04-16T14:26:22.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.824+0000 7f8e1e0f6700 1 -- start start 2024-04-16T14:26:22.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.824+0000 7f8e1e0f6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e18076c20 0x7f8e18111760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:22.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.824+0000 7f8e1e0f6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e18111ca0 con 0x7f8e18076c20 2024-04-16T14:26:22.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.824+0000 7f8e177fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e18076c20 0x7f8e18111760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:22.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.824+0000 7f8e177fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e18076c20 0x7f8e18111760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38906/0 (socket says 172.21.15.5:38906) 2024-04-16T14:26:22.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.824+0000 7f8e177fe700 1 -- 172.21.15.5:0/2055105119 learned_addr learned my addr 172.21.15.5:0/2055105119 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:22.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.825+0000 7f8e177fe700 1 -- 172.21.15.5:0/2055105119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e080094f0 con 0x7f8e18076c20 2024-04-16T14:26:22.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.825+0000 7f8e177fe700 1 --2- 172.21.15.5:0/2055105119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e18076c20 0x7f8e18111760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8e080090b0 tx=0x7f8e08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:22.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.825+0000 7f8dfffff700 1 -- 172.21.15.5:0/2055105119 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e08010760 con 0x7f8e18076c20 2024-04-16T14:26:22.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.825+0000 7f8dfffff700 1 -- 172.21.15.5:0/2055105119 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f8e08010d50 con 0x7f8e18076c20 2024-04-16T14:26:22.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.825+0000 7f8e1e0f6700 1 -- 172.21.15.5:0/2055105119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e18111ea0 con 0x7f8e18076c20 2024-04-16T14:26:22.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.825+0000 7f8dfffff700 1 -- 172.21.15.5:0/2055105119 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e0801ace0 con 0x7f8e18076c20 2024-04-16T14:26:22.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.825+0000 7f8e1e0f6700 1 -- 172.21.15.5:0/2055105119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e18112a10 con 0x7f8e18076c20 2024-04-16T14:26:22.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.826+0000 7f8dfffff700 1 -- 172.21.15.5:0/2055105119 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f8e0802d3f0 con 0x7f8e18076c20 2024-04-16T14:26:22.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.826+0000 7f8e1e0f6700 1 -- 172.21.15.5:0/2055105119 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e1805f5f0 con 0x7f8e18076c20 2024-04-16T14:26:22.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.826+0000 7f8dfffff700 1 --2- 172.21.15.5:0/2055105119 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f8e000367e0 0x7f8e00038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:22.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.826+0000 7f8dfffff700 1 -- 172.21.15.5:0/2055105119 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f8e0804a2c0 con 0x7f8e18076c20 2024-04-16T14:26:22.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.826+0000 7f8e16ffd700 1 --2- 172.21.15.5:0/2055105119 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f8e000367e0 0x7f8e00038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:22.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.827+0000 7f8e16ffd700 1 --2- 172.21.15.5:0/2055105119 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f8e000367e0 0x7f8e00038c90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c009990 tx=0x7f8e0c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:22.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:21.831+0000 7f8dfffff700 1 -- 172.21.15.5:0/2055105119 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8e0802b8c0 con 0x7f8e18076c20 2024-04-16T14:26:22.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:22.026+0000 7f8e1e0f6700 1 -- 172.21.15.5:0/2055105119 --> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e180fe3b0 con 0x7f8e000367e0 2024-04-16T14:26:22.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:22.417+0000 7f8dfffff700 1 -- 172.21.15.5:0/2055105119 <== mgr.14118 v2:172.21.15.5:6800/4088193218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8e180fe3b0 con 0x7f8e000367e0 2024-04-16T14:26:22.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:22.419+0000 7f8e1e0f6700 1 -- 172.21.15.5:0/2055105119 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f8e000367e0 msgr2=0x7f8e00038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:22.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:22.419+0000 7f8e1e0f6700 1 --2- 172.21.15.5:0/2055105119 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f8e000367e0 0x7f8e00038c90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c009990 tx=0x7f8e0c006e40 comp rx=0 tx=0).stop 2024-04-16T14:26:22.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:22.419+0000 7f8e1e0f6700 1 -- 172.21.15.5:0/2055105119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e18076c20 msgr2=0x7f8e18111760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:22.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:22.419+0000 7f8e1e0f6700 1 --2- 172.21.15.5:0/2055105119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e18076c20 0x7f8e18111760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8e080090b0 tx=0x7f8e08009250 comp rx=0 tx=0).stop 2024-04-16T14:26:22.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:22.420+0000 7f8e1e0f6700 1 -- 172.21.15.5:0/2055105119 shutdown_connections 2024-04-16T14:26:22.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:22.420+0000 7f8e1e0f6700 1 --2- 172.21.15.5:0/2055105119 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f8e000367e0 0x7f8e00038c90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:22.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:22.420+0000 7f8e1e0f6700 1 --2- 172.21.15.5:0/2055105119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8e18076c20 0x7f8e18111760 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:22.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:22.420+0000 7f8e1e0f6700 1 -- 172.21.15.5:0/2055105119 >> 172.21.15.5:0/2055105119 conn(0x7f8e180fcfd0 msgr2=0x7f8e180fdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:22.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:22.420+0000 7f8e1e0f6700 1 -- 172.21.15.5:0/2055105119 shutdown_connections 2024-04-16T14:26:22.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:22.420+0000 7f8e1e0f6700 1 -- 172.21.15.5:0/2055105119 wait complete. 2024-04-16T14:26:23.573 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:23 smithi005 ceph-mon[28964]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:26:23.573 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:23 smithi005 ceph-mon[28964]: Generating ssh key... 2024-04-16T14:26:23.573 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:23 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:26:23.573 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:23 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:26:24.330 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1Jt416Z33HdgIdgd6QjBfA+1jjCzvJb0vVUEmQZK5m8Xr47B9ZpthKFUKnKQYIRvFzNP6oAg7FvyaTfWsCymflrhKewVSmn9otdUTmVZqroB5KWaGb5XpuS97WUyhtUUAPEpvm/P1MVYFwSfCDpW8tX8ItfJmAmyI/t5wzXj/YnCUrdlCWaNzIR0ADoTjo7V6ee4DYVyg1twDaGVS6IMYAIQFB8dJHH/zZWvpHif6pMw2s0OnUb2GKFTZeiffWhLQGLocns+9aVQpBpArNodV9NPCKNN6dso0+OPnFGYxgeEdJaeFJTd31LeN3Y3s9lh6/u+hI/vxTamYNfkWdXDH/rDfF0vNzQWvsgDH1sWlToS3NgkMyOA41F8CCVKrD+sk6Q+r+LiRn9mRUABgbcOQeKcA/Q/+KcoMRxrXkpgdL0GMUQX9G+tXFivVNJ3b53B0tAp19E/juM9eionkP90amv/EKLAU8N/tQAGeTO7WAJpZmFdSv67af9g4aEDrX4U= ceph-10609bfa-fbfd-11ee-bc90-c7b262605968 2024-04-16T14:26:24.330 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.389+0000 7f6c631fb700 1 Processor -- start 2024-04-16T14:26:24.330 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.389+0000 7f6c631fb700 1 -- start start 2024-04-16T14:26:24.330 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.389+0000 7f6c631fb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c5c101dc0 0x7f6c5c1021d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:24.330 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.389+0000 7f6c631fb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c102710 con 0x7f6c5c101dc0 2024-04-16T14:26:24.330 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.389+0000 7f6c60f97700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c5c101dc0 0x7f6c5c1021d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:24.331 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.390+0000 7f6c60f97700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c5c101dc0 0x7f6c5c1021d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38922/0 (socket says 172.21.15.5:38922) 2024-04-16T14:26:24.331 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.390+0000 7f6c60f97700 1 -- 172.21.15.5:0/1683407063 learned_addr learned my addr 172.21.15.5:0/1683407063 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:24.331 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.390+0000 7f6c60f97700 1 -- 172.21.15.5:0/1683407063 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5c102850 con 0x7f6c5c101dc0 2024-04-16T14:26:24.331 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.390+0000 7f6c60f97700 1 --2- 172.21.15.5:0/1683407063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c5c101dc0 0x7f6c5c1021d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c0098e0 tx=0x7f6c4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76251a972356b614 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:24.331 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.390+0000 7f6c5b7fe700 1 -- 172.21.15.5:0/1683407063 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c4c00b860 con 0x7f6c5c101dc0 2024-04-16T14:26:24.331 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.390+0000 7f6c5b7fe700 1 -- 172.21.15.5:0/1683407063 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f6c4c00be50 con 0x7f6c5c101dc0 2024-04-16T14:26:24.331 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.390+0000 7f6c5b7fe700 1 -- 172.21.15.5:0/1683407063 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c4c010380 con 0x7f6c5c101dc0 2024-04-16T14:26:24.331 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.391+0000 7f6c631fb700 1 -- 172.21.15.5:0/1683407063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c5c101dc0 msgr2=0x7f6c5c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:24.331 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.391+0000 7f6c631fb700 1 --2- 172.21.15.5:0/1683407063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c5c101dc0 0x7f6c5c1021d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c0098e0 tx=0x7f6c4c009250 comp rx=0 tx=0).stop 2024-04-16T14:26:24.332 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.391+0000 7f6c631fb700 1 -- 172.21.15.5:0/1683407063 shutdown_connections 2024-04-16T14:26:24.332 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.391+0000 7f6c631fb700 1 --2- 172.21.15.5:0/1683407063 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c5c101dc0 0x7f6c5c1021d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:24.332 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.391+0000 7f6c631fb700 1 -- 172.21.15.5:0/1683407063 >> 172.21.15.5:0/1683407063 conn(0x7f6c5c0fc770 msgr2=0x7f6c5c0feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:24.332 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.391+0000 7f6c631fb700 1 -- 172.21.15.5:0/1683407063 shutdown_connections 2024-04-16T14:26:24.332 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.391+0000 7f6c631fb700 1 -- 172.21.15.5:0/1683407063 wait complete. 2024-04-16T14:26:24.332 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.391+0000 7f6c631fb700 1 Processor -- start 2024-04-16T14:26:24.332 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.391+0000 7f6c631fb700 1 -- start start 2024-04-16T14:26:24.332 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.392+0000 7f6c631fb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c5c101dc0 0x7f6c5c111740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:24.332 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.392+0000 7f6c631fb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c111c80 con 0x7f6c5c101dc0 2024-04-16T14:26:24.333 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.392+0000 7f6c60f97700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c5c101dc0 0x7f6c5c111740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:24.333 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.392+0000 7f6c60f97700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c5c101dc0 0x7f6c5c111740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38928/0 (socket says 172.21.15.5:38928) 2024-04-16T14:26:24.333 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.392+0000 7f6c60f97700 1 -- 172.21.15.5:0/425287852 learned_addr learned my addr 172.21.15.5:0/425287852 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:24.333 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.392+0000 7f6c60f97700 1 -- 172.21.15.5:0/425287852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c0094f0 con 0x7f6c5c101dc0 2024-04-16T14:26:24.333 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.392+0000 7f6c60f97700 1 --2- 172.21.15.5:0/425287852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c5c101dc0 0x7f6c5c111740 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c006b00 tx=0x7f6c4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:24.333 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.392+0000 7f6c597fa700 1 -- 172.21.15.5:0/425287852 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c4c010760 con 0x7f6c5c101dc0 2024-04-16T14:26:24.333 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.392+0000 7f6c597fa700 1 -- 172.21.15.5:0/425287852 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f6c4c010d50 con 0x7f6c5c101dc0 2024-04-16T14:26:24.333 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.392+0000 7f6c631fb700 1 -- 172.21.15.5:0/425287852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c5c111e80 con 0x7f6c5c101dc0 2024-04-16T14:26:24.333 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.392+0000 7f6c597fa700 1 -- 172.21.15.5:0/425287852 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c4c01ad40 con 0x7f6c5c101dc0 2024-04-16T14:26:24.334 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.392+0000 7f6c631fb700 1 -- 172.21.15.5:0/425287852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c5c1129f0 con 0x7f6c5c101dc0 2024-04-16T14:26:24.334 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.393+0000 7f6c597fa700 1 -- 172.21.15.5:0/425287852 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f6c4c0108c0 con 0x7f6c5c101dc0 2024-04-16T14:26:24.334 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.393+0000 7f6c631fb700 1 -- 172.21.15.5:0/425287852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c5c05f5f0 con 0x7f6c5c101dc0 2024-04-16T14:26:24.334 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.393+0000 7f6c597fa700 1 --2- 172.21.15.5:0/425287852 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f6c480367e0 0x7f6c48038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:24.334 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.394+0000 7f6c597fa700 1 -- 172.21.15.5:0/425287852 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6c4c04a560 con 0x7f6c5c101dc0 2024-04-16T14:26:24.334 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.394+0000 7f6c5bfff700 1 --2- 172.21.15.5:0/425287852 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f6c480367e0 0x7f6c48038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:24.334 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.394+0000 7f6c5bfff700 1 --2- 172.21.15.5:0/425287852 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f6c480367e0 0x7f6c48038c90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6c4400ad90 tx=0x7f6c44009410 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:24.334 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.398+0000 7f6c597fa700 1 -- 172.21.15.5:0/425287852 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6c4c018b40 con 0x7f6c5c101dc0 2024-04-16T14:26:24.334 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.600+0000 7f6c631fb700 1 -- 172.21.15.5:0/425287852 --> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c5c113570 con 0x7f6c480367e0 2024-04-16T14:26:24.334 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.601+0000 7f6c597fa700 1 -- 172.21.15.5:0/425287852 <== mgr.14118 v2:172.21.15.5:6800/4088193218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f6c5c113570 con 0x7f6c480367e0 2024-04-16T14:26:24.334 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.603+0000 7f6c631fb700 1 -- 172.21.15.5:0/425287852 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f6c480367e0 msgr2=0x7f6c48038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:24.334 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.603+0000 7f6c631fb700 1 --2- 172.21.15.5:0/425287852 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f6c480367e0 0x7f6c48038c90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6c4400ad90 tx=0x7f6c44009410 comp rx=0 tx=0).stop 2024-04-16T14:26:24.334 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.603+0000 7f6c631fb700 1 -- 172.21.15.5:0/425287852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c5c101dc0 msgr2=0x7f6c5c111740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:24.334 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.603+0000 7f6c631fb700 1 --2- 172.21.15.5:0/425287852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c5c101dc0 0x7f6c5c111740 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c006b00 tx=0x7f6c4c009250 comp rx=0 tx=0).stop 2024-04-16T14:26:24.335 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.603+0000 7f6c631fb700 1 -- 172.21.15.5:0/425287852 shutdown_connections 2024-04-16T14:26:24.335 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.603+0000 7f6c631fb700 1 --2- 172.21.15.5:0/425287852 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f6c480367e0 0x7f6c48038c90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:24.335 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.603+0000 7f6c631fb700 1 --2- 172.21.15.5:0/425287852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6c5c101dc0 0x7f6c5c111740 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:24.335 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.603+0000 7f6c631fb700 1 -- 172.21.15.5:0/425287852 >> 172.21.15.5:0/425287852 conn(0x7f6c5c0fc770 msgr2=0x7f6c5c0fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:24.335 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.603+0000 7f6c631fb700 1 -- 172.21.15.5:0/425287852 shutdown_connections 2024-04-16T14:26:24.335 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:23.603+0000 7f6c631fb700 1 -- 172.21.15.5:0/425287852 wait complete. 2024-04-16T14:26:24.335 INFO:teuthology.orchestra.run.smithi005.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-16T14:26:24.335 INFO:teuthology.orchestra.run.smithi005.stdout:Adding key to root@localhost authorized_keys... 2024-04-16T14:26:24.335 INFO:teuthology.orchestra.run.smithi005.stdout:Adding host smithi005... 2024-04-16T14:26:24.613 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:24 smithi005 ceph-mon[28964]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:26:25.938 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:25 smithi005 ceph-mon[28964]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi005", "addr": "172.21.15.5", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:26:25.938 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:25 smithi005 ceph-mon[28964]: Deploying cephadm binary to smithi005 2024-04-16T14:26:27.593 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Added host 'smithi005' with addr '172.21.15.5' 2024-04-16T14:26:27.593 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.724+0000 7efc09299700 1 Processor -- start 2024-04-16T14:26:27.594 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.724+0000 7efc09299700 1 -- start start 2024-04-16T14:26:27.594 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.724+0000 7efc09299700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04078c30 0x7efc04077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:27.594 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.724+0000 7efc09299700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc04079040 con 0x7efc04078c30 2024-04-16T14:26:27.594 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.724+0000 7efc02ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04078c30 0x7efc04077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:27.594 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.724+0000 7efc02ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04078c30 0x7efc04077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38938/0 (socket says 172.21.15.5:38938) 2024-04-16T14:26:27.594 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.724+0000 7efc02ffd700 1 -- 172.21.15.5:0/1003933570 learned_addr learned my addr 172.21.15.5:0/1003933570 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:27.594 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.724+0000 7efc02ffd700 1 -- 172.21.15.5:0/1003933570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc04077770 con 0x7efc04078c30 2024-04-16T14:26:27.594 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.724+0000 7efc02ffd700 1 --2- 172.21.15.5:0/1003933570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04078c30 0x7efc04077230 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efbf40098e0 tx=0x7efbf4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2fca688e642b154 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:27.594 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.725+0000 7efc01ffb700 1 -- 172.21.15.5:0/1003933570 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efbf400b860 con 0x7efc04078c30 2024-04-16T14:26:27.594 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.725+0000 7efc01ffb700 1 -- 172.21.15.5:0/1003933570 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7efbf400be50 con 0x7efc04078c30 2024-04-16T14:26:27.594 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.725+0000 7efc01ffb700 1 -- 172.21.15.5:0/1003933570 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efbf4010380 con 0x7efc04078c30 2024-04-16T14:26:27.594 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.725+0000 7efc09299700 1 -- 172.21.15.5:0/1003933570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04078c30 msgr2=0x7efc04077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:27.595 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.725+0000 7efc09299700 1 --2- 172.21.15.5:0/1003933570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04078c30 0x7efc04077230 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efbf40098e0 tx=0x7efbf4009250 comp rx=0 tx=0).stop 2024-04-16T14:26:27.595 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.725+0000 7efc09299700 1 -- 172.21.15.5:0/1003933570 shutdown_connections 2024-04-16T14:26:27.595 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.725+0000 7efc09299700 1 --2- 172.21.15.5:0/1003933570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04078c30 0x7efc04077230 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:27.595 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.725+0000 7efc09299700 1 -- 172.21.15.5:0/1003933570 >> 172.21.15.5:0/1003933570 conn(0x7efc040fe0d0 msgr2=0x7efc041004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:27.595 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.725+0000 7efc09299700 1 -- 172.21.15.5:0/1003933570 shutdown_connections 2024-04-16T14:26:27.595 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.725+0000 7efc09299700 1 -- 172.21.15.5:0/1003933570 wait complete. 2024-04-16T14:26:27.595 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.726+0000 7efc09299700 1 Processor -- start 2024-04-16T14:26:27.595 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.726+0000 7efc09299700 1 -- start start 2024-04-16T14:26:27.595 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.726+0000 7efc09299700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04078c30 0x7efc04113a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:27.595 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.726+0000 7efc09299700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc04113f40 con 0x7efc04078c30 2024-04-16T14:26:27.595 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.726+0000 7efc02ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04078c30 0x7efc04113a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:27.595 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.726+0000 7efc02ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04078c30 0x7efc04113a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38940/0 (socket says 172.21.15.5:38940) 2024-04-16T14:26:27.595 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.726+0000 7efc02ffd700 1 -- 172.21.15.5:0/667011432 learned_addr learned my addr 172.21.15.5:0/667011432 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:27.595 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.727+0000 7efc02ffd700 1 -- 172.21.15.5:0/667011432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf40094f0 con 0x7efc04078c30 2024-04-16T14:26:27.596 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.727+0000 7efc02ffd700 1 --2- 172.21.15.5:0/667011432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04078c30 0x7efc04113a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efbf4006d40 tx=0x7efbf4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:27.596 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.727+0000 7efbeb7fe700 1 -- 172.21.15.5:0/667011432 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efbf40107c0 con 0x7efc04078c30 2024-04-16T14:26:27.596 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.727+0000 7efbeb7fe700 1 -- 172.21.15.5:0/667011432 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7efbf4010db0 con 0x7efc04078c30 2024-04-16T14:26:27.596 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.727+0000 7efc09299700 1 -- 172.21.15.5:0/667011432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc04114140 con 0x7efc04078c30 2024-04-16T14:26:27.596 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.727+0000 7efbeb7fe700 1 -- 172.21.15.5:0/667011432 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efbf401ad40 con 0x7efc04078c30 2024-04-16T14:26:27.596 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.727+0000 7efc09299700 1 -- 172.21.15.5:0/667011432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc04114cb0 con 0x7efc04078c30 2024-04-16T14:26:27.596 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.728+0000 7efbeb7fe700 1 -- 172.21.15.5:0/667011432 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7efbf4010920 con 0x7efc04078c30 2024-04-16T14:26:27.596 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.728+0000 7efc09299700 1 -- 172.21.15.5:0/667011432 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc0405f5f0 con 0x7efc04078c30 2024-04-16T14:26:27.596 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.728+0000 7efbeb7fe700 1 --2- 172.21.15.5:0/667011432 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7efbec036790 0x7efbec038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:27.596 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.728+0000 7efbeb7fe700 1 -- 172.21.15.5:0/667011432 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7efbf4049fa0 con 0x7efc04078c30 2024-04-16T14:26:27.596 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.728+0000 7efc027fc700 1 --2- 172.21.15.5:0/667011432 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7efbec036790 0x7efbec038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:27.596 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.729+0000 7efc027fc700 1 --2- 172.21.15.5:0/667011432 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7efbec036790 0x7efbec038c40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efbf8009990 tx=0x7efbf8006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:27.596 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.733+0000 7efbeb7fe700 1 -- 172.21.15.5:0/667011432 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7efbf401a5f0 con 0x7efc04078c30 2024-04-16T14:26:27.596 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:24.933+0000 7efc09299700 1 -- 172.21.15.5:0/667011432 --> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi005", "addr": "172.21.15.5", "target": ["mon-mgr", ""]}) v1 -- 0x7efc040ff4d0 con 0x7efbec036790 2024-04-16T14:26:27.596 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:27.020+0000 7efbeb7fe700 1 -- 172.21.15.5:0/667011432 <== mgr.14118 v2:172.21.15.5:6800/4088193218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7efc040ff4d0 con 0x7efbec036790 2024-04-16T14:26:27.597 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:27.023+0000 7efc09299700 1 -- 172.21.15.5:0/667011432 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7efbec036790 msgr2=0x7efbec038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:27.597 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:27.023+0000 7efc09299700 1 --2- 172.21.15.5:0/667011432 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7efbec036790 0x7efbec038c40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efbf8009990 tx=0x7efbf8006e40 comp rx=0 tx=0).stop 2024-04-16T14:26:27.597 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:27.023+0000 7efc09299700 1 -- 172.21.15.5:0/667011432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04078c30 msgr2=0x7efc04113a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:27.597 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:27.023+0000 7efc09299700 1 --2- 172.21.15.5:0/667011432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04078c30 0x7efc04113a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efbf4006d40 tx=0x7efbf4009250 comp rx=0 tx=0).stop 2024-04-16T14:26:27.597 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:27.023+0000 7efc09299700 1 -- 172.21.15.5:0/667011432 shutdown_connections 2024-04-16T14:26:27.597 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:27.023+0000 7efc09299700 1 --2- 172.21.15.5:0/667011432 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7efbec036790 0x7efbec038c40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:27.597 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:27.023+0000 7efc09299700 1 --2- 172.21.15.5:0/667011432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04078c30 0x7efc04113a00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:27.597 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:27.023+0000 7efc09299700 1 -- 172.21.15.5:0/667011432 >> 172.21.15.5:0/667011432 conn(0x7efc040fe0d0 msgr2=0x7efc040fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:27.597 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:27.023+0000 7efc09299700 1 -- 172.21.15.5:0/667011432 shutdown_connections 2024-04-16T14:26:27.597 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:27.023+0000 7efc09299700 1 -- 172.21.15.5:0/667011432 wait complete. 2024-04-16T14:26:27.597 INFO:teuthology.orchestra.run.smithi005.stdout:Deploying mon service with default placement... 2024-04-16T14:26:28.223 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:28 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:26:28.223 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:28 smithi005 ceph-mon[28964]: Added host smithi005 2024-04-16T14:26:28.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:28 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:26:29.558 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:29 smithi005 ceph-mon[28964]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:26:29.559 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:29 smithi005 ceph-mon[28964]: Saving service mon spec with placement count:5 2024-04-16T14:26:29.559 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:29 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:26:29.559 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:29 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:26:29.767 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-16T14:26:29.767 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.067+0000 7f49b6834700 1 Processor -- start 2024-04-16T14:26:29.767 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.067+0000 7f49b6834700 1 -- start start 2024-04-16T14:26:29.767 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.068+0000 7f49b6834700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b0078b90 0x7f49b0077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:29.767 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.068+0000 7f49b6834700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b0078fa0 con 0x7f49b0078b90 2024-04-16T14:26:29.767 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.068+0000 7f49affff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b0078b90 0x7f49b0077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:29.767 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.068+0000 7f49affff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b0078b90 0x7f49b0077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38956/0 (socket says 172.21.15.5:38956) 2024-04-16T14:26:29.767 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.068+0000 7f49affff700 1 -- 172.21.15.5:0/1324914061 learned_addr learned my addr 172.21.15.5:0/1324914061 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:29.767 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.068+0000 7f49affff700 1 -- 172.21.15.5:0/1324914061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b00790e0 con 0x7f49b0078b90 2024-04-16T14:26:29.768 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.068+0000 7f49affff700 1 --2- 172.21.15.5:0/1324914061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b0078b90 0x7f49b0077230 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f49a00098e0 tx=0x7f49a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b624ce637c435b49 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:29.768 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.069+0000 7f49af7fe700 1 -- 172.21.15.5:0/1324914061 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f49a000b8f0 con 0x7f49b0078b90 2024-04-16T14:26:29.768 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.069+0000 7f49af7fe700 1 -- 172.21.15.5:0/1324914061 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f49a0011420 con 0x7f49b0078b90 2024-04-16T14:26:29.768 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.069+0000 7f49af7fe700 1 -- 172.21.15.5:0/1324914061 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f49a0010540 con 0x7f49b0078b90 2024-04-16T14:26:29.768 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.069+0000 7f49b6834700 1 -- 172.21.15.5:0/1324914061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b0078b90 msgr2=0x7f49b0077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:29.768 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.069+0000 7f49b6834700 1 --2- 172.21.15.5:0/1324914061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b0078b90 0x7f49b0077230 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f49a00098e0 tx=0x7f49a0009250 comp rx=0 tx=0).stop 2024-04-16T14:26:29.768 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.069+0000 7f49b6834700 1 -- 172.21.15.5:0/1324914061 shutdown_connections 2024-04-16T14:26:29.768 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.069+0000 7f49b6834700 1 --2- 172.21.15.5:0/1324914061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b0078b90 0x7f49b0077230 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:29.768 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.069+0000 7f49b6834700 1 -- 172.21.15.5:0/1324914061 >> 172.21.15.5:0/1324914061 conn(0x7f49b00fe120 msgr2=0x7f49b0100550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:29.768 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.069+0000 7f49b6834700 1 -- 172.21.15.5:0/1324914061 shutdown_connections 2024-04-16T14:26:29.768 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.069+0000 7f49b6834700 1 -- 172.21.15.5:0/1324914061 wait complete. 2024-04-16T14:26:29.768 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.070+0000 7f49b6834700 1 Processor -- start 2024-04-16T14:26:29.768 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.070+0000 7f49b6834700 1 -- start start 2024-04-16T14:26:29.768 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.070+0000 7f49b6834700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b0078b90 0x7f49b0113940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:29.769 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.070+0000 7f49b6834700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b0113e80 con 0x7f49b0078b90 2024-04-16T14:26:29.769 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.070+0000 7f49affff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b0078b90 0x7f49b0113940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:29.769 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.070+0000 7f49affff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b0078b90 0x7f49b0113940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38970/0 (socket says 172.21.15.5:38970) 2024-04-16T14:26:29.769 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.070+0000 7f49affff700 1 -- 172.21.15.5:0/3055508523 learned_addr learned my addr 172.21.15.5:0/3055508523 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:29.769 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.071+0000 7f49affff700 1 -- 172.21.15.5:0/3055508523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a00094f0 con 0x7f49b0078b90 2024-04-16T14:26:29.769 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.071+0000 7f49affff700 1 --2- 172.21.15.5:0/3055508523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b0078b90 0x7f49b0113940 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f49a0000c00 tx=0x7f49a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:29.769 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.071+0000 7f49ad7fa700 1 -- 172.21.15.5:0/3055508523 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f49a00107b0 con 0x7f49b0078b90 2024-04-16T14:26:29.769 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.071+0000 7f49ad7fa700 1 -- 172.21.15.5:0/3055508523 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f49a0010da0 con 0x7f49b0078b90 2024-04-16T14:26:29.769 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.071+0000 7f49b6834700 1 -- 172.21.15.5:0/3055508523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b01140e0 con 0x7f49b0078b90 2024-04-16T14:26:29.769 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.071+0000 7f49ad7fa700 1 -- 172.21.15.5:0/3055508523 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f49a001add0 con 0x7f49b0078b90 2024-04-16T14:26:29.769 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.071+0000 7f49b6834700 1 -- 172.21.15.5:0/3055508523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b0114bf0 con 0x7f49b0078b90 2024-04-16T14:26:29.769 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.072+0000 7f49ad7fa700 1 -- 172.21.15.5:0/3055508523 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f49a002e440 con 0x7f49b0078b90 2024-04-16T14:26:29.769 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.072+0000 7f49b6834700 1 -- 172.21.15.5:0/3055508523 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b005f5f0 con 0x7f49b0078b90 2024-04-16T14:26:29.769 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.072+0000 7f49ad7fa700 1 --2- 172.21.15.5:0/3055508523 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f499c036790 0x7f499c038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:29.770 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.072+0000 7f49ad7fa700 1 -- 172.21.15.5:0/3055508523 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f49a004ac20 con 0x7f49b0078b90 2024-04-16T14:26:29.770 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.072+0000 7f49a7fff700 1 --2- 172.21.15.5:0/3055508523 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f499c036790 0x7f499c038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:29.770 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.073+0000 7f49a7fff700 1 --2- 172.21.15.5:0/3055508523 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f499c036790 0x7f499c038c40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4998009990 tx=0x7f4998006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:29.770 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.077+0000 7f49ad7fa700 1 -- 172.21.15.5:0/3055508523 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f49a001a5c0 con 0x7f49b0078b90 2024-04-16T14:26:29.770 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.313+0000 7f49b6834700 1 -- 172.21.15.5:0/3055508523 --> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f49b00ff5f0 con 0x7f499c036790 2024-04-16T14:26:29.770 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.317+0000 7f49ad7fa700 1 -- 172.21.15.5:0/3055508523 <== mgr.14118 v2:172.21.15.5:6800/4088193218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f49b00ff5f0 con 0x7f499c036790 2024-04-16T14:26:29.770 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.319+0000 7f49b6834700 1 -- 172.21.15.5:0/3055508523 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f499c036790 msgr2=0x7f499c038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:29.770 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.319+0000 7f49b6834700 1 --2- 172.21.15.5:0/3055508523 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f499c036790 0x7f499c038c40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4998009990 tx=0x7f4998006e40 comp rx=0 tx=0).stop 2024-04-16T14:26:29.770 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.319+0000 7f49b6834700 1 -- 172.21.15.5:0/3055508523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b0078b90 msgr2=0x7f49b0113940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:29.770 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.319+0000 7f49b6834700 1 --2- 172.21.15.5:0/3055508523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b0078b90 0x7f49b0113940 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f49a0000c00 tx=0x7f49a0009250 comp rx=0 tx=0).stop 2024-04-16T14:26:29.770 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.319+0000 7f49b6834700 1 -- 172.21.15.5:0/3055508523 shutdown_connections 2024-04-16T14:26:29.771 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.319+0000 7f49b6834700 1 --2- 172.21.15.5:0/3055508523 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f499c036790 0x7f499c038c40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:29.771 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.319+0000 7f49b6834700 1 --2- 172.21.15.5:0/3055508523 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49b0078b90 0x7f49b0113940 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:29.771 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.319+0000 7f49b6834700 1 -- 172.21.15.5:0/3055508523 >> 172.21.15.5:0/3055508523 conn(0x7f49b00fe120 msgr2=0x7f49b00fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:29.771 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.319+0000 7f49b6834700 1 -- 172.21.15.5:0/3055508523 shutdown_connections 2024-04-16T14:26:29.771 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:28.319+0000 7f49b6834700 1 -- 172.21.15.5:0/3055508523 wait complete. 2024-04-16T14:26:29.771 INFO:teuthology.orchestra.run.smithi005.stdout:Deploying mgr service with default placement... 2024-04-16T14:26:31.192 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:30 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:26:31.192 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:30 smithi005 ceph-mon[28964]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:26:31.192 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:30 smithi005 ceph-mon[28964]: Saving service mgr spec with placement count:2 2024-04-16T14:26:31.192 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:30 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:26:31.203 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-16T14:26:31.204 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.223+0000 7fc6da579700 1 Processor -- start 2024-04-16T14:26:31.204 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.223+0000 7fc6da579700 1 -- start start 2024-04-16T14:26:31.204 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.223+0000 7fc6da579700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6d4100d10 0x7fc6d4101120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:31.204 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.223+0000 7fc6da579700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d4103b70 con 0x7fc6d4100d10 2024-04-16T14:26:31.204 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.223+0000 7fc6d3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6d4100d10 0x7fc6d4101120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:31.204 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.223+0000 7fc6d3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6d4100d10 0x7fc6d4101120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59804/0 (socket says 172.21.15.5:59804) 2024-04-16T14:26:31.204 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.223+0000 7fc6d3fff700 1 -- 172.21.15.5:0/4262612871 learned_addr learned my addr 172.21.15.5:0/4262612871 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:31.204 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.224+0000 7fc6d3fff700 1 -- 172.21.15.5:0/4262612871 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d4101660 con 0x7fc6d4100d10 2024-04-16T14:26:31.204 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.224+0000 7fc6d3fff700 1 --2- 172.21.15.5:0/4262612871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6d4100d10 0x7fc6d4101120 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc6c40098e0 tx=0x7fc6c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f88cbd73de528d server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:31.204 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.224+0000 7fc6d2ffd700 1 -- 172.21.15.5:0/4262612871 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc6c400b860 con 0x7fc6d4100d10 2024-04-16T14:26:31.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.224+0000 7fc6d2ffd700 1 -- 172.21.15.5:0/4262612871 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc6c400be90 con 0x7fc6d4100d10 2024-04-16T14:26:31.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.224+0000 7fc6d2ffd700 1 -- 172.21.15.5:0/4262612871 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc6c40103c0 con 0x7fc6d4100d10 2024-04-16T14:26:31.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.225+0000 7fc6da579700 1 -- 172.21.15.5:0/4262612871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6d4100d10 msgr2=0x7fc6d4101120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:31.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.225+0000 7fc6da579700 1 --2- 172.21.15.5:0/4262612871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6d4100d10 0x7fc6d4101120 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc6c40098e0 tx=0x7fc6c4009250 comp rx=0 tx=0).stop 2024-04-16T14:26:31.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.225+0000 7fc6da579700 1 -- 172.21.15.5:0/4262612871 shutdown_connections 2024-04-16T14:26:31.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.225+0000 7fc6da579700 1 --2- 172.21.15.5:0/4262612871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6d4100d10 0x7fc6d4101120 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:31.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.225+0000 7fc6da579700 1 -- 172.21.15.5:0/4262612871 >> 172.21.15.5:0/4262612871 conn(0x7fc6d40fc6f0 msgr2=0x7fc6d40feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:31.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.225+0000 7fc6da579700 1 -- 172.21.15.5:0/4262612871 shutdown_connections 2024-04-16T14:26:31.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.225+0000 7fc6da579700 1 -- 172.21.15.5:0/4262612871 wait complete. 2024-04-16T14:26:31.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.225+0000 7fc6da579700 1 Processor -- start 2024-04-16T14:26:31.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.226+0000 7fc6da579700 1 -- start start 2024-04-16T14:26:31.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.226+0000 7fc6da579700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6d4100d10 0x7fc6d41138c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:31.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.226+0000 7fc6da579700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d4113e00 con 0x7fc6d4100d10 2024-04-16T14:26:31.206 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.226+0000 7fc6d3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6d4100d10 0x7fc6d41138c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:31.206 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.226+0000 7fc6d3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6d4100d10 0x7fc6d41138c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59818/0 (socket says 172.21.15.5:59818) 2024-04-16T14:26:31.206 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.226+0000 7fc6d3fff700 1 -- 172.21.15.5:0/3115077019 learned_addr learned my addr 172.21.15.5:0/3115077019 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:31.206 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.226+0000 7fc6d3fff700 1 -- 172.21.15.5:0/3115077019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c40094f0 con 0x7fc6d4100d10 2024-04-16T14:26:31.206 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.226+0000 7fc6d3fff700 1 --2- 172.21.15.5:0/3115077019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6d4100d10 0x7fc6d41138c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4011680 tx=0x7fc6c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:31.206 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.227+0000 7fc6d0ff9700 1 -- 172.21.15.5:0/3115077019 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc6c4010890 con 0x7fc6d4100d10 2024-04-16T14:26:31.206 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.227+0000 7fc6d0ff9700 1 -- 172.21.15.5:0/3115077019 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc6c4010ec0 con 0x7fc6d4100d10 2024-04-16T14:26:31.206 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.227+0000 7fc6d0ff9700 1 -- 172.21.15.5:0/3115077019 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc6c40243f0 con 0x7fc6d4100d10 2024-04-16T14:26:31.206 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.227+0000 7fc6da579700 1 -- 172.21.15.5:0/3115077019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d4114000 con 0x7fc6d4100d10 2024-04-16T14:26:31.206 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.227+0000 7fc6da579700 1 -- 172.21.15.5:0/3115077019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d4114b70 con 0x7fc6d4100d10 2024-04-16T14:26:31.206 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.228+0000 7fc6d0ff9700 1 -- 172.21.15.5:0/3115077019 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fc6c402d3f0 con 0x7fc6d4100d10 2024-04-16T14:26:31.206 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.228+0000 7fc6d0ff9700 1 --2- 172.21.15.5:0/3115077019 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fc6bc036790 0x7fc6bc038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:31.207 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.228+0000 7fc6da579700 1 -- 172.21.15.5:0/3115077019 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d405f5f0 con 0x7fc6d4100d10 2024-04-16T14:26:31.207 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.228+0000 7fc6d0ff9700 1 -- 172.21.15.5:0/3115077019 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc6c404a280 con 0x7fc6d4100d10 2024-04-16T14:26:31.207 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.228+0000 7fc6d37fe700 1 --2- 172.21.15.5:0/3115077019 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fc6bc036790 0x7fc6bc038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:31.207 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.229+0000 7fc6d37fe700 1 --2- 172.21.15.5:0/3115077019 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fc6bc036790 0x7fc6bc038c40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8009990 tx=0x7fc6c8006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:31.207 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.233+0000 7fc6d0ff9700 1 -- 172.21.15.5:0/3115077019 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc6c402b8e0 con 0x7fc6d4100d10 2024-04-16T14:26:31.207 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.451+0000 7fc6da579700 1 -- 172.21.15.5:0/3115077019 --> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6d40fd9f0 con 0x7fc6bc036790 2024-04-16T14:26:31.207 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.455+0000 7fc6d0ff9700 1 -- 172.21.15.5:0/3115077019 <== mgr.14118 v2:172.21.15.5:6800/4088193218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fc6d40fd9f0 con 0x7fc6bc036790 2024-04-16T14:26:31.207 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.457+0000 7fc6da579700 1 -- 172.21.15.5:0/3115077019 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fc6bc036790 msgr2=0x7fc6bc038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:31.207 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.457+0000 7fc6da579700 1 --2- 172.21.15.5:0/3115077019 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fc6bc036790 0x7fc6bc038c40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8009990 tx=0x7fc6c8006e40 comp rx=0 tx=0).stop 2024-04-16T14:26:31.207 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.457+0000 7fc6da579700 1 -- 172.21.15.5:0/3115077019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6d4100d10 msgr2=0x7fc6d41138c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:31.207 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.457+0000 7fc6da579700 1 --2- 172.21.15.5:0/3115077019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6d4100d10 0x7fc6d41138c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4011680 tx=0x7fc6c4009250 comp rx=0 tx=0).stop 2024-04-16T14:26:31.207 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.457+0000 7fc6da579700 1 -- 172.21.15.5:0/3115077019 shutdown_connections 2024-04-16T14:26:31.208 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.457+0000 7fc6da579700 1 --2- 172.21.15.5:0/3115077019 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fc6bc036790 0x7fc6bc038c40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:31.208 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.457+0000 7fc6da579700 1 --2- 172.21.15.5:0/3115077019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc6d4100d10 0x7fc6d41138c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:31.208 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.457+0000 7fc6da579700 1 -- 172.21.15.5:0/3115077019 >> 172.21.15.5:0/3115077019 conn(0x7fc6d40fc6f0 msgr2=0x7fc6d40fd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:31.208 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.457+0000 7fc6da579700 1 -- 172.21.15.5:0/3115077019 shutdown_connections 2024-04-16T14:26:31.208 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:30.457+0000 7fc6da579700 1 -- 172.21.15.5:0/3115077019 wait complete. 2024-04-16T14:26:31.208 INFO:teuthology.orchestra.run.smithi005.stdout:Deploying crash service with default placement... 2024-04-16T14:26:32.516 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-04-16T14:26:32.517 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.624+0000 7fbccd5d4700 1 Processor -- start 2024-04-16T14:26:32.517 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.624+0000 7fbccd5d4700 1 -- start start 2024-04-16T14:26:32.517 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.624+0000 7fbccd5d4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc8101de0 0x7fbcc81021f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:32.517 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.624+0000 7fbccd5d4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc8102730 con 0x7fbcc8101de0 2024-04-16T14:26:32.517 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.624+0000 7fbcc6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc8101de0 0x7fbcc81021f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:32.517 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.624+0000 7fbcc6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc8101de0 0x7fbcc81021f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59820/0 (socket says 172.21.15.5:59820) 2024-04-16T14:26:32.517 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.624+0000 7fbcc6ffd700 1 -- 172.21.15.5:0/1074599720 learned_addr learned my addr 172.21.15.5:0/1074599720 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:32.517 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.624+0000 7fbcc6ffd700 1 -- 172.21.15.5:0/1074599720 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc8102870 con 0x7fbcc8101de0 2024-04-16T14:26:32.517 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.625+0000 7fbcc6ffd700 1 --2- 172.21.15.5:0/1074599720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc8101de0 0x7fbcc81021f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbcb80098e0 tx=0x7fbcb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfccda3a44e5d657 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:32.517 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.625+0000 7fbcc67fc700 1 -- 172.21.15.5:0/1074599720 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbcb800b860 con 0x7fbcc8101de0 2024-04-16T14:26:32.517 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.625+0000 7fbcc67fc700 1 -- 172.21.15.5:0/1074599720 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbcb800be90 con 0x7fbcc8101de0 2024-04-16T14:26:32.517 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.625+0000 7fbcc67fc700 1 -- 172.21.15.5:0/1074599720 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbcb80103c0 con 0x7fbcc8101de0 2024-04-16T14:26:32.518 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.625+0000 7fbccd5d4700 1 -- 172.21.15.5:0/1074599720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc8101de0 msgr2=0x7fbcc81021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:32.518 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.625+0000 7fbccd5d4700 1 --2- 172.21.15.5:0/1074599720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc8101de0 0x7fbcc81021f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbcb80098e0 tx=0x7fbcb8009250 comp rx=0 tx=0).stop 2024-04-16T14:26:32.518 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.625+0000 7fbccd5d4700 1 -- 172.21.15.5:0/1074599720 shutdown_connections 2024-04-16T14:26:32.518 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.625+0000 7fbccd5d4700 1 --2- 172.21.15.5:0/1074599720 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc8101de0 0x7fbcc81021f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:32.518 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.625+0000 7fbccd5d4700 1 -- 172.21.15.5:0/1074599720 >> 172.21.15.5:0/1074599720 conn(0x7fbcc80fc770 msgr2=0x7fbcc80feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:32.518 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.625+0000 7fbccd5d4700 1 -- 172.21.15.5:0/1074599720 shutdown_connections 2024-04-16T14:26:32.518 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.625+0000 7fbccd5d4700 1 -- 172.21.15.5:0/1074599720 wait complete. 2024-04-16T14:26:32.518 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.626+0000 7fbccd5d4700 1 Processor -- start 2024-04-16T14:26:32.518 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.626+0000 7fbccd5d4700 1 -- start start 2024-04-16T14:26:32.518 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.626+0000 7fbccd5d4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc8101de0 0x7fbcc810f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:32.518 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.626+0000 7fbccd5d4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc810fa90 con 0x7fbcc8101de0 2024-04-16T14:26:32.518 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.626+0000 7fbcc6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc8101de0 0x7fbcc810f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:32.518 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.626+0000 7fbcc6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc8101de0 0x7fbcc810f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59828/0 (socket says 172.21.15.5:59828) 2024-04-16T14:26:32.518 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.626+0000 7fbcc6ffd700 1 -- 172.21.15.5:0/3996133338 learned_addr learned my addr 172.21.15.5:0/3996133338 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:32.519 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.627+0000 7fbcc6ffd700 1 -- 172.21.15.5:0/3996133338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb80094f0 con 0x7fbcc8101de0 2024-04-16T14:26:32.519 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.627+0000 7fbcc6ffd700 1 --2- 172.21.15.5:0/3996133338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc8101de0 0x7fbcc810f550 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8011c10 tx=0x7fbcb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:32.519 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.627+0000 7fbcbf7fe700 1 -- 172.21.15.5:0/3996133338 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbcb8010890 con 0x7fbcc8101de0 2024-04-16T14:26:32.519 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.627+0000 7fbcbf7fe700 1 -- 172.21.15.5:0/3996133338 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbcb8010ec0 con 0x7fbcc8101de0 2024-04-16T14:26:32.519 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.627+0000 7fbccd5d4700 1 -- 172.21.15.5:0/3996133338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc810fc90 con 0x7fbcc8101de0 2024-04-16T14:26:32.519 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.627+0000 7fbcbf7fe700 1 -- 172.21.15.5:0/3996133338 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbcb80243f0 con 0x7fbcc8101de0 2024-04-16T14:26:32.519 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.627+0000 7fbccd5d4700 1 -- 172.21.15.5:0/3996133338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc8110800 con 0x7fbcc8101de0 2024-04-16T14:26:32.519 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.628+0000 7fbcbf7fe700 1 -- 172.21.15.5:0/3996133338 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fbcb802d3f0 con 0x7fbcc8101de0 2024-04-16T14:26:32.519 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.628+0000 7fbccd5d4700 1 -- 172.21.15.5:0/3996133338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc805f5f0 con 0x7fbcc8101de0 2024-04-16T14:26:32.519 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.628+0000 7fbcbf7fe700 1 --2- 172.21.15.5:0/3996133338 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fbcb4038a30 0x7fbcb403aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:32.519 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.628+0000 7fbcbf7fe700 1 -- 172.21.15.5:0/3996133338 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fbcb804a320 con 0x7fbcc8101de0 2024-04-16T14:26:32.519 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.628+0000 7fbcbffff700 1 --2- 172.21.15.5:0/3996133338 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fbcb4038a30 0x7fbcb403aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:32.519 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.629+0000 7fbcbffff700 1 --2- 172.21.15.5:0/3996133338 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fbcb4038a30 0x7fbcb403aee0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0009990 tx=0x7fbcb0006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:32.519 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.633+0000 7fbcbf7fe700 1 -- 172.21.15.5:0/3996133338 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fbcb802b8e0 con 0x7fbcc8101de0 2024-04-16T14:26:32.519 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.843+0000 7fbccd5d4700 1 -- 172.21.15.5:0/3996133338 --> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fbcc81113e0 con 0x7fbcb4038a30 2024-04-16T14:26:32.520 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.847+0000 7fbcbf7fe700 1 -- 172.21.15.5:0/3996133338 <== mgr.14118 v2:172.21.15.5:6800/4088193218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fbcc81113e0 con 0x7fbcb4038a30 2024-04-16T14:26:32.520 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.849+0000 7fbccd5d4700 1 -- 172.21.15.5:0/3996133338 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fbcb4038a30 msgr2=0x7fbcb403aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:32.520 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.849+0000 7fbccd5d4700 1 --2- 172.21.15.5:0/3996133338 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fbcb4038a30 0x7fbcb403aee0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0009990 tx=0x7fbcb0006e40 comp rx=0 tx=0).stop 2024-04-16T14:26:32.520 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.849+0000 7fbccd5d4700 1 -- 172.21.15.5:0/3996133338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc8101de0 msgr2=0x7fbcc810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:32.520 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.849+0000 7fbccd5d4700 1 --2- 172.21.15.5:0/3996133338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc8101de0 0x7fbcc810f550 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8011c10 tx=0x7fbcb8009250 comp rx=0 tx=0).stop 2024-04-16T14:26:32.520 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.849+0000 7fbccd5d4700 1 -- 172.21.15.5:0/3996133338 shutdown_connections 2024-04-16T14:26:32.520 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.849+0000 7fbccd5d4700 1 --2- 172.21.15.5:0/3996133338 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fbcb4038a30 0x7fbcb403aee0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:32.520 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.849+0000 7fbccd5d4700 1 --2- 172.21.15.5:0/3996133338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcc8101de0 0x7fbcc810f550 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:32.520 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.849+0000 7fbccd5d4700 1 -- 172.21.15.5:0/3996133338 >> 172.21.15.5:0/3996133338 conn(0x7fbcc80fc770 msgr2=0x7fbcc8105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:32.520 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.849+0000 7fbccd5d4700 1 -- 172.21.15.5:0/3996133338 shutdown_connections 2024-04-16T14:26:32.520 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:31.849+0000 7fbccd5d4700 1 -- 172.21.15.5:0/3996133338 wait complete. 2024-04-16T14:26:32.520 INFO:teuthology.orchestra.run.smithi005.stdout:Deploying prometheus service with default placement... 2024-04-16T14:26:33.223 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:32 smithi005 ceph-mon[28964]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:26:33.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:32 smithi005 ceph-mon[28964]: Saving service crash spec with placement * 2024-04-16T14:26:33.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:32 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:26:33.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:32 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:26:33.883 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-04-16T14:26:33.883 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.017+0000 7fb8e92e9700 1 Processor -- start 2024-04-16T14:26:33.884 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.017+0000 7fb8e92e9700 1 -- start start 2024-04-16T14:26:33.884 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.017+0000 7fb8e92e9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e4078bb0 0x7fb8e4077250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:33.884 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.017+0000 7fb8e92e9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e4078fc0 con 0x7fb8e4078bb0 2024-04-16T14:26:33.884 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.017+0000 7fb8e2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e4078bb0 0x7fb8e4077250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:33.884 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.018+0000 7fb8e2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e4078bb0 0x7fb8e4077250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59844/0 (socket says 172.21.15.5:59844) 2024-04-16T14:26:33.884 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.018+0000 7fb8e2ffd700 1 -- 172.21.15.5:0/1548633605 learned_addr learned my addr 172.21.15.5:0/1548633605 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:33.884 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.018+0000 7fb8e2ffd700 1 -- 172.21.15.5:0/1548633605 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e4079100 con 0x7fb8e4078bb0 2024-04-16T14:26:33.884 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.018+0000 7fb8e2ffd700 1 --2- 172.21.15.5:0/1548633605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e4078bb0 0x7fb8e4077250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4009e50 tx=0x7fb8d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6cc8ea3644e3ce server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:33.884 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.018+0000 7fb8e1ffb700 1 -- 172.21.15.5:0/1548633605 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8d40092e0 con 0x7fb8e4078bb0 2024-04-16T14:26:33.884 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.018+0000 7fb8e1ffb700 1 -- 172.21.15.5:0/1548633605 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb8d4012430 con 0x7fb8e4078bb0 2024-04-16T14:26:33.884 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.018+0000 7fb8e1ffb700 1 -- 172.21.15.5:0/1548633605 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8d40075c0 con 0x7fb8e4078bb0 2024-04-16T14:26:33.884 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.019+0000 7fb8e92e9700 1 -- 172.21.15.5:0/1548633605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e4078bb0 msgr2=0x7fb8e4077250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:33.884 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.019+0000 7fb8e92e9700 1 --2- 172.21.15.5:0/1548633605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e4078bb0 0x7fb8e4077250 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4009e50 tx=0x7fb8d4009840 comp rx=0 tx=0).stop 2024-04-16T14:26:33.884 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.019+0000 7fb8e92e9700 1 -- 172.21.15.5:0/1548633605 shutdown_connections 2024-04-16T14:26:33.885 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.019+0000 7fb8e92e9700 1 --2- 172.21.15.5:0/1548633605 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e4078bb0 0x7fb8e4077250 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:33.885 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.019+0000 7fb8e92e9700 1 -- 172.21.15.5:0/1548633605 >> 172.21.15.5:0/1548633605 conn(0x7fb8e40fe120 msgr2=0x7fb8e4100550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:33.885 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.019+0000 7fb8e92e9700 1 -- 172.21.15.5:0/1548633605 shutdown_connections 2024-04-16T14:26:33.885 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.019+0000 7fb8e92e9700 1 -- 172.21.15.5:0/1548633605 wait complete. 2024-04-16T14:26:33.885 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.020+0000 7fb8e92e9700 1 Processor -- start 2024-04-16T14:26:33.885 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.020+0000 7fb8e92e9700 1 -- start start 2024-04-16T14:26:33.885 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.020+0000 7fb8e92e9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e4078bb0 0x7fb8e4113900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:33.885 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.020+0000 7fb8e92e9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e4113e40 con 0x7fb8e4078bb0 2024-04-16T14:26:33.885 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.020+0000 7fb8e2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e4078bb0 0x7fb8e4113900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:33.885 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.020+0000 7fb8e2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e4078bb0 0x7fb8e4113900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59848/0 (socket says 172.21.15.5:59848) 2024-04-16T14:26:33.885 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.020+0000 7fb8e2ffd700 1 -- 172.21.15.5:0/3801320581 learned_addr learned my addr 172.21.15.5:0/3801320581 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:33.885 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.021+0000 7fb8e2ffd700 1 -- 172.21.15.5:0/3801320581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d4009ae0 con 0x7fb8e4078bb0 2024-04-16T14:26:33.885 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.021+0000 7fb8e2ffd700 1 --2- 172.21.15.5:0/3801320581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e4078bb0 0x7fb8e4113900 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4012e80 tx=0x7fb8d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:33.885 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.021+0000 7fb8db7fe700 1 -- 172.21.15.5:0/3801320581 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8d40092e0 con 0x7fb8e4078bb0 2024-04-16T14:26:33.886 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.021+0000 7fb8e92e9700 1 -- 172.21.15.5:0/3801320581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e4114040 con 0x7fb8e4078bb0 2024-04-16T14:26:33.886 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.021+0000 7fb8db7fe700 1 -- 172.21.15.5:0/3801320581 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb8d4007d00 con 0x7fb8e4078bb0 2024-04-16T14:26:33.886 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.021+0000 7fb8db7fe700 1 -- 172.21.15.5:0/3801320581 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8d401c9f0 con 0x7fb8e4078bb0 2024-04-16T14:26:33.886 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.021+0000 7fb8e92e9700 1 -- 172.21.15.5:0/3801320581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e4114bb0 con 0x7fb8e4078bb0 2024-04-16T14:26:33.886 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.022+0000 7fb8e92e9700 1 -- 172.21.15.5:0/3801320581 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e4114530 con 0x7fb8e4078bb0 2024-04-16T14:26:33.886 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.022+0000 7fb8db7fe700 1 -- 172.21.15.5:0/3801320581 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fb8d4019070 con 0x7fb8e4078bb0 2024-04-16T14:26:33.886 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.023+0000 7fb8db7fe700 1 --2- 172.21.15.5:0/3801320581 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fb8d0036790 0x7fb8d0038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:33.886 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.023+0000 7fb8db7fe700 1 -- 172.21.15.5:0/3801320581 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fb8d404a660 con 0x7fb8e4078bb0 2024-04-16T14:26:33.886 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.023+0000 7fb8e27fc700 1 --2- 172.21.15.5:0/3801320581 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fb8d0036790 0x7fb8d0038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:33.886 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.023+0000 7fb8e27fc700 1 --2- 172.21.15.5:0/3801320581 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fb8d0036790 0x7fb8d0038c40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009990 tx=0x7fb8cc006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:33.886 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.027+0000 7fb8db7fe700 1 -- 172.21.15.5:0/3801320581 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb8d4023360 con 0x7fb8e4078bb0 2024-04-16T14:26:33.886 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.259+0000 7fb8e92e9700 1 -- 172.21.15.5:0/3801320581 --> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8e40ff420 con 0x7fb8d0036790 2024-04-16T14:26:33.887 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.264+0000 7fb8db7fe700 1 -- 172.21.15.5:0/3801320581 <== mgr.14118 v2:172.21.15.5:6800/4088193218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7fb8e40ff420 con 0x7fb8d0036790 2024-04-16T14:26:33.887 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.266+0000 7fb8e92e9700 1 -- 172.21.15.5:0/3801320581 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fb8d0036790 msgr2=0x7fb8d0038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:33.887 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.266+0000 7fb8e92e9700 1 --2- 172.21.15.5:0/3801320581 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fb8d0036790 0x7fb8d0038c40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009990 tx=0x7fb8cc006e40 comp rx=0 tx=0).stop 2024-04-16T14:26:33.887 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.266+0000 7fb8e92e9700 1 -- 172.21.15.5:0/3801320581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e4078bb0 msgr2=0x7fb8e4113900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:33.887 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.266+0000 7fb8e92e9700 1 --2- 172.21.15.5:0/3801320581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e4078bb0 0x7fb8e4113900 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4012e80 tx=0x7fb8d4009840 comp rx=0 tx=0).stop 2024-04-16T14:26:33.887 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.266+0000 7fb8e92e9700 1 -- 172.21.15.5:0/3801320581 shutdown_connections 2024-04-16T14:26:33.887 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.266+0000 7fb8e92e9700 1 --2- 172.21.15.5:0/3801320581 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fb8d0036790 0x7fb8d0038c40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:33.887 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.266+0000 7fb8e92e9700 1 --2- 172.21.15.5:0/3801320581 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8e4078bb0 0x7fb8e4113900 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:33.887 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.266+0000 7fb8e92e9700 1 -- 172.21.15.5:0/3801320581 >> 172.21.15.5:0/3801320581 conn(0x7fb8e40fe120 msgr2=0x7fb8e40fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:33.887 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.266+0000 7fb8e92e9700 1 -- 172.21.15.5:0/3801320581 shutdown_connections 2024-04-16T14:26:33.887 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:33.266+0000 7fb8e92e9700 1 -- 172.21.15.5:0/3801320581 wait complete. 2024-04-16T14:26:33.887 INFO:teuthology.orchestra.run.smithi005.stdout:Deploying grafana service with default placement... 2024-04-16T14:26:34.473 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:34 smithi005 ceph-mon[28964]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:26:34.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:34 smithi005 ceph-mon[28964]: Saving service prometheus spec with placement count:1 2024-04-16T14:26:34.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:34 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:26:34.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:34 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:26:35.593 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:35 smithi005 ceph-mon[28964]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:26:35.593 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:35 smithi005 ceph-mon[28964]: Saving service grafana spec with placement count:1 2024-04-16T14:26:35.593 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:35 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:26:35.601 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-04-16T14:26:35.601 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.280+0000 7fa38699c700 1 Processor -- start 2024-04-16T14:26:35.601 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.281+0000 7fa38699c700 1 -- start start 2024-04-16T14:26:35.601 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.281+0000 7fa38699c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa380076ab0 0x7fa3801079f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:35.601 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.281+0000 7fa38699c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3801033e0 con 0x7fa380076ab0 2024-04-16T14:26:35.601 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.281+0000 7fa37ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa380076ab0 0x7fa3801079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:35.601 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.281+0000 7fa37ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa380076ab0 0x7fa3801079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59862/0 (socket says 172.21.15.5:59862) 2024-04-16T14:26:35.601 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.281+0000 7fa37ffff700 1 -- 172.21.15.5:0/1633995853 learned_addr learned my addr 172.21.15.5:0/1633995853 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:35.601 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.281+0000 7fa37ffff700 1 -- 172.21.15.5:0/1633995853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa380076ec0 con 0x7fa380076ab0 2024-04-16T14:26:35.601 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.281+0000 7fa37ffff700 1 --2- 172.21.15.5:0/1633995853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa380076ab0 0x7fa3801079f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa3700098e0 tx=0x7fa370009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc7d51493cebcd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:35.601 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.282+0000 7fa37effd700 1 -- 172.21.15.5:0/1633995853 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa37000b8f0 con 0x7fa380076ab0 2024-04-16T14:26:35.601 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.282+0000 7fa37effd700 1 -- 172.21.15.5:0/1633995853 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa370011420 con 0x7fa380076ab0 2024-04-16T14:26:35.602 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.282+0000 7fa37effd700 1 -- 172.21.15.5:0/1633995853 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa370010540 con 0x7fa380076ab0 2024-04-16T14:26:35.602 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.282+0000 7fa38699c700 1 -- 172.21.15.5:0/1633995853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa380076ab0 msgr2=0x7fa3801079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:35.602 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.282+0000 7fa38699c700 1 --2- 172.21.15.5:0/1633995853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa380076ab0 0x7fa3801079f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa3700098e0 tx=0x7fa370009250 comp rx=0 tx=0).stop 2024-04-16T14:26:35.602 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.282+0000 7fa38699c700 1 -- 172.21.15.5:0/1633995853 shutdown_connections 2024-04-16T14:26:35.602 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.282+0000 7fa38699c700 1 --2- 172.21.15.5:0/1633995853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa380076ab0 0x7fa3801079f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:35.602 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.282+0000 7fa38699c700 1 -- 172.21.15.5:0/1633995853 >> 172.21.15.5:0/1633995853 conn(0x7fa3800fd000 msgr2=0x7fa3800ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:35.602 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.282+0000 7fa38699c700 1 -- 172.21.15.5:0/1633995853 shutdown_connections 2024-04-16T14:26:35.602 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.283+0000 7fa38699c700 1 -- 172.21.15.5:0/1633995853 wait complete. 2024-04-16T14:26:35.602 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.283+0000 7fa38699c700 1 Processor -- start 2024-04-16T14:26:35.602 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.283+0000 7fa38699c700 1 -- start start 2024-04-16T14:26:35.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.283+0000 7fa38699c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa380076ab0 0x7fa380113920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:35.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.283+0000 7fa38699c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa380113e60 con 0x7fa380076ab0 2024-04-16T14:26:35.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.284+0000 7fa37ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa380076ab0 0x7fa380113920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:35.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.284+0000 7fa37ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa380076ab0 0x7fa380113920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59874/0 (socket says 172.21.15.5:59874) 2024-04-16T14:26:35.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.284+0000 7fa37ffff700 1 -- 172.21.15.5:0/891978660 learned_addr learned my addr 172.21.15.5:0/891978660 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:35.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.284+0000 7fa37ffff700 1 -- 172.21.15.5:0/891978660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3700094f0 con 0x7fa380076ab0 2024-04-16T14:26:35.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.284+0000 7fa37ffff700 1 --2- 172.21.15.5:0/891978660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa380076ab0 0x7fa380113920 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa370011e90 tx=0x7fa370009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:35.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.284+0000 7fa37cff9700 1 -- 172.21.15.5:0/891978660 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa37000beb0 con 0x7fa380076ab0 2024-04-16T14:26:35.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.284+0000 7fa37cff9700 1 -- 172.21.15.5:0/891978660 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa370010c80 con 0x7fa380076ab0 2024-04-16T14:26:35.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.284+0000 7fa37cff9700 1 -- 172.21.15.5:0/891978660 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa37001ad40 con 0x7fa380076ab0 2024-04-16T14:26:35.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.284+0000 7fa38699c700 1 -- 172.21.15.5:0/891978660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa380114060 con 0x7fa380076ab0 2024-04-16T14:26:35.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.284+0000 7fa38699c700 1 -- 172.21.15.5:0/891978660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa380114bd0 con 0x7fa380076ab0 2024-04-16T14:26:35.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.285+0000 7fa37cff9700 1 -- 172.21.15.5:0/891978660 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fa37002d3f0 con 0x7fa380076ab0 2024-04-16T14:26:35.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.286+0000 7fa38699c700 1 -- 172.21.15.5:0/891978660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa38005f5f0 con 0x7fa380076ab0 2024-04-16T14:26:35.603 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.286+0000 7fa37cff9700 1 --2- 172.21.15.5:0/891978660 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fa368036870 0x7fa368038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:35.604 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.286+0000 7fa37cff9700 1 -- 172.21.15.5:0/891978660 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa37004a370 con 0x7fa380076ab0 2024-04-16T14:26:35.604 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.286+0000 7fa37f7fe700 1 --2- 172.21.15.5:0/891978660 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fa368036870 0x7fa368038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:35.604 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.286+0000 7fa37f7fe700 1 --2- 172.21.15.5:0/891978660 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fa368036870 0x7fa368038d20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa374009990 tx=0x7fa374006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:35.604 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.291+0000 7fa37cff9700 1 -- 172.21.15.5:0/891978660 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa37002b8d0 con 0x7fa380076ab0 2024-04-16T14:26:35.604 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.507+0000 7fa38699c700 1 -- 172.21.15.5:0/891978660 --> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3800fe3a0 con 0x7fa368036870 2024-04-16T14:26:35.604 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.511+0000 7fa37cff9700 1 -- 172.21.15.5:0/891978660 <== mgr.14118 v2:172.21.15.5:6800/4088193218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fa3800fe3a0 con 0x7fa368036870 2024-04-16T14:26:35.604 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.513+0000 7fa38699c700 1 -- 172.21.15.5:0/891978660 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fa368036870 msgr2=0x7fa368038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:35.604 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.513+0000 7fa38699c700 1 --2- 172.21.15.5:0/891978660 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fa368036870 0x7fa368038d20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa374009990 tx=0x7fa374006e40 comp rx=0 tx=0).stop 2024-04-16T14:26:35.604 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.513+0000 7fa38699c700 1 -- 172.21.15.5:0/891978660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa380076ab0 msgr2=0x7fa380113920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:35.604 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.513+0000 7fa38699c700 1 --2- 172.21.15.5:0/891978660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa380076ab0 0x7fa380113920 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa370011e90 tx=0x7fa370009250 comp rx=0 tx=0).stop 2024-04-16T14:26:35.604 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.513+0000 7fa38699c700 1 -- 172.21.15.5:0/891978660 shutdown_connections 2024-04-16T14:26:35.604 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.513+0000 7fa38699c700 1 --2- 172.21.15.5:0/891978660 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fa368036870 0x7fa368038d20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:35.604 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.513+0000 7fa38699c700 1 --2- 172.21.15.5:0/891978660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa380076ab0 0x7fa380113920 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:35.604 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.513+0000 7fa38699c700 1 -- 172.21.15.5:0/891978660 >> 172.21.15.5:0/891978660 conn(0x7fa3800fd000 msgr2=0x7fa3800fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:35.605 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.513+0000 7fa38699c700 1 -- 172.21.15.5:0/891978660 shutdown_connections 2024-04-16T14:26:35.605 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:34.513+0000 7fa38699c700 1 -- 172.21.15.5:0/891978660 wait complete. 2024-04-16T14:26:35.605 INFO:teuthology.orchestra.run.smithi005.stdout:Deploying node-exporter service with default placement... 2024-04-16T14:26:37.093 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-04-16T14:26:37.093 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.021+0000 7fba8e280700 1 Processor -- start 2024-04-16T14:26:37.093 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.021+0000 7fba8e280700 1 -- start start 2024-04-16T14:26:37.093 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.022+0000 7fba8e280700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba881029c0 0x7fba88102dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:37.093 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.022+0000 7fba8e280700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba881033a0 con 0x7fba881029c0 2024-04-16T14:26:37.093 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.022+0000 7fba87fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba881029c0 0x7fba88102dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:37.093 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.022+0000 7fba87fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba881029c0 0x7fba88102dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59888/0 (socket says 172.21.15.5:59888) 2024-04-16T14:26:37.093 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.022+0000 7fba87fff700 1 -- 172.21.15.5:0/512194495 learned_addr learned my addr 172.21.15.5:0/512194495 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:37.093 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.022+0000 7fba87fff700 1 -- 172.21.15.5:0/512194495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba881034e0 con 0x7fba881029c0 2024-04-16T14:26:37.093 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.022+0000 7fba87fff700 1 --2- 172.21.15.5:0/512194495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba881029c0 0x7fba88102dd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fba780098e0 tx=0x7fba78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1488ae35e3ed18 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:37.094 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.022+0000 7fba877fe700 1 -- 172.21.15.5:0/512194495 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba7800b860 con 0x7fba881029c0 2024-04-16T14:26:37.094 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.022+0000 7fba877fe700 1 -- 172.21.15.5:0/512194495 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba7800be90 con 0x7fba881029c0 2024-04-16T14:26:37.094 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.022+0000 7fba877fe700 1 -- 172.21.15.5:0/512194495 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba780103c0 con 0x7fba881029c0 2024-04-16T14:26:37.094 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.023+0000 7fba8e280700 1 -- 172.21.15.5:0/512194495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba881029c0 msgr2=0x7fba88102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:37.094 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.023+0000 7fba8e280700 1 --2- 172.21.15.5:0/512194495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba881029c0 0x7fba88102dd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fba780098e0 tx=0x7fba78009250 comp rx=0 tx=0).stop 2024-04-16T14:26:37.094 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.023+0000 7fba8e280700 1 -- 172.21.15.5:0/512194495 shutdown_connections 2024-04-16T14:26:37.094 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.023+0000 7fba8e280700 1 --2- 172.21.15.5:0/512194495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba881029c0 0x7fba88102dd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:37.094 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.023+0000 7fba8e280700 1 -- 172.21.15.5:0/512194495 >> 172.21.15.5:0/512194495 conn(0x7fba880fe0e0 msgr2=0x7fba88100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:37.094 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.023+0000 7fba8e280700 1 -- 172.21.15.5:0/512194495 shutdown_connections 2024-04-16T14:26:37.094 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.023+0000 7fba8e280700 1 -- 172.21.15.5:0/512194495 wait complete. 2024-04-16T14:26:37.094 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.024+0000 7fba8e280700 1 Processor -- start 2024-04-16T14:26:37.094 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.024+0000 7fba8e280700 1 -- start start 2024-04-16T14:26:37.094 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.024+0000 7fba8e280700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba881029c0 0x7fba881116d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:37.094 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.024+0000 7fba8e280700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba88111c10 con 0x7fba881029c0 2024-04-16T14:26:37.095 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.024+0000 7fba87fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba881029c0 0x7fba881116d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:37.095 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.024+0000 7fba87fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba881029c0 0x7fba881116d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59900/0 (socket says 172.21.15.5:59900) 2024-04-16T14:26:37.095 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.024+0000 7fba87fff700 1 -- 172.21.15.5:0/1332619771 learned_addr learned my addr 172.21.15.5:0/1332619771 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:37.095 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.024+0000 7fba87fff700 1 -- 172.21.15.5:0/1332619771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba780094f0 con 0x7fba881029c0 2024-04-16T14:26:37.095 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.024+0000 7fba87fff700 1 --2- 172.21.15.5:0/1332619771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba881029c0 0x7fba881116d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fba78011680 tx=0x7fba78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:37.095 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.025+0000 7fba857fa700 1 -- 172.21.15.5:0/1332619771 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba78010890 con 0x7fba881029c0 2024-04-16T14:26:37.095 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.025+0000 7fba857fa700 1 -- 172.21.15.5:0/1332619771 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba78010ec0 con 0x7fba881029c0 2024-04-16T14:26:37.095 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.025+0000 7fba8e280700 1 -- 172.21.15.5:0/1332619771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba88111e10 con 0x7fba881029c0 2024-04-16T14:26:37.095 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.025+0000 7fba857fa700 1 -- 172.21.15.5:0/1332619771 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba780243f0 con 0x7fba881029c0 2024-04-16T14:26:37.095 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.025+0000 7fba8e280700 1 -- 172.21.15.5:0/1332619771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba88112980 con 0x7fba881029c0 2024-04-16T14:26:37.095 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.026+0000 7fba8e280700 1 -- 172.21.15.5:0/1332619771 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba8805f5f0 con 0x7fba881029c0 2024-04-16T14:26:37.095 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.026+0000 7fba857fa700 1 -- 172.21.15.5:0/1332619771 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fba780109f0 con 0x7fba881029c0 2024-04-16T14:26:37.095 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.026+0000 7fba857fa700 1 --2- 172.21.15.5:0/1332619771 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fba74036790 0x7fba74038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:37.095 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.026+0000 7fba857fa700 1 -- 172.21.15.5:0/1332619771 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fba7804a210 con 0x7fba881029c0 2024-04-16T14:26:37.096 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.026+0000 7fba7ffff700 1 --2- 172.21.15.5:0/1332619771 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fba74036790 0x7fba74038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:37.096 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.026+0000 7fba7ffff700 1 --2- 172.21.15.5:0/1332619771 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fba74036790 0x7fba74038c40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fba70009990 tx=0x7fba70006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:37.096 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.031+0000 7fba857fa700 1 -- 172.21.15.5:0/1332619771 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fba7802b8c0 con 0x7fba881029c0 2024-04-16T14:26:37.096 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.243+0000 7fba8e280700 1 -- 172.21.15.5:0/1332619771 --> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fba880ff300 con 0x7fba74036790 2024-04-16T14:26:37.096 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.247+0000 7fba857fa700 1 -- 172.21.15.5:0/1332619771 <== mgr.14118 v2:172.21.15.5:6800/4088193218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fba880ff300 con 0x7fba74036790 2024-04-16T14:26:37.096 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.249+0000 7fba8e280700 1 -- 172.21.15.5:0/1332619771 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fba74036790 msgr2=0x7fba74038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:37.096 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.249+0000 7fba8e280700 1 --2- 172.21.15.5:0/1332619771 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fba74036790 0x7fba74038c40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fba70009990 tx=0x7fba70006e40 comp rx=0 tx=0).stop 2024-04-16T14:26:37.096 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.250+0000 7fba8e280700 1 -- 172.21.15.5:0/1332619771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba881029c0 msgr2=0x7fba881116d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:37.096 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.250+0000 7fba8e280700 1 --2- 172.21.15.5:0/1332619771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba881029c0 0x7fba881116d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fba78011680 tx=0x7fba78009250 comp rx=0 tx=0).stop 2024-04-16T14:26:37.096 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.250+0000 7fba8e280700 1 -- 172.21.15.5:0/1332619771 shutdown_connections 2024-04-16T14:26:37.096 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.250+0000 7fba8e280700 1 --2- 172.21.15.5:0/1332619771 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fba74036790 0x7fba74038c40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:37.096 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.250+0000 7fba8e280700 1 --2- 172.21.15.5:0/1332619771 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fba881029c0 0x7fba881116d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:37.096 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.250+0000 7fba8e280700 1 -- 172.21.15.5:0/1332619771 >> 172.21.15.5:0/1332619771 conn(0x7fba880fe0e0 msgr2=0x7fba880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:37.097 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.250+0000 7fba8e280700 1 -- 172.21.15.5:0/1332619771 shutdown_connections 2024-04-16T14:26:37.097 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:36.250+0000 7fba8e280700 1 -- 172.21.15.5:0/1332619771 wait complete. 2024-04-16T14:26:37.097 INFO:teuthology.orchestra.run.smithi005.stdout:Deploying alertmanager service with default placement... 2024-04-16T14:26:37.404 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:37 smithi005 ceph-mon[28964]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:26:37.404 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:37 smithi005 ceph-mon[28964]: Saving service node-exporter spec with placement * 2024-04-16T14:26:37.404 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:37 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:26:38.367 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-04-16T14:26:38.367 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.517+0000 7fc15f2e5700 1 Processor -- start 2024-04-16T14:26:38.367 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.517+0000 7fc15f2e5700 1 -- start start 2024-04-16T14:26:38.367 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.517+0000 7fc15f2e5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc158076c20 0x7fc1581054a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:38.367 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.517+0000 7fc15f2e5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1581059e0 con 0x7fc158076c20 2024-04-16T14:26:38.367 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.517+0000 7fc15d081700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc158076c20 0x7fc1581054a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:38.367 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.518+0000 7fc15d081700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc158076c20 0x7fc1581054a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59908/0 (socket says 172.21.15.5:59908) 2024-04-16T14:26:38.367 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.518+0000 7fc15d081700 1 -- 172.21.15.5:0/1916411742 learned_addr learned my addr 172.21.15.5:0/1916411742 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:38.367 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.518+0000 7fc15d081700 1 -- 172.21.15.5:0/1916411742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc158105b20 con 0x7fc158076c20 2024-04-16T14:26:38.367 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.518+0000 7fc15d081700 1 --2- 172.21.15.5:0/1916411742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc158076c20 0x7fc1581054a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0098e0 tx=0x7fc14c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af49ae8d5fa4f3e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:38.368 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.518+0000 7fc14bfff700 1 -- 172.21.15.5:0/1916411742 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc14c00b860 con 0x7fc158076c20 2024-04-16T14:26:38.368 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.518+0000 7fc14bfff700 1 -- 172.21.15.5:0/1916411742 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc14c00be90 con 0x7fc158076c20 2024-04-16T14:26:38.368 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.518+0000 7fc14bfff700 1 -- 172.21.15.5:0/1916411742 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc14c0103c0 con 0x7fc158076c20 2024-04-16T14:26:38.368 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.519+0000 7fc15f2e5700 1 -- 172.21.15.5:0/1916411742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc158076c20 msgr2=0x7fc1581054a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:38.368 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.519+0000 7fc15f2e5700 1 --2- 172.21.15.5:0/1916411742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc158076c20 0x7fc1581054a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0098e0 tx=0x7fc14c009250 comp rx=0 tx=0).stop 2024-04-16T14:26:38.368 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.519+0000 7fc15f2e5700 1 -- 172.21.15.5:0/1916411742 shutdown_connections 2024-04-16T14:26:38.368 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.519+0000 7fc15f2e5700 1 --2- 172.21.15.5:0/1916411742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc158076c20 0x7fc1581054a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:38.368 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.519+0000 7fc15f2e5700 1 -- 172.21.15.5:0/1916411742 >> 172.21.15.5:0/1916411742 conn(0x7fc1580fcfd0 msgr2=0x7fc1580ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:38.368 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.519+0000 7fc15f2e5700 1 -- 172.21.15.5:0/1916411742 shutdown_connections 2024-04-16T14:26:38.368 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.519+0000 7fc15f2e5700 1 -- 172.21.15.5:0/1916411742 wait complete. 2024-04-16T14:26:38.368 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.520+0000 7fc15f2e5700 1 Processor -- start 2024-04-16T14:26:38.368 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.520+0000 7fc15f2e5700 1 -- start start 2024-04-16T14:26:38.369 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.520+0000 7fc15f2e5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc158076c20 0x7fc158102df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:38.369 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.520+0000 7fc15f2e5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc158103330 con 0x7fc158076c20 2024-04-16T14:26:38.369 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.520+0000 7fc15d081700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc158076c20 0x7fc158102df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:38.369 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.520+0000 7fc15d081700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc158076c20 0x7fc158102df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59920/0 (socket says 172.21.15.5:59920) 2024-04-16T14:26:38.369 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.520+0000 7fc15d081700 1 -- 172.21.15.5:0/3088457425 learned_addr learned my addr 172.21.15.5:0/3088457425 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:38.369 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.520+0000 7fc15d081700 1 -- 172.21.15.5:0/3088457425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14c0094f0 con 0x7fc158076c20 2024-04-16T14:26:38.369 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.520+0000 7fc15d081700 1 --2- 172.21.15.5:0/3088457425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc158076c20 0x7fc158102df0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0105b0 tx=0x7fc14c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:38.369 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.520+0000 7fc149ffb700 1 -- 172.21.15.5:0/3088457425 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc14c010840 con 0x7fc158076c20 2024-04-16T14:26:38.369 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.520+0000 7fc149ffb700 1 -- 172.21.15.5:0/3088457425 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc14c010e70 con 0x7fc158076c20 2024-04-16T14:26:38.369 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.520+0000 7fc15f2e5700 1 -- 172.21.15.5:0/3088457425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1581013a0 con 0x7fc158076c20 2024-04-16T14:26:38.369 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.521+0000 7fc149ffb700 1 -- 172.21.15.5:0/3088457425 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc14c01ae30 con 0x7fc158076c20 2024-04-16T14:26:38.369 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.521+0000 7fc15f2e5700 1 -- 172.21.15.5:0/3088457425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc158101890 con 0x7fc158076c20 2024-04-16T14:26:38.370 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.522+0000 7fc149ffb700 1 -- 172.21.15.5:0/3088457425 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fc14c01a430 con 0x7fc158076c20 2024-04-16T14:26:38.370 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.522+0000 7fc15f2e5700 1 -- 172.21.15.5:0/3088457425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc15804bed0 con 0x7fc158076c20 2024-04-16T14:26:38.370 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.522+0000 7fc149ffb700 1 --2- 172.21.15.5:0/3088457425 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fc1440367e0 0x7fc144038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:38.370 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.522+0000 7fc149ffb700 1 -- 172.21.15.5:0/3088457425 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc14c04a150 con 0x7fc158076c20 2024-04-16T14:26:38.370 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.522+0000 7fc15c880700 1 --2- 172.21.15.5:0/3088457425 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fc1440367e0 0x7fc144038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:38.370 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.523+0000 7fc15c880700 1 --2- 172.21.15.5:0/3088457425 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fc1440367e0 0x7fc144038c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc154009990 tx=0x7fc154006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:38.370 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.527+0000 7fc149ffb700 1 -- 172.21.15.5:0/3088457425 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc14c02b4d0 con 0x7fc158076c20 2024-04-16T14:26:38.370 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.733+0000 7fc15f2e5700 1 -- 172.21.15.5:0/3088457425 --> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7fc158102050 con 0x7fc1440367e0 2024-04-16T14:26:38.370 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.737+0000 7fc149ffb700 1 -- 172.21.15.5:0/3088457425 <== mgr.14118 v2:172.21.15.5:6800/4088193218 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7fc158102050 con 0x7fc1440367e0 2024-04-16T14:26:38.370 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.739+0000 7fc15f2e5700 1 -- 172.21.15.5:0/3088457425 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fc1440367e0 msgr2=0x7fc144038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:38.370 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.739+0000 7fc15f2e5700 1 --2- 172.21.15.5:0/3088457425 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fc1440367e0 0x7fc144038c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc154009990 tx=0x7fc154006e40 comp rx=0 tx=0).stop 2024-04-16T14:26:38.370 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.739+0000 7fc15f2e5700 1 -- 172.21.15.5:0/3088457425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc158076c20 msgr2=0x7fc158102df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:38.371 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.739+0000 7fc15f2e5700 1 --2- 172.21.15.5:0/3088457425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc158076c20 0x7fc158102df0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc14c0105b0 tx=0x7fc14c009250 comp rx=0 tx=0).stop 2024-04-16T14:26:38.371 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.739+0000 7fc15f2e5700 1 -- 172.21.15.5:0/3088457425 shutdown_connections 2024-04-16T14:26:38.371 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.739+0000 7fc15f2e5700 1 --2- 172.21.15.5:0/3088457425 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fc1440367e0 0x7fc144038c90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:38.371 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.739+0000 7fc15f2e5700 1 --2- 172.21.15.5:0/3088457425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc158076c20 0x7fc158102df0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:38.371 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.739+0000 7fc15f2e5700 1 -- 172.21.15.5:0/3088457425 >> 172.21.15.5:0/3088457425 conn(0x7fc1580fcfd0 msgr2=0x7fc1580fdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:38.371 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.739+0000 7fc15f2e5700 1 -- 172.21.15.5:0/3088457425 shutdown_connections 2024-04-16T14:26:38.371 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:37.739+0000 7fc15f2e5700 1 -- 172.21.15.5:0/3088457425 wait complete. 2024-04-16T14:26:38.973 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:38 smithi005 ceph-mon[28964]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:26:38.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:38 smithi005 ceph-mon[28964]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:26:38.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:38 smithi005 ceph-mon[28964]: Saving service alertmanager spec with placement count:1 2024-04-16T14:26:38.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:38 smithi005 ceph-mon[28964]: from='mgr.14118 172.21.15.5:0/2800231664' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:26:39.575 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.786+0000 7f13f59fa700 1 Processor -- start 2024-04-16T14:26:39.575 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.786+0000 7f13f59fa700 1 -- start start 2024-04-16T14:26:39.575 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.787+0000 7f13f59fa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13f0078c50 0x7f13f0077250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:39.575 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.787+0000 7f13f59fa700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f0079060 con 0x7f13f0078c50 2024-04-16T14:26:39.575 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.787+0000 7f13eeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13f0078c50 0x7f13f0077250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:39.575 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.787+0000 7f13eeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13f0078c50 0x7f13f0077250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36658/0 (socket says 172.21.15.5:36658) 2024-04-16T14:26:39.575 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.787+0000 7f13eeffd700 1 -- 172.21.15.5:0/2684190448 learned_addr learned my addr 172.21.15.5:0/2684190448 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:39.575 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.787+0000 7f13eeffd700 1 -- 172.21.15.5:0/2684190448 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f0077790 con 0x7f13f0078c50 2024-04-16T14:26:39.575 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.787+0000 7f13eeffd700 1 --2- 172.21.15.5:0/2684190448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13f0078c50 0x7f13f0077250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f13e00098e0 tx=0x7f13e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d96a2cbe2e707e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:39.575 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.787+0000 7f13edffb700 1 -- 172.21.15.5:0/2684190448 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f13e000b860 con 0x7f13f0078c50 2024-04-16T14:26:39.576 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.787+0000 7f13edffb700 1 -- 172.21.15.5:0/2684190448 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f13e000be90 con 0x7f13f0078c50 2024-04-16T14:26:39.576 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.787+0000 7f13edffb700 1 -- 172.21.15.5:0/2684190448 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f13e00103c0 con 0x7f13f0078c50 2024-04-16T14:26:39.576 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.788+0000 7f13f59fa700 1 -- 172.21.15.5:0/2684190448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13f0078c50 msgr2=0x7f13f0077250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:39.576 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.788+0000 7f13f59fa700 1 --2- 172.21.15.5:0/2684190448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13f0078c50 0x7f13f0077250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f13e00098e0 tx=0x7f13e0009250 comp rx=0 tx=0).stop 2024-04-16T14:26:39.576 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.788+0000 7f13f59fa700 1 -- 172.21.15.5:0/2684190448 shutdown_connections 2024-04-16T14:26:39.576 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.788+0000 7f13f59fa700 1 --2- 172.21.15.5:0/2684190448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13f0078c50 0x7f13f0077250 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:39.576 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.788+0000 7f13f59fa700 1 -- 172.21.15.5:0/2684190448 >> 172.21.15.5:0/2684190448 conn(0x7f13f00fe0e0 msgr2=0x7f13f01004f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:39.576 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.788+0000 7f13f59fa700 1 -- 172.21.15.5:0/2684190448 shutdown_connections 2024-04-16T14:26:39.576 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.788+0000 7f13f59fa700 1 -- 172.21.15.5:0/2684190448 wait complete. 2024-04-16T14:26:39.576 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.789+0000 7f13f59fa700 1 Processor -- start 2024-04-16T14:26:39.576 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.789+0000 7f13f59fa700 1 -- start start 2024-04-16T14:26:39.576 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.789+0000 7f13f59fa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13f0078c50 0x7f13f0113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:39.576 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.789+0000 7f13f59fa700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f0113ed0 con 0x7f13f0078c50 2024-04-16T14:26:39.577 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.789+0000 7f13eeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13f0078c50 0x7f13f0113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:39.577 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.789+0000 7f13eeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13f0078c50 0x7f13f0113990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36664/0 (socket says 172.21.15.5:36664) 2024-04-16T14:26:39.577 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.789+0000 7f13eeffd700 1 -- 172.21.15.5:0/2205582997 learned_addr learned my addr 172.21.15.5:0/2205582997 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:39.577 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.789+0000 7f13eeffd700 1 -- 172.21.15.5:0/2205582997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e00094f0 con 0x7f13f0078c50 2024-04-16T14:26:39.577 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.789+0000 7f13eeffd700 1 --2- 172.21.15.5:0/2205582997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13f0078c50 0x7f13f0113990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f13e00105b0 tx=0x7f13e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:39.577 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.790+0000 7f13d77fe700 1 -- 172.21.15.5:0/2205582997 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f13e0010840 con 0x7f13f0078c50 2024-04-16T14:26:39.577 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.790+0000 7f13d77fe700 1 -- 172.21.15.5:0/2205582997 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f13e0010e70 con 0x7f13f0078c50 2024-04-16T14:26:39.577 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.790+0000 7f13f59fa700 1 -- 172.21.15.5:0/2205582997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f01140d0 con 0x7f13f0078c50 2024-04-16T14:26:39.577 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.790+0000 7f13d77fe700 1 -- 172.21.15.5:0/2205582997 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f13e001ae30 con 0x7f13f0078c50 2024-04-16T14:26:39.577 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.790+0000 7f13f59fa700 1 -- 172.21.15.5:0/2205582997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f0114c40 con 0x7f13f0078c50 2024-04-16T14:26:39.577 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.791+0000 7f13d77fe700 1 -- 172.21.15.5:0/2205582997 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f13e002d3f0 con 0x7f13f0078c50 2024-04-16T14:26:39.577 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.791+0000 7f13f59fa700 1 -- 172.21.15.5:0/2205582997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f005f5f0 con 0x7f13f0078c50 2024-04-16T14:26:39.578 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.791+0000 7f13d77fe700 1 --2- 172.21.15.5:0/2205582997 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f13d8036790 0x7f13d8038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:39.578 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.791+0000 7f13d77fe700 1 -- 172.21.15.5:0/2205582997 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f13e004a2c0 con 0x7f13f0078c50 2024-04-16T14:26:39.578 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.791+0000 7f13ee7fc700 1 --2- 172.21.15.5:0/2205582997 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f13d8036790 0x7f13d8038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:39.578 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.791+0000 7f13ee7fc700 1 --2- 172.21.15.5:0/2205582997 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f13d8036790 0x7f13d8038c40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f13e4009990 tx=0x7f13e4006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:39.578 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.796+0000 7f13d77fe700 1 -- 172.21.15.5:0/2205582997 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f13e002b8c0 con 0x7f13f0078c50 2024-04-16T14:26:39.578 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.990+0000 7f13f59fa700 1 -- 172.21.15.5:0/2205582997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f13f004bed0 con 0x7f13f0078c50 2024-04-16T14:26:39.578 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.993+0000 7f13d77fe700 1 -- 172.21.15.5:0/2205582997 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f13e002b2f0 con 0x7f13f0078c50 2024-04-16T14:26:39.578 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.995+0000 7f13f59fa700 1 -- 172.21.15.5:0/2205582997 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f13d8036790 msgr2=0x7f13d8038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:39.578 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.995+0000 7f13f59fa700 1 --2- 172.21.15.5:0/2205582997 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f13d8036790 0x7f13d8038c40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f13e4009990 tx=0x7f13e4006e40 comp rx=0 tx=0).stop 2024-04-16T14:26:39.578 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.995+0000 7f13f59fa700 1 -- 172.21.15.5:0/2205582997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13f0078c50 msgr2=0x7f13f0113990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:39.578 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.995+0000 7f13f59fa700 1 --2- 172.21.15.5:0/2205582997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13f0078c50 0x7f13f0113990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f13e00105b0 tx=0x7f13e0009250 comp rx=0 tx=0).stop 2024-04-16T14:26:39.579 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.995+0000 7f13f59fa700 1 -- 172.21.15.5:0/2205582997 shutdown_connections 2024-04-16T14:26:39.579 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.995+0000 7f13f59fa700 1 --2- 172.21.15.5:0/2205582997 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f13d8036790 0x7f13d8038c40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:39.579 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.995+0000 7f13f59fa700 1 --2- 172.21.15.5:0/2205582997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f13f0078c50 0x7f13f0113990 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:39.579 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.995+0000 7f13f59fa700 1 -- 172.21.15.5:0/2205582997 >> 172.21.15.5:0/2205582997 conn(0x7f13f00fe0e0 msgr2=0x7f13f00fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:39.579 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.995+0000 7f13f59fa700 1 -- 172.21.15.5:0/2205582997 shutdown_connections 2024-04-16T14:26:39.579 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:38.995+0000 7f13f59fa700 1 -- 172.21.15.5:0/2205582997 wait complete. 2024-04-16T14:26:40.193 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:39 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/2205582997' entity='client.admin' 2024-04-16T14:26:40.193 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:39 smithi005 ceph-mon[28964]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:26:40.754 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.989+0000 7f4a62f1c700 1 Processor -- start 2024-04-16T14:26:40.754 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.989+0000 7f4a62f1c700 1 -- start start 2024-04-16T14:26:40.754 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.989+0000 7f4a62f1c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a5c076c20 0x7f4a5c105480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:40.754 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.989+0000 7f4a62f1c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c1059c0 con 0x7f4a5c076c20 2024-04-16T14:26:40.754 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.989+0000 7f4a60cb8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a5c076c20 0x7f4a5c105480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:40.755 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.989+0000 7f4a60cb8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a5c076c20 0x7f4a5c105480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36668/0 (socket says 172.21.15.5:36668) 2024-04-16T14:26:40.755 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.989+0000 7f4a60cb8700 1 -- 172.21.15.5:0/3933027549 learned_addr learned my addr 172.21.15.5:0/3933027549 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:40.755 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.990+0000 7f4a60cb8700 1 -- 172.21.15.5:0/3933027549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5c105b00 con 0x7f4a5c076c20 2024-04-16T14:26:40.755 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.990+0000 7f4a60cb8700 1 --2- 172.21.15.5:0/3933027549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a5c076c20 0x7f4a5c105480 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4a500098e0 tx=0x7f4a50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=555331c13c83c48e server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:40.755 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.990+0000 7f4a5b7fe700 1 -- 172.21.15.5:0/3933027549 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a5000b860 con 0x7f4a5c076c20 2024-04-16T14:26:40.755 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.990+0000 7f4a5b7fe700 1 -- 172.21.15.5:0/3933027549 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4a5000be90 con 0x7f4a5c076c20 2024-04-16T14:26:40.755 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.990+0000 7f4a5b7fe700 1 -- 172.21.15.5:0/3933027549 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a500103c0 con 0x7f4a5c076c20 2024-04-16T14:26:40.755 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.990+0000 7f4a62f1c700 1 -- 172.21.15.5:0/3933027549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a5c076c20 msgr2=0x7f4a5c105480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:40.755 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.990+0000 7f4a62f1c700 1 --2- 172.21.15.5:0/3933027549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a5c076c20 0x7f4a5c105480 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4a500098e0 tx=0x7f4a50009250 comp rx=0 tx=0).stop 2024-04-16T14:26:40.755 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.991+0000 7f4a62f1c700 1 -- 172.21.15.5:0/3933027549 shutdown_connections 2024-04-16T14:26:40.755 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.991+0000 7f4a62f1c700 1 --2- 172.21.15.5:0/3933027549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a5c076c20 0x7f4a5c105480 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:40.755 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.991+0000 7f4a62f1c700 1 -- 172.21.15.5:0/3933027549 >> 172.21.15.5:0/3933027549 conn(0x7f4a5c0fcfb0 msgr2=0x7f4a5c0ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:40.755 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.991+0000 7f4a62f1c700 1 -- 172.21.15.5:0/3933027549 shutdown_connections 2024-04-16T14:26:40.755 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.991+0000 7f4a62f1c700 1 -- 172.21.15.5:0/3933027549 wait complete. 2024-04-16T14:26:40.756 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.991+0000 7f4a62f1c700 1 Processor -- start 2024-04-16T14:26:40.756 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.991+0000 7f4a62f1c700 1 -- start start 2024-04-16T14:26:40.756 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.991+0000 7f4a62f1c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a5c076c20 0x7f4a5c111750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:40.756 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.991+0000 7f4a62f1c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c111c90 con 0x7f4a5c076c20 2024-04-16T14:26:40.756 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.992+0000 7f4a60cb8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a5c076c20 0x7f4a5c111750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:40.756 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.992+0000 7f4a60cb8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a5c076c20 0x7f4a5c111750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36672/0 (socket says 172.21.15.5:36672) 2024-04-16T14:26:40.756 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.992+0000 7f4a60cb8700 1 -- 172.21.15.5:0/2260072551 learned_addr learned my addr 172.21.15.5:0/2260072551 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:40.756 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.992+0000 7f4a60cb8700 1 -- 172.21.15.5:0/2260072551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a500094f0 con 0x7f4a5c076c20 2024-04-16T14:26:40.756 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.992+0000 7f4a60cb8700 1 --2- 172.21.15.5:0/2260072551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a5c076c20 0x7f4a5c111750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4a500094c0 tx=0x7f4a50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:40.756 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.993+0000 7f4a597fa700 1 -- 172.21.15.5:0/2260072551 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a500118f0 con 0x7f4a5c076c20 2024-04-16T14:26:40.756 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.993+0000 7f4a597fa700 1 -- 172.21.15.5:0/2260072551 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4a50010d60 con 0x7f4a5c076c20 2024-04-16T14:26:40.756 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.993+0000 7f4a597fa700 1 -- 172.21.15.5:0/2260072551 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a5001a430 con 0x7f4a5c076c20 2024-04-16T14:26:40.756 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.993+0000 7f4a62f1c700 1 -- 172.21.15.5:0/2260072551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5c111e90 con 0x7f4a5c076c20 2024-04-16T14:26:40.756 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.993+0000 7f4a62f1c700 1 -- 172.21.15.5:0/2260072551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5c112a00 con 0x7f4a5c076c20 2024-04-16T14:26:40.756 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.994+0000 7f4a62f1c700 1 -- 172.21.15.5:0/2260072551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a5c05f5f0 con 0x7f4a5c076c20 2024-04-16T14:26:40.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.995+0000 7f4a597fa700 1 -- 172.21.15.5:0/2260072551 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f4a50024440 con 0x7f4a5c076c20 2024-04-16T14:26:40.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.995+0000 7f4a597fa700 1 --2- 172.21.15.5:0/2260072551 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f4a4c0367e0 0x7f4a4c038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:40.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.996+0000 7f4a597fa700 1 -- 172.21.15.5:0/2260072551 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f4a5004a6c0 con 0x7f4a5c076c20 2024-04-16T14:26:40.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.996+0000 7f4a5bfff700 1 --2- 172.21.15.5:0/2260072551 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f4a4c0367e0 0x7f4a4c038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:40.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:39.996+0000 7f4a5bfff700 1 --2- 172.21.15.5:0/2260072551 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f4a4c0367e0 0x7f4a4c038c90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009990 tx=0x7f4a48006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:40.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:40.000+0000 7f4a597fa700 1 -- 172.21.15.5:0/2260072551 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4a50022b90 con 0x7f4a5c076c20 2024-04-16T14:26:40.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:40.195+0000 7f4a62f1c700 1 -- 172.21.15.5:0/2260072551 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f4a5c04bed0 con 0x7f4a5c076c20 2024-04-16T14:26:40.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:40.198+0000 7f4a597fa700 1 -- 172.21.15.5:0/2260072551 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f4a500227b0 con 0x7f4a5c076c20 2024-04-16T14:26:40.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:40.201+0000 7f4a62f1c700 1 -- 172.21.15.5:0/2260072551 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f4a4c0367e0 msgr2=0x7f4a4c038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:40.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:40.201+0000 7f4a62f1c700 1 --2- 172.21.15.5:0/2260072551 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f4a4c0367e0 0x7f4a4c038c90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009990 tx=0x7f4a48006e40 comp rx=0 tx=0).stop 2024-04-16T14:26:40.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:40.201+0000 7f4a62f1c700 1 -- 172.21.15.5:0/2260072551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a5c076c20 msgr2=0x7f4a5c111750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:40.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:40.201+0000 7f4a62f1c700 1 --2- 172.21.15.5:0/2260072551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a5c076c20 0x7f4a5c111750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4a500094c0 tx=0x7f4a50009250 comp rx=0 tx=0).stop 2024-04-16T14:26:40.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:40.201+0000 7f4a62f1c700 1 -- 172.21.15.5:0/2260072551 shutdown_connections 2024-04-16T14:26:40.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:40.201+0000 7f4a62f1c700 1 --2- 172.21.15.5:0/2260072551 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f4a4c0367e0 0x7f4a4c038c90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:40.758 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:40.201+0000 7f4a62f1c700 1 --2- 172.21.15.5:0/2260072551 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a5c076c20 0x7f4a5c111750 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:40.758 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:40.201+0000 7f4a62f1c700 1 -- 172.21.15.5:0/2260072551 >> 172.21.15.5:0/2260072551 conn(0x7f4a5c0fcfb0 msgr2=0x7f4a5c0fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:40.758 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:40.201+0000 7f4a62f1c700 1 -- 172.21.15.5:0/2260072551 shutdown_connections 2024-04-16T14:26:40.758 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:40.201+0000 7f4a62f1c700 1 -- 172.21.15.5:0/2260072551 wait complete. 2024-04-16T14:26:40.758 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling the dashboard module... 2024-04-16T14:26:41.465 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:41 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/2260072551' entity='client.admin' 2024-04-16T14:26:42.473 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:42 smithi005 ceph-mon[28964]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:26:42.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:42 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/2270320193' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-16T14:26:42.868 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.208+0000 7fde40a80700 1 Processor -- start 2024-04-16T14:26:42.868 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.209+0000 7fde40a80700 1 -- start start 2024-04-16T14:26:42.868 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.209+0000 7fde40a80700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde3c076c20 0x7fde3c105480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:42.869 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.209+0000 7fde40a80700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c1059c0 con 0x7fde3c076c20 2024-04-16T14:26:42.869 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.209+0000 7fde3a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde3c076c20 0x7fde3c105480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:42.869 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.209+0000 7fde3a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde3c076c20 0x7fde3c105480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36676/0 (socket says 172.21.15.5:36676) 2024-04-16T14:26:42.869 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.209+0000 7fde3a59c700 1 -- 172.21.15.5:0/221606987 learned_addr learned my addr 172.21.15.5:0/221606987 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:42.869 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.209+0000 7fde3a59c700 1 -- 172.21.15.5:0/221606987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3c105b00 con 0x7fde3c076c20 2024-04-16T14:26:42.869 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.209+0000 7fde3a59c700 1 --2- 172.21.15.5:0/221606987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde3c076c20 0x7fde3c105480 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fde2c0098e0 tx=0x7fde2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e1722ebc99b6c server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:42.869 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.209+0000 7fde39d9b700 1 -- 172.21.15.5:0/221606987 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde2c00b860 con 0x7fde3c076c20 2024-04-16T14:26:42.869 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.209+0000 7fde39d9b700 1 -- 172.21.15.5:0/221606987 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fde2c00be90 con 0x7fde3c076c20 2024-04-16T14:26:42.869 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.210+0000 7fde39d9b700 1 -- 172.21.15.5:0/221606987 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde2c0103c0 con 0x7fde3c076c20 2024-04-16T14:26:42.869 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.210+0000 7fde40a80700 1 -- 172.21.15.5:0/221606987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde3c076c20 msgr2=0x7fde3c105480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:42.869 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.210+0000 7fde40a80700 1 --2- 172.21.15.5:0/221606987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde3c076c20 0x7fde3c105480 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fde2c0098e0 tx=0x7fde2c009250 comp rx=0 tx=0).stop 2024-04-16T14:26:42.869 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.210+0000 7fde40a80700 1 -- 172.21.15.5:0/221606987 shutdown_connections 2024-04-16T14:26:42.869 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.210+0000 7fde40a80700 1 --2- 172.21.15.5:0/221606987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde3c076c20 0x7fde3c105480 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:42.869 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.210+0000 7fde40a80700 1 -- 172.21.15.5:0/221606987 >> 172.21.15.5:0/221606987 conn(0x7fde3c0fcfb0 msgr2=0x7fde3c0ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:42.870 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.210+0000 7fde40a80700 1 -- 172.21.15.5:0/221606987 shutdown_connections 2024-04-16T14:26:42.870 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.210+0000 7fde40a80700 1 -- 172.21.15.5:0/221606987 wait complete. 2024-04-16T14:26:42.870 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.211+0000 7fde40a80700 1 Processor -- start 2024-04-16T14:26:42.870 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.211+0000 7fde40a80700 1 -- start start 2024-04-16T14:26:42.870 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.211+0000 7fde40a80700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde3c076c20 0x7fde3c111750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:42.870 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.211+0000 7fde40a80700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c111c90 con 0x7fde3c076c20 2024-04-16T14:26:42.870 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.211+0000 7fde3a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde3c076c20 0x7fde3c111750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:42.870 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.211+0000 7fde3a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde3c076c20 0x7fde3c111750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36680/0 (socket says 172.21.15.5:36680) 2024-04-16T14:26:42.870 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.211+0000 7fde3a59c700 1 -- 172.21.15.5:0/2270320193 learned_addr learned my addr 172.21.15.5:0/2270320193 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:42.870 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.211+0000 7fde3a59c700 1 -- 172.21.15.5:0/2270320193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde2c0094f0 con 0x7fde3c076c20 2024-04-16T14:26:42.870 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.212+0000 7fde3a59c700 1 --2- 172.21.15.5:0/2270320193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde3c076c20 0x7fde3c111750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fde2c0094c0 tx=0x7fde2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:42.870 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.212+0000 7fde337fe700 1 -- 172.21.15.5:0/2270320193 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde2c0118f0 con 0x7fde3c076c20 2024-04-16T14:26:42.870 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.212+0000 7fde337fe700 1 -- 172.21.15.5:0/2270320193 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fde2c010d60 con 0x7fde3c076c20 2024-04-16T14:26:42.871 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.212+0000 7fde40a80700 1 -- 172.21.15.5:0/2270320193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde3c111e90 con 0x7fde3c076c20 2024-04-16T14:26:42.871 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.212+0000 7fde337fe700 1 -- 172.21.15.5:0/2270320193 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde2c01a430 con 0x7fde3c076c20 2024-04-16T14:26:42.871 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.212+0000 7fde40a80700 1 -- 172.21.15.5:0/2270320193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde3c112a00 con 0x7fde3c076c20 2024-04-16T14:26:42.871 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.213+0000 7fde337fe700 1 -- 172.21.15.5:0/2270320193 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fde2c01a590 con 0x7fde3c076c20 2024-04-16T14:26:42.871 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.213+0000 7fde40a80700 1 -- 172.21.15.5:0/2270320193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde3c05f5f0 con 0x7fde3c076c20 2024-04-16T14:26:42.871 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.213+0000 7fde337fe700 1 --2- 172.21.15.5:0/2270320193 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fde28036790 0x7fde28038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:42.871 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.213+0000 7fde337fe700 1 -- 172.21.15.5:0/2270320193 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fde2c04a6a0 con 0x7fde3c076c20 2024-04-16T14:26:42.871 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.213+0000 7fde31d9b700 1 --2- 172.21.15.5:0/2270320193 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fde28036790 0x7fde28038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:42.871 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.213+0000 7fde31d9b700 1 --2- 172.21.15.5:0/2270320193 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fde28036790 0x7fde28038c40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fde24009990 tx=0x7fde24006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:42.871 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.218+0000 7fde337fe700 1 -- 172.21.15.5:0/2270320193 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fde2c018db0 con 0x7fde3c076c20 2024-04-16T14:26:42.871 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:41.467+0000 7fde40a80700 1 -- 172.21.15.5:0/2270320193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fde3c04bed0 con 0x7fde3c076c20 2024-04-16T14:26:42.871 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:42.202+0000 7fde337fe700 1 -- 172.21.15.5:0/2270320193 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7fde2c02ad60 con 0x7fde3c076c20 2024-04-16T14:26:42.871 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:42.204+0000 7fde337fe700 1 -- 172.21.15.5:0/2270320193 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fde2c00f2e0 con 0x7fde3c076c20 2024-04-16T14:26:42.871 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:42.206+0000 7fde40a80700 1 -- 172.21.15.5:0/2270320193 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fde28036790 msgr2=0x7fde28038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:42.871 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:42.206+0000 7fde40a80700 1 --2- 172.21.15.5:0/2270320193 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fde28036790 0x7fde28038c40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fde24009990 tx=0x7fde24006e40 comp rx=0 tx=0).stop 2024-04-16T14:26:42.872 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:42.206+0000 7fde40a80700 1 -- 172.21.15.5:0/2270320193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde3c076c20 msgr2=0x7fde3c111750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:42.872 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:42.206+0000 7fde40a80700 1 --2- 172.21.15.5:0/2270320193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde3c076c20 0x7fde3c111750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fde2c0094c0 tx=0x7fde2c009250 comp rx=0 tx=0).stop 2024-04-16T14:26:42.872 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:42.206+0000 7fde40a80700 1 -- 172.21.15.5:0/2270320193 shutdown_connections 2024-04-16T14:26:42.872 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:42.206+0000 7fde40a80700 1 --2- 172.21.15.5:0/2270320193 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fde28036790 0x7fde28038c40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:42.872 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:42.206+0000 7fde40a80700 1 --2- 172.21.15.5:0/2270320193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde3c076c20 0x7fde3c111750 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:42.872 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:42.206+0000 7fde40a80700 1 -- 172.21.15.5:0/2270320193 >> 172.21.15.5:0/2270320193 conn(0x7fde3c0fcfb0 msgr2=0x7fde3c0fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:42.872 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:42.207+0000 7fde40a80700 1 -- 172.21.15.5:0/2270320193 shutdown_connections 2024-04-16T14:26:42.872 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:42.207+0000 7fde40a80700 1 -- 172.21.15.5:0/2270320193 wait complete. 2024-04-16T14:26:43.467 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:43 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/2270320193' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-16T14:26:43.467 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:43 smithi005 ceph-mon[28964]: mgrmap e9: smithi005.ipwdkc(active, since 24s) 2024-04-16T14:26:44.144 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-04-16T14:26:44.151 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-16T14:26:44.151 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-16T14:26:44.151 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "active_name": "smithi005.ipwdkc", 2024-04-16T14:26:44.151 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-16T14:26:44.151 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-04-16T14:26:44.151 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.263+0000 7f83616ba700 1 Processor -- start 2024-04-16T14:26:44.151 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.263+0000 7f83616ba700 1 -- start start 2024-04-16T14:26:44.151 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.263+0000 7f83616ba700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f835c101d40 0x7f835c102150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:44.151 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.263+0000 7f83616ba700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c102690 con 0x7f835c101d40 2024-04-16T14:26:44.151 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.264+0000 7f835affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f835c101d40 0x7f835c102150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:44.151 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.264+0000 7f835affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f835c101d40 0x7f835c102150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36702/0 (socket says 172.21.15.5:36702) 2024-04-16T14:26:44.151 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.264+0000 7f835affd700 1 -- 172.21.15.5:0/2191699732 learned_addr learned my addr 172.21.15.5:0/2191699732 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:44.151 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.264+0000 7f835affd700 1 -- 172.21.15.5:0/2191699732 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835c1027d0 con 0x7f835c101d40 2024-04-16T14:26:44.152 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.264+0000 7f835affd700 1 --2- 172.21.15.5:0/2191699732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f835c101d40 0x7f835c102150 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f834c00bb80 tx=0x7f834c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e4a4a58a5872494 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:44.152 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.264+0000 7f8359ffb700 1 -- 172.21.15.5:0/2191699732 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f834c00dd00 con 0x7f835c101d40 2024-04-16T14:26:44.152 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.264+0000 7f8359ffb700 1 -- 172.21.15.5:0/2191699732 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f834c00de60 con 0x7f835c101d40 2024-04-16T14:26:44.152 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.264+0000 7f8359ffb700 1 -- 172.21.15.5:0/2191699732 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f834c018920 con 0x7f835c101d40 2024-04-16T14:26:44.152 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.265+0000 7f83616ba700 1 -- 172.21.15.5:0/2191699732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f835c101d40 msgr2=0x7f835c102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:44.152 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.265+0000 7f83616ba700 1 --2- 172.21.15.5:0/2191699732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f835c101d40 0x7f835c102150 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f834c00bb80 tx=0x7f834c00b4f0 comp rx=0 tx=0).stop 2024-04-16T14:26:44.152 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.265+0000 7f83616ba700 1 -- 172.21.15.5:0/2191699732 shutdown_connections 2024-04-16T14:26:44.152 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.265+0000 7f83616ba700 1 --2- 172.21.15.5:0/2191699732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f835c101d40 0x7f835c102150 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:44.152 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.265+0000 7f83616ba700 1 -- 172.21.15.5:0/2191699732 >> 172.21.15.5:0/2191699732 conn(0x7f835c0fc770 msgr2=0x7f835c0feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:44.152 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.265+0000 7f83616ba700 1 -- 172.21.15.5:0/2191699732 shutdown_connections 2024-04-16T14:26:44.152 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.265+0000 7f83616ba700 1 -- 172.21.15.5:0/2191699732 wait complete. 2024-04-16T14:26:44.152 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.266+0000 7f83616ba700 1 Processor -- start 2024-04-16T14:26:44.152 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.266+0000 7f83616ba700 1 -- start start 2024-04-16T14:26:44.152 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.266+0000 7f83616ba700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f835c101d40 0x7f835c113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:44.153 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.266+0000 7f83616ba700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c113ed0 con 0x7f835c101d40 2024-04-16T14:26:44.153 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.266+0000 7f835affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f835c101d40 0x7f835c113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:44.153 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.266+0000 7f835affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f835c101d40 0x7f835c113990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36716/0 (socket says 172.21.15.5:36716) 2024-04-16T14:26:44.153 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.266+0000 7f835affd700 1 -- 172.21.15.5:0/3423501350 learned_addr learned my addr 172.21.15.5:0/3423501350 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:44.153 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.266+0000 7f835affd700 1 -- 172.21.15.5:0/3423501350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834c00b790 con 0x7f835c101d40 2024-04-16T14:26:44.153 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.266+0000 7f835affd700 1 --2- 172.21.15.5:0/3423501350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f835c101d40 0x7f835c113990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f834c0106a0 tx=0x7f834c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:44.153 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.267+0000 7f83437fe700 1 -- 172.21.15.5:0/3423501350 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f834c018e90 con 0x7f835c101d40 2024-04-16T14:26:44.153 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.267+0000 7f83437fe700 1 -- 172.21.15.5:0/3423501350 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f834c00dc70 con 0x7f835c101d40 2024-04-16T14:26:44.153 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.267+0000 7f83616ba700 1 -- 172.21.15.5:0/3423501350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f835c1140d0 con 0x7f835c101d40 2024-04-16T14:26:44.153 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.267+0000 7f83437fe700 1 -- 172.21.15.5:0/3423501350 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f834c021550 con 0x7f835c101d40 2024-04-16T14:26:44.153 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.267+0000 7f83616ba700 1 -- 172.21.15.5:0/3423501350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f835c114c40 con 0x7f835c101d40 2024-04-16T14:26:44.153 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.268+0000 7f83616ba700 1 -- 172.21.15.5:0/3423501350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f835c05f5f0 con 0x7f835c101d40 2024-04-16T14:26:44.153 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.268+0000 7f83437fe700 1 -- 172.21.15.5:0/3423501350 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f834c021790 con 0x7f835c101d40 2024-04-16T14:26:44.153 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.268+0000 7f83437fe700 1 --2- 172.21.15.5:0/3423501350 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f83440367e0 0x7f8344038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:44.154 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.268+0000 7f83437fe700 1 -- 172.21.15.5:0/3423501350 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f834c014070 con 0x7f835c101d40 2024-04-16T14:26:44.154 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.268+0000 7f835a7fc700 1 -- 172.21.15.5:0/3423501350 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f83440367e0 msgr2=0x7f8344038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/4088193218 2024-04-16T14:26:44.154 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.268+0000 7f835a7fc700 1 --2- 172.21.15.5:0/3423501350 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f83440367e0 0x7f8344038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T14:26:44.154 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.273+0000 7f83437fe700 1 -- 172.21.15.5:0/3423501350 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f834c050020 con 0x7f835c101d40 2024-04-16T14:26:44.154 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.469+0000 7f835a7fc700 1 -- 172.21.15.5:0/3423501350 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f83440367e0 msgr2=0x7f8344038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/4088193218 2024-04-16T14:26:44.154 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.469+0000 7f835a7fc700 1 --2- 172.21.15.5:0/3423501350 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f83440367e0 0x7f8344038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-16T14:26:44.154 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.530+0000 7f83616ba700 1 -- 172.21.15.5:0/3423501350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f835c1157b0 con 0x7f835c101d40 2024-04-16T14:26:44.154 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.531+0000 7f83437fe700 1 -- 172.21.15.5:0/3423501350 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f834c00ed90 con 0x7f835c101d40 2024-04-16T14:26:44.154 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.533+0000 7f83616ba700 1 -- 172.21.15.5:0/3423501350 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f83440367e0 msgr2=0x7f8344038c90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T14:26:44.154 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.533+0000 7f83616ba700 1 --2- 172.21.15.5:0/3423501350 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f83440367e0 0x7f8344038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:44.154 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.533+0000 7f83616ba700 1 -- 172.21.15.5:0/3423501350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f835c101d40 msgr2=0x7f835c113990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:44.154 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.533+0000 7f83616ba700 1 --2- 172.21.15.5:0/3423501350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f835c101d40 0x7f835c113990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f834c0106a0 tx=0x7f834c00b4f0 comp rx=0 tx=0).stop 2024-04-16T14:26:44.154 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.533+0000 7f83616ba700 1 -- 172.21.15.5:0/3423501350 shutdown_connections 2024-04-16T14:26:44.154 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.533+0000 7f83616ba700 1 --2- 172.21.15.5:0/3423501350 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7f83440367e0 0x7f8344038c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:44.155 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.533+0000 7f83616ba700 1 --2- 172.21.15.5:0/3423501350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f835c101d40 0x7f835c113990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:44.155 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.533+0000 7f83616ba700 1 -- 172.21.15.5:0/3423501350 >> 172.21.15.5:0/3423501350 conn(0x7f835c0fc770 msgr2=0x7f835c105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:44.155 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.533+0000 7f83616ba700 1 -- 172.21.15.5:0/3423501350 shutdown_connections 2024-04-16T14:26:44.155 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:43.533+0000 7f83616ba700 1 -- 172.21.15.5:0/3423501350 wait complete. 2024-04-16T14:26:44.155 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for the mgr to restart... 2024-04-16T14:26:44.155 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr epoch 9... 2024-04-16T14:26:44.377 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:44 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/3423501350' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-16T14:26:49.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:48 smithi005 ceph-mon[28964]: Active manager daemon smithi005.ipwdkc restarted 2024-04-16T14:26:49.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:48 smithi005 ceph-mon[28964]: Activating manager daemon smithi005.ipwdkc 2024-04-16T14:26:49.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:48 smithi005 ceph-mon[28964]: osdmap e3: 0 total, 0 up, 0 in 2024-04-16T14:26:49.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:48 smithi005 ceph-mon[28964]: mgrmap e10: smithi005.ipwdkc(active, starting, since 0.00315868s) 2024-04-16T14:26:49.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:48 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-04-16T14:26:49.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:48 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr metadata", "who": "smithi005.ipwdkc", "id": "smithi005.ipwdkc"}]: dispatch 2024-04-16T14:26:49.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:48 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-16T14:26:49.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:48 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-16T14:26:49.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:48 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-16T14:26:49.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:48 smithi005 ceph-mon[28964]: Manager daemon smithi005.ipwdkc is now available 2024-04-16T14:26:49.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:48 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:26:49.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:48 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:26:49.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:48 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi005.ipwdkc/mirror_snapshot_schedule"}]: dispatch 2024-04-16T14:26:49.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:48 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi005.ipwdkc/trash_purge_schedule"}]: dispatch 2024-04-16T14:26:50.776 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:50 smithi005 ceph-mon[28964]: [16/Apr/2024:14:26:49] ENGINE Bus STARTING 2024-04-16T14:26:50.777 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:50 smithi005 ceph-mon[28964]: [16/Apr/2024:14:26:49] ENGINE Serving on https://172.21.15.5:7150 2024-04-16T14:26:50.777 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:50 smithi005 ceph-mon[28964]: [16/Apr/2024:14:26:49] ENGINE Bus STARTED 2024-04-16T14:26:50.777 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:50 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:26:50.777 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:50 smithi005 ceph-mon[28964]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-16T14:26:50.777 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:50 smithi005 ceph-mon[28964]: mgrmap e11: smithi005.ipwdkc(active, since 1.00538s) 2024-04-16T14:26:50.777 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:50 smithi005 ceph-mon[28964]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-16T14:26:50.777 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:50 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:26:50.787 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-04-16T14:26:50.787 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-16T14:26:50.787 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-16T14:26:50.787 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-04-16T14:26:50.787 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.613+0000 7fcf3b26b700 1 Processor -- start 2024-04-16T14:26:50.787 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.614+0000 7fcf3b26b700 1 -- start start 2024-04-16T14:26:50.787 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.614+0000 7fcf3b26b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf34078bd0 0x7fcf34077270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:50.787 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.614+0000 7fcf3b26b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf34078fe0 con 0x7fcf34078bd0 2024-04-16T14:26:50.788 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.614+0000 7fcf39007700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf34078bd0 0x7fcf34077270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:50.788 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.614+0000 7fcf39007700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf34078bd0 0x7fcf34077270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36726/0 (socket says 172.21.15.5:36726) 2024-04-16T14:26:50.788 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.614+0000 7fcf39007700 1 -- 172.21.15.5:0/1610621522 learned_addr learned my addr 172.21.15.5:0/1610621522 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:50.788 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.614+0000 7fcf39007700 1 -- 172.21.15.5:0/1610621522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf34079120 con 0x7fcf34078bd0 2024-04-16T14:26:50.788 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.614+0000 7fcf39007700 1 --2- 172.21.15.5:0/1610621522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf34078bd0 0x7fcf34077270 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcf300098e0 tx=0x7fcf30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc3724949fb6659 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:50.788 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.615+0000 7fcf2bfff700 1 -- 172.21.15.5:0/1610621522 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf3000b8f0 con 0x7fcf34078bd0 2024-04-16T14:26:50.788 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.615+0000 7fcf2bfff700 1 -- 172.21.15.5:0/1610621522 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcf30011420 con 0x7fcf34078bd0 2024-04-16T14:26:50.788 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.615+0000 7fcf2bfff700 1 -- 172.21.15.5:0/1610621522 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf30010540 con 0x7fcf34078bd0 2024-04-16T14:26:50.788 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.615+0000 7fcf3b26b700 1 -- 172.21.15.5:0/1610621522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf34078bd0 msgr2=0x7fcf34077270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:50.788 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.615+0000 7fcf3b26b700 1 --2- 172.21.15.5:0/1610621522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf34078bd0 0x7fcf34077270 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcf300098e0 tx=0x7fcf30009250 comp rx=0 tx=0).stop 2024-04-16T14:26:50.788 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.615+0000 7fcf3b26b700 1 -- 172.21.15.5:0/1610621522 shutdown_connections 2024-04-16T14:26:50.788 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.615+0000 7fcf3b26b700 1 --2- 172.21.15.5:0/1610621522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf34078bd0 0x7fcf34077270 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:50.788 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.615+0000 7fcf3b26b700 1 -- 172.21.15.5:0/1610621522 >> 172.21.15.5:0/1610621522 conn(0x7fcf340fe120 msgr2=0x7fcf34100550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:50.788 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.615+0000 7fcf3b26b700 1 -- 172.21.15.5:0/1610621522 shutdown_connections 2024-04-16T14:26:50.789 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.615+0000 7fcf3b26b700 1 -- 172.21.15.5:0/1610621522 wait complete. 2024-04-16T14:26:50.789 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.616+0000 7fcf3b26b700 1 Processor -- start 2024-04-16T14:26:50.789 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.616+0000 7fcf3b26b700 1 -- start start 2024-04-16T14:26:50.789 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.616+0000 7fcf3b26b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf34078bd0 0x7fcf341139b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:50.789 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.616+0000 7fcf3b26b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf34113ef0 con 0x7fcf34078bd0 2024-04-16T14:26:50.789 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.616+0000 7fcf39007700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf34078bd0 0x7fcf341139b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:50.789 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.616+0000 7fcf39007700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf34078bd0 0x7fcf341139b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36728/0 (socket says 172.21.15.5:36728) 2024-04-16T14:26:50.789 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.616+0000 7fcf39007700 1 -- 172.21.15.5:0/3336876394 learned_addr learned my addr 172.21.15.5:0/3336876394 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:50.789 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.617+0000 7fcf39007700 1 -- 172.21.15.5:0/3336876394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf300094f0 con 0x7fcf34078bd0 2024-04-16T14:26:50.789 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.617+0000 7fcf39007700 1 --2- 172.21.15.5:0/3336876394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf34078bd0 0x7fcf341139b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcf30011cf0 tx=0x7fcf30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:50.789 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.617+0000 7fcf29ffb700 1 -- 172.21.15.5:0/3336876394 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf30010800 con 0x7fcf34078bd0 2024-04-16T14:26:50.789 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.617+0000 7fcf29ffb700 1 -- 172.21.15.5:0/3336876394 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcf30010e30 con 0x7fcf34078bd0 2024-04-16T14:26:50.789 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.617+0000 7fcf3b26b700 1 -- 172.21.15.5:0/3336876394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf341140f0 con 0x7fcf34078bd0 2024-04-16T14:26:50.789 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.617+0000 7fcf29ffb700 1 -- 172.21.15.5:0/3336876394 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf3001ae80 con 0x7fcf34078bd0 2024-04-16T14:26:50.790 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.617+0000 7fcf3b26b700 1 -- 172.21.15.5:0/3336876394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf34114c60 con 0x7fcf34078bd0 2024-04-16T14:26:50.790 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.618+0000 7fcf29ffb700 1 -- 172.21.15.5:0/3336876394 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7fcf3002d3f0 con 0x7fcf34078bd0 2024-04-16T14:26:50.790 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.618+0000 7fcf29ffb700 1 --2- 172.21.15.5:0/3336876394 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fcf20036830 0x7fcf20038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:50.790 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.618+0000 7fcf29ffb700 1 -- 172.21.15.5:0/3336876394 --> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcf3000bed0 con 0x7fcf20036830 2024-04-16T14:26:50.790 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.618+0000 7fcf29ffb700 1 -- 172.21.15.5:0/3336876394 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fcf3004a4b0 con 0x7fcf34078bd0 2024-04-16T14:26:50.790 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.618+0000 7fcf38806700 1 -- 172.21.15.5:0/3336876394 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fcf20036830 msgr2=0x7fcf20038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/4088193218 2024-04-16T14:26:50.790 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.618+0000 7fcf38806700 1 --2- 172.21.15.5:0/3336876394 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fcf20036830 0x7fcf20038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T14:26:50.790 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.819+0000 7fcf38806700 1 -- 172.21.15.5:0/3336876394 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fcf20036830 msgr2=0x7fcf20038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/4088193218 2024-04-16T14:26:50.790 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:44.819+0000 7fcf38806700 1 --2- 172.21.15.5:0/3336876394 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fcf20036830 0x7fcf20038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-16T14:26:50.790 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:45.220+0000 7fcf38806700 1 -- 172.21.15.5:0/3336876394 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fcf20036830 msgr2=0x7fcf20038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/4088193218 2024-04-16T14:26:50.790 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:45.220+0000 7fcf38806700 1 --2- 172.21.15.5:0/3336876394 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fcf20036830 0x7fcf20038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-16T14:26:50.790 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:46.021+0000 7fcf38806700 1 -- 172.21.15.5:0/3336876394 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fcf20036830 msgr2=0x7fcf20038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/4088193218 2024-04-16T14:26:50.790 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:46.021+0000 7fcf38806700 1 --2- 172.21.15.5:0/3336876394 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fcf20036830 0x7fcf20038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-16T14:26:50.790 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:47.622+0000 7fcf38806700 1 -- 172.21.15.5:0/3336876394 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fcf20036830 msgr2=0x7fcf20038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/4088193218 2024-04-16T14:26:50.791 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:47.622+0000 7fcf38806700 1 --2- 172.21.15.5:0/3336876394 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fcf20036830 0x7fcf20038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-16T14:26:50.791 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:48.931+0000 7fcf29ffb700 1 -- 172.21.15.5:0/3336876394 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mgrmap(e 10) v1 ==== 43156+0+0 (secure 0 0 0) 0x7fcf3001a730 con 0x7fcf34078bd0 2024-04-16T14:26:50.791 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:48.931+0000 7fcf29ffb700 1 -- 172.21.15.5:0/3336876394 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fcf20036830 msgr2=0x7fcf20038ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T14:26:50.791 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:48.931+0000 7fcf29ffb700 1 --2- 172.21.15.5:0/3336876394 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fcf20036830 0x7fcf20038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:50.791 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:49.932+0000 7fcf29ffb700 1 -- 172.21.15.5:0/3336876394 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 11) v1 ==== 43283+0+0 (secure 0 0 0) 0x7fcf30016d30 con 0x7fcf34078bd0 2024-04-16T14:26:50.791 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:49.932+0000 7fcf29ffb700 1 --2- 172.21.15.5:0/3336876394 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fcf20039fe0 0x7fcf2003c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:50.791 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:49.932+0000 7fcf29ffb700 1 -- 172.21.15.5:0/3336876394 --> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcf3000bed0 con 0x7fcf20039fe0 2024-04-16T14:26:50.791 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:49.933+0000 7fcf38806700 1 --2- 172.21.15.5:0/3336876394 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fcf20039fe0 0x7fcf2003c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:50.791 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:49.933+0000 7fcf38806700 1 --2- 172.21.15.5:0/3336876394 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fcf20039fe0 0x7fcf2003c3c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcf240039d0 tx=0x7fcf24009350 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:50.791 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:49.934+0000 7fcf29ffb700 1 -- 172.21.15.5:0/3336876394 <== mgr.14160 v2:172.21.15.5:6800/4176454319 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7fcf3000bed0 con 0x7fcf20039fe0 2024-04-16T14:26:50.791 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:49.940+0000 7fcf3b26b700 1 -- 172.21.15.5:0/3336876394 --> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fcf34114580 con 0x7fcf20039fe0 2024-04-16T14:26:50.791 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:49.940+0000 7fcf29ffb700 1 -- 172.21.15.5:0/3336876394 <== mgr.14160 v2:172.21.15.5:6800/4176454319 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fcf34114580 con 0x7fcf20039fe0 2024-04-16T14:26:50.791 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:49.940+0000 7fcf3b26b700 1 -- 172.21.15.5:0/3336876394 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fcf20039fe0 msgr2=0x7fcf2003c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:50.791 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:49.940+0000 7fcf3b26b700 1 --2- 172.21.15.5:0/3336876394 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fcf20039fe0 0x7fcf2003c3c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcf240039d0 tx=0x7fcf24009350 comp rx=0 tx=0).stop 2024-04-16T14:26:50.791 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:49.940+0000 7fcf3b26b700 1 -- 172.21.15.5:0/3336876394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf34078bd0 msgr2=0x7fcf341139b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:50.792 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:49.940+0000 7fcf3b26b700 1 --2- 172.21.15.5:0/3336876394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf34078bd0 0x7fcf341139b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcf30011cf0 tx=0x7fcf30009250 comp rx=0 tx=0).stop 2024-04-16T14:26:50.792 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:49.940+0000 7fcf3b26b700 1 -- 172.21.15.5:0/3336876394 shutdown_connections 2024-04-16T14:26:50.792 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:49.940+0000 7fcf3b26b700 1 --2- 172.21.15.5:0/3336876394 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fcf20039fe0 0x7fcf2003c3c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:50.792 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:49.940+0000 7fcf3b26b700 1 --2- 172.21.15.5:0/3336876394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf34078bd0 0x7fcf341139b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:50.792 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:49.940+0000 7fcf3b26b700 1 --2- 172.21.15.5:0/3336876394 >> [v2:172.21.15.5:6800/4088193218,v1:172.21.15.5:6801/4088193218] conn(0x7fcf20036830 0x7fcf20038ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:50.792 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:49.940+0000 7fcf3b26b700 1 -- 172.21.15.5:0/3336876394 >> 172.21.15.5:0/3336876394 conn(0x7fcf340fe120 msgr2=0x7fcf340fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:50.792 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:49.940+0000 7fcf3b26b700 1 -- 172.21.15.5:0/3336876394 shutdown_connections 2024-04-16T14:26:50.792 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:49.940+0000 7fcf3b26b700 1 -- 172.21.15.5:0/3336876394 wait complete. 2024-04-16T14:26:50.792 INFO:teuthology.orchestra.run.smithi005.stdout:mgr epoch 9 is available 2024-04-16T14:26:50.792 INFO:teuthology.orchestra.run.smithi005.stdout:Generating a dashboard self-signed certificate... 2024-04-16T14:26:52.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:52 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:26:52.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:52 smithi005 ceph-mon[28964]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:26:52.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:52 smithi005 ceph-mon[28964]: mgrmap e12: smithi005.ipwdkc(active, since 2s) 2024-04-16T14:26:52.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:52 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:26:52.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:52 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:26:52.896 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-16T14:26:52.896 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.232+0000 7f353801d700 1 Processor -- start 2024-04-16T14:26:52.896 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.232+0000 7f353801d700 1 -- start start 2024-04-16T14:26:52.896 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.232+0000 7f353801d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3530071270 0x7f3530105510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:52.896 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.232+0000 7f353801d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3530071680 con 0x7f3530071270 2024-04-16T14:26:52.896 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.233+0000 7f3535db9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3530071270 0x7f3530105510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:52.896 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.233+0000 7f3535db9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3530071270 0x7f3530105510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35584/0 (socket says 172.21.15.5:35584) 2024-04-16T14:26:52.896 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.233+0000 7f3535db9700 1 -- 172.21.15.5:0/3486731829 learned_addr learned my addr 172.21.15.5:0/3486731829 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:52.896 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.233+0000 7f3535db9700 1 -- 172.21.15.5:0/3486731829 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3530105a50 con 0x7f3530071270 2024-04-16T14:26:52.896 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.233+0000 7f3535db9700 1 --2- 172.21.15.5:0/3486731829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3530071270 0x7f3530105510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f35200098e0 tx=0x7f3520009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d03b54328dcb57 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:52.896 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.233+0000 7f3534db7700 1 -- 172.21.15.5:0/3486731829 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f352000b860 con 0x7f3530071270 2024-04-16T14:26:52.897 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.233+0000 7f3534db7700 1 -- 172.21.15.5:0/3486731829 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f352000be90 con 0x7f3530071270 2024-04-16T14:26:52.897 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.233+0000 7f3534db7700 1 -- 172.21.15.5:0/3486731829 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35200103c0 con 0x7f3530071270 2024-04-16T14:26:52.897 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.234+0000 7f353801d700 1 -- 172.21.15.5:0/3486731829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3530071270 msgr2=0x7f3530105510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:52.897 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.234+0000 7f353801d700 1 --2- 172.21.15.5:0/3486731829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3530071270 0x7f3530105510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f35200098e0 tx=0x7f3520009250 comp rx=0 tx=0).stop 2024-04-16T14:26:52.897 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.234+0000 7f353801d700 1 -- 172.21.15.5:0/3486731829 shutdown_connections 2024-04-16T14:26:52.897 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.234+0000 7f353801d700 1 --2- 172.21.15.5:0/3486731829 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3530071270 0x7f3530105510 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:52.897 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.234+0000 7f353801d700 1 -- 172.21.15.5:0/3486731829 >> 172.21.15.5:0/3486731829 conn(0x7f35300fcf80 msgr2=0x7f35300ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:52.897 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.234+0000 7f353801d700 1 -- 172.21.15.5:0/3486731829 shutdown_connections 2024-04-16T14:26:52.897 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.234+0000 7f353801d700 1 -- 172.21.15.5:0/3486731829 wait complete. 2024-04-16T14:26:52.897 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.235+0000 7f353801d700 1 Processor -- start 2024-04-16T14:26:52.897 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.235+0000 7f353801d700 1 -- start start 2024-04-16T14:26:52.897 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.235+0000 7f353801d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3530071270 0x7f3530111740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:52.897 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.235+0000 7f353801d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3530111c80 con 0x7f3530071270 2024-04-16T14:26:52.897 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.235+0000 7f3535db9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3530071270 0x7f3530111740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:52.898 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.235+0000 7f3535db9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3530071270 0x7f3530111740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35592/0 (socket says 172.21.15.5:35592) 2024-04-16T14:26:52.898 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.235+0000 7f3535db9700 1 -- 172.21.15.5:0/1653530725 learned_addr learned my addr 172.21.15.5:0/1653530725 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:52.898 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.235+0000 7f3535db9700 1 -- 172.21.15.5:0/1653530725 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35200094f0 con 0x7f3530071270 2024-04-16T14:26:52.898 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.236+0000 7f3535db9700 1 --2- 172.21.15.5:0/1653530725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3530071270 0x7f3530111740 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3520006d40 tx=0x7f3520009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:52.898 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.236+0000 7f35267fc700 1 -- 172.21.15.5:0/1653530725 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3520010840 con 0x7f3530071270 2024-04-16T14:26:52.898 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.236+0000 7f353801d700 1 -- 172.21.15.5:0/1653530725 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3530111e80 con 0x7f3530071270 2024-04-16T14:26:52.898 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.236+0000 7f35267fc700 1 -- 172.21.15.5:0/1653530725 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3520010e70 con 0x7f3530071270 2024-04-16T14:26:52.898 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.236+0000 7f35267fc700 1 -- 172.21.15.5:0/1653530725 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3520024ea0 con 0x7f3530071270 2024-04-16T14:26:52.898 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.236+0000 7f353801d700 1 -- 172.21.15.5:0/1653530725 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35301129f0 con 0x7f3530071270 2024-04-16T14:26:52.898 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.237+0000 7f35267fc700 1 -- 172.21.15.5:0/1653530725 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 43283+0+0 (secure 0 0 0) 0x7f352001a510 con 0x7f3530071270 2024-04-16T14:26:52.898 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.237+0000 7f353801d700 1 -- 172.21.15.5:0/1653530725 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f353005f5f0 con 0x7f3530071270 2024-04-16T14:26:52.898 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.237+0000 7f35267fc700 1 --2- 172.21.15.5:0/1653530725 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f351c036660 0x7f351c038b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:52.898 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.237+0000 7f35267fc700 1 -- 172.21.15.5:0/1653530725 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f352004a660 con 0x7f3530071270 2024-04-16T14:26:52.899 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.237+0000 7f35355b8700 1 --2- 172.21.15.5:0/1653530725 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f351c036660 0x7f351c038b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:52.899 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.238+0000 7f35355b8700 1 --2- 172.21.15.5:0/1653530725 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f351c036660 0x7f351c038b10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f352c009990 tx=0x7f352c006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:52.899 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.242+0000 7f35267fc700 1 -- 172.21.15.5:0/1653530725 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3520018940 con 0x7f3530071270 2024-04-16T14:26:52.899 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.446+0000 7f353801d700 1 -- 172.21.15.5:0/1653530725 --> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f35300fe3b0 con 0x7f351c036660 2024-04-16T14:26:52.899 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.519+0000 7f35267fc700 1 -- 172.21.15.5:0/1653530725 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f3520024780 con 0x7f3530071270 2024-04-16T14:26:52.899 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.591+0000 7f35267fc700 1 -- 172.21.15.5:0/1653530725 <== mgr.14160 v2:172.21.15.5:6800/4176454319 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f35300fe3b0 con 0x7f351c036660 2024-04-16T14:26:52.899 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.593+0000 7f353801d700 1 -- 172.21.15.5:0/1653530725 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f351c036660 msgr2=0x7f351c038b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:52.899 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.593+0000 7f353801d700 1 --2- 172.21.15.5:0/1653530725 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f351c036660 0x7f351c038b10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f352c009990 tx=0x7f352c006e40 comp rx=0 tx=0).stop 2024-04-16T14:26:52.899 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.593+0000 7f353801d700 1 -- 172.21.15.5:0/1653530725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3530071270 msgr2=0x7f3530111740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:52.899 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.593+0000 7f353801d700 1 --2- 172.21.15.5:0/1653530725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3530071270 0x7f3530111740 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3520006d40 tx=0x7f3520009250 comp rx=0 tx=0).stop 2024-04-16T14:26:52.899 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.593+0000 7f353801d700 1 -- 172.21.15.5:0/1653530725 shutdown_connections 2024-04-16T14:26:52.899 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.593+0000 7f353801d700 1 --2- 172.21.15.5:0/1653530725 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f351c036660 0x7f351c038b10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:52.899 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.593+0000 7f353801d700 1 --2- 172.21.15.5:0/1653530725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3530071270 0x7f3530111740 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:52.900 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.593+0000 7f353801d700 1 -- 172.21.15.5:0/1653530725 >> 172.21.15.5:0/1653530725 conn(0x7f35300fcf80 msgr2=0x7f35300fdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:52.900 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.593+0000 7f353801d700 1 -- 172.21.15.5:0/1653530725 shutdown_connections 2024-04-16T14:26:52.900 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:51.593+0000 7f353801d700 1 -- 172.21.15.5:0/1653530725 wait complete. 2024-04-16T14:26:52.900 INFO:teuthology.orchestra.run.smithi005.stdout:Creating initial admin user... 2024-04-16T14:26:54.530 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$KKKdiRacRPdJ1XlT/DYyourwg20hLUxIFEVQmD2XelVS64.7iBlIG", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1713277613, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-16T14:26:54.530 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.308+0000 7f57f9afe700 1 Processor -- start 2024-04-16T14:26:54.530 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.308+0000 7f57f9afe700 1 -- start start 2024-04-16T14:26:54.530 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.308+0000 7f57f9afe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f4102940 0x7f57f4102d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:54.531 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.308+0000 7f57f9afe700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f4103290 con 0x7f57f4102940 2024-04-16T14:26:54.531 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.308+0000 7f57f37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f4102940 0x7f57f4102d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:54.531 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.308+0000 7f57f37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f4102940 0x7f57f4102d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35608/0 (socket says 172.21.15.5:35608) 2024-04-16T14:26:54.531 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.308+0000 7f57f37fe700 1 -- 172.21.15.5:0/1861471439 learned_addr learned my addr 172.21.15.5:0/1861471439 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:54.531 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.309+0000 7f57f37fe700 1 -- 172.21.15.5:0/1861471439 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f41033d0 con 0x7f57f4102940 2024-04-16T14:26:54.531 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.309+0000 7f57f37fe700 1 --2- 172.21.15.5:0/1861471439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f4102940 0x7f57f4102d50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f57e40098e0 tx=0x7f57e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1404ce6e3f3d6e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:54.531 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.309+0000 7f57f27fc700 1 -- 172.21.15.5:0/1861471439 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57e400b860 con 0x7f57f4102940 2024-04-16T14:26:54.531 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.309+0000 7f57f27fc700 1 -- 172.21.15.5:0/1861471439 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f57e400be90 con 0x7f57f4102940 2024-04-16T14:26:54.531 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.309+0000 7f57f27fc700 1 -- 172.21.15.5:0/1861471439 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57e40103c0 con 0x7f57f4102940 2024-04-16T14:26:54.531 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.310+0000 7f57f9afe700 1 -- 172.21.15.5:0/1861471439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f4102940 msgr2=0x7f57f4102d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:54.531 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.310+0000 7f57f9afe700 1 --2- 172.21.15.5:0/1861471439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f4102940 0x7f57f4102d50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f57e40098e0 tx=0x7f57e4009250 comp rx=0 tx=0).stop 2024-04-16T14:26:54.531 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.310+0000 7f57f9afe700 1 -- 172.21.15.5:0/1861471439 shutdown_connections 2024-04-16T14:26:54.531 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.310+0000 7f57f9afe700 1 --2- 172.21.15.5:0/1861471439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f4102940 0x7f57f4102d50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:54.531 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.310+0000 7f57f9afe700 1 -- 172.21.15.5:0/1861471439 >> 172.21.15.5:0/1861471439 conn(0x7f57f40fe0e0 msgr2=0x7f57f41004f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:54.532 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.310+0000 7f57f9afe700 1 -- 172.21.15.5:0/1861471439 shutdown_connections 2024-04-16T14:26:54.532 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.310+0000 7f57f9afe700 1 -- 172.21.15.5:0/1861471439 wait complete. 2024-04-16T14:26:54.532 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.310+0000 7f57f9afe700 1 Processor -- start 2024-04-16T14:26:54.532 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.310+0000 7f57f9afe700 1 -- start start 2024-04-16T14:26:54.532 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.311+0000 7f57f9afe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f4102940 0x7f57f4078c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:54.532 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.311+0000 7f57f9afe700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f4079180 con 0x7f57f4102940 2024-04-16T14:26:54.532 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.311+0000 7f57f37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f4102940 0x7f57f4078c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:54.532 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.311+0000 7f57f37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f4102940 0x7f57f4078c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35614/0 (socket says 172.21.15.5:35614) 2024-04-16T14:26:54.532 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.311+0000 7f57f37fe700 1 -- 172.21.15.5:0/3483216855 learned_addr learned my addr 172.21.15.5:0/3483216855 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:54.532 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.311+0000 7f57f37fe700 1 -- 172.21.15.5:0/3483216855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e40094f0 con 0x7f57f4102940 2024-04-16T14:26:54.532 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.311+0000 7f57f37fe700 1 --2- 172.21.15.5:0/3483216855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f4102940 0x7f57f4078c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f57e4011c10 tx=0x7f57e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:54.532 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.311+0000 7f57ebfff700 1 -- 172.21.15.5:0/3483216855 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57e4010890 con 0x7f57f4102940 2024-04-16T14:26:54.532 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.311+0000 7f57ebfff700 1 -- 172.21.15.5:0/3483216855 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f57e4010ec0 con 0x7f57f4102940 2024-04-16T14:26:54.532 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.311+0000 7f57f9afe700 1 -- 172.21.15.5:0/3483216855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f40771f0 con 0x7f57f4102940 2024-04-16T14:26:54.533 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.311+0000 7f57ebfff700 1 -- 172.21.15.5:0/3483216855 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f57e40243f0 con 0x7f57f4102940 2024-04-16T14:26:54.533 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.311+0000 7f57f9afe700 1 -- 172.21.15.5:0/3483216855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f40776e0 con 0x7f57f4102940 2024-04-16T14:26:54.533 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.312+0000 7f57ebfff700 1 -- 172.21.15.5:0/3483216855 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f57e402d3f0 con 0x7f57f4102940 2024-04-16T14:26:54.533 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.312+0000 7f57f9afe700 1 -- 172.21.15.5:0/3483216855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f404bed0 con 0x7f57f4102940 2024-04-16T14:26:54.533 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.312+0000 7f57ebfff700 1 --2- 172.21.15.5:0/3483216855 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f57e00367e0 0x7f57e0038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:54.533 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.313+0000 7f57ebfff700 1 -- 172.21.15.5:0/3483216855 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f57e404a390 con 0x7f57f4102940 2024-04-16T14:26:54.533 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.313+0000 7f57f2ffd700 1 --2- 172.21.15.5:0/3483216855 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f57e00367e0 0x7f57e0038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:54.533 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.313+0000 7f57f2ffd700 1 --2- 172.21.15.5:0/3483216855 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f57e00367e0 0x7f57e0038c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f57dc009990 tx=0x7f57dc006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:54.533 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.317+0000 7f57ebfff700 1 -- 172.21.15.5:0/3483216855 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f57e402b8e0 con 0x7f57f4102940 2024-04-16T14:26:54.533 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.533+0000 7f57f9afe700 1 -- 172.21.15.5:0/3483216855 --> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f57f405f410 con 0x7f57e00367e0 2024-04-16T14:26:54.534 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.779+0000 7f57ebfff700 1 -- 172.21.15.5:0/3483216855 <== mgr.14160 v2:172.21.15.5:6800/4176454319 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f57f405f410 con 0x7f57e00367e0 2024-04-16T14:26:54.534 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.781+0000 7f57f9afe700 1 -- 172.21.15.5:0/3483216855 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f57e00367e0 msgr2=0x7f57e0038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:54.534 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.781+0000 7f57f9afe700 1 --2- 172.21.15.5:0/3483216855 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f57e00367e0 0x7f57e0038c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f57dc009990 tx=0x7f57dc006e40 comp rx=0 tx=0).stop 2024-04-16T14:26:54.534 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.781+0000 7f57f9afe700 1 -- 172.21.15.5:0/3483216855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f4102940 msgr2=0x7f57f4078c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:54.534 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.781+0000 7f57f9afe700 1 --2- 172.21.15.5:0/3483216855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f4102940 0x7f57f4078c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f57e4011c10 tx=0x7f57e4009250 comp rx=0 tx=0).stop 2024-04-16T14:26:54.534 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.781+0000 7f57f9afe700 1 -- 172.21.15.5:0/3483216855 shutdown_connections 2024-04-16T14:26:54.534 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.781+0000 7f57f9afe700 1 --2- 172.21.15.5:0/3483216855 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f57e00367e0 0x7f57e0038c90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:54.534 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.781+0000 7f57f9afe700 1 --2- 172.21.15.5:0/3483216855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57f4102940 0x7f57f4078c40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:54.534 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.781+0000 7f57f9afe700 1 -- 172.21.15.5:0/3483216855 >> 172.21.15.5:0/3483216855 conn(0x7f57f40fe0e0 msgr2=0x7f57f40fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:54.534 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.781+0000 7f57f9afe700 1 -- 172.21.15.5:0/3483216855 shutdown_connections 2024-04-16T14:26:54.534 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:53.781+0000 7f57f9afe700 1 -- 172.21.15.5:0/3483216855 wait complete. 2024-04-16T14:26:54.534 INFO:teuthology.orchestra.run.smithi005.stdout:Fetching dashboard port number... 2024-04-16T14:26:55.113 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:54 smithi005 ceph-mon[28964]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:26:55.113 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:54 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:26:55.678 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 8443 2024-04-16T14:26:55.678 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.911+0000 7f21c64c0700 1 Processor -- start 2024-04-16T14:26:55.678 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.911+0000 7f21c64c0700 1 -- start start 2024-04-16T14:26:55.679 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.911+0000 7f21c64c0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c0101d90 0x7f21c01021a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:55.679 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.911+0000 7f21c64c0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c01026e0 con 0x7f21c0101d90 2024-04-16T14:26:55.679 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.911+0000 7f21bffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c0101d90 0x7f21c01021a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:55.679 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.911+0000 7f21bffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c0101d90 0x7f21c01021a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35620/0 (socket says 172.21.15.5:35620) 2024-04-16T14:26:55.679 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.911+0000 7f21bffff700 1 -- 172.21.15.5:0/3400442619 learned_addr learned my addr 172.21.15.5:0/3400442619 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:55.679 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.912+0000 7f21bffff700 1 -- 172.21.15.5:0/3400442619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c0102820 con 0x7f21c0101d90 2024-04-16T14:26:55.679 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.912+0000 7f21bffff700 1 --2- 172.21.15.5:0/3400442619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c0101d90 0x7f21c01021a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f21b00098e0 tx=0x7f21b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe4613875c55c61 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:55.679 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.912+0000 7f21beffd700 1 -- 172.21.15.5:0/3400442619 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f21b000b860 con 0x7f21c0101d90 2024-04-16T14:26:55.679 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.912+0000 7f21beffd700 1 -- 172.21.15.5:0/3400442619 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f21b000be90 con 0x7f21c0101d90 2024-04-16T14:26:55.680 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.912+0000 7f21beffd700 1 -- 172.21.15.5:0/3400442619 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f21b00103c0 con 0x7f21c0101d90 2024-04-16T14:26:55.680 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.913+0000 7f21c64c0700 1 -- 172.21.15.5:0/3400442619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c0101d90 msgr2=0x7f21c01021a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:55.680 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.913+0000 7f21c64c0700 1 --2- 172.21.15.5:0/3400442619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c0101d90 0x7f21c01021a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f21b00098e0 tx=0x7f21b0009250 comp rx=0 tx=0).stop 2024-04-16T14:26:55.680 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.913+0000 7f21c64c0700 1 -- 172.21.15.5:0/3400442619 shutdown_connections 2024-04-16T14:26:55.680 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.913+0000 7f21c64c0700 1 --2- 172.21.15.5:0/3400442619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c0101d90 0x7f21c01021a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:55.680 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.913+0000 7f21c64c0700 1 -- 172.21.15.5:0/3400442619 >> 172.21.15.5:0/3400442619 conn(0x7f21c00fc740 msgr2=0x7f21c00feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:55.680 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.913+0000 7f21c64c0700 1 -- 172.21.15.5:0/3400442619 shutdown_connections 2024-04-16T14:26:55.680 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.913+0000 7f21c64c0700 1 -- 172.21.15.5:0/3400442619 wait complete. 2024-04-16T14:26:55.680 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.913+0000 7f21c64c0700 1 Processor -- start 2024-04-16T14:26:55.680 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.913+0000 7f21c64c0700 1 -- start start 2024-04-16T14:26:55.680 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.914+0000 7f21c64c0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c0101d90 0x7f21c01117c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:55.681 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.914+0000 7f21c64c0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c0111d00 con 0x7f21c0101d90 2024-04-16T14:26:55.681 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.914+0000 7f21bffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c0101d90 0x7f21c01117c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:55.681 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.914+0000 7f21bffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c0101d90 0x7f21c01117c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35632/0 (socket says 172.21.15.5:35632) 2024-04-16T14:26:55.681 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.914+0000 7f21bffff700 1 -- 172.21.15.5:0/3153368544 learned_addr learned my addr 172.21.15.5:0/3153368544 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:55.681 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.914+0000 7f21bffff700 1 -- 172.21.15.5:0/3153368544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b00094f0 con 0x7f21c0101d90 2024-04-16T14:26:55.681 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.914+0000 7f21bffff700 1 --2- 172.21.15.5:0/3153368544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c0101d90 0x7f21c01117c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f21b0011c10 tx=0x7f21b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:55.681 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.914+0000 7f21bcff9700 1 -- 172.21.15.5:0/3153368544 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f21b0010890 con 0x7f21c0101d90 2024-04-16T14:26:55.681 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.914+0000 7f21bcff9700 1 -- 172.21.15.5:0/3153368544 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f21b0010ec0 con 0x7f21c0101d90 2024-04-16T14:26:55.681 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.914+0000 7f21c64c0700 1 -- 172.21.15.5:0/3153368544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c0111f00 con 0x7f21c0101d90 2024-04-16T14:26:55.681 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.914+0000 7f21bcff9700 1 -- 172.21.15.5:0/3153368544 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f21b00243f0 con 0x7f21c0101d90 2024-04-16T14:26:55.682 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.914+0000 7f21c64c0700 1 -- 172.21.15.5:0/3153368544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c0112a70 con 0x7f21c0101d90 2024-04-16T14:26:55.682 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.915+0000 7f21bcff9700 1 -- 172.21.15.5:0/3153368544 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f21b002d3f0 con 0x7f21c0101d90 2024-04-16T14:26:55.682 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.915+0000 7f21c64c0700 1 -- 172.21.15.5:0/3153368544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c005f5f0 con 0x7f21c0101d90 2024-04-16T14:26:55.682 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.915+0000 7f21bcff9700 1 --2- 172.21.15.5:0/3153368544 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f21a80367e0 0x7f21a8038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:55.682 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.915+0000 7f21bcff9700 1 -- 172.21.15.5:0/3153368544 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f21b004a3b0 con 0x7f21c0101d90 2024-04-16T14:26:55.682 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.915+0000 7f21bf7fe700 1 --2- 172.21.15.5:0/3153368544 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f21a80367e0 0x7f21a8038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:55.682 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.916+0000 7f21bf7fe700 1 --2- 172.21.15.5:0/3153368544 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f21a80367e0 0x7f21a8038c90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009990 tx=0x7f21b4006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:55.682 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:54.920+0000 7f21bcff9700 1 -- 172.21.15.5:0/3153368544 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f21b002b8e0 con 0x7f21c0101d90 2024-04-16T14:26:55.682 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:55.115+0000 7f21c64c0700 1 -- 172.21.15.5:0/3153368544 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f21c004bed0 con 0x7f21c0101d90 2024-04-16T14:26:55.683 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:55.116+0000 7f21bcff9700 1 -- 172.21.15.5:0/3153368544 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f21b002b2f0 con 0x7f21c0101d90 2024-04-16T14:26:55.683 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:55.118+0000 7f21c64c0700 1 -- 172.21.15.5:0/3153368544 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f21a80367e0 msgr2=0x7f21a8038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:55.683 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:55.118+0000 7f21c64c0700 1 --2- 172.21.15.5:0/3153368544 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f21a80367e0 0x7f21a8038c90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009990 tx=0x7f21b4006e40 comp rx=0 tx=0).stop 2024-04-16T14:26:55.683 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:55.118+0000 7f21c64c0700 1 -- 172.21.15.5:0/3153368544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c0101d90 msgr2=0x7f21c01117c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:55.683 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:55.118+0000 7f21c64c0700 1 --2- 172.21.15.5:0/3153368544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c0101d90 0x7f21c01117c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f21b0011c10 tx=0x7f21b0009250 comp rx=0 tx=0).stop 2024-04-16T14:26:55.683 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:55.118+0000 7f21c64c0700 1 -- 172.21.15.5:0/3153368544 shutdown_connections 2024-04-16T14:26:55.683 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:55.118+0000 7f21c64c0700 1 --2- 172.21.15.5:0/3153368544 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f21a80367e0 0x7f21a8038c90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:55.683 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:55.118+0000 7f21c64c0700 1 --2- 172.21.15.5:0/3153368544 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c0101d90 0x7f21c01117c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:55.683 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:55.118+0000 7f21c64c0700 1 -- 172.21.15.5:0/3153368544 >> 172.21.15.5:0/3153368544 conn(0x7f21c00fc740 msgr2=0x7f21c00fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:55.683 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:55.118+0000 7f21c64c0700 1 -- 172.21.15.5:0/3153368544 shutdown_connections 2024-04-16T14:26:55.683 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:55.118+0000 7f21c64c0700 1 -- 172.21.15.5:0/3153368544 wait complete. 2024-04-16T14:26:55.685 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-16T14:26:55.685 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2024-04-16T14:26:55.693 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-16T14:26:55.693 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-04-16T14:26:55.693 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2024-04-16T14:26:55.693 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-16T14:26:55.694 INFO:teuthology.orchestra.run.smithi005.stdout:Ceph Dashboard is now available at: 2024-04-16T14:26:55.694 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:26:55.694 INFO:teuthology.orchestra.run.smithi005.stdout: URL: https://smithi005.front.sepia.ceph.com:8443/ 2024-04-16T14:26:55.694 INFO:teuthology.orchestra.run.smithi005.stdout: User: admin 2024-04-16T14:26:55.695 INFO:teuthology.orchestra.run.smithi005.stdout: Password: iwtvw2r8vz 2024-04-16T14:26:55.695 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:26:55.695 INFO:teuthology.orchestra.run.smithi005.stdout:Saving cluster configuration to /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config directory 2024-04-16T14:26:55.695 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling autotune for osd_memory_target 2024-04-16T14:26:55.923 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:55 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/3153368544' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-16T14:26:56.959 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:56 smithi005 ceph-mon[28964]: mgrmap e13: smithi005.ipwdkc(active, since 6s) 2024-04-16T14:26:56.968 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.146+0000 7f288bff2700 1 Processor -- start 2024-04-16T14:26:56.969 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.147+0000 7f288bff2700 1 -- start start 2024-04-16T14:26:56.969 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.147+0000 7f288bff2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2884102930 0x7f2884102d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:56.969 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.147+0000 7f288bff2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2884103280 con 0x7f2884102930 2024-04-16T14:26:56.969 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.147+0000 7f2889d8e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2884102930 0x7f2884102d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:56.969 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.147+0000 7f2889d8e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2884102930 0x7f2884102d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35636/0 (socket says 172.21.15.5:35636) 2024-04-16T14:26:56.969 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.147+0000 7f2889d8e700 1 -- 172.21.15.5:0/997270736 learned_addr learned my addr 172.21.15.5:0/997270736 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:56.969 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.147+0000 7f2889d8e700 1 -- 172.21.15.5:0/997270736 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28841033c0 con 0x7f2884102930 2024-04-16T14:26:56.969 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.148+0000 7f2889d8e700 1 --2- 172.21.15.5:0/997270736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2884102930 0x7f2884102d40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f28800098e0 tx=0x7f2880009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c44a7db0dd10fd server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:56.969 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.148+0000 7f2888d8c700 1 -- 172.21.15.5:0/997270736 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f288000b860 con 0x7f2884102930 2024-04-16T14:26:56.969 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.148+0000 7f2888d8c700 1 -- 172.21.15.5:0/997270736 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f288000be90 con 0x7f2884102930 2024-04-16T14:26:56.970 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.148+0000 7f2888d8c700 1 -- 172.21.15.5:0/997270736 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28800103c0 con 0x7f2884102930 2024-04-16T14:26:56.970 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.148+0000 7f288bff2700 1 -- 172.21.15.5:0/997270736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2884102930 msgr2=0x7f2884102d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:56.970 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.148+0000 7f288bff2700 1 --2- 172.21.15.5:0/997270736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2884102930 0x7f2884102d40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f28800098e0 tx=0x7f2880009250 comp rx=0 tx=0).stop 2024-04-16T14:26:56.970 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.148+0000 7f288bff2700 1 -- 172.21.15.5:0/997270736 shutdown_connections 2024-04-16T14:26:56.970 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.148+0000 7f288bff2700 1 --2- 172.21.15.5:0/997270736 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2884102930 0x7f2884102d40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:56.970 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.148+0000 7f288bff2700 1 -- 172.21.15.5:0/997270736 >> 172.21.15.5:0/997270736 conn(0x7f28840fe0d0 msgr2=0x7f28841004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:56.970 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.149+0000 7f288bff2700 1 -- 172.21.15.5:0/997270736 shutdown_connections 2024-04-16T14:26:56.970 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.149+0000 7f288bff2700 1 -- 172.21.15.5:0/997270736 wait complete. 2024-04-16T14:26:56.970 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.149+0000 7f288bff2700 1 Processor -- start 2024-04-16T14:26:56.970 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.149+0000 7f288bff2700 1 -- start start 2024-04-16T14:26:56.970 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.149+0000 7f288bff2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2884102930 0x7f2884078c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:56.970 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.149+0000 7f288bff2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2884079180 con 0x7f2884102930 2024-04-16T14:26:56.970 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.149+0000 7f2889d8e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2884102930 0x7f2884078c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:56.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.149+0000 7f2889d8e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2884102930 0x7f2884078c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35642/0 (socket says 172.21.15.5:35642) 2024-04-16T14:26:56.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.149+0000 7f2889d8e700 1 -- 172.21.15.5:0/1029287578 learned_addr learned my addr 172.21.15.5:0/1029287578 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:56.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.150+0000 7f2889d8e700 1 -- 172.21.15.5:0/1029287578 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28800094f0 con 0x7f2884102930 2024-04-16T14:26:56.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.150+0000 7f2889d8e700 1 --2- 172.21.15.5:0/1029287578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2884102930 0x7f2884078c40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2880011c10 tx=0x7f2880009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:56.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.150+0000 7f287a7fc700 1 -- 172.21.15.5:0/1029287578 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2880010890 con 0x7f2884102930 2024-04-16T14:26:56.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.150+0000 7f287a7fc700 1 -- 172.21.15.5:0/1029287578 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2880010ec0 con 0x7f2884102930 2024-04-16T14:26:56.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.150+0000 7f288bff2700 1 -- 172.21.15.5:0/1029287578 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28840771f0 con 0x7f2884102930 2024-04-16T14:26:56.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.150+0000 7f287a7fc700 1 -- 172.21.15.5:0/1029287578 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28800243f0 con 0x7f2884102930 2024-04-16T14:26:56.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.150+0000 7f288bff2700 1 -- 172.21.15.5:0/1029287578 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28840776e0 con 0x7f2884102930 2024-04-16T14:26:56.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.151+0000 7f287a7fc700 1 -- 172.21.15.5:0/1029287578 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 43431+0+0 (secure 0 0 0) 0x7f288001a430 con 0x7f2884102930 2024-04-16T14:26:56.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.151+0000 7f288bff2700 1 -- 172.21.15.5:0/1029287578 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f288404bed0 con 0x7f2884102930 2024-04-16T14:26:56.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.151+0000 7f287a7fc700 1 --2- 172.21.15.5:0/1029287578 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f28700368d0 0x7f2870038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:56.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.151+0000 7f287a7fc700 1 -- 172.21.15.5:0/1029287578 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f288004a4b0 con 0x7f2884102930 2024-04-16T14:26:56.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.151+0000 7f288958d700 1 --2- 172.21.15.5:0/1029287578 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f28700368d0 0x7f2870038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:56.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.152+0000 7f288958d700 1 --2- 172.21.15.5:0/1029287578 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f28700368d0 0x7f2870038d80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2874009990 tx=0x7f2874006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:56.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.156+0000 7f287a7fc700 1 -- 172.21.15.5:0/1029287578 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f288002b8e0 con 0x7f2884102930 2024-04-16T14:26:56.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.354+0000 7f288bff2700 1 -- 172.21.15.5:0/1029287578 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f2884104680 con 0x7f2884102930 2024-04-16T14:26:56.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.355+0000 7f287a7fc700 1 -- 172.21.15.5:0/1029287578 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f288002b2f0 con 0x7f2884102930 2024-04-16T14:26:56.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.357+0000 7f288bff2700 1 -- 172.21.15.5:0/1029287578 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f28700368d0 msgr2=0x7f2870038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:56.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.357+0000 7f288bff2700 1 --2- 172.21.15.5:0/1029287578 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f28700368d0 0x7f2870038d80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2874009990 tx=0x7f2874006e40 comp rx=0 tx=0).stop 2024-04-16T14:26:56.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.357+0000 7f288bff2700 1 -- 172.21.15.5:0/1029287578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2884102930 msgr2=0x7f2884078c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:56.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.357+0000 7f288bff2700 1 --2- 172.21.15.5:0/1029287578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2884102930 0x7f2884078c40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2880011c10 tx=0x7f2880009250 comp rx=0 tx=0).stop 2024-04-16T14:26:56.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.357+0000 7f288bff2700 1 -- 172.21.15.5:0/1029287578 shutdown_connections 2024-04-16T14:26:56.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.357+0000 7f288bff2700 1 --2- 172.21.15.5:0/1029287578 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f28700368d0 0x7f2870038d80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:56.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.357+0000 7f288bff2700 1 --2- 172.21.15.5:0/1029287578 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2884102930 0x7f2884078c40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:56.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.357+0000 7f288bff2700 1 -- 172.21.15.5:0/1029287578 >> 172.21.15.5:0/1029287578 conn(0x7f28840fe0d0 msgr2=0x7f28840fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:56.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.357+0000 7f288bff2700 1 -- 172.21.15.5:0/1029287578 shutdown_connections 2024-04-16T14:26:56.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:56.357+0000 7f288bff2700 1 -- 172.21.15.5:0/1029287578 wait complete. 2024-04-16T14:26:58.317 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.421+0000 7f9458c9c700 1 Processor -- start 2024-04-16T14:26:58.317 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.421+0000 7f9458c9c700 1 -- start start 2024-04-16T14:26:58.317 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.421+0000 7f9458c9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9454071250 0x7f9454105530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:58.318 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.421+0000 7f9458c9c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9454071660 con 0x7f9454071250 2024-04-16T14:26:58.318 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.422+0000 7f945259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9454071250 0x7f9454105530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:58.318 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.422+0000 7f945259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9454071250 0x7f9454105530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35646/0 (socket says 172.21.15.5:35646) 2024-04-16T14:26:58.318 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.422+0000 7f945259c700 1 -- 172.21.15.5:0/3941475781 learned_addr learned my addr 172.21.15.5:0/3941475781 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:58.318 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.422+0000 7f945259c700 1 -- 172.21.15.5:0/3941475781 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9454105a70 con 0x7f9454071250 2024-04-16T14:26:58.318 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.422+0000 7f945259c700 1 --2- 172.21.15.5:0/3941475781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9454071250 0x7f9454105530 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9444009e50 tx=0x7f9444009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc743e44f57a1d71 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:58.318 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.422+0000 7f945159a700 1 -- 172.21.15.5:0/3941475781 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f94440092e0 con 0x7f9454071250 2024-04-16T14:26:58.318 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.422+0000 7f945159a700 1 -- 172.21.15.5:0/3941475781 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9444012430 con 0x7f9454071250 2024-04-16T14:26:58.318 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.422+0000 7f945159a700 1 -- 172.21.15.5:0/3941475781 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f94440075a0 con 0x7f9454071250 2024-04-16T14:26:58.318 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.423+0000 7f9458c9c700 1 -- 172.21.15.5:0/3941475781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9454071250 msgr2=0x7f9454105530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:58.318 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.423+0000 7f9458c9c700 1 --2- 172.21.15.5:0/3941475781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9454071250 0x7f9454105530 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9444009e50 tx=0x7f9444009840 comp rx=0 tx=0).stop 2024-04-16T14:26:58.318 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.423+0000 7f9458c9c700 1 -- 172.21.15.5:0/3941475781 shutdown_connections 2024-04-16T14:26:58.318 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.423+0000 7f9458c9c700 1 --2- 172.21.15.5:0/3941475781 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9454071250 0x7f9454105530 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:58.319 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.423+0000 7f9458c9c700 1 -- 172.21.15.5:0/3941475781 >> 172.21.15.5:0/3941475781 conn(0x7f94540fcf80 msgr2=0x7f94540ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:58.319 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.423+0000 7f9458c9c700 1 -- 172.21.15.5:0/3941475781 shutdown_connections 2024-04-16T14:26:58.319 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.423+0000 7f9458c9c700 1 -- 172.21.15.5:0/3941475781 wait complete. 2024-04-16T14:26:58.319 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.424+0000 7f9458c9c700 1 Processor -- start 2024-04-16T14:26:58.319 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.424+0000 7f9458c9c700 1 -- start start 2024-04-16T14:26:58.319 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.424+0000 7f9458c9c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9454071250 0x7f9454111720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:58.319 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.424+0000 7f9458c9c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9454111c60 con 0x7f9454071250 2024-04-16T14:26:58.319 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.424+0000 7f945259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9454071250 0x7f9454111720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:58.319 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.424+0000 7f945259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9454071250 0x7f9454111720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35652/0 (socket says 172.21.15.5:35652) 2024-04-16T14:26:58.319 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.424+0000 7f945259c700 1 -- 172.21.15.5:0/819442501 learned_addr learned my addr 172.21.15.5:0/819442501 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:26:58.319 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.424+0000 7f945259c700 1 -- 172.21.15.5:0/819442501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9444009ae0 con 0x7f9454071250 2024-04-16T14:26:58.320 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.424+0000 7f945259c700 1 --2- 172.21.15.5:0/819442501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9454071250 0x7f9454111720 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9444012f20 tx=0x7f9444009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:58.320 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.424+0000 7f944affd700 1 -- 172.21.15.5:0/819442501 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f94440092e0 con 0x7f9454071250 2024-04-16T14:26:58.320 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.424+0000 7f944affd700 1 -- 172.21.15.5:0/819442501 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9444007d30 con 0x7f9454071250 2024-04-16T14:26:58.320 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.425+0000 7f9458c9c700 1 -- 172.21.15.5:0/819442501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9454111e60 con 0x7f9454071250 2024-04-16T14:26:58.320 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.425+0000 7f944affd700 1 -- 172.21.15.5:0/819442501 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9444025a00 con 0x7f9454071250 2024-04-16T14:26:58.320 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.425+0000 7f9458c9c700 1 -- 172.21.15.5:0/819442501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94541129d0 con 0x7f9454071250 2024-04-16T14:26:58.320 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.425+0000 7f944affd700 1 -- 172.21.15.5:0/819442501 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 43431+0+0 (secure 0 0 0) 0x7f9444019050 con 0x7f9454071250 2024-04-16T14:26:58.320 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.425+0000 7f9458c9c700 1 -- 172.21.15.5:0/819442501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f945405f5f0 con 0x7f9454071250 2024-04-16T14:26:58.320 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.426+0000 7f944affd700 1 --2- 172.21.15.5:0/819442501 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f9440036880 0x7f9440038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:26:58.320 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.426+0000 7f944affd700 1 -- 172.21.15.5:0/819442501 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f944404a1f0 con 0x7f9454071250 2024-04-16T14:26:58.320 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.426+0000 7f9451d9b700 1 --2- 172.21.15.5:0/819442501 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f9440036880 0x7f9440038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:26:58.320 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.426+0000 7f9451d9b700 1 --2- 172.21.15.5:0/819442501 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f9440036880 0x7f9440038d30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f943c009990 tx=0x7f943c006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:26:58.320 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.430+0000 7f944affd700 1 -- 172.21.15.5:0/819442501 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9444011570 con 0x7f9454071250 2024-04-16T14:26:58.321 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.733+0000 7f9458c9c700 1 -- 172.21.15.5:0/819442501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f945404bed0 con 0x7f9454071250 2024-04-16T14:26:58.321 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.735+0000 7f944affd700 1 -- 172.21.15.5:0/819442501 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7f9444020020 con 0x7f9454071250 2024-04-16T14:26:58.321 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.737+0000 7f9458c9c700 1 -- 172.21.15.5:0/819442501 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f9440036880 msgr2=0x7f9440038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:58.321 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.737+0000 7f9458c9c700 1 --2- 172.21.15.5:0/819442501 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f9440036880 0x7f9440038d30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f943c009990 tx=0x7f943c006e40 comp rx=0 tx=0).stop 2024-04-16T14:26:58.321 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.737+0000 7f9458c9c700 1 -- 172.21.15.5:0/819442501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9454071250 msgr2=0x7f9454111720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:26:58.321 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.737+0000 7f9458c9c700 1 --2- 172.21.15.5:0/819442501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9454071250 0x7f9454111720 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9444012f20 tx=0x7f9444009840 comp rx=0 tx=0).stop 2024-04-16T14:26:58.321 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.737+0000 7f9458c9c700 1 -- 172.21.15.5:0/819442501 shutdown_connections 2024-04-16T14:26:58.321 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.737+0000 7f9458c9c700 1 --2- 172.21.15.5:0/819442501 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f9440036880 0x7f9440038d30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:58.321 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.737+0000 7f9458c9c700 1 --2- 172.21.15.5:0/819442501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9454071250 0x7f9454111720 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:26:58.321 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.737+0000 7f9458c9c700 1 -- 172.21.15.5:0/819442501 >> 172.21.15.5:0/819442501 conn(0x7f94540fcf80 msgr2=0x7f94540fdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:26:58.321 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.737+0000 7f9458c9c700 1 -- 172.21.15.5:0/819442501 shutdown_connections 2024-04-16T14:26:58.321 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-04-16T14:26:57.737+0000 7f9458c9c700 1 -- 172.21.15.5:0/819442501 wait complete. 2024-04-16T14:26:58.321 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-16T14:26:58.321 INFO:teuthology.orchestra.run.smithi005.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-16T14:26:58.322 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:26:58.322 INFO:teuthology.orchestra.run.smithi005.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-16T14:26:58.322 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:26:58.322 INFO:teuthology.orchestra.run.smithi005.stdout:Or, if you are only running a single cluster on this host: 2024-04-16T14:26:58.322 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:26:58.322 INFO:teuthology.orchestra.run.smithi005.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-16T14:26:58.322 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:26:58.322 INFO:teuthology.orchestra.run.smithi005.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-16T14:26:58.322 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:26:58.322 INFO:teuthology.orchestra.run.smithi005.stdout: ceph telemetry on 2024-04-16T14:26:58.322 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:26:58.322 INFO:teuthology.orchestra.run.smithi005.stdout:For more information see: 2024-04-16T14:26:58.322 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:26:58.322 INFO:teuthology.orchestra.run.smithi005.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-04-16T14:26:58.323 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:26:58.323 INFO:teuthology.orchestra.run.smithi005.stdout:Bootstrap complete. 2024-04-16T14:26:58.355 INFO:tasks.cephadm:Fetching config... 2024-04-16T14:26:58.356 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-16T14:26:58.356 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-16T14:26:58.373 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-16T14:26:58.374 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-16T14:26:58.374 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-16T14:26:58.430 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-16T14:26:58.430 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-16T14:26:58.430 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/keyring of=/dev/stdout 2024-04-16T14:26:58.497 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-16T14:26:58.498 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-16T14:26:58.498 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-16T14:26:58.553 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-16T14:26:58.553 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1Jt416Z33HdgIdgd6QjBfA+1jjCzvJb0vVUEmQZK5m8Xr47B9ZpthKFUKnKQYIRvFzNP6oAg7FvyaTfWsCymflrhKewVSmn9otdUTmVZqroB5KWaGb5XpuS97WUyhtUUAPEpvm/P1MVYFwSfCDpW8tX8ItfJmAmyI/t5wzXj/YnCUrdlCWaNzIR0ADoTjo7V6ee4DYVyg1twDaGVS6IMYAIQFB8dJHH/zZWvpHif6pMw2s0OnUb2GKFTZeiffWhLQGLocns+9aVQpBpArNodV9NPCKNN6dso0+OPnFGYxgeEdJaeFJTd31LeN3Y3s9lh6/u+hI/vxTamYNfkWdXDH/rDfF0vNzQWvsgDH1sWlToS3NgkMyOA41F8CCVKrD+sk6Q+r+LiRn9mRUABgbcOQeKcA/Q/+KcoMRxrXkpgdL0GMUQX9G+tXFivVNJ3b53B0tAp19E/juM9eionkP90amv/EKLAU8N/tQAGeTO7WAJpZmFdSv67af9g4aEDrX4U= ceph-10609bfa-fbfd-11ee-bc90-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-16T14:26:58.636 INFO:teuthology.orchestra.run.smithi005.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1Jt416Z33HdgIdgd6QjBfA+1jjCzvJb0vVUEmQZK5m8Xr47B9ZpthKFUKnKQYIRvFzNP6oAg7FvyaTfWsCymflrhKewVSmn9otdUTmVZqroB5KWaGb5XpuS97WUyhtUUAPEpvm/P1MVYFwSfCDpW8tX8ItfJmAmyI/t5wzXj/YnCUrdlCWaNzIR0ADoTjo7V6ee4DYVyg1twDaGVS6IMYAIQFB8dJHH/zZWvpHif6pMw2s0OnUb2GKFTZeiffWhLQGLocns+9aVQpBpArNodV9NPCKNN6dso0+OPnFGYxgeEdJaeFJTd31LeN3Y3s9lh6/u+hI/vxTamYNfkWdXDH/rDfF0vNzQWvsgDH1sWlToS3NgkMyOA41F8CCVKrD+sk6Q+r+LiRn9mRUABgbcOQeKcA/Q/+KcoMRxrXkpgdL0GMUQX9G+tXFivVNJ3b53B0tAp19E/juM9eionkP90amv/EKLAU8N/tQAGeTO7WAJpZmFdSv67af9g4aEDrX4U= ceph-10609bfa-fbfd-11ee-bc90-c7b262605968 2024-04-16T14:26:58.650 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1Jt416Z33HdgIdgd6QjBfA+1jjCzvJb0vVUEmQZK5m8Xr47B9ZpthKFUKnKQYIRvFzNP6oAg7FvyaTfWsCymflrhKewVSmn9otdUTmVZqroB5KWaGb5XpuS97WUyhtUUAPEpvm/P1MVYFwSfCDpW8tX8ItfJmAmyI/t5wzXj/YnCUrdlCWaNzIR0ADoTjo7V6ee4DYVyg1twDaGVS6IMYAIQFB8dJHH/zZWvpHif6pMw2s0OnUb2GKFTZeiffWhLQGLocns+9aVQpBpArNodV9NPCKNN6dso0+OPnFGYxgeEdJaeFJTd31LeN3Y3s9lh6/u+hI/vxTamYNfkWdXDH/rDfF0vNzQWvsgDH1sWlToS3NgkMyOA41F8CCVKrD+sk6Q+r+LiRn9mRUABgbcOQeKcA/Q/+KcoMRxrXkpgdL0GMUQX9G+tXFivVNJ3b53B0tAp19E/juM9eionkP90amv/EKLAU8N/tQAGeTO7WAJpZmFdSv67af9g4aEDrX4U= ceph-10609bfa-fbfd-11ee-bc90-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-16T14:26:58.698 INFO:teuthology.orchestra.run.smithi115.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1Jt416Z33HdgIdgd6QjBfA+1jjCzvJb0vVUEmQZK5m8Xr47B9ZpthKFUKnKQYIRvFzNP6oAg7FvyaTfWsCymflrhKewVSmn9otdUTmVZqroB5KWaGb5XpuS97WUyhtUUAPEpvm/P1MVYFwSfCDpW8tX8ItfJmAmyI/t5wzXj/YnCUrdlCWaNzIR0ADoTjo7V6ee4DYVyg1twDaGVS6IMYAIQFB8dJHH/zZWvpHif6pMw2s0OnUb2GKFTZeiffWhLQGLocns+9aVQpBpArNodV9NPCKNN6dso0+OPnFGYxgeEdJaeFJTd31LeN3Y3s9lh6/u+hI/vxTamYNfkWdXDH/rDfF0vNzQWvsgDH1sWlToS3NgkMyOA41F8CCVKrD+sk6Q+r+LiRn9mRUABgbcOQeKcA/Q/+KcoMRxrXkpgdL0GMUQX9G+tXFivVNJ3b53B0tAp19E/juM9eionkP90amv/EKLAU8N/tQAGeTO7WAJpZmFdSv67af9g4aEDrX4U= ceph-10609bfa-fbfd-11ee-bc90-c7b262605968 2024-04-16T14:26:58.714 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-16T14:26:58.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:26:58 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/819442501' entity='client.admin' 2024-04-16T14:26:58.980 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:27:01.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.152+0000 7fc4e0f4b700 1 -- 172.21.15.5:0/1787180154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4dc0fca70 msgr2=0x7fc4dc0fce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:01.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.152+0000 7fc4e0f4b700 1 --2- 172.21.15.5:0/1787180154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4dc0fca70 0x7fc4dc0fce80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc009c60 tx=0x7fc4cc004d10 comp rx=0 tx=0).stop 2024-04-16T14:27:01.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.152+0000 7fc4e0f4b700 1 -- 172.21.15.5:0/1787180154 shutdown_connections 2024-04-16T14:27:01.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.152+0000 7fc4e0f4b700 1 --2- 172.21.15.5:0/1787180154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4dc0fca70 0x7fc4dc0fce80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:01.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.152+0000 7fc4e0f4b700 1 -- 172.21.15.5:0/1787180154 >> 172.21.15.5:0/1787180154 conn(0x7fc4dc0f81d0 msgr2=0x7fc4dc0fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:01.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.152+0000 7fc4e0f4b700 1 -- 172.21.15.5:0/1787180154 shutdown_connections 2024-04-16T14:27:01.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.152+0000 7fc4e0f4b700 1 -- 172.21.15.5:0/1787180154 wait complete. 2024-04-16T14:27:01.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.153+0000 7fc4e0f4b700 1 Processor -- start 2024-04-16T14:27:01.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.153+0000 7fc4e0f4b700 1 -- start start 2024-04-16T14:27:01.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.153+0000 7fc4e0f4b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4dc0fca70 0x7fc4dc10d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:01.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.153+0000 7fc4e0f4b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc10d5e0 con 0x7fc4dc0fca70 2024-04-16T14:27:01.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.153+0000 7fc4da59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4dc0fca70 0x7fc4dc10d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:01.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.153+0000 7fc4da59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4dc0fca70 0x7fc4dc10d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45932/0 (socket says 172.21.15.5:45932) 2024-04-16T14:27:01.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.153+0000 7fc4da59c700 1 -- 172.21.15.5:0/3853663376 learned_addr learned my addr 172.21.15.5:0/3853663376 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:27:01.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.154+0000 7fc4da59c700 1 -- 172.21.15.5:0/3853663376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4cc009940 con 0x7fc4dc0fca70 2024-04-16T14:27:01.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.154+0000 7fc4da59c700 1 --2- 172.21.15.5:0/3853663376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4dc0fca70 0x7fc4dc10d0a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc009500 tx=0x7fc4cc004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:01.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.154+0000 7fc4d37fe700 1 -- 172.21.15.5:0/3853663376 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4cc007c80 con 0x7fc4dc0fca70 2024-04-16T14:27:01.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.154+0000 7fc4d37fe700 1 -- 172.21.15.5:0/3853663376 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc4cc01d910 con 0x7fc4dc0fca70 2024-04-16T14:27:01.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.154+0000 7fc4e0f4b700 1 -- 172.21.15.5:0/3853663376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4dc10d7e0 con 0x7fc4dc0fca70 2024-04-16T14:27:01.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.154+0000 7fc4d37fe700 1 -- 172.21.15.5:0/3853663376 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4cc0129d0 con 0x7fc4dc0fca70 2024-04-16T14:27:01.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.154+0000 7fc4e0f4b700 1 -- 172.21.15.5:0/3853663376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4dc10e350 con 0x7fc4dc0fca70 2024-04-16T14:27:01.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.155+0000 7fc4d37fe700 1 -- 172.21.15.5:0/3853663376 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 43431+0+0 (secure 0 0 0) 0x7fc4cc019040 con 0x7fc4dc0fca70 2024-04-16T14:27:01.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.155+0000 7fc4d37fe700 1 --2- 172.21.15.5:0/3853663376 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fc4c80368d0 0x7fc4c8038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:01.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.155+0000 7fc4d37fe700 1 -- 172.21.15.5:0/3853663376 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc4cc04b2b0 con 0x7fc4dc0fca70 2024-04-16T14:27:01.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.155+0000 7fc4d1d9b700 1 --2- 172.21.15.5:0/3853663376 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fc4c80368d0 0x7fc4c8038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:01.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.155+0000 7fc4e0f4b700 1 -- 172.21.15.5:0/3853663376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4dc102f80 con 0x7fc4dc0fca70 2024-04-16T14:27:01.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.156+0000 7fc4d1d9b700 1 --2- 172.21.15.5:0/3853663376 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fc4c80368d0 0x7fc4c8038d80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009990 tx=0x7fc4c4006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:01.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.160+0000 7fc4d37fe700 1 -- 172.21.15.5:0/3853663376 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc4cc017080 con 0x7fc4dc0fca70 2024-04-16T14:27:01.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.357+0000 7fc4e0f4b700 1 -- 172.21.15.5:0/3853663376 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fc4dc05f5f0 con 0x7fc4dc0fca70 2024-04-16T14:27:01.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.360+0000 7fc4d37fe700 1 -- 172.21.15.5:0/3853663376 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fc4cc021020 con 0x7fc4dc0fca70 2024-04-16T14:27:01.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.362+0000 7fc4e0f4b700 1 -- 172.21.15.5:0/3853663376 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fc4c80368d0 msgr2=0x7fc4c8038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:01.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.362+0000 7fc4e0f4b700 1 --2- 172.21.15.5:0/3853663376 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fc4c80368d0 0x7fc4c8038d80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009990 tx=0x7fc4c4006e40 comp rx=0 tx=0).stop 2024-04-16T14:27:01.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.362+0000 7fc4e0f4b700 1 -- 172.21.15.5:0/3853663376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4dc0fca70 msgr2=0x7fc4dc10d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:01.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.362+0000 7fc4e0f4b700 1 --2- 172.21.15.5:0/3853663376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4dc0fca70 0x7fc4dc10d0a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc009500 tx=0x7fc4cc004d10 comp rx=0 tx=0).stop 2024-04-16T14:27:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.362+0000 7fc4e0f4b700 1 -- 172.21.15.5:0/3853663376 shutdown_connections 2024-04-16T14:27:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.362+0000 7fc4e0f4b700 1 --2- 172.21.15.5:0/3853663376 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fc4c80368d0 0x7fc4c8038d80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.362+0000 7fc4e0f4b700 1 --2- 172.21.15.5:0/3853663376 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4dc0fca70 0x7fc4dc10d0a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.362+0000 7fc4e0f4b700 1 -- 172.21.15.5:0/3853663376 >> 172.21.15.5:0/3853663376 conn(0x7fc4dc0f81d0 msgr2=0x7fc4dc103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.363+0000 7fc4e0f4b700 1 -- 172.21.15.5:0/3853663376 shutdown_connections 2024-04-16T14:27:01.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:01.363+0000 7fc4e0f4b700 1 -- 172.21.15.5:0/3853663376 wait complete. 2024-04-16T14:27:01.932 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-16T14:27:01.933 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-16T14:27:02.209 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:01 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:02.209 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:01 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:02.209 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:01 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd/host:smithi005", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:27:02.210 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:01 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:02.210 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:01 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi005", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-16T14:27:02.210 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:01 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi005", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-16T14:27:02.210 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:01 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:27:02.210 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:01 smithi005 ceph-mon[28964]: Deploying daemon crash.smithi005 on smithi005 2024-04-16T14:27:02.210 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:01 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/3853663376' entity='client.admin' 2024-04-16T14:27:02.271 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:27:05.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.797+0000 7fd999139700 1 -- 172.21.15.5:0/3855109562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd994071e20 msgr2=0x7fd994070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:05.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.797+0000 7fd999139700 1 --2- 172.21.15.5:0/3855109562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd994071e20 0x7fd994070330 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd984009c60 tx=0x7fd984004d10 comp rx=0 tx=0).stop 2024-04-16T14:27:05.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.797+0000 7fd999139700 1 -- 172.21.15.5:0/3855109562 shutdown_connections 2024-04-16T14:27:05.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.797+0000 7fd999139700 1 --2- 172.21.15.5:0/3855109562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd994071e20 0x7fd994070330 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:05.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.797+0000 7fd999139700 1 -- 172.21.15.5:0/3855109562 >> 172.21.15.5:0/3855109562 conn(0x7fd9940f81d0 msgr2=0x7fd9940fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:05.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.797+0000 7fd999139700 1 -- 172.21.15.5:0/3855109562 shutdown_connections 2024-04-16T14:27:05.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.797+0000 7fd999139700 1 -- 172.21.15.5:0/3855109562 wait complete. 2024-04-16T14:27:05.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.798+0000 7fd999139700 1 Processor -- start 2024-04-16T14:27:05.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.798+0000 7fd999139700 1 -- start start 2024-04-16T14:27:05.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.798+0000 7fd999139700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd994071e20 0x7fd99410f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:05.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.798+0000 7fd999139700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd99410f820 con 0x7fd994071e20 2024-04-16T14:27:05.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.798+0000 7fd992d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd994071e20 0x7fd99410f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:05.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.798+0000 7fd992d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd994071e20 0x7fd99410f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45962/0 (socket says 172.21.15.5:45962) 2024-04-16T14:27:05.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.798+0000 7fd992d9d700 1 -- 172.21.15.5:0/768978664 learned_addr learned my addr 172.21.15.5:0/768978664 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:27:05.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.798+0000 7fd992d9d700 1 -- 172.21.15.5:0/768978664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd984009940 con 0x7fd994071e20 2024-04-16T14:27:05.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.798+0000 7fd992d9d700 1 --2- 172.21.15.5:0/768978664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd994071e20 0x7fd99410f2e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd9840097b0 tx=0x7fd984004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:05.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.799+0000 7fd98b7fe700 1 -- 172.21.15.5:0/768978664 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd984012410 con 0x7fd994071e20 2024-04-16T14:27:05.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.799+0000 7fd98b7fe700 1 -- 172.21.15.5:0/768978664 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd984012a40 con 0x7fd994071e20 2024-04-16T14:27:05.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.799+0000 7fd999139700 1 -- 172.21.15.5:0/768978664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd99410fa20 con 0x7fd994071e20 2024-04-16T14:27:05.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.799+0000 7fd98b7fe700 1 -- 172.21.15.5:0/768978664 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd98401b980 con 0x7fd994071e20 2024-04-16T14:27:05.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.799+0000 7fd999139700 1 -- 172.21.15.5:0/768978664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd994110590 con 0x7fd994071e20 2024-04-16T14:27:05.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.799+0000 7fd98b7fe700 1 -- 172.21.15.5:0/768978664 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 43431+0+0 (secure 0 0 0) 0x7fd984019040 con 0x7fd994071e20 2024-04-16T14:27:05.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.800+0000 7fd999139700 1 -- 172.21.15.5:0/768978664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd994105170 con 0x7fd994071e20 2024-04-16T14:27:05.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.800+0000 7fd98b7fe700 1 --2- 172.21.15.5:0/768978664 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fd980036880 0x7fd980038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:05.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.800+0000 7fd98b7fe700 1 -- 172.21.15.5:0/768978664 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fd984049de0 con 0x7fd994071e20 2024-04-16T14:27:05.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.800+0000 7fd99259c700 1 --2- 172.21.15.5:0/768978664 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fd980036880 0x7fd980038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:05.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.800+0000 7fd99259c700 1 --2- 172.21.15.5:0/768978664 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fd980036880 0x7fd980038d30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd97c009990 tx=0x7fd97c006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:05.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:05.804+0000 7fd98b7fe700 1 -- 172.21.15.5:0/768978664 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd984023400 con 0x7fd994071e20 2024-04-16T14:27:06.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:06.004+0000 7fd999139700 1 -- 172.21.15.5:0/768978664 --> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9941107d0 con 0x7fd980036880 2024-04-16T14:27:06.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:06.007+0000 7fd98b7fe700 1 -- 172.21.15.5:0/768978664 <== mgr.14160 v2:172.21.15.5:6800/4176454319 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd9941107d0 con 0x7fd980036880 2024-04-16T14:27:06.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:06.009+0000 7fd999139700 1 -- 172.21.15.5:0/768978664 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fd980036880 msgr2=0x7fd980038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:06.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:06.009+0000 7fd999139700 1 --2- 172.21.15.5:0/768978664 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fd980036880 0x7fd980038d30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd97c009990 tx=0x7fd97c006e40 comp rx=0 tx=0).stop 2024-04-16T14:27:06.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:06.009+0000 7fd999139700 1 -- 172.21.15.5:0/768978664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd994071e20 msgr2=0x7fd99410f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:06.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:06.009+0000 7fd999139700 1 --2- 172.21.15.5:0/768978664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd994071e20 0x7fd99410f2e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd9840097b0 tx=0x7fd984004d10 comp rx=0 tx=0).stop 2024-04-16T14:27:06.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:06.009+0000 7fd999139700 1 -- 172.21.15.5:0/768978664 shutdown_connections 2024-04-16T14:27:06.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:06.009+0000 7fd999139700 1 --2- 172.21.15.5:0/768978664 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fd980036880 0x7fd980038d30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:06.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:06.009+0000 7fd999139700 1 --2- 172.21.15.5:0/768978664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd994071e20 0x7fd99410f2e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:06.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:06.009+0000 7fd999139700 1 -- 172.21.15.5:0/768978664 >> 172.21.15.5:0/768978664 conn(0x7fd9940f81d0 msgr2=0x7fd994105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:06.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:06.009+0000 7fd999139700 1 -- 172.21.15.5:0/768978664 shutdown_connections 2024-04-16T14:27:06.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:06.009+0000 7fd999139700 1 -- 172.21.15.5:0/768978664 wait complete. 2024-04-16T14:27:06.623 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi115 2024-04-16T14:27:06.623 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-16T14:27:06.623 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/etc/ceph/ceph.conf 2024-04-16T14:27:06.642 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-16T14:27:06.642 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-16T14:27:06.700 INFO:tasks.cephadm:Adding host smithi115 to orchestrator... 2024-04-16T14:27:06.701 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph orch host add smithi115 2024-04-16T14:27:07.046 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:27:07.259 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:07 smithi005 ceph-mon[28964]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:27:07.259 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:07 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:07.259 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:07 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:07.259 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:07 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:07.259 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:07 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:07.260 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:07 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:07.260 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:07 smithi005 ceph-mon[28964]: Deploying daemon node-exporter.smithi005 on smithi005 2024-04-16T14:27:08.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.569+0000 7f2013477700 1 -- 172.21.15.5:0/3097938761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f200c0fd040 msgr2=0x7f200c0fd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.569+0000 7f2013477700 1 --2- 172.21.15.5:0/3097938761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f200c0fd040 0x7f200c0fd450 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2004009c60 tx=0x7f2004004d10 comp rx=0 tx=0).stop 2024-04-16T14:27:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.569+0000 7f2013477700 1 -- 172.21.15.5:0/3097938761 shutdown_connections 2024-04-16T14:27:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.569+0000 7f2013477700 1 --2- 172.21.15.5:0/3097938761 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f200c0fd040 0x7f200c0fd450 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.569+0000 7f2013477700 1 -- 172.21.15.5:0/3097938761 >> 172.21.15.5:0/3097938761 conn(0x7f200c0f70c0 msgr2=0x7f200c0f94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.569+0000 7f2013477700 1 -- 172.21.15.5:0/3097938761 shutdown_connections 2024-04-16T14:27:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.569+0000 7f2013477700 1 -- 172.21.15.5:0/3097938761 wait complete. 2024-04-16T14:27:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.570+0000 7f2013477700 1 Processor -- start 2024-04-16T14:27:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.570+0000 7f2013477700 1 -- start start 2024-04-16T14:27:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.570+0000 7f2013477700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f200c0fd040 0x7f200c0664d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.570+0000 7f2013477700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200c10fd40 con 0x7f200c0fd040 2024-04-16T14:27:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.570+0000 7f2011213700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f200c0fd040 0x7f200c0664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.570+0000 7f2011213700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f200c0fd040 0x7f200c0664d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55988/0 (socket says 172.21.15.5:55988) 2024-04-16T14:27:08.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.570+0000 7f2011213700 1 -- 172.21.15.5:0/2388549659 learned_addr learned my addr 172.21.15.5:0/2388549659 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:27:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.570+0000 7f2011213700 1 -- 172.21.15.5:0/2388549659 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2004009940 con 0x7f200c0fd040 2024-04-16T14:27:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.571+0000 7f2011213700 1 --2- 172.21.15.5:0/2388549659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f200c0fd040 0x7f200c0664d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2004009500 tx=0x7f2004004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.571+0000 7f2009ffb700 1 -- 172.21.15.5:0/2388549659 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2004007c80 con 0x7f200c0fd040 2024-04-16T14:27:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.571+0000 7f2009ffb700 1 -- 172.21.15.5:0/2388549659 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f200401d910 con 0x7f200c0fd040 2024-04-16T14:27:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.571+0000 7f2013477700 1 -- 172.21.15.5:0/2388549659 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f200c10fee0 con 0x7f200c0fd040 2024-04-16T14:27:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.571+0000 7f2009ffb700 1 -- 172.21.15.5:0/2388549659 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20040129d0 con 0x7f200c0fd040 2024-04-16T14:27:08.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.571+0000 7f2013477700 1 -- 172.21.15.5:0/2388549659 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f200c110370 con 0x7f200c0fd040 2024-04-16T14:27:08.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.572+0000 7f2009ffb700 1 -- 172.21.15.5:0/2388549659 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 43431+0+0 (secure 0 0 0) 0x7f2004019040 con 0x7f200c0fd040 2024-04-16T14:27:08.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.572+0000 7f2013477700 1 -- 172.21.15.5:0/2388549659 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f200c105910 con 0x7f200c0fd040 2024-04-16T14:27:08.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.572+0000 7f2009ffb700 1 --2- 172.21.15.5:0/2388549659 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f1ff4036880 0x7f1ff4038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:08.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.572+0000 7f2009ffb700 1 -- 172.21.15.5:0/2388549659 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f200404a460 con 0x7f200c0fd040 2024-04-16T14:27:08.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.572+0000 7f2010a12700 1 --2- 172.21.15.5:0/2388549659 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f1ff4036880 0x7f1ff4038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:08.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.572+0000 7f2010a12700 1 --2- 172.21.15.5:0/2388549659 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f1ff4036880 0x7f1ff4038d30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2000009990 tx=0x7f2000006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:08.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.577+0000 7f2009ffb700 1 -- 172.21.15.5:0/2388549659 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2004024310 con 0x7f200c0fd040 2024-04-16T14:27:08.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:08.778+0000 7f2013477700 1 -- 172.21.15.5:0/2388549659 --> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi115", "target": ["mon-mgr", ""]}) v1 -- 0x7f200c02b310 con 0x7f1ff4036880 2024-04-16T14:27:10.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:09 smithi005 ceph-mon[28964]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi115", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:27:10.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:09 smithi005 ceph-mon[28964]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:27:10.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:09 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:11.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:11.010+0000 7f2009ffb700 1 -- 172.21.15.5:0/2388549659 <== mgr.14160 v2:172.21.15.5:6800/4176454319 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f200c02b310 con 0x7f1ff4036880 2024-04-16T14:27:11.008 INFO:teuthology.orchestra.run.smithi005.stdout:Added host 'smithi115' with addr '172.21.15.115' 2024-04-16T14:27:11.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:11.012+0000 7f2013477700 1 -- 172.21.15.5:0/2388549659 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f1ff4036880 msgr2=0x7f1ff4038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:11.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:11.012+0000 7f2013477700 1 --2- 172.21.15.5:0/2388549659 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f1ff4036880 0x7f1ff4038d30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2000009990 tx=0x7f2000006e40 comp rx=0 tx=0).stop 2024-04-16T14:27:11.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:11.012+0000 7f2013477700 1 -- 172.21.15.5:0/2388549659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f200c0fd040 msgr2=0x7f200c0664d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:11.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:11.012+0000 7f2013477700 1 --2- 172.21.15.5:0/2388549659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f200c0fd040 0x7f200c0664d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2004009500 tx=0x7f2004004d10 comp rx=0 tx=0).stop 2024-04-16T14:27:11.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:11.012+0000 7f2013477700 1 -- 172.21.15.5:0/2388549659 shutdown_connections 2024-04-16T14:27:11.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:11.012+0000 7f2013477700 1 --2- 172.21.15.5:0/2388549659 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f1ff4036880 0x7f1ff4038d30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:11.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:11.012+0000 7f2013477700 1 --2- 172.21.15.5:0/2388549659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f200c0fd040 0x7f200c0664d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:11.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:11.012+0000 7f2013477700 1 -- 172.21.15.5:0/2388549659 >> 172.21.15.5:0/2388549659 conn(0x7f200c0f70c0 msgr2=0x7f200c102a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:11.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:11.012+0000 7f2013477700 1 -- 172.21.15.5:0/2388549659 shutdown_connections 2024-04-16T14:27:11.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:11.012+0000 7f2013477700 1 -- 172.21.15.5:0/2388549659 wait complete. 2024-04-16T14:27:11.223 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:10 smithi005 ceph-mon[28964]: Deploying cephadm binary to smithi115 2024-04-16T14:27:11.888 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph orch host ls --format=json 2024-04-16T14:27:12.160 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:27:12.223 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:12 smithi005 ceph-mon[28964]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:27:12.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:12 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:12.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:12 smithi005 ceph-mon[28964]: Added host smithi115 2024-04-16T14:27:12.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:12 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:12.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:12 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:12.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:12 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:12.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:12 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:13.323 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:13 smithi005 ceph-mon[28964]: Deploying daemon alertmanager.smithi005 on smithi005 2024-04-16T14:27:14.266 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:14 smithi005 ceph-mon[28964]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:27:14.266 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:14 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:14.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.268+0000 7f02f793f700 1 -- 172.21.15.5:0/3916414251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02f00fca70 msgr2=0x7f02f00fce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:14.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.268+0000 7f02f793f700 1 --2- 172.21.15.5:0/3916414251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02f00fca70 0x7f02f00fce80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0048c0 tx=0x7f02ec009e30 comp rx=0 tx=0).stop 2024-04-16T14:27:14.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.268+0000 7f02f793f700 1 -- 172.21.15.5:0/3916414251 shutdown_connections 2024-04-16T14:27:14.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.268+0000 7f02f793f700 1 --2- 172.21.15.5:0/3916414251 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02f00fca70 0x7f02f00fce80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:14.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.268+0000 7f02f793f700 1 -- 172.21.15.5:0/3916414251 >> 172.21.15.5:0/3916414251 conn(0x7f02f00f81d0 msgr2=0x7f02f00fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:14.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.268+0000 7f02f793f700 1 -- 172.21.15.5:0/3916414251 shutdown_connections 2024-04-16T14:27:14.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.268+0000 7f02f793f700 1 -- 172.21.15.5:0/3916414251 wait complete. 2024-04-16T14:27:14.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.268+0000 7f02f793f700 1 Processor -- start 2024-04-16T14:27:14.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.269+0000 7f02f793f700 1 -- start start 2024-04-16T14:27:14.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.269+0000 7f02f793f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02f00fca70 0x7f02f010d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:14.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.269+0000 7f02f793f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f010d5e0 con 0x7f02f00fca70 2024-04-16T14:27:14.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.269+0000 7f02f56db700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02f00fca70 0x7f02f010d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:14.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.269+0000 7f02f56db700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02f00fca70 0x7f02f010d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56010/0 (socket says 172.21.15.5:56010) 2024-04-16T14:27:14.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.269+0000 7f02f56db700 1 -- 172.21.15.5:0/1523121604 learned_addr learned my addr 172.21.15.5:0/1523121604 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:27:14.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.269+0000 7f02f56db700 1 -- 172.21.15.5:0/1523121604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ec005040 con 0x7f02f00fca70 2024-04-16T14:27:14.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.269+0000 7f02f56db700 1 --2- 172.21.15.5:0/1523121604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02f00fca70 0x7f02f010d0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0096b0 tx=0x7f02ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:14.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.269+0000 7f02e5ffb700 1 -- 172.21.15.5:0/1523121604 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f02ec00bed0 con 0x7f02f00fca70 2024-04-16T14:27:14.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.269+0000 7f02e5ffb700 1 -- 172.21.15.5:0/1523121604 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f02ec00b5c0 con 0x7f02f00fca70 2024-04-16T14:27:14.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.269+0000 7f02f793f700 1 -- 172.21.15.5:0/1523121604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f010d7e0 con 0x7f02f00fca70 2024-04-16T14:27:14.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.269+0000 7f02e5ffb700 1 -- 172.21.15.5:0/1523121604 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f02ec01c5b0 con 0x7f02f00fca70 2024-04-16T14:27:14.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.270+0000 7f02f793f700 1 -- 172.21.15.5:0/1523121604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f010e350 con 0x7f02f00fca70 2024-04-16T14:27:14.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.271+0000 7f02e5ffb700 1 -- 172.21.15.5:0/1523121604 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 43431+0+0 (secure 0 0 0) 0x7f02ec01c820 con 0x7f02f00fca70 2024-04-16T14:27:14.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.271+0000 7f02f793f700 1 -- 172.21.15.5:0/1523121604 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f0102f80 con 0x7f02f00fca70 2024-04-16T14:27:14.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.271+0000 7f02e5ffb700 1 --2- 172.21.15.5:0/1523121604 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f02dc036880 0x7f02dc038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:14.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.271+0000 7f02e5ffb700 1 -- 172.21.15.5:0/1523121604 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f02ec049af0 con 0x7f02f00fca70 2024-04-16T14:27:14.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.271+0000 7f02f4eda700 1 --2- 172.21.15.5:0/1523121604 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f02dc036880 0x7f02dc038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:14.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.271+0000 7f02f4eda700 1 --2- 172.21.15.5:0/1523121604 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f02dc036880 0x7f02dc038d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009990 tx=0x7f02e0006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:14.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.276+0000 7f02e5ffb700 1 -- 172.21.15.5:0/1523121604 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f02ec023300 con 0x7f02f00fca70 2024-04-16T14:27:14.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.510+0000 7f02f793f700 1 -- 172.21.15.5:0/1523121604 --> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f02f005f690 con 0x7f02dc036880 2024-04-16T14:27:14.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.511+0000 7f02e5ffb700 1 -- 172.21.15.5:0/1523121604 <== mgr.14160 v2:172.21.15.5:6800/4176454319 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7f02f005f690 con 0x7f02dc036880 2024-04-16T14:27:14.510 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:27:14.510 INFO:teuthology.orchestra.run.smithi005.stdout:[{"addr": "172.21.15.5", "hostname": "smithi005", "labels": [], "status": ""}, {"addr": "172.21.15.115", "hostname": "smithi115", "labels": [], "status": ""}] 2024-04-16T14:27:14.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.513+0000 7f02f793f700 1 -- 172.21.15.5:0/1523121604 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f02dc036880 msgr2=0x7f02dc038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:14.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.513+0000 7f02f793f700 1 --2- 172.21.15.5:0/1523121604 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f02dc036880 0x7f02dc038d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009990 tx=0x7f02e0006e40 comp rx=0 tx=0).stop 2024-04-16T14:27:14.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.513+0000 7f02f793f700 1 -- 172.21.15.5:0/1523121604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02f00fca70 msgr2=0x7f02f010d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:14.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.513+0000 7f02f793f700 1 --2- 172.21.15.5:0/1523121604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02f00fca70 0x7f02f010d0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0096b0 tx=0x7f02ec009e30 comp rx=0 tx=0).stop 2024-04-16T14:27:14.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.513+0000 7f02f793f700 1 -- 172.21.15.5:0/1523121604 shutdown_connections 2024-04-16T14:27:14.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.513+0000 7f02f793f700 1 --2- 172.21.15.5:0/1523121604 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f02dc036880 0x7f02dc038d30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:14.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.513+0000 7f02f793f700 1 --2- 172.21.15.5:0/1523121604 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02f00fca70 0x7f02f010d0a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:14.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.513+0000 7f02f793f700 1 -- 172.21.15.5:0/1523121604 >> 172.21.15.5:0/1523121604 conn(0x7f02f00f81d0 msgr2=0x7f02f0103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:14.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.513+0000 7f02f793f700 1 -- 172.21.15.5:0/1523121604 shutdown_connections 2024-04-16T14:27:14.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:14.513+0000 7f02f793f700 1 -- 172.21.15.5:0/1523121604 wait complete. 2024-04-16T14:27:16.164 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-16T14:27:16.164 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph osd crush tunables default 2024-04-16T14:27:16.421 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:27:16.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:16 smithi005 ceph-mon[28964]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-16T14:27:16.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:16 smithi005 ceph-mon[28964]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:27:18.383 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:18 smithi005 ceph-mon[28964]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:27:20.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:20 smithi005 ceph-mon[28964]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:27:20.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.967+0000 7f7d6f2eb700 1 -- 172.21.15.5:0/507263754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d680fb970 msgr2=0x7f7d680fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:20.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.967+0000 7f7d6f2eb700 1 --2- 172.21.15.5:0/507263754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d680fb970 0x7f7d680fbd80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7d640048c0 tx=0x7f7d64009e30 comp rx=0 tx=0).stop 2024-04-16T14:27:20.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.967+0000 7f7d6f2eb700 1 -- 172.21.15.5:0/507263754 shutdown_connections 2024-04-16T14:27:20.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.967+0000 7f7d6f2eb700 1 --2- 172.21.15.5:0/507263754 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d680fb970 0x7f7d680fbd80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:20.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.967+0000 7f7d6f2eb700 1 -- 172.21.15.5:0/507263754 >> 172.21.15.5:0/507263754 conn(0x7f7d680f70d0 msgr2=0x7f7d680f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:20.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.967+0000 7f7d6f2eb700 1 -- 172.21.15.5:0/507263754 shutdown_connections 2024-04-16T14:27:20.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.967+0000 7f7d6f2eb700 1 -- 172.21.15.5:0/507263754 wait complete. 2024-04-16T14:27:20.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.968+0000 7f7d6f2eb700 1 Processor -- start 2024-04-16T14:27:20.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.968+0000 7f7d6f2eb700 1 -- start start 2024-04-16T14:27:20.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.968+0000 7f7d6f2eb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d680fb970 0x7f7d68065be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:20.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.968+0000 7f7d6f2eb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6810fde0 con 0x7f7d680fb970 2024-04-16T14:27:20.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.968+0000 7f7d6d087700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d680fb970 0x7f7d68065be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:20.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.968+0000 7f7d6d087700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d680fb970 0x7f7d68065be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60726/0 (socket says 172.21.15.5:60726) 2024-04-16T14:27:20.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.968+0000 7f7d6d087700 1 -- 172.21.15.5:0/3748218278 learned_addr learned my addr 172.21.15.5:0/3748218278 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:27:20.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.969+0000 7f7d6d087700 1 -- 172.21.15.5:0/3748218278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d64005040 con 0x7f7d680fb970 2024-04-16T14:27:20.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.969+0000 7f7d6d087700 1 --2- 172.21.15.5:0/3748218278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d680fb970 0x7f7d68065be0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7d640096b0 tx=0x7f7d64009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:20.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.969+0000 7f7d5dffb700 1 -- 172.21.15.5:0/3748218278 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7d6400bed0 con 0x7f7d680fb970 2024-04-16T14:27:20.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.969+0000 7f7d5dffb700 1 -- 172.21.15.5:0/3748218278 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7d6400b5c0 con 0x7f7d680fb970 2024-04-16T14:27:20.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.969+0000 7f7d6f2eb700 1 -- 172.21.15.5:0/3748218278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d6810ff20 con 0x7f7d680fb970 2024-04-16T14:27:20.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.969+0000 7f7d5dffb700 1 -- 172.21.15.5:0/3748218278 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7d6401c5b0 con 0x7f7d680fb970 2024-04-16T14:27:20.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.969+0000 7f7d6f2eb700 1 -- 172.21.15.5:0/3748218278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d68110410 con 0x7f7d680fb970 2024-04-16T14:27:20.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.970+0000 7f7d5dffb700 1 -- 172.21.15.5:0/3748218278 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 43431+0+0 (secure 0 0 0) 0x7f7d6401c820 con 0x7f7d680fb970 2024-04-16T14:27:20.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.970+0000 7f7d6f2eb700 1 -- 172.21.15.5:0/3748218278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d68105930 con 0x7f7d680fb970 2024-04-16T14:27:20.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.970+0000 7f7d5dffb700 1 --2- 172.21.15.5:0/3748218278 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f7d54036880 0x7f7d54038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:20.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.970+0000 7f7d5dffb700 1 -- 172.21.15.5:0/3748218278 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7d64049a10 con 0x7f7d680fb970 2024-04-16T14:27:20.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.970+0000 7f7d6c886700 1 --2- 172.21.15.5:0/3748218278 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f7d54036880 0x7f7d54038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:20.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.971+0000 7f7d6c886700 1 --2- 172.21.15.5:0/3748218278 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f7d54036880 0x7f7d54038d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7d58009990 tx=0x7f7d58006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:20.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:20.975+0000 7f7d5dffb700 1 -- 172.21.15.5:0/3748218278 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7d64023300 con 0x7f7d680fb970 2024-04-16T14:27:21.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:21.190+0000 7f7d6f2eb700 1 -- 172.21.15.5:0/3748218278 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f7d68101830 con 0x7f7d680fb970 2024-04-16T14:27:22.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:22.020+0000 7f7d5dffb700 1 -- 172.21.15.5:0/3748218278 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7d64011b60 con 0x7f7d680fb970 2024-04-16T14:27:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:22.022+0000 7f7d6f2eb700 1 -- 172.21.15.5:0/3748218278 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f7d54036880 msgr2=0x7f7d54038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:22.022+0000 7f7d6f2eb700 1 --2- 172.21.15.5:0/3748218278 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f7d54036880 0x7f7d54038d30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7d58009990 tx=0x7f7d58006e40 comp rx=0 tx=0).stop 2024-04-16T14:27:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:22.022+0000 7f7d6f2eb700 1 -- 172.21.15.5:0/3748218278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d680fb970 msgr2=0x7f7d68065be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:22.022+0000 7f7d6f2eb700 1 --2- 172.21.15.5:0/3748218278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d680fb970 0x7f7d68065be0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7d640096b0 tx=0x7f7d64009e30 comp rx=0 tx=0).stop 2024-04-16T14:27:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:22.022+0000 7f7d6f2eb700 1 -- 172.21.15.5:0/3748218278 shutdown_connections 2024-04-16T14:27:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:22.022+0000 7f7d6f2eb700 1 --2- 172.21.15.5:0/3748218278 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f7d54036880 0x7f7d54038d30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:22.022+0000 7f7d6f2eb700 1 --2- 172.21.15.5:0/3748218278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d680fb970 0x7f7d68065be0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:22.023+0000 7f7d6f2eb700 1 -- 172.21.15.5:0/3748218278 >> 172.21.15.5:0/3748218278 conn(0x7f7d680f70d0 msgr2=0x7f7d68102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:22.023+0000 7f7d6f2eb700 1 -- 172.21.15.5:0/3748218278 shutdown_connections 2024-04-16T14:27:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:27:22.023+0000 7f7d6f2eb700 1 -- 172.21.15.5:0/3748218278 wait complete. 2024-04-16T14:27:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:adjusted tunables profile to default 2024-04-16T14:27:22.356 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:22 smithi005 ceph-mon[28964]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:27:22.356 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:22 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/3748218278' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-16T14:27:22.356 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:22 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:22.356 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:22 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:22.356 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:22 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:22.357 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:22 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:22.357 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:22 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:22.357 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:22 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:22.357 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:22 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-16T14:27:22.357 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:22 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:22.672 INFO:tasks.cephadm:Adding mon.smithi005 on smithi005 2024-04-16T14:27:22.673 INFO:tasks.cephadm:Adding mon.smithi115 on smithi115 2024-04-16T14:27:22.673 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph orch apply mon '2;smithi005:172.21.15.5=smithi005;smithi115:172.21.15.115=smithi115' 2024-04-16T14:27:22.926 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-16T14:27:22.974 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-16T14:27:23.473 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:23 smithi005 ceph-mon[28964]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-16T14:27:23.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:23 smithi005 ceph-mon[28964]: Deploying daemon grafana.smithi005 on smithi005 2024-04-16T14:27:23.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:23 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/3748218278' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-16T14:27:23.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:23 smithi005 ceph-mon[28964]: osdmap e4: 0 total, 0 up, 0 in 2024-04-16T14:27:24.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:24 smithi005 ceph-mon[28964]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:27:24.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:24 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:24.506 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.506+0000 7f3f35f9e700 1 -- 172.21.15.115:0/1604438334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f300fca60 msgr2=0x7f3f300fce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:24.506 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.506+0000 7f3f35f9e700 1 --2- 172.21.15.115:0/1604438334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f300fca60 0x7f3f300fce70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3f20009c60 tx=0x7f3f20004d10 comp rx=0 tx=0).stop 2024-04-16T14:27:24.506 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.506+0000 7f3f35f9e700 1 -- 172.21.15.115:0/1604438334 shutdown_connections 2024-04-16T14:27:24.506 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.506+0000 7f3f35f9e700 1 --2- 172.21.15.115:0/1604438334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f300fca60 0x7f3f300fce70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:24.506 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.506+0000 7f3f35f9e700 1 -- 172.21.15.115:0/1604438334 >> 172.21.15.115:0/1604438334 conn(0x7f3f300f81c0 msgr2=0x7f3f300fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:24.506 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.506+0000 7f3f35f9e700 1 -- 172.21.15.115:0/1604438334 shutdown_connections 2024-04-16T14:27:24.506 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.506+0000 7f3f35f9e700 1 -- 172.21.15.115:0/1604438334 wait complete. 2024-04-16T14:27:24.506 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.507+0000 7f3f35f9e700 1 Processor -- start 2024-04-16T14:27:24.506 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.507+0000 7f3f35f9e700 1 -- start start 2024-04-16T14:27:24.506 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.507+0000 7f3f35f9e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f300fca60 0x7f3f30071d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:24.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.507+0000 7f3f35f9e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f300722a0 con 0x7f3f300fca60 2024-04-16T14:27:24.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.507+0000 7f3f2f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f300fca60 0x7f3f30071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:24.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.507+0000 7f3f2f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f300fca60 0x7f3f30071d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.115:33268/0 (socket says 172.21.15.115:33268) 2024-04-16T14:27:24.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.507+0000 7f3f2f7fe700 1 -- 172.21.15.115:0/2728584178 learned_addr learned my addr 172.21.15.115:0/2728584178 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-04-16T14:27:24.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.508+0000 7f3f2f7fe700 1 -- 172.21.15.115:0/2728584178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f20009940 con 0x7f3f300fca60 2024-04-16T14:27:24.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.508+0000 7f3f2f7fe700 1 --2- 172.21.15.115:0/2728584178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f300fca60 0x7f3f30071d60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3f20009500 tx=0x7f3f20004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:24.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.508+0000 7f3f17fff700 1 -- 172.21.15.115:0/2728584178 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f20007c80 con 0x7f3f300fca60 2024-04-16T14:27:24.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.508+0000 7f3f17fff700 1 -- 172.21.15.115:0/2728584178 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f2001d910 con 0x7f3f300fca60 2024-04-16T14:27:24.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.508+0000 7f3f35f9e700 1 -- 172.21.15.115:0/2728584178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f30070370 con 0x7f3f300fca60 2024-04-16T14:27:24.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.508+0000 7f3f17fff700 1 -- 172.21.15.115:0/2728584178 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f200129d0 con 0x7f3f300fca60 2024-04-16T14:27:24.508 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.508+0000 7f3f35f9e700 1 -- 172.21.15.115:0/2728584178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f30070860 con 0x7f3f300fca60 2024-04-16T14:27:24.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.509+0000 7f3f17fff700 1 -- 172.21.15.115:0/2728584178 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 43431+0+0 (secure 0 0 0) 0x7f3f20019040 con 0x7f3f300fca60 2024-04-16T14:27:24.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.509+0000 7f3f35f9e700 1 -- 172.21.15.115:0/2728584178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f3005f5f0 con 0x7f3f300fca60 2024-04-16T14:27:24.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.509+0000 7f3f17fff700 1 --2- 172.21.15.115:0/2728584178 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f3f18036880 0x7f3f18038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:24.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.509+0000 7f3f17fff700 1 -- 172.21.15.115:0/2728584178 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f3f2004a3c0 con 0x7f3f300fca60 2024-04-16T14:27:24.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.510+0000 7f3f2effd700 1 --2- 172.21.15.115:0/2728584178 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f3f18036880 0x7f3f18038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:24.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.510+0000 7f3f2effd700 1 --2- 172.21.15.115:0/2728584178 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f3f18036880 0x7f3f18038d30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009990 tx=0x7f3f24006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:24.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.516+0000 7f3f17fff700 1 -- 172.21.15.115:0/2728584178 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3f2002eb40 con 0x7f3f300fca60 2024-04-16T14:27:24.705 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.708+0000 7f3f35f9e700 1 -- 172.21.15.115:0/2728584178 --> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi005:172.21.15.5=smithi005;smithi115:172.21.15.115=smithi115", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f30106560 con 0x7f3f18036880 2024-04-16T14:27:24.710 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.713+0000 7f3f17fff700 1 -- 172.21.15.115:0/2728584178 <== mgr.14160 v2:172.21.15.5:6800/4176454319 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f3f30106560 con 0x7f3f18036880 2024-04-16T14:27:24.710 INFO:teuthology.orchestra.run.smithi115.stdout:Scheduled mon update... 2024-04-16T14:27:24.712 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.714+0000 7f3f35f9e700 1 -- 172.21.15.115:0/2728584178 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f3f18036880 msgr2=0x7f3f18038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:24.712 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.714+0000 7f3f35f9e700 1 --2- 172.21.15.115:0/2728584178 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f3f18036880 0x7f3f18038d30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009990 tx=0x7f3f24006e40 comp rx=0 tx=0).stop 2024-04-16T14:27:24.712 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.714+0000 7f3f35f9e700 1 -- 172.21.15.115:0/2728584178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f300fca60 msgr2=0x7f3f30071d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:24.712 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.714+0000 7f3f35f9e700 1 --2- 172.21.15.115:0/2728584178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f300fca60 0x7f3f30071d60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3f20009500 tx=0x7f3f20004d10 comp rx=0 tx=0).stop 2024-04-16T14:27:24.712 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.715+0000 7f3f35f9e700 1 -- 172.21.15.115:0/2728584178 shutdown_connections 2024-04-16T14:27:24.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.715+0000 7f3f35f9e700 1 --2- 172.21.15.115:0/2728584178 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f3f18036880 0x7f3f18038d30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:24.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.715+0000 7f3f35f9e700 1 --2- 172.21.15.115:0/2728584178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f300fca60 0x7f3f30071d60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:24.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.715+0000 7f3f35f9e700 1 -- 172.21.15.115:0/2728584178 >> 172.21.15.115:0/2728584178 conn(0x7f3f300f81c0 msgr2=0x7f3f30103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:24.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.715+0000 7f3f35f9e700 1 -- 172.21.15.115:0/2728584178 shutdown_connections 2024-04-16T14:27:24.713 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:24.715+0000 7f3f35f9e700 1 -- 172.21.15.115:0/2728584178 wait complete. 2024-04-16T14:27:25.190 DEBUG:teuthology.orchestra.run.smithi115:mon.smithi115> sudo journalctl -f -n 0 -u ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@mon.smithi115.service 2024-04-16T14:27:25.193 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-16T14:27:25.193 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph mon dump -f json 2024-04-16T14:27:25.472 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-16T14:27:25.520 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-16T14:27:25.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:25 smithi005 ceph-mon[28964]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi005:172.21.15.5=smithi005;smithi115:172.21.15.115=smithi115", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:27:25.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:25 smithi005 ceph-mon[28964]: Saving service mon spec with placement smithi005:172.21.15.5=smithi005;smithi115:172.21.15.115=smithi115;count:2 2024-04-16T14:27:25.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:25 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:25.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:25 smithi005 ceph-mon[28964]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:27:26.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.857+0000 7fcec9b60700 1 -- 172.21.15.115:0/259875580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcec4066930 msgr2=0x7fcec40ff710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:26.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.857+0000 7fcec9b60700 1 --2- 172.21.15.115:0/259875580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcec4066930 0x7fcec40ff710 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009c60 tx=0x7fceb4004d10 comp rx=0 tx=0).stop 2024-04-16T14:27:26.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.857+0000 7fcec9b60700 1 -- 172.21.15.115:0/259875580 shutdown_connections 2024-04-16T14:27:26.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.857+0000 7fcec9b60700 1 --2- 172.21.15.115:0/259875580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcec4066930 0x7fcec40ff710 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:26.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.857+0000 7fcec9b60700 1 -- 172.21.15.115:0/259875580 >> 172.21.15.115:0/259875580 conn(0x7fcec40f70c0 msgr2=0x7fcec40f94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:26.855 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.857+0000 7fcec9b60700 1 -- 172.21.15.115:0/259875580 shutdown_connections 2024-04-16T14:27:26.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.857+0000 7fcec9b60700 1 -- 172.21.15.115:0/259875580 wait complete. 2024-04-16T14:27:26.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.858+0000 7fcec9b60700 1 Processor -- start 2024-04-16T14:27:26.856 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.858+0000 7fcec9b60700 1 -- start start 2024-04-16T14:27:26.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.858+0000 7fcec9b60700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcec4066930 0x7fcec40fd060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:26.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.858+0000 7fcec9b60700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec40fd5a0 con 0x7fcec4066930 2024-04-16T14:27:26.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.858+0000 7fcec37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcec4066930 0x7fcec40fd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:26.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.858+0000 7fcec37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcec4066930 0x7fcec40fd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.115:33298/0 (socket says 172.21.15.115:33298) 2024-04-16T14:27:26.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.858+0000 7fcec37fe700 1 -- 172.21.15.115:0/2939355052 learned_addr learned my addr 172.21.15.115:0/2939355052 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-04-16T14:27:26.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.858+0000 7fcec37fe700 1 -- 172.21.15.115:0/2939355052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb4009940 con 0x7fcec4066930 2024-04-16T14:27:26.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.859+0000 7fcec37fe700 1 --2- 172.21.15.115:0/2939355052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcec4066930 0x7fcec40fd060 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fceb40097b0 tx=0x7fceb4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:26.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.859+0000 7fcebbfff700 1 -- 172.21.15.115:0/2939355052 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fceb4012410 con 0x7fcec4066930 2024-04-16T14:27:26.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.859+0000 7fcebbfff700 1 -- 172.21.15.115:0/2939355052 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fceb4012a40 con 0x7fcec4066930 2024-04-16T14:27:26.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.859+0000 7fcec9b60700 1 -- 172.21.15.115:0/2939355052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec40fb670 con 0x7fcec4066930 2024-04-16T14:27:26.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.859+0000 7fcebbfff700 1 -- 172.21.15.115:0/2939355052 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fceb401b980 con 0x7fcec4066930 2024-04-16T14:27:26.858 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.859+0000 7fcec9b60700 1 -- 172.21.15.115:0/2939355052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec40fbb60 con 0x7fcec4066930 2024-04-16T14:27:26.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.860+0000 7fcebbfff700 1 -- 172.21.15.115:0/2939355052 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 43431+0+0 (secure 0 0 0) 0x7fceb4019040 con 0x7fcec4066930 2024-04-16T14:27:26.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.860+0000 7fcec9b60700 1 -- 172.21.15.115:0/2939355052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec405f5f0 con 0x7fcec4066930 2024-04-16T14:27:26.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.860+0000 7fcebbfff700 1 --2- 172.21.15.115:0/2939355052 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fceb0036880 0x7fceb0038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:26.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.860+0000 7fcebbfff700 1 -- 172.21.15.115:0/2939355052 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fceb4049d10 con 0x7fcec4066930 2024-04-16T14:27:26.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.860+0000 7fcec2ffd700 1 --2- 172.21.15.115:0/2939355052 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fceb0036880 0x7fceb0038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:26.859 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.860+0000 7fcec2ffd700 1 --2- 172.21.15.115:0/2939355052 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fceb0036880 0x7fceb0038d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fceac009990 tx=0x7fceac006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:26.862 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:26.865+0000 7fcebbfff700 1 -- 172.21.15.115:0/2939355052 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fceb404f020 con 0x7fcec4066930 2024-04-16T14:27:27.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:27.125+0000 7fcec9b60700 1 -- 172.21.15.115:0/2939355052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fcec4106430 con 0x7fcec4066930 2024-04-16T14:27:27.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:27.125+0000 7fcebbfff700 1 -- 172.21.15.115:0/2939355052 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7fceb4017090 con 0x7fcec4066930 2024-04-16T14:27:27.123 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:27:27.123 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":1,"fsid":"10609bfa-fbfd-11ee-bc90-c7b262605968","modified":"2024-04-16T14:25:42.269119Z","created":"2024-04-16T14:25:42.269119Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi005","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-16T14:27:27.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:27.128+0000 7fcec9b60700 1 -- 172.21.15.115:0/2939355052 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fceb0036880 msgr2=0x7fceb0038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:27.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:27.128+0000 7fcec9b60700 1 --2- 172.21.15.115:0/2939355052 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fceb0036880 0x7fceb0038d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fceac009990 tx=0x7fceac006e40 comp rx=0 tx=0).stop 2024-04-16T14:27:27.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:27.128+0000 7fcec9b60700 1 -- 172.21.15.115:0/2939355052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcec4066930 msgr2=0x7fcec40fd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:27.125 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:27.128+0000 7fcec9b60700 1 --2- 172.21.15.115:0/2939355052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcec4066930 0x7fcec40fd060 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fceb40097b0 tx=0x7fceb4004d10 comp rx=0 tx=0).stop 2024-04-16T14:27:27.126 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:27.128+0000 7fcec9b60700 1 -- 172.21.15.115:0/2939355052 shutdown_connections 2024-04-16T14:27:27.126 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:27.128+0000 7fcec9b60700 1 --2- 172.21.15.115:0/2939355052 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fceb0036880 0x7fceb0038d30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:27.126 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:27.128+0000 7fcec9b60700 1 --2- 172.21.15.115:0/2939355052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcec4066930 0x7fcec40fd060 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:27.126 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:27.128+0000 7fcec9b60700 1 -- 172.21.15.115:0/2939355052 >> 172.21.15.115:0/2939355052 conn(0x7fcec40f70c0 msgr2=0x7fcec4103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:27.126 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:27.128+0000 7fcec9b60700 1 -- 172.21.15.115:0/2939355052 shutdown_connections 2024-04-16T14:27:27.126 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:27.128+0000 7fcec9b60700 1 -- 172.21.15.115:0/2939355052 wait complete. 2024-04-16T14:27:27.126 INFO:teuthology.orchestra.run.smithi115.stderr:dumped monmap epoch 1 2024-04-16T14:27:28.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:27 smithi005 ceph-mon[28964]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:27:28.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:27 smithi005 ceph-mon[28964]: from='client.? 172.21.15.115:0/2939355052' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:27:28.653 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-16T14:27:28.654 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph mon dump -f json 2024-04-16T14:27:28.916 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-16T14:27:28.963 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-16T14:27:30.361 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.363+0000 7f284baab700 1 -- 172.21.15.115:0/3100250899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2844065ca0 msgr2=0x7f28440ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:30.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.363+0000 7f284baab700 1 --2- 172.21.15.115:0/3100250899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2844065ca0 0x7f28440ff720 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f28400048c0 tx=0x7f2840009e30 comp rx=0 tx=0).stop 2024-04-16T14:27:30.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.363+0000 7f284baab700 1 -- 172.21.15.115:0/3100250899 shutdown_connections 2024-04-16T14:27:30.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.363+0000 7f284baab700 1 --2- 172.21.15.115:0/3100250899 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2844065ca0 0x7f28440ff720 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:30.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.363+0000 7f284baab700 1 -- 172.21.15.115:0/3100250899 >> 172.21.15.115:0/3100250899 conn(0x7f28440f70d0 msgr2=0x7f28440f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:30.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.363+0000 7f284baab700 1 -- 172.21.15.115:0/3100250899 shutdown_connections 2024-04-16T14:27:30.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.363+0000 7f284baab700 1 -- 172.21.15.115:0/3100250899 wait complete. 2024-04-16T14:27:30.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.363+0000 7f284baab700 1 Processor -- start 2024-04-16T14:27:30.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.363+0000 7f284baab700 1 -- start start 2024-04-16T14:27:30.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.363+0000 7f284baab700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2844065ca0 0x7f28440fd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:30.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.363+0000 7f284baab700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28440fd5b0 con 0x7f2844065ca0 2024-04-16T14:27:30.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.364+0000 7f2849847700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2844065ca0 0x7f28440fd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:30.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.364+0000 7f2849847700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2844065ca0 0x7f28440fd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.115:33304/0 (socket says 172.21.15.115:33304) 2024-04-16T14:27:30.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.364+0000 7f2849847700 1 -- 172.21.15.115:0/4012107623 learned_addr learned my addr 172.21.15.115:0/4012107623 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-04-16T14:27:30.362 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.364+0000 7f2849847700 1 -- 172.21.15.115:0/4012107623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2840005040 con 0x7f2844065ca0 2024-04-16T14:27:30.363 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.364+0000 7f2849847700 1 --2- 172.21.15.115:0/4012107623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2844065ca0 0x7f28440fd070 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2840009680 tx=0x7f2840009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:30.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.364+0000 7f283a7fc700 1 -- 172.21.15.115:0/4012107623 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f284000bed0 con 0x7f2844065ca0 2024-04-16T14:27:30.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.364+0000 7f283a7fc700 1 -- 172.21.15.115:0/4012107623 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f284000b5c0 con 0x7f2844065ca0 2024-04-16T14:27:30.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.364+0000 7f283a7fc700 1 -- 172.21.15.115:0/4012107623 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f284001c5b0 con 0x7f2844065ca0 2024-04-16T14:27:30.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.364+0000 7f284baab700 1 -- 172.21.15.115:0/4012107623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28440fb680 con 0x7f2844065ca0 2024-04-16T14:27:30.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.364+0000 7f284baab700 1 -- 172.21.15.115:0/4012107623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28440fbb70 con 0x7f2844065ca0 2024-04-16T14:27:30.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.365+0000 7f283a7fc700 1 -- 172.21.15.115:0/4012107623 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 43431+0+0 (secure 0 0 0) 0x7f2840004d30 con 0x7f2844065ca0 2024-04-16T14:27:30.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.365+0000 7f284baab700 1 -- 172.21.15.115:0/4012107623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f284405f5f0 con 0x7f2844065ca0 2024-04-16T14:27:30.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.365+0000 7f283a7fc700 1 --2- 172.21.15.115:0/4012107623 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f2830036880 0x7f2830038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:30.364 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.365+0000 7f283a7fc700 1 -- 172.21.15.115:0/4012107623 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f2840049a50 con 0x7f2844065ca0 2024-04-16T14:27:30.365 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.366+0000 7f2849046700 1 --2- 172.21.15.115:0/4012107623 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f2830036880 0x7f2830038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:30.365 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.366+0000 7f2849046700 1 --2- 172.21.15.115:0/4012107623 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f2830036880 0x7f2830038d30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2834009990 tx=0x7f2834006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:30.368 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.370+0000 7f283a7fc700 1 -- 172.21.15.115:0/4012107623 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2840011550 con 0x7f2844065ca0 2024-04-16T14:27:30.473 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:29 smithi005 ceph-mon[28964]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:27:30.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.635+0000 7f284baab700 1 -- 172.21.15.115:0/4012107623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2844106440 con 0x7f2844065ca0 2024-04-16T14:27:30.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.635+0000 7f283a7fc700 1 -- 172.21.15.115:0/4012107623 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f2840011370 con 0x7f2844065ca0 2024-04-16T14:27:30.633 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:27:30.633 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":1,"fsid":"10609bfa-fbfd-11ee-bc90-c7b262605968","modified":"2024-04-16T14:25:42.269119Z","created":"2024-04-16T14:25:42.269119Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi005","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-16T14:27:30.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.637+0000 7f284baab700 1 -- 172.21.15.115:0/4012107623 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f2830036880 msgr2=0x7f2830038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:30.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.637+0000 7f284baab700 1 --2- 172.21.15.115:0/4012107623 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f2830036880 0x7f2830038d30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2834009990 tx=0x7f2834006e40 comp rx=0 tx=0).stop 2024-04-16T14:27:30.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.637+0000 7f284baab700 1 -- 172.21.15.115:0/4012107623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2844065ca0 msgr2=0x7f28440fd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:30.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.637+0000 7f284baab700 1 --2- 172.21.15.115:0/4012107623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2844065ca0 0x7f28440fd070 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2840009680 tx=0x7f2840009e30 comp rx=0 tx=0).stop 2024-04-16T14:27:30.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.637+0000 7f284baab700 1 -- 172.21.15.115:0/4012107623 shutdown_connections 2024-04-16T14:27:30.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.637+0000 7f284baab700 1 --2- 172.21.15.115:0/4012107623 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f2830036880 0x7f2830038d30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:30.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.637+0000 7f284baab700 1 --2- 172.21.15.115:0/4012107623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2844065ca0 0x7f28440fd070 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:30.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.637+0000 7f284baab700 1 -- 172.21.15.115:0/4012107623 >> 172.21.15.115:0/4012107623 conn(0x7f28440f70d0 msgr2=0x7f2844103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:30.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.637+0000 7f284baab700 1 -- 172.21.15.115:0/4012107623 shutdown_connections 2024-04-16T14:27:30.635 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:30.637+0000 7f284baab700 1 -- 172.21.15.115:0/4012107623 wait complete. 2024-04-16T14:27:30.636 INFO:teuthology.orchestra.run.smithi115.stderr:dumped monmap epoch 1 2024-04-16T14:27:31.374 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:30 smithi005 ceph-mon[28964]: from='client.? 172.21.15.115:0/4012107623' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:27:32.191 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-16T14:27:32.192 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph mon dump -f json 2024-04-16T14:27:32.448 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-16T14:27:32.473 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:31 smithi005 ceph-mon[28964]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:27:32.496 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-16T14:27:33.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.884+0000 7f71dba0e700 1 -- 172.21.15.115:0/3054545531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71d40fb970 msgr2=0x7f71d40fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:33.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.884+0000 7f71dba0e700 1 --2- 172.21.15.115:0/3054545531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71d40fb970 0x7f71d40fbd80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f71d00048c0 tx=0x7f71d0009e30 comp rx=0 tx=0).stop 2024-04-16T14:27:33.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.884+0000 7f71dba0e700 1 -- 172.21.15.115:0/3054545531 shutdown_connections 2024-04-16T14:27:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.884+0000 7f71dba0e700 1 --2- 172.21.15.115:0/3054545531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71d40fb970 0x7f71d40fbd80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.884+0000 7f71dba0e700 1 -- 172.21.15.115:0/3054545531 >> 172.21.15.115:0/3054545531 conn(0x7f71d40f70d0 msgr2=0x7f71d40f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.884+0000 7f71dba0e700 1 -- 172.21.15.115:0/3054545531 shutdown_connections 2024-04-16T14:27:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.884+0000 7f71dba0e700 1 -- 172.21.15.115:0/3054545531 wait complete. 2024-04-16T14:27:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.884+0000 7f71dba0e700 1 Processor -- start 2024-04-16T14:27:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.884+0000 7f71dba0e700 1 -- start start 2024-04-16T14:27:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.884+0000 7f71dba0e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71d40fb970 0x7f71d410d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.884+0000 7f71dba0e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d410d5d0 con 0x7f71d40fb970 2024-04-16T14:27:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.885+0000 7f71d97aa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71d40fb970 0x7f71d410d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.885+0000 7f71d97aa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71d40fb970 0x7f71d410d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.115:37886/0 (socket says 172.21.15.115:37886) 2024-04-16T14:27:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.885+0000 7f71d97aa700 1 -- 172.21.15.115:0/93179295 learned_addr learned my addr 172.21.15.115:0/93179295 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-04-16T14:27:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.885+0000 7f71d97aa700 1 -- 172.21.15.115:0/93179295 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d0005040 con 0x7f71d40fb970 2024-04-16T14:27:33.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.885+0000 7f71d97aa700 1 --2- 172.21.15.115:0/93179295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71d40fb970 0x7f71d410d090 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f71d00096b0 tx=0x7f71d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:33.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.885+0000 7f71c9ffb700 1 -- 172.21.15.115:0/93179295 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71d000bed0 con 0x7f71d40fb970 2024-04-16T14:27:33.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.885+0000 7f71dba0e700 1 -- 172.21.15.115:0/93179295 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d410d7d0 con 0x7f71d40fb970 2024-04-16T14:27:33.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.885+0000 7f71c9ffb700 1 -- 172.21.15.115:0/93179295 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f71d000b5c0 con 0x7f71d40fb970 2024-04-16T14:27:33.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.885+0000 7f71c9ffb700 1 -- 172.21.15.115:0/93179295 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f71d001c5b0 con 0x7f71d40fb970 2024-04-16T14:27:33.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.885+0000 7f71dba0e700 1 -- 172.21.15.115:0/93179295 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d410e340 con 0x7f71d40fb970 2024-04-16T14:27:33.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.886+0000 7f71c9ffb700 1 -- 172.21.15.115:0/93179295 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 43431+0+0 (secure 0 0 0) 0x7f71d0013a80 con 0x7f71d40fb970 2024-04-16T14:27:33.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.886+0000 7f71dba0e700 1 -- 172.21.15.115:0/93179295 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d4101e80 con 0x7f71d40fb970 2024-04-16T14:27:33.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.887+0000 7f71c9ffb700 1 --2- 172.21.15.115:0/93179295 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f71c0036880 0x7f71c0038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:33.885 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.887+0000 7f71c9ffb700 1 -- 172.21.15.115:0/93179295 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f71d0049a80 con 0x7f71d40fb970 2024-04-16T14:27:33.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.887+0000 7f71d8fa9700 1 --2- 172.21.15.115:0/93179295 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f71c0036880 0x7f71c0038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:33.886 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.887+0000 7f71d8fa9700 1 --2- 172.21.15.115:0/93179295 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f71c0036880 0x7f71c0038d30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f71c4009990 tx=0x7f71c4006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:33.889 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:33.892+0000 7f71c9ffb700 1 -- 172.21.15.115:0/93179295 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f71d0011960 con 0x7f71d40fb970 2024-04-16T14:27:34.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:34.151+0000 7f71dba0e700 1 -- 172.21.15.115:0/93179295 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f71d410e580 con 0x7f71d40fb970 2024-04-16T14:27:34.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:34.151+0000 7f71c9ffb700 1 -- 172.21.15.115:0/93179295 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f71d0011370 con 0x7f71d40fb970 2024-04-16T14:27:34.149 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:27:34.149 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":1,"fsid":"10609bfa-fbfd-11ee-bc90-c7b262605968","modified":"2024-04-16T14:25:42.269119Z","created":"2024-04-16T14:25:42.269119Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi005","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-16T14:27:34.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:34.153+0000 7f71dba0e700 1 -- 172.21.15.115:0/93179295 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f71c0036880 msgr2=0x7f71c0038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:34.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:34.153+0000 7f71dba0e700 1 --2- 172.21.15.115:0/93179295 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f71c0036880 0x7f71c0038d30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f71c4009990 tx=0x7f71c4006e40 comp rx=0 tx=0).stop 2024-04-16T14:27:34.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:34.153+0000 7f71dba0e700 1 -- 172.21.15.115:0/93179295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71d40fb970 msgr2=0x7f71d410d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:34.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:34.153+0000 7f71dba0e700 1 --2- 172.21.15.115:0/93179295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71d40fb970 0x7f71d410d090 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f71d00096b0 tx=0x7f71d0009e30 comp rx=0 tx=0).stop 2024-04-16T14:27:34.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:34.153+0000 7f71dba0e700 1 -- 172.21.15.115:0/93179295 shutdown_connections 2024-04-16T14:27:34.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:34.153+0000 7f71dba0e700 1 --2- 172.21.15.115:0/93179295 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f71c0036880 0x7f71c0038d30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:34.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:34.153+0000 7f71dba0e700 1 --2- 172.21.15.115:0/93179295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71d40fb970 0x7f71d410d090 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:34.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:34.153+0000 7f71dba0e700 1 -- 172.21.15.115:0/93179295 >> 172.21.15.115:0/93179295 conn(0x7f71d40f70d0 msgr2=0x7f71d4065910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:34.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:34.153+0000 7f71dba0e700 1 -- 172.21.15.115:0/93179295 shutdown_connections 2024-04-16T14:27:34.152 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:34.153+0000 7f71dba0e700 1 -- 172.21.15.115:0/93179295 wait complete. 2024-04-16T14:27:34.152 INFO:teuthology.orchestra.run.smithi115.stderr:dumped monmap epoch 1 2024-04-16T14:27:34.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:33 smithi005 ceph-mon[28964]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:27:35.401 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:34 smithi005 ceph-mon[28964]: from='client.? 172.21.15.115:0/93179295' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:27:35.712 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-16T14:27:35.712 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph mon dump -f json 2024-04-16T14:27:35.965 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-16T14:27:36.011 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-16T14:27:36.366 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:35 smithi005 ceph-mon[28964]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:27:37.426 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.427+0000 7ff370b6f700 1 -- 172.21.15.115:0/1266642232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff36c071ea0 msgr2=0x7ff36c0703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:37.426 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.427+0000 7ff370b6f700 1 --2- 172.21.15.115:0/1266642232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff36c071ea0 0x7ff36c0703b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff35c0048c0 tx=0x7ff35c009e30 comp rx=0 tx=0).stop 2024-04-16T14:27:37.426 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.427+0000 7ff370b6f700 1 -- 172.21.15.115:0/1266642232 shutdown_connections 2024-04-16T14:27:37.426 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.427+0000 7ff370b6f700 1 --2- 172.21.15.115:0/1266642232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff36c071ea0 0x7ff36c0703b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:37.426 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.427+0000 7ff370b6f700 1 -- 172.21.15.115:0/1266642232 >> 172.21.15.115:0/1266642232 conn(0x7ff36c0f81c0 msgr2=0x7ff36c0fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:37.426 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.427+0000 7ff370b6f700 1 -- 172.21.15.115:0/1266642232 shutdown_connections 2024-04-16T14:27:37.426 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.427+0000 7ff370b6f700 1 -- 172.21.15.115:0/1266642232 wait complete. 2024-04-16T14:27:37.426 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.428+0000 7ff370b6f700 1 Processor -- start 2024-04-16T14:27:37.426 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.428+0000 7ff370b6f700 1 -- start start 2024-04-16T14:27:37.426 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.428+0000 7ff370b6f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff36c071ea0 0x7ff36c10f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:37.426 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.428+0000 7ff370b6f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c10f830 con 0x7ff36c071ea0 2024-04-16T14:27:37.426 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.428+0000 7ff36a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff36c071ea0 0x7ff36c10f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:37.427 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.428+0000 7ff36a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff36c071ea0 0x7ff36c10f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.115:37892/0 (socket says 172.21.15.115:37892) 2024-04-16T14:27:37.427 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.428+0000 7ff36a59c700 1 -- 172.21.15.115:0/3327268356 learned_addr learned my addr 172.21.15.115:0/3327268356 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-04-16T14:27:37.427 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.428+0000 7ff36a59c700 1 -- 172.21.15.115:0/3327268356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35c005040 con 0x7ff36c071ea0 2024-04-16T14:27:37.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.429+0000 7ff36a59c700 1 --2- 172.21.15.115:0/3327268356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff36c071ea0 0x7ff36c10f2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff35c009680 tx=0x7ff35c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:37.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.429+0000 7ff35affd700 1 -- 172.21.15.115:0/3327268356 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff35c00bed0 con 0x7ff36c071ea0 2024-04-16T14:27:37.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.429+0000 7ff370b6f700 1 -- 172.21.15.115:0/3327268356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff36c10fa30 con 0x7ff36c071ea0 2024-04-16T14:27:37.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.429+0000 7ff370b6f700 1 -- 172.21.15.115:0/3327268356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff36c1105a0 con 0x7ff36c071ea0 2024-04-16T14:27:37.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.429+0000 7ff35affd700 1 -- 172.21.15.115:0/3327268356 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff35c00b5c0 con 0x7ff36c071ea0 2024-04-16T14:27:37.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.429+0000 7ff35affd700 1 -- 172.21.15.115:0/3327268356 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff35c025560 con 0x7ff36c071ea0 2024-04-16T14:27:37.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.430+0000 7ff370b6f700 1 -- 172.21.15.115:0/3327268356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff34c0052e0 con 0x7ff36c071ea0 2024-04-16T14:27:37.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.430+0000 7ff35affd700 1 -- 172.21.15.115:0/3327268356 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 43431+0+0 (secure 0 0 0) 0x7ff35c004d30 con 0x7ff36c071ea0 2024-04-16T14:27:37.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.430+0000 7ff35affd700 1 --2- 172.21.15.115:0/3327268356 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7ff354036880 0x7ff354038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:37.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.430+0000 7ff35affd700 1 -- 172.21.15.115:0/3327268356 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff35c049a80 con 0x7ff36c071ea0 2024-04-16T14:27:37.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.430+0000 7ff369d9b700 1 --2- 172.21.15.115:0/3327268356 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7ff354036880 0x7ff354038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:37.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.431+0000 7ff369d9b700 1 --2- 172.21.15.115:0/3327268356 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7ff354036880 0x7ff354038d30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff360009990 tx=0x7ff360006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:37.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.435+0000 7ff35affd700 1 -- 172.21.15.115:0/3327268356 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff35c0238f0 con 0x7ff36c071ea0 2024-04-16T14:27:37.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.695+0000 7ff370b6f700 1 -- 172.21.15.115:0/3327268356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff34c005590 con 0x7ff36c071ea0 2024-04-16T14:27:37.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.696+0000 7ff35affd700 1 -- 172.21.15.115:0/3327268356 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7ff35c023300 con 0x7ff36c071ea0 2024-04-16T14:27:37.693 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:27:37.693 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":1,"fsid":"10609bfa-fbfd-11ee-bc90-c7b262605968","modified":"2024-04-16T14:25:42.269119Z","created":"2024-04-16T14:25:42.269119Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi005","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-16T14:27:37.695 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.698+0000 7ff370b6f700 1 -- 172.21.15.115:0/3327268356 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7ff354036880 msgr2=0x7ff354038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:37.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.698+0000 7ff370b6f700 1 --2- 172.21.15.115:0/3327268356 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7ff354036880 0x7ff354038d30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff360009990 tx=0x7ff360006e40 comp rx=0 tx=0).stop 2024-04-16T14:27:37.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.698+0000 7ff370b6f700 1 -- 172.21.15.115:0/3327268356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff36c071ea0 msgr2=0x7ff36c10f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:37.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.698+0000 7ff370b6f700 1 --2- 172.21.15.115:0/3327268356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff36c071ea0 0x7ff36c10f2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff35c009680 tx=0x7ff35c009e30 comp rx=0 tx=0).stop 2024-04-16T14:27:37.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.698+0000 7ff370b6f700 1 -- 172.21.15.115:0/3327268356 shutdown_connections 2024-04-16T14:27:37.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.698+0000 7ff370b6f700 1 --2- 172.21.15.115:0/3327268356 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7ff354036880 0x7ff354038d30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:37.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.698+0000 7ff370b6f700 1 --2- 172.21.15.115:0/3327268356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff36c071ea0 0x7ff36c10f2f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:37.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.698+0000 7ff370b6f700 1 -- 172.21.15.115:0/3327268356 >> 172.21.15.115:0/3327268356 conn(0x7ff36c0f81c0 msgr2=0x7ff36c105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:37.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.698+0000 7ff370b6f700 1 -- 172.21.15.115:0/3327268356 shutdown_connections 2024-04-16T14:27:37.696 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:37.698+0000 7ff370b6f700 1 -- 172.21.15.115:0/3327268356 wait complete. 2024-04-16T14:27:37.696 INFO:teuthology.orchestra.run.smithi115.stderr:dumped monmap epoch 1 2024-04-16T14:27:38.121 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:37 smithi005 ceph-mon[28964]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:27:38.121 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:37 smithi005 ceph-mon[28964]: from='client.? 172.21.15.115:0/3327268356' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:27:39.249 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-16T14:27:39.249 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph mon dump -f json 2024-04-16T14:27:39.503 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-16T14:27:39.551 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-16T14:27:39.641 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:39 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:39.642 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:39 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:39.642 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:39 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:39.642 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:39 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:39.642 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:39 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:39.642 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:39 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:39.642 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:39 smithi005 ceph-mon[28964]: Deploying daemon prometheus.smithi005 on smithi005 2024-04-16T14:27:39.642 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:39 smithi005 ceph-mon[28964]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:27:39.642 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:39 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:40.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.823+0000 7f900d07e700 1 -- 172.21.15.115:0/3314159881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90080fca60 msgr2=0x7f90080fce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:40.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.823+0000 7f900d07e700 1 --2- 172.21.15.115:0/3314159881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90080fca60 0x7f90080fce70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80048c0 tx=0x7f8ff8009e30 comp rx=0 tx=0).stop 2024-04-16T14:27:40.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.823+0000 7f900d07e700 1 -- 172.21.15.115:0/3314159881 shutdown_connections 2024-04-16T14:27:40.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.823+0000 7f900d07e700 1 --2- 172.21.15.115:0/3314159881 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90080fca60 0x7f90080fce70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:40.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.823+0000 7f900d07e700 1 -- 172.21.15.115:0/3314159881 >> 172.21.15.115:0/3314159881 conn(0x7f90080f81c0 msgr2=0x7f90080fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:40.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.823+0000 7f900d07e700 1 -- 172.21.15.115:0/3314159881 shutdown_connections 2024-04-16T14:27:40.823 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.823+0000 7f900d07e700 1 -- 172.21.15.115:0/3314159881 wait complete. 2024-04-16T14:27:40.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.824+0000 7f900d07e700 1 Processor -- start 2024-04-16T14:27:40.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.824+0000 7f900d07e700 1 -- start start 2024-04-16T14:27:40.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.824+0000 7f900d07e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90080fca60 0x7f900810d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:40.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.824+0000 7f900d07e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900810d5d0 con 0x7f90080fca60 2024-04-16T14:27:40.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.824+0000 7f9006d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90080fca60 0x7f900810d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:40.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.824+0000 7f9006d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90080fca60 0x7f900810d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.115:56862/0 (socket says 172.21.15.115:56862) 2024-04-16T14:27:40.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.824+0000 7f9006d9d700 1 -- 172.21.15.115:0/3005662622 learned_addr learned my addr 172.21.15.115:0/3005662622 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-04-16T14:27:40.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.825+0000 7f9006d9d700 1 -- 172.21.15.115:0/3005662622 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff8005040 con 0x7f90080fca60 2024-04-16T14:27:40.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.825+0000 7f9006d9d700 1 --2- 172.21.15.115:0/3005662622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90080fca60 0x7f900810d090 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80096b0 tx=0x7f8ff8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:40.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.825+0000 7f8fff7fe700 1 -- 172.21.15.115:0/3005662622 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ff800bed0 con 0x7f90080fca60 2024-04-16T14:27:40.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.825+0000 7f900d07e700 1 -- 172.21.15.115:0/3005662622 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f900810d7d0 con 0x7f90080fca60 2024-04-16T14:27:40.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.825+0000 7f8fff7fe700 1 -- 172.21.15.115:0/3005662622 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ff800b5c0 con 0x7f90080fca60 2024-04-16T14:27:40.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.825+0000 7f8fff7fe700 1 -- 172.21.15.115:0/3005662622 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ff801c5b0 con 0x7f90080fca60 2024-04-16T14:27:40.824 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.825+0000 7f900d07e700 1 -- 172.21.15.115:0/3005662622 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f900810e340 con 0x7f90080fca60 2024-04-16T14:27:40.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.826+0000 7f8fff7fe700 1 -- 172.21.15.115:0/3005662622 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 43431+0+0 (secure 0 0 0) 0x7f8ff8013420 con 0x7f90080fca60 2024-04-16T14:27:40.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.826+0000 7f900d07e700 1 -- 172.21.15.115:0/3005662622 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9008102f70 con 0x7f90080fca60 2024-04-16T14:27:40.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.826+0000 7f8fff7fe700 1 --2- 172.21.15.115:0/3005662622 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f8ff4036880 0x7f8ff4038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:40.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.826+0000 7f8fff7fe700 1 -- 172.21.15.115:0/3005662622 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8ff8049ac0 con 0x7f90080fca60 2024-04-16T14:27:40.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.826+0000 7f900659c700 1 --2- 172.21.15.115:0/3005662622 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f8ff4036880 0x7f8ff4038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:40.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.827+0000 7f900659c700 1 --2- 172.21.15.115:0/3005662622 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f8ff4036880 0x7f8ff4038d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009990 tx=0x7f8ff0006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:40.830 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:40.833+0000 7f8fff7fe700 1 -- 172.21.15.115:0/3005662622 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8ff8013a80 con 0x7f90080fca60 2024-04-16T14:27:41.095 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:41.097+0000 7f900d07e700 1 -- 172.21.15.115:0/3005662622 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f900810ed50 con 0x7f90080fca60 2024-04-16T14:27:41.095 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:41.097+0000 7f8fff7fe700 1 -- 172.21.15.115:0/3005662622 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f8ff8011370 con 0x7f90080fca60 2024-04-16T14:27:41.095 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:27:41.095 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":1,"fsid":"10609bfa-fbfd-11ee-bc90-c7b262605968","modified":"2024-04-16T14:25:42.269119Z","created":"2024-04-16T14:25:42.269119Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi005","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-16T14:27:41.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:41.099+0000 7f900d07e700 1 -- 172.21.15.115:0/3005662622 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f8ff4036880 msgr2=0x7f8ff4038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:41.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:41.099+0000 7f900d07e700 1 --2- 172.21.15.115:0/3005662622 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f8ff4036880 0x7f8ff4038d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009990 tx=0x7f8ff0006e40 comp rx=0 tx=0).stop 2024-04-16T14:27:41.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:41.099+0000 7f900d07e700 1 -- 172.21.15.115:0/3005662622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90080fca60 msgr2=0x7f900810d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:41.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:41.099+0000 7f900d07e700 1 --2- 172.21.15.115:0/3005662622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90080fca60 0x7f900810d090 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8ff80096b0 tx=0x7f8ff8009e30 comp rx=0 tx=0).stop 2024-04-16T14:27:41.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:41.099+0000 7f900d07e700 1 -- 172.21.15.115:0/3005662622 shutdown_connections 2024-04-16T14:27:41.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:41.099+0000 7f900d07e700 1 --2- 172.21.15.115:0/3005662622 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f8ff4036880 0x7f8ff4038d30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:41.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:41.099+0000 7f900d07e700 1 --2- 172.21.15.115:0/3005662622 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90080fca60 0x7f900810d090 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:41.097 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:41.099+0000 7f900d07e700 1 -- 172.21.15.115:0/3005662622 >> 172.21.15.115:0/3005662622 conn(0x7f90080f81c0 msgr2=0x7f9008103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:41.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:41.099+0000 7f900d07e700 1 -- 172.21.15.115:0/3005662622 shutdown_connections 2024-04-16T14:27:41.098 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:41.099+0000 7f900d07e700 1 -- 172.21.15.115:0/3005662622 wait complete. 2024-04-16T14:27:41.098 INFO:teuthology.orchestra.run.smithi115.stderr:dumped monmap epoch 1 2024-04-16T14:27:42.473 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:41 smithi005 ceph-mon[28964]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:27:42.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:41 smithi005 ceph-mon[28964]: from='client.? 172.21.15.115:0/3005662622' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:27:42.711 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-16T14:27:42.712 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph mon dump -f json 2024-04-16T14:27:42.961 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-16T14:27:43.008 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-16T14:27:44.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.383+0000 7f6317fff700 1 -- 172.21.15.115:0/1557766123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6318071ea0 msgr2=0x7f63180703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:44.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.383+0000 7f6317fff700 1 --2- 172.21.15.115:0/1557766123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6318071ea0 0x7f63180703b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6310009c60 tx=0x7f6310004d10 comp rx=0 tx=0).stop 2024-04-16T14:27:44.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.383+0000 7f6317fff700 1 -- 172.21.15.115:0/1557766123 shutdown_connections 2024-04-16T14:27:44.386 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.383+0000 7f6317fff700 1 --2- 172.21.15.115:0/1557766123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6318071ea0 0x7f63180703b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:44.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.383+0000 7f6317fff700 1 -- 172.21.15.115:0/1557766123 >> 172.21.15.115:0/1557766123 conn(0x7f63180f8030 msgr2=0x7f63180fa460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:44.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.383+0000 7f6317fff700 1 -- 172.21.15.115:0/1557766123 shutdown_connections 2024-04-16T14:27:44.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.383+0000 7f6317fff700 1 -- 172.21.15.115:0/1557766123 wait complete. 2024-04-16T14:27:44.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.384+0000 7f6317fff700 1 Processor -- start 2024-04-16T14:27:44.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.384+0000 7f6317fff700 1 -- start start 2024-04-16T14:27:44.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.384+0000 7f6317fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6318071ea0 0x7f631810f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:44.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.384+0000 7f6317fff700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631810f670 con 0x7f6318071ea0 2024-04-16T14:27:44.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.384+0000 7f6316ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6318071ea0 0x7f631810f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:44.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.384+0000 7f6316ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6318071ea0 0x7f631810f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.115:56874/0 (socket says 172.21.15.115:56874) 2024-04-16T14:27:44.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.384+0000 7f6316ffd700 1 -- 172.21.15.115:0/3907219640 learned_addr learned my addr 172.21.15.115:0/3907219640 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-04-16T14:27:44.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.384+0000 7f6316ffd700 1 -- 172.21.15.115:0/3907219640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6310009940 con 0x7f6318071ea0 2024-04-16T14:27:44.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.385+0000 7f6316ffd700 1 --2- 172.21.15.115:0/3907219640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6318071ea0 0x7f631810f130 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f63100097b0 tx=0x7f6310004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:44.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.385+0000 7f630f7fe700 1 -- 172.21.15.115:0/3907219640 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6310012410 con 0x7f6318071ea0 2024-04-16T14:27:44.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.385+0000 7f6317fff700 1 -- 172.21.15.115:0/3907219640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f631810f870 con 0x7f6318071ea0 2024-04-16T14:27:44.388 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.385+0000 7f630f7fe700 1 -- 172.21.15.115:0/3907219640 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6310012a40 con 0x7f6318071ea0 2024-04-16T14:27:44.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.385+0000 7f630f7fe700 1 -- 172.21.15.115:0/3907219640 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f631001b980 con 0x7f6318071ea0 2024-04-16T14:27:44.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.385+0000 7f6317fff700 1 -- 172.21.15.115:0/3907219640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63181103e0 con 0x7f6318071ea0 2024-04-16T14:27:44.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.386+0000 7f6317fff700 1 -- 172.21.15.115:0/3907219640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6318104ff0 con 0x7f6318071ea0 2024-04-16T14:27:44.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.386+0000 7f630f7fe700 1 -- 172.21.15.115:0/3907219640 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 43431+0+0 (secure 0 0 0) 0x7f6310019040 con 0x7f6318071ea0 2024-04-16T14:27:44.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.386+0000 7f630f7fe700 1 --2- 172.21.15.115:0/3907219640 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f63040368d0 0x7f6304038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:44.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.386+0000 7f630f7fe700 1 -- 172.21.15.115:0/3907219640 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6310049c50 con 0x7f6318071ea0 2024-04-16T14:27:44.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.386+0000 7f63167fc700 1 --2- 172.21.15.115:0/3907219640 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f63040368d0 0x7f6304038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:44.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.387+0000 7f63167fc700 1 --2- 172.21.15.115:0/3907219640 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f63040368d0 0x7f6304038d80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6300009990 tx=0x7f6300006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:44.390 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.391+0000 7f630f7fe700 1 -- 172.21.15.115:0/3907219640 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6310022b50 con 0x7f6318071ea0 2024-04-16T14:27:44.473 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:43 smithi005 ceph-mon[28964]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:27:44.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.650+0000 7f6317fff700 1 -- 172.21.15.115:0/3907219640 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f631805f5f0 con 0x7f6318071ea0 2024-04-16T14:27:44.649 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.650+0000 7f630f7fe700 1 -- 172.21.15.115:0/3907219640 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f6310017090 con 0x7f6318071ea0 2024-04-16T14:27:44.649 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:27:44.649 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":1,"fsid":"10609bfa-fbfd-11ee-bc90-c7b262605968","modified":"2024-04-16T14:25:42.269119Z","created":"2024-04-16T14:25:42.269119Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi005","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-16T14:27:44.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.652+0000 7f6317fff700 1 -- 172.21.15.115:0/3907219640 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f63040368d0 msgr2=0x7f6304038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:44.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.652+0000 7f6317fff700 1 --2- 172.21.15.115:0/3907219640 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f63040368d0 0x7f6304038d80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6300009990 tx=0x7f6300006e40 comp rx=0 tx=0).stop 2024-04-16T14:27:44.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.652+0000 7f6317fff700 1 -- 172.21.15.115:0/3907219640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6318071ea0 msgr2=0x7f631810f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:44.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.652+0000 7f6317fff700 1 --2- 172.21.15.115:0/3907219640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6318071ea0 0x7f631810f130 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f63100097b0 tx=0x7f6310004d10 comp rx=0 tx=0).stop 2024-04-16T14:27:44.651 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.653+0000 7f6317fff700 1 -- 172.21.15.115:0/3907219640 shutdown_connections 2024-04-16T14:27:44.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.653+0000 7f6317fff700 1 --2- 172.21.15.115:0/3907219640 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f63040368d0 0x7f6304038d80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:44.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.653+0000 7f6317fff700 1 --2- 172.21.15.115:0/3907219640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6318071ea0 0x7f631810f130 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:44.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.653+0000 7f6317fff700 1 -- 172.21.15.115:0/3907219640 >> 172.21.15.115:0/3907219640 conn(0x7f63180f8030 msgr2=0x7f6318105c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:44.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.653+0000 7f6317fff700 1 -- 172.21.15.115:0/3907219640 shutdown_connections 2024-04-16T14:27:44.652 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:44.653+0000 7f6317fff700 1 -- 172.21.15.115:0/3907219640 wait complete. 2024-04-16T14:27:44.652 INFO:teuthology.orchestra.run.smithi115.stderr:dumped monmap epoch 1 2024-04-16T14:27:45.473 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:44 smithi005 ceph-mon[28964]: from='client.? 172.21.15.115:0/3907219640' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:27:46.188 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-16T14:27:46.189 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph mon dump -f json 2024-04-16T14:27:46.438 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-16T14:27:46.473 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:45 smithi005 ceph-mon[28964]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:27:46.485 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-16T14:27:47.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.920+0000 7f38ccb66700 1 -- 172.21.15.115:0/3375582938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38c80fca70 msgr2=0x7f38c80fce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:47.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.920+0000 7f38ccb66700 1 --2- 172.21.15.115:0/3375582938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38c80fca70 0x7f38c80fce80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f38b80048c0 tx=0x7f38b8009e30 comp rx=0 tx=0).stop 2024-04-16T14:27:47.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.920+0000 7f38ccb66700 1 -- 172.21.15.115:0/3375582938 shutdown_connections 2024-04-16T14:27:47.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.920+0000 7f38ccb66700 1 --2- 172.21.15.115:0/3375582938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38c80fca70 0x7f38c80fce80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:47.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.920+0000 7f38ccb66700 1 -- 172.21.15.115:0/3375582938 >> 172.21.15.115:0/3375582938 conn(0x7f38c80f81d0 msgr2=0x7f38c80fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:47.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.920+0000 7f38ccb66700 1 -- 172.21.15.115:0/3375582938 shutdown_connections 2024-04-16T14:27:47.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.921+0000 7f38ccb66700 1 -- 172.21.15.115:0/3375582938 wait complete. 2024-04-16T14:27:47.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.921+0000 7f38ccb66700 1 Processor -- start 2024-04-16T14:27:47.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.921+0000 7f38ccb66700 1 -- start start 2024-04-16T14:27:47.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.921+0000 7f38ccb66700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38c80fca70 0x7f38c810d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:47.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.921+0000 7f38ccb66700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c810d600 con 0x7f38c80fca70 2024-04-16T14:27:47.921 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.921+0000 7f38c659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38c80fca70 0x7f38c810d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:47.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.921+0000 7f38c659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38c80fca70 0x7f38c810d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.115:56892/0 (socket says 172.21.15.115:56892) 2024-04-16T14:27:47.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.921+0000 7f38c659c700 1 -- 172.21.15.115:0/3094793629 learned_addr learned my addr 172.21.15.115:0/3094793629 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-04-16T14:27:47.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.922+0000 7f38c659c700 1 -- 172.21.15.115:0/3094793629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b8005040 con 0x7f38c80fca70 2024-04-16T14:27:47.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.922+0000 7f38c659c700 1 --2- 172.21.15.115:0/3094793629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38c80fca70 0x7f38c810d0c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f38b80096b0 tx=0x7f38b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:47.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.922+0000 7f38beffd700 1 -- 172.21.15.115:0/3094793629 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f38b800bed0 con 0x7f38c80fca70 2024-04-16T14:27:47.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.922+0000 7f38ccb66700 1 -- 172.21.15.115:0/3094793629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c810d800 con 0x7f38c80fca70 2024-04-16T14:27:47.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.922+0000 7f38beffd700 1 -- 172.21.15.115:0/3094793629 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f38b800b5c0 con 0x7f38c80fca70 2024-04-16T14:27:47.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.922+0000 7f38ccb66700 1 -- 172.21.15.115:0/3094793629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c810e370 con 0x7f38c80fca70 2024-04-16T14:27:47.922 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.922+0000 7f38beffd700 1 -- 172.21.15.115:0/3094793629 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f38b8025560 con 0x7f38c80fca70 2024-04-16T14:27:47.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.923+0000 7f38beffd700 1 -- 172.21.15.115:0/3094793629 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 43431+0+0 (secure 0 0 0) 0x7f38b8004d30 con 0x7f38c80fca70 2024-04-16T14:27:47.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.923+0000 7f38ccb66700 1 -- 172.21.15.115:0/3094793629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c8102f80 con 0x7f38c80fca70 2024-04-16T14:27:47.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.923+0000 7f38beffd700 1 --2- 172.21.15.115:0/3094793629 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f38b4036880 0x7f38b4038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:47.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.923+0000 7f38beffd700 1 -- 172.21.15.115:0/3094793629 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f38b8049b00 con 0x7f38c80fca70 2024-04-16T14:27:47.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.923+0000 7f38c5d9b700 1 --2- 172.21.15.115:0/3094793629 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f38b4036880 0x7f38b4038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:47.923 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.924+0000 7f38c5d9b700 1 --2- 172.21.15.115:0/3094793629 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f38b4036880 0x7f38b4038d30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009990 tx=0x7f38b0006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:47.926 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:47.928+0000 7f38beffd700 1 -- 172.21.15.115:0/3094793629 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f38b8011940 con 0x7f38c80fca70 2024-04-16T14:27:48.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:48.188+0000 7f38ccb66700 1 -- 172.21.15.115:0/3094793629 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f38c810ed80 con 0x7f38c80fca70 2024-04-16T14:27:48.188 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:48.189+0000 7f38beffd700 1 -- 172.21.15.115:0/3094793629 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f38b8011370 con 0x7f38c80fca70 2024-04-16T14:27:48.189 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:27:48.189 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":1,"fsid":"10609bfa-fbfd-11ee-bc90-c7b262605968","modified":"2024-04-16T14:25:42.269119Z","created":"2024-04-16T14:25:42.269119Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi005","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-16T14:27:48.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:48.191+0000 7f38ccb66700 1 -- 172.21.15.115:0/3094793629 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f38b4036880 msgr2=0x7f38b4038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:48.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:48.191+0000 7f38ccb66700 1 --2- 172.21.15.115:0/3094793629 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f38b4036880 0x7f38b4038d30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009990 tx=0x7f38b0006e40 comp rx=0 tx=0).stop 2024-04-16T14:27:48.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:48.191+0000 7f38ccb66700 1 -- 172.21.15.115:0/3094793629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38c80fca70 msgr2=0x7f38c810d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:48.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:48.191+0000 7f38ccb66700 1 --2- 172.21.15.115:0/3094793629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38c80fca70 0x7f38c810d0c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f38b80096b0 tx=0x7f38b8009e30 comp rx=0 tx=0).stop 2024-04-16T14:27:48.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:48.191+0000 7f38ccb66700 1 -- 172.21.15.115:0/3094793629 shutdown_connections 2024-04-16T14:27:48.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:48.191+0000 7f38ccb66700 1 --2- 172.21.15.115:0/3094793629 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f38b4036880 0x7f38b4038d30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:48.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:48.191+0000 7f38ccb66700 1 --2- 172.21.15.115:0/3094793629 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38c80fca70 0x7f38c810d0c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:48.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:48.191+0000 7f38ccb66700 1 -- 172.21.15.115:0/3094793629 >> 172.21.15.115:0/3094793629 conn(0x7f38c80f81d0 msgr2=0x7f38c8103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:48.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:48.191+0000 7f38ccb66700 1 -- 172.21.15.115:0/3094793629 shutdown_connections 2024-04-16T14:27:48.191 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:48.191+0000 7f38ccb66700 1 -- 172.21.15.115:0/3094793629 wait complete. 2024-04-16T14:27:48.192 INFO:teuthology.orchestra.run.smithi115.stderr:dumped monmap epoch 1 2024-04-16T14:27:48.282 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:47 smithi005 ceph-mon[28964]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:27:49.269 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:49 smithi005 ceph-mon[28964]: from='client.? 172.21.15.115:0/3094793629' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:27:49.800 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-16T14:27:49.800 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph mon dump -f json 2024-04-16T14:27:50.051 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-16T14:27:50.098 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-16T14:27:50.334 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:50 smithi005 ceph-mon[28964]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:27:51.559 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.559+0000 7f01cbbc0700 1 -- 172.21.15.115:0/35968555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c40fb970 msgr2=0x7f01c40fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:51.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.559+0000 7f01cbbc0700 1 --2- 172.21.15.115:0/35968555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c40fb970 0x7f01c40fbd80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009c60 tx=0x7f01c0004d10 comp rx=0 tx=0).stop 2024-04-16T14:27:51.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.559+0000 7f01cbbc0700 1 -- 172.21.15.115:0/35968555 shutdown_connections 2024-04-16T14:27:51.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.559+0000 7f01cbbc0700 1 --2- 172.21.15.115:0/35968555 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c40fb970 0x7f01c40fbd80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:51.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.559+0000 7f01cbbc0700 1 -- 172.21.15.115:0/35968555 >> 172.21.15.115:0/35968555 conn(0x7f01c40f70d0 msgr2=0x7f01c40f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:51.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.559+0000 7f01cbbc0700 1 -- 172.21.15.115:0/35968555 shutdown_connections 2024-04-16T14:27:51.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.559+0000 7f01cbbc0700 1 -- 172.21.15.115:0/35968555 wait complete. 2024-04-16T14:27:51.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.560+0000 7f01cbbc0700 1 Processor -- start 2024-04-16T14:27:51.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.560+0000 7f01cbbc0700 1 -- start start 2024-04-16T14:27:51.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.560+0000 7f01cbbc0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c40fb970 0x7f01c4065c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:51.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.560+0000 7f01cbbc0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c410fd80 con 0x7f01c40fb970 2024-04-16T14:27:51.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.560+0000 7f01c995c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c40fb970 0x7f01c4065c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:51.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.560+0000 7f01c995c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c40fb970 0x7f01c4065c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.115:41294/0 (socket says 172.21.15.115:41294) 2024-04-16T14:27:51.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.560+0000 7f01c995c700 1 -- 172.21.15.115:0/3842313980 learned_addr learned my addr 172.21.15.115:0/3842313980 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-04-16T14:27:51.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.560+0000 7f01c995c700 1 -- 172.21.15.115:0/3842313980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c0009940 con 0x7f01c40fb970 2024-04-16T14:27:51.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.561+0000 7f01c995c700 1 --2- 172.21.15.115:0/3842313980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c40fb970 0x7f01c4065c40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009500 tx=0x7f01c0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:51.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.561+0000 7f01ba7fc700 1 -- 172.21.15.115:0/3842313980 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f01c0007c80 con 0x7f01c40fb970 2024-04-16T14:27:51.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.561+0000 7f01ba7fc700 1 -- 172.21.15.115:0/3842313980 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f01c001d910 con 0x7f01c40fb970 2024-04-16T14:27:51.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.561+0000 7f01cbbc0700 1 -- 172.21.15.115:0/3842313980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c410ff20 con 0x7f01c40fb970 2024-04-16T14:27:51.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.561+0000 7f01ba7fc700 1 -- 172.21.15.115:0/3842313980 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f01c00129d0 con 0x7f01c40fb970 2024-04-16T14:27:51.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.561+0000 7f01cbbc0700 1 -- 172.21.15.115:0/3842313980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c41103b0 con 0x7f01c40fb970 2024-04-16T14:27:51.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.562+0000 7f01ba7fc700 1 -- 172.21.15.115:0/3842313980 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 43431+0+0 (secure 0 0 0) 0x7f01c0019040 con 0x7f01c40fb970 2024-04-16T14:27:51.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.562+0000 7f01cbbc0700 1 -- 172.21.15.115:0/3842313980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c4105930 con 0x7f01c40fb970 2024-04-16T14:27:51.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.562+0000 7f01ba7fc700 1 --2- 172.21.15.115:0/3842313980 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f01b0036880 0x7f01b0038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:51.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.562+0000 7f01ba7fc700 1 -- 172.21.15.115:0/3842313980 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f01c004a360 con 0x7f01c40fb970 2024-04-16T14:27:51.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.562+0000 7f01c915b700 1 --2- 172.21.15.115:0/3842313980 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f01b0036880 0x7f01b0038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:51.562 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.563+0000 7f01c915b700 1 --2- 172.21.15.115:0/3842313980 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f01b0036880 0x7f01b0038d30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009990 tx=0x7f01b4006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:51.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.567+0000 7f01ba7fc700 1 -- 172.21.15.115:0/3842313980 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f01c002eb40 con 0x7f01c40fb970 2024-04-16T14:27:51.825 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.827+0000 7f01cbbc0700 1 -- 172.21.15.115:0/3842313980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f01c405f5f0 con 0x7f01c40fb970 2024-04-16T14:27:51.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.828+0000 7f01ba7fc700 1 -- 172.21.15.115:0/3842313980 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f01c0017020 con 0x7f01c40fb970 2024-04-16T14:27:51.827 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:27:51.827 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":1,"fsid":"10609bfa-fbfd-11ee-bc90-c7b262605968","modified":"2024-04-16T14:25:42.269119Z","created":"2024-04-16T14:25:42.269119Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi005","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-16T14:27:51.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.829+0000 7f01cbbc0700 1 -- 172.21.15.115:0/3842313980 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f01b0036880 msgr2=0x7f01b0038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:51.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.829+0000 7f01cbbc0700 1 --2- 172.21.15.115:0/3842313980 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f01b0036880 0x7f01b0038d30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009990 tx=0x7f01b4006e40 comp rx=0 tx=0).stop 2024-04-16T14:27:51.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.829+0000 7f01cbbc0700 1 -- 172.21.15.115:0/3842313980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c40fb970 msgr2=0x7f01c4065c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:51.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.829+0000 7f01cbbc0700 1 --2- 172.21.15.115:0/3842313980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c40fb970 0x7f01c4065c40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009500 tx=0x7f01c0004d10 comp rx=0 tx=0).stop 2024-04-16T14:27:51.829 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.829+0000 7f01cbbc0700 1 -- 172.21.15.115:0/3842313980 shutdown_connections 2024-04-16T14:27:51.830 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.829+0000 7f01cbbc0700 1 --2- 172.21.15.115:0/3842313980 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f01b0036880 0x7f01b0038d30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:51.830 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.829+0000 7f01cbbc0700 1 --2- 172.21.15.115:0/3842313980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01c40fb970 0x7f01c4065c40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:51.830 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.829+0000 7f01cbbc0700 1 -- 172.21.15.115:0/3842313980 >> 172.21.15.115:0/3842313980 conn(0x7f01c40f70d0 msgr2=0x7f01c4102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:51.830 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.829+0000 7f01cbbc0700 1 -- 172.21.15.115:0/3842313980 shutdown_connections 2024-04-16T14:27:51.830 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:51.830+0000 7f01cbbc0700 1 -- 172.21.15.115:0/3842313980 wait complete. 2024-04-16T14:27:51.830 INFO:teuthology.orchestra.run.smithi115.stderr:dumped monmap epoch 1 2024-04-16T14:27:52.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:52 smithi005 ceph-mon[28964]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:27:52.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:52 smithi005 ceph-mon[28964]: from='client.? 172.21.15.115:0/3842313980' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:27:53.380 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-16T14:27:53.380 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph mon dump -f json 2024-04-16T14:27:53.633 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-16T14:27:53.681 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-16T14:27:54.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:54 smithi005 ceph-mon[28964]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:27:55.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.027+0000 7fbcbc56d700 1 -- 172.21.15.115:0/646844066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcb40fbf90 msgr2=0x7fbcb40fc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:55.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.027+0000 7fbcbc56d700 1 --2- 172.21.15.115:0/646844066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcb40fbf90 0x7fbcb40fc3a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00048c0 tx=0x7fbcb0009e30 comp rx=0 tx=0).stop 2024-04-16T14:27:55.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.027+0000 7fbcbc56d700 1 -- 172.21.15.115:0/646844066 shutdown_connections 2024-04-16T14:27:55.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.027+0000 7fbcbc56d700 1 --2- 172.21.15.115:0/646844066 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcb40fbf90 0x7fbcb40fc3a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:55.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.027+0000 7fbcbc56d700 1 -- 172.21.15.115:0/646844066 >> 172.21.15.115:0/646844066 conn(0x7fbcb40f6860 msgr2=0x7fbcb40f8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:55.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.027+0000 7fbcbc56d700 1 -- 172.21.15.115:0/646844066 shutdown_connections 2024-04-16T14:27:55.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.027+0000 7fbcbc56d700 1 -- 172.21.15.115:0/646844066 wait complete. 2024-04-16T14:27:55.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.027+0000 7fbcbc56d700 1 Processor -- start 2024-04-16T14:27:55.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.027+0000 7fbcbc56d700 1 -- start start 2024-04-16T14:27:55.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.027+0000 7fbcbc56d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcb40fbf90 0x7fbcb410bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:55.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.028+0000 7fbcbc56d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb410c500 con 0x7fbcb40fbf90 2024-04-16T14:27:55.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.028+0000 7fbcba309700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcb40fbf90 0x7fbcb410bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:55.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.028+0000 7fbcba309700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcb40fbf90 0x7fbcb410bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.115:41312/0 (socket says 172.21.15.115:41312) 2024-04-16T14:27:55.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.028+0000 7fbcba309700 1 -- 172.21.15.115:0/309817504 learned_addr learned my addr 172.21.15.115:0/309817504 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-04-16T14:27:55.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.028+0000 7fbcba309700 1 -- 172.21.15.115:0/309817504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb0005040 con 0x7fbcb40fbf90 2024-04-16T14:27:55.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.028+0000 7fbcba309700 1 --2- 172.21.15.115:0/309817504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcb40fbf90 0x7fbcb410bfc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0009680 tx=0x7fbcb0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:55.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.028+0000 7fbcaaffd700 1 -- 172.21.15.115:0/309817504 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbcb000b5c0 con 0x7fbcb40fbf90 2024-04-16T14:27:55.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.028+0000 7fbcbc56d700 1 -- 172.21.15.115:0/309817504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb410c700 con 0x7fbcb40fbf90 2024-04-16T14:27:55.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.028+0000 7fbcaaffd700 1 -- 172.21.15.115:0/309817504 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbcb000be70 con 0x7fbcb40fbf90 2024-04-16T14:27:55.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.028+0000 7fbcaaffd700 1 -- 172.21.15.115:0/309817504 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbcb00135a0 con 0x7fbcb40fbf90 2024-04-16T14:27:55.029 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.028+0000 7fbcbc56d700 1 -- 172.21.15.115:0/309817504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb410d270 con 0x7fbcb40fbf90 2024-04-16T14:27:55.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.029+0000 7fbcaaffd700 1 -- 172.21.15.115:0/309817504 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 43431+0+0 (secure 0 0 0) 0x7fbcb001c430 con 0x7fbcb40fbf90 2024-04-16T14:27:55.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.029+0000 7fbcbc56d700 1 -- 172.21.15.115:0/309817504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb4101e80 con 0x7fbcb40fbf90 2024-04-16T14:27:55.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.030+0000 7fbcaaffd700 1 --2- 172.21.15.115:0/309817504 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fbca0036880 0x7fbca0038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:55.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.030+0000 7fbcaaffd700 1 -- 172.21.15.115:0/309817504 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fbcb00493a0 con 0x7fbcb40fbf90 2024-04-16T14:27:55.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.030+0000 7fbcb9b08700 1 --2- 172.21.15.115:0/309817504 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fbca0036880 0x7fbca0038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:55.030 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.030+0000 7fbcb9b08700 1 --2- 172.21.15.115:0/309817504 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fbca0036880 0x7fbca0038d30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbca4009990 tx=0x7fbca4006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:55.033 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.035+0000 7fbcaaffd700 1 -- 172.21.15.115:0/309817504 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fbcb001c7d0 con 0x7fbcb40fbf90 2024-04-16T14:27:55.292 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.294+0000 7fbcbc56d700 1 -- 172.21.15.115:0/309817504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fbcb410dc80 con 0x7fbcb40fbf90 2024-04-16T14:27:55.293 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.294+0000 7fbcaaffd700 1 -- 172.21.15.115:0/309817504 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7fbcb0021070 con 0x7fbcb40fbf90 2024-04-16T14:27:55.293 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:27:55.293 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":1,"fsid":"10609bfa-fbfd-11ee-bc90-c7b262605968","modified":"2024-04-16T14:25:42.269119Z","created":"2024-04-16T14:25:42.269119Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi005","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-16T14:27:55.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.296+0000 7fbcbc56d700 1 -- 172.21.15.115:0/309817504 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fbca0036880 msgr2=0x7fbca0038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:55.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.296+0000 7fbcbc56d700 1 --2- 172.21.15.115:0/309817504 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fbca0036880 0x7fbca0038d30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbca4009990 tx=0x7fbca4006e40 comp rx=0 tx=0).stop 2024-04-16T14:27:55.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.296+0000 7fbcbc56d700 1 -- 172.21.15.115:0/309817504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcb40fbf90 msgr2=0x7fbcb410bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:55.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.296+0000 7fbcbc56d700 1 --2- 172.21.15.115:0/309817504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcb40fbf90 0x7fbcb410bfc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0009680 tx=0x7fbcb0009e30 comp rx=0 tx=0).stop 2024-04-16T14:27:55.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.296+0000 7fbcbc56d700 1 -- 172.21.15.115:0/309817504 shutdown_connections 2024-04-16T14:27:55.295 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.296+0000 7fbcbc56d700 1 --2- 172.21.15.115:0/309817504 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fbca0036880 0x7fbca0038d30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:55.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.296+0000 7fbcbc56d700 1 --2- 172.21.15.115:0/309817504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbcb40fbf90 0x7fbcb410bfc0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:55.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.297+0000 7fbcbc56d700 1 -- 172.21.15.115:0/309817504 >> 172.21.15.115:0/309817504 conn(0x7fbcb40f6860 msgr2=0x7fbcb4102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:55.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.297+0000 7fbcbc56d700 1 -- 172.21.15.115:0/309817504 shutdown_connections 2024-04-16T14:27:55.296 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:55.297+0000 7fbcbc56d700 1 -- 172.21.15.115:0/309817504 wait complete. 2024-04-16T14:27:55.296 INFO:teuthology.orchestra.run.smithi115.stderr:dumped monmap epoch 1 2024-04-16T14:27:56.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:55 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:56.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:55 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:56.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:55 smithi005 ceph-mon[28964]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:27:56.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:55 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:27:56.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:55 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-04-16T14:27:56.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:55 smithi005 ceph-mon[28964]: from='client.? 172.21.15.115:0/309817504' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:27:56.873 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-16T14:27:56.873 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph mon dump -f json 2024-04-16T14:27:57.126 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-16T14:27:57.174 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-16T14:27:57.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:56 smithi005 ceph-mon[28964]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-04-16T14:27:57.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:56 smithi005 ceph-mon[28964]: mgrmap e14: smithi005.ipwdkc(active, since 67s) 2024-04-16T14:27:58.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.456+0000 7fe608bb8700 1 -- 172.21.15.115:0/3037695480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6040fca70 msgr2=0x7fe6040fce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:58.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.456+0000 7fe608bb8700 1 --2- 172.21.15.115:0/3037695480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6040fca70 0x7fe6040fce80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0048c0 tx=0x7fe5fc009e30 comp rx=0 tx=0).stop 2024-04-16T14:27:58.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.456+0000 7fe608bb8700 1 -- 172.21.15.115:0/3037695480 shutdown_connections 2024-04-16T14:27:58.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.456+0000 7fe608bb8700 1 --2- 172.21.15.115:0/3037695480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6040fca70 0x7fe6040fce80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:58.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.456+0000 7fe608bb8700 1 -- 172.21.15.115:0/3037695480 >> 172.21.15.115:0/3037695480 conn(0x7fe6040f81d0 msgr2=0x7fe6040fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:58.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.456+0000 7fe608bb8700 1 -- 172.21.15.115:0/3037695480 shutdown_connections 2024-04-16T14:27:58.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.457+0000 7fe608bb8700 1 -- 172.21.15.115:0/3037695480 wait complete. 2024-04-16T14:27:58.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.457+0000 7fe608bb8700 1 Processor -- start 2024-04-16T14:27:58.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.457+0000 7fe608bb8700 1 -- start start 2024-04-16T14:27:58.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.457+0000 7fe608bb8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6040fca70 0x7fe604071d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:58.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.457+0000 7fe608bb8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6040722a0 con 0x7fe6040fca70 2024-04-16T14:27:58.457 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.457+0000 7fe60259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6040fca70 0x7fe604071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:27:58.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.457+0000 7fe60259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6040fca70 0x7fe604071d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.115:41328/0 (socket says 172.21.15.115:41328) 2024-04-16T14:27:58.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.457+0000 7fe60259c700 1 -- 172.21.15.115:0/2925225303 learned_addr learned my addr 172.21.15.115:0/2925225303 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-04-16T14:27:58.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.458+0000 7fe60259c700 1 -- 172.21.15.115:0/2925225303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc005040 con 0x7fe6040fca70 2024-04-16T14:27:58.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.458+0000 7fe60259c700 1 --2- 172.21.15.115:0/2925225303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6040fca70 0x7fe604071d60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0096b0 tx=0x7fe5fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:27:58.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.458+0000 7fe5faffd700 1 -- 172.21.15.115:0/2925225303 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe5fc00bed0 con 0x7fe6040fca70 2024-04-16T14:27:58.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.458+0000 7fe5faffd700 1 -- 172.21.15.115:0/2925225303 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe5fc00b5c0 con 0x7fe6040fca70 2024-04-16T14:27:58.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.458+0000 7fe5faffd700 1 -- 172.21.15.115:0/2925225303 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe5fc01c5b0 con 0x7fe6040fca70 2024-04-16T14:27:58.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.458+0000 7fe608bb8700 1 -- 172.21.15.115:0/2925225303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe604070370 con 0x7fe6040fca70 2024-04-16T14:27:58.458 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.458+0000 7fe608bb8700 1 -- 172.21.15.115:0/2925225303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe604070860 con 0x7fe6040fca70 2024-04-16T14:27:58.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.459+0000 7fe5faffd700 1 -- 172.21.15.115:0/2925225303 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 14) v1 ==== 43445+0+0 (secure 0 0 0) 0x7fe5fc01c710 con 0x7fe6040fca70 2024-04-16T14:27:58.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.459+0000 7fe5faffd700 1 --2- 172.21.15.115:0/2925225303 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fe5f0036920 0x7fe5f0038dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:27:58.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.459+0000 7fe5faffd700 1 -- 172.21.15.115:0/2925225303 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe5fc049af0 con 0x7fe6040fca70 2024-04-16T14:27:58.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.459+0000 7fe608bb8700 1 -- 172.21.15.115:0/2925225303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe60405f5f0 con 0x7fe6040fca70 2024-04-16T14:27:58.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.459+0000 7fe601d9b700 1 -- 172.21.15.115:0/2925225303 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fe5f0036920 msgr2=0x7fe5f0038dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/4176454319 2024-04-16T14:27:58.459 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.459+0000 7fe601d9b700 1 --2- 172.21.15.115:0/2925225303 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fe5f0036920 0x7fe5f0038dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T14:27:58.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.464+0000 7fe5faffd700 1 -- 172.21.15.115:0/2925225303 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe5fc025400 con 0x7fe6040fca70 2024-04-16T14:27:58.658 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.660+0000 7fe601d9b700 1 -- 172.21.15.115:0/2925225303 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fe5f0036920 msgr2=0x7fe5f0038dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/4176454319 2024-04-16T14:27:58.659 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.660+0000 7fe601d9b700 1 --2- 172.21.15.115:0/2925225303 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fe5f0036920 0x7fe5f0038dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-16T14:27:58.727 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.729+0000 7fe608bb8700 1 -- 172.21.15.115:0/2925225303 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe60404bed0 con 0x7fe6040fca70 2024-04-16T14:27:58.728 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.729+0000 7fe5faffd700 1 -- 172.21.15.115:0/2925225303 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7fe5fc011b60 con 0x7fe6040fca70 2024-04-16T14:27:58.728 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:27:58.728 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":1,"fsid":"10609bfa-fbfd-11ee-bc90-c7b262605968","modified":"2024-04-16T14:25:42.269119Z","created":"2024-04-16T14:25:42.269119Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi005","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-16T14:27:58.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.731+0000 7fe608bb8700 1 -- 172.21.15.115:0/2925225303 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fe5f0036920 msgr2=0x7fe5f0038dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T14:27:58.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.731+0000 7fe608bb8700 1 --2- 172.21.15.115:0/2925225303 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fe5f0036920 0x7fe5f0038dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:58.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.731+0000 7fe608bb8700 1 -- 172.21.15.115:0/2925225303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6040fca70 msgr2=0x7fe604071d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:27:58.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.731+0000 7fe608bb8700 1 --2- 172.21.15.115:0/2925225303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6040fca70 0x7fe604071d60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0096b0 tx=0x7fe5fc009e30 comp rx=0 tx=0).stop 2024-04-16T14:27:58.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.731+0000 7fe608bb8700 1 -- 172.21.15.115:0/2925225303 shutdown_connections 2024-04-16T14:27:58.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.731+0000 7fe608bb8700 1 --2- 172.21.15.115:0/2925225303 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7fe5f0036920 0x7fe5f0038dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:58.730 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.731+0000 7fe608bb8700 1 --2- 172.21.15.115:0/2925225303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe6040fca70 0x7fe604071d60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:27:58.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.731+0000 7fe608bb8700 1 -- 172.21.15.115:0/2925225303 >> 172.21.15.115:0/2925225303 conn(0x7fe6040f81d0 msgr2=0x7fe604103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:27:58.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.731+0000 7fe608bb8700 1 -- 172.21.15.115:0/2925225303 shutdown_connections 2024-04-16T14:27:58.731 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:27:58.731+0000 7fe608bb8700 1 -- 172.21.15.115:0/2925225303 wait complete. 2024-04-16T14:27:58.731 INFO:teuthology.orchestra.run.smithi115.stderr:dumped monmap epoch 1 2024-04-16T14:27:59.223 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:27:58 smithi005 ceph-mon[28964]: from='client.? 172.21.15.115:0/2925225303' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:28:00.268 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-16T14:28:00.268 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph mon dump -f json 2024-04-16T14:28:00.524 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-16T14:28:00.570 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-16T14:28:02.000 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.000+0000 7f182853c700 1 -- 172.21.15.115:0/3363890945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18200fb970 msgr2=0x7f18200fbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:28:02.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.000+0000 7f182853c700 1 --2- 172.21.15.115:0/3363890945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18200fb970 0x7f18200fbd80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f181c0048c0 tx=0x7f181c009e30 comp rx=0 tx=0).stop 2024-04-16T14:28:02.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.000+0000 7f182853c700 1 -- 172.21.15.115:0/3363890945 shutdown_connections 2024-04-16T14:28:02.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.000+0000 7f182853c700 1 --2- 172.21.15.115:0/3363890945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18200fb970 0x7f18200fbd80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:02.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.000+0000 7f182853c700 1 -- 172.21.15.115:0/3363890945 >> 172.21.15.115:0/3363890945 conn(0x7f18200f70d0 msgr2=0x7f18200f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:28:02.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.001+0000 7f182853c700 1 -- 172.21.15.115:0/3363890945 shutdown_connections 2024-04-16T14:28:02.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.001+0000 7f182853c700 1 -- 172.21.15.115:0/3363890945 wait complete. 2024-04-16T14:28:02.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.001+0000 7f182853c700 1 Processor -- start 2024-04-16T14:28:02.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.001+0000 7f182853c700 1 -- start start 2024-04-16T14:28:02.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.001+0000 7f182853c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18200fb970 0x7f182010f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:28:02.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.001+0000 7f182853c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182010f7f0 con 0x7f18200fb970 2024-04-16T14:28:02.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.001+0000 7f18262d8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18200fb970 0x7f182010f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:28:02.001 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.001+0000 7f18262d8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18200fb970 0x7f182010f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.115:58788/0 (socket says 172.21.15.115:58788) 2024-04-16T14:28:02.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.001+0000 7f18262d8700 1 -- 172.21.15.115:0/1604611136 learned_addr learned my addr 172.21.15.115:0/1604611136 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-04-16T14:28:02.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.002+0000 7f18262d8700 1 -- 172.21.15.115:0/1604611136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181c005040 con 0x7f18200fb970 2024-04-16T14:28:02.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.002+0000 7f18262d8700 1 --2- 172.21.15.115:0/1604611136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18200fb970 0x7f182010f2b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f181c009680 tx=0x7f181c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:28:02.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.002+0000 7f1816ffd700 1 -- 172.21.15.115:0/1604611136 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f181c00b5c0 con 0x7f18200fb970 2024-04-16T14:28:02.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.002+0000 7f182853c700 1 -- 172.21.15.115:0/1604611136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f182010f9f0 con 0x7f18200fb970 2024-04-16T14:28:02.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.002+0000 7f1816ffd700 1 -- 172.21.15.115:0/1604611136 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f181c00be70 con 0x7f18200fb970 2024-04-16T14:28:02.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.002+0000 7f182853c700 1 -- 172.21.15.115:0/1604611136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1820110560 con 0x7f18200fb970 2024-04-16T14:28:02.002 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.002+0000 7f1816ffd700 1 -- 172.21.15.115:0/1604611136 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f181c013580 con 0x7f18200fb970 2024-04-16T14:28:02.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.003+0000 7f1816ffd700 1 -- 172.21.15.115:0/1604611136 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 14) v1 ==== 43445+0+0 (secure 0 0 0) 0x7f181c01c430 con 0x7f18200fb970 2024-04-16T14:28:02.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.003+0000 7f182853c700 1 -- 172.21.15.115:0/1604611136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1820101e80 con 0x7f18200fb970 2024-04-16T14:28:02.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.003+0000 7f1816ffd700 1 --2- 172.21.15.115:0/1604611136 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f180c036920 0x7f180c038dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:28:02.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.003+0000 7f1816ffd700 1 -- 172.21.15.115:0/1604611136 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f181c049470 con 0x7f18200fb970 2024-04-16T14:28:02.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.003+0000 7f1825ad7700 1 -- 172.21.15.115:0/1604611136 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f180c036920 msgr2=0x7f180c038dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/4176454319 2024-04-16T14:28:02.003 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.003+0000 7f1825ad7700 1 --2- 172.21.15.115:0/1604611136 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f180c036920 0x7f180c038dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T14:28:02.010 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.012+0000 7f1816ffd700 1 -- 172.21.15.115:0/1604611136 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f181c004d30 con 0x7f18200fb970 2024-04-16T14:28:02.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.204+0000 7f1825ad7700 1 -- 172.21.15.115:0/1604611136 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f180c036920 msgr2=0x7f180c038dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/4176454319 2024-04-16T14:28:02.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.204+0000 7f1825ad7700 1 --2- 172.21.15.115:0/1604611136 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f180c036920 0x7f180c038dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-16T14:28:02.272 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.273+0000 7f182853c700 1 -- 172.21.15.115:0/1604611136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f18201107a0 con 0x7f18200fb970 2024-04-16T14:28:02.272 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.274+0000 7f1816ffd700 1 -- 172.21.15.115:0/1604611136 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f181c021070 con 0x7f18200fb970 2024-04-16T14:28:02.273 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:28:02.273 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":1,"fsid":"10609bfa-fbfd-11ee-bc90-c7b262605968","modified":"2024-04-16T14:25:42.269119Z","created":"2024-04-16T14:25:42.269119Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi005","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-16T14:28:02.274 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.276+0000 7f182853c700 1 -- 172.21.15.115:0/1604611136 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f180c036920 msgr2=0x7f180c038dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T14:28:02.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.276+0000 7f182853c700 1 --2- 172.21.15.115:0/1604611136 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f180c036920 0x7f180c038dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:02.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.276+0000 7f182853c700 1 -- 172.21.15.115:0/1604611136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18200fb970 msgr2=0x7f182010f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:28:02.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.276+0000 7f182853c700 1 --2- 172.21.15.115:0/1604611136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18200fb970 0x7f182010f2b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f181c009680 tx=0x7f181c009e30 comp rx=0 tx=0).stop 2024-04-16T14:28:02.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.276+0000 7f182853c700 1 -- 172.21.15.115:0/1604611136 shutdown_connections 2024-04-16T14:28:02.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.276+0000 7f182853c700 1 --2- 172.21.15.115:0/1604611136 >> [v2:172.21.15.5:6800/4176454319,v1:172.21.15.5:6801/4176454319] conn(0x7f180c036920 0x7f180c038dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:02.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.276+0000 7f182853c700 1 --2- 172.21.15.115:0/1604611136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18200fb970 0x7f182010f2b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:02.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.276+0000 7f182853c700 1 -- 172.21.15.115:0/1604611136 >> 172.21.15.115:0/1604611136 conn(0x7f18200f70d0 msgr2=0x7f18200f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:28:02.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.276+0000 7f182853c700 1 -- 172.21.15.115:0/1604611136 shutdown_connections 2024-04-16T14:28:02.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:02.276+0000 7f182853c700 1 -- 172.21.15.115:0/1604611136 wait complete. 2024-04-16T14:28:02.276 INFO:teuthology.orchestra.run.smithi115.stderr:dumped monmap epoch 1 2024-04-16T14:28:02.452 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:02 smithi005 ceph-mon[28964]: from='client.? 172.21.15.115:0/1604611136' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:28:03.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:03 smithi005 ceph-mon[28964]: Active manager daemon smithi005.ipwdkc restarted 2024-04-16T14:28:03.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:03 smithi005 ceph-mon[28964]: Activating manager daemon smithi005.ipwdkc 2024-04-16T14:28:03.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:03 smithi005 ceph-mon[28964]: osdmap e5: 0 total, 0 up, 0 in 2024-04-16T14:28:03.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:03 smithi005 ceph-mon[28964]: mgrmap e15: smithi005.ipwdkc(active, starting, since 0.00318795s) 2024-04-16T14:28:03.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:03 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-04-16T14:28:03.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:03 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr metadata", "who": "smithi005.ipwdkc", "id": "smithi005.ipwdkc"}]: dispatch 2024-04-16T14:28:03.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:03 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-16T14:28:03.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:03 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-16T14:28:03.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:03 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-16T14:28:03.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:03 smithi005 ceph-mon[28964]: Manager daemon smithi005.ipwdkc is now available 2024-04-16T14:28:03.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:03 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:28:03.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:03 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:28:03.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:03 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:03.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:03 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:28:03.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:03 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi005.ipwdkc/mirror_snapshot_schedule"}]: dispatch 2024-04-16T14:28:03.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:03 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi005.ipwdkc/trash_purge_schedule"}]: dispatch 2024-04-16T14:28:03.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:03 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:03.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:03 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:03.930 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-16T14:28:03.930 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph mon dump -f json 2024-04-16T14:28:04.178 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-16T14:28:04.230 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-16T14:28:04.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:04 smithi005 ceph-mon[28964]: [16/Apr/2024:14:28:03] ENGINE Bus STARTING 2024-04-16T14:28:04.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:04 smithi005 ceph-mon[28964]: [16/Apr/2024:14:28:03] ENGINE Serving on https://172.21.15.5:7150 2024-04-16T14:28:04.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:04 smithi005 ceph-mon[28964]: [16/Apr/2024:14:28:03] ENGINE Bus STARTED 2024-04-16T14:28:04.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:04 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:04.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:04 smithi005 ceph-mon[28964]: mgrmap e16: smithi005.ipwdkc(active, since 1.0054s) 2024-04-16T14:28:04.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:04 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:06.723 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:06 smithi005 ceph-mon[28964]: mgrmap e17: smithi005.ipwdkc(active, since 2s) 2024-04-16T14:28:06.797 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.799+0000 7fcd4e25d700 1 -- 172.21.15.115:0/595620162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd480fca60 msgr2=0x7fcd480fce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:28:06.797 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.799+0000 7fcd4e25d700 1 --2- 172.21.15.115:0/595620162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd480fca60 0x7fcd480fce70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcd380048c0 tx=0x7fcd38009e30 comp rx=0 tx=0).stop 2024-04-16T14:28:06.797 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.799+0000 7fcd4e25d700 1 -- 172.21.15.115:0/595620162 shutdown_connections 2024-04-16T14:28:06.797 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.799+0000 7fcd4e25d700 1 --2- 172.21.15.115:0/595620162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd480fca60 0x7fcd480fce70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:06.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.799+0000 7fcd4e25d700 1 -- 172.21.15.115:0/595620162 >> 172.21.15.115:0/595620162 conn(0x7fcd480f81c0 msgr2=0x7fcd480fa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:28:06.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.799+0000 7fcd4e25d700 1 -- 172.21.15.115:0/595620162 shutdown_connections 2024-04-16T14:28:06.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.799+0000 7fcd4e25d700 1 -- 172.21.15.115:0/595620162 wait complete. 2024-04-16T14:28:06.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.799+0000 7fcd4e25d700 1 Processor -- start 2024-04-16T14:28:06.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.800+0000 7fcd4e25d700 1 -- start start 2024-04-16T14:28:06.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.800+0000 7fcd4e25d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd480fca60 0x7fcd4810d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:28:06.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.800+0000 7fcd4e25d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4810d5f0 con 0x7fcd480fca60 2024-04-16T14:28:06.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.800+0000 7fcd477fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd480fca60 0x7fcd4810d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:28:06.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.800+0000 7fcd477fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd480fca60 0x7fcd4810d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.115:58798/0 (socket says 172.21.15.115:58798) 2024-04-16T14:28:06.798 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.800+0000 7fcd477fe700 1 -- 172.21.15.115:0/2415125903 learned_addr learned my addr 172.21.15.115:0/2415125903 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-04-16T14:28:06.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.800+0000 7fcd477fe700 1 -- 172.21.15.115:0/2415125903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd38005040 con 0x7fcd480fca60 2024-04-16T14:28:06.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.800+0000 7fcd477fe700 1 --2- 172.21.15.115:0/2415125903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd480fca60 0x7fcd4810d0b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcd380096b0 tx=0x7fcd38009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:28:06.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.800+0000 7fcd2ffff700 1 -- 172.21.15.115:0/2415125903 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd3800bed0 con 0x7fcd480fca60 2024-04-16T14:28:06.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.801+0000 7fcd2ffff700 1 -- 172.21.15.115:0/2415125903 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd3800b5c0 con 0x7fcd480fca60 2024-04-16T14:28:06.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.801+0000 7fcd4e25d700 1 -- 172.21.15.115:0/2415125903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd4810d7f0 con 0x7fcd480fca60 2024-04-16T14:28:06.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.801+0000 7fcd2ffff700 1 -- 172.21.15.115:0/2415125903 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd3801c5b0 con 0x7fcd480fca60 2024-04-16T14:28:06.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.801+0000 7fcd4e25d700 1 -- 172.21.15.115:0/2415125903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd4810e360 con 0x7fcd480fca60 2024-04-16T14:28:06.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.801+0000 7fcd2ffff700 1 -- 172.21.15.115:0/2415125903 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 43487+0+0 (secure 0 0 0) 0x7fcd3801c820 con 0x7fcd480fca60 2024-04-16T14:28:06.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.802+0000 7fcd2ffff700 1 --2- 172.21.15.115:0/2415125903 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fcd30036970 0x7fcd30038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:28:06.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.802+0000 7fcd4e25d700 1 -- 172.21.15.115:0/2415125903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd48102f70 con 0x7fcd480fca60 2024-04-16T14:28:06.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.802+0000 7fcd2ffff700 1 -- 172.21.15.115:0/2415125903 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fcd38049df0 con 0x7fcd480fca60 2024-04-16T14:28:06.800 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.802+0000 7fcd46ffd700 1 --2- 172.21.15.115:0/2415125903 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fcd30036970 0x7fcd30038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:28:06.801 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.802+0000 7fcd46ffd700 1 --2- 172.21.15.115:0/2415125903 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fcd30036970 0x7fcd30038e20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009990 tx=0x7fcd3c006e40 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:28:06.804 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:06.807+0000 7fcd2ffff700 1 -- 172.21.15.115:0/2415125903 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fcd38023300 con 0x7fcd480fca60 2024-04-16T14:28:07.078 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:07.081+0000 7fcd4e25d700 1 -- 172.21.15.115:0/2415125903 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fcd4810ed70 con 0x7fcd480fca60 2024-04-16T14:28:07.079 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:07.081+0000 7fcd2ffff700 1 -- 172.21.15.115:0/2415125903 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7fcd38004d30 con 0x7fcd480fca60 2024-04-16T14:28:07.079 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:28:07.079 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":1,"fsid":"10609bfa-fbfd-11ee-bc90-c7b262605968","modified":"2024-04-16T14:25:42.269119Z","created":"2024-04-16T14:25:42.269119Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi005","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-16T14:28:07.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:07.083+0000 7fcd4e25d700 1 -- 172.21.15.115:0/2415125903 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fcd30036970 msgr2=0x7fcd30038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:28:07.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:07.083+0000 7fcd4e25d700 1 --2- 172.21.15.115:0/2415125903 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fcd30036970 0x7fcd30038e20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009990 tx=0x7fcd3c006e40 comp rx=0 tx=0).stop 2024-04-16T14:28:07.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:07.083+0000 7fcd4e25d700 1 -- 172.21.15.115:0/2415125903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd480fca60 msgr2=0x7fcd4810d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:28:07.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:07.083+0000 7fcd4e25d700 1 --2- 172.21.15.115:0/2415125903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd480fca60 0x7fcd4810d0b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcd380096b0 tx=0x7fcd38009e30 comp rx=0 tx=0).stop 2024-04-16T14:28:07.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:07.083+0000 7fcd4e25d700 1 -- 172.21.15.115:0/2415125903 shutdown_connections 2024-04-16T14:28:07.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:07.083+0000 7fcd4e25d700 1 --2- 172.21.15.115:0/2415125903 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fcd30036970 0x7fcd30038e20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:07.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:07.083+0000 7fcd4e25d700 1 --2- 172.21.15.115:0/2415125903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd480fca60 0x7fcd4810d0b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:07.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:07.083+0000 7fcd4e25d700 1 -- 172.21.15.115:0/2415125903 >> 172.21.15.115:0/2415125903 conn(0x7fcd480f81c0 msgr2=0x7fcd48103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:28:07.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:07.083+0000 7fcd4e25d700 1 -- 172.21.15.115:0/2415125903 shutdown_connections 2024-04-16T14:28:07.081 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:07.083+0000 7fcd4e25d700 1 -- 172.21.15.115:0/2415125903 wait complete. 2024-04-16T14:28:07.082 INFO:teuthology.orchestra.run.smithi115.stderr:dumped monmap epoch 1 2024-04-16T14:28:08.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:07 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:08.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:07 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:08.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:07 smithi005 ceph-mon[28964]: from='client.? 172.21.15.115:0/2415125903' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:28:08.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:07 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:08.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:07 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:08.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:07 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd/host:smithi005", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:28:08.785 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-16T14:28:08.785 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph mon dump -f json 2024-04-16T14:28:09.037 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.conf 2024-04-16T14:28:09.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:09 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:09.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:09 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:09.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:09 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:09.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:09 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:09.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:09 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd/host:smithi115", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:28:09.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:09 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:28:09.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:09 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:28:09.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:09 smithi005 ceph-mon[28964]: Updating smithi005:/etc/ceph/ceph.conf 2024-04-16T14:28:09.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:09 smithi005 ceph-mon[28964]: Updating smithi115:/etc/ceph/ceph.conf 2024-04-16T14:28:09.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:09 smithi005 ceph-mon[28964]: Updating smithi005:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.conf 2024-04-16T14:28:09.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:09 smithi005 ceph-mon[28964]: Updating smithi115:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.conf 2024-04-16T14:28:09.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:09 smithi005 ceph-mon[28964]: Updating smithi005:/etc/ceph/ceph.client.admin.keyring 2024-04-16T14:28:09.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:09 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:09.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:09 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:09.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:09 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:09.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:09 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:09.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:09 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:09.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:09 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi115", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-16T14:28:09.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:09 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi115", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-16T14:28:09.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:09 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:28:10.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.507+0000 7f6cbb985700 1 -- 172.21.15.115:0/2655292755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cb4102ad0 msgr2=0x7f6cb4102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:28:10.507 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.507+0000 7f6cbb985700 1 --2- 172.21.15.115:0/2655292755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cb4102ad0 0x7f6cb4102ea0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6cb00048c0 tx=0x7f6cb0009e30 comp rx=0 tx=0).stop 2024-04-16T14:28:10.508 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.507+0000 7f6cbb985700 1 -- 172.21.15.115:0/2655292755 shutdown_connections 2024-04-16T14:28:10.508 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.507+0000 7f6cbb985700 1 --2- 172.21.15.115:0/2655292755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cb4102ad0 0x7f6cb4102ea0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:10.508 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.507+0000 7f6cbb985700 1 -- 172.21.15.115:0/2655292755 >> 172.21.15.115:0/2655292755 conn(0x7f6cb40f85d0 msgr2=0x7f6cb40fa9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:28:10.508 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.507+0000 7f6cbb985700 1 -- 172.21.15.115:0/2655292755 shutdown_connections 2024-04-16T14:28:10.508 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.507+0000 7f6cbb985700 1 -- 172.21.15.115:0/2655292755 wait complete. 2024-04-16T14:28:10.508 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.508+0000 7f6cbb985700 1 Processor -- start 2024-04-16T14:28:10.508 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.508+0000 7f6cbb985700 1 -- start start 2024-04-16T14:28:10.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.508+0000 7f6cbb985700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cb4102ad0 0x7f6cb4113180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:28:10.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.508+0000 7f6cbb985700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb41136c0 con 0x7f6cb4102ad0 2024-04-16T14:28:10.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.508+0000 7f6cb9721700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cb4102ad0 0x7f6cb4113180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:28:10.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.508+0000 7f6cb9721700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cb4102ad0 0x7f6cb4113180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.115:58816/0 (socket says 172.21.15.115:58816) 2024-04-16T14:28:10.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.508+0000 7f6cb9721700 1 -- 172.21.15.115:0/2855793757 learned_addr learned my addr 172.21.15.115:0/2855793757 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-04-16T14:28:10.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.509+0000 7f6cb9721700 1 -- 172.21.15.115:0/2855793757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb0005040 con 0x7f6cb4102ad0 2024-04-16T14:28:10.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.509+0000 7f6cb9721700 1 --2- 172.21.15.115:0/2855793757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cb4102ad0 0x7f6cb4113180 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000b7f0 tx=0x7f6cb0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:28:10.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.509+0000 7f6ca9ffb700 1 -- 172.21.15.115:0/2855793757 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6cb0009370 con 0x7f6cb4102ad0 2024-04-16T14:28:10.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.509+0000 7f6cbb985700 1 -- 172.21.15.115:0/2855793757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb41138c0 con 0x7f6cb4102ad0 2024-04-16T14:28:10.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.509+0000 7f6ca9ffb700 1 -- 172.21.15.115:0/2855793757 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6cb0013420 con 0x7f6cb4102ad0 2024-04-16T14:28:10.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.509+0000 7f6ca9ffb700 1 -- 172.21.15.115:0/2855793757 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6cb001c590 con 0x7f6cb4102ad0 2024-04-16T14:28:10.510 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.509+0000 7f6cbb985700 1 -- 172.21.15.115:0/2855793757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb4113db0 con 0x7f6cb4102ad0 2024-04-16T14:28:10.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.510+0000 7f6cbb985700 1 -- 172.21.15.115:0/2855793757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb40fe1d0 con 0x7f6cb4102ad0 2024-04-16T14:28:10.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.510+0000 7f6ca9ffb700 1 -- 172.21.15.115:0/2855793757 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 43487+0+0 (secure 0 0 0) 0x7f6cb0013a70 con 0x7f6cb4102ad0 2024-04-16T14:28:10.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.510+0000 7f6ca9ffb700 1 --2- 172.21.15.115:0/2855793757 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6ca0036970 0x7f6ca0038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:28:10.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.510+0000 7f6ca9ffb700 1 -- 172.21.15.115:0/2855793757 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f6cb0049470 con 0x7f6cb4102ad0 2024-04-16T14:28:10.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.511+0000 7f6cb8f20700 1 --2- 172.21.15.115:0/2855793757 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6ca0036970 0x7f6ca0038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:28:10.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.511+0000 7f6cb8f20700 1 --2- 172.21.15.115:0/2855793757 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6ca0036970 0x7f6ca0038e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4009990 tx=0x7f6ca4006e40 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:28:10.513 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.516+0000 7f6ca9ffb700 1 -- 172.21.15.115:0/2855793757 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6cb0024d30 con 0x7f6cb4102ad0 2024-04-16T14:28:10.781 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.784+0000 7f6cbb985700 1 -- 172.21.15.115:0/2855793757 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6cb405f5f0 con 0x7f6cb4102ad0 2024-04-16T14:28:10.782 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.784+0000 7f6ca9ffb700 1 -- 172.21.15.115:0/2855793757 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f6cb0021070 con 0x7f6cb4102ad0 2024-04-16T14:28:10.782 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:28:10.782 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":1,"fsid":"10609bfa-fbfd-11ee-bc90-c7b262605968","modified":"2024-04-16T14:25:42.269119Z","created":"2024-04-16T14:25:42.269119Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi005","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-16T14:28:10.784 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.786+0000 7f6cbb985700 1 -- 172.21.15.115:0/2855793757 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6ca0036970 msgr2=0x7f6ca0038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:28:10.784 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.786+0000 7f6cbb985700 1 --2- 172.21.15.115:0/2855793757 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6ca0036970 0x7f6ca0038e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4009990 tx=0x7f6ca4006e40 comp rx=0 tx=0).stop 2024-04-16T14:28:10.784 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.786+0000 7f6cbb985700 1 -- 172.21.15.115:0/2855793757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cb4102ad0 msgr2=0x7f6cb4113180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:28:10.784 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.786+0000 7f6cbb985700 1 --2- 172.21.15.115:0/2855793757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cb4102ad0 0x7f6cb4113180 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6cb000b7f0 tx=0x7f6cb0009e30 comp rx=0 tx=0).stop 2024-04-16T14:28:10.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.787+0000 7f6cbb985700 1 -- 172.21.15.115:0/2855793757 shutdown_connections 2024-04-16T14:28:10.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.787+0000 7f6cbb985700 1 --2- 172.21.15.115:0/2855793757 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6ca0036970 0x7f6ca0038e20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:10.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.787+0000 7f6cbb985700 1 --2- 172.21.15.115:0/2855793757 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cb4102ad0 0x7f6cb4113180 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:10.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.787+0000 7f6cbb985700 1 -- 172.21.15.115:0/2855793757 >> 172.21.15.115:0/2855793757 conn(0x7f6cb40f85d0 msgr2=0x7f6cb40f9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:28:10.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.787+0000 7f6cbb985700 1 -- 172.21.15.115:0/2855793757 shutdown_connections 2024-04-16T14:28:10.785 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:10.787+0000 7f6cbb985700 1 -- 172.21.15.115:0/2855793757 wait complete. 2024-04-16T14:28:10.785 INFO:teuthology.orchestra.run.smithi115.stderr:dumped monmap epoch 1 2024-04-16T14:28:10.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:10 smithi005 ceph-mon[28964]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-04-16T14:28:10.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:10 smithi005 ceph-mon[28964]: Updating smithi005:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.client.admin.keyring 2024-04-16T14:28:10.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:10 smithi005 ceph-mon[28964]: Updating smithi115:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.client.admin.keyring 2024-04-16T14:28:10.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:10 smithi005 ceph-mon[28964]: Deploying daemon crash.smithi115 on smithi115 2024-04-16T14:28:11.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:11 smithi005 ceph-mon[28964]: from='client.? 172.21.15.115:0/2855793757' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:28:12.345 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-16T14:28:12.346 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph mon dump -f json 2024-04-16T14:28:12.725 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.conf 2024-04-16T14:28:14.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.149+0000 7efc4bd30700 1 -- 172.21.15.115:0/3038210729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc44071f90 msgr2=0x7efc44070360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:28:14.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.149+0000 7efc4bd30700 1 --2- 172.21.15.115:0/3038210729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc44071f90 0x7efc44070360 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efc400048c0 tx=0x7efc40009e30 comp rx=0 tx=0).stop 2024-04-16T14:28:14.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.149+0000 7efc4bd30700 1 -- 172.21.15.115:0/3038210729 shutdown_connections 2024-04-16T14:28:14.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.149+0000 7efc4bd30700 1 --2- 172.21.15.115:0/3038210729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc44071f90 0x7efc44070360 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:14.148 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.149+0000 7efc4bd30700 1 -- 172.21.15.115:0/3038210729 >> 172.21.15.115:0/3038210729 conn(0x7efc440f85d0 msgr2=0x7efc440fa9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:28:14.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.149+0000 7efc4bd30700 1 -- 172.21.15.115:0/3038210729 shutdown_connections 2024-04-16T14:28:14.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.149+0000 7efc4bd30700 1 -- 172.21.15.115:0/3038210729 wait complete. 2024-04-16T14:28:14.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.150+0000 7efc4bd30700 1 Processor -- start 2024-04-16T14:28:14.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.150+0000 7efc4bd30700 1 -- start start 2024-04-16T14:28:14.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.150+0000 7efc4bd30700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc44071f90 0x7efc441197e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:28:14.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.150+0000 7efc4bd30700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc44119d20 con 0x7efc44071f90 2024-04-16T14:28:14.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.151+0000 7efc49acc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc44071f90 0x7efc441197e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:28:14.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.151+0000 7efc49acc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc44071f90 0x7efc441197e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.115:33218/0 (socket says 172.21.15.115:33218) 2024-04-16T14:28:14.149 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.151+0000 7efc49acc700 1 -- 172.21.15.115:0/2633670865 learned_addr learned my addr 172.21.15.115:0/2633670865 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-04-16T14:28:14.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.151+0000 7efc49acc700 1 -- 172.21.15.115:0/2633670865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc40005040 con 0x7efc44071f90 2024-04-16T14:28:14.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.151+0000 7efc49acc700 1 --2- 172.21.15.115:0/2633670865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc44071f90 0x7efc441197e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efc4000b890 tx=0x7efc40009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:28:14.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.152+0000 7efc3a7fc700 1 -- 172.21.15.115:0/2633670865 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc400098d0 con 0x7efc44071f90 2024-04-16T14:28:14.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.152+0000 7efc4bd30700 1 -- 172.21.15.115:0/2633670865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc44119f20 con 0x7efc44071f90 2024-04-16T14:28:14.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.152+0000 7efc4bd30700 1 -- 172.21.15.115:0/2633670865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc4411a390 con 0x7efc44071f90 2024-04-16T14:28:14.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.152+0000 7efc3a7fc700 1 -- 172.21.15.115:0/2633670865 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efc4000bc10 con 0x7efc44071f90 2024-04-16T14:28:14.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.152+0000 7efc3a7fc700 1 -- 172.21.15.115:0/2633670865 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc400255c0 con 0x7efc44071f90 2024-04-16T14:28:14.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.152+0000 7efc4bd30700 1 -- 172.21.15.115:0/2633670865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc280052b0 con 0x7efc44071f90 2024-04-16T14:28:14.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.153+0000 7efc3a7fc700 1 -- 172.21.15.115:0/2633670865 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 43487+0+0 (secure 0 0 0) 0x7efc4000bd80 con 0x7efc44071f90 2024-04-16T14:28:14.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.153+0000 7efc3a7fc700 1 --2- 172.21.15.115:0/2633670865 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7efc30036970 0x7efc30038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:28:14.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.153+0000 7efc3a7fc700 1 -- 172.21.15.115:0/2633670865 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7efc40049b30 con 0x7efc44071f90 2024-04-16T14:28:14.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.153+0000 7efc492cb700 1 --2- 172.21.15.115:0/2633670865 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7efc30036970 0x7efc30038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:28:14.151 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.153+0000 7efc492cb700 1 --2- 172.21.15.115:0/2633670865 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7efc30036970 0x7efc30038e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efc34009990 tx=0x7efc34006e40 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:28:14.155 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.158+0000 7efc3a7fc700 1 -- 172.21.15.115:0/2633670865 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7efc400123c0 con 0x7efc44071f90 2024-04-16T14:28:14.429 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.432+0000 7efc4bd30700 1 -- 172.21.15.115:0/2633670865 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7efc28005560 con 0x7efc44071f90 2024-04-16T14:28:14.430 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.432+0000 7efc3a7fc700 1 -- 172.21.15.115:0/2633670865 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7efc40023300 con 0x7efc44071f90 2024-04-16T14:28:14.430 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:28:14.430 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":1,"fsid":"10609bfa-fbfd-11ee-bc90-c7b262605968","modified":"2024-04-16T14:25:42.269119Z","created":"2024-04-16T14:25:42.269119Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi005","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-16T14:28:14.432 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.434+0000 7efc4bd30700 1 -- 172.21.15.115:0/2633670865 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7efc30036970 msgr2=0x7efc30038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:28:14.432 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.434+0000 7efc4bd30700 1 --2- 172.21.15.115:0/2633670865 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7efc30036970 0x7efc30038e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efc34009990 tx=0x7efc34006e40 comp rx=0 tx=0).stop 2024-04-16T14:28:14.432 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.434+0000 7efc4bd30700 1 -- 172.21.15.115:0/2633670865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc44071f90 msgr2=0x7efc441197e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:28:14.432 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.434+0000 7efc4bd30700 1 --2- 172.21.15.115:0/2633670865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc44071f90 0x7efc441197e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efc4000b890 tx=0x7efc40009e30 comp rx=0 tx=0).stop 2024-04-16T14:28:14.432 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.434+0000 7efc4bd30700 1 -- 172.21.15.115:0/2633670865 shutdown_connections 2024-04-16T14:28:14.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.434+0000 7efc4bd30700 1 --2- 172.21.15.115:0/2633670865 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7efc30036970 0x7efc30038e20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:14.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.434+0000 7efc4bd30700 1 --2- 172.21.15.115:0/2633670865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc44071f90 0x7efc441197e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:14.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.434+0000 7efc4bd30700 1 -- 172.21.15.115:0/2633670865 >> 172.21.15.115:0/2633670865 conn(0x7efc440f85d0 msgr2=0x7efc440fa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:28:14.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.435+0000 7efc4bd30700 1 -- 172.21.15.115:0/2633670865 shutdown_connections 2024-04-16T14:28:14.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:14.435+0000 7efc4bd30700 1 -- 172.21.15.115:0/2633670865 wait complete. 2024-04-16T14:28:14.433 INFO:teuthology.orchestra.run.smithi115.stderr:dumped monmap epoch 1 2024-04-16T14:28:14.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:14 smithi005 ceph-mon[28964]: from='client.? 172.21.15.115:0/2633670865' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:28:15.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:15 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:15.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:15 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:15.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:15 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:15.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:15 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:15.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:15 smithi005 ceph-mon[28964]: Deploying daemon node-exporter.smithi115 on smithi115 2024-04-16T14:28:16.105 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-16T14:28:16.105 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph mon dump -f json 2024-04-16T14:28:16.360 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.conf 2024-04-16T14:28:18.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:18 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:18.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:18 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:28:19.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.221+0000 7f6632985700 1 -- 172.21.15.115:0/3367560316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f662c0fda80 msgr2=0x7f662c0fde50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:28:19.220 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.221+0000 7f6632985700 1 --2- 172.21.15.115:0/3367560316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f662c0fda80 0x7f662c0fde50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f661c0048c0 tx=0x7f661c009e30 comp rx=0 tx=0).stop 2024-04-16T14:28:19.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.221+0000 7f6632985700 1 -- 172.21.15.115:0/3367560316 shutdown_connections 2024-04-16T14:28:19.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.221+0000 7f6632985700 1 --2- 172.21.15.115:0/3367560316 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f662c0fda80 0x7f662c0fde50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:19.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.221+0000 7f6632985700 1 -- 172.21.15.115:0/3367560316 >> 172.21.15.115:0/3367560316 conn(0x7f662c0f7510 msgr2=0x7f662c0f9920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:28:19.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.221+0000 7f6632985700 1 -- 172.21.15.115:0/3367560316 shutdown_connections 2024-04-16T14:28:19.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.221+0000 7f6632985700 1 -- 172.21.15.115:0/3367560316 wait complete. 2024-04-16T14:28:19.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.221+0000 7f6632985700 1 Processor -- start 2024-04-16T14:28:19.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.222+0000 7f6632985700 1 -- start start 2024-04-16T14:28:19.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.222+0000 7f6632985700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f662c0fda80 0x7f662c0fb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:28:19.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.222+0000 7f6632985700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662c0fbdf0 con 0x7f662c0fda80 2024-04-16T14:28:19.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.222+0000 7f662bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f662c0fda80 0x7f662c0fb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:28:19.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.222+0000 7f662bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f662c0fda80 0x7f662c0fb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.115:33248/0 (socket says 172.21.15.115:33248) 2024-04-16T14:28:19.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.222+0000 7f662bfff700 1 -- 172.21.15.115:0/677685593 learned_addr learned my addr 172.21.15.115:0/677685593 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-04-16T14:28:19.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.222+0000 7f662bfff700 1 -- 172.21.15.115:0/677685593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661c005040 con 0x7f662c0fda80 2024-04-16T14:28:19.221 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.223+0000 7f662bfff700 1 --2- 172.21.15.115:0/677685593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f662c0fda80 0x7f662c0fb8b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f661c00b7f0 tx=0x7f661c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:28:19.222 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.223+0000 7f6628ff9700 1 -- 172.21.15.115:0/677685593 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f661c009370 con 0x7f662c0fda80 2024-04-16T14:28:19.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.223+0000 7f6632985700 1 -- 172.21.15.115:0/677685593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f662c0fbff0 con 0x7f662c0fda80 2024-04-16T14:28:19.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.223+0000 7f6628ff9700 1 -- 172.21.15.115:0/677685593 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f661c013420 con 0x7f662c0fda80 2024-04-16T14:28:19.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.223+0000 7f6628ff9700 1 -- 172.21.15.115:0/677685593 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f661c01c590 con 0x7f662c0fda80 2024-04-16T14:28:19.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.223+0000 7f6632985700 1 -- 172.21.15.115:0/677685593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f662c0fc460 con 0x7f662c0fda80 2024-04-16T14:28:19.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.224+0000 7f6628ff9700 1 -- 172.21.15.115:0/677685593 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 43487+0+0 (secure 0 0 0) 0x7f661c026440 con 0x7f662c0fda80 2024-04-16T14:28:19.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.224+0000 7f6632985700 1 -- 172.21.15.115:0/677685593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f662c0665d0 con 0x7f662c0fda80 2024-04-16T14:28:19.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.224+0000 7f6628ff9700 1 --2- 172.21.15.115:0/677685593 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6614036970 0x7f6614038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:28:19.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.224+0000 7f6628ff9700 1 -- 172.21.15.115:0/677685593 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f661c0493e0 con 0x7f662c0fda80 2024-04-16T14:28:19.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.224+0000 7f662b7fe700 1 --2- 172.21.15.115:0/677685593 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6614036970 0x7f6614038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:28:19.223 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.225+0000 7f662b7fe700 1 --2- 172.21.15.115:0/677685593 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6614036970 0x7f6614038e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6620009990 tx=0x7f6620006e40 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:28:19.226 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.229+0000 7f6628ff9700 1 -- 172.21.15.115:0/677685593 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f661c011760 con 0x7f662c0fda80 2024-04-16T14:28:19.511 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.513+0000 7f6632985700 1 -- 172.21.15.115:0/677685593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f662c106dd0 con 0x7f662c0fda80 2024-04-16T14:28:19.512 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.514+0000 7f6628ff9700 1 -- 172.21.15.115:0/677685593 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7f661c021030 con 0x7f662c0fda80 2024-04-16T14:28:19.512 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:28:19.512 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":1,"fsid":"10609bfa-fbfd-11ee-bc90-c7b262605968","modified":"2024-04-16T14:25:42.269119Z","created":"2024-04-16T14:25:42.269119Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi005","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-16T14:28:19.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.516+0000 7f6632985700 1 -- 172.21.15.115:0/677685593 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6614036970 msgr2=0x7f6614038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:28:19.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.516+0000 7f6632985700 1 --2- 172.21.15.115:0/677685593 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6614036970 0x7f6614038e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6620009990 tx=0x7f6620006e40 comp rx=0 tx=0).stop 2024-04-16T14:28:19.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.516+0000 7f6632985700 1 -- 172.21.15.115:0/677685593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f662c0fda80 msgr2=0x7f662c0fb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:28:19.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.516+0000 7f6632985700 1 --2- 172.21.15.115:0/677685593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f662c0fda80 0x7f662c0fb8b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f661c00b7f0 tx=0x7f661c009e30 comp rx=0 tx=0).stop 2024-04-16T14:28:19.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.516+0000 7f6632985700 1 -- 172.21.15.115:0/677685593 shutdown_connections 2024-04-16T14:28:19.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.516+0000 7f6632985700 1 --2- 172.21.15.115:0/677685593 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6614036970 0x7f6614038e20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:19.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.516+0000 7f6632985700 1 --2- 172.21.15.115:0/677685593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f662c0fda80 0x7f662c0fb8b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:19.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.516+0000 7f6632985700 1 -- 172.21.15.115:0/677685593 >> 172.21.15.115:0/677685593 conn(0x7f662c0f7510 msgr2=0x7f662c103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:28:19.514 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.516+0000 7f6632985700 1 -- 172.21.15.115:0/677685593 shutdown_connections 2024-04-16T14:28:19.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:19.516+0000 7f6632985700 1 -- 172.21.15.115:0/677685593 wait complete. 2024-04-16T14:28:19.515 INFO:teuthology.orchestra.run.smithi115.stderr:dumped monmap epoch 1 2024-04-16T14:28:20.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:19 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:20.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:19 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:20.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:19 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:20.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:19 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:20.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:19 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi115.brjkpo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-16T14:28:20.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:19 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi115.brjkpo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-16T14:28:20.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:19 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-16T14:28:20.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:19 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:28:20.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:19 smithi005 ceph-mon[28964]: Deploying daemon mgr.smithi115.brjkpo on smithi115 2024-04-16T14:28:20.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:19 smithi005 ceph-mon[28964]: from='client.? 172.21.15.115:0/677685593' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:28:22.061 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-16T14:28:22.062 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph mon dump -f json 2024-04-16T14:28:23.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:22 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:23.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:22 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:23.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:22 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:23.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:22 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:23.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:22 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-16T14:28:23.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:22 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:28:23.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:22 smithi005 ceph-mon[28964]: Deploying daemon mon.smithi115 on smithi115 2024-04-16T14:28:23.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:22 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:23.287 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.conf 2024-04-16T14:28:24.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:23 smithi005 ceph-mon[28964]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:24.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:24 smithi115 systemd[1]: Starting Ceph mon.smithi115 for 10609bfa-fbfd-11ee-bc90-c7b262605968... 2024-04-16T14:28:25.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.807+0000 7fde0ebaf700 1 -- 172.21.15.115:0/3026246527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde08101ba0 msgr2=0x7fde08101f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:28:25.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.807+0000 7fde0ebaf700 1 --2- 172.21.15.115:0/3026246527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde08101ba0 0x7fde08101f70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fddfc0048c0 tx=0x7fddfc009e30 comp rx=0 tx=0).stop 2024-04-16T14:28:25.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.807+0000 7fde0ebaf700 1 -- 172.21.15.115:0/3026246527 shutdown_connections 2024-04-16T14:28:25.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.807+0000 7fde0ebaf700 1 --2- 172.21.15.115:0/3026246527 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde08101ba0 0x7fde08101f70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:25.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.807+0000 7fde0ebaf700 1 -- 172.21.15.115:0/3026246527 >> 172.21.15.115:0/3026246527 conn(0x7fde080f6c30 msgr2=0x7fde080f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:28:25.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.807+0000 7fde0ebaf700 1 -- 172.21.15.115:0/3026246527 shutdown_connections 2024-04-16T14:28:25.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.807+0000 7fde0ebaf700 1 -- 172.21.15.115:0/3026246527 wait complete. 2024-04-16T14:28:25.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.808+0000 7fde0ebaf700 1 Processor -- start 2024-04-16T14:28:25.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.808+0000 7fde0ebaf700 1 -- start start 2024-04-16T14:28:25.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.808+0000 7fde0ebaf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde08101ba0 0x7fde08113330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:28:25.806 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.808+0000 7fde0ebaf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde08113870 con 0x7fde08101ba0 2024-04-16T14:28:25.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.809+0000 7fde0c94b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde08101ba0 0x7fde08113330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:28:25.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.809+0000 7fde0c94b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde08101ba0 0x7fde08113330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.115:59558/0 (socket says 172.21.15.115:59558) 2024-04-16T14:28:25.807 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.809+0000 7fde0c94b700 1 -- 172.21.15.115:0/1211663275 learned_addr learned my addr 172.21.15.115:0/1211663275 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-04-16T14:28:25.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.809+0000 7fde0c94b700 1 -- 172.21.15.115:0/1211663275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddfc005040 con 0x7fde08101ba0 2024-04-16T14:28:25.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.809+0000 7fde0c94b700 1 --2- 172.21.15.115:0/1211663275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde08101ba0 0x7fde08113330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fddfc00b820 tx=0x7fddfc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:28:25.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.809+0000 7fde057fa700 1 -- 172.21.15.115:0/1211663275 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fddfc0093c0 con 0x7fde08101ba0 2024-04-16T14:28:25.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.809+0000 7fde057fa700 1 -- 172.21.15.115:0/1211663275 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fddfc013420 con 0x7fde08101ba0 2024-04-16T14:28:25.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.809+0000 7fde0ebaf700 1 -- 172.21.15.115:0/1211663275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde08113a70 con 0x7fde08101ba0 2024-04-16T14:28:25.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.810+0000 7fde057fa700 1 -- 172.21.15.115:0/1211663275 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fddfc01c5b0 con 0x7fde08101ba0 2024-04-16T14:28:25.808 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.810+0000 7fde0ebaf700 1 -- 172.21.15.115:0/1211663275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde08113f60 con 0x7fde08101ba0 2024-04-16T14:28:25.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.810+0000 7fde057fa700 1 -- 172.21.15.115:0/1211663275 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) v1 ==== 43487+0+0 (secure 0 0 0) 0x7fddfc01c7f0 con 0x7fde08101ba0 2024-04-16T14:28:25.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.811+0000 7fde057fa700 1 --2- 172.21.15.115:0/1211663275 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fddf8036970 0x7fddf8038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:28:25.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.811+0000 7fde057fa700 1 -- 172.21.15.115:0/1211663275 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fddfc049ca0 con 0x7fde08101ba0 2024-04-16T14:28:25.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.811+0000 7fde0ebaf700 1 -- 172.21.15.115:0/1211663275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde080fd2f0 con 0x7fde08101ba0 2024-04-16T14:28:25.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.811+0000 7fde07fff700 1 --2- 172.21.15.115:0/1211663275 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fddf8036970 0x7fddf8038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:28:25.809 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.812+0000 7fde07fff700 1 --2- 172.21.15.115:0/1211663275 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fddf8036970 0x7fddf8038e20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fddf4009990 tx=0x7fddf4006e40 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:28:25.814 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:25.816+0000 7fde057fa700 1 -- 172.21.15.115:0/1211663275 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fddfc023300 con 0x7fde08101ba0 2024-04-16T14:28:26.076 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:25 smithi115 podman[37260]: 2024-04-16 14:28:25.853653664 +0000 UTC m=+0.023876968 image pull b04d96489b7caae41247d23636ddaa80f54b8d6ea9d961629a77038693cd9669 quay.ceph.io/ceph-ci/ceph@sha256:15b9a118425d53cc97d2f7bc08f63df1d8bfa1149df59d4de72a305b04501998 2024-04-16T14:28:26.076 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:25 smithi115 podman[37260]: 2024-04-16 14:28:25.958215132 +0000 UTC m=+0.128438461 container create feb5354cdbe9e309d0a7aa4bbc77e19f27a9c3e740dbbfc9946e1eb96a3c6fa5 (image=quay.ceph.io/ceph-ci/ceph@sha256:15b9a118425d53cc97d2f7bc08f63df1d8bfa1149df59d4de72a305b04501998, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi115, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=quincy-412a552, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-16T14:28:26.102 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:26.104+0000 7fde0ebaf700 1 -- 172.21.15.115:0/1211663275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fde0805f5f0 con 0x7fde08101ba0 2024-04-16T14:28:26.103 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:26.105+0000 7fde057fa700 1 -- 172.21.15.115:0/1211663275 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+735 (secure 0 0 0) 0x7fddfc034090 con 0x7fde08101ba0 2024-04-16T14:28:26.103 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:28:26.103 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":1,"fsid":"10609bfa-fbfd-11ee-bc90-c7b262605968","modified":"2024-04-16T14:25:42.269119Z","created":"2024-04-16T14:25:42.269119Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi005","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-16T14:28:26.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:26.107+0000 7fde0ebaf700 1 -- 172.21.15.115:0/1211663275 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fddf8036970 msgr2=0x7fddf8038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:28:26.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:26.107+0000 7fde0ebaf700 1 --2- 172.21.15.115:0/1211663275 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fddf8036970 0x7fddf8038e20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fddf4009990 tx=0x7fddf4006e40 comp rx=0 tx=0).stop 2024-04-16T14:28:26.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:26.107+0000 7fde0ebaf700 1 -- 172.21.15.115:0/1211663275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde08101ba0 msgr2=0x7fde08113330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:28:26.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:26.107+0000 7fde0ebaf700 1 --2- 172.21.15.115:0/1211663275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde08101ba0 0x7fde08113330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fddfc00b820 tx=0x7fddfc009e30 comp rx=0 tx=0).stop 2024-04-16T14:28:26.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:26.107+0000 7fde0ebaf700 1 -- 172.21.15.115:0/1211663275 shutdown_connections 2024-04-16T14:28:26.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:26.107+0000 7fde0ebaf700 1 --2- 172.21.15.115:0/1211663275 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fddf8036970 0x7fddf8038e20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:26.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:26.107+0000 7fde0ebaf700 1 --2- 172.21.15.115:0/1211663275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde08101ba0 0x7fde08113330 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:26.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:26.107+0000 7fde0ebaf700 1 -- 172.21.15.115:0/1211663275 >> 172.21.15.115:0/1211663275 conn(0x7fde080f6c30 msgr2=0x7fde080fb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:28:26.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:26.107+0000 7fde0ebaf700 1 -- 172.21.15.115:0/1211663275 shutdown_connections 2024-04-16T14:28:26.105 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:26.107+0000 7fde0ebaf700 1 -- 172.21.15.115:0/1211663275 wait complete. 2024-04-16T14:28:26.106 INFO:teuthology.orchestra.run.smithi115.stderr:dumped monmap epoch 1 2024-04-16T14:28:26.223 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:25 smithi005 ceph-mon[28964]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:26.364 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 podman[37260]: 2024-04-16 14:28:26.219670212 +0000 UTC m=+0.389893507 container init feb5354cdbe9e309d0a7aa4bbc77e19f27a9c3e740dbbfc9946e1eb96a3c6fa5 (image=quay.ceph.io/ceph-ci/ceph@sha256:15b9a118425d53cc97d2f7bc08f63df1d8bfa1149df59d4de72a305b04501998, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi115, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, RELEASE=quincy-412a552, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-16T14:28:26.364 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 podman[37260]: 2024-04-16 14:28:26.223680269 +0000 UTC m=+0.393903560 container start feb5354cdbe9e309d0a7aa4bbc77e19f27a9c3e740dbbfc9946e1eb96a3c6fa5 (image=quay.ceph.io/ceph-ci/ceph@sha256:15b9a118425d53cc97d2f7bc08f63df1d8bfa1149df59d4de72a305b04501998, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi115, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=quincy-412a552, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-04-16T14:28:26.364 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: set uid:gid to 167:167 (ceph:ceph) 2024-04-16T14:28:26.364 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable), process ceph-mon, pid 2 2024-04-16T14:28:26.364 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: pidfile_write: ignore empty --pid-file 2024-04-16T14:28:26.364 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: load: jerasure load: lrc 2024-04-16T14:28:26.365 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: RocksDB version: 6.15.5 2024-04-16T14:28:26.365 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-04-16T14:28:26.365 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Compile date Apr 15 2024 2024-04-16T14:28:26.365 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: DB SUMMARY 2024-04-16T14:28:26.365 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: DB Session ID: RDJ7XWXUB06O6CTSRDF1 2024-04-16T14:28:26.365 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: CURRENT file: CURRENT 2024-04-16T14:28:26.365 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: IDENTITY file: IDENTITY 2024-04-16T14:28:26.365 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2024-04-16T14:28:26.365 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi115/store.db dir, Total Num: 0, files: 2024-04-16T14:28:26.365 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi115/store.db: 000004.log size: 511 ; 2024-04-16T14:28:26.365 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.error_if_exists: 0 2024-04-16T14:28:26.365 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.create_if_missing: 0 2024-04-16T14:28:26.365 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.paranoid_checks: 1 2024-04-16T14:28:26.365 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-16T14:28:26.366 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.env: 0x55ff011ffb00 2024-04-16T14:28:26.366 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.fs: Posix File System 2024-04-16T14:28:26.366 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.info_log: 0x55ff03351c00 2024-04-16T14:28:26.366 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.max_file_opening_threads: 16 2024-04-16T14:28:26.366 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.statistics: (nil) 2024-04-16T14:28:26.366 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.use_fsync: 0 2024-04-16T14:28:26.367 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.max_log_file_size: 0 2024-04-16T14:28:26.367 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-16T14:28:26.367 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-16T14:28:26.367 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.keep_log_file_num: 1000 2024-04-16T14:28:26.368 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.recycle_log_file_num: 0 2024-04-16T14:28:26.368 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.allow_fallocate: 1 2024-04-16T14:28:26.368 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.allow_mmap_reads: 0 2024-04-16T14:28:26.368 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.allow_mmap_writes: 0 2024-04-16T14:28:26.368 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.use_direct_reads: 0 2024-04-16T14:28:26.368 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-16T14:28:26.368 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.create_missing_column_families: 0 2024-04-16T14:28:26.368 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.db_log_dir: 2024-04-16T14:28:26.368 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi115/store.db 2024-04-16T14:28:26.368 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-16T14:28:26.368 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-16T14:28:26.369 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-16T14:28:26.369 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-16T14:28:26.369 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-16T14:28:26.369 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-16T14:28:26.369 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.advise_random_on_open: 1 2024-04-16T14:28:26.369 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.db_write_buffer_size: 0 2024-04-16T14:28:26.369 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.write_buffer_manager: 0x55ff040c6a20 2024-04-16T14:28:26.369 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-16T14:28:26.369 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-04-16T14:28:26.369 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-16T14:28:26.369 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-16T14:28:26.369 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.rate_limiter: (nil) 2024-04-16T14:28:26.370 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-16T14:28:26.370 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.wal_recovery_mode: 2 2024-04-16T14:28:26.370 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.enable_thread_tracking: 0 2024-04-16T14:28:26.370 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.enable_pipelined_write: 0 2024-04-16T14:28:26.370 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.unordered_write: 0 2024-04-16T14:28:26.370 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-16T14:28:26.370 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-16T14:28:26.370 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-16T14:28:26.370 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-16T14:28:26.371 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.row_cache: None 2024-04-16T14:28:26.371 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.wal_filter: None 2024-04-16T14:28:26.371 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-16T14:28:26.371 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.allow_ingest_behind: 0 2024-04-16T14:28:26.371 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.preserve_deletes: 0 2024-04-16T14:28:26.371 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.two_write_queues: 0 2024-04-16T14:28:26.371 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.manual_wal_flush: 0 2024-04-16T14:28:26.371 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.atomic_flush: 0 2024-04-16T14:28:26.371 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-16T14:28:26.371 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-16T14:28:26.371 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-16T14:28:26.371 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.log_readahead_size: 0 2024-04-16T14:28:26.371 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-16T14:28:26.371 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.best_efforts_recovery: 0 2024-04-16T14:28:26.372 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-16T14:28:26.372 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-16T14:28:26.372 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.allow_data_in_errors: 0 2024-04-16T14:28:26.372 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.db_host_id: __hostname__ 2024-04-16T14:28:26.372 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.max_background_jobs: 2 2024-04-16T14:28:26.372 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.max_background_compactions: -1 2024-04-16T14:28:26.372 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.max_subcompactions: 1 2024-04-16T14:28:26.372 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-16T14:28:26.372 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-16T14:28:26.372 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-16T14:28:26.372 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.max_total_wal_size: 0 2024-04-16T14:28:26.372 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-16T14:28:26.372 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-16T14:28:26.372 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-16T14:28:26.372 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-16T14:28:26.373 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.max_open_files: -1 2024-04-16T14:28:26.373 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.bytes_per_sync: 0 2024-04-16T14:28:26.373 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-16T14:28:26.373 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-16T14:28:26.373 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.compaction_readahead_size: 0 2024-04-16T14:28:26.373 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.max_background_flushes: -1 2024-04-16T14:28:26.373 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Compression algorithms supported: 2024-04-16T14:28:26.373 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-16T14:28:26.373 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: kZSTD supported: 0 2024-04-16T14:28:26.373 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: kXpressCompression supported: 0 2024-04-16T14:28:26.373 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: kLZ4HCCompression supported: 1 2024-04-16T14:28:26.373 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: kZlibCompression supported: 1 2024-04-16T14:28:26.373 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: kSnappyCompression supported: 1 2024-04-16T14:28:26.373 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: kLZ4Compression supported: 1 2024-04-16T14:28:26.374 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: kBZip2Compression supported: 0 2024-04-16T14:28:26.374 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-16T14:28:26.374 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi115/store.db/MANIFEST-000003 2024-04-16T14:28:26.374 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-04-16T14:28:26.374 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-16T14:28:26.374 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.merge_operator: 2024-04-16T14:28:26.374 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.compaction_filter: None 2024-04-16T14:28:26.374 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.compaction_filter_factory: None 2024-04-16T14:28:26.374 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.sst_partitioner_factory: None 2024-04-16T14:28:26.374 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-16T14:28:26.374 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-16T14:28:26.374 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ff033a6f58) 2024-04-16T14:28:26.374 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: cache_index_and_filter_blocks: 1 2024-04-16T14:28:26.374 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-16T14:28:26.375 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-16T14:28:26.375 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: pin_top_level_index_and_filter: 1 2024-04-16T14:28:26.375 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: index_type: 0 2024-04-16T14:28:26.375 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: data_block_index_type: 0 2024-04-16T14:28:26.375 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: index_shortening: 1 2024-04-16T14:28:26.375 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-16T14:28:26.375 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: hash_index_allow_collision: 1 2024-04-16T14:28:26.375 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: checksum: 1 2024-04-16T14:28:26.375 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: no_block_cache: 0 2024-04-16T14:28:26.375 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_cache: 0x55ff033d9090 2024-04-16T14:28:26.375 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_cache_name: BinnedLRUCache 2024-04-16T14:28:26.375 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_cache_options: 2024-04-16T14:28:26.375 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: capacity : 536870912 2024-04-16T14:28:26.375 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: num_shard_bits : 4 2024-04-16T14:28:26.375 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: strict_capacity_limit : 0 2024-04-16T14:28:26.376 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: high_pri_pool_ratio: 0.000 2024-04-16T14:28:26.376 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_cache_compressed: (nil) 2024-04-16T14:28:26.376 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: persistent_cache: (nil) 2024-04-16T14:28:26.376 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_size: 4096 2024-04-16T14:28:26.376 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_size_deviation: 10 2024-04-16T14:28:26.376 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_restart_interval: 16 2024-04-16T14:28:26.376 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: index_block_restart_interval: 1 2024-04-16T14:28:26.376 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: metadata_block_size: 4096 2024-04-16T14:28:26.376 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: partition_filters: 0 2024-04-16T14:28:26.376 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: use_delta_encoding: 1 2024-04-16T14:28:26.376 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-04-16T14:28:26.376 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: whole_key_filtering: 1 2024-04-16T14:28:26.376 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: verify_compression: 0 2024-04-16T14:28:26.376 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: read_amp_bytes_per_bit: 0 2024-04-16T14:28:26.376 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: format_version: 4 2024-04-16T14:28:26.377 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: enable_index_compression: 1 2024-04-16T14:28:26.377 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_align: 0 2024-04-16T14:28:26.377 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.write_buffer_size: 33554432 2024-04-16T14:28:26.377 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.max_write_buffer_number: 2 2024-04-16T14:28:26.377 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.compression: NoCompression 2024-04-16T14:28:26.377 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.bottommost_compression: Disabled 2024-04-16T14:28:26.377 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.prefix_extractor: nullptr 2024-04-16T14:28:26.377 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-16T14:28:26.377 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.num_levels: 7 2024-04-16T14:28:26.377 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-16T14:28:26.378 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-16T14:28:26.378 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-16T14:28:26.378 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-16T14:28:26.378 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-16T14:28:26.378 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-16T14:28:26.378 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-16T14:28:26.378 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-16T14:28:26.378 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-16T14:28:26.378 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-16T14:28:26.378 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-16T14:28:26.378 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.compression_opts.level: 32767 2024-04-16T14:28:26.378 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.compression_opts.strategy: 0 2024-04-16T14:28:26.378 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-16T14:28:26.378 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-16T14:28:26.379 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-16T14:28:26.379 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.compression_opts.enabled: false 2024-04-16T14:28:26.379 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-16T14:28:26.379 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-16T14:28:26.379 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-16T14:28:26.379 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.target_file_size_base: 67108864 2024-04-16T14:28:26.379 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-16T14:28:26.379 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-16T14:28:26.379 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-16T14:28:26.379 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-16T14:28:26.379 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-16T14:28:26.379 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-16T14:28:26.380 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-16T14:28:26.380 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-16T14:28:26.380 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-16T14:28:26.380 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-16T14:28:26.380 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-16T14:28:26.380 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-16T14:28:26.380 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-16T14:28:26.380 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.arena_block_size: 4194304 2024-04-16T14:28:26.380 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-16T14:28:26.382 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-16T14:28:26.382 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-04-16T14:28:26.382 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.disable_auto_compactions: 0 2024-04-16T14:28:26.382 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-16T14:28:26.382 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-16T14:28:26.382 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-16T14:28:26.382 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-16T14:28:26.382 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-16T14:28:26.382 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-16T14:28:26.382 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-16T14:28:26.382 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-16T14:28:26.383 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-16T14:28:26.383 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-16T14:28:26.383 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.table_properties_collectors: 2024-04-16T14:28:26.383 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.inplace_update_support: 0 2024-04-16T14:28:26.383 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-16T14:28:26.383 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-16T14:28:26.383 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-16T14:28:26.383 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-16T14:28:26.383 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.bloom_locality: 0 2024-04-16T14:28:26.383 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.max_successive_merges: 0 2024-04-16T14:28:26.383 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-16T14:28:26.383 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.paranoid_file_checks: 0 2024-04-16T14:28:26.383 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.force_consistency_checks: 1 2024-04-16T14:28:26.383 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.report_bg_io_stats: 0 2024-04-16T14:28:26.384 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.ttl: 2592000 2024-04-16T14:28:26.384 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-16T14:28:26.384 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.enable_blob_files: false 2024-04-16T14:28:26.384 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.min_blob_size: 0 2024-04-16T14:28:26.384 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.blob_file_size: 268435456 2024-04-16T14:28:26.384 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-16T14:28:26.384 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-16T14:28:26.384 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-16T14:28:26.384 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi115/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-16T14:28:26.384 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2024-04-16T14:28:26.384 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2024-04-16T14:28:26.384 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713277706250362, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-16T14:28:26.384 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2024-04-16T14:28:26.384 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-04-16T14:28:26.384 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713277706250690, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1713277706, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "1f053f23-728a-4e5e-8e7c-fdf8bc3a594b", "db_session_id": "RDJ7XWXUB06O6CTSRDF1"}} 2024-04-16T14:28:26.385 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2024-04-16T14:28:26.385 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713277706250997, "job": 1, "event": "recovery_finished"} 2024-04-16T14:28:26.385 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi115/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-16T14:28:26.385 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55ff0336d180 2024-04-16T14:28:26.385 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: DB pointer 0x55ff03442000 2024-04-16T14:28:26.385 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-04-16T14:28:26.385 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-04-16T14:28:26.385 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** DB Stats ** 2024-04-16T14:28:26.385 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-16T14:28:26.385 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-16T14:28:26.385 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-16T14:28:26.385 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-16T14:28:26.385 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-16T14:28:26.385 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-04-16T14:28:26.385 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-16T14:28:26.386 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-04-16T14:28:26.386 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** Compaction Stats [default] ** 2024-04-16T14:28:26.386 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-16T14:28:26.386 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-16T14:28:26.386 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.8 0.00 0.00 1 0.000 0 0 2024-04-16T14:28:26.386 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.8 0.00 0.00 1 0.000 0 0 2024-04-16T14:28:26.386 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.8 0.00 0.00 1 0.000 0 0 2024-04-16T14:28:26.386 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-04-16T14:28:26.386 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** Compaction Stats [default] ** 2024-04-16T14:28:26.386 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-16T14:28:26.386 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-16T14:28:26.386 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.8 0.00 0.00 1 0.000 0 0 2024-04-16T14:28:26.386 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-16T14:28:26.386 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-16T14:28:26.387 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-16T14:28:26.387 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-16T14:28:26.387 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-16T14:28:26.387 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-16T14:28:26.387 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Cumulative compaction: 0.00 GB write, 0.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-16T14:28:26.387 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Interval compaction: 0.00 GB write, 0.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-16T14:28:26.387 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-16T14:28:26.387 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-04-16T14:28:26.387 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-16T14:28:26.387 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-04-16T14:28:26.387 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** Compaction Stats [default] ** 2024-04-16T14:28:26.387 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-16T14:28:26.388 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-16T14:28:26.388 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.8 0.00 0.00 1 0.000 0 0 2024-04-16T14:28:26.388 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.8 0.00 0.00 1 0.000 0 0 2024-04-16T14:28:26.388 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-04-16T14:28:26.388 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-04-16T14:28:26.388 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** Compaction Stats [default] ** 2024-04-16T14:28:26.388 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-16T14:28:26.388 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-16T14:28:26.388 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.8 0.00 0.00 1 0.000 0 0 2024-04-16T14:28:26.388 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-16T14:28:26.389 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-16T14:28:26.389 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-16T14:28:26.389 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-16T14:28:26.389 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-16T14:28:26.389 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-16T14:28:26.389 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Cumulative compaction: 0.00 GB write, 0.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-16T14:28:26.389 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-16T14:28:26.389 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-16T14:28:26.389 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-04-16T14:28:26.389 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-16T14:28:26.389 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: mon.smithi115 does not exist in monmap, will attempt to join an existing cluster 2024-04-16T14:28:26.389 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: using public_addr v2:172.21.15.115:0/0 -> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] 2024-04-16T14:28:26.389 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: starting mon.smithi115 rank -1 at public addrs [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] at bind addrs [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi115 fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 2024-04-16T14:28:26.389 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: mon.smithi115@-1(???) e0 preinit fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 2024-04-16T14:28:26.389 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: mon.smithi115@-1(synchronizing).mds e1 new map 2024-04-16T14:28:26.389 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: mon.smithi115@-1(synchronizing).mds e1 print_map 2024-04-16T14:28:26.390 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: e1 2024-04-16T14:28:26.390 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:28:26.390 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:28:26.390 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: legacy client fscid: -1 2024-04-16T14:28:26.390 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-04-16T14:28:26.390 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: No filesystems configured 2024-04-16T14:28:26.390 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: mon.smithi115@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-16T14:28:26.390 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: mon.smithi115@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-16T14:28:26.390 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: mon.smithi115@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-16T14:28:26.390 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: mon.smithi115@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-16T14:28:26.390 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: mon.smithi115@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-16T14:28:26.390 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: mon.smithi115@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-16T14:28:26.390 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: mon.smithi115@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-04-16T14:28:26.391 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: mon.smithi115@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-16T14:28:26.391 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: mon.smithi115@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-16T14:28:26.391 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: mon.smithi115@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-16T14:28:26.391 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: mon.smithi115@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-16T14:28:26.391 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-16T14:28:26.391 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:26.391 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:26.391 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:26.392 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:26.392 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/3748218278' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-16T14:28:26.392 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.392 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.392 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.392 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.392 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.392 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.392 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-16T14:28:26.392 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.392 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-16T14:28:26.392 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: Deploying daemon grafana.smithi005 on smithi005 2024-04-16T14:28:26.392 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/3748218278' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-16T14:28:26.393 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: osdmap e4: 0 total, 0 up, 0 in 2024-04-16T14:28:26.393 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:26.393 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.393 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi005:172.21.15.5=smithi005;smithi115:172.21.15.115=smithi115", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:28:26.393 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: Saving service mon spec with placement smithi005:172.21.15.5=smithi005;smithi115:172.21.15.115=smithi115;count:2 2024-04-16T14:28:26.393 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.393 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:26.393 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:26.393 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='client.? 172.21.15.115:0/2939355052' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:28:26.393 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:26.393 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='client.? 172.21.15.115:0/4012107623' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:28:26.393 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:26.393 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:26.393 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='client.? 172.21.15.115:0/93179295' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:28:26.394 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:26.394 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:26.394 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='client.? 172.21.15.115:0/3327268356' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:28:26.394 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.394 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.394 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.394 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.394 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.394 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.394 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: Deploying daemon prometheus.smithi005 on smithi005 2024-04-16T14:28:26.394 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:26.394 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.394 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:26.394 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='client.? 172.21.15.115:0/3005662622' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:28:26.395 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:26.395 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='client.? 172.21.15.115:0/3907219640' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:28:26.395 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:26.395 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:26.395 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='client.? 172.21.15.115:0/3094793629' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:28:26.395 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:26.395 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:26.395 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='client.? 172.21.15.115:0/3842313980' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:28:26.395 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:26.395 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.396 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.396 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:26.396 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.396 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-04-16T14:28:26.396 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='client.? 172.21.15.115:0/309817504' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:28:26.396 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14160 172.21.15.5:0/1429091017' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-04-16T14:28:26.396 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: mgrmap e14: smithi005.ipwdkc(active, since 67s) 2024-04-16T14:28:26.396 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='client.? 172.21.15.115:0/2925225303' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:28:26.396 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='client.? 172.21.15.115:0/1604611136' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:28:26.396 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: Active manager daemon smithi005.ipwdkc restarted 2024-04-16T14:28:26.396 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: Activating manager daemon smithi005.ipwdkc 2024-04-16T14:28:26.396 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: osdmap e5: 0 total, 0 up, 0 in 2024-04-16T14:28:26.396 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: mgrmap e15: smithi005.ipwdkc(active, starting, since 0.00318795s) 2024-04-16T14:28:26.396 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-04-16T14:28:26.397 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr metadata", "who": "smithi005.ipwdkc", "id": "smithi005.ipwdkc"}]: dispatch 2024-04-16T14:28:26.397 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-16T14:28:26.397 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-16T14:28:26.397 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-16T14:28:26.397 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: Manager daemon smithi005.ipwdkc is now available 2024-04-16T14:28:26.397 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:28:26.397 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:28:26.397 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.397 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:28:26.397 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi005.ipwdkc/mirror_snapshot_schedule"}]: dispatch 2024-04-16T14:28:26.397 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi005.ipwdkc/trash_purge_schedule"}]: dispatch 2024-04-16T14:28:26.397 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.397 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.397 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: [16/Apr/2024:14:28:03] ENGINE Bus STARTING 2024-04-16T14:28:26.398 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: [16/Apr/2024:14:28:03] ENGINE Serving on https://172.21.15.5:7150 2024-04-16T14:28:26.398 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: [16/Apr/2024:14:28:03] ENGINE Bus STARTED 2024-04-16T14:28:26.398 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.398 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: mgrmap e16: smithi005.ipwdkc(active, since 1.0054s) 2024-04-16T14:28:26.398 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.398 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: mgrmap e17: smithi005.ipwdkc(active, since 2s) 2024-04-16T14:28:26.398 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.398 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.398 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='client.? 172.21.15.115:0/2415125903' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:28:26.398 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.399 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.399 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd/host:smithi005", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:28:26.399 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.399 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.399 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.399 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.399 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd/host:smithi115", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:28:26.399 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:28:26.399 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:28:26.399 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: Updating smithi005:/etc/ceph/ceph.conf 2024-04-16T14:28:26.400 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: Updating smithi115:/etc/ceph/ceph.conf 2024-04-16T14:28:26.400 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: Updating smithi005:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.conf 2024-04-16T14:28:26.400 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: Updating smithi115:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.conf 2024-04-16T14:28:26.400 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: Updating smithi005:/etc/ceph/ceph.client.admin.keyring 2024-04-16T14:28:26.400 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.400 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.400 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.400 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.400 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.400 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi115", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-16T14:28:26.400 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi115", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-16T14:28:26.400 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:28:26.400 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-04-16T14:28:26.400 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: Updating smithi005:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.client.admin.keyring 2024-04-16T14:28:26.401 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: Updating smithi115:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.client.admin.keyring 2024-04-16T14:28:26.401 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: Deploying daemon crash.smithi115 on smithi115 2024-04-16T14:28:26.401 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='client.? 172.21.15.115:0/2855793757' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:28:26.401 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='client.? 172.21.15.115:0/2633670865' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:28:26.401 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.401 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.401 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.401 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.401 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: Deploying daemon node-exporter.smithi115 on smithi115 2024-04-16T14:28:26.401 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.401 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:28:26.401 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.401 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.401 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.401 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.402 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi115.brjkpo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-16T14:28:26.402 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi115.brjkpo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-16T14:28:26.402 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-16T14:28:26.402 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:28:26.402 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: Deploying daemon mgr.smithi115.brjkpo on smithi115 2024-04-16T14:28:26.402 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='client.? 172.21.15.115:0/677685593' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:28:26.402 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.402 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.402 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.402 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.402 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-16T14:28:26.402 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:28:26.402 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: Deploying daemon mon.smithi115 on smithi115 2024-04-16T14:28:26.402 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:26.403 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:26.403 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:26.403 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 ceph-mon[37295]: mon.smithi115@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2024-04-16T14:28:26.403 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 bash[37260]: feb5354cdbe9e309d0a7aa4bbc77e19f27a9c3e740dbbfc9946e1eb96a3c6fa5 2024-04-16T14:28:26.403 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:26 smithi115 systemd[1]: Started Ceph mon.smithi115 for 10609bfa-fbfd-11ee-bc90-c7b262605968. 2024-04-16T14:28:28.052 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-16T14:28:28.052 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph mon dump -f json 2024-04-16T14:28:28.315 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi115/config 2024-04-16T14:28:31.630 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-04-16T14:28:31.631 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: mon.smithi005 calling monitor election 2024-04-16T14:28:31.631 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:28:31.631 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:31.631 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:28:31.631 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:28:31.631 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: mon.smithi115 calling monitor election 2024-04-16T14:28:31.631 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: from='mgr.? 172.21.15.115:0/4171063394' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.brjkpo/crt"}]: dispatch 2024-04-16T14:28:31.631 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:31.631 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:28:31.632 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:28:31.632 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:31.632 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:28:31.632 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: mon.smithi005 is new leader, mons smithi005,smithi115 in quorum (ranks 0,1) 2024-04-16T14:28:31.632 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: monmap e2: 2 mons at {smithi005=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],smithi115=[v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-16T14:28:31.632 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: fsmap 2024-04-16T14:28:31.632 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: osdmap e5: 0 total, 0 up, 0 in 2024-04-16T14:28:31.632 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: mgrmap e17: smithi005.ipwdkc(active, since 28s) 2024-04-16T14:28:31.632 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: overall HEALTH_OK 2024-04-16T14:28:31.633 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: Standby manager daemon smithi115.brjkpo started 2024-04-16T14:28:31.633 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: from='mgr.? 172.21.15.115:0/4171063394' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-16T14:28:31.633 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:31.633 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: from='mgr.? 172.21.15.115:0/4171063394' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.brjkpo/key"}]: dispatch 2024-04-16T14:28:31.633 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: from='mgr.? 172.21.15.115:0/4171063394' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-16T14:28:31.633 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:31.633 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:31.633 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:31.634 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:31 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:31.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-04-16T14:28:31.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: mon.smithi005 calling monitor election 2024-04-16T14:28:31.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:28:31.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:31.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:28:31.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:28:31.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: mon.smithi115 calling monitor election 2024-04-16T14:28:31.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.115:0/4171063394' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.brjkpo/crt"}]: dispatch 2024-04-16T14:28:31.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:31.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:28:31.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:28:31.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:31.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:28:31.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: mon.smithi005 is new leader, mons smithi005,smithi115 in quorum (ranks 0,1) 2024-04-16T14:28:31.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: monmap e2: 2 mons at {smithi005=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],smithi115=[v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-16T14:28:31.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: fsmap 2024-04-16T14:28:31.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: osdmap e5: 0 total, 0 up, 0 in 2024-04-16T14:28:31.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: mgrmap e17: smithi005.ipwdkc(active, since 28s) 2024-04-16T14:28:31.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: overall HEALTH_OK 2024-04-16T14:28:31.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: Standby manager daemon smithi115.brjkpo started 2024-04-16T14:28:31.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.115:0/4171063394' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-16T14:28:31.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:31.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.115:0/4171063394' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.brjkpo/key"}]: dispatch 2024-04-16T14:28:31.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.115:0/4171063394' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-16T14:28:31.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:31.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:31.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:31.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:31 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:32.634 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:32 smithi115 ceph-mon[37295]: mgrmap e18: smithi005.ipwdkc(active, since 28s), standbys: smithi115.brjkpo 2024-04-16T14:28:32.634 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:32 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr metadata", "who": "smithi115.brjkpo", "id": "smithi115.brjkpo"}]: dispatch 2024-04-16T14:28:32.634 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:32 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:28:32.634 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:32 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:28:32.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:32 smithi005 ceph-mon[28964]: mgrmap e18: smithi005.ipwdkc(active, since 28s), standbys: smithi115.brjkpo 2024-04-16T14:28:32.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:32 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr metadata", "who": "smithi115.brjkpo", "id": "smithi115.brjkpo"}]: dispatch 2024-04-16T14:28:32.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:32 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:28:32.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:32 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:28:32.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.755+0000 7f17f4ab4700 1 -- 172.21.15.115:0/739844192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17d8003580 msgr2=0x7f17d8005a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:28:32.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.755+0000 7f17f4ab4700 1 --2- 172.21.15.115:0/739844192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17d8003580 0x7f17d8005a00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f17f00fcb00 tx=0x7f17e400b040 comp rx=0 tx=0).stop 2024-04-16T14:28:32.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.755+0000 7f17f4ab4700 1 -- 172.21.15.115:0/739844192 shutdown_connections 2024-04-16T14:28:32.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.755+0000 7f17f4ab4700 1 --2- 172.21.15.115:0/739844192 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17d8003580 0x7f17d8005a00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:32.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.755+0000 7f17f4ab4700 1 -- 172.21.15.115:0/739844192 >> 172.21.15.115:0/739844192 conn(0x7f17f00f8730 msgr2=0x7f17f00fab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:28:32.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.755+0000 7f17f4ab4700 1 -- 172.21.15.115:0/739844192 shutdown_connections 2024-04-16T14:28:32.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.755+0000 7f17f4ab4700 1 -- 172.21.15.115:0/739844192 wait complete. 2024-04-16T14:28:32.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.755+0000 7f17f4ab4700 1 Processor -- start 2024-04-16T14:28:32.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.756+0000 7f17f4ab4700 1 -- start start 2024-04-16T14:28:32.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.756+0000 7f17f4ab4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17d8003580 0x7f17f01132b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:28:32.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.756+0000 7f17f4ab4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17f01137f0 0x7f17f010d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:28:32.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.756+0000 7f17f4ab4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f0113e00 con 0x7f17d8003580 2024-04-16T14:28:32.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.756+0000 7f17f4ab4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f010d750 con 0x7f17f01137f0 2024-04-16T14:28:32.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.756+0000 7f17edd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17f01137f0 0x7f17f010d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:28:32.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.756+0000 7f17edd9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17f01137f0 0x7f17f010d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:37024/0 (socket says 172.21.15.115:37024) 2024-04-16T14:28:32.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.756+0000 7f17edd9b700 1 -- 172.21.15.115:0/531319323 learned_addr learned my addr 172.21.15.115:0/531319323 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-04-16T14:28:32.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.756+0000 7f17ee59c700 1 --2- 172.21.15.115:0/531319323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17d8003580 0x7f17f01132b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:28:32.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.756+0000 7f17edd9b700 1 -- 172.21.15.115:0/531319323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17f01137f0 msgr2=0x7f17f010d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-16T14:28:32.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.756+0000 7f17edd9b700 1 -- 172.21.15.115:0/531319323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17f01137f0 msgr2=0x7f17f010d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-16T14:28:32.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.756+0000 7f17edd9b700 1 --2- 172.21.15.115:0/531319323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17f01137f0 0x7f17f010d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-16T14:28:32.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.756+0000 7f17edd9b700 1 --2- 172.21.15.115:0/531319323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17f01137f0 0x7f17f010d210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-16T14:28:32.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.756+0000 7f17ee59c700 1 -- 172.21.15.115:0/531319323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17f01137f0 msgr2=0x7f17f010d210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T14:28:32.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.756+0000 7f17ee59c700 1 --2- 172.21.15.115:0/531319323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17f01137f0 0x7f17f010d210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:32.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.756+0000 7f17ee59c700 1 -- 172.21.15.115:0/531319323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e4005040 con 0x7f17d8003580 2024-04-16T14:28:32.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.756+0000 7f17ee59c700 1 --2- 172.21.15.115:0/531319323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17d8003580 0x7f17f01132b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f17e4009ce0 tx=0x7f17e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:28:32.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.757+0000 7f17deffd700 1 -- 172.21.15.115:0/531319323 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17e401b070 con 0x7f17d8003580 2024-04-16T14:28:32.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.757+0000 7f17deffd700 1 -- 172.21.15.115:0/531319323 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f17e4016d10 con 0x7f17d8003580 2024-04-16T14:28:32.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.757+0000 7f17f4ab4700 1 -- 172.21.15.115:0/531319323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f010d9d0 con 0x7f17d8003580 2024-04-16T14:28:32.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.757+0000 7f17deffd700 1 -- 172.21.15.115:0/531319323 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17e401f620 con 0x7f17d8003580 2024-04-16T14:28:32.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.757+0000 7f17f4ab4700 1 -- 172.21.15.115:0/531319323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f010df10 con 0x7f17d8003580 2024-04-16T14:28:32.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.757+0000 7f17f4ab4700 1 -- 172.21.15.115:0/531319323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f0101680 con 0x7f17d8003580 2024-04-16T14:28:32.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.758+0000 7f17deffd700 1 -- 172.21.15.115:0/531319323 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 86571+0+0 (secure 0 0 0) 0x7f17e4020440 con 0x7f17d8003580 2024-04-16T14:28:32.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.758+0000 7f17deffd700 1 --2- 172.21.15.115:0/531319323 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f17d0069320 0x7f17d006b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:28:32.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.759+0000 7f17deffd700 1 -- 172.21.15.115:0/531319323 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f17e4087fe0 con 0x7f17d8003580 2024-04-16T14:28:32.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.759+0000 7f17edd9b700 1 --2- 172.21.15.115:0/531319323 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f17d0069320 0x7f17d006b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:28:32.758 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.759+0000 7f17edd9b700 1 --2- 172.21.15.115:0/531319323 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f17d0069320 0x7f17d006b7d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f17e0006fd0 tx=0x7f17e0008040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:28:32.764 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:32.767+0000 7f17deffd700 1 -- 172.21.15.115:0/531319323 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f17e40ba250 con 0x7f17d8003580 2024-04-16T14:28:33.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:33.036+0000 7f17f4ab4700 1 -- 172.21.15.115:0/531319323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f17f01048e0 con 0x7f17d8003580 2024-04-16T14:28:33.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:33.037+0000 7f17deffd700 1 -- 172.21.15.115:0/531319323 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1013 (secure 0 0 0) 0x7f17e4024410 con 0x7f17d8003580 2024-04-16T14:28:33.035 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-04-16T14:28:33.035 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":2,"fsid":"10609bfa-fbfd-11ee-bc90-c7b262605968","modified":"2024-04-16T14:28:26.275259Z","created":"2024-04-16T14:25:42.269119Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi005","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi115","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-16T14:28:33.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:33.039+0000 7f17f4ab4700 1 -- 172.21.15.115:0/531319323 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f17d0069320 msgr2=0x7f17d006b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:28:33.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:33.039+0000 7f17f4ab4700 1 --2- 172.21.15.115:0/531319323 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f17d0069320 0x7f17d006b7d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f17e0006fd0 tx=0x7f17e0008040 comp rx=0 tx=0).stop 2024-04-16T14:28:33.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:33.039+0000 7f17f4ab4700 1 -- 172.21.15.115:0/531319323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17d8003580 msgr2=0x7f17f01132b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:28:33.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:33.039+0000 7f17f4ab4700 1 --2- 172.21.15.115:0/531319323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17d8003580 0x7f17f01132b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f17e4009ce0 tx=0x7f17e400b040 comp rx=0 tx=0).stop 2024-04-16T14:28:33.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:33.039+0000 7f17f4ab4700 1 -- 172.21.15.115:0/531319323 shutdown_connections 2024-04-16T14:28:33.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:33.039+0000 7f17f4ab4700 1 --2- 172.21.15.115:0/531319323 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f17d0069320 0x7f17d006b7d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:33.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:33.039+0000 7f17f4ab4700 1 --2- 172.21.15.115:0/531319323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f17d8003580 0x7f17f01132b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:33.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:33.039+0000 7f17f4ab4700 1 --2- 172.21.15.115:0/531319323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17f01137f0 0x7f17f010d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:33.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:33.039+0000 7f17f4ab4700 1 -- 172.21.15.115:0/531319323 >> 172.21.15.115:0/531319323 conn(0x7f17f00f8730 msgr2=0x7f17f00fa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:28:33.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:33.039+0000 7f17f4ab4700 1 -- 172.21.15.115:0/531319323 shutdown_connections 2024-04-16T14:28:33.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:28:33.039+0000 7f17f4ab4700 1 -- 172.21.15.115:0/531319323 wait complete. 2024-04-16T14:28:33.038 INFO:teuthology.orchestra.run.smithi115.stderr:dumped monmap epoch 2 2024-04-16T14:28:33.614 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:33 smithi115 ceph-mon[37295]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:33.614 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:33 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:28:33.614 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:33 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:33.614 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:33 smithi115 ceph-mon[37295]: from='client.? 172.21.15.115:0/531319323' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:28:33.637 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-16T14:28:33.638 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph config generate-minimal-conf 2024-04-16T14:28:33.675 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:33 smithi005 ceph-mon[28964]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:33.675 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:33 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:28:33.675 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:33 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:33.676 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:33 smithi005 ceph-mon[28964]: from='client.? 172.21.15.115:0/531319323' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-16T14:28:33.920 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:28:35.050 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:34 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:35.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:34 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:35.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:34 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:28:35.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:34 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:28:35.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:34 smithi005 ceph-mon[28964]: Updating smithi005:/etc/ceph/ceph.conf 2024-04-16T14:28:35.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:34 smithi005 ceph-mon[28964]: Updating smithi115:/etc/ceph/ceph.conf 2024-04-16T14:28:35.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:34 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:35.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:34 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:35.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:34 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:35.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:34 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:35.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:34 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:35.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:34 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-16T14:28:35.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:34 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-16T14:28:35.051 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:34 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:28:35.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:34 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:35.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:34 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:35.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:34 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:28:35.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:34 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:28:35.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:34 smithi115 ceph-mon[37295]: Updating smithi005:/etc/ceph/ceph.conf 2024-04-16T14:28:35.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:34 smithi115 ceph-mon[37295]: Updating smithi115:/etc/ceph/ceph.conf 2024-04-16T14:28:35.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:34 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:35.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:34 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:35.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:34 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:35.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:34 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:35.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:34 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:35.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:34 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-16T14:28:35.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:34 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-16T14:28:35.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:34 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:28:36.049 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:35 smithi005 ceph-mon[28964]: Updating smithi005:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.conf 2024-04-16T14:28:36.050 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:35 smithi005 ceph-mon[28964]: Updating smithi115:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.conf 2024-04-16T14:28:36.050 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:35 smithi005 ceph-mon[28964]: Reconfiguring mon.smithi005 (unknown last config time)... 2024-04-16T14:28:36.050 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:35 smithi005 ceph-mon[28964]: Reconfiguring daemon mon.smithi005 on smithi005 2024-04-16T14:28:36.050 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:35 smithi005 ceph-mon[28964]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:36.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.156+0000 7fe89051f700 1 -- 172.21.15.5:0/1299284606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe888102b10 msgr2=0x7fe888102ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:28:36.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.156+0000 7fe89051f700 1 --2- 172.21.15.5:0/1299284606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe888102b10 0x7fe888102ee0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe8840048c0 tx=0x7fe884009e30 comp rx=0 tx=0).stop 2024-04-16T14:28:36.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.156+0000 7fe89051f700 1 -- 172.21.15.5:0/1299284606 shutdown_connections 2024-04-16T14:28:36.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.156+0000 7fe89051f700 1 --2- 172.21.15.5:0/1299284606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe888102b10 0x7fe888102ee0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:36.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.156+0000 7fe89051f700 1 -- 172.21.15.5:0/1299284606 >> 172.21.15.5:0/1299284606 conn(0x7fe8880f6c30 msgr2=0x7fe8880f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:28:36.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.156+0000 7fe89051f700 1 -- 172.21.15.5:0/1299284606 shutdown_connections 2024-04-16T14:28:36.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.156+0000 7fe89051f700 1 -- 172.21.15.5:0/1299284606 wait complete. 2024-04-16T14:28:36.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.156+0000 7fe89051f700 1 Processor -- start 2024-04-16T14:28:36.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.156+0000 7fe89051f700 1 -- start start 2024-04-16T14:28:36.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.157+0000 7fe89051f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe888102b10 0x7fe888113290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:28:36.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.157+0000 7fe89051f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8881137d0 0x7fe88810d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:28:36.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.157+0000 7fe89051f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe888113de0 con 0x7fe888102b10 2024-04-16T14:28:36.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.157+0000 7fe89051f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88810d730 con 0x7fe8881137d0 2024-04-16T14:28:36.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.157+0000 7fe88e2bb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe888102b10 0x7fe888113290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:28:36.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.157+0000 7fe88e2bb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe888102b10 0x7fe888113290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37282/0 (socket says 172.21.15.5:37282) 2024-04-16T14:28:36.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.157+0000 7fe88e2bb700 1 -- 172.21.15.5:0/1682818825 learned_addr learned my addr 172.21.15.5:0/1682818825 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:28:36.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.157+0000 7fe88e2bb700 1 -- 172.21.15.5:0/1682818825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8881137d0 msgr2=0x7fe88810d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:28:36.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.157+0000 7fe88e2bb700 1 --2- 172.21.15.5:0/1682818825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8881137d0 0x7fe88810d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:36.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.157+0000 7fe88e2bb700 1 -- 172.21.15.5:0/1682818825 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe884005040 con 0x7fe888102b10 2024-04-16T14:28:36.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.157+0000 7fe88e2bb700 1 --2- 172.21.15.5:0/1682818825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe888102b10 0x7fe888113290 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe884007f50 tx=0x7fe884009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:28:36.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.157+0000 7fe87effd700 1 -- 172.21.15.5:0/1682818825 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe88400e040 con 0x7fe888102b10 2024-04-16T14:28:36.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.157+0000 7fe87effd700 1 -- 172.21.15.5:0/1682818825 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe884013420 con 0x7fe888102b10 2024-04-16T14:28:36.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.157+0000 7fe89051f700 1 -- 172.21.15.5:0/1682818825 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe88810da10 con 0x7fe888102b10 2024-04-16T14:28:36.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.157+0000 7fe87effd700 1 -- 172.21.15.5:0/1682818825 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe88401c630 con 0x7fe888102b10 2024-04-16T14:28:36.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.157+0000 7fe89051f700 1 -- 172.21.15.5:0/1682818825 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe88810df50 con 0x7fe888102b10 2024-04-16T14:28:36.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.158+0000 7fe89051f700 1 -- 172.21.15.5:0/1682818825 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8880fe200 con 0x7fe888102b10 2024-04-16T14:28:36.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.159+0000 7fe87effd700 1 -- 172.21.15.5:0/1682818825 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 86571+0+0 (secure 0 0 0) 0x7fe884009500 con 0x7fe888102b10 2024-04-16T14:28:36.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.159+0000 7fe87effd700 1 --2- 172.21.15.5:0/1682818825 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe874069370 0x7fe87406b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:28:36.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.159+0000 7fe87effd700 1 -- 172.21.15.5:0/1682818825 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fe8840872a0 con 0x7fe888102b10 2024-04-16T14:28:36.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.159+0000 7fe88daba700 1 --2- 172.21.15.5:0/1682818825 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe874069370 0x7fe87406b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:28:36.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.160+0000 7fe88daba700 1 --2- 172.21.15.5:0/1682818825 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe874069370 0x7fe87406b820 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe878009930 tx=0x7fe878006de0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:28:36.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.164+0000 7fe87effd700 1 -- 172.21.15.5:0/1682818825 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe8840581e0 con 0x7fe888102b10 2024-04-16T14:28:36.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:35 smithi115 ceph-mon[37295]: Updating smithi005:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.conf 2024-04-16T14:28:36.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:35 smithi115 ceph-mon[37295]: Updating smithi115:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.conf 2024-04-16T14:28:36.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:35 smithi115 ceph-mon[37295]: Reconfiguring mon.smithi005 (unknown last config time)... 2024-04-16T14:28:36.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:35 smithi115 ceph-mon[37295]: Reconfiguring daemon mon.smithi005 on smithi005 2024-04-16T14:28:36.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:35 smithi115 ceph-mon[37295]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:36.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.360+0000 7fe89051f700 1 -- 172.21.15.5:0/1682818825 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fe888106e50 con 0x7fe888102b10 2024-04-16T14:28:36.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.360+0000 7fe87effd700 1 -- 172.21.15.5:0/1682818825 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+223 (secure 0 0 0) 0x7fe884057d70 con 0x7fe888102b10 2024-04-16T14:28:36.359 INFO:teuthology.orchestra.run.smithi005.stdout:# minimal ceph.conf for 10609bfa-fbfd-11ee-bc90-c7b262605968 2024-04-16T14:28:36.359 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2024-04-16T14:28:36.360 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = 10609bfa-fbfd-11ee-bc90-c7b262605968 2024-04-16T14:28:36.360 INFO:teuthology.orchestra.run.smithi005.stdout: mon_host = [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] 2024-04-16T14:28:36.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.362+0000 7fe89051f700 1 -- 172.21.15.5:0/1682818825 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe874069370 msgr2=0x7fe87406b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:28:36.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.362+0000 7fe89051f700 1 --2- 172.21.15.5:0/1682818825 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe874069370 0x7fe87406b820 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe878009930 tx=0x7fe878006de0 comp rx=0 tx=0).stop 2024-04-16T14:28:36.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.363+0000 7fe89051f700 1 -- 172.21.15.5:0/1682818825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe888102b10 msgr2=0x7fe888113290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:28:36.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.363+0000 7fe89051f700 1 --2- 172.21.15.5:0/1682818825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe888102b10 0x7fe888113290 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe884007f50 tx=0x7fe884009e30 comp rx=0 tx=0).stop 2024-04-16T14:28:36.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.363+0000 7fe89051f700 1 -- 172.21.15.5:0/1682818825 shutdown_connections 2024-04-16T14:28:36.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.363+0000 7fe89051f700 1 --2- 172.21.15.5:0/1682818825 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe874069370 0x7fe87406b820 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:36.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.363+0000 7fe89051f700 1 --2- 172.21.15.5:0/1682818825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe888102b10 0x7fe888113290 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:36.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.363+0000 7fe89051f700 1 --2- 172.21.15.5:0/1682818825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8881137d0 0x7fe88810d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:36.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.363+0000 7fe89051f700 1 -- 172.21.15.5:0/1682818825 >> 172.21.15.5:0/1682818825 conn(0x7fe8880f6c30 msgr2=0x7fe8880f7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:28:36.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.363+0000 7fe89051f700 1 -- 172.21.15.5:0/1682818825 shutdown_connections 2024-04-16T14:28:36.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:36.363+0000 7fe89051f700 1 -- 172.21.15.5:0/1682818825 wait complete. 2024-04-16T14:28:37.247 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-16T14:28:37.247 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-16T14:28:37.247 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.conf 2024-04-16T14:28:37.318 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-16T14:28:37.318 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-16T14:28:37.387 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-16T14:28:37.387 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.conf 2024-04-16T14:28:37.423 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-16T14:28:37.423 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-16T14:28:37.495 INFO:tasks.cephadm:Deploying OSDs... 2024-04-16T14:28:37.495 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-16T14:28:37.495 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/scratch_devs of=/dev/stdout 2024-04-16T14:28:37.512 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-16T14:28:37.512 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_1 2024-04-16T14:28:37.513 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:37 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/1682818825' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:28:37.513 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:37 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:37.513 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:37 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:37.513 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:37 smithi005 ceph-mon[28964]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:37.513 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:37 smithi005 ceph-mon[28964]: Reconfiguring mgr.smithi005.ipwdkc (unknown last config time)... 2024-04-16T14:28:37.513 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:37 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi005.ipwdkc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-16T14:28:37.513 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:37 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-16T14:28:37.513 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:37 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:28:37.513 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:37 smithi005 ceph-mon[28964]: Reconfiguring daemon mgr.smithi005.ipwdkc on smithi005 2024-04-16T14:28:37.568 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-16T14:28:37.568 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T14:28:37.568 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-16T14:28:37.568 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T14:28:37.568 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T14:28:37.568 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-04-16 14:27:50.958366672 +0000 2024-04-16T14:28:37.568 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-04-16 14:22:00.139457180 +0000 2024-04-16T14:28:37.568 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-04-16 14:22:00.139457180 +0000 2024-04-16T14:28:37.568 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-04-16 14:22:00.139457180 +0000 2024-04-16T14:28:37.569 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-16T14:28:37.638 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-16T14:28:37.638 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-16T14:28:37.638 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 9.0188e-05 s, 5.7 MB/s 2024-04-16T14:28:37.639 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-16T14:28:37.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:37 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/1682818825' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:28:37.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:37 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:37.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:37 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:37.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:37 smithi115 ceph-mon[37295]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:37.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:37 smithi115 ceph-mon[37295]: Reconfiguring mgr.smithi005.ipwdkc (unknown last config time)... 2024-04-16T14:28:37.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:37 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi005.ipwdkc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-16T14:28:37.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:37 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-16T14:28:37.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:37 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:28:37.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:37 smithi115 ceph-mon[37295]: Reconfiguring daemon mgr.smithi005.ipwdkc on smithi005 2024-04-16T14:28:37.695 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_2 2024-04-16T14:28:37.753 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-16T14:28:37.753 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T14:28:37.753 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-16T14:28:37.753 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T14:28:37.754 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T14:28:37.754 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-04-16 14:27:50.958366672 +0000 2024-04-16T14:28:37.754 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-04-16 14:22:00.476450807 +0000 2024-04-16T14:28:37.754 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-04-16 14:22:00.476450807 +0000 2024-04-16T14:28:37.754 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-04-16 14:22:00.476450807 +0000 2024-04-16T14:28:37.754 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-16T14:28:37.823 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-16T14:28:37.823 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-16T14:28:37.823 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000100361 s, 5.1 MB/s 2024-04-16T14:28:37.825 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-16T14:28:37.887 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_3 2024-04-16T14:28:37.943 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-16T14:28:37.943 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T14:28:37.944 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-16T14:28:37.944 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T14:28:37.944 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T14:28:37.944 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-04-16 14:27:50.959366654 +0000 2024-04-16T14:28:37.944 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-04-16 14:22:00.914442523 +0000 2024-04-16T14:28:37.944 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-04-16 14:22:00.914442523 +0000 2024-04-16T14:28:37.944 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-04-16 14:22:00.914442523 +0000 2024-04-16T14:28:37.945 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-16T14:28:38.011 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-16T14:28:38.011 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-16T14:28:38.011 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 9.7878e-05 s, 5.2 MB/s 2024-04-16T14:28:38.012 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-16T14:28:38.069 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_4 2024-04-16T14:28:38.124 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-16T14:28:38.125 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T14:28:38.125 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-16T14:28:38.125 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T14:28:38.125 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T14:28:38.125 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-04-16 14:27:50.959366654 +0000 2024-04-16T14:28:38.125 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-04-16 14:22:01.238436396 +0000 2024-04-16T14:28:38.125 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-04-16 14:22:01.238436396 +0000 2024-04-16T14:28:38.125 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-04-16 14:22:01.238436396 +0000 2024-04-16T14:28:38.125 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-16T14:28:38.191 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-04-16T14:28:38.191 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-04-16T14:28:38.191 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000101155 s, 5.1 MB/s 2024-04-16T14:28:38.192 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-16T14:28:38.249 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-16T14:28:38.249 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/scratch_devs of=/dev/stdout 2024-04-16T14:28:38.267 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-16T14:28:38.268 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_1 2024-04-16T14:28:38.325 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-16T14:28:38.325 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T14:28:38.325 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-04-16T14:28:38.326 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T14:28:38.326 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T14:28:38.326 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-04-16 14:28:24.611225299 +0000 2024-04-16T14:28:38.326 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-04-16 14:21:59.617381505 +0000 2024-04-16T14:28:38.326 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-04-16 14:21:59.617381505 +0000 2024-04-16T14:28:38.326 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-04-16 14:21:59.617381505 +0000 2024-04-16T14:28:38.326 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-16T14:28:38.396 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-04-16T14:28:38.396 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-04-16T14:28:38.396 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000233773 s, 2.2 MB/s 2024-04-16T14:28:38.397 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-16T14:28:38.456 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_2 2024-04-16T14:28:38.513 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-16T14:28:38.514 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T14:28:38.514 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-16T14:28:38.514 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T14:28:38.514 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T14:28:38.514 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-04-16 14:28:24.612225280 +0000 2024-04-16T14:28:38.514 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-04-16 14:21:59.968374872 +0000 2024-04-16T14:28:38.514 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-04-16 14:21:59.968374872 +0000 2024-04-16T14:28:38.514 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-04-16 14:21:59.968374872 +0000 2024-04-16T14:28:38.515 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-16T14:28:38.581 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-04-16T14:28:38.582 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-04-16T14:28:38.582 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000205993 s, 2.5 MB/s 2024-04-16T14:28:38.583 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-16T14:28:38.640 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_3 2024-04-16T14:28:38.696 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-16T14:28:38.696 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T14:28:38.697 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-04-16T14:28:38.697 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T14:28:38.697 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T14:28:38.697 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-04-16 14:28:24.612225280 +0000 2024-04-16T14:28:38.697 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-04-16 14:22:00.325368126 +0000 2024-04-16T14:28:38.697 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-04-16 14:22:00.325368126 +0000 2024-04-16T14:28:38.697 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-04-16 14:22:00.325368126 +0000 2024-04-16T14:28:38.697 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-16T14:28:38.764 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-04-16T14:28:38.764 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-04-16T14:28:38.764 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000209163 s, 2.4 MB/s 2024-04-16T14:28:38.765 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-16T14:28:38.822 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_4 2024-04-16T14:28:38.878 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-16T14:28:38.878 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T14:28:38.878 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-16T14:28:38.878 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T14:28:38.878 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T14:28:38.878 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-04-16 14:28:24.612225280 +0000 2024-04-16T14:28:38.878 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-04-16 14:22:00.679361436 +0000 2024-04-16T14:28:38.878 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-04-16 14:22:00.679361436 +0000 2024-04-16T14:28:38.879 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-04-16 14:22:00.679361436 +0000 2024-04-16T14:28:38.879 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-16T14:28:38.945 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-04-16T14:28:38.945 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-04-16T14:28:38.945 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000176341 s, 2.9 MB/s 2024-04-16T14:28:38.947 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-16T14:28:39.003 INFO:tasks.cephadm:Deploying osd.0 on smithi005 with /dev/vg_nvme/lv_4... 2024-04-16T14:28:39.003 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-16T14:28:39.338 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:28:39.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:39 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:39.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:39 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:39.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:39 smithi005 ceph-mon[28964]: Reconfiguring crash.smithi005 (monmap changed)... 2024-04-16T14:28:39.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:39 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi005", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-16T14:28:39.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:39 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:28:39.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:39 smithi005 ceph-mon[28964]: Reconfiguring daemon crash.smithi005 on smithi005 2024-04-16T14:28:39.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:39 smithi005 ceph-mon[28964]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:39.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:39 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:39.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:39 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:39.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:39 smithi115 ceph-mon[37295]: Reconfiguring crash.smithi005 (monmap changed)... 2024-04-16T14:28:39.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:39 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi005", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-16T14:28:39.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:39 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:28:39.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:39 smithi115 ceph-mon[37295]: Reconfiguring daemon crash.smithi005 on smithi005 2024-04-16T14:28:39.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:39 smithi115 ceph-mon[37295]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:41.048 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:40 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:41.048 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:40 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:41.048 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:40 smithi005 ceph-mon[28964]: Reconfiguring alertmanager.smithi005 (dependencies changed)... 2024-04-16T14:28:41.048 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:40 smithi005 ceph-mon[28964]: Reconfiguring daemon alertmanager.smithi005 on smithi005 2024-04-16T14:28:41.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:40 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:41.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:40 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:41.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:40 smithi115 ceph-mon[37295]: Reconfiguring alertmanager.smithi005 (dependencies changed)... 2024-04-16T14:28:41.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:40 smithi115 ceph-mon[37295]: Reconfiguring daemon alertmanager.smithi005 on smithi005 2024-04-16T14:28:41.594 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-16T14:28:41.594 INFO:teuthology.orchestra.run.smithi005.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-16T14:28:41.595 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10+0 records in 2024-04-16T14:28:41.595 INFO:teuthology.orchestra.run.smithi005.stderr:10+0 records out 2024-04-16T14:28:41.595 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00872045 s, 1.2 GB/s 2024-04-16T14:28:41.595 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping successful for: 2024-04-16T14:28:41.957 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:41 smithi005 ceph-mon[28964]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:42.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:41 smithi115 ceph-mon[37295]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:42.342 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph orch daemon add osd smithi005:vg_nvme/lv_4 2024-04-16T14:28:42.686 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:28:44.084 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:43 smithi005 ceph-mon[28964]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:44.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:43 smithi115 ceph-mon[37295]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:45.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.854+0000 7ffab65a2700 1 -- 172.21.15.5:0/3261116260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffab00fc110 msgr2=0x7ffab00fc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:28:45.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.854+0000 7ffab65a2700 1 --2- 172.21.15.5:0/3261116260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffab00fc110 0x7ffab00fc520 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ffaac004940 tx=0x7ffaac009e30 comp rx=0 tx=0).stop 2024-04-16T14:28:45.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.854+0000 7ffab65a2700 1 -- 172.21.15.5:0/3261116260 shutdown_connections 2024-04-16T14:28:45.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.854+0000 7ffab65a2700 1 --2- 172.21.15.5:0/3261116260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffab00fca60 0x7ffab00fced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:45.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.854+0000 7ffab65a2700 1 --2- 172.21.15.5:0/3261116260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffab00fc110 0x7ffab00fc520 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:45.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.854+0000 7ffab65a2700 1 -- 172.21.15.5:0/3261116260 >> 172.21.15.5:0/3261116260 conn(0x7ffab00f6a00 msgr2=0x7ffab00f8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:28:45.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.854+0000 7ffab65a2700 1 -- 172.21.15.5:0/3261116260 shutdown_connections 2024-04-16T14:28:45.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.854+0000 7ffab65a2700 1 -- 172.21.15.5:0/3261116260 wait complete. 2024-04-16T14:28:45.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.854+0000 7ffab65a2700 1 Processor -- start 2024-04-16T14:28:45.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.854+0000 7ffab65a2700 1 -- start start 2024-04-16T14:28:45.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.855+0000 7ffab65a2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffab00fc110 0x7ffab0110660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:28:45.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.855+0000 7ffab65a2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffab00fca60 0x7ffab0112bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:28:45.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.855+0000 7ffab65a2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab00fbb90 con 0x7ffab00fca60 2024-04-16T14:28:45.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.855+0000 7ffab65a2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab00fbcd0 con 0x7ffab00fc110 2024-04-16T14:28:45.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.855+0000 7ffab4d9f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffab00fca60 0x7ffab0112bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:28:45.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.855+0000 7ffab4d9f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffab00fca60 0x7ffab0112bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46076/0 (socket says 172.21.15.5:46076) 2024-04-16T14:28:45.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.855+0000 7ffab4d9f700 1 -- 172.21.15.5:0/40119113 learned_addr learned my addr 172.21.15.5:0/40119113 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:28:45.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.855+0000 7ffab55a0700 1 --2- 172.21.15.5:0/40119113 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffab00fc110 0x7ffab0110660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:28:45.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.855+0000 7ffab4d9f700 1 -- 172.21.15.5:0/40119113 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffab00fc110 msgr2=0x7ffab0110660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:28:45.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.855+0000 7ffab4d9f700 1 --2- 172.21.15.5:0/40119113 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffab00fc110 0x7ffab0110660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:28:45.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.855+0000 7ffab4d9f700 1 -- 172.21.15.5:0/40119113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac005040 con 0x7ffab00fca60 2024-04-16T14:28:45.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.855+0000 7ffab4d9f700 1 --2- 172.21.15.5:0/40119113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffab00fca60 0x7ffab0112bb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000b790 tx=0x7ffaa0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:28:45.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.855+0000 7ffaa5ffb700 1 -- 172.21.15.5:0/40119113 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaa000f6f0 con 0x7ffab00fca60 2024-04-16T14:28:45.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.855+0000 7ffab65a2700 1 -- 172.21.15.5:0/40119113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab0113210 con 0x7ffab00fca60 2024-04-16T14:28:45.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.856+0000 7ffaa5ffb700 1 -- 172.21.15.5:0/40119113 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffaa000fd20 con 0x7ffab00fca60 2024-04-16T14:28:45.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.856+0000 7ffaa5ffb700 1 -- 172.21.15.5:0/40119113 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaa001adf0 con 0x7ffab00fca60 2024-04-16T14:28:45.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.856+0000 7ffab65a2700 1 -- 172.21.15.5:0/40119113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab01137a0 con 0x7ffab00fca60 2024-04-16T14:28:45.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.857+0000 7ffaa5ffb700 1 -- 172.21.15.5:0/40119113 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 86571+0+0 (secure 0 0 0) 0x7ffaa0011400 con 0x7ffab00fca60 2024-04-16T14:28:45.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.857+0000 7ffab65a2700 1 -- 172.21.15.5:0/40119113 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa940052e0 con 0x7ffab00fca60 2024-04-16T14:28:45.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.857+0000 7ffaa5ffb700 1 --2- 172.21.15.5:0/40119113 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ffa9c069260 0x7ffa9c06b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:28:45.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.858+0000 7ffaa5ffb700 1 -- 172.21.15.5:0/40119113 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7ffaa0085dc0 con 0x7ffab00fca60 2024-04-16T14:28:45.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.858+0000 7ffab55a0700 1 --2- 172.21.15.5:0/40119113 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ffa9c069260 0x7ffa9c06b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:28:45.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.858+0000 7ffab55a0700 1 --2- 172.21.15.5:0/40119113 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ffa9c069260 0x7ffa9c06b710 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffab00fb780 tx=0x7ffaac009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:28:45.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:45.862+0000 7ffaa5ffb700 1 -- 172.21.15.5:0/40119113 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ffaa00531d0 con 0x7ffab00fca60 2024-04-16T14:28:45.951 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:45 smithi005 ceph-mon[28964]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:46.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:28:46.068+0000 7ffab65a2700 1 -- 172.21.15.5:0/40119113 --> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa94000bf0 con 0x7ffa9c069260 2024-04-16T14:28:46.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:45 smithi115 ceph-mon[37295]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:46.929 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:46 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-16T14:28:46.929 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:46 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-16T14:28:46.929 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:46 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:28:47.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:46 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-16T14:28:47.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:46 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-16T14:28:47.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:46 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:28:47.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:47 smithi005 ceph-mon[28964]: from='client.14246 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:28:47.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:47 smithi005 ceph-mon[28964]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:47.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:47 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:28:48.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:47 smithi115 ceph-mon[37295]: from='client.14246 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:28:48.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:47 smithi115 ceph-mon[37295]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:48.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:47 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:28:49.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:49 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:49.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:49 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:49.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:49 smithi115 ceph-mon[37295]: Reconfiguring grafana.smithi005 (dependencies changed)... 2024-04-16T14:28:49.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:49 smithi115 ceph-mon[37295]: Reconfiguring daemon grafana.smithi005 on smithi005 2024-04-16T14:28:49.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:49 smithi115 ceph-mon[37295]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:49.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:49 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:49.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:49 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:49.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:49 smithi005 ceph-mon[28964]: Reconfiguring grafana.smithi005 (dependencies changed)... 2024-04-16T14:28:49.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:49 smithi005 ceph-mon[28964]: Reconfiguring daemon grafana.smithi005 on smithi005 2024-04-16T14:28:49.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:49 smithi005 ceph-mon[28964]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:50.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:50 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/798010629' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa9fa9e4-bdd2-42c5-ba51-8d141fa9c4c0"}]: dispatch 2024-04-16T14:28:50.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:50 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/798010629' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aa9fa9e4-bdd2-42c5-ba51-8d141fa9c4c0"}]': finished 2024-04-16T14:28:50.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:50 smithi115 ceph-mon[37295]: osdmap e6: 1 total, 0 up, 1 in 2024-04-16T14:28:50.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:50 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-16T14:28:50.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:50 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/3185674881' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-16T14:28:50.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:50 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/798010629' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aa9fa9e4-bdd2-42c5-ba51-8d141fa9c4c0"}]: dispatch 2024-04-16T14:28:50.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:50 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/798010629' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aa9fa9e4-bdd2-42c5-ba51-8d141fa9c4c0"}]': finished 2024-04-16T14:28:50.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:50 smithi005 ceph-mon[28964]: osdmap e6: 1 total, 0 up, 1 in 2024-04-16T14:28:50.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:50 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-16T14:28:50.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:50 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/3185674881' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-16T14:28:51.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:51 smithi115 ceph-mon[37295]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:51.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:51 smithi005 ceph-mon[28964]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:53.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:53 smithi005 ceph-mon[28964]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:54.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:53 smithi115 ceph-mon[37295]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:56.126 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:55 smithi005 ceph-mon[28964]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:56.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:55 smithi115 ceph-mon[37295]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:57.929 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:57 smithi005 ceph-mon[28964]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:58.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:57 smithi115 ceph-mon[37295]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:59.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:59 smithi005 ceph-mon[28964]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:28:59.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:59 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:59.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:59 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:28:59.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:59 smithi005 ceph-mon[28964]: Reconfiguring prometheus.smithi005 (dependencies changed)... 2024-04-16T14:28:59.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:28:59 smithi005 ceph-mon[28964]: Reconfiguring daemon prometheus.smithi005 on smithi005 2024-04-16T14:29:00.258 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:59 smithi115 ceph-mon[37295]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:29:00.258 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:59 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:00.258 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:59 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:00.258 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:59 smithi115 ceph-mon[37295]: Reconfiguring prometheus.smithi005 (dependencies changed)... 2024-04-16T14:29:00.258 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:28:59 smithi115 ceph-mon[37295]: Reconfiguring daemon prometheus.smithi005 on smithi005 2024-04-16T14:29:01.200 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:00 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-16T14:29:01.200 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:00 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:29:01.223 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:00 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-16T14:29:01.223 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:00 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:29:02.086 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:01 smithi005 ceph-mon[28964]: Deploying daemon osd.0 on smithi005 2024-04-16T14:29:02.086 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:01 smithi005 ceph-mon[28964]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:29:02.434 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:01 smithi115 ceph-mon[37295]: Deploying daemon osd.0 on smithi005 2024-04-16T14:29:02.434 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:01 smithi115 ceph-mon[37295]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:29:03.194 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:02 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:29:03.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:02 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:29:04.160 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:03 smithi005 ceph-mon[28964]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:29:04.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:03 smithi115 ceph-mon[37295]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:29:05.666 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:05 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:05.667 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:05 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:05.667 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:05 smithi005 ceph-mon[28964]: Reconfiguring crash.smithi115 (monmap changed)... 2024-04-16T14:29:05.667 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:05 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi115", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-16T14:29:05.667 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:05 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:29:05.667 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:05 smithi005 ceph-mon[28964]: Reconfiguring daemon crash.smithi115 on smithi115 2024-04-16T14:29:05.667 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:05 smithi005 ceph-mon[28964]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:29:05.833 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:05 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:05.834 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:05 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:05.834 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:05 smithi115 ceph-mon[37295]: Reconfiguring crash.smithi115 (monmap changed)... 2024-04-16T14:29:05.834 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:05 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi115", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-16T14:29:05.834 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:05 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:29:05.834 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:05 smithi115 ceph-mon[37295]: Reconfiguring daemon crash.smithi115 on smithi115 2024-04-16T14:29:05.834 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:05 smithi115 ceph-mon[37295]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:29:06.978 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:06 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:06.979 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:06 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:06.979 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:06 smithi005 ceph-mon[28964]: Reconfiguring mgr.smithi115.brjkpo (monmap changed)... 2024-04-16T14:29:06.979 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:06 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi115.brjkpo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-16T14:29:06.979 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:06 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-16T14:29:06.979 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:06 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:29:06.979 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:06 smithi005 ceph-mon[28964]: Reconfiguring daemon mgr.smithi115.brjkpo on smithi115 2024-04-16T14:29:07.174 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:06 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:07.175 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:06 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:07.175 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:06 smithi115 ceph-mon[37295]: Reconfiguring mgr.smithi115.brjkpo (monmap changed)... 2024-04-16T14:29:07.175 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:06 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi115.brjkpo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-16T14:29:07.175 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:06 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-16T14:29:07.175 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:06 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:29:07.175 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:06 smithi115 ceph-mon[37295]: Reconfiguring daemon mgr.smithi115.brjkpo on smithi115 2024-04-16T14:29:07.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:07 smithi115 ceph-mon[37295]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:29:07.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:07 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:07.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:07 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:07.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:07 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-16T14:29:07.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:07 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-16T14:29:07.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:07 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:29:07.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:07 smithi005 ceph-mon[28964]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:29:07.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:07 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:07.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:07 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:07.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:07 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-16T14:29:07.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:07 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-16T14:29:07.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:07 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:29:09.133 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:08 smithi005 ceph-mon[28964]: Reconfiguring mon.smithi115 (monmap changed)... 2024-04-16T14:29:09.133 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:08 smithi005 ceph-mon[28964]: Reconfiguring daemon mon.smithi115 on smithi115 2024-04-16T14:29:09.133 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:08 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:09.133 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:08 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:09.133 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:08 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-16T14:29:09.133 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:08 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi005.front.sepia.ceph.com:9093"}]: dispatch 2024-04-16T14:29:09.133 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:08 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:09.133 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:08 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-16T14:29:09.134 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:08 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi005.front.sepia.ceph.com:3000"}]: dispatch 2024-04-16T14:29:09.134 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:08 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:09.134 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:08 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-16T14:29:09.134 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:08 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi005.front.sepia.ceph.com:9095"}]: dispatch 2024-04-16T14:29:09.134 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:08 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:09.134 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:08 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:29:09.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:08 smithi115 ceph-mon[37295]: Reconfiguring mon.smithi115 (monmap changed)... 2024-04-16T14:29:09.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:08 smithi115 ceph-mon[37295]: Reconfiguring daemon mon.smithi115 on smithi115 2024-04-16T14:29:09.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:08 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:09.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:08 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:09.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:08 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-16T14:29:09.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:08 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi005.front.sepia.ceph.com:9093"}]: dispatch 2024-04-16T14:29:09.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:08 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:09.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:08 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-16T14:29:09.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:08 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi005.front.sepia.ceph.com:3000"}]: dispatch 2024-04-16T14:29:09.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:08 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:09.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:08 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-16T14:29:09.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:08 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi005.front.sepia.ceph.com:9095"}]: dispatch 2024-04-16T14:29:09.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:08 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:09.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:08 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:29:10.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:09 smithi115 ceph-mon[37295]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-16T14:29:10.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:09 smithi115 ceph-mon[37295]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi005.front.sepia.ceph.com:9093"}]: dispatch 2024-04-16T14:29:10.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:09 smithi115 ceph-mon[37295]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:29:10.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:09 smithi115 ceph-mon[37295]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-16T14:29:10.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:09 smithi115 ceph-mon[37295]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi005.front.sepia.ceph.com:3000"}]: dispatch 2024-04-16T14:29:10.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:09 smithi115 ceph-mon[37295]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-16T14:29:10.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:09 smithi115 ceph-mon[37295]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi005.front.sepia.ceph.com:9095"}]: dispatch 2024-04-16T14:29:10.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:09 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:10.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:09 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:10.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:09 smithi005 ceph-mon[28964]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-16T14:29:10.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:09 smithi005 ceph-mon[28964]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi005.front.sepia.ceph.com:9093"}]: dispatch 2024-04-16T14:29:10.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:09 smithi005 ceph-mon[28964]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:29:10.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:09 smithi005 ceph-mon[28964]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-16T14:29:10.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:09 smithi005 ceph-mon[28964]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi005.front.sepia.ceph.com:3000"}]: dispatch 2024-04-16T14:29:10.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:09 smithi005 ceph-mon[28964]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-16T14:29:10.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:09 smithi005 ceph-mon[28964]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi005.front.sepia.ceph.com:9095"}]: dispatch 2024-04-16T14:29:10.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:09 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:10.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:09 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:11.520 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:11 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:11.520 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:11 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:11.520 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:11 smithi005 ceph-mon[28964]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:29:11.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:11 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:11.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:11 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:11.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:11 smithi115 ceph-mon[37295]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:29:12.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:12.705+0000 7ffaa5ffb700 1 -- 172.21.15.5:0/40119113 <== mgr.14212 v2:172.21.15.5:6800/3841652776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ffa94000bf0 con 0x7ffa9c069260 2024-04-16T14:29:12.704 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 0 on host 'smithi005' 2024-04-16T14:29:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:12.707+0000 7ffab65a2700 1 -- 172.21.15.5:0/40119113 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ffa9c069260 msgr2=0x7ffa9c06b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:29:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:12.707+0000 7ffab65a2700 1 --2- 172.21.15.5:0/40119113 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ffa9c069260 0x7ffa9c06b710 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffab00fb780 tx=0x7ffaac009e30 comp rx=0 tx=0).stop 2024-04-16T14:29:12.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:12.707+0000 7ffab65a2700 1 -- 172.21.15.5:0/40119113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffab00fca60 msgr2=0x7ffab0112bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:29:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:12.707+0000 7ffab65a2700 1 --2- 172.21.15.5:0/40119113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffab00fca60 0x7ffab0112bb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000b790 tx=0x7ffaa0009250 comp rx=0 tx=0).stop 2024-04-16T14:29:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:12.707+0000 7ffab65a2700 1 -- 172.21.15.5:0/40119113 shutdown_connections 2024-04-16T14:29:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:12.707+0000 7ffab65a2700 1 --2- 172.21.15.5:0/40119113 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ffa9c069260 0x7ffa9c06b710 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:29:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:12.707+0000 7ffab65a2700 1 --2- 172.21.15.5:0/40119113 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffab00fc110 0x7ffab0110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:29:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:12.707+0000 7ffab65a2700 1 --2- 172.21.15.5:0/40119113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffab00fca60 0x7ffab0112bb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:29:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:12.707+0000 7ffab65a2700 1 -- 172.21.15.5:0/40119113 >> 172.21.15.5:0/40119113 conn(0x7ffab00f6a00 msgr2=0x7ffab00f8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:29:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:12.708+0000 7ffab65a2700 1 -- 172.21.15.5:0/40119113 shutdown_connections 2024-04-16T14:29:12.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:12.708+0000 7ffab65a2700 1 -- 172.21.15.5:0/40119113 wait complete. 2024-04-16T14:29:13.532 DEBUG:teuthology.orchestra.run.smithi005:osd.0> sudo journalctl -f -n 0 -u ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.0.service 2024-04-16T14:29:13.534 INFO:tasks.cephadm:Deploying osd.1 on smithi005 with /dev/vg_nvme/lv_3... 2024-04-16T14:29:13.534 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-16T14:29:13.776 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:13 smithi005 ceph-mon[28964]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:29:13.776 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:13 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:13.776 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:13 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:13.776 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:13 smithi005 ceph-mon[28964]: from='osd.0 [v2:172.21.15.5:6802/2400102721,v1:172.21.15.5:6803/2400102721]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-16T14:29:14.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:13 smithi115 ceph-mon[37295]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:29:14.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:13 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:14.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:13 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:14.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:13 smithi115 ceph-mon[37295]: from='osd.0 [v2:172.21.15.5:6802/2400102721,v1:172.21.15.5:6803/2400102721]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-16T14:29:14.196 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:29:14.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:14 smithi005 ceph-mon[28964]: from='osd.0 [v2:172.21.15.5:6802/2400102721,v1:172.21.15.5:6803/2400102721]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-16T14:29:14.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:14 smithi005 ceph-mon[28964]: osdmap e7: 1 total, 0 up, 1 in 2024-04-16T14:29:14.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:14 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-16T14:29:14.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:14 smithi005 ceph-mon[28964]: from='osd.0 [v2:172.21.15.5:6802/2400102721,v1:172.21.15.5:6803/2400102721]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-04-16T14:29:14.975 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:29:14 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0[47594]: 2024-04-16T14:29:14.734+0000 7ff6fe84f700 -1 osd.0 0 waiting for initial osdmap 2024-04-16T14:29:14.975 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:29:14 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0[47594]: 2024-04-16T14:29:14.737+0000 7ff6fae4d700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T14:29:15.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:14 smithi115 ceph-mon[37295]: from='osd.0 [v2:172.21.15.5:6802/2400102721,v1:172.21.15.5:6803/2400102721]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-16T14:29:15.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:14 smithi115 ceph-mon[37295]: osdmap e7: 1 total, 0 up, 1 in 2024-04-16T14:29:15.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:14 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-16T14:29:15.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:14 smithi115 ceph-mon[37295]: from='osd.0 [v2:172.21.15.5:6802/2400102721,v1:172.21.15.5:6803/2400102721]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-04-16T14:29:15.936 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:15 smithi005 ceph-mon[28964]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:29:15.936 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:15 smithi005 ceph-mon[28964]: from='osd.0 [v2:172.21.15.5:6802/2400102721,v1:172.21.15.5:6803/2400102721]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-04-16T14:29:15.936 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:15 smithi005 ceph-mon[28964]: osdmap e8: 1 total, 0 up, 1 in 2024-04-16T14:29:15.936 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:15 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-16T14:29:15.937 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:15 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-16T14:29:15.937 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:15 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-16T14:29:16.123 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-16T14:29:16.123 INFO:teuthology.orchestra.run.smithi005.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-16T14:29:16.123 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10+0 records in 2024-04-16T14:29:16.123 INFO:teuthology.orchestra.run.smithi005.stderr:10+0 records out 2024-04-16T14:29:16.123 INFO:teuthology.orchestra.run.smithi005.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0107188 s, 978 MB/s 2024-04-16T14:29:16.123 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping successful for: 2024-04-16T14:29:16.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:15 smithi115 ceph-mon[37295]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:29:16.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:15 smithi115 ceph-mon[37295]: from='osd.0 [v2:172.21.15.5:6802/2400102721,v1:172.21.15.5:6803/2400102721]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-04-16T14:29:16.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:15 smithi115 ceph-mon[37295]: osdmap e8: 1 total, 0 up, 1 in 2024-04-16T14:29:16.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:15 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-16T14:29:16.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:15 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-16T14:29:16.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:15 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-16T14:29:17.125 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:16 smithi005 ceph-mon[28964]: purged_snaps scrub starts 2024-04-16T14:29:17.125 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:16 smithi005 ceph-mon[28964]: purged_snaps scrub ok 2024-04-16T14:29:17.125 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:16 smithi005 ceph-mon[28964]: osd.0 [v2:172.21.15.5:6802/2400102721,v1:172.21.15.5:6803/2400102721] boot 2024-04-16T14:29:17.125 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:16 smithi005 ceph-mon[28964]: osdmap e9: 1 total, 1 up, 1 in 2024-04-16T14:29:17.125 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:16 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-16T14:29:17.151 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph orch daemon add osd smithi005:vg_nvme/lv_3 2024-04-16T14:29:17.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:16 smithi115 ceph-mon[37295]: purged_snaps scrub starts 2024-04-16T14:29:17.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:16 smithi115 ceph-mon[37295]: purged_snaps scrub ok 2024-04-16T14:29:17.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:16 smithi115 ceph-mon[37295]: osd.0 [v2:172.21.15.5:6802/2400102721,v1:172.21.15.5:6803/2400102721] boot 2024-04-16T14:29:17.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:16 smithi115 ceph-mon[37295]: osdmap e9: 1 total, 1 up, 1 in 2024-04-16T14:29:17.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:16 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-16T14:29:17.803 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:29:18.047 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:17 smithi005 ceph-mon[28964]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:29:18.047 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:17 smithi005 ceph-mon[28964]: osdmap e10: 1 total, 1 up, 1 in 2024-04-16T14:29:18.047 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:17 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:29:18.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:17 smithi115 ceph-mon[37295]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-16T14:29:18.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:17 smithi115 ceph-mon[37295]: osdmap e10: 1 total, 1 up, 1 in 2024-04-16T14:29:18.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:17 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:29:19.121 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:18 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:19.121 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:18 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:19.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:18 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:19.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:18 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:19.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.356+0000 7ff18af3d700 1 -- 172.21.15.5:0/3513821504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1840fce50 msgr2=0x7ff1840fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:29:19.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.356+0000 7ff18af3d700 1 --2- 172.21.15.5:0/3513821504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1840fce50 0x7ff1840fd260 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff178004940 tx=0x7ff178009e30 comp rx=0 tx=0).stop 2024-04-16T14:29:19.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.356+0000 7ff18af3d700 1 -- 172.21.15.5:0/3513821504 shutdown_connections 2024-04-16T14:29:19.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.356+0000 7ff18af3d700 1 --2- 172.21.15.5:0/3513821504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1840fe050 0x7ff1840fe4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:29:19.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.356+0000 7ff18af3d700 1 --2- 172.21.15.5:0/3513821504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1840fce50 0x7ff1840fd260 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:29:19.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.356+0000 7ff18af3d700 1 -- 172.21.15.5:0/3513821504 >> 172.21.15.5:0/3513821504 conn(0x7ff1840f8580 msgr2=0x7ff1840fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:29:19.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.356+0000 7ff18af3d700 1 -- 172.21.15.5:0/3513821504 shutdown_connections 2024-04-16T14:29:19.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.356+0000 7ff18af3d700 1 -- 172.21.15.5:0/3513821504 wait complete. 2024-04-16T14:29:19.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.357+0000 7ff18af3d700 1 Processor -- start 2024-04-16T14:29:19.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.357+0000 7ff18af3d700 1 -- start start 2024-04-16T14:29:19.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.357+0000 7ff18af3d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1840fce50 0x7ff18410fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:29:19.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.357+0000 7ff18af3d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1840fe050 0x7ff1841100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:29:19.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.357+0000 7ff18af3d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1841106b0 con 0x7ff1840fe050 2024-04-16T14:29:19.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.357+0000 7ff18af3d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff184110820 con 0x7ff1840fce50 2024-04-16T14:29:19.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.357+0000 7ff183fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1840fe050 0x7ff1841100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:29:19.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.357+0000 7ff183fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1840fe050 0x7ff1841100b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54454/0 (socket says 172.21.15.5:54454) 2024-04-16T14:29:19.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.357+0000 7ff183fff700 1 -- 172.21.15.5:0/2859753301 learned_addr learned my addr 172.21.15.5:0/2859753301 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:29:19.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.357+0000 7ff188cd9700 1 --2- 172.21.15.5:0/2859753301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1840fce50 0x7ff18410fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:29:19.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.357+0000 7ff183fff700 1 -- 172.21.15.5:0/2859753301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1840fce50 msgr2=0x7ff18410fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:29:19.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.357+0000 7ff183fff700 1 --2- 172.21.15.5:0/2859753301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1840fce50 0x7ff18410fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:29:19.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.357+0000 7ff183fff700 1 -- 172.21.15.5:0/2859753301 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff178005040 con 0x7ff1840fe050 2024-04-16T14:29:19.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.358+0000 7ff183fff700 1 --2- 172.21.15.5:0/2859753301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1840fe050 0x7ff1841100b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff170002a50 tx=0x7ff1700046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:29:19.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.358+0000 7ff1817fa700 1 -- 172.21.15.5:0/2859753301 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff170007cc0 con 0x7ff1840fe050 2024-04-16T14:29:19.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.358+0000 7ff18af3d700 1 -- 172.21.15.5:0/2859753301 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff184115280 con 0x7ff1840fe050 2024-04-16T14:29:19.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.358+0000 7ff1817fa700 1 -- 172.21.15.5:0/2859753301 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff17000f040 con 0x7ff1840fe050 2024-04-16T14:29:19.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.358+0000 7ff1817fa700 1 -- 172.21.15.5:0/2859753301 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff17000da30 con 0x7ff1840fe050 2024-04-16T14:29:19.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.358+0000 7ff18af3d700 1 -- 172.21.15.5:0/2859753301 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff184115840 con 0x7ff1840fe050 2024-04-16T14:29:19.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.359+0000 7ff18af3d700 1 -- 172.21.15.5:0/2859753301 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1680052e0 con 0x7ff1840fe050 2024-04-16T14:29:19.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.360+0000 7ff1817fa700 1 -- 172.21.15.5:0/2859753301 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 86571+0+0 (secure 0 0 0) 0x7ff17000dbb0 con 0x7ff1840fe050 2024-04-16T14:29:19.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.360+0000 7ff1817fa700 1 --2- 172.21.15.5:0/2859753301 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ff174069210 0x7ff17406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:29:19.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.360+0000 7ff1817fa700 1 -- 172.21.15.5:0/2859753301 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7ff170085fb0 con 0x7ff1840fe050 2024-04-16T14:29:19.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.360+0000 7ff188cd9700 1 --2- 172.21.15.5:0/2859753301 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ff174069210 0x7ff17406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:29:19.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.361+0000 7ff188cd9700 1 --2- 172.21.15.5:0/2859753301 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ff174069210 0x7ff17406b6c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff17800b970 tx=0x7ff178009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:29:19.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.366+0000 7ff1817fa700 1 -- 172.21.15.5:0/2859753301 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff170056b70 con 0x7ff1840fe050 2024-04-16T14:29:19.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:19.578+0000 7ff18af3d700 1 -- 172.21.15.5:0/2859753301 --> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7ff168000bf0 con 0x7ff174069210 2024-04-16T14:29:20.157 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:19 smithi005 ceph-mon[28964]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-16T14:29:20.157 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:19 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-16T14:29:20.157 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:19 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-16T14:29:20.157 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:19 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:29:20.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:19 smithi115 ceph-mon[37295]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-16T14:29:20.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:19 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-16T14:29:20.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:19 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-16T14:29:20.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:19 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:29:21.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:20 smithi115 ceph-mon[37295]: from='client.14264 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:29:21.196 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:20 smithi005 ceph-mon[28964]: from='client.14264 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:29:22.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:21 smithi115 ceph-mon[37295]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-16T14:29:22.223 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:21 smithi005 ceph-mon[28964]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-16T14:29:24.171 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:23 smithi005 ceph-mon[28964]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-16T14:29:24.171 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:23 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:24.171 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:23 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:24.171 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:23 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:29:24.171 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:23 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:24.171 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:23 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:29:24.171 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:23 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:29:24.171 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:23 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:24.171 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:23 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:29:24.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:23 smithi115 ceph-mon[37295]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-16T14:29:24.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:23 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:24.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:23 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:24.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:23 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:29:24.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:23 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:24.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:23 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:29:24.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:23 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:29:24.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:23 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:24.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:23 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:29:24.907 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:24 smithi115 ceph-mon[37295]: Detected new or changed devices on smithi005 2024-04-16T14:29:24.908 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:24 smithi115 ceph-mon[37295]: Adjusting osd_memory_target on smithi005 to 12869M 2024-04-16T14:29:24.908 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:24 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/1186740760' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4074765-a246-412a-8b68-8da402adc7d5"}]: dispatch 2024-04-16T14:29:24.908 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:24 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/1186740760' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d4074765-a246-412a-8b68-8da402adc7d5"}]': finished 2024-04-16T14:29:24.908 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:24 smithi115 ceph-mon[37295]: osdmap e11: 2 total, 1 up, 2 in 2024-04-16T14:29:24.908 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:24 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-16T14:29:25.191 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:24 smithi005 ceph-mon[28964]: Detected new or changed devices on smithi005 2024-04-16T14:29:25.191 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:24 smithi005 ceph-mon[28964]: Adjusting osd_memory_target on smithi005 to 12869M 2024-04-16T14:29:25.191 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:24 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/1186740760' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4074765-a246-412a-8b68-8da402adc7d5"}]: dispatch 2024-04-16T14:29:25.191 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:24 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/1186740760' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d4074765-a246-412a-8b68-8da402adc7d5"}]': finished 2024-04-16T14:29:25.191 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:24 smithi005 ceph-mon[28964]: osdmap e11: 2 total, 1 up, 2 in 2024-04-16T14:29:25.191 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:24 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-16T14:29:26.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:26 smithi005 ceph-mon[28964]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-16T14:29:26.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:26 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:26.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:26 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:26.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:26 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/2347302223' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-16T14:29:26.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:26 smithi115 ceph-mon[37295]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-16T14:29:26.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:26.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:26.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:26 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/2347302223' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-16T14:29:28.319 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:28 smithi005 ceph-mon[28964]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-16T14:29:28.319 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:28 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:28.319 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:28 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:28.319 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:28 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:29:28.319 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:28 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:29:28.319 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:28 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:28.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:28 smithi115 ceph-mon[37295]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-16T14:29:28.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:28 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:28.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:28 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:28.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:28 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:29:28.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:28 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:29:28.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:28 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:30.378 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:30 smithi005 ceph-mon[28964]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-16T14:29:30.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:30 smithi115 ceph-mon[37295]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-16T14:29:32.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:32 smithi005 ceph-mon[28964]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-16T14:29:32.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:32 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-16T14:29:32.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:32 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:29:32.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:32 smithi115 ceph-mon[37295]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-16T14:29:32.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:32 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-16T14:29:32.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:32 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:29:33.289 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:33 smithi005 ceph-mon[28964]: Deploying daemon osd.1 on smithi005 2024-04-16T14:29:33.289 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:33 smithi005 ceph-mon[28964]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-16T14:29:33.289 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:33 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:29:33.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:33 smithi115 ceph-mon[37295]: Deploying daemon osd.1 on smithi005 2024-04-16T14:29:33.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:33 smithi115 ceph-mon[37295]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-16T14:29:33.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:33 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:29:35.902 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:35 smithi005 ceph-mon[28964]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-16T14:29:36.180 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:35 smithi115 ceph-mon[37295]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-16T14:29:38.076 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:37 smithi005 ceph-mon[28964]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-16T14:29:38.076 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:37 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:38.076 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:37 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:38.076 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:37 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:29:38.124 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:37 smithi115 ceph-mon[37295]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-16T14:29:38.124 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:37 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:38.124 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:37 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:38.124 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:37 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:29:39.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:39 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:39.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:39 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:39.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:39 smithi005 ceph-mon[28964]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-16T14:29:39.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:39 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:39.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:39 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:39.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:39 smithi115 ceph-mon[37295]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-16T14:29:40.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:40.935+0000 7ff1817fa700 1 -- 172.21.15.5:0/2859753301 <== mgr.14212 v2:172.21.15.5:6800/3841652776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff168000bf0 con 0x7ff174069210 2024-04-16T14:29:40.934 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 1 on host 'smithi005' 2024-04-16T14:29:40.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:40.937+0000 7ff18af3d700 1 -- 172.21.15.5:0/2859753301 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ff174069210 msgr2=0x7ff17406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:29:40.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:40.937+0000 7ff18af3d700 1 --2- 172.21.15.5:0/2859753301 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ff174069210 0x7ff17406b6c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff17800b970 tx=0x7ff178009e30 comp rx=0 tx=0).stop 2024-04-16T14:29:40.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:40.937+0000 7ff18af3d700 1 -- 172.21.15.5:0/2859753301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1840fe050 msgr2=0x7ff1841100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:29:40.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:40.937+0000 7ff18af3d700 1 --2- 172.21.15.5:0/2859753301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1840fe050 0x7ff1841100b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff170002a50 tx=0x7ff1700046b0 comp rx=0 tx=0).stop 2024-04-16T14:29:40.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:40.937+0000 7ff18af3d700 1 -- 172.21.15.5:0/2859753301 shutdown_connections 2024-04-16T14:29:40.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:40.937+0000 7ff18af3d700 1 --2- 172.21.15.5:0/2859753301 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ff174069210 0x7ff17406b6c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:29:40.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:40.937+0000 7ff18af3d700 1 --2- 172.21.15.5:0/2859753301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1840fce50 0x7ff18410fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:29:40.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:40.937+0000 7ff18af3d700 1 --2- 172.21.15.5:0/2859753301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1840fe050 0x7ff1841100b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:29:40.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:40.937+0000 7ff18af3d700 1 -- 172.21.15.5:0/2859753301 >> 172.21.15.5:0/2859753301 conn(0x7ff1840f8580 msgr2=0x7ff1840f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:29:40.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:40.937+0000 7ff18af3d700 1 -- 172.21.15.5:0/2859753301 shutdown_connections 2024-04-16T14:29:40.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:40.937+0000 7ff18af3d700 1 -- 172.21.15.5:0/2859753301 wait complete. 2024-04-16T14:29:40.946 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:40 smithi005 ceph-mon[28964]: from='osd.1 [v2:172.21.15.5:6810/755259206,v1:172.21.15.5:6811/755259206]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-16T14:29:41.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:40 smithi115 ceph-mon[37295]: from='osd.1 [v2:172.21.15.5:6810/755259206,v1:172.21.15.5:6811/755259206]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-16T14:29:41.554 DEBUG:teuthology.orchestra.run.smithi005:osd.1> sudo journalctl -f -n 0 -u ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.1.service 2024-04-16T14:29:41.557 INFO:tasks.cephadm:Deploying osd.2 on smithi005 with /dev/vg_nvme/lv_2... 2024-04-16T14:29:41.557 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-16T14:29:41.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:41 smithi115 ceph-mon[37295]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-16T14:29:41.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:41 smithi115 ceph-mon[37295]: from='osd.1 [v2:172.21.15.5:6810/755259206,v1:172.21.15.5:6811/755259206]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-16T14:29:41.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:41 smithi115 ceph-mon[37295]: osdmap e12: 2 total, 1 up, 2 in 2024-04-16T14:29:41.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:41 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-16T14:29:41.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:41 smithi115 ceph-mon[37295]: from='osd.1 [v2:172.21.15.5:6810/755259206,v1:172.21.15.5:6811/755259206]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-04-16T14:29:41.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:41 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:41.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:41 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:41.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:41 smithi115 ceph-mon[37295]: from='osd.1 [v2:172.21.15.5:6810/755259206,v1:172.21.15.5:6811/755259206]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-04-16T14:29:41.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:41 smithi115 ceph-mon[37295]: osdmap e13: 2 total, 1 up, 2 in 2024-04-16T14:29:41.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:41 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-16T14:29:41.943 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:29:41.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:41 smithi005 ceph-mon[28964]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-16T14:29:41.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:41 smithi005 ceph-mon[28964]: from='osd.1 [v2:172.21.15.5:6810/755259206,v1:172.21.15.5:6811/755259206]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-16T14:29:41.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:41 smithi005 ceph-mon[28964]: osdmap e12: 2 total, 1 up, 2 in 2024-04-16T14:29:41.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:41 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-16T14:29:41.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:41 smithi005 ceph-mon[28964]: from='osd.1 [v2:172.21.15.5:6810/755259206,v1:172.21.15.5:6811/755259206]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-04-16T14:29:41.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:41 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:41.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:41 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:41.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:41 smithi005 ceph-mon[28964]: from='osd.1 [v2:172.21.15.5:6810/755259206,v1:172.21.15.5:6811/755259206]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-04-16T14:29:41.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:41 smithi005 ceph-mon[28964]: osdmap e13: 2 total, 1 up, 2 in 2024-04-16T14:29:41.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:41 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-16T14:29:41.975 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:29:41 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1[55157]: 2024-04-16T14:29:41.695+0000 7f2ca633d700 -1 osd.1 0 waiting for initial osdmap 2024-04-16T14:29:41.975 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:29:41 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1[55157]: 2024-04-16T14:29:41.701+0000 7f2ca1939700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T14:29:42.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:42 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-16T14:29:42.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:42 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-16T14:29:43.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:42 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-16T14:29:43.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:42 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-16T14:29:43.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:43 smithi005 ceph-mon[28964]: purged_snaps scrub starts 2024-04-16T14:29:43.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:43 smithi005 ceph-mon[28964]: purged_snaps scrub ok 2024-04-16T14:29:43.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:43 smithi005 ceph-mon[28964]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-16T14:29:43.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:43 smithi005 ceph-mon[28964]: osd.1 [v2:172.21.15.5:6810/755259206,v1:172.21.15.5:6811/755259206] boot 2024-04-16T14:29:43.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:43 smithi005 ceph-mon[28964]: osdmap e14: 2 total, 2 up, 2 in 2024-04-16T14:29:43.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:43 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-16T14:29:44.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:43 smithi115 ceph-mon[37295]: purged_snaps scrub starts 2024-04-16T14:29:44.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:43 smithi115 ceph-mon[37295]: purged_snaps scrub ok 2024-04-16T14:29:44.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:43 smithi115 ceph-mon[37295]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-16T14:29:44.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:43 smithi115 ceph-mon[37295]: osd.1 [v2:172.21.15.5:6810/755259206,v1:172.21.15.5:6811/755259206] boot 2024-04-16T14:29:44.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:43 smithi115 ceph-mon[37295]: osdmap e14: 2 total, 2 up, 2 in 2024-04-16T14:29:44.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:43 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-16T14:29:44.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:44 smithi005 ceph-mon[28964]: osdmap e15: 2 total, 2 up, 2 in 2024-04-16T14:29:44.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:44 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:44.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:44 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-16T14:29:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-16T14:29:45.113 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10+0 records in 2024-04-16T14:29:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:10+0 records out 2024-04-16T14:29:45.113 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00857922 s, 1.2 GB/s 2024-04-16T14:29:45.113 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping successful for: 2024-04-16T14:29:45.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:44 smithi115 ceph-mon[37295]: osdmap e15: 2 total, 2 up, 2 in 2024-04-16T14:29:45.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:44 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:45.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:44 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:45.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:45 smithi005 ceph-mon[28964]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:29:46.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:45 smithi115 ceph-mon[37295]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:29:46.470 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph orch daemon add osd smithi005:vg_nvme/lv_2 2024-04-16T14:29:46.936 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:29:47.913 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:47 smithi005 ceph-mon[28964]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:29:48.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:47 smithi115 ceph-mon[37295]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:29:48.886 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:48 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:29:48.886 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:48 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:48.886 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:48 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:48.887 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:48 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:29:48.887 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:48 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:29:48.887 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:48 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:48.887 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:48 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:29:48.887 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:48 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:29:48.887 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:48 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:48.887 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:48 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:29:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.092+0000 7fa443a57700 1 -- 172.21.15.5:0/200663055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa43c0fe050 msgr2=0x7fa43c0fe4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:29:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.092+0000 7fa443a57700 1 --2- 172.21.15.5:0/200663055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa43c0fe050 0x7fa43c0fe4c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa42c004940 tx=0x7fa42c009e30 comp rx=0 tx=0).stop 2024-04-16T14:29:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.092+0000 7fa443a57700 1 -- 172.21.15.5:0/200663055 shutdown_connections 2024-04-16T14:29:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.092+0000 7fa443a57700 1 --2- 172.21.15.5:0/200663055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa43c0fe050 0x7fa43c0fe4c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:29:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.092+0000 7fa443a57700 1 --2- 172.21.15.5:0/200663055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa43c0fce50 0x7fa43c0fd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:29:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.092+0000 7fa443a57700 1 -- 172.21.15.5:0/200663055 >> 172.21.15.5:0/200663055 conn(0x7fa43c0f8580 msgr2=0x7fa43c0fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:29:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.092+0000 7fa443a57700 1 -- 172.21.15.5:0/200663055 shutdown_connections 2024-04-16T14:29:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.092+0000 7fa443a57700 1 -- 172.21.15.5:0/200663055 wait complete. 2024-04-16T14:29:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.092+0000 7fa443a57700 1 Processor -- start 2024-04-16T14:29:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.093+0000 7fa443a57700 1 -- start start 2024-04-16T14:29:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.093+0000 7fa443a57700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa43c0fce50 0x7fa43c071c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:29:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.093+0000 7fa443a57700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa43c0fe050 0x7fa43c070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:29:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.093+0000 7fa443a57700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c072260 con 0x7fa43c0fce50 2024-04-16T14:29:49.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.093+0000 7fa443a57700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c070850 con 0x7fa43c0fe050 2024-04-16T14:29:49.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.093+0000 7fa4417f3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa43c0fce50 0x7fa43c071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:29:49.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.093+0000 7fa4417f3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa43c0fce50 0x7fa43c071c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:41284/0 (socket says 172.21.15.5:41284) 2024-04-16T14:29:49.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.093+0000 7fa4417f3700 1 -- 172.21.15.5:0/3897047229 learned_addr learned my addr 172.21.15.5:0/3897047229 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:29:49.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.093+0000 7fa440ff2700 1 --2- 172.21.15.5:0/3897047229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa43c0fe050 0x7fa43c070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:29:49.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.093+0000 7fa4417f3700 1 -- 172.21.15.5:0/3897047229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa43c0fe050 msgr2=0x7fa43c070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:29:49.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.093+0000 7fa4417f3700 1 --2- 172.21.15.5:0/3897047229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa43c0fe050 0x7fa43c070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:29:49.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.093+0000 7fa4417f3700 1 -- 172.21.15.5:0/3897047229 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c005040 con 0x7fa43c0fce50 2024-04-16T14:29:49.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.093+0000 7fa4417f3700 1 --2- 172.21.15.5:0/3897047229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa43c0fce50 0x7fa43c071c60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa438002a80 tx=0x7fa438004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:29:49.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.093+0000 7fa431ffb700 1 -- 172.21.15.5:0/3897047229 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa438007cc0 con 0x7fa43c0fce50 2024-04-16T14:29:49.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.094+0000 7fa443a57700 1 -- 172.21.15.5:0/3897047229 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa43c070b00 con 0x7fa43c0fce50 2024-04-16T14:29:49.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.094+0000 7fa431ffb700 1 -- 172.21.15.5:0/3897047229 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa43800f040 con 0x7fa43c0fce50 2024-04-16T14:29:49.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.094+0000 7fa431ffb700 1 -- 172.21.15.5:0/3897047229 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa43800dad0 con 0x7fa43c0fce50 2024-04-16T14:29:49.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.094+0000 7fa443a57700 1 -- 172.21.15.5:0/3897047229 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa43c0710c0 con 0x7fa43c0fce50 2024-04-16T14:29:49.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.095+0000 7fa443a57700 1 -- 172.21.15.5:0/3897047229 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa43c04c710 con 0x7fa43c0fce50 2024-04-16T14:29:49.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.095+0000 7fa431ffb700 1 -- 172.21.15.5:0/3897047229 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) v1 ==== 86571+0+0 (secure 0 0 0) 0x7fa43800dc30 con 0x7fa43c0fce50 2024-04-16T14:29:49.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.095+0000 7fa431ffb700 1 --2- 172.21.15.5:0/3897047229 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa428069210 0x7fa42806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:29:49.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.096+0000 7fa431ffb700 1 -- 172.21.15.5:0/3897047229 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7fa4380862e0 con 0x7fa43c0fce50 2024-04-16T14:29:49.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.096+0000 7fa440ff2700 1 --2- 172.21.15.5:0/3897047229 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa428069210 0x7fa42806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:29:49.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.096+0000 7fa440ff2700 1 --2- 172.21.15.5:0/3897047229 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa428069210 0x7fa42806b6c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa42c00b3b0 tx=0x7fa42c009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:29:49.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.100+0000 7fa431ffb700 1 -- 172.21.15.5:0/3897047229 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa438056c50 con 0x7fa43c0fce50 2024-04-16T14:29:49.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:48 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:29:49.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:48 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:49.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:48 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:49.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:48 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:29:49.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:48 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:29:49.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:48 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:49.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:48 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:29:49.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:48 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:29:49.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:48 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:49.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:48 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:29:49.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:29:49.315+0000 7fa443a57700 1 -- 172.21.15.5:0/3897047229 --> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa43c1023e0 con 0x7fa428069210 2024-04-16T14:29:49.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:49 smithi005 ceph-mon[28964]: Detected new or changed devices on smithi005 2024-04-16T14:29:49.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:49 smithi005 ceph-mon[28964]: Adjusting osd_memory_target on smithi005 to 6434M 2024-04-16T14:29:49.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:49 smithi005 ceph-mon[28964]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:29:49.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:49 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-16T14:29:49.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:49 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-16T14:29:49.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:49 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:29:50.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:49 smithi115 ceph-mon[37295]: Detected new or changed devices on smithi005 2024-04-16T14:29:50.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:49 smithi115 ceph-mon[37295]: Adjusting osd_memory_target on smithi005 to 6434M 2024-04-16T14:29:50.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:49 smithi115 ceph-mon[37295]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:29:50.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:49 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-16T14:29:50.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:49 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-16T14:29:50.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:49 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:29:50.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:50 smithi005 ceph-mon[28964]: from='client.14282 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:29:51.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:50 smithi115 ceph-mon[37295]: from='client.14282 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:29:51.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:51 smithi005 ceph-mon[28964]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:29:52.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:51 smithi115 ceph-mon[37295]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:29:53.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:53 smithi005 ceph-mon[28964]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:29:53.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:53 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/1130540715' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1851758c-0015-4f54-b4b8-30c1424394ee"}]: dispatch 2024-04-16T14:29:53.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:53 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/1130540715' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1851758c-0015-4f54-b4b8-30c1424394ee"}]': finished 2024-04-16T14:29:53.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:53 smithi005 ceph-mon[28964]: osdmap e16: 3 total, 2 up, 3 in 2024-04-16T14:29:53.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:53 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-16T14:29:53.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:53 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/1816132997' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-16T14:29:54.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:53 smithi115 ceph-mon[37295]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:29:54.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:53 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/1130540715' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1851758c-0015-4f54-b4b8-30c1424394ee"}]: dispatch 2024-04-16T14:29:54.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:53 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/1130540715' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1851758c-0015-4f54-b4b8-30c1424394ee"}]': finished 2024-04-16T14:29:54.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:53 smithi115 ceph-mon[37295]: osdmap e16: 3 total, 2 up, 3 in 2024-04-16T14:29:54.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:53 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-16T14:29:54.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:53 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/1816132997' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-16T14:29:55.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:55 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:55.801 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:55 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:55.801 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:55 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:29:55.801 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:55 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:29:55.801 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:55 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:55.801 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:55 smithi005 ceph-mon[28964]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:29:55.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:55 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:55.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:55 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:55.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:55 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:29:55.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:55 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:29:55.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:55 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:29:55.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:55 smithi115 ceph-mon[37295]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:29:57.957 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:57 smithi005 ceph-mon[28964]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:29:58.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:57 smithi115 ceph-mon[37295]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:30:00.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:29:59 smithi115 ceph-mon[37295]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:30:00.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:29:59 smithi005 ceph-mon[28964]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:30:00.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:00 smithi005 ceph-mon[28964]: overall HEALTH_OK 2024-04-16T14:30:00.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:00 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-16T14:30:00.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:00 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:30:00.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:00 smithi005 ceph-mon[28964]: Deploying daemon osd.2 on smithi005 2024-04-16T14:30:01.084 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:00 smithi115 ceph-mon[37295]: overall HEALTH_OK 2024-04-16T14:30:01.084 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:00 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-16T14:30:01.084 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:00 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:30:01.084 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:00 smithi115 ceph-mon[37295]: Deploying daemon osd.2 on smithi005 2024-04-16T14:30:01.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:01 smithi005 ceph-mon[28964]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:30:02.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:01 smithi115 ceph-mon[37295]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:30:02.917 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:02 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:30:03.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:02 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:30:03.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:03 smithi005 ceph-mon[28964]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:30:04.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:03 smithi115 ceph-mon[37295]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:30:05.912 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:05 smithi005 ceph-mon[28964]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:30:05.912 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:05 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:05.912 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:05 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:30:05.913 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:05 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:06.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:05 smithi115 ceph-mon[37295]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:30:06.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:05 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:06.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:05 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:30:06.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:05 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:07.924 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:07 smithi005 ceph-mon[28964]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:30:08.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:07 smithi115 ceph-mon[37295]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:30:08.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:30:08.586+0000 7fa431ffb700 1 -- 172.21.15.5:0/3897047229 <== mgr.14212 v2:172.21.15.5:6800/3841652776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa43c1023e0 con 0x7fa428069210 2024-04-16T14:30:08.585 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 2 on host 'smithi005' 2024-04-16T14:30:08.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:30:08.589+0000 7fa443a57700 1 -- 172.21.15.5:0/3897047229 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa428069210 msgr2=0x7fa42806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:30:08.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:30:08.589+0000 7fa443a57700 1 --2- 172.21.15.5:0/3897047229 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa428069210 0x7fa42806b6c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa42c00b3b0 tx=0x7fa42c009e30 comp rx=0 tx=0).stop 2024-04-16T14:30:08.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:30:08.589+0000 7fa443a57700 1 -- 172.21.15.5:0/3897047229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa43c0fce50 msgr2=0x7fa43c071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:30:08.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:30:08.589+0000 7fa443a57700 1 --2- 172.21.15.5:0/3897047229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa43c0fce50 0x7fa43c071c60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa438002a80 tx=0x7fa438004600 comp rx=0 tx=0).stop 2024-04-16T14:30:08.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:30:08.589+0000 7fa443a57700 1 -- 172.21.15.5:0/3897047229 shutdown_connections 2024-04-16T14:30:08.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:30:08.589+0000 7fa443a57700 1 --2- 172.21.15.5:0/3897047229 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa428069210 0x7fa42806b6c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:30:08.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:30:08.589+0000 7fa443a57700 1 --2- 172.21.15.5:0/3897047229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa43c0fce50 0x7fa43c071c60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:30:08.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:30:08.589+0000 7fa443a57700 1 --2- 172.21.15.5:0/3897047229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa43c0fe050 0x7fa43c070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:30:08.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:30:08.589+0000 7fa443a57700 1 -- 172.21.15.5:0/3897047229 >> 172.21.15.5:0/3897047229 conn(0x7fa43c0f8580 msgr2=0x7fa43c0f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:30:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:30:08.589+0000 7fa443a57700 1 -- 172.21.15.5:0/3897047229 shutdown_connections 2024-04-16T14:30:08.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:30:08.589+0000 7fa443a57700 1 -- 172.21.15.5:0/3897047229 wait complete. 2024-04-16T14:30:09.220 DEBUG:teuthology.orchestra.run.smithi005:osd.2> sudo journalctl -f -n 0 -u ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.2.service 2024-04-16T14:30:09.222 INFO:tasks.cephadm:Deploying osd.3 on smithi115 with /dev/vg_nvme/lv_4... 2024-04-16T14:30:09.223 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-16T14:30:09.485 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi115/config 2024-04-16T14:30:09.862 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:09 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:09.863 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:09 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:09.863 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:09 smithi115 ceph-mon[37295]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:30:09.863 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:09 smithi115 ceph-mon[37295]: from='osd.2 [v2:172.21.15.5:6818/2907807829,v1:172.21.15.5:6819/2907807829]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-16T14:30:09.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:09 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:09.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:09 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:09.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:09 smithi005 ceph-mon[28964]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:30:09.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:09 smithi005 ceph-mon[28964]: from='osd.2 [v2:172.21.15.5:6818/2907807829,v1:172.21.15.5:6819/2907807829]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-16T14:30:10.783 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:10 smithi115 ceph-mon[37295]: from='osd.2 [v2:172.21.15.5:6818/2907807829,v1:172.21.15.5:6819/2907807829]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-16T14:30:10.783 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:10 smithi115 ceph-mon[37295]: osdmap e17: 3 total, 2 up, 3 in 2024-04-16T14:30:10.783 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:10 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-16T14:30:10.783 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:10 smithi115 ceph-mon[37295]: from='osd.2 [v2:172.21.15.5:6818/2907807829,v1:172.21.15.5:6819/2907807829]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-04-16T14:30:10.963 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:10 smithi005 ceph-mon[28964]: from='osd.2 [v2:172.21.15.5:6818/2907807829,v1:172.21.15.5:6819/2907807829]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-16T14:30:10.963 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:10 smithi005 ceph-mon[28964]: osdmap e17: 3 total, 2 up, 3 in 2024-04-16T14:30:10.963 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:10 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-16T14:30:10.963 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:10 smithi005 ceph-mon[28964]: from='osd.2 [v2:172.21.15.5:6818/2907807829,v1:172.21.15.5:6819/2907807829]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-04-16T14:30:10.963 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:30:10 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2[62661]: 2024-04-16T14:30:10.587+0000 7f48e3be8700 -1 osd.2 0 waiting for initial osdmap 2024-04-16T14:30:10.964 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:30:10 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2[62661]: 2024-04-16T14:30:10.593+0000 7f48e09e7700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T14:30:11.347 INFO:teuthology.orchestra.run.smithi115.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-16T14:30:11.347 INFO:teuthology.orchestra.run.smithi115.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-16T14:30:11.347 INFO:teuthology.orchestra.run.smithi115.stderr: stderr: 10+0 records in 2024-04-16T14:30:11.347 INFO:teuthology.orchestra.run.smithi115.stderr:10+0 records out 2024-04-16T14:30:11.347 INFO:teuthology.orchestra.run.smithi115.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.011456 s, 915 MB/s 2024-04-16T14:30:11.347 INFO:teuthology.orchestra.run.smithi115.stderr: stderr: 2024-04-16T14:30:11.347 INFO:teuthology.orchestra.run.smithi115.stderr:--> Zapping successful for: 2024-04-16T14:30:11.900 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:11 smithi005 ceph-mon[28964]: from='osd.2 [v2:172.21.15.5:6818/2907807829,v1:172.21.15.5:6819/2907807829]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-04-16T14:30:11.900 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:11 smithi005 ceph-mon[28964]: osdmap e18: 3 total, 2 up, 3 in 2024-04-16T14:30:11.900 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:11 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-16T14:30:11.900 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:11 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-16T14:30:11.901 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:11 smithi005 ceph-mon[28964]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:30:11.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:11 smithi115 ceph-mon[37295]: from='osd.2 [v2:172.21.15.5:6818/2907807829,v1:172.21.15.5:6819/2907807829]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-04-16T14:30:11.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:11 smithi115 ceph-mon[37295]: osdmap e18: 3 total, 2 up, 3 in 2024-04-16T14:30:11.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:11 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-16T14:30:11.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:11 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-16T14:30:11.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:11 smithi115 ceph-mon[37295]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-16T14:30:11.970 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph orch daemon add osd smithi115:vg_nvme/lv_4 2024-04-16T14:30:12.221 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi115/config 2024-04-16T14:30:12.674 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:12 smithi115 ceph-mon[37295]: purged_snaps scrub starts 2024-04-16T14:30:12.674 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:12 smithi115 ceph-mon[37295]: purged_snaps scrub ok 2024-04-16T14:30:12.674 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:12 smithi115 ceph-mon[37295]: osd.2 [v2:172.21.15.5:6818/2907807829,v1:172.21.15.5:6819/2907807829] boot 2024-04-16T14:30:12.674 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:12 smithi115 ceph-mon[37295]: osdmap e19: 3 total, 3 up, 3 in 2024-04-16T14:30:12.674 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:12 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-16T14:30:12.674 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:12 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:12.674 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:12 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:12.921 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:12 smithi005 ceph-mon[28964]: purged_snaps scrub starts 2024-04-16T14:30:12.921 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:12 smithi005 ceph-mon[28964]: purged_snaps scrub ok 2024-04-16T14:30:12.921 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:12 smithi005 ceph-mon[28964]: osd.2 [v2:172.21.15.5:6818/2907807829,v1:172.21.15.5:6819/2907807829] boot 2024-04-16T14:30:12.921 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:12 smithi005 ceph-mon[28964]: osdmap e19: 3 total, 3 up, 3 in 2024-04-16T14:30:12.921 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:12 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-16T14:30:12.921 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:12 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:12.921 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:12 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:13.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:13 smithi115 ceph-mon[37295]: osdmap e20: 3 total, 3 up, 3 in 2024-04-16T14:30:13.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:13 smithi115 ceph-mon[37295]: pgmap v73: 0 pgs: ; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-16T14:30:13.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:13 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-04-16T14:30:13.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.734+0000 7f6cd8e22700 1 -- 172.21.15.115:0/329846215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6cd40fcff0 msgr2=0x7f6cd40fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:30:13.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.734+0000 7f6cd8e22700 1 --2- 172.21.15.115:0/329846215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6cd40fcff0 0x7f6cd40fd460 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc004940 tx=0x7f6cbc009e30 comp rx=0 tx=0).stop 2024-04-16T14:30:13.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.734+0000 7f6cd8e22700 1 -- 172.21.15.115:0/329846215 shutdown_connections 2024-04-16T14:30:13.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.734+0000 7f6cd8e22700 1 --2- 172.21.15.115:0/329846215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6cd40fcff0 0x7f6cd40fd460 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:30:13.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.734+0000 7f6cd8e22700 1 --2- 172.21.15.115:0/329846215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cd40fbd40 0x7f6cd40fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:30:13.733 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.734+0000 7f6cd8e22700 1 -- 172.21.15.115:0/329846215 >> 172.21.15.115:0/329846215 conn(0x7f6cd40f74c0 msgr2=0x7f6cd40f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:30:13.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.734+0000 7f6cd8e22700 1 -- 172.21.15.115:0/329846215 shutdown_connections 2024-04-16T14:30:13.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.734+0000 7f6cd8e22700 1 -- 172.21.15.115:0/329846215 wait complete. 2024-04-16T14:30:13.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.735+0000 7f6cd8e22700 1 Processor -- start 2024-04-16T14:30:13.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.735+0000 7f6cd8e22700 1 -- start start 2024-04-16T14:30:13.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.735+0000 7f6cd8e22700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6cd40fbd40 0x7f6cd410daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:30:13.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.735+0000 7f6cd8e22700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cd40fcff0 0x7f6cd410e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:30:13.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.735+0000 7f6cd8e22700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd410e630 con 0x7f6cd40fcff0 2024-04-16T14:30:13.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.735+0000 7f6cd8e22700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd410ede0 con 0x7f6cd40fbd40 2024-04-16T14:30:13.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.735+0000 7f6cd259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6cd40fbd40 0x7f6cd410daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:30:13.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.735+0000 7f6cd259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6cd40fbd40 0x7f6cd410daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:58866/0 (socket says 172.21.15.115:58866) 2024-04-16T14:30:13.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.735+0000 7f6cd259c700 1 -- 172.21.15.115:0/3874665843 learned_addr learned my addr 172.21.15.115:0/3874665843 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-04-16T14:30:13.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.735+0000 7f6cd1d9b700 1 --2- 172.21.15.115:0/3874665843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cd40fcff0 0x7f6cd410e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:30:13.734 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.735+0000 7f6cd259c700 1 -- 172.21.15.115:0/3874665843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cd40fcff0 msgr2=0x7f6cd410e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:30:13.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.735+0000 7f6cd259c700 1 --2- 172.21.15.115:0/3874665843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cd40fcff0 0x7f6cd410e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:30:13.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.735+0000 7f6cd259c700 1 -- 172.21.15.115:0/3874665843 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cbc005040 con 0x7f6cd40fbd40 2024-04-16T14:30:13.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.735+0000 7f6cd259c700 1 --2- 172.21.15.115:0/3874665843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6cd40fbd40 0x7f6cd410daf0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc001d00 tx=0x7f6ccc009f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:30:13.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.735+0000 7f6ccaffd700 1 -- 172.21.15.115:0/3874665843 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ccc001e60 con 0x7f6cd40fbd40 2024-04-16T14:30:13.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.735+0000 7f6cd8e22700 1 -- 172.21.15.115:0/3874665843 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd410f0c0 con 0x7f6cd40fbd40 2024-04-16T14:30:13.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.735+0000 7f6ccaffd700 1 -- 172.21.15.115:0/3874665843 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6ccc00f040 con 0x7f6cd40fbd40 2024-04-16T14:30:13.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.735+0000 7f6ccaffd700 1 -- 172.21.15.115:0/3874665843 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ccc009310 con 0x7f6cd40fbd40 2024-04-16T14:30:13.735 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.736+0000 7f6cd8e22700 1 -- 172.21.15.115:0/3874665843 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd410f600 con 0x7f6cd40fbd40 2024-04-16T14:30:13.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.736+0000 7f6cd8e22700 1 -- 172.21.15.115:0/3874665843 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd4101b80 con 0x7f6cd40fbd40 2024-04-16T14:30:13.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.737+0000 7f6ccaffd700 1 -- 172.21.15.115:0/3874665843 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) v1 ==== 86571+0+0 (secure 0 0 0) 0x7f6ccc009470 con 0x7f6cd40fbd40 2024-04-16T14:30:13.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.737+0000 7f6ccaffd700 1 --2- 172.21.15.115:0/3874665843 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6cc0069210 0x7f6cc006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:30:13.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.737+0000 7f6ccaffd700 1 -- 172.21.15.115:0/3874665843 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3217+0+0 (secure 0 0 0) 0x7f6ccc086110 con 0x7f6cd40fbd40 2024-04-16T14:30:13.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.738+0000 7f6cd1d9b700 1 --2- 172.21.15.115:0/3874665843 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6cc0069210 0x7f6cc006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:30:13.736 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.738+0000 7f6cd1d9b700 1 --2- 172.21.15.115:0/3874665843 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6cc0069210 0x7f6cc006b6c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc009fd0 tx=0x7f6cbc009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:30:13.739 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.742+0000 7f6ccaffd700 1 -- 172.21.15.115:0/3874665843 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6ccc04d250 con 0x7f6cd40fbd40 2024-04-16T14:30:13.932 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:13.934+0000 7f6cd8e22700 1 -- 172.21.15.115:0/3874665843 --> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f6cd410f820 con 0x7f6cc0069210 2024-04-16T14:30:13.938 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:13 smithi005 ceph-mon[28964]: osdmap e20: 3 total, 3 up, 3 in 2024-04-16T14:30:13.938 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:13 smithi005 ceph-mon[28964]: pgmap v73: 0 pgs: ; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-16T14:30:13.938 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:13 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-04-16T14:30:14.912 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:14 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-04-16T14:30:14.912 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:14 smithi115 ceph-mon[37295]: osdmap e21: 3 total, 3 up, 3 in 2024-04-16T14:30:14.912 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:14 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-16T14:30:14.912 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:14 smithi115 ceph-mon[37295]: from='client.24133 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:30:14.912 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:14 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-16T14:30:14.912 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:14 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-16T14:30:14.912 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:14 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:30:14.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:14 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-04-16T14:30:14.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:14 smithi005 ceph-mon[28964]: osdmap e21: 3 total, 3 up, 3 in 2024-04-16T14:30:14.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:14 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-16T14:30:14.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:14 smithi005 ceph-mon[28964]: from='client.24133 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:30:14.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:14 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-16T14:30:14.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:14 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-16T14:30:14.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:14 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:30:15.724 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:30:15 smithi005 sudo[67095]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-16T14:30:15.724 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:30:15 smithi005 sudo[67095]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-16T14:30:15.724 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:30:15 smithi005 sudo[67095]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-16T14:30:15.724 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:30:15 smithi005 sudo[67095]: pam_unix(sudo:session): session closed for user root 2024-04-16T14:30:15.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:15 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-16T14:30:15.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:15 smithi005 ceph-mon[28964]: osdmap e22: 3 total, 3 up, 3 in 2024-04-16T14:30:15.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:15 smithi005 ceph-mon[28964]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-16T14:30:15.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:15 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:15.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:15 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:15.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:15 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:30:15.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:15 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:30:15.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:15 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:30:15.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:15 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:15.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:15 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:30:15.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:15 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:30:15.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:15 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:15.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:15 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:30:15.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:15 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-16T14:30:15.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:15 smithi115 ceph-mon[37295]: osdmap e22: 3 total, 3 up, 3 in 2024-04-16T14:30:15.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:15 smithi115 ceph-mon[37295]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-16T14:30:15.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:15 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:15.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:15 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:15.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:15 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:30:15.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:15 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:30:15.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:15 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:30:15.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:15 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:15.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:15 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:30:15.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:15 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:30:15.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:15 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:15.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:15 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:30:16.094 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:30:15 smithi005 sudo[67164]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-16T14:30:16.095 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:30:15 smithi005 sudo[67164]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-16T14:30:16.095 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:30:15 smithi005 sudo[67164]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-16T14:30:16.095 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:30:15 smithi005 sudo[67164]: pam_unix(sudo:session): session closed for user root 2024-04-16T14:30:16.365 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:30:16 smithi005 sudo[67252]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-16T14:30:16.365 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:30:16 smithi005 sudo[67252]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-16T14:30:16.365 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:30:16 smithi005 sudo[67252]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-16T14:30:16.365 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:30:16 smithi005 sudo[67252]: pam_unix(sudo:session): session closed for user root 2024-04-16T14:30:16.627 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:30:16 smithi005 sudo[67274]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-16T14:30:16.627 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:30:16 smithi005 sudo[67274]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-16T14:30:16.627 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:30:16 smithi005 sudo[67274]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-16T14:30:16.627 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:30:16 smithi005 sudo[67274]: pam_unix(sudo:session): session closed for user root 2024-04-16T14:30:16.627 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:16 smithi005 ceph-mon[28964]: Detected new or changed devices on smithi005 2024-04-16T14:30:16.628 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:16 smithi005 ceph-mon[28964]: Adjusting osd_memory_target on smithi005 to 4289M 2024-04-16T14:30:16.628 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:16 smithi005 ceph-mon[28964]: osdmap e23: 3 total, 3 up, 3 in 2024-04-16T14:30:16.628 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:16 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:16.628 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:16 smithi005 ceph-mon[28964]: from='client.? 172.21.15.115:0/160462618' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ab6404e2-5cef-4a8a-8b93-a24914c67fc2"}]: dispatch 2024-04-16T14:30:16.628 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:16 smithi005 ceph-mon[28964]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ab6404e2-5cef-4a8a-8b93-a24914c67fc2"}]: dispatch 2024-04-16T14:30:16.628 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:16 smithi005 ceph-mon[28964]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ab6404e2-5cef-4a8a-8b93-a24914c67fc2"}]': finished 2024-04-16T14:30:16.628 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:16 smithi005 ceph-mon[28964]: osdmap e24: 4 total, 3 up, 4 in 2024-04-16T14:30:16.628 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:16 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-16T14:30:16.913 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:30:16 smithi005 sudo[67277]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-16T14:30:16.913 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:30:16 smithi005 sudo[67277]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-16T14:30:16.913 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:30:16 smithi005 sudo[67277]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-16T14:30:16.913 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:30:16 smithi005 sudo[67277]: pam_unix(sudo:session): session closed for user root 2024-04-16T14:30:16.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:16 smithi115 ceph-mon[37295]: Detected new or changed devices on smithi005 2024-04-16T14:30:16.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:16 smithi115 ceph-mon[37295]: Adjusting osd_memory_target on smithi005 to 4289M 2024-04-16T14:30:16.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:16 smithi115 ceph-mon[37295]: osdmap e23: 3 total, 3 up, 3 in 2024-04-16T14:30:16.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:16 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:16.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:16 smithi115 ceph-mon[37295]: from='client.? 172.21.15.115:0/160462618' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ab6404e2-5cef-4a8a-8b93-a24914c67fc2"}]: dispatch 2024-04-16T14:30:16.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:16 smithi115 ceph-mon[37295]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ab6404e2-5cef-4a8a-8b93-a24914c67fc2"}]: dispatch 2024-04-16T14:30:16.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:16 smithi115 ceph-mon[37295]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ab6404e2-5cef-4a8a-8b93-a24914c67fc2"}]': finished 2024-04-16T14:30:16.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:16 smithi115 ceph-mon[37295]: osdmap e24: 4 total, 3 up, 4 in 2024-04-16T14:30:16.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:16 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-16T14:30:17.172 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:30:16 smithi005 sudo[67362]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-16T14:30:17.173 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:30:16 smithi005 sudo[67362]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-16T14:30:17.173 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:30:16 smithi005 sudo[67362]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-16T14:30:17.173 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:30:16 smithi005 sudo[67362]: pam_unix(sudo:session): session closed for user root 2024-04-16T14:30:17.443 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:17 smithi005 sudo[67384]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-16T14:30:17.443 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:17 smithi005 sudo[67384]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-16T14:30:17.443 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:17 smithi005 sudo[67384]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-16T14:30:17.443 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:17 smithi005 sudo[67384]: pam_unix(sudo:session): session closed for user root 2024-04-16T14:30:17.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:17 smithi005 sudo[67390]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-16T14:30:17.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:17 smithi005 sudo[67390]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-16T14:30:17.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:17 smithi005 sudo[67390]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-16T14:30:17.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:17 smithi005 sudo[67390]: pam_unix(sudo:session): session closed for user root 2024-04-16T14:30:17.951 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:17 smithi115 sudo[40853]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-16T14:30:17.951 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:17 smithi115 sudo[40853]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-16T14:30:17.951 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:17 smithi115 sudo[40853]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-16T14:30:17.951 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:17 smithi115 sudo[40853]: pam_unix(sudo:session): session closed for user root 2024-04-16T14:30:17.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:17.966+0000 7f6ccaffd700 1 -- 172.21.15.115:0/3874665843 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f6ccc053130 con 0x7f6cd40fbd40 2024-04-16T14:30:18.063 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:17 smithi005 ceph-mon[28964]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-16T14:30:18.063 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:17 smithi005 ceph-mon[28964]: from='client.? 172.21.15.115:0/132275613' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-16T14:30:18.064 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:17 smithi005 ceph-mon[28964]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-16T14:30:18.064 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:17 smithi005 ceph-mon[28964]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-16T14:30:18.064 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:17 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-04-16T14:30:18.064 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:17 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:30:18.064 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:17 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-04-16T14:30:18.064 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:17 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:30:18.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:17 smithi115 sudo[41041]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-16T14:30:18.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:17 smithi115 sudo[41041]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-16T14:30:18.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:17 smithi115 sudo[41041]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-16T14:30:18.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:17 smithi115 sudo[41041]: pam_unix(sudo:session): session closed for user root 2024-04-16T14:30:18.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:17 smithi115 ceph-mon[37295]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-16T14:30:18.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:17 smithi115 ceph-mon[37295]: from='client.? 172.21.15.115:0/132275613' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-16T14:30:18.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:17 smithi115 ceph-mon[37295]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-16T14:30:18.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:17 smithi115 ceph-mon[37295]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-16T14:30:18.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:17 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-04-16T14:30:18.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:17 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:30:18.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:17 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-04-16T14:30:18.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:17 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:30:19.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:18 smithi005 ceph-mon[28964]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-16T14:30:19.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:18 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:30:19.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:18 smithi005 ceph-mon[28964]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-16T14:30:19.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:18 smithi005 ceph-mon[28964]: mgrmap e19: smithi005.ipwdkc(active, since 2m), standbys: smithi115.brjkpo 2024-04-16T14:30:19.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:18 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:19.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:18 smithi115 ceph-mon[37295]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-16T14:30:19.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:18 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:30:19.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:18 smithi115 ceph-mon[37295]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-16T14:30:19.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:18 smithi115 ceph-mon[37295]: mgrmap e19: smithi005.ipwdkc(active, since 2m), standbys: smithi115.brjkpo 2024-04-16T14:30:19.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:18 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:20.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:19 smithi115 ceph-mon[37295]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-16T14:30:20.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:19 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:20.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:19 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:20.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:19 smithi005 ceph-mon[28964]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-16T14:30:20.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:19 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:20.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:19 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:21.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:20 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:30:21.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:20 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:30:21.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:20 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:21.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:20 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:30:21.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:20 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:30:21.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:20 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:22.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:21 smithi115 ceph-mon[37295]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-16T14:30:22.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:21 smithi005 ceph-mon[28964]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-16T14:30:24.102 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:23 smithi115 ceph-mon[37295]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-16T14:30:24.103 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:23 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-16T14:30:24.103 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:23 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:30:24.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:23 smithi005 ceph-mon[28964]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-16T14:30:24.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:23 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-16T14:30:24.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:23 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:30:25.267 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:24 smithi115 ceph-mon[37295]: Deploying daemon osd.3 on smithi115 2024-04-16T14:30:25.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:24 smithi005 ceph-mon[28964]: Deploying daemon osd.3 on smithi115 2024-04-16T14:30:26.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:25 smithi115 ceph-mon[37295]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-16T14:30:26.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:25 smithi005 ceph-mon[28964]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-16T14:30:28.140 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:27 smithi115 ceph-mon[37295]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-16T14:30:28.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:27 smithi005 ceph-mon[28964]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-16T14:30:29.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:29 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:29.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:29 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:29.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:29 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:30:29.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:29 smithi115 ceph-mon[37295]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-16T14:30:29.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:29 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:29.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:29 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:29.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:29 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:30:29.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:29 smithi005 ceph-mon[28964]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-16T14:30:31.885 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:31 smithi115 ceph-mon[37295]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-16T14:30:32.200 INFO:teuthology.orchestra.run.smithi115.stdout:Created osd(s) 3 on host 'smithi115' 2024-04-16T14:30:32.200 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:32.200+0000 7f6ccaffd700 1 -- 172.21.15.115:0/3874665843 <== mgr.14212 v2:172.21.15.5:6800/3841652776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6cd410f820 con 0x7f6cc0069210 2024-04-16T14:30:32.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:32.203+0000 7f6cd8e22700 1 -- 172.21.15.115:0/3874665843 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6cc0069210 msgr2=0x7f6cc006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:30:32.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:32.203+0000 7f6cd8e22700 1 --2- 172.21.15.115:0/3874665843 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6cc0069210 0x7f6cc006b6c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc009fd0 tx=0x7f6cbc009e30 comp rx=0 tx=0).stop 2024-04-16T14:30:32.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:32.203+0000 7f6cd8e22700 1 -- 172.21.15.115:0/3874665843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6cd40fbd40 msgr2=0x7f6cd410daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:30:32.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:32.203+0000 7f6cd8e22700 1 --2- 172.21.15.115:0/3874665843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6cd40fbd40 0x7f6cd410daf0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc001d00 tx=0x7f6ccc009f30 comp rx=0 tx=0).stop 2024-04-16T14:30:32.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:32.203+0000 7f6cd8e22700 1 -- 172.21.15.115:0/3874665843 shutdown_connections 2024-04-16T14:30:32.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:32.203+0000 7f6cd8e22700 1 --2- 172.21.15.115:0/3874665843 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6cc0069210 0x7f6cc006b6c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:30:32.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:32.203+0000 7f6cd8e22700 1 --2- 172.21.15.115:0/3874665843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6cd40fbd40 0x7f6cd410daf0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:30:32.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:32.203+0000 7f6cd8e22700 1 --2- 172.21.15.115:0/3874665843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cd40fcff0 0x7f6cd410e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:30:32.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:32.203+0000 7f6cd8e22700 1 -- 172.21.15.115:0/3874665843 >> 172.21.15.115:0/3874665843 conn(0x7f6cd40f74c0 msgr2=0x7f6cd4065ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:30:32.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:32.203+0000 7f6cd8e22700 1 -- 172.21.15.115:0/3874665843 shutdown_connections 2024-04-16T14:30:32.202 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:32.203+0000 7f6cd8e22700 1 -- 172.21.15.115:0/3874665843 wait complete. 2024-04-16T14:30:32.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:31 smithi005 ceph-mon[28964]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-16T14:30:32.796 DEBUG:teuthology.orchestra.run.smithi115:osd.3> sudo journalctl -f -n 0 -u ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.3.service 2024-04-16T14:30:32.799 INFO:tasks.cephadm:Deploying osd.4 on smithi115 with /dev/vg_nvme/lv_3... 2024-04-16T14:30:32.799 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-16T14:30:33.100 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi115/config 2024-04-16T14:30:33.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:33 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:33.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:33 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:33.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:33 smithi115 ceph-mon[37295]: from='osd.3 [v2:172.21.15.115:6800/2081173791,v1:172.21.15.115:6801/2081173791]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-16T14:30:33.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:33 smithi115 ceph-mon[37295]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-16T14:30:33.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:33 smithi115 ceph-mon[37295]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-16T14:30:33.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:33 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:30:33.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:33 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:33.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:33 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:33.472 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:33 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:33.473 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:33 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:33.473 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:33 smithi005 ceph-mon[28964]: from='osd.3 [v2:172.21.15.115:6800/2081173791,v1:172.21.15.115:6801/2081173791]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-16T14:30:33.473 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:33 smithi005 ceph-mon[28964]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-16T14:30:33.473 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:33 smithi005 ceph-mon[28964]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-16T14:30:33.473 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:33 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:30:33.473 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:33 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:33.473 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:33 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:34.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:34 smithi115 ceph-mon[37295]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-16T14:30:34.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:34 smithi115 ceph-mon[37295]: osdmap e25: 4 total, 3 up, 4 in 2024-04-16T14:30:34.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:34 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-16T14:30:34.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:34 smithi115 ceph-mon[37295]: from='osd.3 [v2:172.21.15.115:6800/2081173791,v1:172.21.15.115:6801/2081173791]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-04-16T14:30:34.425 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:34 smithi115 ceph-mon[37295]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-04-16T14:30:34.425 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:30:34 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3[42864]: 2024-04-16T14:30:34.190+0000 7fb2bfecd700 -1 osd.3 0 waiting for initial osdmap 2024-04-16T14:30:34.426 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:30:34 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3[42864]: 2024-04-16T14:30:34.196+0000 7fb2b8cc4700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T14:30:34.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:34 smithi005 ceph-mon[28964]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-16T14:30:34.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:34 smithi005 ceph-mon[28964]: osdmap e25: 4 total, 3 up, 4 in 2024-04-16T14:30:34.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:34 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-16T14:30:34.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:34 smithi005 ceph-mon[28964]: from='osd.3 [v2:172.21.15.115:6800/2081173791,v1:172.21.15.115:6801/2081173791]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-04-16T14:30:34.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:34 smithi005 ceph-mon[28964]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-04-16T14:30:34.997 INFO:teuthology.orchestra.run.smithi115.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-16T14:30:34.998 INFO:teuthology.orchestra.run.smithi115.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-16T14:30:34.998 INFO:teuthology.orchestra.run.smithi115.stderr: stderr: 10+0 records in 2024-04-16T14:30:34.998 INFO:teuthology.orchestra.run.smithi115.stderr:10+0 records out 2024-04-16T14:30:34.998 INFO:teuthology.orchestra.run.smithi115.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0142641 s, 735 MB/s 2024-04-16T14:30:34.998 INFO:teuthology.orchestra.run.smithi115.stderr:--> Zapping successful for: 2024-04-16T14:30:35.352 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:35 smithi115 ceph-mon[37295]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-04-16T14:30:35.353 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:35 smithi115 ceph-mon[37295]: osdmap e26: 4 total, 3 up, 4 in 2024-04-16T14:30:35.353 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:35 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-16T14:30:35.353 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:35 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-16T14:30:35.353 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:35 smithi115 ceph-mon[37295]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-16T14:30:35.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:35 smithi005 ceph-mon[28964]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-04-16T14:30:35.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:35 smithi005 ceph-mon[28964]: osdmap e26: 4 total, 3 up, 4 in 2024-04-16T14:30:35.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:35 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-16T14:30:35.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:35 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-16T14:30:35.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:35 smithi005 ceph-mon[28964]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-16T14:30:36.316 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:36 smithi115 ceph-mon[37295]: purged_snaps scrub starts 2024-04-16T14:30:36.316 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:36 smithi115 ceph-mon[37295]: purged_snaps scrub ok 2024-04-16T14:30:36.316 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:36 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-16T14:30:36.317 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:36 smithi115 ceph-mon[37295]: osd.3 [v2:172.21.15.115:6800/2081173791,v1:172.21.15.115:6801/2081173791] boot 2024-04-16T14:30:36.317 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:36 smithi115 ceph-mon[37295]: osdmap e27: 4 total, 4 up, 4 in 2024-04-16T14:30:36.317 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:36 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-16T14:30:36.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:36 smithi005 ceph-mon[28964]: purged_snaps scrub starts 2024-04-16T14:30:36.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:36 smithi005 ceph-mon[28964]: purged_snaps scrub ok 2024-04-16T14:30:36.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:36 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-16T14:30:36.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:36 smithi005 ceph-mon[28964]: osd.3 [v2:172.21.15.115:6800/2081173791,v1:172.21.15.115:6801/2081173791] boot 2024-04-16T14:30:36.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:36 smithi005 ceph-mon[28964]: osdmap e27: 4 total, 4 up, 4 in 2024-04-16T14:30:36.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:36 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-16T14:30:37.017 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph orch daemon add osd smithi115:vg_nvme/lv_3 2024-04-16T14:30:37.246 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:37 smithi115 ceph-mon[37295]: osdmap e28: 4 total, 4 up, 4 in 2024-04-16T14:30:37.246 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:37 smithi115 ceph-mon[37295]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-16T14:30:37.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:37 smithi005 ceph-mon[28964]: osdmap e28: 4 total, 4 up, 4 in 2024-04-16T14:30:37.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:37 smithi005 ceph-mon[28964]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-16T14:30:37.811 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi115/config 2024-04-16T14:30:38.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:38 smithi005 ceph-mon[28964]: osdmap e29: 4 total, 4 up, 4 in 2024-04-16T14:30:38.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:38 smithi005 ceph-mon[28964]: Detected new or changed devices on smithi115 2024-04-16T14:30:38.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:38 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:38.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:38 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:38.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:38 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:30:38.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:38 smithi005 ceph-mon[28964]: Adjusting osd_memory_target on smithi115 to 15936M 2024-04-16T14:30:38.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:38 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:38.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:38 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:30:38.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:38 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:30:38.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:38 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:38.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:38 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:30:38.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:38 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:30:38.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:38 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:30:38.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:38 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:38.479 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:38 smithi115 ceph-mon[37295]: osdmap e29: 4 total, 4 up, 4 in 2024-04-16T14:30:38.480 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:38 smithi115 ceph-mon[37295]: Detected new or changed devices on smithi115 2024-04-16T14:30:38.480 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:38 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:38.480 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:38 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:38.480 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:38 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:30:38.480 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:38 smithi115 ceph-mon[37295]: Adjusting osd_memory_target on smithi115 to 15936M 2024-04-16T14:30:38.480 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:38 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:38.480 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:38 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:30:38.480 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:38 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:30:38.480 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:38 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:38.480 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:38 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:30:38.480 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:38 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:30:38.480 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:38 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:30:38.480 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:38 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:39.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.249+0000 7fe2c2995700 1 -- 172.21.15.115:0/4083226677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc0fe0e0 msgr2=0x7fe2bc0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:30:39.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.249+0000 7fe2c2995700 1 --2- 172.21.15.115:0/4083226677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc0fe0e0 0x7fe2bc0fe550 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4004970 tx=0x7fe2a4009e30 comp rx=0 tx=0).stop 2024-04-16T14:30:39.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.250+0000 7fe2c2995700 1 -- 172.21.15.115:0/4083226677 shutdown_connections 2024-04-16T14:30:39.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.250+0000 7fe2c2995700 1 --2- 172.21.15.115:0/4083226677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc0fe0e0 0x7fe2bc0fe550 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:30:39.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.250+0000 7fe2c2995700 1 --2- 172.21.15.115:0/4083226677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2bc0fcef0 0x7fe2bc0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:30:39.250 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.250+0000 7fe2c2995700 1 -- 172.21.15.115:0/4083226677 >> 172.21.15.115:0/4083226677 conn(0x7fe2bc0f8530 msgr2=0x7fe2bc0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:30:39.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.250+0000 7fe2c2995700 1 -- 172.21.15.115:0/4083226677 shutdown_connections 2024-04-16T14:30:39.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.250+0000 7fe2c2995700 1 -- 172.21.15.115:0/4083226677 wait complete. 2024-04-16T14:30:39.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.250+0000 7fe2c2995700 1 Processor -- start 2024-04-16T14:30:39.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.250+0000 7fe2c2995700 1 -- start start 2024-04-16T14:30:39.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.250+0000 7fe2c2995700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2bc0fcef0 0x7fe2bc10d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:30:39.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.250+0000 7fe2c2995700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc0fe0e0 0x7fe2bc10dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:30:39.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.250+0000 7fe2c2995700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc10e4e0 con 0x7fe2bc0fcef0 2024-04-16T14:30:39.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.250+0000 7fe2c2995700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc10ed30 con 0x7fe2bc0fe0e0 2024-04-16T14:30:39.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.250+0000 7fe2b3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc0fe0e0 0x7fe2bc10dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:30:39.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.251+0000 7fe2b3fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc0fe0e0 0x7fe2bc10dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:47422/0 (socket says 172.21.15.115:47422) 2024-04-16T14:30:39.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.251+0000 7fe2b3fff700 1 -- 172.21.15.115:0/3442682370 learned_addr learned my addr 172.21.15.115:0/3442682370 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-04-16T14:30:39.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.251+0000 7fe2bbfff700 1 --2- 172.21.15.115:0/3442682370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2bc0fcef0 0x7fe2bc10d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:30:39.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.251+0000 7fe2b3fff700 1 -- 172.21.15.115:0/3442682370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2bc0fcef0 msgr2=0x7fe2bc10d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:30:39.251 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.251+0000 7fe2b3fff700 1 --2- 172.21.15.115:0/3442682370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2bc0fcef0 0x7fe2bc10d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:30:39.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.251+0000 7fe2b3fff700 1 -- 172.21.15.115:0/3442682370 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a4005040 con 0x7fe2bc0fe0e0 2024-04-16T14:30:39.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.251+0000 7fe2b3fff700 1 --2- 172.21.15.115:0/3442682370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc0fe0e0 0x7fe2bc10dee0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4005010 tx=0x7fe2a4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:30:39.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.251+0000 7fe2b97fa700 1 -- 172.21.15.115:0/3442682370 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2a400e040 con 0x7fe2bc0fe0e0 2024-04-16T14:30:39.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.251+0000 7fe2b97fa700 1 -- 172.21.15.115:0/3442682370 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe2a4013420 con 0x7fe2bc0fe0e0 2024-04-16T14:30:39.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.251+0000 7fe2c2995700 1 -- 172.21.15.115:0/3442682370 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2bc10efb0 con 0x7fe2bc0fe0e0 2024-04-16T14:30:39.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.251+0000 7fe2b97fa700 1 -- 172.21.15.115:0/3442682370 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2a401c630 con 0x7fe2bc0fe0e0 2024-04-16T14:30:39.252 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.251+0000 7fe2c2995700 1 -- 172.21.15.115:0/3442682370 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2bc10f4f0 con 0x7fe2bc0fe0e0 2024-04-16T14:30:39.253 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.252+0000 7fe2c2995700 1 -- 172.21.15.115:0/3442682370 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2bc05f5f0 con 0x7fe2bc0fe0e0 2024-04-16T14:30:39.253 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.253+0000 7fe2b97fa700 1 -- 172.21.15.115:0/3442682370 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7fe2a4013a20 con 0x7fe2bc0fe0e0 2024-04-16T14:30:39.253 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.253+0000 7fe2b97fa700 1 --2- 172.21.15.115:0/3442682370 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe2a80692b0 0x7fe2a806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:30:39.253 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.253+0000 7fe2b97fa700 1 -- 172.21.15.115:0/3442682370 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3770+0+0 (secure 0 0 0) 0x7fe2a4087d70 con 0x7fe2bc0fe0e0 2024-04-16T14:30:39.253 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.253+0000 7fe2bbfff700 1 --2- 172.21.15.115:0/3442682370 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe2a80692b0 0x7fe2a806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:30:39.253 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.254+0000 7fe2bbfff700 1 --2- 172.21.15.115:0/3442682370 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe2a80692b0 0x7fe2a806b760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc0fcc30 tx=0x7fe2ac00b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:30:39.256 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.258+0000 7fe2b97fa700 1 -- 172.21.15.115:0/3442682370 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe2a4058270 con 0x7fe2bc0fe0e0 2024-04-16T14:30:39.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:39 smithi115 ceph-mon[37295]: osdmap e30: 4 total, 4 up, 4 in 2024-04-16T14:30:39.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:39 smithi115 ceph-mon[37295]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-16T14:30:39.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:39 smithi115 ceph-mon[37295]: osdmap e31: 4 total, 4 up, 4 in 2024-04-16T14:30:39.452 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:39.453+0000 7fe2c2995700 1 -- 172.21.15.115:0/3442682370 --> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2bc10f890 con 0x7fe2a80692b0 2024-04-16T14:30:39.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:39 smithi005 ceph-mon[28964]: osdmap e30: 4 total, 4 up, 4 in 2024-04-16T14:30:39.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:39 smithi005 ceph-mon[28964]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-16T14:30:39.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:39 smithi005 ceph-mon[28964]: osdmap e31: 4 total, 4 up, 4 in 2024-04-16T14:30:40.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:40 smithi115 ceph-mon[37295]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:30:40.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:40 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-16T14:30:40.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:40 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-16T14:30:40.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:40 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:30:40.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:40 smithi005 ceph-mon[28964]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:30:40.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:40 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-16T14:30:40.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:40 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-16T14:30:40.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:40 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:30:41.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:41 smithi115 ceph-mon[37295]: pgmap v98: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 128 KiB/s, 0 objects/s recovering 2024-04-16T14:30:41.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:41 smithi005 ceph-mon[28964]: pgmap v98: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 128 KiB/s, 0 objects/s recovering 2024-04-16T14:30:42.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:42 smithi005 ceph-mon[28964]: from='client.? 172.21.15.115:0/3822871749' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4252814c-6811-4b53-a8be-cd65d7aa39a9"}]: dispatch 2024-04-16T14:30:42.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:42 smithi005 ceph-mon[28964]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4252814c-6811-4b53-a8be-cd65d7aa39a9"}]: dispatch 2024-04-16T14:30:42.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:42 smithi005 ceph-mon[28964]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4252814c-6811-4b53-a8be-cd65d7aa39a9"}]': finished 2024-04-16T14:30:42.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:42 smithi005 ceph-mon[28964]: osdmap e32: 5 total, 4 up, 5 in 2024-04-16T14:30:42.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:42 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-16T14:30:42.544 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:42 smithi115 ceph-mon[37295]: from='client.? 172.21.15.115:0/3822871749' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4252814c-6811-4b53-a8be-cd65d7aa39a9"}]: dispatch 2024-04-16T14:30:42.544 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:42 smithi115 ceph-mon[37295]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4252814c-6811-4b53-a8be-cd65d7aa39a9"}]: dispatch 2024-04-16T14:30:42.545 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:42 smithi115 ceph-mon[37295]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4252814c-6811-4b53-a8be-cd65d7aa39a9"}]': finished 2024-04-16T14:30:42.545 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:42 smithi115 ceph-mon[37295]: osdmap e32: 5 total, 4 up, 5 in 2024-04-16T14:30:42.545 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:42 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-16T14:30:43.545 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:43 smithi005 ceph-mon[28964]: from='client.? 172.21.15.115:0/2578768432' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-16T14:30:43.545 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:43 smithi005 ceph-mon[28964]: pgmap v100: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-04-16T14:30:43.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:43 smithi115 ceph-mon[37295]: from='client.? 172.21.15.115:0/2578768432' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-16T14:30:43.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:43 smithi115 ceph-mon[37295]: pgmap v100: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-04-16T14:30:46.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:45 smithi115 ceph-mon[37295]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-04-16T14:30:46.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:45 smithi005 ceph-mon[28964]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-04-16T14:30:47.934 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:47 smithi115 ceph-mon[37295]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-16T14:30:47.935 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:47 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:30:48.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:47 smithi005 ceph-mon[28964]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-16T14:30:48.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:47 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:30:49.881 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:49 smithi115 ceph-mon[37295]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-16T14:30:49.881 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:49 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-16T14:30:49.881 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:49 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:30:50.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:49 smithi005 ceph-mon[28964]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-16T14:30:50.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:49 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-16T14:30:50.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:49 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:30:51.136 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:50 smithi115 ceph-mon[37295]: Deploying daemon osd.4 on smithi115 2024-04-16T14:30:51.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:50 smithi005 ceph-mon[28964]: Deploying daemon osd.4 on smithi115 2024-04-16T14:30:51.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:51 smithi115 ceph-mon[37295]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-16T14:30:52.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:51 smithi005 ceph-mon[28964]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-16T14:30:54.025 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:53 smithi115 ceph-mon[37295]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-16T14:30:54.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:53 smithi005 ceph-mon[28964]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-16T14:30:55.657 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:55 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:55.657 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:55 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:55.657 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:55 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:30:55.657 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:55 smithi115 ceph-mon[37295]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-16T14:30:55.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:55 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:55.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:55 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:55.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:55 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:30:55.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:55 smithi005 ceph-mon[28964]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-16T14:30:57.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:57.519+0000 7fe2b97fa700 1 -- 172.21.15.115:0/3442682370 <== mgr.14212 v2:172.21.15.5:6800/3841652776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe2bc10f890 con 0x7fe2a80692b0 2024-04-16T14:30:57.518 INFO:teuthology.orchestra.run.smithi115.stdout:Created osd(s) 4 on host 'smithi115' 2024-04-16T14:30:57.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:57.521+0000 7fe2c2995700 1 -- 172.21.15.115:0/3442682370 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe2a80692b0 msgr2=0x7fe2a806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:30:57.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:57.521+0000 7fe2c2995700 1 --2- 172.21.15.115:0/3442682370 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe2a80692b0 0x7fe2a806b760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc0fcc30 tx=0x7fe2ac00b040 comp rx=0 tx=0).stop 2024-04-16T14:30:57.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:57.521+0000 7fe2c2995700 1 -- 172.21.15.115:0/3442682370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc0fe0e0 msgr2=0x7fe2bc10dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:30:57.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:57.521+0000 7fe2c2995700 1 --2- 172.21.15.115:0/3442682370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc0fe0e0 0x7fe2bc10dee0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4005010 tx=0x7fe2a4009e30 comp rx=0 tx=0).stop 2024-04-16T14:30:57.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:57.521+0000 7fe2c2995700 1 -- 172.21.15.115:0/3442682370 shutdown_connections 2024-04-16T14:30:57.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:57.521+0000 7fe2c2995700 1 --2- 172.21.15.115:0/3442682370 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe2a80692b0 0x7fe2a806b760 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:30:57.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:57.521+0000 7fe2c2995700 1 --2- 172.21.15.115:0/3442682370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe2bc0fcef0 0x7fe2bc10d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:30:57.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:57.521+0000 7fe2c2995700 1 --2- 172.21.15.115:0/3442682370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2bc0fe0e0 0x7fe2bc10dee0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:30:57.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:57.521+0000 7fe2c2995700 1 -- 172.21.15.115:0/3442682370 >> 172.21.15.115:0/3442682370 conn(0x7fe2bc0f8530 msgr2=0x7fe2bc0f9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:30:57.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:57.521+0000 7fe2c2995700 1 -- 172.21.15.115:0/3442682370 shutdown_connections 2024-04-16T14:30:57.520 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:30:57.521+0000 7fe2c2995700 1 -- 172.21.15.115:0/3442682370 wait complete. 2024-04-16T14:30:58.160 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:57 smithi115 ceph-mon[37295]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-16T14:30:58.160 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:57 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:58.160 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:57 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:58.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:57 smithi005 ceph-mon[28964]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-16T14:30:58.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:57 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:58.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:57 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:30:58.740 DEBUG:teuthology.orchestra.run.smithi115:osd.4> sudo journalctl -f -n 0 -u ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.4.service 2024-04-16T14:30:58.743 INFO:tasks.cephadm:Deploying osd.5 on smithi115 with /dev/vg_nvme/lv_2... 2024-04-16T14:30:58.743 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-16T14:30:59.053 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi115/config 2024-04-16T14:30:59.176 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:58 smithi115 ceph-mon[37295]: from='osd.4 [v2:172.21.15.115:6808/3982965260,v1:172.21.15.115:6809/3982965260]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-16T14:30:59.176 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:58 smithi115 ceph-mon[37295]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-16T14:30:59.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:58 smithi005 ceph-mon[28964]: from='osd.4 [v2:172.21.15.115:6808/3982965260,v1:172.21.15.115:6809/3982965260]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-16T14:30:59.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:58 smithi005 ceph-mon[28964]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-16T14:31:00.114 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:59 smithi115 ceph-mon[37295]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-16T14:31:00.114 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:59 smithi115 ceph-mon[37295]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-16T14:31:00.114 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:59 smithi115 ceph-mon[37295]: osdmap e33: 5 total, 4 up, 5 in 2024-04-16T14:31:00.114 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:59 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-16T14:31:00.114 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:59 smithi115 ceph-mon[37295]: from='osd.4 [v2:172.21.15.115:6808/3982965260,v1:172.21.15.115:6809/3982965260]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-04-16T14:31:00.114 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:59 smithi115 ceph-mon[37295]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-04-16T14:31:00.114 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:59 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:00.114 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:30:59 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:00.115 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:30:59 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4[49714]: 2024-04-16T14:30:59.760+0000 7fbf2b46b700 -1 osd.4 0 waiting for initial osdmap 2024-04-16T14:31:00.115 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:30:59 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4[49714]: 2024-04-16T14:30:59.769+0000 7fbf26266700 -1 osd.4 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T14:31:00.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:59 smithi005 ceph-mon[28964]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-16T14:31:00.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:59 smithi005 ceph-mon[28964]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-16T14:31:00.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:59 smithi005 ceph-mon[28964]: osdmap e33: 5 total, 4 up, 5 in 2024-04-16T14:31:00.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:59 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-16T14:31:00.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:59 smithi005 ceph-mon[28964]: from='osd.4 [v2:172.21.15.115:6808/3982965260,v1:172.21.15.115:6809/3982965260]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-04-16T14:31:00.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:59 smithi005 ceph-mon[28964]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-04-16T14:31:00.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:59 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:00.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:30:59 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:00.938 INFO:teuthology.orchestra.run.smithi115.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-16T14:31:00.938 INFO:teuthology.orchestra.run.smithi115.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-16T14:31:00.938 INFO:teuthology.orchestra.run.smithi115.stderr: stderr: 10+0 records in 2024-04-16T14:31:00.938 INFO:teuthology.orchestra.run.smithi115.stderr:10+0 records out 2024-04-16T14:31:00.938 INFO:teuthology.orchestra.run.smithi115.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0125729 s, 834 MB/s 2024-04-16T14:31:00.938 INFO:teuthology.orchestra.run.smithi115.stderr:--> Zapping successful for: 2024-04-16T14:31:00.966 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:00 smithi115 ceph-mon[37295]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-04-16T14:31:00.966 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:00 smithi115 ceph-mon[37295]: osdmap e34: 5 total, 4 up, 5 in 2024-04-16T14:31:00.966 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:00 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-16T14:31:00.966 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:00 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-16T14:31:01.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:00 smithi005 ceph-mon[28964]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-04-16T14:31:01.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:00 smithi005 ceph-mon[28964]: osdmap e34: 5 total, 4 up, 5 in 2024-04-16T14:31:01.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:00 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-16T14:31:01.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:00 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-16T14:31:01.893 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:01 smithi115 ceph-mon[37295]: purged_snaps scrub starts 2024-04-16T14:31:01.894 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:01 smithi115 ceph-mon[37295]: purged_snaps scrub ok 2024-04-16T14:31:01.894 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:01 smithi115 ceph-mon[37295]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-16T14:31:01.894 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:01 smithi115 ceph-mon[37295]: osd.4 [v2:172.21.15.115:6808/3982965260,v1:172.21.15.115:6809/3982965260] boot 2024-04-16T14:31:01.894 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:01 smithi115 ceph-mon[37295]: osdmap e35: 5 total, 5 up, 5 in 2024-04-16T14:31:01.894 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:01 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-16T14:31:02.126 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:01 smithi005 ceph-mon[28964]: purged_snaps scrub starts 2024-04-16T14:31:02.126 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:01 smithi005 ceph-mon[28964]: purged_snaps scrub ok 2024-04-16T14:31:02.126 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:01 smithi005 ceph-mon[28964]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-16T14:31:02.126 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:01 smithi005 ceph-mon[28964]: osd.4 [v2:172.21.15.115:6808/3982965260,v1:172.21.15.115:6809/3982965260] boot 2024-04-16T14:31:02.126 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:01 smithi005 ceph-mon[28964]: osdmap e35: 5 total, 5 up, 5 in 2024-04-16T14:31:02.126 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:01 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-16T14:31:02.323 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph orch daemon add osd smithi115:vg_nvme/lv_2 2024-04-16T14:31:02.842 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:02 smithi115 ceph-mon[37295]: osdmap e36: 5 total, 5 up, 5 in 2024-04-16T14:31:02.842 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:02 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:31:02.904 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi115/config 2024-04-16T14:31:03.150 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:02 smithi005 ceph-mon[28964]: osdmap e36: 5 total, 5 up, 5 in 2024-04-16T14:31:03.150 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:02 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:31:04.174 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:03 smithi115 ceph-mon[37295]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-16T14:31:04.223 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:03 smithi005 ceph-mon[28964]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-16T14:31:05.183 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.184+0000 7f280b1e7700 1 -- 172.21.15.115:0/2747447902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28040fff50 msgr2=0x7f2804102370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:05.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.184+0000 7f280b1e7700 1 --2- 172.21.15.115:0/2747447902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28040fff50 0x7f2804102370 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f27f4004940 tx=0x7f27f4009e30 comp rx=0 tx=0).stop 2024-04-16T14:31:05.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.184+0000 7f280b1e7700 1 -- 172.21.15.115:0/2747447902 shutdown_connections 2024-04-16T14:31:05.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.184+0000 7f280b1e7700 1 --2- 172.21.15.115:0/2747447902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28040fff50 0x7f2804102370 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:05.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.184+0000 7f280b1e7700 1 --2- 172.21.15.115:0/2747447902 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2804066f60 0x7f28040ffa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:05.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.184+0000 7f280b1e7700 1 -- 172.21.15.115:0/2747447902 >> 172.21.15.115:0/2747447902 conn(0x7f28040f7480 msgr2=0x7f28040f98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:05.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.184+0000 7f280b1e7700 1 -- 172.21.15.115:0/2747447902 shutdown_connections 2024-04-16T14:31:05.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.184+0000 7f280b1e7700 1 -- 172.21.15.115:0/2747447902 wait complete. 2024-04-16T14:31:05.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.184+0000 7f280b1e7700 1 Processor -- start 2024-04-16T14:31:05.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.185+0000 7f280b1e7700 1 -- start start 2024-04-16T14:31:05.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.185+0000 7f280b1e7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2804066f60 0x7f280410dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:05.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.185+0000 7f280b1e7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28040fff50 0x7f280410e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:05.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.185+0000 7f280b1e7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280410e860 con 0x7f2804066f60 2024-04-16T14:31:05.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.185+0000 7f280b1e7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2804113200 con 0x7f28040fff50 2024-04-16T14:31:05.184 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.185+0000 7f27fbfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28040fff50 0x7f280410e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:05.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.185+0000 7f27fbfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28040fff50 0x7f280410e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:56340/0 (socket says 172.21.15.115:56340) 2024-04-16T14:31:05.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.185+0000 7f27fbfff700 1 -- 172.21.15.115:0/2442793176 learned_addr learned my addr 172.21.15.115:0/2442793176 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-04-16T14:31:05.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.185+0000 7f2808f83700 1 --2- 172.21.15.115:0/2442793176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2804066f60 0x7f280410dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:05.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.185+0000 7f27fbfff700 1 -- 172.21.15.115:0/2442793176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2804066f60 msgr2=0x7f280410dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:05.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.185+0000 7f27fbfff700 1 --2- 172.21.15.115:0/2442793176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2804066f60 0x7f280410dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:05.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.185+0000 7f27fbfff700 1 -- 172.21.15.115:0/2442793176 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f4005040 con 0x7f28040fff50 2024-04-16T14:31:05.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.186+0000 7f27fbfff700 1 --2- 172.21.15.115:0/2442793176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28040fff50 0x7f280410e1e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f27f400b3b0 tx=0x7f27f4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:05.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.186+0000 7f27f97fa700 1 -- 172.21.15.115:0/2442793176 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27f400e040 con 0x7f28040fff50 2024-04-16T14:31:05.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.186+0000 7f280b1e7700 1 -- 172.21.15.115:0/2442793176 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28041133a0 con 0x7f28040fff50 2024-04-16T14:31:05.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.186+0000 7f27f97fa700 1 -- 172.21.15.115:0/2442793176 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f27f400bbf0 con 0x7f28040fff50 2024-04-16T14:31:05.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.186+0000 7f27f97fa700 1 -- 172.21.15.115:0/2442793176 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27f401c630 con 0x7f28040fff50 2024-04-16T14:31:05.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.186+0000 7f280b1e7700 1 -- 172.21.15.115:0/2442793176 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2804113910 con 0x7f28040fff50 2024-04-16T14:31:05.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.187+0000 7f280b1e7700 1 -- 172.21.15.115:0/2442793176 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280404c710 con 0x7f28040fff50 2024-04-16T14:31:05.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.187+0000 7f27f97fa700 1 -- 172.21.15.115:0/2442793176 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f27f400bd60 con 0x7f28040fff50 2024-04-16T14:31:05.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.188+0000 7f27f97fa700 1 --2- 172.21.15.115:0/2442793176 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f27ec0692a0 0x7f27ec06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:05.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.188+0000 7f27f97fa700 1 -- 172.21.15.115:0/2442793176 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f27f40879d0 con 0x7f28040fff50 2024-04-16T14:31:05.186 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.188+0000 7f2808f83700 1 --2- 172.21.15.115:0/2442793176 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f27ec0692a0 0x7f27ec06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:05.187 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.189+0000 7f2808f83700 1 --2- 172.21.15.115:0/2442793176 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f27ec0692a0 0x7f27ec06b750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f28000041d0 tx=0x7f28000043c0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:05.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.193+0000 7f27f97fa700 1 -- 172.21.15.115:0/2442793176 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f27f40541f0 con 0x7f28040fff50 2024-04-16T14:31:05.382 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:05.384+0000 7f280b1e7700 1 -- 172.21.15.115:0/2442793176 --> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f2804101ba0 con 0x7f27ec0692a0 2024-04-16T14:31:05.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:05 smithi115 ceph-mon[37295]: Detected new or changed devices on smithi115 2024-04-16T14:31:05.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:05 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:05.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:05 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:05.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:05 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:31:05.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:05 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:31:05.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:05 smithi115 ceph-mon[37295]: Adjusting osd_memory_target on smithi115 to 7968M 2024-04-16T14:31:05.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:05 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:05.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:05 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:31:05.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:05 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:31:05.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:05 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:05.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:05 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:31:05.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:05 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:31:05.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:05 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:31:05.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:05 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:05.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:05 smithi115 ceph-mon[37295]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-16T14:31:05.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:05 smithi005 ceph-mon[28964]: Detected new or changed devices on smithi115 2024-04-16T14:31:05.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:05 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:05.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:05 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:05.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:05 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:31:05.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:05 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:31:05.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:05 smithi005 ceph-mon[28964]: Adjusting osd_memory_target on smithi115 to 7968M 2024-04-16T14:31:05.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:05 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:05.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:05 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:31:05.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:05 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:31:05.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:05 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:05.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:05 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:31:05.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:05 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:31:05.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:05 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:31:05.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:05 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:05.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:05 smithi005 ceph-mon[28964]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-16T14:31:06.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:06 smithi115 ceph-mon[37295]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:31:06.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:06 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-16T14:31:06.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:06 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-16T14:31:06.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:06 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:31:06.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:06 smithi005 ceph-mon[28964]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:31:06.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:06 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-16T14:31:06.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:06 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-16T14:31:06.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:06 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:31:07.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:07 smithi115 ceph-mon[37295]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-16T14:31:07.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:07 smithi005 ceph-mon[28964]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-16T14:31:08.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:08 smithi115 ceph-mon[37295]: from='client.? 172.21.15.115:0/25153344' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "124732a1-f6a0-462e-bd5e-2bcd743ab2a3"}]: dispatch 2024-04-16T14:31:08.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:08 smithi115 ceph-mon[37295]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "124732a1-f6a0-462e-bd5e-2bcd743ab2a3"}]: dispatch 2024-04-16T14:31:08.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:08 smithi115 ceph-mon[37295]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "124732a1-f6a0-462e-bd5e-2bcd743ab2a3"}]': finished 2024-04-16T14:31:08.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:08 smithi115 ceph-mon[37295]: osdmap e37: 6 total, 5 up, 6 in 2024-04-16T14:31:08.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:08 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-16T14:31:08.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:08 smithi005 ceph-mon[28964]: from='client.? 172.21.15.115:0/25153344' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "124732a1-f6a0-462e-bd5e-2bcd743ab2a3"}]: dispatch 2024-04-16T14:31:08.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:08 smithi005 ceph-mon[28964]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "124732a1-f6a0-462e-bd5e-2bcd743ab2a3"}]: dispatch 2024-04-16T14:31:08.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:08 smithi005 ceph-mon[28964]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "124732a1-f6a0-462e-bd5e-2bcd743ab2a3"}]': finished 2024-04-16T14:31:08.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:08 smithi005 ceph-mon[28964]: osdmap e37: 6 total, 5 up, 6 in 2024-04-16T14:31:08.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:08 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-16T14:31:09.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:09 smithi115 ceph-mon[37295]: from='client.? 172.21.15.115:0/2176316727' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-16T14:31:09.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:09 smithi115 ceph-mon[37295]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-16T14:31:09.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:09 smithi005 ceph-mon[28964]: from='client.? 172.21.15.115:0/2176316727' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-16T14:31:09.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:09 smithi005 ceph-mon[28964]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-16T14:31:12.144 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:11 smithi115 ceph-mon[37295]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-16T14:31:12.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:11 smithi005 ceph-mon[28964]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-16T14:31:14.004 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:13 smithi115 ceph-mon[37295]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-16T14:31:14.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:13 smithi005 ceph-mon[28964]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-16T14:31:15.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:15 smithi115 ceph-mon[37295]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-16T14:31:15.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:15 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-16T14:31:15.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:15 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:31:15.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:15 smithi115 ceph-mon[37295]: Deploying daemon osd.5 on smithi115 2024-04-16T14:31:16.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:15 smithi005 ceph-mon[28964]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-16T14:31:16.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:15 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-16T14:31:16.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:15 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:31:16.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:15 smithi005 ceph-mon[28964]: Deploying daemon osd.5 on smithi115 2024-04-16T14:31:17.834 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:17 smithi115 ceph-mon[37295]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-16T14:31:17.834 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:17 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:31:18.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:17 smithi005 ceph-mon[28964]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-16T14:31:18.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:17 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:31:19.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:19 smithi115 ceph-mon[37295]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-16T14:31:20.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:19 smithi005 ceph-mon[28964]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-16T14:31:21.370 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:21 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:21.371 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:21 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:21.371 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:21 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:31:21.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:21 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:21.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:21 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:21.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:21 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:31:22.353 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:22 smithi115 ceph-mon[37295]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-16T14:31:22.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:22 smithi005 ceph-mon[28964]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-16T14:31:22.644 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:22.645+0000 7f27f97fa700 1 -- 172.21.15.115:0/2442793176 <== mgr.14212 v2:172.21.15.5:6800/3841652776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2804101ba0 con 0x7f27ec0692a0 2024-04-16T14:31:22.645 INFO:teuthology.orchestra.run.smithi115.stdout:Created osd(s) 5 on host 'smithi115' 2024-04-16T14:31:22.646 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:22.648+0000 7f280b1e7700 1 -- 172.21.15.115:0/2442793176 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f27ec0692a0 msgr2=0x7f27ec06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:22.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:22.648+0000 7f280b1e7700 1 --2- 172.21.15.115:0/2442793176 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f27ec0692a0 0x7f27ec06b750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f28000041d0 tx=0x7f28000043c0 comp rx=0 tx=0).stop 2024-04-16T14:31:22.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:22.648+0000 7f280b1e7700 1 -- 172.21.15.115:0/2442793176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28040fff50 msgr2=0x7f280410e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:22.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:22.648+0000 7f280b1e7700 1 --2- 172.21.15.115:0/2442793176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28040fff50 0x7f280410e1e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f27f400b3b0 tx=0x7f27f4009e30 comp rx=0 tx=0).stop 2024-04-16T14:31:22.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:22.648+0000 7f280b1e7700 1 -- 172.21.15.115:0/2442793176 shutdown_connections 2024-04-16T14:31:22.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:22.648+0000 7f280b1e7700 1 --2- 172.21.15.115:0/2442793176 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f27ec0692a0 0x7f27ec06b750 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:22.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:22.648+0000 7f280b1e7700 1 --2- 172.21.15.115:0/2442793176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2804066f60 0x7f280410dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:22.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:22.648+0000 7f280b1e7700 1 --2- 172.21.15.115:0/2442793176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28040fff50 0x7f280410e1e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:22.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:22.648+0000 7f280b1e7700 1 -- 172.21.15.115:0/2442793176 >> 172.21.15.115:0/2442793176 conn(0x7f28040f7480 msgr2=0x7f28040f98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:22.647 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:22.648+0000 7f280b1e7700 1 -- 172.21.15.115:0/2442793176 shutdown_connections 2024-04-16T14:31:22.648 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:22.648+0000 7f280b1e7700 1 -- 172.21.15.115:0/2442793176 wait complete. 2024-04-16T14:31:23.215 DEBUG:teuthology.orchestra.run.smithi115:osd.5> sudo journalctl -f -n 0 -u ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.5.service 2024-04-16T14:31:23.218 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-04-16T14:31:23.218 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph osd stat -f json 2024-04-16T14:31:23.496 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:31:23.865 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:23 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:23.865 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:23 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:23.865 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:23 smithi005 ceph-mon[28964]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-16T14:31:23.910 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:23 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:23.910 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:23 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:23.910 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:23 smithi115 ceph-mon[37295]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-16T14:31:23.910 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:31:23 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[56666]: 2024-04-16T14:31:23.872+0000 7f5c0d937540 -1 osd.5 0 log_to_monitors true 2024-04-16T14:31:24.904 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:24 smithi005 ceph-mon[28964]: from='osd.5 [v2:172.21.15.115:6816/448370235,v1:172.21.15.115:6817/448370235]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-16T14:31:24.904 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:24 smithi005 ceph-mon[28964]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-16T14:31:24.904 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:24 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:24.904 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:24 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:24.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:24 smithi115 ceph-mon[37295]: from='osd.5 [v2:172.21.15.115:6816/448370235,v1:172.21.15.115:6817/448370235]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-16T14:31:24.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:24 smithi115 ceph-mon[37295]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-16T14:31:24.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:24 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:24.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:24 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:25.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.221+0000 7fd88dd65700 1 -- 172.21.15.5:0/1758308568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8880fce50 msgr2=0x7fd8880fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:25.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.221+0000 7fd88dd65700 1 --2- 172.21.15.5:0/1758308568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8880fce50 0x7fd8880fd260 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd878004940 tx=0x7fd878009e30 comp rx=0 tx=0).stop 2024-04-16T14:31:25.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.221+0000 7fd88dd65700 1 -- 172.21.15.5:0/1758308568 shutdown_connections 2024-04-16T14:31:25.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.221+0000 7fd88dd65700 1 --2- 172.21.15.5:0/1758308568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8880fe050 0x7fd8880fe4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.221+0000 7fd88dd65700 1 --2- 172.21.15.5:0/1758308568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8880fce50 0x7fd8880fd260 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.221+0000 7fd88dd65700 1 -- 172.21.15.5:0/1758308568 >> 172.21.15.5:0/1758308568 conn(0x7fd8880f8580 msgr2=0x7fd8880fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.221+0000 7fd88dd65700 1 -- 172.21.15.5:0/1758308568 shutdown_connections 2024-04-16T14:31:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.221+0000 7fd88dd65700 1 -- 172.21.15.5:0/1758308568 wait complete. 2024-04-16T14:31:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.221+0000 7fd88dd65700 1 Processor -- start 2024-04-16T14:31:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.221+0000 7fd88dd65700 1 -- start start 2024-04-16T14:31:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.222+0000 7fd88dd65700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8880fce50 0x7fd88810da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.222+0000 7fd88dd65700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8880fe050 0x7fd88810df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.222+0000 7fd88dd65700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88810e550 con 0x7fd8880fce50 2024-04-16T14:31:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.222+0000 7fd88dd65700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88810eda0 con 0x7fd8880fe050 2024-04-16T14:31:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.222+0000 7fd8877fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8880fce50 0x7fd88810da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.222+0000 7fd8877fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8880fce50 0x7fd88810da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56946/0 (socket says 172.21.15.5:56946) 2024-04-16T14:31:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.222+0000 7fd8877fe700 1 -- 172.21.15.5:0/1488647645 learned_addr learned my addr 172.21.15.5:0/1488647645 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:31:25.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.222+0000 7fd886ffd700 1 --2- 172.21.15.5:0/1488647645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8880fe050 0x7fd88810df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:25.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.222+0000 7fd8877fe700 1 -- 172.21.15.5:0/1488647645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8880fe050 msgr2=0x7fd88810df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:25.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.222+0000 7fd8877fe700 1 --2- 172.21.15.5:0/1488647645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8880fe050 0x7fd88810df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:25.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.222+0000 7fd8877fe700 1 -- 172.21.15.5:0/1488647645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd878005040 con 0x7fd8880fce50 2024-04-16T14:31:25.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.222+0000 7fd8877fe700 1 --2- 172.21.15.5:0/1488647645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8880fce50 0x7fd88810da10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd878000c00 tx=0x7fd878009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:25.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.223+0000 7fd86ffff700 1 -- 172.21.15.5:0/1488647645 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd87800e030 con 0x7fd8880fce50 2024-04-16T14:31:25.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.223+0000 7fd88dd65700 1 -- 172.21.15.5:0/1488647645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd88810f020 con 0x7fd8880fce50 2024-04-16T14:31:25.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.223+0000 7fd86ffff700 1 -- 172.21.15.5:0/1488647645 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd878013de0 con 0x7fd8880fce50 2024-04-16T14:31:25.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.223+0000 7fd88dd65700 1 -- 172.21.15.5:0/1488647645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd88810f560 con 0x7fd8880fce50 2024-04-16T14:31:25.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.223+0000 7fd86ffff700 1 -- 172.21.15.5:0/1488647645 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd87801ce50 con 0x7fd8880fce50 2024-04-16T14:31:25.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.224+0000 7fd88dd65700 1 -- 172.21.15.5:0/1488647645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8740052e0 con 0x7fd8880fce50 2024-04-16T14:31:25.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.224+0000 7fd86ffff700 1 -- 172.21.15.5:0/1488647645 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7fd87800b460 con 0x7fd8880fce50 2024-04-16T14:31:25.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.225+0000 7fd86ffff700 1 --2- 172.21.15.5:0/1488647645 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd8700692a0 0x7fd87006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:25.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.225+0000 7fd86ffff700 1 -- 172.21.15.5:0/1488647645 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4338+0+0 (secure 0 0 0) 0x7fd878088670 con 0x7fd8880fce50 2024-04-16T14:31:25.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.225+0000 7fd886ffd700 1 --2- 172.21.15.5:0/1488647645 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd8700692a0 0x7fd87006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:25.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.225+0000 7fd886ffd700 1 --2- 172.21.15.5:0/1488647645 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd8700692a0 0x7fd87006b750 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd87c009b80 tx=0x7fd87c00b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:25.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.229+0000 7fd86ffff700 1 -- 172.21.15.5:0/1488647645 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd878058890 con 0x7fd8880fce50 2024-04-16T14:31:25.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.427+0000 7fd88dd65700 1 -- 172.21.15.5:0/1488647645 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fd874005590 con 0x7fd8880fce50 2024-04-16T14:31:25.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.427+0000 7fd86ffff700 1 -- 172.21.15.5:0/1488647645 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7fd878058420 con 0x7fd8880fce50 2024-04-16T14:31:25.426 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:31:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.430+0000 7fd88dd65700 1 -- 172.21.15.5:0/1488647645 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd8700692a0 msgr2=0x7fd87006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.430+0000 7fd88dd65700 1 --2- 172.21.15.5:0/1488647645 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd8700692a0 0x7fd87006b750 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd87c009b80 tx=0x7fd87c00b040 comp rx=0 tx=0).stop 2024-04-16T14:31:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.430+0000 7fd88dd65700 1 -- 172.21.15.5:0/1488647645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8880fce50 msgr2=0x7fd88810da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.430+0000 7fd88dd65700 1 --2- 172.21.15.5:0/1488647645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8880fce50 0x7fd88810da10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd878000c00 tx=0x7fd878009e30 comp rx=0 tx=0).stop 2024-04-16T14:31:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.430+0000 7fd88dd65700 1 -- 172.21.15.5:0/1488647645 shutdown_connections 2024-04-16T14:31:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.430+0000 7fd88dd65700 1 --2- 172.21.15.5:0/1488647645 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd8700692a0 0x7fd87006b750 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.430+0000 7fd88dd65700 1 --2- 172.21.15.5:0/1488647645 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8880fce50 0x7fd88810da10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.430+0000 7fd88dd65700 1 --2- 172.21.15.5:0/1488647645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8880fe050 0x7fd88810df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:25.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.430+0000 7fd88dd65700 1 -- 172.21.15.5:0/1488647645 >> 172.21.15.5:0/1488647645 conn(0x7fd8880f8580 msgr2=0x7fd8880f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:25.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.430+0000 7fd88dd65700 1 -- 172.21.15.5:0/1488647645 shutdown_connections 2024-04-16T14:31:25.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:25.430+0000 7fd88dd65700 1 -- 172.21.15.5:0/1488647645 wait complete. 2024-04-16T14:31:25.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:25 smithi005 ceph-mon[28964]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-16T14:31:25.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:25 smithi005 ceph-mon[28964]: osdmap e38: 6 total, 5 up, 6 in 2024-04-16T14:31:25.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:25 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-16T14:31:25.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:25 smithi005 ceph-mon[28964]: from='osd.5 [v2:172.21.15.115:6816/448370235,v1:172.21.15.115:6817/448370235]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-04-16T14:31:25.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:25 smithi005 ceph-mon[28964]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-04-16T14:31:25.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:25 smithi005 ceph-mon[28964]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-16T14:31:25.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:25 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/1488647645' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-16T14:31:25.931 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:31:25 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[56666]: 2024-04-16T14:31:25.657+0000 7f5c04109700 -1 osd.5 0 waiting for initial osdmap 2024-04-16T14:31:25.931 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:31:25 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[56666]: 2024-04-16T14:31:25.668+0000 7f5bfef04700 -1 osd.5 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T14:31:25.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:25 smithi115 ceph-mon[37295]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-16T14:31:25.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:25 smithi115 ceph-mon[37295]: osdmap e38: 6 total, 5 up, 6 in 2024-04-16T14:31:25.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:25 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-16T14:31:25.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:25 smithi115 ceph-mon[37295]: from='osd.5 [v2:172.21.15.115:6816/448370235,v1:172.21.15.115:6817/448370235]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-04-16T14:31:25.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:25 smithi115 ceph-mon[37295]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-04-16T14:31:25.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:25 smithi115 ceph-mon[37295]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-16T14:31:25.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:25 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/1488647645' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-16T14:31:26.086 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":38,"num_osds":6,"num_up_osds":5,"osd_up_since":1713277860,"num_in_osds":6,"osd_in_since":1713277867,"num_remapped_pgs":0} 2024-04-16T14:31:26.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:26 smithi005 ceph-mon[28964]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-04-16T14:31:26.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:26 smithi005 ceph-mon[28964]: osdmap e39: 6 total, 5 up, 6 in 2024-04-16T14:31:26.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:26 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-16T14:31:26.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:26 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-16T14:31:26.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:26 smithi115 ceph-mon[37295]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-04-16T14:31:26.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:26 smithi115 ceph-mon[37295]: osdmap e39: 6 total, 5 up, 6 in 2024-04-16T14:31:26.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-16T14:31:26.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:26 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-16T14:31:27.087 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph osd stat -f json 2024-04-16T14:31:27.359 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:31:27.773 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:27 smithi005 ceph-mon[28964]: purged_snaps scrub starts 2024-04-16T14:31:27.773 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:27 smithi005 ceph-mon[28964]: purged_snaps scrub ok 2024-04-16T14:31:27.773 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:27 smithi005 ceph-mon[28964]: osd.5 [v2:172.21.15.115:6816/448370235,v1:172.21.15.115:6817/448370235] boot 2024-04-16T14:31:27.774 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:27 smithi005 ceph-mon[28964]: osdmap e40: 6 total, 6 up, 6 in 2024-04-16T14:31:27.774 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:27 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-16T14:31:27.774 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:27 smithi005 ceph-mon[28964]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:27.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:27 smithi115 ceph-mon[37295]: purged_snaps scrub starts 2024-04-16T14:31:27.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:27 smithi115 ceph-mon[37295]: purged_snaps scrub ok 2024-04-16T14:31:27.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:27 smithi115 ceph-mon[37295]: osd.5 [v2:172.21.15.115:6816/448370235,v1:172.21.15.115:6817/448370235] boot 2024-04-16T14:31:27.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:27 smithi115 ceph-mon[37295]: osdmap e40: 6 total, 6 up, 6 in 2024-04-16T14:31:27.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:27 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-16T14:31:27.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:27 smithi115 ceph-mon[37295]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:28.836 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:28 smithi005 ceph-mon[28964]: osdmap e41: 6 total, 6 up, 6 in 2024-04-16T14:31:28.836 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:28 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:28.836 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:28 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:28.836 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:28 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:31:28.836 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:28 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:31:28.836 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:28 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:31:28.836 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:28 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:28.837 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:28 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:31:28.837 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:28 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:31:28.837 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:28 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:28.837 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:28 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:31:28.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:28 smithi115 ceph-mon[37295]: osdmap e41: 6 total, 6 up, 6 in 2024-04-16T14:31:28.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:28 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:28.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:28 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:28.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:28 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:31:28.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:28 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:31:28.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:28 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:31:28.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:28 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:28.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:28 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:31:28.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:28 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:31:28.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:28 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:28.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:28 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:31:29.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.042+0000 7ffa17e94700 1 -- 172.21.15.5:0/1336554074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa100fcff0 msgr2=0x7ffa100fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:29.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.042+0000 7ffa17e94700 1 --2- 172.21.15.5:0/1336554074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa100fcff0 0x7ffa100fd460 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ffa00004940 tx=0x7ffa00009e30 comp rx=0 tx=0).stop 2024-04-16T14:31:29.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.042+0000 7ffa17e94700 1 -- 172.21.15.5:0/1336554074 shutdown_connections 2024-04-16T14:31:29.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.042+0000 7ffa17e94700 1 --2- 172.21.15.5:0/1336554074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa100fcff0 0x7ffa100fd460 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:29.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.042+0000 7ffa17e94700 1 --2- 172.21.15.5:0/1336554074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa100fbd40 0x7ffa100fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:29.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.042+0000 7ffa17e94700 1 -- 172.21.15.5:0/1336554074 >> 172.21.15.5:0/1336554074 conn(0x7ffa100f74c0 msgr2=0x7ffa100f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:29.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.042+0000 7ffa17e94700 1 -- 172.21.15.5:0/1336554074 shutdown_connections 2024-04-16T14:31:29.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.042+0000 7ffa17e94700 1 -- 172.21.15.5:0/1336554074 wait complete. 2024-04-16T14:31:29.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.043+0000 7ffa17e94700 1 Processor -- start 2024-04-16T14:31:29.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.043+0000 7ffa17e94700 1 -- start start 2024-04-16T14:31:29.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.043+0000 7ffa17e94700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa100fbd40 0x7ffa100ffe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:29.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.043+0000 7ffa17e94700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa100fcff0 0x7ffa100fe330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:29.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.043+0000 7ffa17e94700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa100fe8c0 con 0x7ffa100fcff0 2024-04-16T14:31:29.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.043+0000 7ffa17e94700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa100fea00 con 0x7ffa100fbd40 2024-04-16T14:31:29.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.043+0000 7ffa1542f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa100fcff0 0x7ffa100fe330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.043+0000 7ffa1542f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa100fcff0 0x7ffa100fe330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60402/0 (socket says 172.21.15.5:60402) 2024-04-16T14:31:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.043+0000 7ffa1542f700 1 -- 172.21.15.5:0/2490653814 learned_addr learned my addr 172.21.15.5:0/2490653814 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:31:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.043+0000 7ffa15c30700 1 --2- 172.21.15.5:0/2490653814 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa100fbd40 0x7ffa100ffe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.044+0000 7ffa1542f700 1 -- 172.21.15.5:0/2490653814 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa100fbd40 msgr2=0x7ffa100ffe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.044+0000 7ffa1542f700 1 --2- 172.21.15.5:0/2490653814 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa100fbd40 0x7ffa100ffe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.044+0000 7ffa1542f700 1 -- 172.21.15.5:0/2490653814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa00005040 con 0x7ffa100fcff0 2024-04-16T14:31:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.044+0000 7ffa1542f700 1 --2- 172.21.15.5:0/2490653814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa100fcff0 0x7ffa100fe330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ffa0000b3b0 tx=0x7ffa00009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.044+0000 7ffa067fc700 1 -- 172.21.15.5:0/2490653814 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa0000e040 con 0x7ffa100fcff0 2024-04-16T14:31:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.044+0000 7ffa067fc700 1 -- 172.21.15.5:0/2490653814 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa0000bbf0 con 0x7ffa100fcff0 2024-04-16T14:31:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.044+0000 7ffa17e94700 1 -- 172.21.15.5:0/2490653814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa100fec80 con 0x7ffa100fcff0 2024-04-16T14:31:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.044+0000 7ffa067fc700 1 -- 172.21.15.5:0/2490653814 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa0001c630 con 0x7ffa100fcff0 2024-04-16T14:31:29.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.044+0000 7ffa17e94700 1 -- 172.21.15.5:0/2490653814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa10115ad0 con 0x7ffa100fcff0 2024-04-16T14:31:29.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.045+0000 7ffa17e94700 1 -- 172.21.15.5:0/2490653814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa10101b80 con 0x7ffa100fcff0 2024-04-16T14:31:29.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.046+0000 7ffa067fc700 1 -- 172.21.15.5:0/2490653814 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7ffa0000bd60 con 0x7ffa100fcff0 2024-04-16T14:31:29.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.046+0000 7ffa067fc700 1 --2- 172.21.15.5:0/2490653814 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ff9fc0692a0 0x7ff9fc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:29.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.046+0000 7ffa067fc700 1 -- 172.21.15.5:0/2490653814 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ffa00087b80 con 0x7ffa100fcff0 2024-04-16T14:31:29.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.046+0000 7ffa15c30700 1 --2- 172.21.15.5:0/2490653814 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ff9fc0692a0 0x7ff9fc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:29.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.047+0000 7ffa15c30700 1 --2- 172.21.15.5:0/2490653814 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ff9fc0692a0 0x7ff9fc06b750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffa100ffba0 tx=0x7ffa0c00b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:29.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.051+0000 7ffa067fc700 1 -- 172.21.15.5:0/2490653814 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ffa000541f0 con 0x7ffa100fcff0 2024-04-16T14:31:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.248+0000 7ffa17e94700 1 -- 172.21.15.5:0/2490653814 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7ffa1005f5f0 con 0x7ffa100fcff0 2024-04-16T14:31:29.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.248+0000 7ffa067fc700 1 -- 172.21.15.5:0/2490653814 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v41) v1 ==== 74+0+130 (secure 0 0 0) 0x7ffa00057810 con 0x7ffa100fcff0 2024-04-16T14:31:29.246 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:31:29.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.250+0000 7ffa17e94700 1 -- 172.21.15.5:0/2490653814 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ff9fc0692a0 msgr2=0x7ff9fc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.250+0000 7ffa17e94700 1 --2- 172.21.15.5:0/2490653814 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ff9fc0692a0 0x7ff9fc06b750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffa100ffba0 tx=0x7ffa0c00b040 comp rx=0 tx=0).stop 2024-04-16T14:31:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.250+0000 7ffa17e94700 1 -- 172.21.15.5:0/2490653814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa100fcff0 msgr2=0x7ffa100fe330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.250+0000 7ffa17e94700 1 --2- 172.21.15.5:0/2490653814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa100fcff0 0x7ffa100fe330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ffa0000b3b0 tx=0x7ffa00009e30 comp rx=0 tx=0).stop 2024-04-16T14:31:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.250+0000 7ffa17e94700 1 -- 172.21.15.5:0/2490653814 shutdown_connections 2024-04-16T14:31:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.250+0000 7ffa17e94700 1 --2- 172.21.15.5:0/2490653814 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ff9fc0692a0 0x7ff9fc06b750 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.250+0000 7ffa17e94700 1 --2- 172.21.15.5:0/2490653814 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa100fbd40 0x7ffa100ffe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.250+0000 7ffa17e94700 1 --2- 172.21.15.5:0/2490653814 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa100fcff0 0x7ffa100fe330 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.250+0000 7ffa17e94700 1 -- 172.21.15.5:0/2490653814 >> 172.21.15.5:0/2490653814 conn(0x7ffa100f74c0 msgr2=0x7ffa10065b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.250+0000 7ffa17e94700 1 -- 172.21.15.5:0/2490653814 shutdown_connections 2024-04-16T14:31:29.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:29.250+0000 7ffa17e94700 1 -- 172.21.15.5:0/2490653814 wait complete. 2024-04-16T14:31:29.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:29 smithi115 ceph-mon[37295]: Detected new or changed devices on smithi115 2024-04-16T14:31:29.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:29 smithi115 ceph-mon[37295]: Adjusting osd_memory_target on smithi115 to 5312M 2024-04-16T14:31:29.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:29 smithi115 ceph-mon[37295]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:29.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:29 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:31:29.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:29 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:31:29.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:29 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:29.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:29 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/2490653814' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-16T14:31:29.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:29 smithi005 ceph-mon[28964]: Detected new or changed devices on smithi115 2024-04-16T14:31:29.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:29 smithi005 ceph-mon[28964]: Adjusting osd_memory_target on smithi115 to 5312M 2024-04-16T14:31:29.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:29 smithi005 ceph-mon[28964]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:29.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:29 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:31:29.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:29 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:31:29.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:29 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:31:29.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:29 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/2490653814' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-16T14:31:30.061 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":41,"num_osds":6,"num_up_osds":6,"osd_up_since":1713277886,"num_in_osds":6,"osd_in_since":1713277867,"num_remapped_pgs":0} 2024-04-16T14:31:30.062 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph osd dump --format=json 2024-04-16T14:31:30.326 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:31:31.782 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:31 smithi005 ceph-mon[28964]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:32.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.003+0000 7fa3479de700 1 -- 172.21.15.5:0/524262910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa340102e20 msgr2=0x7fa3401031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:32.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.003+0000 7fa3479de700 1 --2- 172.21.15.5:0/524262910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa340102e20 0x7fa3401031f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa338004940 tx=0x7fa338009e30 comp rx=0 tx=0).stop 2024-04-16T14:31:32.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.003+0000 7fa3479de700 1 -- 172.21.15.5:0/524262910 shutdown_connections 2024-04-16T14:31:32.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.003+0000 7fa3479de700 1 --2- 172.21.15.5:0/524262910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3401037c0 0x7fa3400fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:32.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.003+0000 7fa3479de700 1 --2- 172.21.15.5:0/524262910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa340102e20 0x7fa3401031f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:32.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.003+0000 7fa3479de700 1 -- 172.21.15.5:0/524262910 >> 172.21.15.5:0/524262910 conn(0x7fa3400f89b0 msgr2=0x7fa3400fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:32.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.003+0000 7fa3479de700 1 -- 172.21.15.5:0/524262910 shutdown_connections 2024-04-16T14:31:32.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.003+0000 7fa3479de700 1 -- 172.21.15.5:0/524262910 wait complete. 2024-04-16T14:31:32.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.003+0000 7fa3479de700 1 Processor -- start 2024-04-16T14:31:32.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.003+0000 7fa3479de700 1 -- start start 2024-04-16T14:31:32.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.004+0000 7fa3479de700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa340102e20 0x7fa340113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:32.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.004+0000 7fa3479de700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3401037c0 0x7fa340113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:32.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.004+0000 7fa3479de700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa340114590 con 0x7fa3401037c0 2024-04-16T14:31:32.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.004+0000 7fa3479de700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34010db00 con 0x7fa340102e20 2024-04-16T14:31:32.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.004+0000 7fa344f79700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3401037c0 0x7fa340113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:32.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.004+0000 7fa344f79700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3401037c0 0x7fa340113eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60428/0 (socket says 172.21.15.5:60428) 2024-04-16T14:31:32.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.004+0000 7fa344f79700 1 -- 172.21.15.5:0/2630684237 learned_addr learned my addr 172.21.15.5:0/2630684237 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:31:32.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.004+0000 7fa34577a700 1 --2- 172.21.15.5:0/2630684237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa340102e20 0x7fa340113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:32.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.004+0000 7fa344f79700 1 -- 172.21.15.5:0/2630684237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa340102e20 msgr2=0x7fa340113970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:32.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.004+0000 7fa344f79700 1 --2- 172.21.15.5:0/2630684237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa340102e20 0x7fa340113970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:32.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.004+0000 7fa344f79700 1 -- 172.21.15.5:0/2630684237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa338005040 con 0x7fa3401037c0 2024-04-16T14:31:32.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.004+0000 7fa34577a700 1 --2- 172.21.15.5:0/2630684237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa340102e20 0x7fa340113970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T14:31:32.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.004+0000 7fa344f79700 1 --2- 172.21.15.5:0/2630684237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3401037c0 0x7fa340113eb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa33400b790 tx=0x7fa334009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:32.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.004+0000 7fa33dffb700 1 -- 172.21.15.5:0/2630684237 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa33400f6f0 con 0x7fa3401037c0 2024-04-16T14:31:32.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.004+0000 7fa3479de700 1 -- 172.21.15.5:0/2630684237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa34010dde0 con 0x7fa3401037c0 2024-04-16T14:31:32.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.004+0000 7fa33dffb700 1 -- 172.21.15.5:0/2630684237 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa33400fd20 con 0x7fa3401037c0 2024-04-16T14:31:32.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.005+0000 7fa33dffb700 1 -- 172.21.15.5:0/2630684237 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3340103a0 con 0x7fa3401037c0 2024-04-16T14:31:32.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.005+0000 7fa3479de700 1 -- 172.21.15.5:0/2630684237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa34010e3a0 con 0x7fa3401037c0 2024-04-16T14:31:32.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.006+0000 7fa3479de700 1 -- 172.21.15.5:0/2630684237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3400fe570 con 0x7fa3401037c0 2024-04-16T14:31:32.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.006+0000 7fa33dffb700 1 -- 172.21.15.5:0/2630684237 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7fa334011400 con 0x7fa3401037c0 2024-04-16T14:31:32.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.006+0000 7fa33dffb700 1 --2- 172.21.15.5:0/2630684237 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa3280692a0 0x7fa32806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:32.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.006+0000 7fa33dffb700 1 -- 172.21.15.5:0/2630684237 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa334086d20 con 0x7fa3401037c0 2024-04-16T14:31:32.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.007+0000 7fa34577a700 1 --2- 172.21.15.5:0/2630684237 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa3280692a0 0x7fa32806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:32.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.007+0000 7fa34577a700 1 --2- 172.21.15.5:0/2630684237 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa3280692a0 0x7fa32806b750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa338004560 tx=0x7fa338009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:32.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.011+0000 7fa33dffb700 1 -- 172.21.15.5:0/2630684237 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa334056da0 con 0x7fa3401037c0 2024-04-16T14:31:32.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:31 smithi115 ceph-mon[37295]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:32.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.206+0000 7fa3479de700 1 -- 172.21.15.5:0/2630684237 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa34004c710 con 0x7fa3401037c0 2024-04-16T14:31:32.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.207+0000 7fa33dffb700 1 -- 172.21.15.5:0/2630684237 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11021 (secure 0 0 0) 0x7fa334056930 con 0x7fa3401037c0 2024-04-16T14:31:32.206 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:31:32.206 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":41,"fsid":"10609bfa-fbfd-11ee-bc90-c7b262605968","created":"2024-04-16T14:25:45.190718+0000","modified":"2024-04-16T14:31:27.658744+0000","last_up_change":"2024-04-16T14:31:26.654027+0000","last_in_change":"2024-04-16T14:31:07.952511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T14:30:12.985367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"aa9fa9e4-bdd2-42c5-ba51-8d141fa9c4c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2400102721},{"type":"v1","addr":"172.21.15.5:6803","nonce":2400102721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2400102721},{"type":"v1","addr":"172.21.15.5:6805","nonce":2400102721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2400102721},{"type":"v1","addr":"172.21.15.5:6809","nonce":2400102721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2400102721},{"type":"v1","addr":"172.21.15.5:6807","nonce":2400102721}]},"public_addr":"172.21.15.5:6803/2400102721","cluster_addr":"172.21.15.5:6805/2400102721","heartbeat_back_addr":"172.21.15.5:6809/2400102721","heartbeat_front_addr":"172.21.15.5:6807/2400102721","state":["exists","up"]},{"osd":1,"uuid":"d4074765-a246-412a-8b68-8da402adc7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":755259206},{"type":"v1","addr":"172.21.15.5:6811","nonce":755259206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":755259206},{"type":"v1","addr":"172.21.15.5:6813","nonce":755259206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":755259206},{"type":"v1","addr":"172.21.15.5:6817","nonce":755259206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":755259206},{"type":"v1","addr":"172.21.15.5:6815","nonce":755259206}]},"public_addr":"172.21.15.5:6811/755259206","cluster_addr":"172.21.15.5:6813/755259206","heartbeat_back_addr":"172.21.15.5:6817/755259206","heartbeat_front_addr":"172.21.15.5:6815/755259206","state":["exists","up"]},{"osd":2,"uuid":"1851758c-0015-4f54-b4b8-30c1424394ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2907807829},{"type":"v1","addr":"172.21.15.5:6819","nonce":2907807829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2907807829},{"type":"v1","addr":"172.21.15.5:6821","nonce":2907807829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":2907807829},{"type":"v1","addr":"172.21.15.5:6825","nonce":2907807829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2907807829},{"type":"v1","addr":"172.21.15.5:6823","nonce":2907807829}]},"public_addr":"172.21.15.5:6819/2907807829","cluster_addr":"172.21.15.5:6821/2907807829","heartbeat_back_addr":"172.21.15.5:6825/2907807829","heartbeat_front_addr":"172.21.15.5:6823/2907807829","state":["exists","up"]},{"osd":3,"uuid":"ab6404e2-5cef-4a8a-8b93-a24914c67fc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2081173791},{"type":"v1","addr":"172.21.15.115:6801","nonce":2081173791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2081173791},{"type":"v1","addr":"172.21.15.115:6803","nonce":2081173791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2081173791},{"type":"v1","addr":"172.21.15.115:6807","nonce":2081173791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2081173791},{"type":"v1","addr":"172.21.15.115:6805","nonce":2081173791}]},"public_addr":"172.21.15.115:6801/2081173791","cluster_addr":"172.21.15.115:6803/2081173791","heartbeat_back_addr":"172.21.15.115:6807/2081173791","heartbeat_front_addr":"172.21.15.115:6805/2081173791","state":["exists","up"]},{"osd":4,"uuid":"4252814c-6811-4b53-a8be-cd65d7aa39a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":3982965260},{"type":"v1","addr":"172.21.15.115:6809","nonce":3982965260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":3982965260},{"type":"v1","addr":"172.21.15.115:6811","nonce":3982965260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":3982965260},{"type":"v1","addr":"172.21.15.115:6815","nonce":3982965260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":3982965260},{"type":"v1","addr":"172.21.15.115:6813","nonce":3982965260}]},"public_addr":"172.21.15.115:6809/3982965260","cluster_addr":"172.21.15.115:6811/3982965260","heartbeat_back_addr":"172.21.15.115:6815/3982965260","heartbeat_front_addr":"172.21.15.115:6813/3982965260","state":["exists","up"]},{"osd":5,"uuid":"124732a1-f6a0-462e-bd5e-2bcd743ab2a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":448370235},{"type":"v1","addr":"172.21.15.115:6817","nonce":448370235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":448370235},{"type":"v1","addr":"172.21.15.115:6819","nonce":448370235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":448370235},{"type":"v1","addr":"172.21.15.115:6823","nonce":448370235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":448370235},{"type":"v1","addr":"172.21.15.115:6821","nonce":448370235}]},"public_addr":"172.21.15.115:6817/448370235","cluster_addr":"172.21.15.115:6819/448370235","heartbeat_back_addr":"172.21.15.115:6823/448370235","heartbeat_front_addr":"172.21.15.115:6821/448370235","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:29:14.299546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:29:41.658611+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:30:10.127883+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:30:33.310873+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:30:59.158923+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:31:24.898158+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/4176454319":"2024-04-17T14:28:02.662455+0000","172.21.15.5:6800/4176454319":"2024-04-17T14:28:02.662455+0000","172.21.15.5:0/3767913866":"2024-04-17T14:28:02.662455+0000","172.21.15.5:6800/4088193218":"2024-04-17T14:26:48.930147+0000","172.21.15.5:0/801827499":"2024-04-17T14:26:48.930147+0000","172.21.15.5:0/3364969045":"2024-04-17T14:26:48.930147+0000","172.21.15.5:6800/1086445367":"2024-04-17T14:26:17.425567+0000","172.21.15.5:0/2653432440":"2024-04-17T14:28:02.662455+0000","172.21.15.5:0/3710869010":"2024-04-17T14:26:17.425567+0000","172.21.15.5:0/2384405072":"2024-04-17T14:26:17.425567+0000","172.21.15.5:0/2015079913":"2024-04-17T14:26:17.425567+0000","172.21.15.5:6801/1086445367":"2024-04-17T14:26:17.425567+0000","172.21.15.5:0/1548281910":"2024-04-17T14:28:02.662455+0000","172.21.15.5:6801/4088193218":"2024-04-17T14:26:48.930147+0000","172.21.15.5:0/2013882368":"2024-04-17T14:26:48.930147+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T14:31:32.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.209+0000 7fa3479de700 1 -- 172.21.15.5:0/2630684237 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa3280692a0 msgr2=0x7fa32806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:32.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.209+0000 7fa3479de700 1 --2- 172.21.15.5:0/2630684237 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa3280692a0 0x7fa32806b750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa338004560 tx=0x7fa338009e30 comp rx=0 tx=0).stop 2024-04-16T14:31:32.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.209+0000 7fa3479de700 1 -- 172.21.15.5:0/2630684237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3401037c0 msgr2=0x7fa340113eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:32.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.209+0000 7fa3479de700 1 --2- 172.21.15.5:0/2630684237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3401037c0 0x7fa340113eb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa33400b790 tx=0x7fa334009220 comp rx=0 tx=0).stop 2024-04-16T14:31:32.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.210+0000 7fa3479de700 1 -- 172.21.15.5:0/2630684237 shutdown_connections 2024-04-16T14:31:32.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.210+0000 7fa3479de700 1 --2- 172.21.15.5:0/2630684237 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa3280692a0 0x7fa32806b750 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:32.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.210+0000 7fa3479de700 1 --2- 172.21.15.5:0/2630684237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa340102e20 0x7fa340113970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:32.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.210+0000 7fa3479de700 1 --2- 172.21.15.5:0/2630684237 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa3401037c0 0x7fa340113eb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:32.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.210+0000 7fa3479de700 1 -- 172.21.15.5:0/2630684237 >> 172.21.15.5:0/2630684237 conn(0x7fa3400f89b0 msgr2=0x7fa3400f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:32.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.210+0000 7fa3479de700 1 -- 172.21.15.5:0/2630684237 shutdown_connections 2024-04-16T14:31:32.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:32.210+0000 7fa3479de700 1 -- 172.21.15.5:0/2630684237 wait complete. 2024-04-16T14:31:32.793 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:32 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/2630684237' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-16T14:31:32.793 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:32 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:31:32.817 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T14:30:12.985367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-04-16T14:31:32.818 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-16T14:31:33.078 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:31:33.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:32 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/2630684237' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-16T14:31:33.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:32 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:31:34.162 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:33 smithi005 ceph-mon[28964]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:34.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:33 smithi115 ceph-mon[37295]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:34.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.661+0000 7f3ab0bea700 1 -- 172.21.15.5:0/3173182695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aac0656b0 msgr2=0x7f3aac065b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:34.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.661+0000 7f3ab0bea700 1 --2- 172.21.15.5:0/3173182695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aac0656b0 0x7f3aac065b20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3a94004940 tx=0x7f3a94009e30 comp rx=0 tx=0).stop 2024-04-16T14:31:34.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.661+0000 7f3ab0bea700 1 -- 172.21.15.5:0/3173182695 shutdown_connections 2024-04-16T14:31:34.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.661+0000 7f3ab0bea700 1 --2- 172.21.15.5:0/3173182695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aac0656b0 0x7f3aac065b20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:34.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.661+0000 7f3ab0bea700 1 --2- 172.21.15.5:0/3173182695 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3aac102e60 0x7f3aac103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:34.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.661+0000 7f3ab0bea700 1 -- 172.21.15.5:0/3173182695 >> 172.21.15.5:0/3173182695 conn(0x7f3aac072bc0 msgr2=0x7f3aac072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:34.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.661+0000 7f3ab0bea700 1 -- 172.21.15.5:0/3173182695 shutdown_connections 2024-04-16T14:31:34.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.661+0000 7f3ab0bea700 1 -- 172.21.15.5:0/3173182695 wait complete. 2024-04-16T14:31:34.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.662+0000 7f3ab0bea700 1 Processor -- start 2024-04-16T14:31:34.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.662+0000 7f3ab0bea700 1 -- start start 2024-04-16T14:31:34.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.662+0000 7f3ab0bea700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aac0656b0 0x7f3aac0fbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:34.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.662+0000 7f3ab0bea700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3aac102e60 0x7f3aac0fc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:34.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.662+0000 7f3ab0bea700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac0fc8b0 con 0x7f3aac0656b0 2024-04-16T14:31:34.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.662+0000 7f3ab0bea700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac0fc9f0 con 0x7f3aac102e60 2024-04-16T14:31:34.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.662+0000 7f3aaa59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aac0656b0 0x7f3aac0fbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:34.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.662+0000 7f3aaa59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aac0656b0 0x7f3aac0fbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60438/0 (socket says 172.21.15.5:60438) 2024-04-16T14:31:34.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.662+0000 7f3aaa59c700 1 -- 172.21.15.5:0/1228178093 learned_addr learned my addr 172.21.15.5:0/1228178093 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:31:34.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.662+0000 7f3aa9d9b700 1 --2- 172.21.15.5:0/1228178093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3aac102e60 0x7f3aac0fc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:34.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.662+0000 7f3aaa59c700 1 -- 172.21.15.5:0/1228178093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3aac102e60 msgr2=0x7f3aac0fc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:34.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.662+0000 7f3aaa59c700 1 --2- 172.21.15.5:0/1228178093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3aac102e60 0x7f3aac0fc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:34.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.662+0000 7f3aaa59c700 1 -- 172.21.15.5:0/1228178093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a94005040 con 0x7f3aac0656b0 2024-04-16T14:31:34.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.662+0000 7f3aaa59c700 1 --2- 172.21.15.5:0/1228178093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aac0656b0 0x7f3aac0fbd50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400b790 tx=0x7f3aa4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:34.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.662+0000 7f3aa2ffd700 1 -- 172.21.15.5:0/1228178093 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3aa400f6f0 con 0x7f3aac0656b0 2024-04-16T14:31:34.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.663+0000 7f3aa2ffd700 1 -- 172.21.15.5:0/1228178093 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3aa400fd20 con 0x7f3aac0656b0 2024-04-16T14:31:34.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.663+0000 7f3aa2ffd700 1 -- 172.21.15.5:0/1228178093 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3aa40103a0 con 0x7f3aac0656b0 2024-04-16T14:31:34.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.663+0000 7f3ab0bea700 1 -- 172.21.15.5:0/1228178093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aac119e70 con 0x7f3aac0656b0 2024-04-16T14:31:34.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.663+0000 7f3ab0bea700 1 -- 172.21.15.5:0/1228178093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aac11a350 con 0x7f3aac0656b0 2024-04-16T14:31:34.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.664+0000 7f3ab0bea700 1 -- 172.21.15.5:0/1228178093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aac0fe570 con 0x7f3aac0656b0 2024-04-16T14:31:34.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.664+0000 7f3aa2ffd700 1 -- 172.21.15.5:0/1228178093 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f3aa4011400 con 0x7f3aac0656b0 2024-04-16T14:31:34.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.665+0000 7f3aa2ffd700 1 --2- 172.21.15.5:0/1228178093 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f3a980692b0 0x7f3a9806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:34.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.665+0000 7f3aa9d9b700 1 --2- 172.21.15.5:0/1228178093 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f3a980692b0 0x7f3a9806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:34.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.665+0000 7f3aa2ffd700 1 -- 172.21.15.5:0/1228178093 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3aa4086c20 con 0x7f3aac0656b0 2024-04-16T14:31:34.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.665+0000 7f3aa9d9b700 1 --2- 172.21.15.5:0/1228178093 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f3a980692b0 0x7f3a9806b760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3aac0fd690 tx=0x7f3a94009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:34.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.669+0000 7f3aa2ffd700 1 -- 172.21.15.5:0/1228178093 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3aa4053290 con 0x7f3aac0656b0 2024-04-16T14:31:34.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.866+0000 7f3ab0bea700 1 -- 172.21.15.5:0/1228178093 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3aac0fd440 con 0x7f3aac0656b0 2024-04-16T14:31:34.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.866+0000 7f3aa2ffd700 1 -- 172.21.15.5:0/1228178093 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3aa40568b0 con 0x7f3aac0656b0 2024-04-16T14:31:34.865 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-16T14:31:34.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.868+0000 7f3ab0bea700 1 -- 172.21.15.5:0/1228178093 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f3a980692b0 msgr2=0x7f3a9806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:34.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.868+0000 7f3ab0bea700 1 --2- 172.21.15.5:0/1228178093 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f3a980692b0 0x7f3a9806b760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3aac0fd690 tx=0x7f3a94009e30 comp rx=0 tx=0).stop 2024-04-16T14:31:34.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.868+0000 7f3ab0bea700 1 -- 172.21.15.5:0/1228178093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aac0656b0 msgr2=0x7f3aac0fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:34.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.868+0000 7f3ab0bea700 1 --2- 172.21.15.5:0/1228178093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aac0656b0 0x7f3aac0fbd50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400b790 tx=0x7f3aa4009250 comp rx=0 tx=0).stop 2024-04-16T14:31:34.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.868+0000 7f3ab0bea700 1 -- 172.21.15.5:0/1228178093 shutdown_connections 2024-04-16T14:31:34.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.868+0000 7f3ab0bea700 1 --2- 172.21.15.5:0/1228178093 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f3a980692b0 0x7f3a9806b760 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:34.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.868+0000 7f3ab0bea700 1 --2- 172.21.15.5:0/1228178093 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aac0656b0 0x7f3aac0fbd50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:34.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.868+0000 7f3ab0bea700 1 --2- 172.21.15.5:0/1228178093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3aac102e60 0x7f3aac0fc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:34.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.868+0000 7f3ab0bea700 1 -- 172.21.15.5:0/1228178093 >> 172.21.15.5:0/1228178093 conn(0x7f3aac072bc0 msgr2=0x7f3aac0fa040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:34.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.868+0000 7f3ab0bea700 1 -- 172.21.15.5:0/1228178093 shutdown_connections 2024-04-16T14:31:34.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:34.868+0000 7f3ab0bea700 1 -- 172.21.15.5:0/1228178093 wait complete. 2024-04-16T14:31:35.604 INFO:tasks.cephadm:Setting up client nodes... 2024-04-16T14:31:35.604 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-16T14:31:35.872 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:31:35.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:35 smithi005 ceph-mon[28964]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:35.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:35 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/1228178093' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-16T14:31:36.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:35 smithi115 ceph-mon[37295]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:36.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:35 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/1228178093' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-16T14:31:37.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.592+0000 7fe56c7aa700 1 -- 172.21.15.5:0/3693497654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5640fcff0 msgr2=0x7fe5640fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:37.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.592+0000 7fe56c7aa700 1 --2- 172.21.15.5:0/3693497654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5640fcff0 0x7fe5640fd460 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe554004940 tx=0x7fe554009e30 comp rx=0 tx=0).stop 2024-04-16T14:31:37.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.592+0000 7fe56c7aa700 1 -- 172.21.15.5:0/3693497654 shutdown_connections 2024-04-16T14:31:37.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.592+0000 7fe56c7aa700 1 --2- 172.21.15.5:0/3693497654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5640fcff0 0x7fe5640fd460 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:37.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.592+0000 7fe56c7aa700 1 --2- 172.21.15.5:0/3693497654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5640fbd40 0x7fe5640fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:37.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.592+0000 7fe56c7aa700 1 -- 172.21.15.5:0/3693497654 >> 172.21.15.5:0/3693497654 conn(0x7fe5640f7460 msgr2=0x7fe5640f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:37.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.592+0000 7fe56c7aa700 1 -- 172.21.15.5:0/3693497654 shutdown_connections 2024-04-16T14:31:37.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.592+0000 7fe56c7aa700 1 -- 172.21.15.5:0/3693497654 wait complete. 2024-04-16T14:31:37.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.593+0000 7fe56c7aa700 1 Processor -- start 2024-04-16T14:31:37.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.593+0000 7fe56c7aa700 1 -- start start 2024-04-16T14:31:37.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.593+0000 7fe56c7aa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5640fbd40 0x7fe56410c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:37.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.593+0000 7fe56c7aa700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5640fcff0 0x7fe56410cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:37.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.593+0000 7fe56c7aa700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56410d390 con 0x7fe5640fbd40 2024-04-16T14:31:37.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.593+0000 7fe56c7aa700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56410d500 con 0x7fe5640fcff0 2024-04-16T14:31:37.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.593+0000 7fe56a546700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5640fbd40 0x7fe56410c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:37.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.593+0000 7fe56a546700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5640fbd40 0x7fe56410c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60452/0 (socket says 172.21.15.5:60452) 2024-04-16T14:31:37.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.593+0000 7fe56a546700 1 -- 172.21.15.5:0/1166490630 learned_addr learned my addr 172.21.15.5:0/1166490630 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:31:37.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.593+0000 7fe569d45700 1 --2- 172.21.15.5:0/1166490630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5640fcff0 0x7fe56410cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:37.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.594+0000 7fe56a546700 1 -- 172.21.15.5:0/1166490630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5640fcff0 msgr2=0x7fe56410cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:37.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.594+0000 7fe56a546700 1 --2- 172.21.15.5:0/1166490630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5640fcff0 0x7fe56410cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:37.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.594+0000 7fe56a546700 1 -- 172.21.15.5:0/1166490630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe554005040 con 0x7fe5640fbd40 2024-04-16T14:31:37.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.594+0000 7fe56a546700 1 --2- 172.21.15.5:0/1166490630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5640fbd40 0x7fe56410c850 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe56000c830 tx=0x7fe560004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:37.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.594+0000 7fe55affd700 1 -- 172.21.15.5:0/1166490630 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5600106f0 con 0x7fe5640fbd40 2024-04-16T14:31:37.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.594+0000 7fe56c7aa700 1 -- 172.21.15.5:0/1166490630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe564065610 con 0x7fe5640fbd40 2024-04-16T14:31:37.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.594+0000 7fe55affd700 1 -- 172.21.15.5:0/1166490630 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe560010d20 con 0x7fe5640fbd40 2024-04-16T14:31:37.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.594+0000 7fe55affd700 1 -- 172.21.15.5:0/1166490630 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5600113a0 con 0x7fe5640fbd40 2024-04-16T14:31:37.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.594+0000 7fe56c7aa700 1 -- 172.21.15.5:0/1166490630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe564065bd0 con 0x7fe5640fbd40 2024-04-16T14:31:37.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.595+0000 7fe56c7aa700 1 -- 172.21.15.5:0/1166490630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe56404c710 con 0x7fe5640fbd40 2024-04-16T14:31:37.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.595+0000 7fe55affd700 1 -- 172.21.15.5:0/1166490630 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7fe560012400 con 0x7fe5640fbd40 2024-04-16T14:31:37.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.596+0000 7fe55affd700 1 --2- 172.21.15.5:0/1166490630 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe5500692a0 0x7fe55006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:37.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.596+0000 7fe55affd700 1 -- 172.21.15.5:0/1166490630 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe560086e20 con 0x7fe5640fbd40 2024-04-16T14:31:37.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.596+0000 7fe569d45700 1 --2- 172.21.15.5:0/1166490630 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe5500692a0 0x7fe55006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:37.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.596+0000 7fe569d45700 1 --2- 172.21.15.5:0/1166490630 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe5500692a0 0x7fe55006b750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe55400b970 tx=0x7fe554009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:37.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.600+0000 7fe55affd700 1 -- 172.21.15.5:0/1166490630 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe560056f20 con 0x7fe5640fbd40 2024-04-16T14:31:37.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.877+0000 7fe56c7aa700 1 -- 172.21.15.5:0/1166490630 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fe564066090 con 0x7fe5640fbd40 2024-04-16T14:31:37.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.880+0000 7fe55affd700 1 -- 172.21.15.5:0/1166490630 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7fe560056ab0 con 0x7fe5640fbd40 2024-04-16T14:31:37.879 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-04-16T14:31:37.879 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDJix5mxHhcNBAAeF8+9jlxA8l93h6TasF9TQ== 2024-04-16T14:31:37.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.882+0000 7fe56c7aa700 1 -- 172.21.15.5:0/1166490630 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe5500692a0 msgr2=0x7fe55006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:37.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.882+0000 7fe56c7aa700 1 --2- 172.21.15.5:0/1166490630 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe5500692a0 0x7fe55006b750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe55400b970 tx=0x7fe554009e30 comp rx=0 tx=0).stop 2024-04-16T14:31:37.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.882+0000 7fe56c7aa700 1 -- 172.21.15.5:0/1166490630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5640fbd40 msgr2=0x7fe56410c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:37.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.882+0000 7fe56c7aa700 1 --2- 172.21.15.5:0/1166490630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5640fbd40 0x7fe56410c850 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe56000c830 tx=0x7fe560004470 comp rx=0 tx=0).stop 2024-04-16T14:31:37.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.882+0000 7fe56c7aa700 1 -- 172.21.15.5:0/1166490630 shutdown_connections 2024-04-16T14:31:37.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.882+0000 7fe56c7aa700 1 --2- 172.21.15.5:0/1166490630 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe5500692a0 0x7fe55006b750 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:37.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.882+0000 7fe56c7aa700 1 --2- 172.21.15.5:0/1166490630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5640fbd40 0x7fe56410c850 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:37.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.882+0000 7fe56c7aa700 1 --2- 172.21.15.5:0/1166490630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5640fcff0 0x7fe56410cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:37.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.882+0000 7fe56c7aa700 1 -- 172.21.15.5:0/1166490630 >> 172.21.15.5:0/1166490630 conn(0x7fe5640f7460 msgr2=0x7fe5640f8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:37.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.883+0000 7fe56c7aa700 1 -- 172.21.15.5:0/1166490630 shutdown_connections 2024-04-16T14:31:37.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:37.883+0000 7fe56c7aa700 1 -- 172.21.15.5:0/1166490630 wait complete. 2024-04-16T14:31:38.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:37 smithi115 ceph-mon[37295]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:38.196 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:37 smithi005 ceph-mon[28964]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:38.548 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-16T14:31:38.548 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-16T14:31:38.548 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-16T14:31:38.593 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-16T14:31:38.861 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi115/config 2024-04-16T14:31:38.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:38 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/1166490630' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-16T14:31:38.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:38 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/1166490630' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-16T14:31:38.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:38 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/1166490630' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-16T14:31:38.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:38 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/1166490630' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-16T14:31:39.991 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:39 smithi115 ceph-mon[37295]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:40.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:39 smithi005 ceph-mon[28964]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:40.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.479+0000 7f2cd9d94700 1 -- 172.21.15.115:0/3210206839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cd40fcfd0 msgr2=0x7f2cd40fd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:40.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.479+0000 7f2cd9d94700 1 --2- 172.21.15.115:0/3210206839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cd40fcfd0 0x7f2cd40fd440 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8004940 tx=0x7f2cc8009e30 comp rx=0 tx=0).stop 2024-04-16T14:31:40.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.479+0000 7f2cd9d94700 1 -- 172.21.15.115:0/3210206839 shutdown_connections 2024-04-16T14:31:40.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.479+0000 7f2cd9d94700 1 --2- 172.21.15.115:0/3210206839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cd40fcfd0 0x7f2cd40fd440 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:40.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.479+0000 7f2cd9d94700 1 --2- 172.21.15.115:0/3210206839 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cd40fbd20 0x7f2cd40fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:40.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.479+0000 7f2cd9d94700 1 -- 172.21.15.115:0/3210206839 >> 172.21.15.115:0/3210206839 conn(0x7f2cd40f7480 msgr2=0x7f2cd40f98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:40.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.479+0000 7f2cd9d94700 1 -- 172.21.15.115:0/3210206839 shutdown_connections 2024-04-16T14:31:40.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.479+0000 7f2cd9d94700 1 -- 172.21.15.115:0/3210206839 wait complete. 2024-04-16T14:31:40.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.480+0000 7f2cd9d94700 1 Processor -- start 2024-04-16T14:31:40.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.480+0000 7f2cd9d94700 1 -- start start 2024-04-16T14:31:40.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.480+0000 7f2cd9d94700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cd40fbd20 0x7f2cd410d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:40.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.480+0000 7f2cd9d94700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cd40fcfd0 0x7f2cd410de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:40.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.480+0000 7f2cd9d94700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd410e4d0 con 0x7f2cd40fbd20 2024-04-16T14:31:40.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.480+0000 7f2cd9d94700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd4112e70 con 0x7f2cd40fcfd0 2024-04-16T14:31:40.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.480+0000 7f2cd2ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cd40fcfd0 0x7f2cd410de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:40.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.480+0000 7f2cd2ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cd40fcfd0 0x7f2cd410de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39516/0 (socket says 172.21.15.115:39516) 2024-04-16T14:31:40.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.480+0000 7f2cd2ffd700 1 -- 172.21.15.115:0/1875922317 learned_addr learned my addr 172.21.15.115:0/1875922317 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-04-16T14:31:40.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.481+0000 7f2cd37fe700 1 --2- 172.21.15.115:0/1875922317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cd40fbd20 0x7f2cd410d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:40.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.481+0000 7f2cd2ffd700 1 -- 172.21.15.115:0/1875922317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cd40fbd20 msgr2=0x7f2cd410d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:40.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.481+0000 7f2cd2ffd700 1 --2- 172.21.15.115:0/1875922317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cd40fbd20 0x7f2cd410d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:40.480 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.481+0000 7f2cd2ffd700 1 -- 172.21.15.115:0/1875922317 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc8005040 con 0x7f2cd40fcfd0 2024-04-16T14:31:40.481 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.481+0000 7f2cd37fe700 1 --2- 172.21.15.115:0/1875922317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cd40fbd20 0x7f2cd410d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:31:40.481 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.481+0000 7f2cd2ffd700 1 --2- 172.21.15.115:0/1875922317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cd40fcfd0 0x7f2cd410de40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009150 tx=0x7f2cc8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:40.481 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.481+0000 7f2cbbfff700 1 -- 172.21.15.115:0/1875922317 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cc800e040 con 0x7f2cd40fcfd0 2024-04-16T14:31:40.481 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.481+0000 7f2cbbfff700 1 -- 172.21.15.115:0/1875922317 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2cc800bbf0 con 0x7f2cd40fcfd0 2024-04-16T14:31:40.481 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.481+0000 7f2cd9d94700 1 -- 172.21.15.115:0/1875922317 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd4113070 con 0x7f2cd40fcfd0 2024-04-16T14:31:40.481 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.481+0000 7f2cbbfff700 1 -- 172.21.15.115:0/1875922317 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cc801c630 con 0x7f2cd40fcfd0 2024-04-16T14:31:40.481 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.481+0000 7f2cd9d94700 1 -- 172.21.15.115:0/1875922317 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd41135e0 con 0x7f2cd40fcfd0 2024-04-16T14:31:40.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.482+0000 7f2cd9d94700 1 -- 172.21.15.115:0/1875922317 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd404c710 con 0x7f2cd40fcfd0 2024-04-16T14:31:40.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.483+0000 7f2cbbfff700 1 -- 172.21.15.115:0/1875922317 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f2cc800bd60 con 0x7f2cd40fcfd0 2024-04-16T14:31:40.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.483+0000 7f2cbbfff700 1 --2- 172.21.15.115:0/1875922317 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f2cbc0692b0 0x7f2cbc06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:40.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.483+0000 7f2cbbfff700 1 -- 172.21.15.115:0/1875922317 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2cc8088190 con 0x7f2cd40fcfd0 2024-04-16T14:31:40.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.483+0000 7f2cd37fe700 1 --2- 172.21.15.115:0/1875922317 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f2cbc0692b0 0x7f2cbc06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:40.482 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.484+0000 7f2cd37fe700 1 --2- 172.21.15.115:0/1875922317 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f2cbc0692b0 0x7f2cbc06b760 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4006fd0 tx=0x7f2cc4008040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:40.485 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.487+0000 7f2cbbfff700 1 -- 172.21.15.115:0/1875922317 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2cc8058330 con 0x7f2cd40fcfd0 2024-04-16T14:31:40.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.751+0000 7f2cd9d94700 1 -- 172.21.15.115:0/1875922317 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f2cd4066bf0 con 0x7f2cd40fcfd0 2024-04-16T14:31:40.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.756+0000 7f2cbbfff700 1 -- 172.21.15.115:0/1875922317 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f2cc8054020 con 0x7f2cd40fcfd0 2024-04-16T14:31:40.754 INFO:teuthology.orchestra.run.smithi115.stdout:[client.1] 2024-04-16T14:31:40.754 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQDMix5m++riLBAA3E/4jHCGoeRILWuCmgfatg== 2024-04-16T14:31:40.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.758+0000 7f2cd9d94700 1 -- 172.21.15.115:0/1875922317 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f2cbc0692b0 msgr2=0x7f2cbc06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:40.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.758+0000 7f2cd9d94700 1 --2- 172.21.15.115:0/1875922317 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f2cbc0692b0 0x7f2cbc06b760 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4006fd0 tx=0x7f2cc4008040 comp rx=0 tx=0).stop 2024-04-16T14:31:40.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.758+0000 7f2cd9d94700 1 -- 172.21.15.115:0/1875922317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cd40fcfd0 msgr2=0x7f2cd410de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:40.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.758+0000 7f2cd9d94700 1 --2- 172.21.15.115:0/1875922317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cd40fcfd0 0x7f2cd410de40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009150 tx=0x7f2cc8009e30 comp rx=0 tx=0).stop 2024-04-16T14:31:40.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.758+0000 7f2cd9d94700 1 -- 172.21.15.115:0/1875922317 shutdown_connections 2024-04-16T14:31:40.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.758+0000 7f2cd9d94700 1 --2- 172.21.15.115:0/1875922317 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f2cbc0692b0 0x7f2cbc06b760 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:40.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.758+0000 7f2cd9d94700 1 --2- 172.21.15.115:0/1875922317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cd40fbd20 0x7f2cd410d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:40.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.758+0000 7f2cd9d94700 1 --2- 172.21.15.115:0/1875922317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cd40fcfd0 0x7f2cd410de40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:40.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.758+0000 7f2cd9d94700 1 -- 172.21.15.115:0/1875922317 >> 172.21.15.115:0/1875922317 conn(0x7f2cd40f7480 msgr2=0x7f2cd40f8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:40.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.759+0000 7f2cd9d94700 1 -- 172.21.15.115:0/1875922317 shutdown_connections 2024-04-16T14:31:40.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:31:40.759+0000 7f2cd9d94700 1 -- 172.21.15.115:0/1875922317 wait complete. 2024-04-16T14:31:41.160 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:40 smithi115 ceph-mon[37295]: from='client.? 172.21.15.115:0/1875922317' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-16T14:31:41.161 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:40 smithi115 ceph-mon[37295]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-16T14:31:41.161 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:40 smithi115 ceph-mon[37295]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-16T14:31:41.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:40 smithi005 ceph-mon[28964]: from='client.? 172.21.15.115:0/1875922317' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-16T14:31:41.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:40 smithi005 ceph-mon[28964]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-16T14:31:41.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:40 smithi005 ceph-mon[28964]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-16T14:31:41.421 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-16T14:31:41.422 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-04-16T14:31:41.422 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-16T14:31:41.467 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-16T14:31:41.467 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-16T14:31:41.467 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph mgr dump --format=json 2024-04-16T14:31:41.741 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:31:42.159 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:41 smithi005 ceph-mon[28964]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:42.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:41 smithi115 ceph-mon[37295]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:43.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.436+0000 7f7dbc0e1700 1 -- 172.21.15.5:0/1318049743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7db4102e20 msgr2=0x7f7db41031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:43.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.436+0000 7f7dbc0e1700 1 --2- 172.21.15.5:0/1318049743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7db4102e20 0x7f7db41031f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7da4009ce0 tx=0x7f7da4004d10 comp rx=0 tx=0).stop 2024-04-16T14:31:43.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.436+0000 7f7dbc0e1700 1 -- 172.21.15.5:0/1318049743 shutdown_connections 2024-04-16T14:31:43.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.436+0000 7f7dbc0e1700 1 --2- 172.21.15.5:0/1318049743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7db41037c0 0x7f7db40fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:43.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.436+0000 7f7dbc0e1700 1 --2- 172.21.15.5:0/1318049743 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7db4102e20 0x7f7db41031f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:43.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.436+0000 7f7dbc0e1700 1 -- 172.21.15.5:0/1318049743 >> 172.21.15.5:0/1318049743 conn(0x7f7db40f89b0 msgr2=0x7f7db40fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:43.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.436+0000 7f7dbc0e1700 1 -- 172.21.15.5:0/1318049743 shutdown_connections 2024-04-16T14:31:43.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.436+0000 7f7dbc0e1700 1 -- 172.21.15.5:0/1318049743 wait complete. 2024-04-16T14:31:43.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.436+0000 7f7dbc0e1700 1 Processor -- start 2024-04-16T14:31:43.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.437+0000 7f7dbc0e1700 1 -- start start 2024-04-16T14:31:43.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.437+0000 7f7dbc0e1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7db4102e20 0x7f7db40702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:43.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.437+0000 7f7dbc0e1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7db41037c0 0x7f7db4070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:43.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.437+0000 7f7dbc0e1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db4072210 con 0x7f7db4102e20 2024-04-16T14:31:43.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.437+0000 7f7dbc0e1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db4070d40 con 0x7f7db41037c0 2024-04-16T14:31:43.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.437+0000 7f7db9e7d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7db4102e20 0x7f7db40702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:43.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.437+0000 7f7db9e7d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7db4102e20 0x7f7db40702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57730/0 (socket says 172.21.15.5:57730) 2024-04-16T14:31:43.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.437+0000 7f7db9e7d700 1 -- 172.21.15.5:0/4092516618 learned_addr learned my addr 172.21.15.5:0/4092516618 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:31:43.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.437+0000 7f7db967c700 1 --2- 172.21.15.5:0/4092516618 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7db41037c0 0x7f7db4070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:43.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.437+0000 7f7db9e7d700 1 -- 172.21.15.5:0/4092516618 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7db41037c0 msgr2=0x7f7db4070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:43.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.437+0000 7f7db9e7d700 1 --2- 172.21.15.5:0/4092516618 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7db41037c0 0x7f7db4070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:43.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.437+0000 7f7db9e7d700 1 -- 172.21.15.5:0/4092516618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da4009940 con 0x7f7db4102e20 2024-04-16T14:31:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.437+0000 7f7db9e7d700 1 --2- 172.21.15.5:0/4092516618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7db4102e20 0x7f7db40702c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7da4003400 tx=0x7f7da4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.437+0000 7f7db27fc700 1 -- 172.21.15.5:0/4092516618 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7da400e040 con 0x7f7db4102e20 2024-04-16T14:31:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.437+0000 7f7db27fc700 1 -- 172.21.15.5:0/4092516618 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7da4004610 con 0x7f7db4102e20 2024-04-16T14:31:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.438+0000 7f7dbc0e1700 1 -- 172.21.15.5:0/4092516618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db4070fc0 con 0x7f7db4102e20 2024-04-16T14:31:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.438+0000 7f7db27fc700 1 -- 172.21.15.5:0/4092516618 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7da401c640 con 0x7f7db4102e20 2024-04-16T14:31:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.438+0000 7f7dbc0e1700 1 -- 172.21.15.5:0/4092516618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db411a2a0 con 0x7f7db4102e20 2024-04-16T14:31:43.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.439+0000 7f7dbc0e1700 1 -- 172.21.15.5:0/4092516618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db4100130 con 0x7f7db4102e20 2024-04-16T14:31:43.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.439+0000 7f7db27fc700 1 -- 172.21.15.5:0/4092516618 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f7da4012a70 con 0x7f7db4102e20 2024-04-16T14:31:43.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.439+0000 7f7db27fc700 1 --2- 172.21.15.5:0/4092516618 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f7d9c0692a0 0x7f7d9c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:43.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.439+0000 7f7db27fc700 1 -- 172.21.15.5:0/4092516618 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7da40887e0 con 0x7f7db4102e20 2024-04-16T14:31:43.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.439+0000 7f7db967c700 1 --2- 172.21.15.5:0/4092516618 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f7d9c0692a0 0x7f7d9c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:43.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.440+0000 7f7db967c700 1 --2- 172.21.15.5:0/4092516618 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f7d9c0692a0 0x7f7d9c06b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7db40719f0 tx=0x7f7da800b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:43.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.444+0000 7f7db27fc700 1 -- 172.21.15.5:0/4092516618 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7da4054e50 con 0x7f7db4102e20 2024-04-16T14:31:43.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.693+0000 7f7dbc0e1700 1 -- 172.21.15.5:0/4092516618 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f7db4109fa0 con 0x7f7db4102e20 2024-04-16T14:31:43.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.696+0000 7f7db27fc700 1 -- 172.21.15.5:0/4092516618 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+167170 (secure 0 0 0) 0x7f7da4004e10 con 0x7f7db4102e20 2024-04-16T14:31:43.697 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:31:43.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.699+0000 7f7dbc0e1700 1 -- 172.21.15.5:0/4092516618 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f7d9c0692a0 msgr2=0x7f7d9c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:43.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.699+0000 7f7dbc0e1700 1 --2- 172.21.15.5:0/4092516618 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f7d9c0692a0 0x7f7d9c06b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7db40719f0 tx=0x7f7da800b040 comp rx=0 tx=0).stop 2024-04-16T14:31:43.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.699+0000 7f7dbc0e1700 1 -- 172.21.15.5:0/4092516618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7db4102e20 msgr2=0x7f7db40702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:43.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.699+0000 7f7dbc0e1700 1 --2- 172.21.15.5:0/4092516618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7db4102e20 0x7f7db40702c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7da4003400 tx=0x7f7da4004d10 comp rx=0 tx=0).stop 2024-04-16T14:31:43.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.699+0000 7f7dbc0e1700 1 -- 172.21.15.5:0/4092516618 shutdown_connections 2024-04-16T14:31:43.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.699+0000 7f7dbc0e1700 1 --2- 172.21.15.5:0/4092516618 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f7d9c0692a0 0x7f7d9c06b750 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:43.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.699+0000 7f7dbc0e1700 1 --2- 172.21.15.5:0/4092516618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7db4102e20 0x7f7db40702c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:43.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.699+0000 7f7dbc0e1700 1 --2- 172.21.15.5:0/4092516618 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7db41037c0 0x7f7db4070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:43.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.699+0000 7f7dbc0e1700 1 -- 172.21.15.5:0/4092516618 >> 172.21.15.5:0/4092516618 conn(0x7f7db40f89b0 msgr2=0x7f7db4107410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:43.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.699+0000 7f7dbc0e1700 1 -- 172.21.15.5:0/4092516618 shutdown_connections 2024-04-16T14:31:43.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:43.699+0000 7f7dbc0e1700 1 -- 172.21.15.5:0/4092516618 wait complete. 2024-04-16T14:31:43.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:43 smithi005 ceph-mon[28964]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:43.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:43 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/4092516618' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-16T14:31:44.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:43 smithi115 ceph-mon[37295]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:44.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:43 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/4092516618' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-16T14:31:44.401 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":19,"flags":0,"active_gid":14212,"active_name":"smithi005.ipwdkc","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3841652776},{"type":"v1","addr":"172.21.15.5:6801","nonce":3841652776}]},"active_addr":"172.21.15.5:6801/3841652776","active_change":"2024-04-16T14:28:02.662580+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14232,"name":"smithi115.brjkpo","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.5:8443/","prometheus":"http://172.21.15.5:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":3602505234}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":4125351321}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":2010393498}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":3063530168}]}]} 2024-04-16T14:31:44.407 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-16T14:31:44.407 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-16T14:31:44.407 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph osd dump --format=json 2024-04-16T14:31:44.677 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:31:46.061 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:45 smithi005 ceph-mon[28964]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:46.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:45 smithi115 ceph-mon[37295]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.394+0000 7f024da99700 1 -- 172.21.15.5:0/1662287198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0248102e20 msgr2=0x7f02481031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.394+0000 7f024da99700 1 --2- 172.21.15.5:0/1662287198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0248102e20 0x7f02481031f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0238004940 tx=0x7f0238009e30 comp rx=0 tx=0).stop 2024-04-16T14:31:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.394+0000 7f024da99700 1 -- 172.21.15.5:0/1662287198 shutdown_connections 2024-04-16T14:31:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.394+0000 7f024da99700 1 --2- 172.21.15.5:0/1662287198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02481037c0 0x7f02480fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.394+0000 7f024da99700 1 --2- 172.21.15.5:0/1662287198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0248102e20 0x7f02481031f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.394+0000 7f024da99700 1 -- 172.21.15.5:0/1662287198 >> 172.21.15.5:0/1662287198 conn(0x7f02480f89b0 msgr2=0x7f02480fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:46.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.395+0000 7f024da99700 1 -- 172.21.15.5:0/1662287198 shutdown_connections 2024-04-16T14:31:46.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.395+0000 7f024da99700 1 -- 172.21.15.5:0/1662287198 wait complete. 2024-04-16T14:31:46.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.395+0000 7f024da99700 1 Processor -- start 2024-04-16T14:31:46.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.395+0000 7f024da99700 1 -- start start 2024-04-16T14:31:46.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.395+0000 7f024da99700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0248102e20 0x7f02480702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.395+0000 7f024da99700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02481037c0 0x7f0248070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.395+0000 7f024da99700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02480721c0 con 0x7f0248102e20 2024-04-16T14:31:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.395+0000 7f024da99700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0248070d40 con 0x7f02481037c0 2024-04-16T14:31:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.396+0000 7f02477fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0248102e20 0x7f02480702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.396+0000 7f02477fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0248102e20 0x7f02480702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:57750/0 (socket says 172.21.15.5:57750) 2024-04-16T14:31:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.396+0000 7f02477fe700 1 -- 172.21.15.5:0/4158394154 learned_addr learned my addr 172.21.15.5:0/4158394154 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:31:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.396+0000 7f0246ffd700 1 --2- 172.21.15.5:0/4158394154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02481037c0 0x7f0248070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.396+0000 7f02477fe700 1 -- 172.21.15.5:0/4158394154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02481037c0 msgr2=0x7f0248070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.396+0000 7f02477fe700 1 --2- 172.21.15.5:0/4158394154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02481037c0 0x7f0248070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.396+0000 7f02477fe700 1 -- 172.21.15.5:0/4158394154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0238005040 con 0x7f0248102e20 2024-04-16T14:31:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.396+0000 7f02477fe700 1 --2- 172.21.15.5:0/4158394154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0248102e20 0x7f02480702c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f023800b3b0 tx=0x7f0238009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.396+0000 7f022ffff700 1 -- 172.21.15.5:0/4158394154 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f023800e040 con 0x7f0248102e20 2024-04-16T14:31:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.396+0000 7f022ffff700 1 -- 172.21.15.5:0/4158394154 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f023800bbc0 con 0x7f0248102e20 2024-04-16T14:31:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.396+0000 7f024da99700 1 -- 172.21.15.5:0/4158394154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0248070fc0 con 0x7f0248102e20 2024-04-16T14:31:46.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.396+0000 7f022ffff700 1 -- 172.21.15.5:0/4158394154 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f023801c630 con 0x7f0248102e20 2024-04-16T14:31:46.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.396+0000 7f024da99700 1 -- 172.21.15.5:0/4158394154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f024811a150 con 0x7f0248102e20 2024-04-16T14:31:46.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.397+0000 7f024da99700 1 -- 172.21.15.5:0/4158394154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0248100130 con 0x7f0248102e20 2024-04-16T14:31:46.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.398+0000 7f022ffff700 1 -- 172.21.15.5:0/4158394154 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f023800bd30 con 0x7f0248102e20 2024-04-16T14:31:46.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.398+0000 7f022ffff700 1 --2- 172.21.15.5:0/4158394154 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f02300692a0 0x7f023006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.398+0000 7f022ffff700 1 -- 172.21.15.5:0/4158394154 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0238088000 con 0x7f0248102e20 2024-04-16T14:31:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.398+0000 7f0246ffd700 1 --2- 172.21.15.5:0/4158394154 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f02300692a0 0x7f023006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:46.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.399+0000 7f0246ffd700 1 --2- 172.21.15.5:0/4158394154 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f02300692a0 0x7f023006b750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f023c007fd0 tx=0x7f023c009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:46.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.403+0000 7f022ffff700 1 -- 172.21.15.5:0/4158394154 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0238054710 con 0x7f0248102e20 2024-04-16T14:31:46.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.597+0000 7f024da99700 1 -- 172.21.15.5:0/4158394154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02480fe570 con 0x7f0248102e20 2024-04-16T14:31:46.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.597+0000 7f022ffff700 1 -- 172.21.15.5:0/4158394154 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11021 (secure 0 0 0) 0x7f0238057d30 con 0x7f0248102e20 2024-04-16T14:31:46.596 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:31:46.596 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":41,"fsid":"10609bfa-fbfd-11ee-bc90-c7b262605968","created":"2024-04-16T14:25:45.190718+0000","modified":"2024-04-16T14:31:27.658744+0000","last_up_change":"2024-04-16T14:31:26.654027+0000","last_in_change":"2024-04-16T14:31:07.952511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T14:30:12.985367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"aa9fa9e4-bdd2-42c5-ba51-8d141fa9c4c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2400102721},{"type":"v1","addr":"172.21.15.5:6803","nonce":2400102721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2400102721},{"type":"v1","addr":"172.21.15.5:6805","nonce":2400102721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2400102721},{"type":"v1","addr":"172.21.15.5:6809","nonce":2400102721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2400102721},{"type":"v1","addr":"172.21.15.5:6807","nonce":2400102721}]},"public_addr":"172.21.15.5:6803/2400102721","cluster_addr":"172.21.15.5:6805/2400102721","heartbeat_back_addr":"172.21.15.5:6809/2400102721","heartbeat_front_addr":"172.21.15.5:6807/2400102721","state":["exists","up"]},{"osd":1,"uuid":"d4074765-a246-412a-8b68-8da402adc7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":755259206},{"type":"v1","addr":"172.21.15.5:6811","nonce":755259206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":755259206},{"type":"v1","addr":"172.21.15.5:6813","nonce":755259206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":755259206},{"type":"v1","addr":"172.21.15.5:6817","nonce":755259206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":755259206},{"type":"v1","addr":"172.21.15.5:6815","nonce":755259206}]},"public_addr":"172.21.15.5:6811/755259206","cluster_addr":"172.21.15.5:6813/755259206","heartbeat_back_addr":"172.21.15.5:6817/755259206","heartbeat_front_addr":"172.21.15.5:6815/755259206","state":["exists","up"]},{"osd":2,"uuid":"1851758c-0015-4f54-b4b8-30c1424394ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2907807829},{"type":"v1","addr":"172.21.15.5:6819","nonce":2907807829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2907807829},{"type":"v1","addr":"172.21.15.5:6821","nonce":2907807829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":2907807829},{"type":"v1","addr":"172.21.15.5:6825","nonce":2907807829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2907807829},{"type":"v1","addr":"172.21.15.5:6823","nonce":2907807829}]},"public_addr":"172.21.15.5:6819/2907807829","cluster_addr":"172.21.15.5:6821/2907807829","heartbeat_back_addr":"172.21.15.5:6825/2907807829","heartbeat_front_addr":"172.21.15.5:6823/2907807829","state":["exists","up"]},{"osd":3,"uuid":"ab6404e2-5cef-4a8a-8b93-a24914c67fc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2081173791},{"type":"v1","addr":"172.21.15.115:6801","nonce":2081173791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2081173791},{"type":"v1","addr":"172.21.15.115:6803","nonce":2081173791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2081173791},{"type":"v1","addr":"172.21.15.115:6807","nonce":2081173791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2081173791},{"type":"v1","addr":"172.21.15.115:6805","nonce":2081173791}]},"public_addr":"172.21.15.115:6801/2081173791","cluster_addr":"172.21.15.115:6803/2081173791","heartbeat_back_addr":"172.21.15.115:6807/2081173791","heartbeat_front_addr":"172.21.15.115:6805/2081173791","state":["exists","up"]},{"osd":4,"uuid":"4252814c-6811-4b53-a8be-cd65d7aa39a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":3982965260},{"type":"v1","addr":"172.21.15.115:6809","nonce":3982965260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":3982965260},{"type":"v1","addr":"172.21.15.115:6811","nonce":3982965260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":3982965260},{"type":"v1","addr":"172.21.15.115:6815","nonce":3982965260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":3982965260},{"type":"v1","addr":"172.21.15.115:6813","nonce":3982965260}]},"public_addr":"172.21.15.115:6809/3982965260","cluster_addr":"172.21.15.115:6811/3982965260","heartbeat_back_addr":"172.21.15.115:6815/3982965260","heartbeat_front_addr":"172.21.15.115:6813/3982965260","state":["exists","up"]},{"osd":5,"uuid":"124732a1-f6a0-462e-bd5e-2bcd743ab2a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":448370235},{"type":"v1","addr":"172.21.15.115:6817","nonce":448370235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":448370235},{"type":"v1","addr":"172.21.15.115:6819","nonce":448370235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":448370235},{"type":"v1","addr":"172.21.15.115:6823","nonce":448370235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":448370235},{"type":"v1","addr":"172.21.15.115:6821","nonce":448370235}]},"public_addr":"172.21.15.115:6817/448370235","cluster_addr":"172.21.15.115:6819/448370235","heartbeat_back_addr":"172.21.15.115:6823/448370235","heartbeat_front_addr":"172.21.15.115:6821/448370235","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:29:14.299546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:29:41.658611+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:30:10.127883+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:30:33.310873+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:30:59.158923+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:31:24.898158+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/4176454319":"2024-04-17T14:28:02.662455+0000","172.21.15.5:6800/4176454319":"2024-04-17T14:28:02.662455+0000","172.21.15.5:0/3767913866":"2024-04-17T14:28:02.662455+0000","172.21.15.5:6800/4088193218":"2024-04-17T14:26:48.930147+0000","172.21.15.5:0/801827499":"2024-04-17T14:26:48.930147+0000","172.21.15.5:0/3364969045":"2024-04-17T14:26:48.930147+0000","172.21.15.5:6800/1086445367":"2024-04-17T14:26:17.425567+0000","172.21.15.5:0/2653432440":"2024-04-17T14:28:02.662455+0000","172.21.15.5:0/3710869010":"2024-04-17T14:26:17.425567+0000","172.21.15.5:0/2384405072":"2024-04-17T14:26:17.425567+0000","172.21.15.5:0/2015079913":"2024-04-17T14:26:17.425567+0000","172.21.15.5:6801/1086445367":"2024-04-17T14:26:17.425567+0000","172.21.15.5:0/1548281910":"2024-04-17T14:28:02.662455+0000","172.21.15.5:6801/4088193218":"2024-04-17T14:26:48.930147+0000","172.21.15.5:0/2013882368":"2024-04-17T14:26:48.930147+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T14:31:46.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.599+0000 7f024da99700 1 -- 172.21.15.5:0/4158394154 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f02300692a0 msgr2=0x7f023006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:46.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.599+0000 7f024da99700 1 --2- 172.21.15.5:0/4158394154 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f02300692a0 0x7f023006b750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f023c007fd0 tx=0x7f023c009040 comp rx=0 tx=0).stop 2024-04-16T14:31:46.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.599+0000 7f024da99700 1 -- 172.21.15.5:0/4158394154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0248102e20 msgr2=0x7f02480702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:46.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.599+0000 7f024da99700 1 --2- 172.21.15.5:0/4158394154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0248102e20 0x7f02480702c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f023800b3b0 tx=0x7f0238009e30 comp rx=0 tx=0).stop 2024-04-16T14:31:46.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.599+0000 7f024da99700 1 -- 172.21.15.5:0/4158394154 shutdown_connections 2024-04-16T14:31:46.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.599+0000 7f024da99700 1 --2- 172.21.15.5:0/4158394154 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f02300692a0 0x7f023006b750 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:46.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.599+0000 7f024da99700 1 --2- 172.21.15.5:0/4158394154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0248102e20 0x7f02480702c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:46.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.599+0000 7f024da99700 1 --2- 172.21.15.5:0/4158394154 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02481037c0 0x7f0248070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:46.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.600+0000 7f024da99700 1 -- 172.21.15.5:0/4158394154 >> 172.21.15.5:0/4158394154 conn(0x7f02480f89b0 msgr2=0x7f02481073c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:46.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.600+0000 7f024da99700 1 -- 172.21.15.5:0/4158394154 shutdown_connections 2024-04-16T14:31:46.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:46.600+0000 7f024da99700 1 -- 172.21.15.5:0/4158394154 wait complete. 2024-04-16T14:31:47.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:46 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/4158394154' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-16T14:31:47.218 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:46 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/4158394154' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-16T14:31:47.246 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-16T14:31:47.246 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph osd dump --format=json 2024-04-16T14:31:47.511 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:31:48.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:47 smithi115 ceph-mon[37295]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:48.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:47 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:31:48.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:47 smithi005 ceph-mon[28964]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:48.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:47 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:31:49.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.157+0000 7f9a359b0700 1 -- 172.21.15.5:0/803993239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a30102f60 msgr2=0x7f9a30103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:49.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.157+0000 7f9a359b0700 1 --2- 172.21.15.5:0/803993239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a30102f60 0x7f9a30103330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9a20004940 tx=0x7f9a20009e30 comp rx=0 tx=0).stop 2024-04-16T14:31:49.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.157+0000 7f9a359b0700 1 -- 172.21.15.5:0/803993239 shutdown_connections 2024-04-16T14:31:49.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.157+0000 7f9a359b0700 1 --2- 172.21.15.5:0/803993239 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a300fb4d0 0x7f9a300fb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:49.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.157+0000 7f9a359b0700 1 --2- 172.21.15.5:0/803993239 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a30102f60 0x7f9a30103330 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:49.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.157+0000 7f9a359b0700 1 -- 172.21.15.5:0/803993239 >> 172.21.15.5:0/803993239 conn(0x7f9a300714c0 msgr2=0x7f9a300718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:49.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.157+0000 7f9a359b0700 1 -- 172.21.15.5:0/803993239 shutdown_connections 2024-04-16T14:31:49.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.157+0000 7f9a359b0700 1 -- 172.21.15.5:0/803993239 wait complete. 2024-04-16T14:31:49.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.157+0000 7f9a359b0700 1 Processor -- start 2024-04-16T14:31:49.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.157+0000 7f9a359b0700 1 -- start start 2024-04-16T14:31:49.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.158+0000 7f9a359b0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a300fb4d0 0x7f9a300fc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.158+0000 7f9a359b0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a30102f60 0x7f9a300fcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.158+0000 7f9a359b0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a300fe640 con 0x7f9a300fb4d0 2024-04-16T14:31:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.158+0000 7f9a359b0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a300fd130 con 0x7f9a30102f60 2024-04-16T14:31:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.158+0000 7f9a2effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a300fb4d0 0x7f9a300fc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.158+0000 7f9a2effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a300fb4d0 0x7f9a300fc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51308/0 (socket says 172.21.15.5:51308) 2024-04-16T14:31:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.158+0000 7f9a2effd700 1 -- 172.21.15.5:0/1822318873 learned_addr learned my addr 172.21.15.5:0/1822318873 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:31:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.158+0000 7f9a2e7fc700 1 --2- 172.21.15.5:0/1822318873 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a30102f60 0x7f9a300fcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.158+0000 7f9a2effd700 1 -- 172.21.15.5:0/1822318873 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a30102f60 msgr2=0x7f9a300fcbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.158+0000 7f9a2effd700 1 --2- 172.21.15.5:0/1822318873 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a30102f60 0x7f9a300fcbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.158+0000 7f9a2effd700 1 -- 172.21.15.5:0/1822318873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a20005040 con 0x7f9a300fb4d0 2024-04-16T14:31:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.158+0000 7f9a2effd700 1 --2- 172.21.15.5:0/1822318873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a300fb4d0 0x7f9a300fc6b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000b3b0 tx=0x7f9a20009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.158+0000 7f9a177fe700 1 -- 172.21.15.5:0/1822318873 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a2000e040 con 0x7f9a300fb4d0 2024-04-16T14:31:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.158+0000 7f9a177fe700 1 -- 172.21.15.5:0/1822318873 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a2000bbc0 con 0x7f9a300fb4d0 2024-04-16T14:31:49.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.158+0000 7f9a359b0700 1 -- 172.21.15.5:0/1822318873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a300fd3b0 con 0x7f9a300fb4d0 2024-04-16T14:31:49.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.158+0000 7f9a177fe700 1 -- 172.21.15.5:0/1822318873 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a2001c3f0 con 0x7f9a300fb4d0 2024-04-16T14:31:49.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.159+0000 7f9a359b0700 1 -- 172.21.15.5:0/1822318873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3011a160 con 0x7f9a300fb4d0 2024-04-16T14:31:49.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.159+0000 7f9a359b0700 1 -- 172.21.15.5:0/1822318873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a30100200 con 0x7f9a300fb4d0 2024-04-16T14:31:49.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.160+0000 7f9a177fe700 1 -- 172.21.15.5:0/1822318873 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f9a2000bd30 con 0x7f9a300fb4d0 2024-04-16T14:31:49.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.160+0000 7f9a177fe700 1 --2- 172.21.15.5:0/1822318873 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f9a180692a0 0x7f9a1806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:49.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.160+0000 7f9a177fe700 1 -- 172.21.15.5:0/1822318873 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9a20088030 con 0x7f9a300fb4d0 2024-04-16T14:31:49.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.160+0000 7f9a2e7fc700 1 --2- 172.21.15.5:0/1822318873 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f9a180692a0 0x7f9a1806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:49.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.161+0000 7f9a2e7fc700 1 --2- 172.21.15.5:0/1822318873 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f9a180692a0 0x7f9a1806b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9a24006fd0 tx=0x7f9a24008040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:49.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.165+0000 7f9a177fe700 1 -- 172.21.15.5:0/1822318873 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9a20054750 con 0x7f9a300fb4d0 2024-04-16T14:31:49.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.362+0000 7f9a359b0700 1 -- 172.21.15.5:0/1822318873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a3004c710 con 0x7f9a300fb4d0 2024-04-16T14:31:49.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.363+0000 7f9a177fe700 1 -- 172.21.15.5:0/1822318873 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11021 (secure 0 0 0) 0x7f9a20057d70 con 0x7f9a300fb4d0 2024-04-16T14:31:49.361 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:31:49.362 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":41,"fsid":"10609bfa-fbfd-11ee-bc90-c7b262605968","created":"2024-04-16T14:25:45.190718+0000","modified":"2024-04-16T14:31:27.658744+0000","last_up_change":"2024-04-16T14:31:26.654027+0000","last_in_change":"2024-04-16T14:31:07.952511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T14:30:12.985367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"aa9fa9e4-bdd2-42c5-ba51-8d141fa9c4c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2400102721},{"type":"v1","addr":"172.21.15.5:6803","nonce":2400102721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2400102721},{"type":"v1","addr":"172.21.15.5:6805","nonce":2400102721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2400102721},{"type":"v1","addr":"172.21.15.5:6809","nonce":2400102721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2400102721},{"type":"v1","addr":"172.21.15.5:6807","nonce":2400102721}]},"public_addr":"172.21.15.5:6803/2400102721","cluster_addr":"172.21.15.5:6805/2400102721","heartbeat_back_addr":"172.21.15.5:6809/2400102721","heartbeat_front_addr":"172.21.15.5:6807/2400102721","state":["exists","up"]},{"osd":1,"uuid":"d4074765-a246-412a-8b68-8da402adc7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":755259206},{"type":"v1","addr":"172.21.15.5:6811","nonce":755259206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":755259206},{"type":"v1","addr":"172.21.15.5:6813","nonce":755259206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":755259206},{"type":"v1","addr":"172.21.15.5:6817","nonce":755259206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":755259206},{"type":"v1","addr":"172.21.15.5:6815","nonce":755259206}]},"public_addr":"172.21.15.5:6811/755259206","cluster_addr":"172.21.15.5:6813/755259206","heartbeat_back_addr":"172.21.15.5:6817/755259206","heartbeat_front_addr":"172.21.15.5:6815/755259206","state":["exists","up"]},{"osd":2,"uuid":"1851758c-0015-4f54-b4b8-30c1424394ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2907807829},{"type":"v1","addr":"172.21.15.5:6819","nonce":2907807829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2907807829},{"type":"v1","addr":"172.21.15.5:6821","nonce":2907807829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":2907807829},{"type":"v1","addr":"172.21.15.5:6825","nonce":2907807829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2907807829},{"type":"v1","addr":"172.21.15.5:6823","nonce":2907807829}]},"public_addr":"172.21.15.5:6819/2907807829","cluster_addr":"172.21.15.5:6821/2907807829","heartbeat_back_addr":"172.21.15.5:6825/2907807829","heartbeat_front_addr":"172.21.15.5:6823/2907807829","state":["exists","up"]},{"osd":3,"uuid":"ab6404e2-5cef-4a8a-8b93-a24914c67fc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2081173791},{"type":"v1","addr":"172.21.15.115:6801","nonce":2081173791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2081173791},{"type":"v1","addr":"172.21.15.115:6803","nonce":2081173791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2081173791},{"type":"v1","addr":"172.21.15.115:6807","nonce":2081173791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2081173791},{"type":"v1","addr":"172.21.15.115:6805","nonce":2081173791}]},"public_addr":"172.21.15.115:6801/2081173791","cluster_addr":"172.21.15.115:6803/2081173791","heartbeat_back_addr":"172.21.15.115:6807/2081173791","heartbeat_front_addr":"172.21.15.115:6805/2081173791","state":["exists","up"]},{"osd":4,"uuid":"4252814c-6811-4b53-a8be-cd65d7aa39a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":3982965260},{"type":"v1","addr":"172.21.15.115:6809","nonce":3982965260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":3982965260},{"type":"v1","addr":"172.21.15.115:6811","nonce":3982965260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":3982965260},{"type":"v1","addr":"172.21.15.115:6815","nonce":3982965260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":3982965260},{"type":"v1","addr":"172.21.15.115:6813","nonce":3982965260}]},"public_addr":"172.21.15.115:6809/3982965260","cluster_addr":"172.21.15.115:6811/3982965260","heartbeat_back_addr":"172.21.15.115:6815/3982965260","heartbeat_front_addr":"172.21.15.115:6813/3982965260","state":["exists","up"]},{"osd":5,"uuid":"124732a1-f6a0-462e-bd5e-2bcd743ab2a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":448370235},{"type":"v1","addr":"172.21.15.115:6817","nonce":448370235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":448370235},{"type":"v1","addr":"172.21.15.115:6819","nonce":448370235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":448370235},{"type":"v1","addr":"172.21.15.115:6823","nonce":448370235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":448370235},{"type":"v1","addr":"172.21.15.115:6821","nonce":448370235}]},"public_addr":"172.21.15.115:6817/448370235","cluster_addr":"172.21.15.115:6819/448370235","heartbeat_back_addr":"172.21.15.115:6823/448370235","heartbeat_front_addr":"172.21.15.115:6821/448370235","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:29:14.299546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:29:41.658611+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:30:10.127883+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:30:33.310873+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:30:59.158923+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:31:24.898158+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/4176454319":"2024-04-17T14:28:02.662455+0000","172.21.15.5:6800/4176454319":"2024-04-17T14:28:02.662455+0000","172.21.15.5:0/3767913866":"2024-04-17T14:28:02.662455+0000","172.21.15.5:6800/4088193218":"2024-04-17T14:26:48.930147+0000","172.21.15.5:0/801827499":"2024-04-17T14:26:48.930147+0000","172.21.15.5:0/3364969045":"2024-04-17T14:26:48.930147+0000","172.21.15.5:6800/1086445367":"2024-04-17T14:26:17.425567+0000","172.21.15.5:0/2653432440":"2024-04-17T14:28:02.662455+0000","172.21.15.5:0/3710869010":"2024-04-17T14:26:17.425567+0000","172.21.15.5:0/2384405072":"2024-04-17T14:26:17.425567+0000","172.21.15.5:0/2015079913":"2024-04-17T14:26:17.425567+0000","172.21.15.5:6801/1086445367":"2024-04-17T14:26:17.425567+0000","172.21.15.5:0/1548281910":"2024-04-17T14:28:02.662455+0000","172.21.15.5:6801/4088193218":"2024-04-17T14:26:48.930147+0000","172.21.15.5:0/2013882368":"2024-04-17T14:26:48.930147+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T14:31:49.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.365+0000 7f9a359b0700 1 -- 172.21.15.5:0/1822318873 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f9a180692a0 msgr2=0x7f9a1806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:49.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.365+0000 7f9a359b0700 1 --2- 172.21.15.5:0/1822318873 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f9a180692a0 0x7f9a1806b750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9a24006fd0 tx=0x7f9a24008040 comp rx=0 tx=0).stop 2024-04-16T14:31:49.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.365+0000 7f9a359b0700 1 -- 172.21.15.5:0/1822318873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a300fb4d0 msgr2=0x7f9a300fc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.365+0000 7f9a359b0700 1 --2- 172.21.15.5:0/1822318873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a300fb4d0 0x7f9a300fc6b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000b3b0 tx=0x7f9a20009e30 comp rx=0 tx=0).stop 2024-04-16T14:31:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.365+0000 7f9a359b0700 1 -- 172.21.15.5:0/1822318873 shutdown_connections 2024-04-16T14:31:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.365+0000 7f9a359b0700 1 --2- 172.21.15.5:0/1822318873 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f9a180692a0 0x7f9a1806b750 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.365+0000 7f9a359b0700 1 --2- 172.21.15.5:0/1822318873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9a300fb4d0 0x7f9a300fc6b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.365+0000 7f9a359b0700 1 --2- 172.21.15.5:0/1822318873 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a30102f60 0x7f9a300fcbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.365+0000 7f9a359b0700 1 -- 172.21.15.5:0/1822318873 >> 172.21.15.5:0/1822318873 conn(0x7f9a300714c0 msgr2=0x7f9a300fa5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.366+0000 7f9a359b0700 1 -- 172.21.15.5:0/1822318873 shutdown_connections 2024-04-16T14:31:49.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:49.366+0000 7f9a359b0700 1 -- 172.21.15.5:0/1822318873 wait complete. 2024-04-16T14:31:49.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:49 smithi005 ceph-mon[28964]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:49.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:49 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/1822318873' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-16T14:31:50.026 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-16T14:31:50.027 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-16T14:31:50.028 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-16T14:31:50.028 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-16T14:31:50.029 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-16T14:31:50.029 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-16T14:31:50.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:49 smithi115 ceph-mon[37295]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:50.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:49 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/1822318873' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-16T14:31:50.372 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:31:50.389 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:31:52.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:51 smithi115 ceph-mon[37295]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:52.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:51 smithi005 ceph-mon[28964]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:31:52.317 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:31:52.318 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:31:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:31:54.159 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:53 smithi005 ceph-mon[28964]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:54.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:53 smithi115 ceph-mon[37295]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.438+0000 7f20b5ac0700 1 -- 172.21.15.5:0/1751966077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20b00656b0 msgr2=0x7f20b0065a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.438+0000 7f20b5ac0700 1 --2- 172.21.15.5:0/1751966077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20b00656b0 0x7f20b0065a80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f20a0009ce0 tx=0x7f20a0004d10 comp rx=0 tx=0).stop 2024-04-16T14:31:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.438+0000 7f20b5ac0700 1 -- 172.21.15.5:0/1751966077 shutdown_connections 2024-04-16T14:31:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.438+0000 7f20b5ac0700 1 --2- 172.21.15.5:0/1751966077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20b0065fc0 0x7f20b01092f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.438+0000 7f20b5ac0700 1 --2- 172.21.15.5:0/1751966077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20b00656b0 0x7f20b0065a80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.438+0000 7f20b5ac0700 1 -- 172.21.15.5:0/1751966077 >> 172.21.15.5:0/1751966077 conn(0x7f20b0072bc0 msgr2=0x7f20b0072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.438+0000 7f20b5ac0700 1 -- 172.21.15.5:0/1751966077 shutdown_connections 2024-04-16T14:31:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.438+0000 7f20b5ac0700 1 -- 172.21.15.5:0/1751966077 wait complete. 2024-04-16T14:31:55.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.439+0000 7f20b5ac0700 1 Processor -- start 2024-04-16T14:31:55.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.439+0000 7f20b5ac0700 1 -- start start 2024-04-16T14:31:55.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.439+0000 7f20b5ac0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20b00656b0 0x7f20b0115d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:55.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.439+0000 7f20b5ac0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20b0065fc0 0x7f20b0116290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:55.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.439+0000 7f20b5ac0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b0116970 con 0x7f20b00656b0 2024-04-16T14:31:55.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.439+0000 7f20b5ac0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b010fcb0 con 0x7f20b0065fc0 2024-04-16T14:31:55.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.439+0000 7f20af7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20b00656b0 0x7f20b0115d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:55.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.439+0000 7f20af7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20b00656b0 0x7f20b0115d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51324/0 (socket says 172.21.15.5:51324) 2024-04-16T14:31:55.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.439+0000 7f20af7fe700 1 -- 172.21.15.5:0/1914733324 learned_addr learned my addr 172.21.15.5:0/1914733324 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:31:55.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.440+0000 7f20aeffd700 1 --2- 172.21.15.5:0/1914733324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20b0065fc0 0x7f20b0116290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:55.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.440+0000 7f20af7fe700 1 -- 172.21.15.5:0/1914733324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20b0065fc0 msgr2=0x7f20b0116290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:55.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.440+0000 7f20af7fe700 1 --2- 172.21.15.5:0/1914733324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20b0065fc0 0x7f20b0116290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:55.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.440+0000 7f20af7fe700 1 -- 172.21.15.5:0/1914733324 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a0009940 con 0x7f20b00656b0 2024-04-16T14:31:55.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.440+0000 7f20aeffd700 1 --2- 172.21.15.5:0/1914733324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20b0065fc0 0x7f20b0116290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:31:55.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.440+0000 7f20af7fe700 1 --2- 172.21.15.5:0/1914733324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20b00656b0 0x7f20b0115d50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f20a000b740 tx=0x7f20a0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:55.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.440+0000 7f2097fff700 1 -- 172.21.15.5:0/1914733324 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20a000e040 con 0x7f20b00656b0 2024-04-16T14:31:55.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.440+0000 7f2097fff700 1 -- 172.21.15.5:0/1914733324 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f20a00128e0 con 0x7f20b00656b0 2024-04-16T14:31:55.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.440+0000 7f20b5ac0700 1 -- 172.21.15.5:0/1914733324 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b010fed0 con 0x7f20b00656b0 2024-04-16T14:31:55.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.440+0000 7f2097fff700 1 -- 172.21.15.5:0/1914733324 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20a001c7c0 con 0x7f20b00656b0 2024-04-16T14:31:55.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.440+0000 7f20b5ac0700 1 -- 172.21.15.5:0/1914733324 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b0110490 con 0x7f20b00656b0 2024-04-16T14:31:55.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.441+0000 7f20b5ac0700 1 -- 172.21.15.5:0/1914733324 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f20b0110970 con 0x7f20b00656b0 2024-04-16T14:31:55.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.442+0000 7f2097fff700 1 -- 172.21.15.5:0/1914733324 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f20a0012410 con 0x7f20b00656b0 2024-04-16T14:31:55.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.442+0000 7f2097fff700 1 --2- 172.21.15.5:0/1914733324 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f20980692a0 0x7f209806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:55.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.442+0000 7f2097fff700 1 -- 172.21.15.5:0/1914733324 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f20a0088c50 con 0x7f20b00656b0 2024-04-16T14:31:55.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.442+0000 7f20aeffd700 1 --2- 172.21.15.5:0/1914733324 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f20980692a0 0x7f209806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:55.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.442+0000 7f2097fff700 1 --2- 172.21.15.5:0/1914733324 >> [v2:172.21.15.115:6808/3982965260,v1:172.21.15.115:6809/3982965260] conn(0x7f209806ef70 0x7f2098071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:55.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.442+0000 7f2097fff700 1 -- 172.21.15.5:0/1914733324 --> [v2:172.21.15.115:6808/3982965260,v1:172.21.15.115:6809/3982965260] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2098071a30 con 0x7f209806ef70 2024-04-16T14:31:55.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.442+0000 7f2097fff700 1 -- 172.21.15.5:0/1914733324 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20a008e250 con 0x7f20b00656b0 2024-04-16T14:31:55.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.443+0000 7f20aeffd700 1 --2- 172.21.15.5:0/1914733324 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f20980692a0 0x7f209806b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f20a4006fd0 tx=0x7f20a4008040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:55.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.443+0000 7f20affff700 1 --2- 172.21.15.5:0/1914733324 >> [v2:172.21.15.115:6808/3982965260,v1:172.21.15.115:6809/3982965260] conn(0x7f209806ef70 0x7f2098071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:55.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.443+0000 7f20affff700 1 --2- 172.21.15.5:0/1914733324 >> [v2:172.21.15.115:6808/3982965260,v1:172.21.15.115:6809/3982965260] conn(0x7f209806ef70 0x7f2098071380 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:55.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.444+0000 7f2097fff700 1 -- 172.21.15.5:0/1914733324 <== osd.4 v2:172.21.15.115:6808/3982965260 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f2098071a30 con 0x7f209806ef70 2024-04-16T14:31:55.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.459+0000 7f20b5ac0700 1 -- 172.21.15.5:0/1914733324 --> [v2:172.21.15.115:6808/3982965260,v1:172.21.15.115:6809/3982965260] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f20b0110b30 con 0x7f209806ef70 2024-04-16T14:31:55.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.459+0000 7f2097fff700 1 -- 172.21.15.5:0/1914733324 <== osd.4 v2:172.21.15.115:6808/3982965260 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f20b0110b30 con 0x7f209806ef70 2024-04-16T14:31:55.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.460+0000 7f20b5ac0700 1 -- 172.21.15.5:0/1914733324 >> [v2:172.21.15.115:6808/3982965260,v1:172.21.15.115:6809/3982965260] conn(0x7f209806ef70 msgr2=0x7f2098071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:55.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.460+0000 7f20b5ac0700 1 --2- 172.21.15.5:0/1914733324 >> [v2:172.21.15.115:6808/3982965260,v1:172.21.15.115:6809/3982965260] conn(0x7f209806ef70 0x7f2098071380 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:55.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.460+0000 7f20b5ac0700 1 -- 172.21.15.5:0/1914733324 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f20980692a0 msgr2=0x7f209806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:55.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.460+0000 7f20b5ac0700 1 --2- 172.21.15.5:0/1914733324 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f20980692a0 0x7f209806b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f20a4006fd0 tx=0x7f20a4008040 comp rx=0 tx=0).stop 2024-04-16T14:31:55.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.460+0000 7f20b5ac0700 1 -- 172.21.15.5:0/1914733324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20b00656b0 msgr2=0x7f20b0115d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:55.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.460+0000 7f20b5ac0700 1 --2- 172.21.15.5:0/1914733324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20b00656b0 0x7f20b0115d50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f20a000b740 tx=0x7f20a0004d10 comp rx=0 tx=0).stop 2024-04-16T14:31:55.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.460+0000 7f20b5ac0700 1 -- 172.21.15.5:0/1914733324 shutdown_connections 2024-04-16T14:31:55.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.460+0000 7f20b5ac0700 1 --2- 172.21.15.5:0/1914733324 >> [v2:172.21.15.115:6808/3982965260,v1:172.21.15.115:6809/3982965260] conn(0x7f209806ef70 0x7f2098071380 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:55.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.460+0000 7f20b5ac0700 1 --2- 172.21.15.5:0/1914733324 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f20980692a0 0x7f209806b750 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:55.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.460+0000 7f20b5ac0700 1 --2- 172.21.15.5:0/1914733324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20b00656b0 0x7f20b0115d50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:55.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.460+0000 7f20b5ac0700 1 --2- 172.21.15.5:0/1914733324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20b0065fc0 0x7f20b0116290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:55.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.460+0000 7f20b5ac0700 1 -- 172.21.15.5:0/1914733324 >> 172.21.15.5:0/1914733324 conn(0x7f20b0072bc0 msgr2=0x7f20b00f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:55.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.460+0000 7f20b5ac0700 1 -- 172.21.15.5:0/1914733324 shutdown_connections 2024-04-16T14:31:55.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:55.460+0000 7f20b5ac0700 1 -- 172.21.15.5:0/1914733324 wait complete. 2024-04-16T14:31:56.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:55 smithi115 ceph-mon[37295]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:56.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:55 smithi005 ceph-mon[28964]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:58.034 INFO:teuthology.orchestra.run.smithi005.stdout:150323855373 2024-04-16T14:31:58.034 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-16T14:31:58.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:57 smithi115 ceph-mon[37295]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:58.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:57 smithi005 ceph-mon[28964]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:31:58.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.334+0000 7fc0b8d16700 1 -- 172.21.15.5:0/382476915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b4070300 msgr2=0x7fc0b40706d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:58.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.334+0000 7fc0b8d16700 1 --2- 172.21.15.5:0/382476915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b4070300 0x7fc0b40706d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4004970 tx=0x7fc0a4009e30 comp rx=0 tx=0).stop 2024-04-16T14:31:58.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.334+0000 7fc0b8d16700 1 -- 172.21.15.5:0/382476915 shutdown_connections 2024-04-16T14:31:58.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.334+0000 7fc0b8d16700 1 --2- 172.21.15.5:0/382476915 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0b4070c10 0x7fc0b4109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:58.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.334+0000 7fc0b8d16700 1 --2- 172.21.15.5:0/382476915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b4070300 0x7fc0b40706d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:58.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.334+0000 7fc0b8d16700 1 -- 172.21.15.5:0/382476915 >> 172.21.15.5:0/382476915 conn(0x7fc0b40f8980 msgr2=0x7fc0b40fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:58.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.334+0000 7fc0b8d16700 1 -- 172.21.15.5:0/382476915 shutdown_connections 2024-04-16T14:31:58.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.334+0000 7fc0b8d16700 1 -- 172.21.15.5:0/382476915 wait complete. 2024-04-16T14:31:58.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.334+0000 7fc0b8d16700 1 Processor -- start 2024-04-16T14:31:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.334+0000 7fc0b8d16700 1 -- start start 2024-04-16T14:31:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.334+0000 7fc0b8d16700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b4070300 0x7fc0b4115d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.334+0000 7fc0b8d16700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0b4070c10 0x7fc0b4116290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.335+0000 7fc0b8d16700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b41168e0 con 0x7fc0b4070300 2024-04-16T14:31:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.335+0000 7fc0b8d16700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b410fcb0 con 0x7fc0b4070c10 2024-04-16T14:31:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.335+0000 7fc0b259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b4070300 0x7fc0b4115d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.335+0000 7fc0b259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b4070300 0x7fc0b4115d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51342/0 (socket says 172.21.15.5:51342) 2024-04-16T14:31:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.335+0000 7fc0b259c700 1 -- 172.21.15.5:0/1793432352 learned_addr learned my addr 172.21.15.5:0/1793432352 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:31:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.335+0000 7fc0b259c700 1 -- 172.21.15.5:0/1793432352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0b4070c10 msgr2=0x7fc0b4116290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.335+0000 7fc0b259c700 1 --2- 172.21.15.5:0/1793432352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0b4070c10 0x7fc0b4116290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.335+0000 7fc0b259c700 1 -- 172.21.15.5:0/1793432352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a4005040 con 0x7fc0b4070300 2024-04-16T14:31:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.335+0000 7fc0b259c700 1 --2- 172.21.15.5:0/1793432352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b4070300 0x7fc0b4115d50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4000c00 tx=0x7fc0a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.335+0000 7fc0a2ffd700 1 -- 172.21.15.5:0/1793432352 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0a400e040 con 0x7fc0b4070300 2024-04-16T14:31:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.335+0000 7fc0a2ffd700 1 -- 172.21.15.5:0/1793432352 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc0a400bc10 con 0x7fc0b4070300 2024-04-16T14:31:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.335+0000 7fc0b8d16700 1 -- 172.21.15.5:0/1793432352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b410ff30 con 0x7fc0b4070300 2024-04-16T14:31:58.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.335+0000 7fc0a2ffd700 1 -- 172.21.15.5:0/1793432352 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0a401c3f0 con 0x7fc0b4070300 2024-04-16T14:31:58.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.335+0000 7fc0b8d16700 1 -- 172.21.15.5:0/1793432352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b4110470 con 0x7fc0b4070300 2024-04-16T14:31:58.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.336+0000 7fc0b8d16700 1 -- 172.21.15.5:0/1793432352 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc0b4110a10 con 0x7fc0b4070300 2024-04-16T14:31:58.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.337+0000 7fc0a2ffd700 1 -- 172.21.15.5:0/1793432352 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7fc0a400bd80 con 0x7fc0b4070300 2024-04-16T14:31:58.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.337+0000 7fc0a2ffd700 1 --2- 172.21.15.5:0/1793432352 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fc09c0692a0 0x7fc09c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:58.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.337+0000 7fc0a2ffd700 1 -- 172.21.15.5:0/1793432352 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc0a4088c80 con 0x7fc0b4070300 2024-04-16T14:31:58.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.337+0000 7fc0b1d9b700 1 --2- 172.21.15.5:0/1793432352 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fc09c0692a0 0x7fc09c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:58.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.337+0000 7fc0a2ffd700 1 --2- 172.21.15.5:0/1793432352 >> [v2:172.21.15.115:6800/2081173791,v1:172.21.15.115:6801/2081173791] conn(0x7fc09c06ef70 0x7fc09c071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:58.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.337+0000 7fc0a2ffd700 1 -- 172.21.15.5:0/1793432352 --> [v2:172.21.15.115:6800/2081173791,v1:172.21.15.115:6801/2081173791] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc09c071a30 con 0x7fc09c06ef70 2024-04-16T14:31:58.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.337+0000 7fc0a2ffd700 1 -- 172.21.15.5:0/1793432352 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0a4088fc0 con 0x7fc0b4070300 2024-04-16T14:31:58.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.338+0000 7fc0b1d9b700 1 --2- 172.21.15.5:0/1793432352 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fc09c0692a0 0x7fc09c06b750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc0b41115f0 tx=0x7fc0a8007cc0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:58.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.338+0000 7fc0b2d9d700 1 --2- 172.21.15.5:0/1793432352 >> [v2:172.21.15.115:6800/2081173791,v1:172.21.15.115:6801/2081173791] conn(0x7fc09c06ef70 0x7fc09c071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:58.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.338+0000 7fc0b2d9d700 1 --2- 172.21.15.5:0/1793432352 >> [v2:172.21.15.115:6800/2081173791,v1:172.21.15.115:6801/2081173791] conn(0x7fc09c06ef70 0x7fc09c071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:58.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.339+0000 7fc0a2ffd700 1 -- 172.21.15.5:0/1793432352 <== osd.3 v2:172.21.15.115:6800/2081173791 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fc09c071a30 con 0x7fc09c06ef70 2024-04-16T14:31:58.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.355+0000 7fc0b8d16700 1 -- 172.21.15.5:0/1793432352 --> [v2:172.21.15.115:6800/2081173791,v1:172.21.15.115:6801/2081173791] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc0b405e6c0 con 0x7fc09c06ef70 2024-04-16T14:31:58.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.355+0000 7fc0a2ffd700 1 -- 172.21.15.5:0/1793432352 <== osd.3 v2:172.21.15.115:6800/2081173791 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc0b405e6c0 con 0x7fc09c06ef70 2024-04-16T14:31:58.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.356+0000 7fc0b8d16700 1 -- 172.21.15.5:0/1793432352 >> [v2:172.21.15.115:6800/2081173791,v1:172.21.15.115:6801/2081173791] conn(0x7fc09c06ef70 msgr2=0x7fc09c071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:58.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.356+0000 7fc0b8d16700 1 --2- 172.21.15.5:0/1793432352 >> [v2:172.21.15.115:6800/2081173791,v1:172.21.15.115:6801/2081173791] conn(0x7fc09c06ef70 0x7fc09c071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:58.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.356+0000 7fc0b8d16700 1 -- 172.21.15.5:0/1793432352 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fc09c0692a0 msgr2=0x7fc09c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:58.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.356+0000 7fc0b8d16700 1 --2- 172.21.15.5:0/1793432352 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fc09c0692a0 0x7fc09c06b750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc0b41115f0 tx=0x7fc0a8007cc0 comp rx=0 tx=0).stop 2024-04-16T14:31:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.356+0000 7fc0b8d16700 1 -- 172.21.15.5:0/1793432352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b4070300 msgr2=0x7fc0b4115d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.356+0000 7fc0b8d16700 1 --2- 172.21.15.5:0/1793432352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b4070300 0x7fc0b4115d50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4000c00 tx=0x7fc0a4009e30 comp rx=0 tx=0).stop 2024-04-16T14:31:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.356+0000 7fc0b8d16700 1 -- 172.21.15.5:0/1793432352 shutdown_connections 2024-04-16T14:31:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.356+0000 7fc0b8d16700 1 --2- 172.21.15.5:0/1793432352 >> [v2:172.21.15.115:6800/2081173791,v1:172.21.15.115:6801/2081173791] conn(0x7fc09c06ef70 0x7fc09c071380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.356+0000 7fc0b8d16700 1 --2- 172.21.15.5:0/1793432352 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fc09c0692a0 0x7fc09c06b750 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.356+0000 7fc0b8d16700 1 --2- 172.21.15.5:0/1793432352 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b4070300 0x7fc0b4115d50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.356+0000 7fc0b8d16700 1 --2- 172.21.15.5:0/1793432352 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0b4070c10 0x7fc0b4116290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.356+0000 7fc0b8d16700 1 -- 172.21.15.5:0/1793432352 >> 172.21.15.5:0/1793432352 conn(0x7fc0b40f8980 msgr2=0x7fc0b4103130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.356+0000 7fc0b8d16700 1 -- 172.21.15.5:0/1793432352 shutdown_connections 2024-04-16T14:31:58.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:58.356+0000 7fc0b8d16700 1 -- 172.21.15.5:0/1793432352 wait complete. 2024-04-16T14:31:59.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.011+0000 7f73f7712700 1 -- 172.21.15.5:0/2394019517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f01003e0 msgr2=0x7f73f01007b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:59.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.011+0000 7f73f7712700 1 --2- 172.21.15.5:0/2394019517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f01003e0 0x7f73f01007b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f73ec004940 tx=0x7f73ec009e30 comp rx=0 tx=0).stop 2024-04-16T14:31:59.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.011+0000 7f73f7712700 1 -- 172.21.15.5:0/2394019517 shutdown_connections 2024-04-16T14:31:59.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.011+0000 7f73f7712700 1 --2- 172.21.15.5:0/2394019517 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73f00fb4e0 0x7f73f00fb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:59.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.011+0000 7f73f7712700 1 --2- 172.21.15.5:0/2394019517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f01003e0 0x7f73f01007b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:59.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.011+0000 7f73f7712700 1 -- 172.21.15.5:0/2394019517 >> 172.21.15.5:0/2394019517 conn(0x7f73f00714c0 msgr2=0x7f73f00718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:59.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.011+0000 7f73f7712700 1 -- 172.21.15.5:0/2394019517 shutdown_connections 2024-04-16T14:31:59.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.011+0000 7f73f7712700 1 -- 172.21.15.5:0/2394019517 wait complete. 2024-04-16T14:31:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.011+0000 7f73f7712700 1 Processor -- start 2024-04-16T14:31:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.011+0000 7f73f7712700 1 -- start start 2024-04-16T14:31:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.012+0000 7f73f7712700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73f00fb4e0 0x7f73f0113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.012+0000 7f73f7712700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f01003e0 0x7f73f01140e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.012+0000 7f73f7712700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f01147c0 con 0x7f73f01003e0 2024-04-16T14:31:59.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.012+0000 7f73f7712700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f010db40 con 0x7f73f00fb4e0 2024-04-16T14:31:59.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.012+0000 7f73f4cad700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f01003e0 0x7f73f01140e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:59.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.012+0000 7f73f4cad700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f01003e0 0x7f73f01140e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37892/0 (socket says 172.21.15.5:37892) 2024-04-16T14:31:59.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.012+0000 7f73f4cad700 1 -- 172.21.15.5:0/4188346653 learned_addr learned my addr 172.21.15.5:0/4188346653 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:31:59.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.012+0000 7f73f4cad700 1 -- 172.21.15.5:0/4188346653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73f00fb4e0 msgr2=0x7f73f0113ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:59.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.012+0000 7f73f4cad700 1 --2- 172.21.15.5:0/4188346653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73f00fb4e0 0x7f73f0113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:59.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.012+0000 7f73f4cad700 1 -- 172.21.15.5:0/4188346653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ec005040 con 0x7f73f01003e0 2024-04-16T14:31:59.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.012+0000 7f73f4cad700 1 --2- 172.21.15.5:0/4188346653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f01003e0 0x7f73f01140e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f73e000b790 tx=0x7f73e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:59.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.012+0000 7f73e5ffb700 1 -- 172.21.15.5:0/4188346653 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73e000f770 con 0x7f73f01003e0 2024-04-16T14:31:59.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.012+0000 7f73e5ffb700 1 -- 172.21.15.5:0/4188346653 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f73e000fda0 con 0x7f73f01003e0 2024-04-16T14:31:59.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.012+0000 7f73f7712700 1 -- 172.21.15.5:0/4188346653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f010de20 con 0x7f73f01003e0 2024-04-16T14:31:59.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.012+0000 7f73e5ffb700 1 -- 172.21.15.5:0/4188346653 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73e000d310 con 0x7f73f01003e0 2024-04-16T14:31:59.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.013+0000 7f73f7712700 1 -- 172.21.15.5:0/4188346653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f010e3e0 con 0x7f73f01003e0 2024-04-16T14:31:59.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.013+0000 7f73f7712700 1 -- 172.21.15.5:0/4188346653 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f73f010e960 con 0x7f73f01003e0 2024-04-16T14:31:59.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.014+0000 7f73e5ffb700 1 -- 172.21.15.5:0/4188346653 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f73e0010420 con 0x7f73f01003e0 2024-04-16T14:31:59.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.014+0000 7f73e5ffb700 1 --2- 172.21.15.5:0/4188346653 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f73dc0692a0 0x7f73dc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:59.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.015+0000 7f73e5ffb700 1 -- 172.21.15.5:0/4188346653 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f73e0086e80 con 0x7f73f01003e0 2024-04-16T14:31:59.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.015+0000 7f73f54ae700 1 --2- 172.21.15.5:0/4188346653 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f73dc0692a0 0x7f73dc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:59.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.015+0000 7f73e5ffb700 1 --2- 172.21.15.5:0/4188346653 >> [v2:172.21.15.5:6802/2400102721,v1:172.21.15.5:6803/2400102721] conn(0x7f73dc06ef70 0x7f73dc071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:59.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.015+0000 7f73e5ffb700 1 -- 172.21.15.5:0/4188346653 --> [v2:172.21.15.5:6802/2400102721,v1:172.21.15.5:6803/2400102721] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f73dc071a30 con 0x7f73dc06ef70 2024-04-16T14:31:59.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.015+0000 7f73e5ffb700 1 -- 172.21.15.5:0/4188346653 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73e008c4e0 con 0x7f73f01003e0 2024-04-16T14:31:59.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.015+0000 7f73f5caf700 1 --2- 172.21.15.5:0/4188346653 >> [v2:172.21.15.5:6802/2400102721,v1:172.21.15.5:6803/2400102721] conn(0x7f73dc06ef70 0x7f73dc071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:59.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.015+0000 7f73f54ae700 1 --2- 172.21.15.5:0/4188346653 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f73dc0692a0 0x7f73dc06b750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f73ec004f90 tx=0x7f73ec009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:59.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.015+0000 7f73f5caf700 1 --2- 172.21.15.5:0/4188346653 >> [v2:172.21.15.5:6802/2400102721,v1:172.21.15.5:6803/2400102721] conn(0x7f73dc06ef70 0x7f73dc071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:59.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.016+0000 7f73e5ffb700 1 -- 172.21.15.5:0/4188346653 <== osd.0 v2:172.21.15.5:6802/2400102721 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f73dc071a30 con 0x7f73dc06ef70 2024-04-16T14:31:59.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.031+0000 7f73f7712700 1 -- 172.21.15.5:0/4188346653 --> [v2:172.21.15.5:6802/2400102721,v1:172.21.15.5:6803/2400102721] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f73f005e6c0 con 0x7f73dc06ef70 2024-04-16T14:31:59.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.031+0000 7f73e5ffb700 1 -- 172.21.15.5:0/4188346653 <== osd.0 v2:172.21.15.5:6802/2400102721 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f73f005e6c0 con 0x7f73dc06ef70 2024-04-16T14:31:59.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.031+0000 7f73f7712700 1 -- 172.21.15.5:0/4188346653 >> [v2:172.21.15.5:6802/2400102721,v1:172.21.15.5:6803/2400102721] conn(0x7f73dc06ef70 msgr2=0x7f73dc071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:59.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.031+0000 7f73f7712700 1 --2- 172.21.15.5:0/4188346653 >> [v2:172.21.15.5:6802/2400102721,v1:172.21.15.5:6803/2400102721] conn(0x7f73dc06ef70 0x7f73dc071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:59.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.032+0000 7f73f7712700 1 -- 172.21.15.5:0/4188346653 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f73dc0692a0 msgr2=0x7f73dc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:59.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.032+0000 7f73f7712700 1 --2- 172.21.15.5:0/4188346653 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f73dc0692a0 0x7f73dc06b750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f73ec004f90 tx=0x7f73ec009e30 comp rx=0 tx=0).stop 2024-04-16T14:31:59.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.032+0000 7f73f7712700 1 -- 172.21.15.5:0/4188346653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f01003e0 msgr2=0x7f73f01140e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:59.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.032+0000 7f73f7712700 1 --2- 172.21.15.5:0/4188346653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f01003e0 0x7f73f01140e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f73e000b790 tx=0x7f73e0009250 comp rx=0 tx=0).stop 2024-04-16T14:31:59.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.032+0000 7f73f7712700 1 -- 172.21.15.5:0/4188346653 shutdown_connections 2024-04-16T14:31:59.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.032+0000 7f73f7712700 1 --2- 172.21.15.5:0/4188346653 >> [v2:172.21.15.5:6802/2400102721,v1:172.21.15.5:6803/2400102721] conn(0x7f73dc06ef70 0x7f73dc071380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:59.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.032+0000 7f73f7712700 1 --2- 172.21.15.5:0/4188346653 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f73dc0692a0 0x7f73dc06b750 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:59.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.032+0000 7f73f7712700 1 --2- 172.21.15.5:0/4188346653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73f00fb4e0 0x7f73f0113ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:59.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.032+0000 7f73f7712700 1 --2- 172.21.15.5:0/4188346653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73f01003e0 0x7f73f01140e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:59.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.032+0000 7f73f7712700 1 -- 172.21.15.5:0/4188346653 >> 172.21.15.5:0/4188346653 conn(0x7f73f00714c0 msgr2=0x7f73f01021f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:59.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.032+0000 7f73f7712700 1 -- 172.21.15.5:0/4188346653 shutdown_connections 2024-04-16T14:31:59.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.032+0000 7f73f7712700 1 -- 172.21.15.5:0/4188346653 wait complete. 2024-04-16T14:31:59.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.578+0000 7fae03730700 1 -- 172.21.15.5:0/139478994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadfc0fbb80 msgr2=0x7fadfc0fbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:59.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.578+0000 7fae03730700 1 --2- 172.21.15.5:0/139478994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadfc0fbb80 0x7fadfc0fbf50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fadf8004940 tx=0x7fadf8009e30 comp rx=0 tx=0).stop 2024-04-16T14:31:59.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.578+0000 7fae03730700 1 -- 172.21.15.5:0/139478994 shutdown_connections 2024-04-16T14:31:59.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.578+0000 7fae03730700 1 --2- 172.21.15.5:0/139478994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadfc0fc490 0x7fadfc1091f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:59.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.578+0000 7fae03730700 1 --2- 172.21.15.5:0/139478994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadfc0fbb80 0x7fadfc0fbf50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:59.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.578+0000 7fae03730700 1 -- 172.21.15.5:0/139478994 >> 172.21.15.5:0/139478994 conn(0x7fadfc0f7870 msgr2=0x7fadfc0f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:59.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.578+0000 7fae03730700 1 -- 172.21.15.5:0/139478994 shutdown_connections 2024-04-16T14:31:59.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.578+0000 7fae03730700 1 -- 172.21.15.5:0/139478994 wait complete. 2024-04-16T14:31:59.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.578+0000 7fae03730700 1 Processor -- start 2024-04-16T14:31:59.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.579+0000 7fae03730700 1 -- start start 2024-04-16T14:31:59.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.579+0000 7fae03730700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadfc0fbb80 0x7fadfc115b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:59.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.579+0000 7fae03730700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadfc0fc490 0x7fadfc1160c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:59.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.579+0000 7fae03730700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc116710 con 0x7fadfc0fbb80 2024-04-16T14:31:59.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.579+0000 7fae03730700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc10fcf0 con 0x7fadfc0fc490 2024-04-16T14:31:59.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.579+0000 7fae014cc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadfc0fbb80 0x7fadfc115b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:59.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.579+0000 7fae014cc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadfc0fbb80 0x7fadfc115b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37898/0 (socket says 172.21.15.5:37898) 2024-04-16T14:31:59.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.579+0000 7fae014cc700 1 -- 172.21.15.5:0/859769153 learned_addr learned my addr 172.21.15.5:0/859769153 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:31:59.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.579+0000 7fae00ccb700 1 --2- 172.21.15.5:0/859769153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadfc0fc490 0x7fadfc1160c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:59.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.579+0000 7fae014cc700 1 -- 172.21.15.5:0/859769153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadfc0fc490 msgr2=0x7fadfc1160c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:59.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.579+0000 7fae014cc700 1 --2- 172.21.15.5:0/859769153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadfc0fc490 0x7fadfc1160c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:59.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.579+0000 7fae014cc700 1 -- 172.21.15.5:0/859769153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf8005040 con 0x7fadfc0fbb80 2024-04-16T14:31:59.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.579+0000 7fae00ccb700 1 --2- 172.21.15.5:0/859769153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadfc0fc490 0x7fadfc1160c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:31:59.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.579+0000 7fae014cc700 1 --2- 172.21.15.5:0/859769153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadfc0fbb80 0x7fadfc115b80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fadf8009380 tx=0x7fadf8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:59.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.579+0000 7fadf1ffb700 1 -- 172.21.15.5:0/859769153 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadf800e040 con 0x7fadfc0fbb80 2024-04-16T14:31:59.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.579+0000 7fadf1ffb700 1 -- 172.21.15.5:0/859769153 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fadf800bbc0 con 0x7fadfc0fbb80 2024-04-16T14:31:59.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.579+0000 7fae03730700 1 -- 172.21.15.5:0/859769153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadfc10ff70 con 0x7fadfc0fbb80 2024-04-16T14:31:59.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.579+0000 7fadf1ffb700 1 -- 172.21.15.5:0/859769153 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadf801c630 con 0x7fadfc0fbb80 2024-04-16T14:31:59.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.580+0000 7fae03730700 1 -- 172.21.15.5:0/859769153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadfc110530 con 0x7fadfc0fbb80 2024-04-16T14:31:59.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.580+0000 7fae03730700 1 -- 172.21.15.5:0/859769153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fadfc110ad0 con 0x7fadfc0fbb80 2024-04-16T14:31:59.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.581+0000 7fadf1ffb700 1 -- 172.21.15.5:0/859769153 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7fadf800bd30 con 0x7fadfc0fbb80 2024-04-16T14:31:59.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.581+0000 7fadf1ffb700 1 --2- 172.21.15.5:0/859769153 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fade80692a0 0x7fade806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:59.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.582+0000 7fadf1ffb700 1 -- 172.21.15.5:0/859769153 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fadf8088d20 con 0x7fadfc0fbb80 2024-04-16T14:31:59.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.582+0000 7fae00ccb700 1 --2- 172.21.15.5:0/859769153 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fade80692a0 0x7fade806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:59.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.582+0000 7fadf1ffb700 1 --2- 172.21.15.5:0/859769153 >> [v2:172.21.15.5:6818/2907807829,v1:172.21.15.5:6819/2907807829] conn(0x7fade806ef70 0x7fade8071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:31:59.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.582+0000 7fadf1ffb700 1 -- 172.21.15.5:0/859769153 --> [v2:172.21.15.5:6818/2907807829,v1:172.21.15.5:6819/2907807829] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fade8071a30 con 0x7fade806ef70 2024-04-16T14:31:59.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.582+0000 7fadf1ffb700 1 -- 172.21.15.5:0/859769153 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fadf8089060 con 0x7fadfc0fbb80 2024-04-16T14:31:59.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.582+0000 7fae01ccd700 1 --2- 172.21.15.5:0/859769153 >> [v2:172.21.15.5:6818/2907807829,v1:172.21.15.5:6819/2907807829] conn(0x7fade806ef70 0x7fade8071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:31:59.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.582+0000 7fae00ccb700 1 --2- 172.21.15.5:0/859769153 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fade80692a0 0x7fade806b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fadec007fd0 tx=0x7fadec009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:59.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.582+0000 7fae01ccd700 1 --2- 172.21.15.5:0/859769153 >> [v2:172.21.15.5:6818/2907807829,v1:172.21.15.5:6819/2907807829] conn(0x7fade806ef70 0x7fade8071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:31:59.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.583+0000 7fadf1ffb700 1 -- 172.21.15.5:0/859769153 <== osd.2 v2:172.21.15.5:6818/2907807829 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fade8071a30 con 0x7fade806ef70 2024-04-16T14:31:59.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.598+0000 7fae03730700 1 -- 172.21.15.5:0/859769153 --> [v2:172.21.15.5:6818/2907807829,v1:172.21.15.5:6819/2907807829] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fadfc110100 con 0x7fade806ef70 2024-04-16T14:31:59.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.598+0000 7fadf1ffb700 1 -- 172.21.15.5:0/859769153 <== osd.2 v2:172.21.15.5:6818/2907807829 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fadfc110100 con 0x7fade806ef70 2024-04-16T14:31:59.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.598+0000 7fae03730700 1 -- 172.21.15.5:0/859769153 >> [v2:172.21.15.5:6818/2907807829,v1:172.21.15.5:6819/2907807829] conn(0x7fade806ef70 msgr2=0x7fade8071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:59.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.598+0000 7fae03730700 1 --2- 172.21.15.5:0/859769153 >> [v2:172.21.15.5:6818/2907807829,v1:172.21.15.5:6819/2907807829] conn(0x7fade806ef70 0x7fade8071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:59.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.598+0000 7fae03730700 1 -- 172.21.15.5:0/859769153 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fade80692a0 msgr2=0x7fade806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:59.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.598+0000 7fae03730700 1 --2- 172.21.15.5:0/859769153 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fade80692a0 0x7fade806b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fadec007fd0 tx=0x7fadec009040 comp rx=0 tx=0).stop 2024-04-16T14:31:59.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.598+0000 7fae03730700 1 -- 172.21.15.5:0/859769153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadfc0fbb80 msgr2=0x7fadfc115b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:31:59.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.598+0000 7fae03730700 1 --2- 172.21.15.5:0/859769153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadfc0fbb80 0x7fadfc115b80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fadf8009380 tx=0x7fadf8009e30 comp rx=0 tx=0).stop 2024-04-16T14:31:59.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.599+0000 7fae03730700 1 -- 172.21.15.5:0/859769153 shutdown_connections 2024-04-16T14:31:59.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.599+0000 7fae03730700 1 --2- 172.21.15.5:0/859769153 >> [v2:172.21.15.5:6818/2907807829,v1:172.21.15.5:6819/2907807829] conn(0x7fade806ef70 0x7fade8071380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:59.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.599+0000 7fae03730700 1 --2- 172.21.15.5:0/859769153 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fade80692a0 0x7fade806b750 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:59.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.599+0000 7fae03730700 1 --2- 172.21.15.5:0/859769153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadfc0fbb80 0x7fadfc115b80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:59.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.599+0000 7fae03730700 1 --2- 172.21.15.5:0/859769153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fadfc0fc490 0x7fadfc1160c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:31:59.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.599+0000 7fae03730700 1 -- 172.21.15.5:0/859769153 >> 172.21.15.5:0/859769153 conn(0x7fadfc0f7870 msgr2=0x7fadfc0f7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:31:59.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.599+0000 7fae03730700 1 -- 172.21.15.5:0/859769153 shutdown_connections 2024-04-16T14:31:59.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:31:59.599+0000 7fae03730700 1 -- 172.21.15.5:0/859769153 wait complete. 2024-04-16T14:32:00.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:31:59 smithi115 ceph-mon[37295]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:00.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:31:59 smithi005 ceph-mon[28964]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:00.272 INFO:teuthology.orchestra.run.smithi005.stdout:38654705700 2024-04-16T14:32:00.273 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-16T14:32:01.373 INFO:teuthology.orchestra.run.smithi005.stdout:81604378649 2024-04-16T14:32:01.373 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-16T14:32:01.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.711+0000 7f5785952700 1 -- 172.21.15.5:0/3128512120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5780101d20 msgr2=0x7f57801020f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:01.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.711+0000 7f5785952700 1 --2- 172.21.15.5:0/3128512120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5780101d20 0x7f57801020f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5770004940 tx=0x7f5770009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:01.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.711+0000 7f5785952700 1 -- 172.21.15.5:0/3128512120 shutdown_connections 2024-04-16T14:32:01.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.711+0000 7f5785952700 1 --2- 172.21.15.5:0/3128512120 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57801026c0 0x7f57800fbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:01.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.711+0000 7f5785952700 1 --2- 172.21.15.5:0/3128512120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5780101d20 0x7f57801020f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:01.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.711+0000 7f5785952700 1 -- 172.21.15.5:0/3128512120 >> 172.21.15.5:0/3128512120 conn(0x7f57800f7870 msgr2=0x7f57800f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:01.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.711+0000 7f5785952700 1 -- 172.21.15.5:0/3128512120 shutdown_connections 2024-04-16T14:32:01.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.711+0000 7f5785952700 1 -- 172.21.15.5:0/3128512120 wait complete. 2024-04-16T14:32:01.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.711+0000 7f5785952700 1 Processor -- start 2024-04-16T14:32:01.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.711+0000 7f5785952700 1 -- start start 2024-04-16T14:32:01.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.712+0000 7f5785952700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5780101d20 0x7f578010eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:01.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.712+0000 7f5785952700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57801026c0 0x7f578010f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:01.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.712+0000 7f5785952700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578010f5d0 con 0x7f57801026c0 2024-04-16T14:32:01.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.712+0000 7f5785952700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578010f710 con 0x7f5780101d20 2024-04-16T14:32:01.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.712+0000 7f577e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57801026c0 0x7f578010f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:01.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.712+0000 7f577e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57801026c0 0x7f578010f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37910/0 (socket says 172.21.15.5:37910) 2024-04-16T14:32:01.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.712+0000 7f577e7fc700 1 -- 172.21.15.5:0/681513317 learned_addr learned my addr 172.21.15.5:0/681513317 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:32:01.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.712+0000 7f577effd700 1 --2- 172.21.15.5:0/681513317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5780101d20 0x7f578010eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:01.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.712+0000 7f577e7fc700 1 -- 172.21.15.5:0/681513317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5780101d20 msgr2=0x7f578010eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:01.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.712+0000 7f577e7fc700 1 --2- 172.21.15.5:0/681513317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5780101d20 0x7f578010eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:01.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.712+0000 7f577e7fc700 1 -- 172.21.15.5:0/681513317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5770005040 con 0x7f57801026c0 2024-04-16T14:32:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.712+0000 7f577e7fc700 1 --2- 172.21.15.5:0/681513317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57801026c0 0x7f578010f090 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f577400c800 tx=0x7f5774004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.712+0000 7f57677fe700 1 -- 172.21.15.5:0/681513317 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57740106f0 con 0x7f57801026c0 2024-04-16T14:32:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.712+0000 7f5785952700 1 -- 172.21.15.5:0/681513317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5780117bc0 con 0x7f57801026c0 2024-04-16T14:32:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.712+0000 7f57677fe700 1 -- 172.21.15.5:0/681513317 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5774010d20 con 0x7f57801026c0 2024-04-16T14:32:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.712+0000 7f57677fe700 1 -- 172.21.15.5:0/681513317 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57740113a0 con 0x7f57801026c0 2024-04-16T14:32:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.712+0000 7f5785952700 1 -- 172.21.15.5:0/681513317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5780117f90 con 0x7f57801026c0 2024-04-16T14:32:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.713+0000 7f5785952700 1 -- 172.21.15.5:0/681513317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f57800f91d0 con 0x7f57801026c0 2024-04-16T14:32:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.714+0000 7f57677fe700 1 -- 172.21.15.5:0/681513317 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f5774012400 con 0x7f57801026c0 2024-04-16T14:32:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.714+0000 7f57677fe700 1 --2- 172.21.15.5:0/681513317 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f57680692a0 0x7f576806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:01.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.714+0000 7f57677fe700 1 -- 172.21.15.5:0/681513317 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5774086dd0 con 0x7f57801026c0 2024-04-16T14:32:01.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.714+0000 7f577effd700 1 --2- 172.21.15.5:0/681513317 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f57680692a0 0x7f576806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:01.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.714+0000 7f57677fe700 1 --2- 172.21.15.5:0/681513317 >> [v2:172.21.15.5:6810/755259206,v1:172.21.15.5:6811/755259206] conn(0x7f576806ef70 0x7f5768071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:01.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.715+0000 7f57677fe700 1 -- 172.21.15.5:0/681513317 --> [v2:172.21.15.5:6810/755259206,v1:172.21.15.5:6811/755259206] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5768071a30 con 0x7f576806ef70 2024-04-16T14:32:01.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.715+0000 7f57677fe700 1 -- 172.21.15.5:0/681513317 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f577408c3d0 con 0x7f57801026c0 2024-04-16T14:32:01.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.715+0000 7f577f7fe700 1 --2- 172.21.15.5:0/681513317 >> [v2:172.21.15.5:6810/755259206,v1:172.21.15.5:6811/755259206] conn(0x7f576806ef70 0x7f5768071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:01.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.715+0000 7f577effd700 1 --2- 172.21.15.5:0/681513317 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f57680692a0 0x7f576806b750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5770004f90 tx=0x7f5770009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:01.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.715+0000 7f577f7fe700 1 --2- 172.21.15.5:0/681513317 >> [v2:172.21.15.5:6810/755259206,v1:172.21.15.5:6811/755259206] conn(0x7f576806ef70 0x7f5768071380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:01.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.716+0000 7f57677fe700 1 -- 172.21.15.5:0/681513317 <== osd.1 v2:172.21.15.5:6810/755259206 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f5768071a30 con 0x7f576806ef70 2024-04-16T14:32:01.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.732+0000 7f5785952700 1 -- 172.21.15.5:0/681513317 --> [v2:172.21.15.5:6810/755259206,v1:172.21.15.5:6811/755259206] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f578010f8d0 con 0x7f576806ef70 2024-04-16T14:32:01.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.732+0000 7f57677fe700 1 -- 172.21.15.5:0/681513317 <== osd.1 v2:172.21.15.5:6810/755259206 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f578010f8d0 con 0x7f576806ef70 2024-04-16T14:32:01.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.732+0000 7f5785952700 1 -- 172.21.15.5:0/681513317 >> [v2:172.21.15.5:6810/755259206,v1:172.21.15.5:6811/755259206] conn(0x7f576806ef70 msgr2=0x7f5768071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:01.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.733+0000 7f5785952700 1 --2- 172.21.15.5:0/681513317 >> [v2:172.21.15.5:6810/755259206,v1:172.21.15.5:6811/755259206] conn(0x7f576806ef70 0x7f5768071380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:01.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.733+0000 7f5785952700 1 -- 172.21.15.5:0/681513317 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f57680692a0 msgr2=0x7f576806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:01.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.733+0000 7f5785952700 1 --2- 172.21.15.5:0/681513317 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f57680692a0 0x7f576806b750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5770004f90 tx=0x7f5770009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:01.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.733+0000 7f5785952700 1 -- 172.21.15.5:0/681513317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57801026c0 msgr2=0x7f578010f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:01.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.733+0000 7f5785952700 1 --2- 172.21.15.5:0/681513317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57801026c0 0x7f578010f090 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f577400c800 tx=0x7f5774004470 comp rx=0 tx=0).stop 2024-04-16T14:32:01.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.733+0000 7f5785952700 1 -- 172.21.15.5:0/681513317 shutdown_connections 2024-04-16T14:32:01.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.733+0000 7f5785952700 1 --2- 172.21.15.5:0/681513317 >> [v2:172.21.15.5:6810/755259206,v1:172.21.15.5:6811/755259206] conn(0x7f576806ef70 0x7f5768071380 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:01.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.733+0000 7f5785952700 1 --2- 172.21.15.5:0/681513317 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f57680692a0 0x7f576806b750 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:01.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.733+0000 7f5785952700 1 --2- 172.21.15.5:0/681513317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5780101d20 0x7f578010eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:01.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.733+0000 7f5785952700 1 --2- 172.21.15.5:0/681513317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57801026c0 0x7f578010f090 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:01.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.733+0000 7f5785952700 1 -- 172.21.15.5:0/681513317 >> 172.21.15.5:0/681513317 conn(0x7f57800f7870 msgr2=0x7f57800f8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:01.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.733+0000 7f5785952700 1 -- 172.21.15.5:0/681513317 shutdown_connections 2024-04-16T14:32:01.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:01.733+0000 7f5785952700 1 -- 172.21.15.5:0/681513317 wait complete. 2024-04-16T14:32:02.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:01 smithi115 ceph-mon[37295]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:02.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:01 smithi005 ceph-mon[28964]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:02.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.331+0000 7f84c8b38700 1 -- 172.21.15.5:0/2642702535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84c40fde20 msgr2=0x7f84c40fe1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:02.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.331+0000 7f84c8b38700 1 --2- 172.21.15.5:0/2642702535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84c40fde20 0x7f84c40fe1f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f84b4004970 tx=0x7f84b4009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.331+0000 7f84c8b38700 1 -- 172.21.15.5:0/2642702535 shutdown_connections 2024-04-16T14:32:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.331+0000 7f84c8b38700 1 --2- 172.21.15.5:0/2642702535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84c40fe7c0 0x7f84c4106e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.331+0000 7f84c8b38700 1 --2- 172.21.15.5:0/2642702535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84c40fde20 0x7f84c40fe1f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.331+0000 7f84c8b38700 1 -- 172.21.15.5:0/2642702535 >> 172.21.15.5:0/2642702535 conn(0x7f84c40f7880 msgr2=0x7f84c40f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.331+0000 7f84c8b38700 1 -- 172.21.15.5:0/2642702535 shutdown_connections 2024-04-16T14:32:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.331+0000 7f84c8b38700 1 -- 172.21.15.5:0/2642702535 wait complete. 2024-04-16T14:32:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.332+0000 7f84c8b38700 1 Processor -- start 2024-04-16T14:32:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.332+0000 7f84c8b38700 1 -- start start 2024-04-16T14:32:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.332+0000 7f84c8b38700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84c40fde20 0x7f84c4113b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.332+0000 7f84c8b38700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84c40fe7c0 0x7f84c41140a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.332+0000 7f84c8b38700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c41146f0 con 0x7f84c40fe7c0 2024-04-16T14:32:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.332+0000 7f84c8b38700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c410dae0 con 0x7f84c40fde20 2024-04-16T14:32:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.332+0000 7f84b9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84c40fe7c0 0x7f84c41140a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:02.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.332+0000 7f84b9d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84c40fe7c0 0x7f84c41140a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37936/0 (socket says 172.21.15.5:37936) 2024-04-16T14:32:02.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.332+0000 7f84b9d9b700 1 -- 172.21.15.5:0/2914225952 learned_addr learned my addr 172.21.15.5:0/2914225952 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:32:02.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.332+0000 7f84c259c700 1 --2- 172.21.15.5:0/2914225952 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84c40fde20 0x7f84c4113b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:02.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.333+0000 7f84b9d9b700 1 -- 172.21.15.5:0/2914225952 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84c40fde20 msgr2=0x7f84c4113b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:02.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.333+0000 7f84b9d9b700 1 --2- 172.21.15.5:0/2914225952 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84c40fde20 0x7f84c4113b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:02.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.333+0000 7f84b9d9b700 1 -- 172.21.15.5:0/2914225952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b4005040 con 0x7f84c40fe7c0 2024-04-16T14:32:02.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.333+0000 7f84b9d9b700 1 --2- 172.21.15.5:0/2914225952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84c40fe7c0 0x7f84c41140a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00c830 tx=0x7f84ac004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:02.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.333+0000 7f84bb7fe700 1 -- 172.21.15.5:0/2914225952 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84ac0106f0 con 0x7f84c40fe7c0 2024-04-16T14:32:02.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.333+0000 7f84bb7fe700 1 -- 172.21.15.5:0/2914225952 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f84ac010d20 con 0x7f84c40fe7c0 2024-04-16T14:32:02.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.333+0000 7f84bb7fe700 1 -- 172.21.15.5:0/2914225952 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84ac0113a0 con 0x7f84c40fe7c0 2024-04-16T14:32:02.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.333+0000 7f84c8b38700 1 -- 172.21.15.5:0/2914225952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c410ddc0 con 0x7f84c40fe7c0 2024-04-16T14:32:02.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.333+0000 7f84c8b38700 1 -- 172.21.15.5:0/2914225952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c410e2b0 con 0x7f84c40fe7c0 2024-04-16T14:32:02.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.334+0000 7f84c8b38700 1 -- 172.21.15.5:0/2914225952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f84c410e840 con 0x7f84c40fe7c0 2024-04-16T14:32:02.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.335+0000 7f84bb7fe700 1 -- 172.21.15.5:0/2914225952 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f84ac012400 con 0x7f84c40fe7c0 2024-04-16T14:32:02.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.335+0000 7f84bb7fe700 1 --2- 172.21.15.5:0/2914225952 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f84b00692a0 0x7f84b006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:02.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.335+0000 7f84bb7fe700 1 -- 172.21.15.5:0/2914225952 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f84ac086e20 con 0x7f84c40fe7c0 2024-04-16T14:32:02.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.335+0000 7f84c259c700 1 --2- 172.21.15.5:0/2914225952 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f84b00692a0 0x7f84b006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:02.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.335+0000 7f84bb7fe700 1 --2- 172.21.15.5:0/2914225952 >> [v2:172.21.15.115:6816/448370235,v1:172.21.15.115:6817/448370235] conn(0x7f84b006ef70 0x7f84b0071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:02.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.335+0000 7f84bb7fe700 1 -- 172.21.15.5:0/2914225952 --> [v2:172.21.15.115:6816/448370235,v1:172.21.15.115:6817/448370235] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f84b0071a30 con 0x7f84b006ef70 2024-04-16T14:32:02.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.335+0000 7f84bb7fe700 1 -- 172.21.15.5:0/2914225952 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84ac08c420 con 0x7f84c40fe7c0 2024-04-16T14:32:02.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.335+0000 7f84c2d9d700 1 --2- 172.21.15.5:0/2914225952 >> [v2:172.21.15.115:6816/448370235,v1:172.21.15.115:6817/448370235] conn(0x7f84b006ef70 0x7f84b0071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:02.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.335+0000 7f84c259c700 1 --2- 172.21.15.5:0/2914225952 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f84b00692a0 0x7f84b006b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f84b4004f50 tx=0x7f84b4009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:02.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.336+0000 7f84c2d9d700 1 --2- 172.21.15.5:0/2914225952 >> [v2:172.21.15.115:6816/448370235,v1:172.21.15.115:6817/448370235] conn(0x7f84b006ef70 0x7f84b0071380 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:02.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.337+0000 7f84bb7fe700 1 -- 172.21.15.5:0/2914225952 <== osd.5 v2:172.21.15.115:6816/448370235 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f84b0071a30 con 0x7f84b006ef70 2024-04-16T14:32:02.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.351+0000 7f84c8b38700 1 -- 172.21.15.5:0/2914225952 --> [v2:172.21.15.115:6816/448370235,v1:172.21.15.115:6817/448370235] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f84c4102370 con 0x7f84b006ef70 2024-04-16T14:32:02.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.352+0000 7f84bb7fe700 1 -- 172.21.15.5:0/2914225952 <== osd.5 v2:172.21.15.115:6816/448370235 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f84c4102370 con 0x7f84b006ef70 2024-04-16T14:32:02.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.352+0000 7f84c8b38700 1 -- 172.21.15.5:0/2914225952 >> [v2:172.21.15.115:6816/448370235,v1:172.21.15.115:6817/448370235] conn(0x7f84b006ef70 msgr2=0x7f84b0071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:02.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.352+0000 7f84c8b38700 1 --2- 172.21.15.5:0/2914225952 >> [v2:172.21.15.115:6816/448370235,v1:172.21.15.115:6817/448370235] conn(0x7f84b006ef70 0x7f84b0071380 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:02.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.352+0000 7f84c8b38700 1 -- 172.21.15.5:0/2914225952 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f84b00692a0 msgr2=0x7f84b006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:02.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.353+0000 7f84c8b38700 1 --2- 172.21.15.5:0/2914225952 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f84b00692a0 0x7f84b006b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f84b4004f50 tx=0x7f84b4009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:02.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.353+0000 7f84c8b38700 1 -- 172.21.15.5:0/2914225952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84c40fe7c0 msgr2=0x7f84c41140a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:02.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.353+0000 7f84c8b38700 1 --2- 172.21.15.5:0/2914225952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84c40fe7c0 0x7f84c41140a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00c830 tx=0x7f84ac004470 comp rx=0 tx=0).stop 2024-04-16T14:32:02.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.353+0000 7f84c8b38700 1 -- 172.21.15.5:0/2914225952 shutdown_connections 2024-04-16T14:32:02.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.353+0000 7f84c8b38700 1 --2- 172.21.15.5:0/2914225952 >> [v2:172.21.15.115:6816/448370235,v1:172.21.15.115:6817/448370235] conn(0x7f84b006ef70 0x7f84b0071380 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:02.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.353+0000 7f84c8b38700 1 --2- 172.21.15.5:0/2914225952 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f84b00692a0 0x7f84b006b750 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:02.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.353+0000 7f84c8b38700 1 --2- 172.21.15.5:0/2914225952 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84c40fde20 0x7f84c4113b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:02.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.353+0000 7f84c8b38700 1 --2- 172.21.15.5:0/2914225952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f84c40fe7c0 0x7f84c41140a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:02.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.353+0000 7f84c8b38700 1 -- 172.21.15.5:0/2914225952 >> 172.21.15.5:0/2914225952 conn(0x7f84c40f7880 msgr2=0x7f84c4103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:02.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.353+0000 7f84c8b38700 1 -- 172.21.15.5:0/2914225952 shutdown_connections 2024-04-16T14:32:02.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:02.353+0000 7f84c8b38700 1 -- 172.21.15.5:0/2914225952 wait complete. 2024-04-16T14:32:02.830 INFO:teuthology.orchestra.run.smithi005.stdout:60129542175 2024-04-16T14:32:02.830 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-16T14:32:03.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:02 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:32:03.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:02 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:32:03.299 INFO:teuthology.orchestra.run.smithi005.stdout:115964117012 2024-04-16T14:32:03.299 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-16T14:32:03.877 INFO:teuthology.orchestra.run.smithi005.stdout:171798691850 2024-04-16T14:32:03.878 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-16T14:32:03.932 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:32:03.933 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:32:03.937 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:32:03.984 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:32:04.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:03 smithi115 ceph-mon[37295]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:04.204 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:03 smithi005 ceph-mon[28964]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:06.095 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:05 smithi005 ceph-mon[28964]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:06.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:05 smithi115 ceph-mon[37295]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:08.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:07 smithi115 ceph-mon[37295]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:08.193 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:07 smithi005 ceph-mon[28964]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:08.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.239+0000 7fdd8070c700 1 -- 172.21.15.5:0/1750184504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd78101d90 msgr2=0x7fdd78102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:08.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.239+0000 7fdd8070c700 1 --2- 172.21.15.5:0/1750184504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd78101d90 0x7fdd78102160 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdd74004940 tx=0x7fdd74009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:08.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.239+0000 7fdd8070c700 1 -- 172.21.15.5:0/1750184504 shutdown_connections 2024-04-16T14:32:08.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.239+0000 7fdd8070c700 1 --2- 172.21.15.5:0/1750184504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd78102730 0x7fdd780fbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:08.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.239+0000 7fdd8070c700 1 --2- 172.21.15.5:0/1750184504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd78101d90 0x7fdd78102160 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:08.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.239+0000 7fdd8070c700 1 -- 172.21.15.5:0/1750184504 >> 172.21.15.5:0/1750184504 conn(0x7fdd780f7900 msgr2=0x7fdd780f9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:08.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.239+0000 7fdd8070c700 1 -- 172.21.15.5:0/1750184504 shutdown_connections 2024-04-16T14:32:08.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.239+0000 7fdd8070c700 1 -- 172.21.15.5:0/1750184504 wait complete. 2024-04-16T14:32:08.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.240+0000 7fdd8070c700 1 Processor -- start 2024-04-16T14:32:08.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.240+0000 7fdd8070c700 1 -- start start 2024-04-16T14:32:08.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.240+0000 7fdd8070c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd78101d90 0x7fdd7810eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:08.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.240+0000 7fdd8070c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd78102730 0x7fdd7810f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:08.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.240+0000 7fdd8070c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7810f5a0 con 0x7fdd78101d90 2024-04-16T14:32:08.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.240+0000 7fdd8070c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7810f6e0 con 0x7fdd78102730 2024-04-16T14:32:08.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.240+0000 7fdd7e4a8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd78101d90 0x7fdd7810eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:08.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.240+0000 7fdd7e4a8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd78101d90 0x7fdd7810eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37964/0 (socket says 172.21.15.5:37964) 2024-04-16T14:32:08.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.240+0000 7fdd7e4a8700 1 -- 172.21.15.5:0/3723770752 learned_addr learned my addr 172.21.15.5:0/3723770752 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:32:08.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.240+0000 7fdd7dca7700 1 --2- 172.21.15.5:0/3723770752 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd78102730 0x7fdd7810f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:08.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.240+0000 7fdd7e4a8700 1 -- 172.21.15.5:0/3723770752 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd78102730 msgr2=0x7fdd7810f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:08.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.240+0000 7fdd7e4a8700 1 --2- 172.21.15.5:0/3723770752 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd78102730 0x7fdd7810f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:08.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.240+0000 7fdd7e4a8700 1 -- 172.21.15.5:0/3723770752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd74005040 con 0x7fdd78101d90 2024-04-16T14:32:08.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.240+0000 7fdd7dca7700 1 --2- 172.21.15.5:0/3723770752 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd78102730 0x7fdd7810f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:32:08.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.241+0000 7fdd7e4a8700 1 --2- 172.21.15.5:0/3723770752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd78101d90 0x7fdd7810eb20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdd7400b3b0 tx=0x7fdd74009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:08.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.241+0000 7fdd6effd700 1 -- 172.21.15.5:0/3723770752 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd7400e040 con 0x7fdd78101d90 2024-04-16T14:32:08.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.241+0000 7fdd6effd700 1 -- 172.21.15.5:0/3723770752 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdd7400bbc0 con 0x7fdd78101d90 2024-04-16T14:32:08.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.241+0000 7fdd6effd700 1 -- 172.21.15.5:0/3723770752 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd7401c3f0 con 0x7fdd78101d90 2024-04-16T14:32:08.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.241+0000 7fdd8070c700 1 -- 172.21.15.5:0/3723770752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd7810f960 con 0x7fdd78101d90 2024-04-16T14:32:08.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.241+0000 7fdd8070c700 1 -- 172.21.15.5:0/3723770752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd78117e80 con 0x7fdd78101d90 2024-04-16T14:32:08.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.242+0000 7fdd8070c700 1 -- 172.21.15.5:0/3723770752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd780ff0a0 con 0x7fdd78101d90 2024-04-16T14:32:08.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.242+0000 7fdd6effd700 1 -- 172.21.15.5:0/3723770752 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7fdd7400bd30 con 0x7fdd78101d90 2024-04-16T14:32:08.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.243+0000 7fdd6effd700 1 --2- 172.21.15.5:0/3723770752 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fdd640692a0 0x7fdd6406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:08.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.243+0000 7fdd6effd700 1 -- 172.21.15.5:0/3723770752 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fdd740880f0 con 0x7fdd78101d90 2024-04-16T14:32:08.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.243+0000 7fdd7dca7700 1 --2- 172.21.15.5:0/3723770752 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fdd640692a0 0x7fdd6406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:08.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.243+0000 7fdd7dca7700 1 --2- 172.21.15.5:0/3723770752 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fdd640692a0 0x7fdd6406b750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdd68007fd0 tx=0x7fdd68009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:08.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.247+0000 7fdd6effd700 1 -- 172.21.15.5:0/3723770752 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fdd740546e0 con 0x7fdd78101d90 2024-04-16T14:32:08.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.446+0000 7fdd8070c700 1 -- 172.21.15.5:0/3723770752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdd780fd4e0 con 0x7fdd78101d90 2024-04-16T14:32:08.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.446+0000 7fdd6effd700 1 -- 172.21.15.5:0/3723770752 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdd74086e60 con 0x7fdd78101d90 2024-04-16T14:32:08.445 INFO:teuthology.orchestra.run.smithi005.stdout:60129542176 2024-04-16T14:32:08.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.448+0000 7fdd8070c700 1 -- 172.21.15.5:0/3723770752 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fdd640692a0 msgr2=0x7fdd6406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:08.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.448+0000 7fdd8070c700 1 --2- 172.21.15.5:0/3723770752 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fdd640692a0 0x7fdd6406b750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdd68007fd0 tx=0x7fdd68009040 comp rx=0 tx=0).stop 2024-04-16T14:32:08.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.448+0000 7fdd8070c700 1 -- 172.21.15.5:0/3723770752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd78101d90 msgr2=0x7fdd7810eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:08.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.448+0000 7fdd8070c700 1 --2- 172.21.15.5:0/3723770752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd78101d90 0x7fdd7810eb20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdd7400b3b0 tx=0x7fdd74009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:08.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.448+0000 7fdd8070c700 1 -- 172.21.15.5:0/3723770752 shutdown_connections 2024-04-16T14:32:08.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.448+0000 7fdd8070c700 1 --2- 172.21.15.5:0/3723770752 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fdd640692a0 0x7fdd6406b750 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:08.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.448+0000 7fdd8070c700 1 --2- 172.21.15.5:0/3723770752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd78101d90 0x7fdd7810eb20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:08.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.448+0000 7fdd8070c700 1 --2- 172.21.15.5:0/3723770752 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd78102730 0x7fdd7810f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:08.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.448+0000 7fdd8070c700 1 -- 172.21.15.5:0/3723770752 >> 172.21.15.5:0/3723770752 conn(0x7fdd780f7900 msgr2=0x7fdd780f9670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:08.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.449+0000 7fdd8070c700 1 -- 172.21.15.5:0/3723770752 shutdown_connections 2024-04-16T14:32:08.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:08.449+0000 7fdd8070c700 1 -- 172.21.15.5:0/3723770752 wait complete. 2024-04-16T14:32:09.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:08 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/3723770752' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-16T14:32:09.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.254+0000 7f23b4738700 1 -- 172.21.15.5:0/3807231919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac1026b0 msgr2=0x7f23ac0fbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.254+0000 7f23b4738700 1 --2- 172.21.15.5:0/3807231919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac1026b0 0x7f23ac0fbd20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f23a8004940 tx=0x7f23a8009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.254+0000 7f23b4738700 1 -- 172.21.15.5:0/3807231919 shutdown_connections 2024-04-16T14:32:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.254+0000 7f23b4738700 1 --2- 172.21.15.5:0/3807231919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac1026b0 0x7f23ac0fbd20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.254+0000 7f23b4738700 1 --2- 172.21.15.5:0/3807231919 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23ac101d10 0x7f23ac1020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.254+0000 7f23b4738700 1 -- 172.21.15.5:0/3807231919 >> 172.21.15.5:0/3807231919 conn(0x7f23ac0f7880 msgr2=0x7f23ac0f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.254+0000 7f23b4738700 1 -- 172.21.15.5:0/3807231919 shutdown_connections 2024-04-16T14:32:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.254+0000 7f23b4738700 1 -- 172.21.15.5:0/3807231919 wait complete. 2024-04-16T14:32:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.255+0000 7f23b4738700 1 Processor -- start 2024-04-16T14:32:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.255+0000 7f23b4738700 1 -- start start 2024-04-16T14:32:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.255+0000 7f23b4738700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac101d10 0x7f23ac113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.255+0000 7f23b4738700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23ac1026b0 0x7f23ac1140d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.255+0000 7f23b4738700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac114720 con 0x7f23ac101d10 2024-04-16T14:32:09.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.255+0000 7f23b4738700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac10db10 con 0x7f23ac1026b0 2024-04-16T14:32:09.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.255+0000 7f23b24d4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac101d10 0x7f23ac113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:09.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.255+0000 7f23b24d4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac101d10 0x7f23ac113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33364/0 (socket says 172.21.15.5:33364) 2024-04-16T14:32:09.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.255+0000 7f23b24d4700 1 -- 172.21.15.5:0/3731305434 learned_addr learned my addr 172.21.15.5:0/3731305434 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:32:09.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.255+0000 7f23b1cd3700 1 --2- 172.21.15.5:0/3731305434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23ac1026b0 0x7f23ac1140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:09.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.256+0000 7f23b24d4700 1 -- 172.21.15.5:0/3731305434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23ac1026b0 msgr2=0x7f23ac1140d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:09.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.256+0000 7f23b24d4700 1 --2- 172.21.15.5:0/3731305434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23ac1026b0 0x7f23ac1140d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:09.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.256+0000 7f23b24d4700 1 -- 172.21.15.5:0/3731305434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a8005040 con 0x7f23ac101d10 2024-04-16T14:32:09.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.256+0000 7f23b24d4700 1 --2- 172.21.15.5:0/3731305434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac101d10 0x7f23ac113b90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f23a0002a50 tx=0x7f23a00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:09.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.256+0000 7f239effd700 1 -- 172.21.15.5:0/3731305434 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23a0007cc0 con 0x7f23ac101d10 2024-04-16T14:32:09.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.256+0000 7f239effd700 1 -- 172.21.15.5:0/3731305434 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f23a000f040 con 0x7f23ac101d10 2024-04-16T14:32:09.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.256+0000 7f23b4738700 1 -- 172.21.15.5:0/3731305434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ac10ddf0 con 0x7f23ac101d10 2024-04-16T14:32:09.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.256+0000 7f239effd700 1 -- 172.21.15.5:0/3731305434 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23a0009640 con 0x7f23ac101d10 2024-04-16T14:32:09.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.256+0000 7f23b4738700 1 -- 172.21.15.5:0/3731305434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ac10e3b0 con 0x7f23ac101d10 2024-04-16T14:32:09.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.257+0000 7f23b4738700 1 -- 172.21.15.5:0/3731305434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23ac0fd460 con 0x7f23ac101d10 2024-04-16T14:32:09.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.258+0000 7f239effd700 1 -- 172.21.15.5:0/3731305434 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f23a00097a0 con 0x7f23ac101d10 2024-04-16T14:32:09.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.258+0000 7f239effd700 1 --2- 172.21.15.5:0/3731305434 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f23980692a0 0x7f239806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:09.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.258+0000 7f239effd700 1 -- 172.21.15.5:0/3731305434 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f23a0086c50 con 0x7f23ac101d10 2024-04-16T14:32:09.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.258+0000 7f23b1cd3700 1 --2- 172.21.15.5:0/3731305434 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f23980692a0 0x7f239806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:09.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.259+0000 7f23b1cd3700 1 --2- 172.21.15.5:0/3731305434 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f23980692a0 0x7f239806b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f23ac10ecd0 tx=0x7f23a8009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:09.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.263+0000 7f239effd700 1 -- 172.21.15.5:0/3731305434 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f23a0056cd0 con 0x7f23ac101d10 2024-04-16T14:32:09.272 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542175 got 60129542176 for osd.1 2024-04-16T14:32:09.272 DEBUG:teuthology.parallel:result is None 2024-04-16T14:32:09.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:08 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/3723770752' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-16T14:32:09.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.459+0000 7f23b4738700 1 -- 172.21.15.5:0/3731305434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f23ac108df0 con 0x7f23ac101d10 2024-04-16T14:32:09.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.459+0000 7f239effd700 1 -- 172.21.15.5:0/3731305434 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f23a0056860 con 0x7f23ac101d10 2024-04-16T14:32:09.457 INFO:teuthology.orchestra.run.smithi005.stdout:81604378651 2024-04-16T14:32:09.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.461+0000 7f23b4738700 1 -- 172.21.15.5:0/3731305434 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f23980692a0 msgr2=0x7f239806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:09.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.461+0000 7f23b4738700 1 --2- 172.21.15.5:0/3731305434 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f23980692a0 0x7f239806b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f23ac10ecd0 tx=0x7f23a8009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:09.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.461+0000 7f23b4738700 1 -- 172.21.15.5:0/3731305434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac101d10 msgr2=0x7f23ac113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:09.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.461+0000 7f23b4738700 1 --2- 172.21.15.5:0/3731305434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac101d10 0x7f23ac113b90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f23a0002a50 tx=0x7f23a00046b0 comp rx=0 tx=0).stop 2024-04-16T14:32:09.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.461+0000 7f23b4738700 1 -- 172.21.15.5:0/3731305434 shutdown_connections 2024-04-16T14:32:09.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.461+0000 7f23b4738700 1 --2- 172.21.15.5:0/3731305434 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f23980692a0 0x7f239806b750 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:09.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.461+0000 7f23b4738700 1 --2- 172.21.15.5:0/3731305434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23ac101d10 0x7f23ac113b90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:09.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.461+0000 7f23b4738700 1 --2- 172.21.15.5:0/3731305434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23ac1026b0 0x7f23ac1140d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:09.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.461+0000 7f23b4738700 1 -- 172.21.15.5:0/3731305434 >> 172.21.15.5:0/3731305434 conn(0x7f23ac0f7880 msgr2=0x7f23ac0f8890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:09.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.461+0000 7f23b4738700 1 -- 172.21.15.5:0/3731305434 shutdown_connections 2024-04-16T14:32:09.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:09.461+0000 7f23b4738700 1 -- 172.21.15.5:0/3731305434 wait complete. 2024-04-16T14:32:10.172 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:09 smithi005 ceph-mon[28964]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:10.172 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:09 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/3731305434' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-16T14:32:10.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:09 smithi115 ceph-mon[37295]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:10.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:09 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/3731305434' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-16T14:32:10.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.563+0000 7fd53d4f9700 1 -- 172.21.15.5:0/1639505819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5380fe860 msgr2=0x7fd538106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:10.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.563+0000 7fd53d4f9700 1 --2- 172.21.15.5:0/1639505819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5380fe860 0x7fd538106f30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd52c004940 tx=0x7fd52c009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:10.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.563+0000 7fd53d4f9700 1 -- 172.21.15.5:0/1639505819 shutdown_connections 2024-04-16T14:32:10.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.563+0000 7fd53d4f9700 1 --2- 172.21.15.5:0/1639505819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5380fe860 0x7fd538106f30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:10.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.563+0000 7fd53d4f9700 1 --2- 172.21.15.5:0/1639505819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5380fdec0 0x7fd5380fe290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:10.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.563+0000 7fd53d4f9700 1 -- 172.21.15.5:0/1639505819 >> 172.21.15.5:0/1639505819 conn(0x7fd5380f7900 msgr2=0x7fd5380f9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:10.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.563+0000 7fd53d4f9700 1 -- 172.21.15.5:0/1639505819 shutdown_connections 2024-04-16T14:32:10.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.563+0000 7fd53d4f9700 1 -- 172.21.15.5:0/1639505819 wait complete. 2024-04-16T14:32:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.564+0000 7fd53d4f9700 1 Processor -- start 2024-04-16T14:32:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.564+0000 7fd53d4f9700 1 -- start start 2024-04-16T14:32:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.564+0000 7fd53d4f9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5380fdec0 0x7fd538113a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.564+0000 7fd53d4f9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5380fe860 0x7fd538113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.564+0000 7fd53d4f9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5381145b0 con 0x7fd5380fe860 2024-04-16T14:32:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.564+0000 7fd53d4f9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53810db90 con 0x7fd5380fdec0 2024-04-16T14:32:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.564+0000 7fd5367fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5380fe860 0x7fd538113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.564+0000 7fd5367fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5380fe860 0x7fd538113f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33404/0 (socket says 172.21.15.5:33404) 2024-04-16T14:32:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.564+0000 7fd5367fc700 1 -- 172.21.15.5:0/584216486 learned_addr learned my addr 172.21.15.5:0/584216486 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:32:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.564+0000 7fd536ffd700 1 --2- 172.21.15.5:0/584216486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5380fdec0 0x7fd538113a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.565+0000 7fd5367fc700 1 -- 172.21.15.5:0/584216486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5380fdec0 msgr2=0x7fd538113a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.565+0000 7fd5367fc700 1 --2- 172.21.15.5:0/584216486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5380fdec0 0x7fd538113a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:10.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.565+0000 7fd5367fc700 1 -- 172.21.15.5:0/584216486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52c005040 con 0x7fd5380fe860 2024-04-16T14:32:10.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.565+0000 7fd5367fc700 1 --2- 172.21.15.5:0/584216486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5380fe860 0x7fd538113f60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd52c000c00 tx=0x7fd52c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:10.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.565+0000 7fd51f7fe700 1 -- 172.21.15.5:0/584216486 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd52c00e070 con 0x7fd5380fe860 2024-04-16T14:32:10.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.565+0000 7fd51f7fe700 1 -- 172.21.15.5:0/584216486 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd52c013c00 con 0x7fd5380fe860 2024-04-16T14:32:10.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.565+0000 7fd53d4f9700 1 -- 172.21.15.5:0/584216486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53810de10 con 0x7fd5380fe860 2024-04-16T14:32:10.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.565+0000 7fd51f7fe700 1 -- 172.21.15.5:0/584216486 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd52c012600 con 0x7fd5380fe860 2024-04-16T14:32:10.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.565+0000 7fd53d4f9700 1 -- 172.21.15.5:0/584216486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53810e350 con 0x7fd5380fe860 2024-04-16T14:32:10.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.566+0000 7fd53d4f9700 1 -- 172.21.15.5:0/584216486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5381018d0 con 0x7fd5380fe860 2024-04-16T14:32:10.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.567+0000 7fd51f7fe700 1 -- 172.21.15.5:0/584216486 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7fd52c01c400 con 0x7fd5380fe860 2024-04-16T14:32:10.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.567+0000 7fd51f7fe700 1 --2- 172.21.15.5:0/584216486 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd5200692a0 0x7fd52006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:10.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.567+0000 7fd51f7fe700 1 -- 172.21.15.5:0/584216486 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd52c0885e0 con 0x7fd5380fe860 2024-04-16T14:32:10.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.567+0000 7fd536ffd700 1 --2- 172.21.15.5:0/584216486 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd5200692a0 0x7fd52006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:10.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.568+0000 7fd536ffd700 1 --2- 172.21.15.5:0/584216486 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd5200692a0 0x7fd52006b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd528009b80 tx=0x7fd52800b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:10.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.576+0000 7fd51f7fe700 1 -- 172.21.15.5:0/584216486 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd52c058780 con 0x7fd5380fe860 2024-04-16T14:32:10.686 INFO:teuthology.orchestra.run.smithi005.stdout:38654705702 2024-04-16T14:32:10.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.453+0000 7f1c24423700 1 -- 172.21.15.5:0/2445074427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c102e20 msgr2=0x7f1c1c1031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:10.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.453+0000 7f1c24423700 1 --2- 172.21.15.5:0/2445074427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c102e20 0x7f1c1c1031f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c004940 tx=0x7f1c0c009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:10.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.453+0000 7f1c24423700 1 -- 172.21.15.5:0/2445074427 shutdown_connections 2024-04-16T14:32:10.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.453+0000 7f1c24423700 1 --2- 172.21.15.5:0/2445074427 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c1c1037c0 0x7f1c1c0fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:10.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.453+0000 7f1c24423700 1 --2- 172.21.15.5:0/2445074427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c102e20 0x7f1c1c1031f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:10.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.453+0000 7f1c24423700 1 -- 172.21.15.5:0/2445074427 >> 172.21.15.5:0/2445074427 conn(0x7f1c1c0f89b0 msgr2=0x7f1c1c0fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:10.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.453+0000 7f1c24423700 1 -- 172.21.15.5:0/2445074427 shutdown_connections 2024-04-16T14:32:10.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.453+0000 7f1c24423700 1 -- 172.21.15.5:0/2445074427 wait complete. 2024-04-16T14:32:10.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.453+0000 7f1c24423700 1 Processor -- start 2024-04-16T14:32:10.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.453+0000 7f1c24423700 1 -- start start 2024-04-16T14:32:10.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.454+0000 7f1c24423700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c102e20 0x7f1c1c0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:10.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.454+0000 7f1c24423700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c1c1037c0 0x7f1c1c070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:10.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.454+0000 7f1c24423700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c072210 con 0x7f1c1c102e20 2024-04-16T14:32:10.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.454+0000 7f1c24423700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c070d40 con 0x7f1c1c1037c0 2024-04-16T14:32:10.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.454+0000 7f1c221bf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c102e20 0x7f1c1c0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:10.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.454+0000 7f1c221bf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c102e20 0x7f1c1c0702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33378/0 (socket says 172.21.15.5:33378) 2024-04-16T14:32:10.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.454+0000 7f1c221bf700 1 -- 172.21.15.5:0/245857022 learned_addr learned my addr 172.21.15.5:0/245857022 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:32:10.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.454+0000 7f1c219be700 1 --2- 172.21.15.5:0/245857022 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c1c1037c0 0x7f1c1c070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:10.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.454+0000 7f1c221bf700 1 -- 172.21.15.5:0/245857022 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c1c1037c0 msgr2=0x7f1c1c070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:10.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.454+0000 7f1c221bf700 1 --2- 172.21.15.5:0/245857022 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c1c1037c0 0x7f1c1c070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:10.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.454+0000 7f1c221bf700 1 -- 172.21.15.5:0/245857022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c005040 con 0x7f1c1c102e20 2024-04-16T14:32:10.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.454+0000 7f1c221bf700 1 --2- 172.21.15.5:0/245857022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c102e20 0x7f1c1c0702c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009150 tx=0x7f1c0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:10.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.454+0000 7f1c1affd700 1 -- 172.21.15.5:0/245857022 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c0c00e040 con 0x7f1c1c102e20 2024-04-16T14:32:10.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.454+0000 7f1c24423700 1 -- 172.21.15.5:0/245857022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1c070fc0 con 0x7f1c1c102e20 2024-04-16T14:32:10.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.454+0000 7f1c1affd700 1 -- 172.21.15.5:0/245857022 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1c0c013420 con 0x7f1c1c102e20 2024-04-16T14:32:10.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.454+0000 7f1c1affd700 1 -- 172.21.15.5:0/245857022 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c0c01c630 con 0x7f1c1c102e20 2024-04-16T14:32:10.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.455+0000 7f1c24423700 1 -- 172.21.15.5:0/245857022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1c11a110 con 0x7f1c1c102e20 2024-04-16T14:32:10.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.455+0000 7f1c24423700 1 -- 172.21.15.5:0/245857022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c1c100130 con 0x7f1c1c102e20 2024-04-16T14:32:10.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.456+0000 7f1c1affd700 1 -- 172.21.15.5:0/245857022 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f1c0c013590 con 0x7f1c1c102e20 2024-04-16T14:32:10.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.456+0000 7f1c1affd700 1 --2- 172.21.15.5:0/245857022 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f1c040692a0 0x7f1c0406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:10.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.456+0000 7f1c1affd700 1 -- 172.21.15.5:0/245857022 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1c0c088180 con 0x7f1c1c102e20 2024-04-16T14:32:10.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.456+0000 7f1c219be700 1 --2- 172.21.15.5:0/245857022 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f1c040692a0 0x7f1c0406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:10.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.457+0000 7f1c219be700 1 --2- 172.21.15.5:0/245857022 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f1c040692a0 0x7f1c0406b750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1c10007fd0 tx=0x7f1c10009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:10.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.461+0000 7f1c1affd700 1 -- 172.21.15.5:0/245857022 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1c0c054750 con 0x7f1c1c102e20 2024-04-16T14:32:10.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.666+0000 7f1c24423700 1 -- 172.21.15.5:0/245857022 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1c1c0fe570 con 0x7f1c1c102e20 2024-04-16T14:32:10.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.666+0000 7f1c1affd700 1 -- 172.21.15.5:0/245857022 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1c0c057d70 con 0x7f1c1c102e20 2024-04-16T14:32:10.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.668+0000 7f1c24423700 1 -- 172.21.15.5:0/245857022 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f1c040692a0 msgr2=0x7f1c0406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:10.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.668+0000 7f1c24423700 1 --2- 172.21.15.5:0/245857022 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f1c040692a0 0x7f1c0406b750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1c10007fd0 tx=0x7f1c10009040 comp rx=0 tx=0).stop 2024-04-16T14:32:10.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.668+0000 7f1c24423700 1 -- 172.21.15.5:0/245857022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c102e20 msgr2=0x7f1c1c0702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:10.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.668+0000 7f1c24423700 1 --2- 172.21.15.5:0/245857022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c102e20 0x7f1c1c0702c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009150 tx=0x7f1c0c009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:10.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.669+0000 7f1c24423700 1 -- 172.21.15.5:0/245857022 shutdown_connections 2024-04-16T14:32:10.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.669+0000 7f1c24423700 1 --2- 172.21.15.5:0/245857022 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f1c040692a0 0x7f1c0406b750 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:10.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.669+0000 7f1c24423700 1 --2- 172.21.15.5:0/245857022 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c1c102e20 0x7f1c1c0702c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:10.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.669+0000 7f1c24423700 1 --2- 172.21.15.5:0/245857022 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c1c1037c0 0x7f1c1c070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:10.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.669+0000 7f1c24423700 1 -- 172.21.15.5:0/245857022 >> 172.21.15.5:0/245857022 conn(0x7f1c1c0f89b0 msgr2=0x7f1c1c107410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:10.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.669+0000 7f1c24423700 1 -- 172.21.15.5:0/245857022 shutdown_connections 2024-04-16T14:32:10.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.669+0000 7f1c24423700 1 -- 172.21.15.5:0/245857022 wait complete. 2024-04-16T14:32:10.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.774+0000 7fd53d4f9700 1 -- 172.21.15.5:0/584216486 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd538066a40 con 0x7fd5380fe860 2024-04-16T14:32:10.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.774+0000 7fd51f7fe700 1 -- 172.21.15.5:0/584216486 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd538066a40 con 0x7fd5380fe860 2024-04-16T14:32:10.773 INFO:teuthology.orchestra.run.smithi005.stdout:150323855376 2024-04-16T14:32:10.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.776+0000 7fd53d4f9700 1 -- 172.21.15.5:0/584216486 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd5200692a0 msgr2=0x7fd52006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:10.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.776+0000 7fd53d4f9700 1 --2- 172.21.15.5:0/584216486 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd5200692a0 0x7fd52006b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd528009b80 tx=0x7fd52800b040 comp rx=0 tx=0).stop 2024-04-16T14:32:10.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.776+0000 7fd53d4f9700 1 -- 172.21.15.5:0/584216486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5380fe860 msgr2=0x7fd538113f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:10.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.776+0000 7fd53d4f9700 1 --2- 172.21.15.5:0/584216486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5380fe860 0x7fd538113f60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd52c000c00 tx=0x7fd52c009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:10.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.776+0000 7fd53d4f9700 1 -- 172.21.15.5:0/584216486 shutdown_connections 2024-04-16T14:32:10.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.776+0000 7fd53d4f9700 1 --2- 172.21.15.5:0/584216486 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd5200692a0 0x7fd52006b750 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:10.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.776+0000 7fd53d4f9700 1 --2- 172.21.15.5:0/584216486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5380fdec0 0x7fd538113a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:10.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.776+0000 7fd53d4f9700 1 --2- 172.21.15.5:0/584216486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd5380fe860 0x7fd538113f60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:10.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.776+0000 7fd53d4f9700 1 -- 172.21.15.5:0/584216486 >> 172.21.15.5:0/584216486 conn(0x7fd5380f7900 msgr2=0x7fd5380ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:10.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.777+0000 7fd53d4f9700 1 -- 172.21.15.5:0/584216486 shutdown_connections 2024-04-16T14:32:10.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:10.777+0000 7fd53d4f9700 1 -- 172.21.15.5:0/584216486 wait complete. 2024-04-16T14:32:11.127 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:32:11.128 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:32:11.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:10 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/245857022' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-16T14:32:11.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:10 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/584216486' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-16T14:32:11.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:10 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/245857022' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-16T14:32:11.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:10 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/584216486' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-16T14:32:11.635 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705700 got 38654705702 for osd.0 2024-04-16T14:32:11.635 DEBUG:teuthology.parallel:result is None 2024-04-16T14:32:11.980 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378649 got 81604378651 for osd.2 2024-04-16T14:32:11.980 DEBUG:teuthology.parallel:result is None 2024-04-16T14:32:12.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:11 smithi005 ceph-mon[28964]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:12.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:11 smithi115 ceph-mon[37295]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:12.477 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855373 got 150323855376 for osd.4 2024-04-16T14:32:12.477 DEBUG:teuthology.parallel:result is None 2024-04-16T14:32:14.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:13 smithi005 ceph-mon[28964]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:14.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:13 smithi115 ceph-mon[37295]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:15.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.099+0000 7fe1ec60b700 1 -- 172.21.15.5:0/4065732475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e4102e20 msgr2=0x7fe1e41031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:15.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.099+0000 7fe1ec60b700 1 --2- 172.21.15.5:0/4065732475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e4102e20 0x7fe1e41031f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4009ce0 tx=0x7fe1d4004d10 comp rx=0 tx=0).stop 2024-04-16T14:32:15.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.099+0000 7fe1ec60b700 1 -- 172.21.15.5:0/4065732475 shutdown_connections 2024-04-16T14:32:15.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.099+0000 7fe1ec60b700 1 --2- 172.21.15.5:0/4065732475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1e41037c0 0x7fe1e40fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:15.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.099+0000 7fe1ec60b700 1 --2- 172.21.15.5:0/4065732475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e4102e20 0x7fe1e41031f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:15.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.099+0000 7fe1ec60b700 1 -- 172.21.15.5:0/4065732475 >> 172.21.15.5:0/4065732475 conn(0x7fe1e40f89b0 msgr2=0x7fe1e40fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:15.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.099+0000 7fe1ec60b700 1 -- 172.21.15.5:0/4065732475 shutdown_connections 2024-04-16T14:32:15.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.099+0000 7fe1ec60b700 1 -- 172.21.15.5:0/4065732475 wait complete. 2024-04-16T14:32:15.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.099+0000 7fe1ec60b700 1 Processor -- start 2024-04-16T14:32:15.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.099+0000 7fe1ec60b700 1 -- start start 2024-04-16T14:32:15.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.100+0000 7fe1ec60b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1e4102e20 0x7fe1e410e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:15.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.100+0000 7fe1ec60b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e41037c0 0x7fe1e410ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:15.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.100+0000 7fe1ec60b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e410baf0 con 0x7fe1e41037c0 2024-04-16T14:32:15.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.100+0000 7fe1ec60b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e410bc30 con 0x7fe1e4102e20 2024-04-16T14:32:15.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.100+0000 7fe1e9ba6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e41037c0 0x7fe1e410ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:15.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.100+0000 7fe1e9ba6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e41037c0 0x7fe1e410ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33412/0 (socket says 172.21.15.5:33412) 2024-04-16T14:32:15.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.100+0000 7fe1e9ba6700 1 -- 172.21.15.5:0/3096558936 learned_addr learned my addr 172.21.15.5:0/3096558936 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:32:15.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.100+0000 7fe1ea3a7700 1 --2- 172.21.15.5:0/3096558936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1e4102e20 0x7fe1e410e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:15.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.100+0000 7fe1e9ba6700 1 -- 172.21.15.5:0/3096558936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1e4102e20 msgr2=0x7fe1e410e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:15.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.100+0000 7fe1e9ba6700 1 --2- 172.21.15.5:0/3096558936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1e4102e20 0x7fe1e410e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:15.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.100+0000 7fe1e9ba6700 1 -- 172.21.15.5:0/3096558936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d4009940 con 0x7fe1e41037c0 2024-04-16T14:32:15.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.100+0000 7fe1e9ba6700 1 --2- 172.21.15.5:0/3096558936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e41037c0 0x7fe1e410ee00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800b790 tx=0x7fe1d8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:15.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.101+0000 7fe1e2ffd700 1 -- 172.21.15.5:0/3096558936 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1d800f6f0 con 0x7fe1e41037c0 2024-04-16T14:32:15.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.101+0000 7fe1e2ffd700 1 -- 172.21.15.5:0/3096558936 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe1d800fd20 con 0x7fe1e41037c0 2024-04-16T14:32:15.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.101+0000 7fe1ec60b700 1 -- 172.21.15.5:0/3096558936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e410bf10 con 0x7fe1e41037c0 2024-04-16T14:32:15.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.101+0000 7fe1e2ffd700 1 -- 172.21.15.5:0/3096558936 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1d80103a0 con 0x7fe1e41037c0 2024-04-16T14:32:15.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.101+0000 7fe1ec60b700 1 -- 172.21.15.5:0/3096558936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e410c4d0 con 0x7fe1e41037c0 2024-04-16T14:32:15.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.102+0000 7fe1ec60b700 1 -- 172.21.15.5:0/3096558936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e40fe570 con 0x7fe1e41037c0 2024-04-16T14:32:15.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.102+0000 7fe1e2ffd700 1 -- 172.21.15.5:0/3096558936 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7fe1d8011400 con 0x7fe1e41037c0 2024-04-16T14:32:15.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.103+0000 7fe1e2ffd700 1 --2- 172.21.15.5:0/3096558936 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe1cc0692a0 0x7fe1cc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:15.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.103+0000 7fe1e2ffd700 1 -- 172.21.15.5:0/3096558936 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe1d8086b20 con 0x7fe1e41037c0 2024-04-16T14:32:15.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.103+0000 7fe1ea3a7700 1 --2- 172.21.15.5:0/3096558936 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe1cc0692a0 0x7fe1cc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:15.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.103+0000 7fe1ea3a7700 1 --2- 172.21.15.5:0/3096558936 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe1cc0692a0 0x7fe1cc06b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe1d400b740 tx=0x7fe1d4004d10 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:15.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.107+0000 7fe1e2ffd700 1 -- 172.21.15.5:0/3096558936 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe1d8053230 con 0x7fe1e41037c0 2024-04-16T14:32:15.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.306+0000 7fe1ec60b700 1 -- 172.21.15.5:0/3096558936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe1e404c710 con 0x7fe1e41037c0 2024-04-16T14:32:15.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.306+0000 7fe1e2ffd700 1 -- 172.21.15.5:0/3096558936 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe1d8056850 con 0x7fe1e41037c0 2024-04-16T14:32:15.305 INFO:teuthology.orchestra.run.smithi005.stdout:115964117015 2024-04-16T14:32:15.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.309+0000 7fe1ec60b700 1 -- 172.21.15.5:0/3096558936 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe1cc0692a0 msgr2=0x7fe1cc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:15.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.309+0000 7fe1ec60b700 1 --2- 172.21.15.5:0/3096558936 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe1cc0692a0 0x7fe1cc06b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe1d400b740 tx=0x7fe1d4004d10 comp rx=0 tx=0).stop 2024-04-16T14:32:15.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.309+0000 7fe1ec60b700 1 -- 172.21.15.5:0/3096558936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e41037c0 msgr2=0x7fe1e410ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:15.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.309+0000 7fe1ec60b700 1 --2- 172.21.15.5:0/3096558936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e41037c0 0x7fe1e410ee00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800b790 tx=0x7fe1d8009220 comp rx=0 tx=0).stop 2024-04-16T14:32:15.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.309+0000 7fe1ec60b700 1 -- 172.21.15.5:0/3096558936 shutdown_connections 2024-04-16T14:32:15.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.309+0000 7fe1ec60b700 1 --2- 172.21.15.5:0/3096558936 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe1cc0692a0 0x7fe1cc06b750 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:15.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.309+0000 7fe1ec60b700 1 --2- 172.21.15.5:0/3096558936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1e4102e20 0x7fe1e410e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:15.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.309+0000 7fe1ec60b700 1 --2- 172.21.15.5:0/3096558936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe1e41037c0 0x7fe1e410ee00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:15.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.309+0000 7fe1ec60b700 1 -- 172.21.15.5:0/3096558936 >> 172.21.15.5:0/3096558936 conn(0x7fe1e40f89b0 msgr2=0x7fe1e4071bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:15.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.309+0000 7fe1ec60b700 1 -- 172.21.15.5:0/3096558936 shutdown_connections 2024-04-16T14:32:15.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.309+0000 7fe1ec60b700 1 -- 172.21.15.5:0/3096558936 wait complete. 2024-04-16T14:32:15.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.571+0000 7f618838a700 1 -- 172.21.15.5:0/2396076367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6180102f60 msgr2=0x7f6180103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:15.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.571+0000 7f618838a700 1 --2- 172.21.15.5:0/2396076367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6180102f60 0x7f6180103330 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f617c004940 tx=0x7f617c009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:15.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.571+0000 7f618838a700 1 -- 172.21.15.5:0/2396076367 shutdown_connections 2024-04-16T14:32:15.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.571+0000 7f618838a700 1 --2- 172.21.15.5:0/2396076367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f61800fb4d0 0x7f61800fb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:15.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.571+0000 7f618838a700 1 --2- 172.21.15.5:0/2396076367 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6180102f60 0x7f6180103330 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:15.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.571+0000 7f618838a700 1 -- 172.21.15.5:0/2396076367 >> 172.21.15.5:0/2396076367 conn(0x7f61800714c0 msgr2=0x7f61800718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:15.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.571+0000 7f618838a700 1 -- 172.21.15.5:0/2396076367 shutdown_connections 2024-04-16T14:32:15.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.571+0000 7f618838a700 1 -- 172.21.15.5:0/2396076367 wait complete. 2024-04-16T14:32:15.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.571+0000 7f618838a700 1 Processor -- start 2024-04-16T14:32:15.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.571+0000 7f618838a700 1 -- start start 2024-04-16T14:32:15.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.572+0000 7f618838a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61800fb4d0 0x7f61800fc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:15.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.572+0000 7f618838a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6180102f60 0x7f61800fcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:15.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.572+0000 7f618838a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61800fe600 con 0x7f61800fb4d0 2024-04-16T14:32:15.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.572+0000 7f618838a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61800fd130 con 0x7f6180102f60 2024-04-16T14:32:15.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.572+0000 7f6186126700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61800fb4d0 0x7f61800fc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:15.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.572+0000 7f6186126700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61800fb4d0 0x7f61800fc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33432/0 (socket says 172.21.15.5:33432) 2024-04-16T14:32:15.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.572+0000 7f6186126700 1 -- 172.21.15.5:0/1530007312 learned_addr learned my addr 172.21.15.5:0/1530007312 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:32:15.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.572+0000 7f6185925700 1 --2- 172.21.15.5:0/1530007312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6180102f60 0x7f61800fcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:15.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.572+0000 7f6186126700 1 -- 172.21.15.5:0/1530007312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6180102f60 msgr2=0x7f61800fcbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:15.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.572+0000 7f6186126700 1 --2- 172.21.15.5:0/1530007312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6180102f60 0x7f61800fcbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:15.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.572+0000 7f6186126700 1 -- 172.21.15.5:0/1530007312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617c005040 con 0x7f61800fb4d0 2024-04-16T14:32:15.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.572+0000 7f6186126700 1 --2- 172.21.15.5:0/1530007312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61800fb4d0 0x7f61800fc6b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f617c00b8b0 tx=0x7f617c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:15.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.572+0000 7f6176ffd700 1 -- 172.21.15.5:0/1530007312 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f617c00e040 con 0x7f61800fb4d0 2024-04-16T14:32:15.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.572+0000 7f6176ffd700 1 -- 172.21.15.5:0/1530007312 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f617c004290 con 0x7f61800fb4d0 2024-04-16T14:32:15.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.572+0000 7f618838a700 1 -- 172.21.15.5:0/1530007312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61800fd3b0 con 0x7f61800fb4d0 2024-04-16T14:32:15.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.572+0000 7f6176ffd700 1 -- 172.21.15.5:0/1530007312 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f617c01c3f0 con 0x7f61800fb4d0 2024-04-16T14:32:15.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.572+0000 7f618838a700 1 -- 172.21.15.5:0/1530007312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f618011a0e0 con 0x7f61800fb4d0 2024-04-16T14:32:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.573+0000 7f618838a700 1 -- 172.21.15.5:0/1530007312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6180100200 con 0x7f61800fb4d0 2024-04-16T14:32:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.574+0000 7f6176ffd700 1 -- 172.21.15.5:0/1530007312 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f617c0137b0 con 0x7f61800fb4d0 2024-04-16T14:32:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.574+0000 7f6176ffd700 1 --2- 172.21.15.5:0/1530007312 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f616c0692a0 0x7f616c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:15.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.575+0000 7f6185925700 1 --2- 172.21.15.5:0/1530007312 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f616c0692a0 0x7f616c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:15.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.575+0000 7f6176ffd700 1 -- 172.21.15.5:0/1530007312 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f617c088190 con 0x7f61800fb4d0 2024-04-16T14:32:15.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.575+0000 7f6185925700 1 --2- 172.21.15.5:0/1530007312 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f616c0692a0 0x7f616c06b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f61800fdde0 tx=0x7f617000b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:15.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.579+0000 7f6176ffd700 1 -- 172.21.15.5:0/1530007312 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f617c054800 con 0x7f61800fb4d0 2024-04-16T14:32:15.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.777+0000 7f618838a700 1 -- 172.21.15.5:0/1530007312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f618010a040 con 0x7f61800fb4d0 2024-04-16T14:32:15.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.777+0000 7f6176ffd700 1 -- 172.21.15.5:0/1530007312 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f617c057e20 con 0x7f61800fb4d0 2024-04-16T14:32:15.776 INFO:teuthology.orchestra.run.smithi005.stdout:171798691852 2024-04-16T14:32:15.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.779+0000 7f618838a700 1 -- 172.21.15.5:0/1530007312 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f616c0692a0 msgr2=0x7f616c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:15.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.779+0000 7f618838a700 1 --2- 172.21.15.5:0/1530007312 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f616c0692a0 0x7f616c06b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f61800fdde0 tx=0x7f617000b040 comp rx=0 tx=0).stop 2024-04-16T14:32:15.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.779+0000 7f618838a700 1 -- 172.21.15.5:0/1530007312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61800fb4d0 msgr2=0x7f61800fc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:15.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.779+0000 7f618838a700 1 --2- 172.21.15.5:0/1530007312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61800fb4d0 0x7f61800fc6b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f617c00b8b0 tx=0x7f617c009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:15.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.780+0000 7f618838a700 1 -- 172.21.15.5:0/1530007312 shutdown_connections 2024-04-16T14:32:15.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.780+0000 7f618838a700 1 --2- 172.21.15.5:0/1530007312 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f616c0692a0 0x7f616c06b750 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:15.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.780+0000 7f618838a700 1 --2- 172.21.15.5:0/1530007312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f61800fb4d0 0x7f61800fc6b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:15.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.780+0000 7f618838a700 1 --2- 172.21.15.5:0/1530007312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6180102f60 0x7f61800fcbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:15.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.780+0000 7f618838a700 1 -- 172.21.15.5:0/1530007312 >> 172.21.15.5:0/1530007312 conn(0x7f61800714c0 msgr2=0x7f61800fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:15.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.780+0000 7f618838a700 1 -- 172.21.15.5:0/1530007312 shutdown_connections 2024-04-16T14:32:15.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:15.780+0000 7f618838a700 1 -- 172.21.15.5:0/1530007312 wait complete. 2024-04-16T14:32:16.155 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:15 smithi005 ceph-mon[28964]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:16.156 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:15 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/3096558936' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-16T14:32:16.156 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:15 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/1530007312' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-16T14:32:16.180 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117012 got 115964117015 for osd.3 2024-04-16T14:32:16.181 DEBUG:teuthology.parallel:result is None 2024-04-16T14:32:16.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:15 smithi115 ceph-mon[37295]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:16.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:15 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/3096558936' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-16T14:32:16.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:15 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/1530007312' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-16T14:32:16.855 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691850 got 171798691852 for osd.5 2024-04-16T14:32:16.856 DEBUG:teuthology.parallel:result is None 2024-04-16T14:32:16.856 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-16T14:32:16.856 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph pg dump --format=json 2024-04-16T14:32:17.128 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:32:18.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:17 smithi005 ceph-mon[28964]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:18.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:17 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:32:18.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:17 smithi115 ceph-mon[37295]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:18.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:17 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:32:18.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.789+0000 7fce54a0e700 1 -- 172.21.15.5:0/1352553685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce50102e20 msgr2=0x7fce501031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:18.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.789+0000 7fce54a0e700 1 --2- 172.21.15.5:0/1352553685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce50102e20 0x7fce501031f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fce40004940 tx=0x7fce40009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:18.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.790+0000 7fce54a0e700 1 -- 172.21.15.5:0/1352553685 shutdown_connections 2024-04-16T14:32:18.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.790+0000 7fce54a0e700 1 --2- 172.21.15.5:0/1352553685 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce501037c0 0x7fce500fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:18.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.790+0000 7fce54a0e700 1 --2- 172.21.15.5:0/1352553685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce50102e20 0x7fce501031f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:18.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.790+0000 7fce54a0e700 1 -- 172.21.15.5:0/1352553685 >> 172.21.15.5:0/1352553685 conn(0x7fce500f89b0 msgr2=0x7fce500fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:18.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.790+0000 7fce54a0e700 1 -- 172.21.15.5:0/1352553685 shutdown_connections 2024-04-16T14:32:18.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.790+0000 7fce54a0e700 1 -- 172.21.15.5:0/1352553685 wait complete. 2024-04-16T14:32:18.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.790+0000 7fce54a0e700 1 Processor -- start 2024-04-16T14:32:18.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.790+0000 7fce54a0e700 1 -- start start 2024-04-16T14:32:18.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.790+0000 7fce54a0e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce50102e20 0x7fce500702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:18.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.790+0000 7fce54a0e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce501037c0 0x7fce50070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:18.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.790+0000 7fce54a0e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce50072210 con 0x7fce50102e20 2024-04-16T14:32:18.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.790+0000 7fce54a0e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce50070d40 con 0x7fce501037c0 2024-04-16T14:32:18.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.791+0000 7fce4e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce50102e20 0x7fce500702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:18.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.791+0000 7fce4e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce50102e20 0x7fce500702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60000/0 (socket says 172.21.15.5:60000) 2024-04-16T14:32:18.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.791+0000 7fce4e59c700 1 -- 172.21.15.5:0/3546069365 learned_addr learned my addr 172.21.15.5:0/3546069365 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:32:18.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.791+0000 7fce4dd9b700 1 --2- 172.21.15.5:0/3546069365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce501037c0 0x7fce50070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:18.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.791+0000 7fce4e59c700 1 -- 172.21.15.5:0/3546069365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce501037c0 msgr2=0x7fce50070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:18.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.791+0000 7fce4e59c700 1 --2- 172.21.15.5:0/3546069365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce501037c0 0x7fce50070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:18.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.791+0000 7fce4e59c700 1 -- 172.21.15.5:0/3546069365 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce40005040 con 0x7fce50102e20 2024-04-16T14:32:18.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.791+0000 7fce4dd9b700 1 --2- 172.21.15.5:0/3546069365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce501037c0 0x7fce50070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T14:32:18.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.791+0000 7fce4e59c700 1 --2- 172.21.15.5:0/3546069365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce50102e20 0x7fce500702c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fce4000b3b0 tx=0x7fce40009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:18.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.791+0000 7fce3effd700 1 -- 172.21.15.5:0/3546069365 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce4000e040 con 0x7fce50102e20 2024-04-16T14:32:18.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.791+0000 7fce3effd700 1 -- 172.21.15.5:0/3546069365 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fce4000bbc0 con 0x7fce50102e20 2024-04-16T14:32:18.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.791+0000 7fce54a0e700 1 -- 172.21.15.5:0/3546069365 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce50070fc0 con 0x7fce50102e20 2024-04-16T14:32:18.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.791+0000 7fce3effd700 1 -- 172.21.15.5:0/3546069365 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce4001c3f0 con 0x7fce50102e20 2024-04-16T14:32:18.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.791+0000 7fce54a0e700 1 -- 172.21.15.5:0/3546069365 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5011a0f0 con 0x7fce50102e20 2024-04-16T14:32:18.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.792+0000 7fce54a0e700 1 -- 172.21.15.5:0/3546069365 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce50100130 con 0x7fce50102e20 2024-04-16T14:32:18.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.793+0000 7fce3effd700 1 -- 172.21.15.5:0/3546069365 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7fce4000bd30 con 0x7fce50102e20 2024-04-16T14:32:18.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.793+0000 7fce3effd700 1 --2- 172.21.15.5:0/3546069365 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fce380692a0 0x7fce3806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:18.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.793+0000 7fce3effd700 1 -- 172.21.15.5:0/3546069365 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fce400880f0 con 0x7fce50102e20 2024-04-16T14:32:18.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.793+0000 7fce4dd9b700 1 --2- 172.21.15.5:0/3546069365 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fce380692a0 0x7fce3806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:18.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.794+0000 7fce4dd9b700 1 --2- 172.21.15.5:0/3546069365 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fce380692a0 0x7fce3806b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fce44009fd0 tx=0x7fce44009ee0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:18.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.798+0000 7fce3effd700 1 -- 172.21.15.5:0/3546069365 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fce400546e0 con 0x7fce50102e20 2024-04-16T14:32:18.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.988+0000 7fce54a0e700 1 -- 172.21.15.5:0/3546069365 --> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fce50071860 con 0x7fce380692a0 2024-04-16T14:32:18.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.990+0000 7fce3effd700 1 -- 172.21.15.5:0/3546069365 <== mgr.14212 v2:172.21.15.5:6800/3841652776 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28351 (secure 0 0 0) 0x7fce50071860 con 0x7fce380692a0 2024-04-16T14:32:18.989 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:32:18.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.991+0000 7fce54a0e700 1 -- 172.21.15.5:0/3546069365 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fce380692a0 msgr2=0x7fce3806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:18.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.991+0000 7fce54a0e700 1 --2- 172.21.15.5:0/3546069365 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fce380692a0 0x7fce3806b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fce44009fd0 tx=0x7fce44009ee0 comp rx=0 tx=0).stop 2024-04-16T14:32:18.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.992+0000 7fce54a0e700 1 -- 172.21.15.5:0/3546069365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce50102e20 msgr2=0x7fce500702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:18.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.992+0000 7fce54a0e700 1 --2- 172.21.15.5:0/3546069365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce50102e20 0x7fce500702c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fce4000b3b0 tx=0x7fce40009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:18.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.992+0000 7fce54a0e700 1 -- 172.21.15.5:0/3546069365 shutdown_connections 2024-04-16T14:32:18.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.992+0000 7fce54a0e700 1 --2- 172.21.15.5:0/3546069365 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fce380692a0 0x7fce3806b750 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:18.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.992+0000 7fce54a0e700 1 --2- 172.21.15.5:0/3546069365 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fce50102e20 0x7fce500702c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:18.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.992+0000 7fce54a0e700 1 --2- 172.21.15.5:0/3546069365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce501037c0 0x7fce50070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:18.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.992+0000 7fce54a0e700 1 -- 172.21.15.5:0/3546069365 >> 172.21.15.5:0/3546069365 conn(0x7fce500f89b0 msgr2=0x7fce50107410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:18.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.992+0000 7fce54a0e700 1 -- 172.21.15.5:0/3546069365 shutdown_connections 2024-04-16T14:32:18.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:18.992+0000 7fce54a0e700 1 -- 172.21.15.5:0/3546069365 wait complete. 2024-04-16T14:32:18.993 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-16T14:32:19.768 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-04-16T14:32:18.710430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1788068,"kb_used_data":3924,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682844,"statfs":{"total":575970213888,"available":574139232256,"internally_reserved":0,"allocated":4018176,"data_stored":2624466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002232"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":189,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T14:31:26.657458+0000","last_change":"2024-04-16T14:31:00.759976+0000","last_active":"2024-04-16T14:31:26.657458+0000","last_peered":"2024-04-16T14:31:26.657458+0000","last_clean":"2024-04-16T14:31:26.657458+0000","last_became_active":"2024-04-16T14:31:00.759678+0000","last_became_peered":"2024-04-16T14:31:00.759678+0000","last_unstale":"2024-04-16T14:31:26.657458+0000","last_undegraded":"2024-04-16T14:31:26.657458+0000","last_fullsized":"2024-04-16T14:31:26.657458+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T14:30:13.595353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T14:30:13.595353+0000","last_clean_scrub_stamp":"2024-04-16T14:30:13.595353+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:11:53.961686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]}]},{"osd":4,"up_from":35,"seq":150323855378,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297724,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447428,"statfs":{"total":95995035648,"available":95690166272,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 16 14:32:02 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.438},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.40699999999999997}]},{"osd":1,"last update":"Tue Apr 16 14:32:02 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.45100000000000001}]},{"osd":2,"last update":"Tue Apr 16 14:32:02 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.38200000000000001}]},{"osd":3,"last update":"Tue Apr 16 14:32:02 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.314},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.39100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]},{"osd":3,"up_from":27,"seq":115964117016,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298304,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446848,"statfs":{"total":95995035648,"available":95689572352,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 16 14:31:35 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.46700000000000003}]},{"osd":1,"last update":"Tue Apr 16 14:31:35 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.40000000000000002}]},{"osd":2,"last update":"Tue Apr 16 14:31:35 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.49299999999999999}]},{"osd":4,"last update":"Tue Apr 16 14:32:02 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 16 14:32:14 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.33500000000000002,"15min":0.33600000000000002},"min":{"1min":0.23100000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.35099999999999998,"15min":0.35299999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.27400000000000002}]},{"osd":1,"last update":"Tue Apr 16 14:32:14 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.25}]},{"osd":3,"last update":"Tue Apr 16 14:31:36 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.44}]},{"osd":4,"last update":"Tue Apr 16 14:32:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.42699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 16 14:31:47 2024","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.24399999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.53200000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.35399999999999998,"15min":0.35599999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.46500000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.26100000000000001}]},{"osd":2,"last update":"Tue Apr 16 14:31:17 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.29299999999999998}]},{"osd":3,"last update":"Tue Apr 16 14:31:37 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.499},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.39900000000000002}]},{"osd":4,"last update":"Tue Apr 16 14:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.378}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 16 14:31:47 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.318,"15min":0.30599999999999999},"min":{"1min":0.29499999999999998,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.33500000000000002,"15min":0.32000000000000001},"min":{"1min":0.28899999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.28999999999999998}]},{"osd":2,"last update":"Tue Apr 16 14:31:15 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.308}]},{"osd":3,"last update":"Tue Apr 16 14:31:37 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.59199999999999997}]},{"osd":4,"last update":"Tue Apr 16 14:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.54800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T14:32:19.769 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph pg dump --format=json 2024-04-16T14:32:20.038 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:32:20.161 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:19 smithi005 ceph-mon[28964]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:20.161 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:19 smithi005 ceph-mon[28964]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-16T14:32:20.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:19 smithi115 ceph-mon[37295]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:20.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:19 smithi115 ceph-mon[37295]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-16T14:32:21.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.662+0000 7f3cdc20a700 1 -- 172.21.15.5:0/1869543547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd4102e20 msgr2=0x7f3cd41031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:21.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.662+0000 7f3cdc20a700 1 --2- 172.21.15.5:0/1869543547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd4102e20 0x7f3cd41031f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4009ce0 tx=0x7f3cc4004d10 comp rx=0 tx=0).stop 2024-04-16T14:32:21.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.662+0000 7f3cdc20a700 1 -- 172.21.15.5:0/1869543547 shutdown_connections 2024-04-16T14:32:21.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.662+0000 7f3cdc20a700 1 --2- 172.21.15.5:0/1869543547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cd41037c0 0x7f3cd40fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:21.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.662+0000 7f3cdc20a700 1 --2- 172.21.15.5:0/1869543547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd4102e20 0x7f3cd41031f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:21.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.662+0000 7f3cdc20a700 1 -- 172.21.15.5:0/1869543547 >> 172.21.15.5:0/1869543547 conn(0x7f3cd40f89b0 msgr2=0x7f3cd40fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:21.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.662+0000 7f3cdc20a700 1 -- 172.21.15.5:0/1869543547 shutdown_connections 2024-04-16T14:32:21.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.662+0000 7f3cdc20a700 1 -- 172.21.15.5:0/1869543547 wait complete. 2024-04-16T14:32:21.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.663+0000 7f3cdc20a700 1 Processor -- start 2024-04-16T14:32:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.663+0000 7f3cdc20a700 1 -- start start 2024-04-16T14:32:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.663+0000 7f3cdc20a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd4102e20 0x7f3cd4115ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.663+0000 7f3cdc20a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cd41037c0 0x7f3cd4116220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.663+0000 7f3cdc20a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd4116900 con 0x7f3cd4102e20 2024-04-16T14:32:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.663+0000 7f3cdc20a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd410fe50 con 0x7f3cd41037c0 2024-04-16T14:32:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.663+0000 7f3cd9fa6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd4102e20 0x7f3cd4115ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.663+0000 7f3cd9fa6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd4102e20 0x7f3cd4115ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60020/0 (socket says 172.21.15.5:60020) 2024-04-16T14:32:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.663+0000 7f3cd9fa6700 1 -- 172.21.15.5:0/3982509312 learned_addr learned my addr 172.21.15.5:0/3982509312 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:32:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.663+0000 7f3cd97a5700 1 --2- 172.21.15.5:0/3982509312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cd41037c0 0x7f3cd4116220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.663+0000 7f3cd9fa6700 1 -- 172.21.15.5:0/3982509312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cd41037c0 msgr2=0x7f3cd4116220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.663+0000 7f3cd9fa6700 1 --2- 172.21.15.5:0/3982509312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cd41037c0 0x7f3cd4116220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.663+0000 7f3cd9fa6700 1 -- 172.21.15.5:0/3982509312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc4009940 con 0x7f3cd4102e20 2024-04-16T14:32:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.664+0000 7f3cd9fa6700 1 --2- 172.21.15.5:0/3982509312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd4102e20 0x7f3cd4115ce0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3cc400be90 tx=0x7f3cc4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.664+0000 7f3cd27fc700 1 -- 172.21.15.5:0/3982509312 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cc400e040 con 0x7f3cd4102e20 2024-04-16T14:32:21.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.664+0000 7f3cd27fc700 1 -- 172.21.15.5:0/3982509312 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3cc4008ea0 con 0x7f3cd4102e20 2024-04-16T14:32:21.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.664+0000 7f3cdc20a700 1 -- 172.21.15.5:0/3982509312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd4110070 con 0x7f3cd4102e20 2024-04-16T14:32:21.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.664+0000 7f3cd27fc700 1 -- 172.21.15.5:0/3982509312 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cc401c810 con 0x7f3cd4102e20 2024-04-16T14:32:21.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.664+0000 7f3cdc20a700 1 -- 172.21.15.5:0/3982509312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd4110630 con 0x7f3cd4102e20 2024-04-16T14:32:21.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.665+0000 7f3cdc20a700 1 -- 172.21.15.5:0/3982509312 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd40fe570 con 0x7f3cd4102e20 2024-04-16T14:32:21.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.665+0000 7f3cd27fc700 1 -- 172.21.15.5:0/3982509312 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f3cc4012c00 con 0x7f3cd4102e20 2024-04-16T14:32:21.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.666+0000 7f3cd27fc700 1 --2- 172.21.15.5:0/3982509312 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f3cbc0692a0 0x7f3cbc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:21.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.666+0000 7f3cd27fc700 1 -- 172.21.15.5:0/3982509312 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3cc4088b10 con 0x7f3cd4102e20 2024-04-16T14:32:21.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.666+0000 7f3cd97a5700 1 --2- 172.21.15.5:0/3982509312 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f3cbc0692a0 0x7f3cbc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:21.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.666+0000 7f3cd97a5700 1 --2- 172.21.15.5:0/3982509312 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f3cbc0692a0 0x7f3cbc06b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8006fd0 tx=0x7f3cc8008040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:21.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.670+0000 7f3cd27fc700 1 -- 172.21.15.5:0/3982509312 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3cc4058b90 con 0x7f3cd4102e20 2024-04-16T14:32:21.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.863+0000 7f3cdc20a700 1 -- 172.21.15.5:0/3982509312 --> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3cd4111330 con 0x7f3cbc0692a0 2024-04-16T14:32:21.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.864+0000 7f3cd27fc700 1 -- 172.21.15.5:0/3982509312 <== mgr.14212 v2:172.21.15.5:6800/3841652776 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28365 (secure 0 0 0) 0x7f3cd4111330 con 0x7f3cbc0692a0 2024-04-16T14:32:21.863 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:32:21.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.866+0000 7f3cdc20a700 1 -- 172.21.15.5:0/3982509312 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f3cbc0692a0 msgr2=0x7f3cbc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:21.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.866+0000 7f3cdc20a700 1 --2- 172.21.15.5:0/3982509312 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f3cbc0692a0 0x7f3cbc06b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8006fd0 tx=0x7f3cc8008040 comp rx=0 tx=0).stop 2024-04-16T14:32:21.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.866+0000 7f3cdc20a700 1 -- 172.21.15.5:0/3982509312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd4102e20 msgr2=0x7f3cd4115ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:21.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.866+0000 7f3cdc20a700 1 --2- 172.21.15.5:0/3982509312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd4102e20 0x7f3cd4115ce0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3cc400be90 tx=0x7f3cc4004d10 comp rx=0 tx=0).stop 2024-04-16T14:32:21.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.866+0000 7f3cdc20a700 1 -- 172.21.15.5:0/3982509312 shutdown_connections 2024-04-16T14:32:21.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.866+0000 7f3cdc20a700 1 --2- 172.21.15.5:0/3982509312 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f3cbc0692a0 0x7f3cbc06b750 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:21.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.866+0000 7f3cdc20a700 1 --2- 172.21.15.5:0/3982509312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3cd4102e20 0x7f3cd4115ce0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:21.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.866+0000 7f3cdc20a700 1 --2- 172.21.15.5:0/3982509312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3cd41037c0 0x7f3cd4116220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:21.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.866+0000 7f3cdc20a700 1 -- 172.21.15.5:0/3982509312 >> 172.21.15.5:0/3982509312 conn(0x7f3cd40f89b0 msgr2=0x7f3cd4071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:21.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.866+0000 7f3cdc20a700 1 -- 172.21.15.5:0/3982509312 shutdown_connections 2024-04-16T14:32:21.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:21.866+0000 7f3cdc20a700 1 -- 172.21.15.5:0/3982509312 wait complete. 2024-04-16T14:32:21.867 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-04-16T14:32:22.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:21 smithi005 ceph-mon[28964]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:22.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:21 smithi115 ceph-mon[37295]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:22.640 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-04-16T14:32:20.710754+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1788068,"kb_used_data":3924,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682844,"statfs":{"total":575970213888,"available":574139232256,"internally_reserved":0,"allocated":4018176,"data_stored":2624466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002122"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":189,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-16T14:31:26.657458+0000","last_change":"2024-04-16T14:31:00.759976+0000","last_active":"2024-04-16T14:31:26.657458+0000","last_peered":"2024-04-16T14:31:26.657458+0000","last_clean":"2024-04-16T14:31:26.657458+0000","last_became_active":"2024-04-16T14:31:00.759678+0000","last_became_peered":"2024-04-16T14:31:00.759678+0000","last_unstale":"2024-04-16T14:31:26.657458+0000","last_undegraded":"2024-04-16T14:31:26.657458+0000","last_fullsized":"2024-04-16T14:31:26.657458+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T14:30:13.595353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T14:30:13.595353+0000","last_clean_scrub_stamp":"2024-04-16T14:30:13.595353+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:11:53.961686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]}]},{"osd":4,"up_from":35,"seq":150323855378,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297724,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447428,"statfs":{"total":95995035648,"available":95690166272,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 16 14:32:02 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.438},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.40699999999999997}]},{"osd":1,"last update":"Tue Apr 16 14:32:02 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.45100000000000001}]},{"osd":2,"last update":"Tue Apr 16 14:32:02 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.38200000000000001}]},{"osd":3,"last update":"Tue Apr 16 14:32:02 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.314},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.39100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]},{"osd":3,"up_from":27,"seq":115964117016,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298304,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446848,"statfs":{"total":95995035648,"available":95689572352,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 16 14:31:35 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.46700000000000003}]},{"osd":1,"last update":"Tue Apr 16 14:31:35 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.40000000000000002}]},{"osd":2,"last update":"Tue Apr 16 14:31:35 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.49299999999999999}]},{"osd":4,"last update":"Tue Apr 16 14:32:02 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 16 14:32:14 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.33500000000000002,"15min":0.33600000000000002},"min":{"1min":0.23100000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.35099999999999998,"15min":0.35299999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.27400000000000002}]},{"osd":1,"last update":"Tue Apr 16 14:32:14 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.25}]},{"osd":3,"last update":"Tue Apr 16 14:31:36 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.44}]},{"osd":4,"last update":"Tue Apr 16 14:32:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.42699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 16 14:31:47 2024","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.24399999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.53200000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.35399999999999998,"15min":0.35599999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.46500000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.26100000000000001}]},{"osd":2,"last update":"Tue Apr 16 14:31:17 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.29299999999999998}]},{"osd":3,"last update":"Tue Apr 16 14:31:37 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.499},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.39900000000000002}]},{"osd":4,"last update":"Tue Apr 16 14:32:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.378}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 16 14:31:47 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.318,"15min":0.30599999999999999},"min":{"1min":0.29499999999999998,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.33500000000000002,"15min":0.32000000000000001},"min":{"1min":0.28899999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.44400000000000001}]},{"osd":2,"last update":"Tue Apr 16 14:31:15 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.46700000000000003}]},{"osd":3,"last update":"Tue Apr 16 14:31:37 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.68300000000000005}]},{"osd":4,"last update":"Tue Apr 16 14:32:00 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T14:32:22.641 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-16T14:32:22.641 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-16T14:32:22.641 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-16T14:32:22.641 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph health --format=json 2024-04-16T14:32:22.908 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:32:23.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:22 smithi005 ceph-mon[28964]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-16T14:32:23.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:22 smithi115 ceph-mon[37295]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-16T14:32:24.210 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:23 smithi005 ceph-mon[28964]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:24.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:23 smithi115 ceph-mon[37295]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:24.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.555+0000 7f58f8abe700 1 -- 172.21.15.5:0/3983941288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58f41026b0 msgr2=0x7f58f40fbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:24.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.555+0000 7f58f8abe700 1 --2- 172.21.15.5:0/3983941288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58f41026b0 0x7f58f40fbd20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f58dc004940 tx=0x7f58dc009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:24.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.555+0000 7f58f8abe700 1 -- 172.21.15.5:0/3983941288 shutdown_connections 2024-04-16T14:32:24.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.555+0000 7f58f8abe700 1 --2- 172.21.15.5:0/3983941288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58f41026b0 0x7f58f40fbd20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:24.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.555+0000 7f58f8abe700 1 --2- 172.21.15.5:0/3983941288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58f4101d10 0x7f58f41020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:24.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.555+0000 7f58f8abe700 1 -- 172.21.15.5:0/3983941288 >> 172.21.15.5:0/3983941288 conn(0x7f58f4072bc0 msgr2=0x7f58f4072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:24.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.555+0000 7f58f8abe700 1 -- 172.21.15.5:0/3983941288 shutdown_connections 2024-04-16T14:32:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.555+0000 7f58f8abe700 1 -- 172.21.15.5:0/3983941288 wait complete. 2024-04-16T14:32:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.555+0000 7f58f8abe700 1 Processor -- start 2024-04-16T14:32:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.556+0000 7f58f8abe700 1 -- start start 2024-04-16T14:32:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.556+0000 7f58f8abe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58f4101d10 0x7f58f4113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.556+0000 7f58f8abe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58f41026b0 0x7f58f41140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.556+0000 7f58f8abe700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f41147a0 con 0x7f58f41026b0 2024-04-16T14:32:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.556+0000 7f58f8abe700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f410db00 con 0x7f58f4101d10 2024-04-16T14:32:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.556+0000 7f58f1d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58f41026b0 0x7f58f41140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.556+0000 7f58f1d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58f41026b0 0x7f58f41140c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60036/0 (socket says 172.21.15.5:60036) 2024-04-16T14:32:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.556+0000 7f58f1d9b700 1 -- 172.21.15.5:0/3083035994 learned_addr learned my addr 172.21.15.5:0/3083035994 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:32:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.556+0000 7f58f259c700 1 --2- 172.21.15.5:0/3083035994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58f4101d10 0x7f58f4113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.556+0000 7f58f1d9b700 1 -- 172.21.15.5:0/3083035994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58f4101d10 msgr2=0x7f58f4113b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.556+0000 7f58f1d9b700 1 --2- 172.21.15.5:0/3083035994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58f4101d10 0x7f58f4113b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:24.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.556+0000 7f58f1d9b700 1 -- 172.21.15.5:0/3083035994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58dc005040 con 0x7f58f41026b0 2024-04-16T14:32:24.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.556+0000 7f58f259c700 1 --2- 172.21.15.5:0/3083035994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58f4101d10 0x7f58f4113b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:32:24.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.556+0000 7f58f1d9b700 1 --2- 172.21.15.5:0/3083035994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58f41026b0 0x7f58f41140c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009100 tx=0x7f58dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:24.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.556+0000 7f58eaffd700 1 -- 172.21.15.5:0/3083035994 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58dc00e040 con 0x7f58f41026b0 2024-04-16T14:32:24.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.557+0000 7f58eaffd700 1 -- 172.21.15.5:0/3083035994 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f58dc013420 con 0x7f58f41026b0 2024-04-16T14:32:24.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.557+0000 7f58f8abe700 1 -- 172.21.15.5:0/3083035994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f410dd80 con 0x7f58f41026b0 2024-04-16T14:32:24.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.557+0000 7f58eaffd700 1 -- 172.21.15.5:0/3083035994 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58dc01c610 con 0x7f58f41026b0 2024-04-16T14:32:24.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.557+0000 7f58f8abe700 1 -- 172.21.15.5:0/3083035994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f410e340 con 0x7f58f41026b0 2024-04-16T14:32:24.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.557+0000 7f58f8abe700 1 -- 172.21.15.5:0/3083035994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f40fd460 con 0x7f58f41026b0 2024-04-16T14:32:24.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.558+0000 7f58eaffd700 1 -- 172.21.15.5:0/3083035994 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f58dc013590 con 0x7f58f41026b0 2024-04-16T14:32:24.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.558+0000 7f58eaffd700 1 --2- 172.21.15.5:0/3083035994 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f58e00692a0 0x7f58e006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:24.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.558+0000 7f58eaffd700 1 -- 172.21.15.5:0/3083035994 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f58dc0880e0 con 0x7f58f41026b0 2024-04-16T14:32:24.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.559+0000 7f58f259c700 1 --2- 172.21.15.5:0/3083035994 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f58e00692a0 0x7f58e006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:24.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.559+0000 7f58f259c700 1 --2- 172.21.15.5:0/3083035994 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f58e00692a0 0x7f58e006b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f58e4007f90 tx=0x7f58e4007460 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:24.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.563+0000 7f58eaffd700 1 -- 172.21.15.5:0/3083035994 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f58dc0581e0 con 0x7f58f41026b0 2024-04-16T14:32:24.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.799+0000 7f58f8abe700 1 -- 172.21.15.5:0/3083035994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f58f405f5f0 con 0x7f58f41026b0 2024-04-16T14:32:24.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.799+0000 7f58eaffd700 1 -- 172.21.15.5:0/3083035994 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f58dc057d70 con 0x7f58f41026b0 2024-04-16T14:32:24.798 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:32:24.798 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-16T14:32:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.801+0000 7f58f8abe700 1 -- 172.21.15.5:0/3083035994 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f58e00692a0 msgr2=0x7f58e006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.802+0000 7f58f8abe700 1 --2- 172.21.15.5:0/3083035994 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f58e00692a0 0x7f58e006b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f58e4007f90 tx=0x7f58e4007460 comp rx=0 tx=0).stop 2024-04-16T14:32:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.802+0000 7f58f8abe700 1 -- 172.21.15.5:0/3083035994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58f41026b0 msgr2=0x7f58f41140c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.802+0000 7f58f8abe700 1 --2- 172.21.15.5:0/3083035994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58f41026b0 0x7f58f41140c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009100 tx=0x7f58dc009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.802+0000 7f58f8abe700 1 -- 172.21.15.5:0/3083035994 shutdown_connections 2024-04-16T14:32:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.802+0000 7f58f8abe700 1 --2- 172.21.15.5:0/3083035994 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f58e00692a0 0x7f58e006b750 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.802+0000 7f58f8abe700 1 --2- 172.21.15.5:0/3083035994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58f4101d10 0x7f58f4113b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.802+0000 7f58f8abe700 1 --2- 172.21.15.5:0/3083035994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58f41026b0 0x7f58f41140c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.802+0000 7f58f8abe700 1 -- 172.21.15.5:0/3083035994 >> 172.21.15.5:0/3083035994 conn(0x7f58f4072bc0 msgr2=0x7f58f40fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.802+0000 7f58f8abe700 1 -- 172.21.15.5:0/3083035994 shutdown_connections 2024-04-16T14:32:24.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:24.802+0000 7f58f8abe700 1 -- 172.21.15.5:0/3083035994 wait complete. 2024-04-16T14:32:25.103 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:24 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/3083035994' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-16T14:32:25.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:24 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/3083035994' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-16T14:32:25.448 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-16T14:32:25.448 INFO:tasks.cephadm:Setup complete, yielding 2024-04-16T14:32:25.449 INFO:teuthology.run_tasks:Running task print... 2024-04-16T14:32:25.458 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-04-16T14:32:25.459 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-16T14:32:25.473 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi005.front.sepia.ceph.com 2024-04-16T14:32:25.473 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-04-16T14:32:25.740 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:32:26.198 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:25 smithi005 ceph-mon[28964]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:26.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:25 smithi115 ceph-mon[37295]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:27.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.448+0000 7fc2e82f4700 1 -- 172.21.15.5:0/1104176370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e00fe470 msgr2=0x7fc2e00fe880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:27.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.448+0000 7fc2e82f4700 1 --2- 172.21.15.5:0/1104176370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e00fe470 0x7fc2e00fe880 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc004940 tx=0x7fc2dc009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:27.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.448+0000 7fc2e82f4700 1 -- 172.21.15.5:0/1104176370 shutdown_connections 2024-04-16T14:32:27.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.448+0000 7fc2e82f4700 1 --2- 172.21.15.5:0/1104176370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2e00fedc0 0x7fc2e00faf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:27.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.448+0000 7fc2e82f4700 1 --2- 172.21.15.5:0/1104176370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e00fe470 0x7fc2e00fe880 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:27.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.448+0000 7fc2e82f4700 1 -- 172.21.15.5:0/1104176370 >> 172.21.15.5:0/1104176370 conn(0x7fc2e00f6c10 msgr2=0x7fc2e00f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:27.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.448+0000 7fc2e82f4700 1 -- 172.21.15.5:0/1104176370 shutdown_connections 2024-04-16T14:32:27.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.448+0000 7fc2e82f4700 1 -- 172.21.15.5:0/1104176370 wait complete. 2024-04-16T14:32:27.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.448+0000 7fc2e82f4700 1 Processor -- start 2024-04-16T14:32:27.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.449+0000 7fc2e82f4700 1 -- start start 2024-04-16T14:32:27.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.449+0000 7fc2e82f4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e00fe470 0x7fc2e00fda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:27.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.449+0000 7fc2e82f4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2e00fedc0 0x7fc2e00fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.449+0000 7fc2e82f4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e00fe080 con 0x7fc2e00fe470 2024-04-16T14:32:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.449+0000 7fc2e82f4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e00fc670 con 0x7fc2e00fedc0 2024-04-16T14:32:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.449+0000 7fc2e6090700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e00fe470 0x7fc2e00fda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.449+0000 7fc2e6090700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e00fe470 0x7fc2e00fda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60054/0 (socket says 172.21.15.5:60054) 2024-04-16T14:32:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.449+0000 7fc2e6090700 1 -- 172.21.15.5:0/3274386370 learned_addr learned my addr 172.21.15.5:0/3274386370 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:32:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.449+0000 7fc2e588f700 1 --2- 172.21.15.5:0/3274386370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2e00fedc0 0x7fc2e00fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.449+0000 7fc2e6090700 1 -- 172.21.15.5:0/3274386370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2e00fedc0 msgr2=0x7fc2e00fc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.449+0000 7fc2e6090700 1 --2- 172.21.15.5:0/3274386370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2e00fedc0 0x7fc2e00fc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.449+0000 7fc2e6090700 1 -- 172.21.15.5:0/3274386370 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc005040 con 0x7fc2e00fe470 2024-04-16T14:32:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.449+0000 7fc2e588f700 1 --2- 172.21.15.5:0/3274386370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2e00fedc0 0x7fc2e00fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T14:32:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.449+0000 7fc2e6090700 1 --2- 172.21.15.5:0/3274386370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e00fe470 0x7fc2e00fda80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009fd0 tx=0x7fc2dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.449+0000 7fc2d6ffd700 1 -- 172.21.15.5:0/3274386370 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2dc00e040 con 0x7fc2e00fe470 2024-04-16T14:32:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.449+0000 7fc2e82f4700 1 -- 172.21.15.5:0/3274386370 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e00fc8c0 con 0x7fc2e00fe470 2024-04-16T14:32:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.449+0000 7fc2d6ffd700 1 -- 172.21.15.5:0/3274386370 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc2dc00bcc0 con 0x7fc2e00fe470 2024-04-16T14:32:27.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.449+0000 7fc2d6ffd700 1 -- 172.21.15.5:0/3274386370 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2dc01c630 con 0x7fc2e00fe470 2024-04-16T14:32:27.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.449+0000 7fc2e82f4700 1 -- 172.21.15.5:0/3274386370 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e00fce80 con 0x7fc2e00fe470 2024-04-16T14:32:27.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.450+0000 7fc2e82f4700 1 -- 172.21.15.5:0/3274386370 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e004c710 con 0x7fc2e00fe470 2024-04-16T14:32:27.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.451+0000 7fc2d6ffd700 1 -- 172.21.15.5:0/3274386370 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7fc2dc013980 con 0x7fc2e00fe470 2024-04-16T14:32:27.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.451+0000 7fc2d6ffd700 1 --2- 172.21.15.5:0/3274386370 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fc2cc0692a0 0x7fc2cc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:27.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.451+0000 7fc2d6ffd700 1 -- 172.21.15.5:0/3274386370 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc2dc088130 con 0x7fc2e00fe470 2024-04-16T14:32:27.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.451+0000 7fc2e588f700 1 --2- 172.21.15.5:0/3274386370 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fc2cc0692a0 0x7fc2cc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:27.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.452+0000 7fc2e588f700 1 --2- 172.21.15.5:0/3274386370 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fc2cc0692a0 0x7fc2cc06b750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0009fd0 tx=0x7fc2d0009ee0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:27.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.456+0000 7fc2d6ffd700 1 -- 172.21.15.5:0/3274386370 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc2dc058260 con 0x7fc2e00fe470 2024-04-16T14:32:27.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.652+0000 7fc2e82f4700 1 -- 172.21.15.5:0/3274386370 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7fc2e0115b30 con 0x7fc2e00fe470 2024-04-16T14:32:27.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.656+0000 7fc2d6ffd700 1 -- 172.21.15.5:0/3274386370 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7fc2dc057df0 con 0x7fc2e00fe470 2024-04-16T14:32:27.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.658+0000 7fc2e82f4700 1 -- 172.21.15.5:0/3274386370 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fc2cc0692a0 msgr2=0x7fc2cc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:27.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.658+0000 7fc2e82f4700 1 --2- 172.21.15.5:0/3274386370 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fc2cc0692a0 0x7fc2cc06b750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0009fd0 tx=0x7fc2d0009ee0 comp rx=0 tx=0).stop 2024-04-16T14:32:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.658+0000 7fc2e82f4700 1 -- 172.21.15.5:0/3274386370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e00fe470 msgr2=0x7fc2e00fda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.658+0000 7fc2e82f4700 1 --2- 172.21.15.5:0/3274386370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e00fe470 0x7fc2e00fda80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009fd0 tx=0x7fc2dc009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.658+0000 7fc2e82f4700 1 -- 172.21.15.5:0/3274386370 shutdown_connections 2024-04-16T14:32:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.658+0000 7fc2e82f4700 1 --2- 172.21.15.5:0/3274386370 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fc2cc0692a0 0x7fc2cc06b750 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.658+0000 7fc2e82f4700 1 --2- 172.21.15.5:0/3274386370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2e00fe470 0x7fc2e00fda80 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.658+0000 7fc2e82f4700 1 --2- 172.21.15.5:0/3274386370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2e00fedc0 0x7fc2e00fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.658+0000 7fc2e82f4700 1 -- 172.21.15.5:0/3274386370 >> 172.21.15.5:0/3274386370 conn(0x7fc2e00f6c10 msgr2=0x7fc2e00f8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.658+0000 7fc2e82f4700 1 -- 172.21.15.5:0/3274386370 shutdown_connections 2024-04-16T14:32:27.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:27.658+0000 7fc2e82f4700 1 -- 172.21.15.5:0/3274386370 wait complete. 2024-04-16T14:32:28.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:27 smithi005 ceph-mon[28964]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:28.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:27 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/3274386370' entity='client.admin' 2024-04-16T14:32:28.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:27 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:32:28.348 INFO:teuthology.run_tasks:Running task print... 2024-04-16T14:32:28.358 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-04-16T14:32:28.358 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-16T14:32:28.366 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi005.front.sepia.ceph.com 2024-04-16T14:32:28.367 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- bash -c 'ceph orch status' 2024-04-16T14:32:28.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:27 smithi115 ceph-mon[37295]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:28.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:27 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/3274386370' entity='client.admin' 2024-04-16T14:32:28.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:27 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:32:28.644 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:32:29.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:28 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:32:29.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:28 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:32:29.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:28 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:29.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:28 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:32:29.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:28 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:32:29.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:28 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:30.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.214+0000 7f2b3a999700 1 -- 172.21.15.5:0/1231407145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b340fbd00 msgr2=0x7f2b340fc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:30.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.214+0000 7f2b3a999700 1 --2- 172.21.15.5:0/1231407145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b340fbd00 0x7f2b340fc110 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2b24004940 tx=0x7f2b24009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:30.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.214+0000 7f2b3a999700 1 -- 172.21.15.5:0/1231407145 shutdown_connections 2024-04-16T14:32:30.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.214+0000 7f2b3a999700 1 --2- 172.21.15.5:0/1231407145 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b340fcfb0 0x7f2b340fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:30.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.214+0000 7f2b3a999700 1 --2- 172.21.15.5:0/1231407145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b340fbd00 0x7f2b340fc110 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:30.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.214+0000 7f2b3a999700 1 -- 172.21.15.5:0/1231407145 >> 172.21.15.5:0/1231407145 conn(0x7f2b340f7440 msgr2=0x7f2b340f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:30.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.214+0000 7f2b3a999700 1 -- 172.21.15.5:0/1231407145 shutdown_connections 2024-04-16T14:32:30.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.214+0000 7f2b3a999700 1 -- 172.21.15.5:0/1231407145 wait complete. 2024-04-16T14:32:30.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.214+0000 7f2b3a999700 1 Processor -- start 2024-04-16T14:32:30.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.215+0000 7f2b3a999700 1 -- start start 2024-04-16T14:32:30.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.215+0000 7f2b3a999700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b340fbd00 0x7f2b3410d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:30.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.215+0000 7f2b3a999700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b340fcfb0 0x7f2b3410dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:30.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.215+0000 7f2b3a999700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3410e550 con 0x7f2b340fcfb0 2024-04-16T14:32:30.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.215+0000 7f2b3a999700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b34112ea0 con 0x7f2b340fbd00 2024-04-16T14:32:30.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.215+0000 7f2b337fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b340fcfb0 0x7f2b3410dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:30.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.215+0000 7f2b337fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b340fcfb0 0x7f2b3410dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44224/0 (socket says 172.21.15.5:44224) 2024-04-16T14:32:30.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.215+0000 7f2b337fe700 1 -- 172.21.15.5:0/3759262687 learned_addr learned my addr 172.21.15.5:0/3759262687 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:32:30.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.215+0000 7f2b33fff700 1 --2- 172.21.15.5:0/3759262687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b340fbd00 0x7f2b3410d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:30.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.215+0000 7f2b337fe700 1 -- 172.21.15.5:0/3759262687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b340fbd00 msgr2=0x7f2b3410d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:30.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.215+0000 7f2b337fe700 1 --2- 172.21.15.5:0/3759262687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b340fbd00 0x7f2b3410d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:30.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.215+0000 7f2b337fe700 1 -- 172.21.15.5:0/3759262687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b24005040 con 0x7f2b340fcfb0 2024-04-16T14:32:30.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.215+0000 7f2b337fe700 1 --2- 172.21.15.5:0/3759262687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b340fcfb0 0x7f2b3410dec0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2b2800b790 tx=0x7f2b28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:30.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.216+0000 7f2b30ff9700 1 -- 172.21.15.5:0/3759262687 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b2800f770 con 0x7f2b340fcfb0 2024-04-16T14:32:30.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.216+0000 7f2b30ff9700 1 -- 172.21.15.5:0/3759262687 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2b2800fda0 con 0x7f2b340fcfb0 2024-04-16T14:32:30.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.216+0000 7f2b3a999700 1 -- 172.21.15.5:0/3759262687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b34113100 con 0x7f2b340fcfb0 2024-04-16T14:32:30.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.216+0000 7f2b30ff9700 1 -- 172.21.15.5:0/3759262687 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b2800d310 con 0x7f2b340fcfb0 2024-04-16T14:32:30.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.216+0000 7f2b3a999700 1 -- 172.21.15.5:0/3759262687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b34113670 con 0x7f2b340fcfb0 2024-04-16T14:32:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.217+0000 7f2b3a999700 1 -- 172.21.15.5:0/3759262687 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b34101b40 con 0x7f2b340fcfb0 2024-04-16T14:32:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.217+0000 7f2b30ff9700 1 -- 172.21.15.5:0/3759262687 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f2b28010420 con 0x7f2b340fcfb0 2024-04-16T14:32:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.217+0000 7f2b30ff9700 1 --2- 172.21.15.5:0/3759262687 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f2b1c0692a0 0x7f2b1c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.218+0000 7f2b30ff9700 1 -- 172.21.15.5:0/3759262687 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2b28086e80 con 0x7f2b340fcfb0 2024-04-16T14:32:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.218+0000 7f2b33fff700 1 --2- 172.21.15.5:0/3759262687 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f2b1c0692a0 0x7f2b1c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:30.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.218+0000 7f2b33fff700 1 --2- 172.21.15.5:0/3759262687 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f2b1c0692a0 0x7f2b1c06b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400b3b0 tx=0x7f2b24009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:30.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.222+0000 7f2b30ff9700 1 -- 172.21.15.5:0/3759262687 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2b28056f80 con 0x7f2b340fcfb0 2024-04-16T14:32:30.220 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:29 smithi005 ceph-mon[28964]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:30.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.430+0000 7f2b3a999700 1 -- 172.21.15.5:0/3759262687 --> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b3402b340 con 0x7f2b1c0692a0 2024-04-16T14:32:30.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.431+0000 7f2b30ff9700 1 -- 172.21.15.5:0/3759262687 <== mgr.14212 v2:172.21.15.5:6800/3841652776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f2b3402b340 con 0x7f2b1c0692a0 2024-04-16T14:32:30.429 INFO:teuthology.orchestra.run.smithi005.stdout:Backend: cephadm 2024-04-16T14:32:30.429 INFO:teuthology.orchestra.run.smithi005.stdout:Available: Yes 2024-04-16T14:32:30.429 INFO:teuthology.orchestra.run.smithi005.stdout:Paused: No 2024-04-16T14:32:30.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:29 smithi115 ceph-mon[37295]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:30.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.433+0000 7f2b3a999700 1 -- 172.21.15.5:0/3759262687 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f2b1c0692a0 msgr2=0x7f2b1c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.433+0000 7f2b3a999700 1 --2- 172.21.15.5:0/3759262687 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f2b1c0692a0 0x7f2b1c06b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400b3b0 tx=0x7f2b24009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.433+0000 7f2b3a999700 1 -- 172.21.15.5:0/3759262687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b340fcfb0 msgr2=0x7f2b3410dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.433+0000 7f2b3a999700 1 --2- 172.21.15.5:0/3759262687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b340fcfb0 0x7f2b3410dec0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2b2800b790 tx=0x7f2b28009250 comp rx=0 tx=0).stop 2024-04-16T14:32:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.433+0000 7f2b3a999700 1 -- 172.21.15.5:0/3759262687 shutdown_connections 2024-04-16T14:32:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.433+0000 7f2b3a999700 1 --2- 172.21.15.5:0/3759262687 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f2b1c0692a0 0x7f2b1c06b750 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.433+0000 7f2b3a999700 1 --2- 172.21.15.5:0/3759262687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b340fbd00 0x7f2b3410d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.433+0000 7f2b3a999700 1 --2- 172.21.15.5:0/3759262687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b340fcfb0 0x7f2b3410dec0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.433+0000 7f2b3a999700 1 -- 172.21.15.5:0/3759262687 >> 172.21.15.5:0/3759262687 conn(0x7f2b340f7440 msgr2=0x7f2b34066730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.433+0000 7f2b3a999700 1 -- 172.21.15.5:0/3759262687 shutdown_connections 2024-04-16T14:32:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:30.433+0000 7f2b3a999700 1 -- 172.21.15.5:0/3759262687 wait complete. 2024-04-16T14:32:31.033 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- bash -c 'ceph orch ps' 2024-04-16T14:32:31.299 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:32:32.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:31 smithi005 ceph-mon[28964]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:32:32.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:31 smithi005 ceph-mon[28964]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:32.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:31 smithi115 ceph-mon[37295]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:32:32.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:31 smithi115 ceph-mon[37295]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:32.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.743+0000 7f6e0d202700 1 -- 172.21.15.5:0/4107476948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e080ffd80 msgr2=0x7f6e081021a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:32.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.743+0000 7f6e0d202700 1 --2- 172.21.15.5:0/4107476948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e080ffd80 0x7f6e081021a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc004940 tx=0x7f6dfc009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:32.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.743+0000 7f6e0d202700 1 -- 172.21.15.5:0/4107476948 shutdown_connections 2024-04-16T14:32:32.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.743+0000 7f6e0d202700 1 --2- 172.21.15.5:0/4107476948 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e080ffd80 0x7f6e081021a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:32.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.743+0000 7f6e0d202700 1 --2- 172.21.15.5:0/4107476948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e08066dc0 0x7f6e080ff840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:32.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.743+0000 7f6e0d202700 1 -- 172.21.15.5:0/4107476948 >> 172.21.15.5:0/4107476948 conn(0x7f6e080f72d0 msgr2=0x7f6e080f96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:32.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.743+0000 7f6e0d202700 1 -- 172.21.15.5:0/4107476948 shutdown_connections 2024-04-16T14:32:32.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.743+0000 7f6e0d202700 1 -- 172.21.15.5:0/4107476948 wait complete. 2024-04-16T14:32:32.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.744+0000 7f6e0d202700 1 Processor -- start 2024-04-16T14:32:32.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.744+0000 7f6e0d202700 1 -- start start 2024-04-16T14:32:32.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.744+0000 7f6e0d202700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e08066dc0 0x7f6e080fd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:32.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.744+0000 7f6e0d202700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e080ffd80 0x7f6e080fb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:32.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.744+0000 7f6e0d202700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e080fbcf0 con 0x7f6e08066dc0 2024-04-16T14:32:32.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.744+0000 7f6e0d202700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e080fbe60 con 0x7f6e080ffd80 2024-04-16T14:32:32.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.744+0000 7f6e06d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e08066dc0 0x7f6e080fd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:32.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.744+0000 7f6e06d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e08066dc0 0x7f6e080fd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44230/0 (socket says 172.21.15.5:44230) 2024-04-16T14:32:32.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.744+0000 7f6e06d9d700 1 -- 172.21.15.5:0/1315390841 learned_addr learned my addr 172.21.15.5:0/1315390841 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:32:32.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.744+0000 7f6e0659c700 1 --2- 172.21.15.5:0/1315390841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e080ffd80 0x7f6e080fb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:32.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.745+0000 7f6e06d9d700 1 -- 172.21.15.5:0/1315390841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e080ffd80 msgr2=0x7f6e080fb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:32.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.745+0000 7f6e06d9d700 1 --2- 172.21.15.5:0/1315390841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e080ffd80 0x7f6e080fb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:32.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.745+0000 7f6e06d9d700 1 -- 172.21.15.5:0/1315390841 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dfc005040 con 0x7f6e08066dc0 2024-04-16T14:32:32.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.745+0000 7f6e06d9d700 1 --2- 172.21.15.5:0/1315390841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e08066dc0 0x7f6e080fd270 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6df800c890 tx=0x7f6df80044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:32.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.745+0000 7f6def7fe700 1 -- 172.21.15.5:0/1315390841 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6df800a700 con 0x7f6e08066dc0 2024-04-16T14:32:32.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.745+0000 7f6e0d202700 1 -- 172.21.15.5:0/1315390841 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e080fc140 con 0x7f6e08066dc0 2024-04-16T14:32:32.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.745+0000 7f6def7fe700 1 -- 172.21.15.5:0/1315390841 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6df800ad30 con 0x7f6e08066dc0 2024-04-16T14:32:32.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.745+0000 7f6def7fe700 1 -- 172.21.15.5:0/1315390841 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6df80113a0 con 0x7f6e08066dc0 2024-04-16T14:32:32.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.745+0000 7f6e0d202700 1 -- 172.21.15.5:0/1315390841 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e081158b0 con 0x7f6e08066dc0 2024-04-16T14:32:32.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.746+0000 7f6e0d202700 1 -- 172.21.15.5:0/1315390841 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e080faf50 con 0x7f6e08066dc0 2024-04-16T14:32:32.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.747+0000 7f6def7fe700 1 -- 172.21.15.5:0/1315390841 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f6df8012400 con 0x7f6e08066dc0 2024-04-16T14:32:32.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.747+0000 7f6def7fe700 1 --2- 172.21.15.5:0/1315390841 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6df00692a0 0x7f6df006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:32.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.747+0000 7f6def7fe700 1 -- 172.21.15.5:0/1315390841 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6df8086f10 con 0x7f6e08066dc0 2024-04-16T14:32:32.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.747+0000 7f6e0659c700 1 --2- 172.21.15.5:0/1315390841 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6df00692a0 0x7f6df006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:32.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.748+0000 7f6e0659c700 1 --2- 172.21.15.5:0/1315390841 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6df00692a0 0x7f6df006b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00b3b0 tx=0x7f6dfc009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:32.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.752+0000 7f6def7fe700 1 -- 172.21.15.5:0/1315390841 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6df8053580 con 0x7f6e08066dc0 2024-04-16T14:32:32.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.955+0000 7f6e0d202700 1 -- 172.21.15.5:0/1315390841 --> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e080f8dc0 con 0x7f6df00692a0 2024-04-16T14:32:32.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.963+0000 7f6def7fe700 1 -- 172.21.15.5:0/1315390841 <== mgr.14212 v2:172.21.15.5:6800/3841652776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2682 (secure 0 0 0) 0x7f6e080f8dc0 con 0x7f6df00692a0 2024-04-16T14:32:32.962 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-16T14:32:32.962 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.smithi005 smithi005 *:9093,9094 running (3m) 2m ago 5m 26.7M - 0.25.0 c8568f914cd2 0f1dad05c95e 2024-04-16T14:32:32.962 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi005 smithi005 running (5m) 2m ago 5m 6669k - 17.2.7-868-g412a5526 b04d96489b7c 6a380d6ec070 2024-04-16T14:32:32.963 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi115 smithi115 running (4m) 68s ago 4m 6665k - 17.2.7-868-g412a5526 b04d96489b7c df7cb0bfe65b 2024-04-16T14:32:32.963 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.smithi005 smithi005 *:3000 running (3m) 2m ago 4m 77.3M - 9.4.7 954c08fa6188 e6011313e3be 2024-04-16T14:32:32.963 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi005.ipwdkc smithi005 *:9283 running (6m) 2m ago 6m 472M - 17.2.7-868-g412a5526 b04d96489b7c 53fb89eec045 2024-04-16T14:32:32.963 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi115.brjkpo smithi115 *:8443,9283 running (4m) 68s ago 4m 433M - 17.2.7-868-g412a5526 b04d96489b7c 6eb664cfe6b2 2024-04-16T14:32:32.963 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi005 smithi005 running (6m) 2m ago 6m 41.3M 2048M 17.2.7-868-g412a5526 b04d96489b7c 764b6a128874 2024-04-16T14:32:32.963 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi115 smithi115 running (4m) 68s ago 4m 38.7M 2048M 17.2.7-868-g412a5526 b04d96489b7c feb5354cdbe9 2024-04-16T14:32:32.963 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi005 smithi005 *:9100 running (5m) 2m ago 5m 14.1M - 1.5.0 0da6a335fe13 16f9701011ea 2024-04-16T14:32:32.963 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi115 smithi115 *:9100 running (4m) 68s ago 4m 16.3M - 1.5.0 0da6a335fe13 38c140c04a1e 2024-04-16T14:32:32.963 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (3m) 2m ago 3m 38.7M 4289M 17.2.7-868-g412a5526 b04d96489b7c ed7aa0542d96 2024-04-16T14:32:32.963 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (2m) 2m ago 2m 43.1M 4289M 17.2.7-868-g412a5526 b04d96489b7c 1868cc6c89f4 2024-04-16T14:32:32.963 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (2m) 2m ago 2m 38.7M 4289M 17.2.7-868-g412a5526 b04d96489b7c b12745ae7d18 2024-04-16T14:32:32.963 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi115 running (2m) 68s ago 2m 39.9M 5312M 17.2.7-868-g412a5526 b04d96489b7c 59f81301ebcf 2024-04-16T14:32:32.964 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi115 running (99s) 68s ago 98s 36.0M 5312M 17.2.7-868-g412a5526 b04d96489b7c e3ea96b7edd9 2024-04-16T14:32:32.964 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi115 running (73s) 68s ago 72s 13.5M 5312M 17.2.7-868-g412a5526 b04d96489b7c 456fa074e453 2024-04-16T14:32:32.964 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.smithi005 smithi005 *:9095 running (3m) 2m ago 4m 38.1M - 2.43.0 a07b618ecd1d 813f7bfd1439 2024-04-16T14:32:32.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.965+0000 7f6e0d202700 1 -- 172.21.15.5:0/1315390841 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6df00692a0 msgr2=0x7f6df006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:32.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.965+0000 7f6e0d202700 1 --2- 172.21.15.5:0/1315390841 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6df00692a0 0x7f6df006b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00b3b0 tx=0x7f6dfc009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:32.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.965+0000 7f6e0d202700 1 -- 172.21.15.5:0/1315390841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e08066dc0 msgr2=0x7f6e080fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:32.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.965+0000 7f6e0d202700 1 --2- 172.21.15.5:0/1315390841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e08066dc0 0x7f6e080fd270 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6df800c890 tx=0x7f6df80044c0 comp rx=0 tx=0).stop 2024-04-16T14:32:32.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.965+0000 7f6e0d202700 1 -- 172.21.15.5:0/1315390841 shutdown_connections 2024-04-16T14:32:32.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.965+0000 7f6e0d202700 1 --2- 172.21.15.5:0/1315390841 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6df00692a0 0x7f6df006b750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:32.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.965+0000 7f6e0d202700 1 --2- 172.21.15.5:0/1315390841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e08066dc0 0x7f6e080fd270 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:32.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.965+0000 7f6e0d202700 1 --2- 172.21.15.5:0/1315390841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e080ffd80 0x7f6e080fb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:32.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.965+0000 7f6e0d202700 1 -- 172.21.15.5:0/1315390841 >> 172.21.15.5:0/1315390841 conn(0x7f6e080f72d0 msgr2=0x7f6e080f76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:32.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.965+0000 7f6e0d202700 1 -- 172.21.15.5:0/1315390841 shutdown_connections 2024-04-16T14:32:32.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:32.965+0000 7f6e0d202700 1 -- 172.21.15.5:0/1315390841 wait complete. 2024-04-16T14:32:33.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:32 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:32:33.332 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:32 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:32:33.577 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- bash -c 'ceph orch ls' 2024-04-16T14:32:33.844 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:32:34.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:33 smithi005 ceph-mon[28964]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:34.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:33 smithi005 ceph-mon[28964]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:32:34.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:33 smithi115 ceph-mon[37295]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:34.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:33 smithi115 ceph-mon[37295]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:32:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.434+0000 7f6365384700 1 -- 172.21.15.5:0/823044236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63600fcfd0 msgr2=0x7f63600fd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.434+0000 7f6365384700 1 --2- 172.21.15.5:0/823044236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63600fcfd0 0x7f63600fd440 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6354004940 tx=0x7f6354009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.434+0000 7f6365384700 1 -- 172.21.15.5:0/823044236 shutdown_connections 2024-04-16T14:32:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.434+0000 7f6365384700 1 --2- 172.21.15.5:0/823044236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63600fcfd0 0x7f63600fd440 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.434+0000 7f6365384700 1 --2- 172.21.15.5:0/823044236 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63600fbd20 0x7f63600fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.434+0000 7f6365384700 1 -- 172.21.15.5:0/823044236 >> 172.21.15.5:0/823044236 conn(0x7f63600f7480 msgr2=0x7f63600f98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.434+0000 7f6365384700 1 -- 172.21.15.5:0/823044236 shutdown_connections 2024-04-16T14:32:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.434+0000 7f6365384700 1 -- 172.21.15.5:0/823044236 wait complete. 2024-04-16T14:32:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.434+0000 7f6365384700 1 Processor -- start 2024-04-16T14:32:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.434+0000 7f6365384700 1 -- start start 2024-04-16T14:32:35.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.434+0000 7f6365384700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63600fbd20 0x7f6360066c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.434+0000 7f6365384700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63600fcfd0 0x7f6360114ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.434+0000 7f6365384700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636010e8a0 con 0x7f63600fcfd0 2024-04-16T14:32:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.434+0000 7f6365384700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6360115400 con 0x7f63600fbd20 2024-04-16T14:32:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.435+0000 7f635e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63600fcfd0 0x7f6360114ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.435+0000 7f635e7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63600fcfd0 0x7f6360114ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44250/0 (socket says 172.21.15.5:44250) 2024-04-16T14:32:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.435+0000 7f635e7fc700 1 -- 172.21.15.5:0/1891616624 learned_addr learned my addr 172.21.15.5:0/1891616624 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:32:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.435+0000 7f635effd700 1 --2- 172.21.15.5:0/1891616624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63600fbd20 0x7f6360066c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.435+0000 7f635e7fc700 1 -- 172.21.15.5:0/1891616624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63600fbd20 msgr2=0x7f6360066c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.435+0000 7f635e7fc700 1 --2- 172.21.15.5:0/1891616624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63600fbd20 0x7f6360066c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.435+0000 7f635e7fc700 1 -- 172.21.15.5:0/1891616624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6354005040 con 0x7f63600fcfd0 2024-04-16T14:32:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.435+0000 7f635e7fc700 1 --2- 172.21.15.5:0/1891616624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63600fcfd0 0x7f6360114ec0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6354009180 tx=0x7f6354009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.435+0000 7f63477fe700 1 -- 172.21.15.5:0/1891616624 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f635400e040 con 0x7f63600fcfd0 2024-04-16T14:32:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.435+0000 7f6365384700 1 -- 172.21.15.5:0/1891616624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6360115540 con 0x7f63600fcfd0 2024-04-16T14:32:35.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.435+0000 7f63477fe700 1 -- 172.21.15.5:0/1891616624 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f635400bbf0 con 0x7f63600fcfd0 2024-04-16T14:32:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.435+0000 7f63477fe700 1 -- 172.21.15.5:0/1891616624 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f635401c630 con 0x7f63600fcfd0 2024-04-16T14:32:35.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.435+0000 7f6365384700 1 -- 172.21.15.5:0/1891616624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6360115ad0 con 0x7f63600fcfd0 2024-04-16T14:32:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.436+0000 7f6365384700 1 -- 172.21.15.5:0/1891616624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f636004c710 con 0x7f63600fcfd0 2024-04-16T14:32:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.437+0000 7f63477fe700 1 -- 172.21.15.5:0/1891616624 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f635400bd60 con 0x7f63600fcfd0 2024-04-16T14:32:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.437+0000 7f63477fe700 1 --2- 172.21.15.5:0/1891616624 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f63480692a0 0x7f634806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.437+0000 7f63477fe700 1 -- 172.21.15.5:0/1891616624 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6354088180 con 0x7f63600fcfd0 2024-04-16T14:32:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.437+0000 7f635effd700 1 --2- 172.21.15.5:0/1891616624 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f63480692a0 0x7f634806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:35.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.438+0000 7f635effd700 1 --2- 172.21.15.5:0/1891616624 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f63480692a0 0x7f634806b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6358004f40 tx=0x7f635800b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:35.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.442+0000 7f63477fe700 1 -- 172.21.15.5:0/1891616624 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6354058330 con 0x7f63600fcfd0 2024-04-16T14:32:35.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.648+0000 7f6365384700 1 -- 172.21.15.5:0/1891616624 --> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f6360101340 con 0x7f63480692a0 2024-04-16T14:32:35.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.652+0000 7f63477fe700 1 -- 172.21.15.5:0/1891616624 <== mgr.14212 v2:172.21.15.5:6800/3841652776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1161 (secure 0 0 0) 0x7f6360101340 con 0x7f63480692a0 2024-04-16T14:32:35.651 INFO:teuthology.orchestra.run.smithi005.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-16T14:32:35.651 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-04-16T14:32:35.651 INFO:teuthology.orchestra.run.smithi005.stdout:crash 2/2 2m ago 6m * 2024-04-16T14:32:35.651 INFO:teuthology.orchestra.run.smithi005.stdout:grafana ?:3000 1/1 2m ago 6m count:1 2024-04-16T14:32:35.651 INFO:teuthology.orchestra.run.smithi005.stdout:mgr 2/2 2m ago 6m count:2 2024-04-16T14:32:35.651 INFO:teuthology.orchestra.run.smithi005.stdout:mon 2/2 2m ago 5m smithi005:172.21.15.5=smithi005;smithi115:172.21.15.115=smithi115;count:2 2024-04-16T14:32:35.651 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-04-16T14:32:35.651 INFO:teuthology.orchestra.run.smithi005.stdout:osd 6 2m ago - 2024-04-16T14:32:35.651 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus ?:9095 1/1 2m ago 6m count:1 2024-04-16T14:32:35.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.655+0000 7f6365384700 1 -- 172.21.15.5:0/1891616624 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f63480692a0 msgr2=0x7f634806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:35.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.655+0000 7f6365384700 1 --2- 172.21.15.5:0/1891616624 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f63480692a0 0x7f634806b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6358004f40 tx=0x7f635800b040 comp rx=0 tx=0).stop 2024-04-16T14:32:35.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.655+0000 7f6365384700 1 -- 172.21.15.5:0/1891616624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63600fcfd0 msgr2=0x7f6360114ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:35.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.655+0000 7f6365384700 1 --2- 172.21.15.5:0/1891616624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63600fcfd0 0x7f6360114ec0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6354009180 tx=0x7f6354009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:35.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.655+0000 7f6365384700 1 -- 172.21.15.5:0/1891616624 shutdown_connections 2024-04-16T14:32:35.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.655+0000 7f6365384700 1 --2- 172.21.15.5:0/1891616624 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f63480692a0 0x7f634806b750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:35.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.655+0000 7f6365384700 1 --2- 172.21.15.5:0/1891616624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63600fbd20 0x7f6360066c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:35.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.655+0000 7f6365384700 1 --2- 172.21.15.5:0/1891616624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63600fcfd0 0x7f6360114ec0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:35.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.655+0000 7f6365384700 1 -- 172.21.15.5:0/1891616624 >> 172.21.15.5:0/1891616624 conn(0x7f63600f7480 msgr2=0x7f63600f8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:35.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.655+0000 7f6365384700 1 -- 172.21.15.5:0/1891616624 shutdown_connections 2024-04-16T14:32:35.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:35.655+0000 7f6365384700 1 -- 172.21.15.5:0/1891616624 wait complete. 2024-04-16T14:32:36.358 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:35 smithi005 ceph-mon[28964]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:36.387 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- bash -c 'ceph orch host ls' 2024-04-16T14:32:36.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:35 smithi115 ceph-mon[37295]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:36.654 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:32:37.095 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:36 smithi005 ceph-mon[28964]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:32:37.246 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:36 smithi115 ceph-mon[37295]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:32:38.098 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:37 smithi005 ceph-mon[28964]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:38.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.303+0000 7fd7417da700 1 -- 172.21.15.5:0/2368647739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c0fff70 msgr2=0x7fd73c102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:38.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.303+0000 7fd7417da700 1 --2- 172.21.15.5:0/2368647739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c0fff70 0x7fd73c102390 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd724004940 tx=0x7fd724009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:38.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.303+0000 7fd7417da700 1 -- 172.21.15.5:0/2368647739 shutdown_connections 2024-04-16T14:32:38.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.303+0000 7fd7417da700 1 --2- 172.21.15.5:0/2368647739 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c0fff70 0x7fd73c102390 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:38.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.303+0000 7fd7417da700 1 --2- 172.21.15.5:0/2368647739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0662f0 0x7fd73c0ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:38.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.303+0000 7fd7417da700 1 -- 172.21.15.5:0/2368647739 >> 172.21.15.5:0/2368647739 conn(0x7fd73c0f74c0 msgr2=0x7fd73c0f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.303+0000 7fd7417da700 1 -- 172.21.15.5:0/2368647739 shutdown_connections 2024-04-16T14:32:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.303+0000 7fd7417da700 1 -- 172.21.15.5:0/2368647739 wait complete. 2024-04-16T14:32:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.303+0000 7fd7417da700 1 Processor -- start 2024-04-16T14:32:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.303+0000 7fd7417da700 1 -- start start 2024-04-16T14:32:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.304+0000 7fd7417da700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0662f0 0x7fd73c10da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.304+0000 7fd7417da700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c0fff70 0x7fd73c10dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.304+0000 7fd7417da700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c10e5a0 con 0x7fd73c0fff70 2024-04-16T14:32:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.304+0000 7fd7417da700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c10edf0 con 0x7fd73c0662f0 2024-04-16T14:32:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.304+0000 7fd73a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c0fff70 0x7fd73c10dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.304+0000 7fd73a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c0fff70 0x7fd73c10dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44256/0 (socket says 172.21.15.5:44256) 2024-04-16T14:32:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.304+0000 7fd73a7fc700 1 -- 172.21.15.5:0/101947363 learned_addr learned my addr 172.21.15.5:0/101947363 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:32:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.304+0000 7fd73affd700 1 --2- 172.21.15.5:0/101947363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0662f0 0x7fd73c10da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.304+0000 7fd73a7fc700 1 -- 172.21.15.5:0/101947363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0662f0 msgr2=0x7fd73c10da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.304+0000 7fd73a7fc700 1 --2- 172.21.15.5:0/101947363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0662f0 0x7fd73c10da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:38.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.304+0000 7fd73a7fc700 1 -- 172.21.15.5:0/101947363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd724005040 con 0x7fd73c0fff70 2024-04-16T14:32:38.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.304+0000 7fd73a7fc700 1 --2- 172.21.15.5:0/101947363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c0fff70 0x7fd73c10dfa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd72400b970 tx=0x7fd724009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:38.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.304+0000 7fd7337fe700 1 -- 172.21.15.5:0/101947363 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd72400e040 con 0x7fd73c0fff70 2024-04-16T14:32:38.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.304+0000 7fd7337fe700 1 -- 172.21.15.5:0/101947363 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd724004290 con 0x7fd73c0fff70 2024-04-16T14:32:38.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.304+0000 7fd7417da700 1 -- 172.21.15.5:0/101947363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd73c10f070 con 0x7fd73c0fff70 2024-04-16T14:32:38.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.304+0000 7fd7337fe700 1 -- 172.21.15.5:0/101947363 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd72401c630 con 0x7fd73c0fff70 2024-04-16T14:32:38.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.305+0000 7fd7417da700 1 -- 172.21.15.5:0/101947363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd73c10f5b0 con 0x7fd73c0fff70 2024-04-16T14:32:38.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.305+0000 7fd7417da700 1 -- 172.21.15.5:0/101947363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd73c05f5f0 con 0x7fd73c0fff70 2024-04-16T14:32:38.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.306+0000 7fd7337fe700 1 -- 172.21.15.5:0/101947363 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7fd72400bbf0 con 0x7fd73c0fff70 2024-04-16T14:32:38.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.306+0000 7fd7337fe700 1 --2- 172.21.15.5:0/101947363 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd7280692b0 0x7fd72806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:38.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.306+0000 7fd7337fe700 1 -- 172.21.15.5:0/101947363 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd724088110 con 0x7fd73c0fff70 2024-04-16T14:32:38.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.306+0000 7fd73affd700 1 --2- 172.21.15.5:0/101947363 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd7280692b0 0x7fd72806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:38.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.307+0000 7fd73affd700 1 --2- 172.21.15.5:0/101947363 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd7280692b0 0x7fd72806b760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd73c066030 tx=0x7fd73400b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:38.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.311+0000 7fd7337fe700 1 -- 172.21.15.5:0/101947363 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd724058210 con 0x7fd73c0fff70 2024-04-16T14:32:38.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:37 smithi115 ceph-mon[37295]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:38.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.517+0000 7fd7417da700 1 -- 172.21.15.5:0/101947363 --> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd73c10f8e0 con 0x7fd7280692b0 2024-04-16T14:32:38.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.518+0000 7fd7337fe700 1 -- 172.21.15.5:0/101947363 <== mgr.14212 v2:172.21.15.5:6800/3841652776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7fd73c10f8e0 con 0x7fd7280692b0 2024-04-16T14:32:38.516 INFO:teuthology.orchestra.run.smithi005.stdout:HOST ADDR LABELS STATUS 2024-04-16T14:32:38.516 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005 172.21.15.5 2024-04-16T14:32:38.516 INFO:teuthology.orchestra.run.smithi005.stdout:smithi115 172.21.15.115 2024-04-16T14:32:38.516 INFO:teuthology.orchestra.run.smithi005.stdout:2 hosts in cluster 2024-04-16T14:32:38.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.520+0000 7fd7417da700 1 -- 172.21.15.5:0/101947363 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd7280692b0 msgr2=0x7fd72806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:38.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.520+0000 7fd7417da700 1 --2- 172.21.15.5:0/101947363 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd7280692b0 0x7fd72806b760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd73c066030 tx=0x7fd73400b040 comp rx=0 tx=0).stop 2024-04-16T14:32:38.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.520+0000 7fd7417da700 1 -- 172.21.15.5:0/101947363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c0fff70 msgr2=0x7fd73c10dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:38.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.520+0000 7fd7417da700 1 --2- 172.21.15.5:0/101947363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c0fff70 0x7fd73c10dfa0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd72400b970 tx=0x7fd724009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:38.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.520+0000 7fd7417da700 1 -- 172.21.15.5:0/101947363 shutdown_connections 2024-04-16T14:32:38.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.520+0000 7fd7417da700 1 --2- 172.21.15.5:0/101947363 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd7280692b0 0x7fd72806b760 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:38.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.520+0000 7fd7417da700 1 --2- 172.21.15.5:0/101947363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0662f0 0x7fd73c10da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:38.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.520+0000 7fd7417da700 1 --2- 172.21.15.5:0/101947363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c0fff70 0x7fd73c10dfa0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:38.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.520+0000 7fd7417da700 1 -- 172.21.15.5:0/101947363 >> 172.21.15.5:0/101947363 conn(0x7fd73c0f74c0 msgr2=0x7fd73c0f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:38.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.520+0000 7fd7417da700 1 -- 172.21.15.5:0/101947363 shutdown_connections 2024-04-16T14:32:38.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:38.520+0000 7fd7417da700 1 -- 172.21.15.5:0/101947363 wait complete. 2024-04-16T14:32:39.112 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- bash -c 'ceph orch device ls' 2024-04-16T14:32:39.372 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:32:40.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:39 smithi005 ceph-mon[28964]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:32:40.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:39 smithi005 ceph-mon[28964]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:40.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:39 smithi115 ceph-mon[37295]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:32:40.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:39 smithi115 ceph-mon[37295]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:40.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.951+0000 7f0cb7294700 1 -- 172.21.15.5:0/1021884568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cb00fdcd0 msgr2=0x7f0cb0104620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:40.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.951+0000 7f0cb7294700 1 --2- 172.21.15.5:0/1021884568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cb00fdcd0 0x7f0cb0104620 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0004940 tx=0x7f0ca0009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:40.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.951+0000 7f0cb7294700 1 -- 172.21.15.5:0/1021884568 shutdown_connections 2024-04-16T14:32:40.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.951+0000 7f0cb7294700 1 --2- 172.21.15.5:0/1021884568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cb00fdcd0 0x7f0cb0104620 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:40.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.951+0000 7f0cb7294700 1 --2- 172.21.15.5:0/1021884568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cb00fd380 0x7f0cb00fd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:40.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.951+0000 7f0cb7294700 1 -- 172.21.15.5:0/1021884568 >> 172.21.15.5:0/1021884568 conn(0x7f0cb00f6bf0 msgr2=0x7f0cb00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:40.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.951+0000 7f0cb7294700 1 -- 172.21.15.5:0/1021884568 shutdown_connections 2024-04-16T14:32:40.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.951+0000 7f0cb7294700 1 -- 172.21.15.5:0/1021884568 wait complete. 2024-04-16T14:32:40.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.952+0000 7f0cb7294700 1 Processor -- start 2024-04-16T14:32:40.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.952+0000 7f0cb7294700 1 -- start start 2024-04-16T14:32:40.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.952+0000 7f0cb7294700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cb00fd380 0x7f0cb010fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:40.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.952+0000 7f0cb7294700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cb00fdcd0 0x7f0cb0110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:40.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.952+0000 7f0cb7294700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb0110680 con 0x7f0cb00fdcd0 2024-04-16T14:32:40.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.952+0000 7f0cb7294700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb01107f0 con 0x7f0cb00fd380 2024-04-16T14:32:40.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.952+0000 7f0cb482f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cb00fdcd0 0x7f0cb0110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:40.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.952+0000 7f0cb482f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cb00fdcd0 0x7f0cb0110080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45870/0 (socket says 172.21.15.5:45870) 2024-04-16T14:32:40.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.952+0000 7f0cb482f700 1 -- 172.21.15.5:0/3208699253 learned_addr learned my addr 172.21.15.5:0/3208699253 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:32:40.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.952+0000 7f0cb5030700 1 --2- 172.21.15.5:0/3208699253 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cb00fd380 0x7f0cb010fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:40.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.953+0000 7f0cb482f700 1 -- 172.21.15.5:0/3208699253 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cb00fd380 msgr2=0x7f0cb010fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:40.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.953+0000 7f0cb482f700 1 --2- 172.21.15.5:0/3208699253 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cb00fd380 0x7f0cb010fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:40.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.953+0000 7f0cb482f700 1 -- 172.21.15.5:0/3208699253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca0005040 con 0x7f0cb00fdcd0 2024-04-16T14:32:40.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.953+0000 7f0cb482f700 1 --2- 172.21.15.5:0/3208699253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cb00fdcd0 0x7f0cb0110080 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0ca000b3b0 tx=0x7f0ca0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:40.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.953+0000 7f0ca5ffb700 1 -- 172.21.15.5:0/3208699253 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ca000e040 con 0x7f0cb00fdcd0 2024-04-16T14:32:40.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.953+0000 7f0ca5ffb700 1 -- 172.21.15.5:0/3208699253 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ca0004290 con 0x7f0cb00fdcd0 2024-04-16T14:32:40.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.953+0000 7f0cb7294700 1 -- 172.21.15.5:0/3208699253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb01151f0 con 0x7f0cb00fdcd0 2024-04-16T14:32:40.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.953+0000 7f0ca5ffb700 1 -- 172.21.15.5:0/3208699253 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ca001c3f0 con 0x7f0cb00fdcd0 2024-04-16T14:32:40.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.953+0000 7f0cb7294700 1 -- 172.21.15.5:0/3208699253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb01157b0 con 0x7f0cb00fdcd0 2024-04-16T14:32:40.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.954+0000 7f0cb7294700 1 -- 172.21.15.5:0/3208699253 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb004c710 con 0x7f0cb00fdcd0 2024-04-16T14:32:40.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.954+0000 7f0ca5ffb700 1 -- 172.21.15.5:0/3208699253 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f0ca000bbf0 con 0x7f0cb00fdcd0 2024-04-16T14:32:40.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.955+0000 7f0ca5ffb700 1 --2- 172.21.15.5:0/3208699253 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f0c9c0692a0 0x7f0c9c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:40.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.955+0000 7f0ca5ffb700 1 -- 172.21.15.5:0/3208699253 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0ca0088160 con 0x7f0cb00fdcd0 2024-04-16T14:32:40.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.955+0000 7f0cb5030700 1 --2- 172.21.15.5:0/3208699253 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f0c9c0692a0 0x7f0c9c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:40.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.956+0000 7f0cb5030700 1 --2- 172.21.15.5:0/3208699253 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f0c9c0692a0 0x7f0c9c06b750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0cac004990 tx=0x7f0cac009ee0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:40.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:40.960+0000 7f0ca5ffb700 1 -- 172.21.15.5:0/3208699253 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0ca0058260 con 0x7f0cb00fdcd0 2024-04-16T14:32:41.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:41.164+0000 7f0cb7294700 1 -- 172.21.15.5:0/3208699253 --> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f0cb00f8730 con 0x7f0c9c0692a0 2024-04-16T14:32:41.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:41.166+0000 7f0ca5ffb700 1 -- 172.21.15.5:0/3208699253 <== mgr.14212 v2:172.21.15.5:6800/3841652776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f0cb00f8730 con 0x7f0c9c0692a0 2024-04-16T14:32:41.164 INFO:teuthology.orchestra.run.smithi005.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-16T14:32:41.164 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300EW480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-04-16T14:32:41.164 INFO:teuthology.orchestra.run.smithi005.stdout:smithi115 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400UU400BGN 372G No 73s ago Has a FileSystem, LVM detected 2024-04-16T14:32:41.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:41.168+0000 7f0cb7294700 1 -- 172.21.15.5:0/3208699253 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f0c9c0692a0 msgr2=0x7f0c9c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:41.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:41.168+0000 7f0cb7294700 1 --2- 172.21.15.5:0/3208699253 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f0c9c0692a0 0x7f0c9c06b750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0cac004990 tx=0x7f0cac009ee0 comp rx=0 tx=0).stop 2024-04-16T14:32:41.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:41.168+0000 7f0cb7294700 1 -- 172.21.15.5:0/3208699253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cb00fdcd0 msgr2=0x7f0cb0110080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:41.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:41.168+0000 7f0cb7294700 1 --2- 172.21.15.5:0/3208699253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cb00fdcd0 0x7f0cb0110080 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0ca000b3b0 tx=0x7f0ca0009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:41.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:41.168+0000 7f0cb7294700 1 -- 172.21.15.5:0/3208699253 shutdown_connections 2024-04-16T14:32:41.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:41.168+0000 7f0cb7294700 1 --2- 172.21.15.5:0/3208699253 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f0c9c0692a0 0x7f0c9c06b750 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:41.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:41.168+0000 7f0cb7294700 1 --2- 172.21.15.5:0/3208699253 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cb00fd380 0x7f0cb010fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:41.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:41.168+0000 7f0cb7294700 1 --2- 172.21.15.5:0/3208699253 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0cb00fdcd0 0x7f0cb0110080 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:41.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:41.168+0000 7f0cb7294700 1 -- 172.21.15.5:0/3208699253 >> 172.21.15.5:0/3208699253 conn(0x7f0cb00f6bf0 msgr2=0x7f0cb00f7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:41.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:41.168+0000 7f0cb7294700 1 -- 172.21.15.5:0/3208699253 shutdown_connections 2024-04-16T14:32:41.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:41.168+0000 7f0cb7294700 1 -- 172.21.15.5:0/3208699253 wait complete. 2024-04-16T14:32:41.785 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-16T14:32:41.800 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi005.front.sepia.ceph.com 2024-04-16T14:32:41.800 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-04-16T14:32:42.064 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:32:42.186 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:41 smithi005 ceph-mon[28964]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:42.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:41 smithi115 ceph-mon[37295]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:43.166 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:42 smithi005 ceph-mon[28964]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:32:43.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:43 smithi115 ceph-mon[37295]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:32:43.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.723+0000 7f8639e65700 1 -- 172.21.15.5:0/1970661729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86340fe060 msgr2=0x7f86340fe4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:43.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.723+0000 7f8639e65700 1 --2- 172.21.15.5:0/1970661729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86340fe060 0x7f86340fe4d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f861c004940 tx=0x7f861c009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:43.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.723+0000 7f8639e65700 1 -- 172.21.15.5:0/1970661729 shutdown_connections 2024-04-16T14:32:43.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.723+0000 7f8639e65700 1 --2- 172.21.15.5:0/1970661729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86340fe060 0x7f86340fe4d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:43.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.723+0000 7f8639e65700 1 --2- 172.21.15.5:0/1970661729 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86340fce60 0x7f86340fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:43.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.723+0000 7f8639e65700 1 -- 172.21.15.5:0/1970661729 >> 172.21.15.5:0/1970661729 conn(0x7f86340f8570 msgr2=0x7f86340fa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:43.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.723+0000 7f8639e65700 1 -- 172.21.15.5:0/1970661729 shutdown_connections 2024-04-16T14:32:43.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.723+0000 7f8639e65700 1 -- 172.21.15.5:0/1970661729 wait complete. 2024-04-16T14:32:43.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.724+0000 7f8639e65700 1 Processor -- start 2024-04-16T14:32:43.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.724+0000 7f8639e65700 1 -- start start 2024-04-16T14:32:43.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.724+0000 7f8639e65700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86340fce60 0x7f863410da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:43.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.724+0000 7f8639e65700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86340fe060 0x7f863410dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:43.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.724+0000 7f8639e65700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863410e630 con 0x7f86340fce60 2024-04-16T14:32:43.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.724+0000 7f8639e65700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863410ee20 con 0x7f86340fe060 2024-04-16T14:32:43.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.724+0000 7f86337fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86340fce60 0x7f863410da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:43.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.724+0000 7f86337fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86340fce60 0x7f863410da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45886/0 (socket says 172.21.15.5:45886) 2024-04-16T14:32:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.724+0000 7f86337fe700 1 -- 172.21.15.5:0/2410363647 learned_addr learned my addr 172.21.15.5:0/2410363647 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:32:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.724+0000 7f8632ffd700 1 --2- 172.21.15.5:0/2410363647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86340fe060 0x7f863410dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.725+0000 7f86337fe700 1 -- 172.21.15.5:0/2410363647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86340fe060 msgr2=0x7f863410dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.725+0000 7f86337fe700 1 --2- 172.21.15.5:0/2410363647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86340fe060 0x7f863410dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.725+0000 7f86337fe700 1 -- 172.21.15.5:0/2410363647 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861c005040 con 0x7f86340fce60 2024-04-16T14:32:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.725+0000 7f8632ffd700 1 --2- 172.21.15.5:0/2410363647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86340fe060 0x7f863410dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T14:32:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.725+0000 7f86337fe700 1 --2- 172.21.15.5:0/2410363647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86340fce60 0x7f863410da60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f862400bae0 tx=0x7f8624009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.725+0000 7f862bfff700 1 -- 172.21.15.5:0/2410363647 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f862400c8c0 con 0x7f86340fce60 2024-04-16T14:32:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.725+0000 7f8639e65700 1 -- 172.21.15.5:0/2410363647 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f863410f100 con 0x7f86340fce60 2024-04-16T14:32:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.725+0000 7f862bfff700 1 -- 172.21.15.5:0/2410363647 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8624014410 con 0x7f86340fce60 2024-04-16T14:32:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.725+0000 7f8639e65700 1 -- 172.21.15.5:0/2410363647 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f863410f6c0 con 0x7f86340fce60 2024-04-16T14:32:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.725+0000 7f862bfff700 1 -- 172.21.15.5:0/2410363647 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8624007610 con 0x7f86340fce60 2024-04-16T14:32:43.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.726+0000 7f8639e65700 1 -- 172.21.15.5:0/2410363647 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f863405f5f0 con 0x7f86340fce60 2024-04-16T14:32:43.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.727+0000 7f862bfff700 1 -- 172.21.15.5:0/2410363647 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f8624007880 con 0x7f86340fce60 2024-04-16T14:32:43.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.727+0000 7f862bfff700 1 --2- 172.21.15.5:0/2410363647 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f86200692b0 0x7f862006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:43.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.727+0000 7f862bfff700 1 -- 172.21.15.5:0/2410363647 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8624086fc0 con 0x7f86340fce60 2024-04-16T14:32:43.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.727+0000 7f8632ffd700 1 --2- 172.21.15.5:0/2410363647 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f86200692b0 0x7f862006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:43.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.727+0000 7f8632ffd700 1 --2- 172.21.15.5:0/2410363647 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f86200692b0 0x7f862006b760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f861c00b3b0 tx=0x7f861c009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:43.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.732+0000 7f862bfff700 1 -- 172.21.15.5:0/2410363647 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f862404d250 con 0x7f86340fce60 2024-04-16T14:32:43.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:43.956+0000 7f8639e65700 1 -- 172.21.15.5:0/2410363647 --> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f863410f9a0 con 0x7f86200692b0 2024-04-16T14:32:44.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:44 smithi115 ceph-mon[37295]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:44.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:44 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-16T14:32:44.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:44 smithi005 ceph-mon[28964]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:44.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:44 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-16T14:32:45.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:45.289+0000 7f862bfff700 1 -- 172.21.15.5:0/2410363647 <== mgr.14212 v2:172.21.15.5:6800/3841652776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f863410f9a0 con 0x7f86200692b0 2024-04-16T14:32:45.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:45.293+0000 7f8639e65700 1 -- 172.21.15.5:0/2410363647 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f86200692b0 msgr2=0x7f862006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:45.293+0000 7f8639e65700 1 --2- 172.21.15.5:0/2410363647 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f86200692b0 0x7f862006b760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f861c00b3b0 tx=0x7f861c009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:45.293+0000 7f8639e65700 1 -- 172.21.15.5:0/2410363647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86340fce60 msgr2=0x7f863410da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:45.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:45.293+0000 7f8639e65700 1 --2- 172.21.15.5:0/2410363647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86340fce60 0x7f863410da60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f862400bae0 tx=0x7f8624009810 comp rx=0 tx=0).stop 2024-04-16T14:32:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:45.294+0000 7f8639e65700 1 -- 172.21.15.5:0/2410363647 shutdown_connections 2024-04-16T14:32:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:45.294+0000 7f8639e65700 1 --2- 172.21.15.5:0/2410363647 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f86200692b0 0x7f862006b760 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:45.294+0000 7f8639e65700 1 --2- 172.21.15.5:0/2410363647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86340fce60 0x7f863410da60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:45.294+0000 7f8639e65700 1 --2- 172.21.15.5:0/2410363647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86340fe060 0x7f863410dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:45.294+0000 7f8639e65700 1 -- 172.21.15.5:0/2410363647 >> 172.21.15.5:0/2410363647 conn(0x7f86340f8570 msgr2=0x7f86340f9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:45.294+0000 7f8639e65700 1 -- 172.21.15.5:0/2410363647 shutdown_connections 2024-04-16T14:32:45.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:45.294+0000 7f8639e65700 1 -- 172.21.15.5:0/2410363647 wait complete. 2024-04-16T14:32:45.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:45 smithi005 ceph-mon[28964]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:32:45.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:45 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-16T14:32:45.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:45 smithi005 ceph-mon[28964]: osdmap e42: 6 total, 6 up, 6 in 2024-04-16T14:32:45.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:45 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-16T14:32:45.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:45 smithi005 ceph-mon[28964]: pgmap v171: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:45.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:45 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi005[28960]: 2024-04-16T14:32:45.269+0000 7f0339e38700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-16T14:32:45.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:45 smithi115 ceph-mon[37295]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:32:45.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:45 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-16T14:32:45.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:45 smithi115 ceph-mon[37295]: osdmap e42: 6 total, 6 up, 6 in 2024-04-16T14:32:45.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:45 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-16T14:32:45.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:45 smithi115 ceph-mon[37295]: pgmap v171: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:45.898 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-16T14:32:46.181 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:32:46.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:46 smithi005 ceph-mon[28964]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-16T14:32:46.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:46 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-16T14:32:46.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:46 smithi005 ceph-mon[28964]: osdmap e43: 6 total, 6 up, 6 in 2024-04-16T14:32:46.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:46 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-16T14:32:46.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:46 smithi005 ceph-mon[28964]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-16T14:32:46.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:46 smithi005 ceph-mon[28964]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-16T14:32:46.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:46 smithi005 ceph-mon[28964]: osdmap e44: 6 total, 6 up, 6 in 2024-04-16T14:32:46.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:46 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-16T14:32:46.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:46 smithi005 ceph-mon[28964]: fsmap cephfs:0 2024-04-16T14:32:46.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:46 smithi005 ceph-mon[28964]: Saving service mds.cephfs spec with placement count:4 2024-04-16T14:32:46.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:46 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:46.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:46 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:32:46.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:46 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:32:46.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:46 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:32:46.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:46 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:46.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:46 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi005.vzoqdl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-16T14:32:46.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:46 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi005.vzoqdl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-16T14:32:46.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:46 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:32:46.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:46 smithi115 ceph-mon[37295]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-16T14:32:46.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:46 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-16T14:32:46.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:46 smithi115 ceph-mon[37295]: osdmap e43: 6 total, 6 up, 6 in 2024-04-16T14:32:46.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:46 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-16T14:32:46.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:46 smithi115 ceph-mon[37295]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-16T14:32:46.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:46 smithi115 ceph-mon[37295]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-16T14:32:46.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:46 smithi115 ceph-mon[37295]: osdmap e44: 6 total, 6 up, 6 in 2024-04-16T14:32:46.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:46 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-16T14:32:46.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:46 smithi115 ceph-mon[37295]: fsmap cephfs:0 2024-04-16T14:32:46.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:46 smithi115 ceph-mon[37295]: Saving service mds.cephfs spec with placement count:4 2024-04-16T14:32:46.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:46 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:46.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:46 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:32:46.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:46 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:32:46.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:46 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:32:46.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:46 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:46.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:46 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi005.vzoqdl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-16T14:32:46.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:46 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi005.vzoqdl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-16T14:32:46.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:46 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:32:47.551 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:47 smithi005 ceph-mon[28964]: Deploying daemon mds.cephfs.smithi005.vzoqdl on smithi005 2024-04-16T14:32:47.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:47 smithi005 ceph-mon[28964]: osdmap e45: 6 total, 6 up, 6 in 2024-04-16T14:32:47.552 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:47 smithi005 ceph-mon[28964]: pgmap v175: 65 pgs: 1 creating+activating, 6 creating+peering, 30 unknown, 28 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:47.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:47 smithi115 ceph-mon[37295]: Deploying daemon mds.cephfs.smithi005.vzoqdl on smithi005 2024-04-16T14:32:47.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:47 smithi115 ceph-mon[37295]: osdmap e45: 6 total, 6 up, 6 in 2024-04-16T14:32:47.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:47 smithi115 ceph-mon[37295]: pgmap v175: 65 pgs: 1 creating+activating, 6 creating+peering, 30 unknown, 28 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:48.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.300+0000 7f05b0544700 1 -- 172.21.15.5:0/3869674514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a80fed60 msgr2=0x7f05a80faea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:48.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.300+0000 7f05b0544700 1 --2- 172.21.15.5:0/3869674514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a80fed60 0x7f05a80faea0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0598004940 tx=0x7f0598009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:48.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.300+0000 7f05b0544700 1 -- 172.21.15.5:0/3869674514 shutdown_connections 2024-04-16T14:32:48.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.300+0000 7f05b0544700 1 --2- 172.21.15.5:0/3869674514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a80fed60 0x7f05a80faea0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:48.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.300+0000 7f05b0544700 1 --2- 172.21.15.5:0/3869674514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05a80fe410 0x7f05a80fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:48.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.300+0000 7f05b0544700 1 -- 172.21.15.5:0/3869674514 >> 172.21.15.5:0/3869674514 conn(0x7f05a80f6bd0 msgr2=0x7f05a80f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.300+0000 7f05b0544700 1 -- 172.21.15.5:0/3869674514 shutdown_connections 2024-04-16T14:32:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.301+0000 7f05b0544700 1 -- 172.21.15.5:0/3869674514 wait complete. 2024-04-16T14:32:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.301+0000 7f05b0544700 1 Processor -- start 2024-04-16T14:32:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.301+0000 7f05b0544700 1 -- start start 2024-04-16T14:32:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.301+0000 7f05b0544700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05a80fe410 0x7f05a810da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.301+0000 7f05b0544700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a80fed60 0x7f05a810dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.301+0000 7f05b0544700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a810e630 con 0x7f05a80fed60 2024-04-16T14:32:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.301+0000 7f05b0544700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a810edd0 con 0x7f05a80fe410 2024-04-16T14:32:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.301+0000 7f05adadf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a80fed60 0x7f05a810dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.301+0000 7f05adadf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a80fed60 0x7f05a810dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45914/0 (socket says 172.21.15.5:45914) 2024-04-16T14:32:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.301+0000 7f05adadf700 1 -- 172.21.15.5:0/1399389172 learned_addr learned my addr 172.21.15.5:0/1399389172 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:32:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.301+0000 7f05ae2e0700 1 --2- 172.21.15.5:0/1399389172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05a80fe410 0x7f05a810da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.302+0000 7f05adadf700 1 -- 172.21.15.5:0/1399389172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05a80fe410 msgr2=0x7f05a810da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.302+0000 7f05adadf700 1 --2- 172.21.15.5:0/1399389172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05a80fe410 0x7f05a810da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:48.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.302+0000 7f05adadf700 1 -- 172.21.15.5:0/1399389172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0598005040 con 0x7f05a80fed60 2024-04-16T14:32:48.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.302+0000 7f05adadf700 1 --2- 172.21.15.5:0/1399389172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a80fed60 0x7f05a810dfa0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0598009150 tx=0x7f0598009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:48.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.302+0000 7f059effd700 1 -- 172.21.15.5:0/1399389172 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f059800e040 con 0x7f05a80fed60 2024-04-16T14:32:48.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.302+0000 7f05b0544700 1 -- 172.21.15.5:0/1399389172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a810f050 con 0x7f05a80fed60 2024-04-16T14:32:48.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.302+0000 7f059effd700 1 -- 172.21.15.5:0/1399389172 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0598004290 con 0x7f05a80fed60 2024-04-16T14:32:48.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.302+0000 7f059effd700 1 -- 172.21.15.5:0/1399389172 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f059801c630 con 0x7f05a80fed60 2024-04-16T14:32:48.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.302+0000 7f05b0544700 1 -- 172.21.15.5:0/1399389172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a810f610 con 0x7f05a80fed60 2024-04-16T14:32:48.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.303+0000 7f05b0544700 1 -- 172.21.15.5:0/1399389172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a805f5f0 con 0x7f05a80fed60 2024-04-16T14:32:48.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.303+0000 7f059effd700 1 -- 172.21.15.5:0/1399389172 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f059800bbf0 con 0x7f05a80fed60 2024-04-16T14:32:48.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.304+0000 7f059effd700 1 --2- 172.21.15.5:0/1399389172 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f05940692a0 0x7f059406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:48.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.304+0000 7f059effd700 1 -- 172.21.15.5:0/1399389172 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0598087e70 con 0x7f05a80fed60 2024-04-16T14:32:48.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.304+0000 7f05ae2e0700 1 --2- 172.21.15.5:0/1399389172 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f05940692a0 0x7f059406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:48.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.304+0000 7f05ae2e0700 1 --2- 172.21.15.5:0/1399389172 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f05940692a0 0x7f059406b750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f05a4007580 tx=0x7f05a4009780 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:48.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.308+0000 7f059effd700 1 -- 172.21.15.5:0/1399389172 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0598057c30 con 0x7f05a80fed60 2024-04-16T14:32:48.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:48 smithi005 ceph-mon[28964]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-16T14:32:48.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:48 smithi005 ceph-mon[28964]: osdmap e46: 6 total, 6 up, 6 in 2024-04-16T14:32:48.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:48 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:48.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:48 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:32:48.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.550+0000 7f05b0544700 1 -- 172.21.15.5:0/1399389172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f05a810f8f0 con 0x7f05a80fed60 2024-04-16T14:32:48.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.550+0000 7f059effd700 1 -- 172.21.15.5:0/1399389172 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7f05980577c0 con 0x7f05a80fed60 2024-04-16T14:32:48.549 INFO:teuthology.orchestra.run.smithi005.stdout:e2 2024-04-16T14:32:48.549 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:32:48.549 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:32:48.549 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2024-04-16T14:32:48.549 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:32:48.549 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2024-04-16T14:32:48.549 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2024-04-16T14:32:48.549 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 2 2024-04-16T14:32:48.549 INFO:teuthology.orchestra.run.smithi005.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-16T14:32:48.549 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-16T14:32:45.270024+0000 2024-04-16T14:32:48.549 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-04-16T14:32:45.270103+0000 2024-04-16T14:32:48.549 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2024-04-16T14:32:48.550 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2024-04-16T14:32:48.550 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 60 2024-04-16T14:32:48.550 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2024-04-16T14:32:48.550 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2024-04-16T14:32:48.550 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2024-04-16T14:32:48.550 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2024-04-16T14:32:48.550 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 0 2024-04-16T14:32:48.550 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:32:48.550 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 1 2024-04-16T14:32:48.550 INFO:teuthology.orchestra.run.smithi005.stdout:in 2024-04-16T14:32:48.550 INFO:teuthology.orchestra.run.smithi005.stdout:up {} 2024-04-16T14:32:48.550 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2024-04-16T14:32:48.550 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2024-04-16T14:32:48.550 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 2024-04-16T14:32:48.551 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3] 2024-04-16T14:32:48.551 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2024-04-16T14:32:48.551 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2024-04-16T14:32:48.551 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2024-04-16T14:32:48.551 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 0 2024-04-16T14:32:48.551 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:32:48.551 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:32:48.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.552+0000 7f05b0544700 1 -- 172.21.15.5:0/1399389172 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f05940692a0 msgr2=0x7f059406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:48.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.552+0000 7f05b0544700 1 --2- 172.21.15.5:0/1399389172 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f05940692a0 0x7f059406b750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f05a4007580 tx=0x7f05a4009780 comp rx=0 tx=0).stop 2024-04-16T14:32:48.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.552+0000 7f05b0544700 1 -- 172.21.15.5:0/1399389172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a80fed60 msgr2=0x7f05a810dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:48.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.552+0000 7f05b0544700 1 --2- 172.21.15.5:0/1399389172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a80fed60 0x7f05a810dfa0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0598009150 tx=0x7f0598009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:48.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.552+0000 7f05b0544700 1 -- 172.21.15.5:0/1399389172 shutdown_connections 2024-04-16T14:32:48.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.552+0000 7f05b0544700 1 --2- 172.21.15.5:0/1399389172 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f05940692a0 0x7f059406b750 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:48.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.552+0000 7f05b0544700 1 --2- 172.21.15.5:0/1399389172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05a80fe410 0x7f05a810da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:48.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.552+0000 7f05b0544700 1 --2- 172.21.15.5:0/1399389172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f05a80fed60 0x7f05a810dfa0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:48.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.552+0000 7f05b0544700 1 -- 172.21.15.5:0/1399389172 >> 172.21.15.5:0/1399389172 conn(0x7f05a80f6bd0 msgr2=0x7f05a80f8210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:48.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.553+0000 7f05b0544700 1 -- 172.21.15.5:0/1399389172 shutdown_connections 2024-04-16T14:32:48.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:48.553+0000 7f05b0544700 1 -- 172.21.15.5:0/1399389172 wait complete. 2024-04-16T14:32:48.553 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 2 2024-04-16T14:32:48.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:48 smithi115 ceph-mon[37295]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-16T14:32:48.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:48 smithi115 ceph-mon[37295]: osdmap e46: 6 total, 6 up, 6 in 2024-04-16T14:32:48.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:48 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:48.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:48 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:32:49.678 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:49 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/1399389172' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:32:49.678 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:49 smithi005 ceph-mon[28964]: pgmap v177: 65 pgs: 5 creating+activating, 6 creating+peering, 12 unknown, 42 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:49.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:49 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/1399389172' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:32:49.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:49 smithi115 ceph-mon[37295]: pgmap v177: 65 pgs: 5 creating+activating, 6 creating+peering, 12 unknown, 42 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:49.703 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-16T14:32:49.716 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi005.front.sepia.ceph.com 2024-04-16T14:32:49.716 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-04-16T14:32:50.421 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:32:51.460 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:51 smithi005 ceph-mon[28964]: mds.? [v2:172.21.15.5:6826/3000067296,v1:172.21.15.5:6827/3000067296] up:boot 2024-04-16T14:32:51.460 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:51 smithi005 ceph-mon[28964]: daemon mds.cephfs.smithi005.vzoqdl assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-16T14:32:51.461 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:51 smithi005 ceph-mon[28964]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-16T14:32:51.461 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:51 smithi005 ceph-mon[28964]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-16T14:32:51.461 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:51 smithi005 ceph-mon[28964]: Cluster is now healthy 2024-04-16T14:32:51.461 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:51 smithi005 ceph-mon[28964]: fsmap cephfs:0 1 up:standby 2024-04-16T14:32:51.461 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:51 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi005.vzoqdl"}]: dispatch 2024-04-16T14:32:51.461 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:51 smithi005 ceph-mon[28964]: fsmap cephfs:1 {0=cephfs.smithi005.vzoqdl=up:creating} 2024-04-16T14:32:51.461 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:51 smithi005 ceph-mon[28964]: daemon mds.cephfs.smithi005.vzoqdl is now active in filesystem cephfs as rank 0 2024-04-16T14:32:51.461 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:51 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:51.461 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:51 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:51.461 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:51 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:51.461 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:51 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.byfytg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-16T14:32:51.461 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:51 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.byfytg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-16T14:32:51.461 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:51 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:32:51.461 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:51 smithi005 ceph-mon[28964]: Deploying daemon mds.cephfs.smithi115.byfytg on smithi115 2024-04-16T14:32:51.462 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:51 smithi005 ceph-mon[28964]: pgmap v178: 65 pgs: 5 creating+activating, 6 creating+peering, 54 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:51.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:51 smithi115 ceph-mon[37295]: mds.? [v2:172.21.15.5:6826/3000067296,v1:172.21.15.5:6827/3000067296] up:boot 2024-04-16T14:32:51.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:51 smithi115 ceph-mon[37295]: daemon mds.cephfs.smithi005.vzoqdl assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-16T14:32:51.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:51 smithi115 ceph-mon[37295]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-16T14:32:51.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:51 smithi115 ceph-mon[37295]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-16T14:32:51.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:51 smithi115 ceph-mon[37295]: Cluster is now healthy 2024-04-16T14:32:51.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:51 smithi115 ceph-mon[37295]: fsmap cephfs:0 1 up:standby 2024-04-16T14:32:51.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:51 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi005.vzoqdl"}]: dispatch 2024-04-16T14:32:51.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:51 smithi115 ceph-mon[37295]: fsmap cephfs:1 {0=cephfs.smithi005.vzoqdl=up:creating} 2024-04-16T14:32:51.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:51 smithi115 ceph-mon[37295]: daemon mds.cephfs.smithi005.vzoqdl is now active in filesystem cephfs as rank 0 2024-04-16T14:32:51.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:51 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:51.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:51 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:51.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:51 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:51.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:51 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.byfytg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-16T14:32:51.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:51 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.byfytg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-16T14:32:51.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:51 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:32:51.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:51 smithi115 ceph-mon[37295]: Deploying daemon mds.cephfs.smithi115.byfytg on smithi115 2024-04-16T14:32:51.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:51 smithi115 ceph-mon[37295]: pgmap v178: 65 pgs: 5 creating+activating, 6 creating+peering, 54 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:32:51.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.864+0000 7f3819042700 1 -- 172.21.15.5:0/938258176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38140fce80 msgr2=0x7f38140fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:51.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.864+0000 7f3819042700 1 --2- 172.21.15.5:0/938258176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38140fce80 0x7f38140fd290 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3804004940 tx=0x7f3804009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:51.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.865+0000 7f3819042700 1 -- 172.21.15.5:0/938258176 shutdown_connections 2024-04-16T14:32:51.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.865+0000 7f3819042700 1 --2- 172.21.15.5:0/938258176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38140fdff0 0x7f38140fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:51.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.865+0000 7f3819042700 1 --2- 172.21.15.5:0/938258176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38140fce80 0x7f38140fd290 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:51.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.865+0000 7f3819042700 1 -- 172.21.15.5:0/938258176 >> 172.21.15.5:0/938258176 conn(0x7f38140f8580 msgr2=0x7f38140fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:51.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.865+0000 7f3819042700 1 -- 172.21.15.5:0/938258176 shutdown_connections 2024-04-16T14:32:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.865+0000 7f3819042700 1 -- 172.21.15.5:0/938258176 wait complete. 2024-04-16T14:32:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.865+0000 7f3819042700 1 Processor -- start 2024-04-16T14:32:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.865+0000 7f3819042700 1 -- start start 2024-04-16T14:32:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.865+0000 7f3819042700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38140fce80 0x7f381410fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:51.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.865+0000 7f3819042700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38140fdff0 0x7f3814110090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:51.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.865+0000 7f3819042700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3814110690 con 0x7f38140fce80 2024-04-16T14:32:51.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.865+0000 7f3819042700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3814110800 con 0x7f38140fdff0 2024-04-16T14:32:51.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.866+0000 7f3812d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38140fce80 0x7f381410fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:51.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.866+0000 7f3812d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38140fce80 0x7f381410fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52326/0 (socket says 172.21.15.5:52326) 2024-04-16T14:32:51.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.866+0000 7f3812d9d700 1 -- 172.21.15.5:0/3389064833 learned_addr learned my addr 172.21.15.5:0/3389064833 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:32:51.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.866+0000 7f381259c700 1 --2- 172.21.15.5:0/3389064833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38140fdff0 0x7f3814110090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:51.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.866+0000 7f3812d9d700 1 -- 172.21.15.5:0/3389064833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38140fdff0 msgr2=0x7f3814110090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:51.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.866+0000 7f3812d9d700 1 --2- 172.21.15.5:0/3389064833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38140fdff0 0x7f3814110090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:51.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.866+0000 7f3812d9d700 1 -- 172.21.15.5:0/3389064833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3804005040 con 0x7f38140fce80 2024-04-16T14:32:51.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.866+0000 7f3812d9d700 1 --2- 172.21.15.5:0/3389064833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38140fce80 0x7f381410fb50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f380400b3b0 tx=0x7f3804009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:51.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.866+0000 7f37fb7fe700 1 -- 172.21.15.5:0/3389064833 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f380400e040 con 0x7f38140fce80 2024-04-16T14:32:51.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.866+0000 7f3819042700 1 -- 172.21.15.5:0/3389064833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3814115200 con 0x7f38140fce80 2024-04-16T14:32:51.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.866+0000 7f37fb7fe700 1 -- 172.21.15.5:0/3389064833 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f380400bbf0 con 0x7f38140fce80 2024-04-16T14:32:51.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.866+0000 7f37fb7fe700 1 -- 172.21.15.5:0/3389064833 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f380401c630 con 0x7f38140fce80 2024-04-16T14:32:51.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.866+0000 7f3819042700 1 -- 172.21.15.5:0/3389064833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38141157c0 con 0x7f38140fce80 2024-04-16T14:32:51.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.867+0000 7f3819042700 1 -- 172.21.15.5:0/3389064833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3814101980 con 0x7f38140fce80 2024-04-16T14:32:51.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.868+0000 7f37fb7fe700 1 -- 172.21.15.5:0/3389064833 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f380400bd60 con 0x7f38140fce80 2024-04-16T14:32:51.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.868+0000 7f37fb7fe700 1 --2- 172.21.15.5:0/3389064833 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f37fc0692a0 0x7f37fc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:51.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.868+0000 7f37fb7fe700 1 -- 172.21.15.5:0/3389064833 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f3804087ec0 con 0x7f38140fce80 2024-04-16T14:32:51.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.868+0000 7f381259c700 1 --2- 172.21.15.5:0/3389064833 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f37fc0692a0 0x7f37fc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:51.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.869+0000 7f381259c700 1 --2- 172.21.15.5:0/3389064833 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f37fc0692a0 0x7f37fc06b750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f38080041d0 tx=0x7f38080043c0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:51.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:51.873+0000 7f37fb7fe700 1 -- 172.21.15.5:0/3389064833 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3804057c80 con 0x7f38140fce80 2024-04-16T14:32:52.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:52.114+0000 7f3819042700 1 -- 172.21.15.5:0/3389064833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f381402b2f0 con 0x7f38140fce80 2024-04-16T14:32:52.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:52.361+0000 7f37fb7fe700 1 -- 172.21.15.5:0/3389064833 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f3804057810 con 0x7f38140fce80 2024-04-16T14:32:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:52.363+0000 7f3819042700 1 -- 172.21.15.5:0/3389064833 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f37fc0692a0 msgr2=0x7f37fc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:52.363+0000 7f3819042700 1 --2- 172.21.15.5:0/3389064833 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f37fc0692a0 0x7f37fc06b750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f38080041d0 tx=0x7f38080043c0 comp rx=0 tx=0).stop 2024-04-16T14:32:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:52.363+0000 7f3819042700 1 -- 172.21.15.5:0/3389064833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38140fce80 msgr2=0x7f381410fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:52.363+0000 7f3819042700 1 --2- 172.21.15.5:0/3389064833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38140fce80 0x7f381410fb50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f380400b3b0 tx=0x7f3804009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:52.364+0000 7f3819042700 1 -- 172.21.15.5:0/3389064833 shutdown_connections 2024-04-16T14:32:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:52.364+0000 7f3819042700 1 --2- 172.21.15.5:0/3389064833 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f37fc0692a0 0x7f37fc06b750 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:52.364+0000 7f3819042700 1 --2- 172.21.15.5:0/3389064833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38140fce80 0x7f381410fb50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:52.364+0000 7f3819042700 1 --2- 172.21.15.5:0/3389064833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f38140fdff0 0x7f3814110090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:52.364+0000 7f3819042700 1 -- 172.21.15.5:0/3389064833 >> 172.21.15.5:0/3389064833 conn(0x7f38140f8580 msgr2=0x7f38140f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:52.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:52.364+0000 7f3819042700 1 -- 172.21.15.5:0/3389064833 shutdown_connections 2024-04-16T14:32:52.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:52.364+0000 7f3819042700 1 -- 172.21.15.5:0/3389064833 wait complete. 2024-04-16T14:32:52.363 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:52 smithi005 ceph-mon[28964]: mds.? [v2:172.21.15.5:6826/3000067296,v1:172.21.15.5:6827/3000067296] up:active 2024-04-16T14:32:52.363 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:52 smithi005 ceph-mon[28964]: fsmap cephfs:1 {0=cephfs.smithi005.vzoqdl=up:active} 2024-04-16T14:32:52.363 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:52 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/3389064833' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-04-16T14:32:52.405 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:52 smithi115 ceph-mon[37295]: mds.? [v2:172.21.15.5:6826/3000067296,v1:172.21.15.5:6827/3000067296] up:active 2024-04-16T14:32:52.405 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:52 smithi115 ceph-mon[37295]: fsmap cephfs:1 {0=cephfs.smithi005.vzoqdl=up:active} 2024-04-16T14:32:52.405 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:52 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/3389064833' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-04-16T14:32:52.965 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-16T14:32:52.975 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi005.front.sepia.ceph.com 2024-04-16T14:32:52.975 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-04-16T14:32:53.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:53 smithi115 ceph-mon[37295]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-16T14:32:53.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:53 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/3389064833' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-04-16T14:32:53.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:53 smithi115 ceph-mon[37295]: fsmap cephfs:1 {0=cephfs.smithi005.vzoqdl=up:active} 2024-04-16T14:32:53.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:53 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:53.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:53 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:53.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:53 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:53.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:53 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi005.wofqlz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-16T14:32:53.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:53 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi005.wofqlz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-16T14:32:53.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:53 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:32:53.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:53 smithi115 ceph-mon[37295]: Deploying daemon mds.cephfs.smithi005.wofqlz on smithi005 2024-04-16T14:32:53.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:53 smithi115 ceph-mon[37295]: pgmap v179: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 5 op/s 2024-04-16T14:32:53.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:53 smithi005 ceph-mon[28964]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-16T14:32:53.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:53 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/3389064833' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-04-16T14:32:53.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:53 smithi005 ceph-mon[28964]: fsmap cephfs:1 {0=cephfs.smithi005.vzoqdl=up:active} 2024-04-16T14:32:53.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:53 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:53.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:53 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:53.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:53 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:53.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:53 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi005.wofqlz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-16T14:32:53.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:53 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi005.wofqlz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-16T14:32:53.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:53 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:32:53.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:53 smithi005 ceph-mon[28964]: Deploying daemon mds.cephfs.smithi005.wofqlz on smithi005 2024-04-16T14:32:53.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:53 smithi005 ceph-mon[28964]: pgmap v179: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 5 op/s 2024-04-16T14:32:54.121 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:32:54.667 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:54 smithi115 ceph-mon[37295]: mds.? [v2:172.21.15.115:6824/1662994117,v1:172.21.15.115:6825/1662994117] up:boot 2024-04-16T14:32:54.667 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:54 smithi115 ceph-mon[37295]: daemon mds.cephfs.smithi115.byfytg assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-16T14:32:54.667 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:54 smithi115 ceph-mon[37295]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-04-16T14:32:54.667 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:54 smithi115 ceph-mon[37295]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-16T14:32:54.667 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:54 smithi115 ceph-mon[37295]: fsmap cephfs:1 {0=cephfs.smithi005.vzoqdl=up:active} 1 up:standby 2024-04-16T14:32:54.667 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:54 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.byfytg"}]: dispatch 2024-04-16T14:32:54.667 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:54 smithi115 ceph-mon[37295]: fsmap cephfs:2 {0=cephfs.smithi005.vzoqdl=up:active,1=cephfs.smithi115.byfytg=up:creating} 2024-04-16T14:32:54.667 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:54 smithi115 ceph-mon[37295]: daemon mds.cephfs.smithi115.byfytg is now active in filesystem cephfs as rank 1 2024-04-16T14:32:54.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:54 smithi005 ceph-mon[28964]: mds.? [v2:172.21.15.115:6824/1662994117,v1:172.21.15.115:6825/1662994117] up:boot 2024-04-16T14:32:54.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:54 smithi005 ceph-mon[28964]: daemon mds.cephfs.smithi115.byfytg assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-16T14:32:54.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:54 smithi005 ceph-mon[28964]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-04-16T14:32:54.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:54 smithi005 ceph-mon[28964]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-16T14:32:54.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:54 smithi005 ceph-mon[28964]: fsmap cephfs:1 {0=cephfs.smithi005.vzoqdl=up:active} 1 up:standby 2024-04-16T14:32:54.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:54 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.byfytg"}]: dispatch 2024-04-16T14:32:54.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:54 smithi005 ceph-mon[28964]: fsmap cephfs:2 {0=cephfs.smithi005.vzoqdl=up:active,1=cephfs.smithi115.byfytg=up:creating} 2024-04-16T14:32:54.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:54 smithi005 ceph-mon[28964]: daemon mds.cephfs.smithi115.byfytg is now active in filesystem cephfs as rank 1 2024-04-16T14:32:55.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:55 smithi005 ceph-mon[28964]: mds.? [v2:172.21.15.115:6824/1662994117,v1:172.21.15.115:6825/1662994117] up:active 2024-04-16T14:32:55.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:55 smithi005 ceph-mon[28964]: fsmap cephfs:2 {0=cephfs.smithi005.vzoqdl=up:active,1=cephfs.smithi115.byfytg=up:active} 2024-04-16T14:32:55.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:55 smithi005 ceph-mon[28964]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 6 op/s 2024-04-16T14:32:55.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:55 smithi115 ceph-mon[37295]: mds.? [v2:172.21.15.115:6824/1662994117,v1:172.21.15.115:6825/1662994117] up:active 2024-04-16T14:32:55.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:55 smithi115 ceph-mon[37295]: fsmap cephfs:2 {0=cephfs.smithi005.vzoqdl=up:active,1=cephfs.smithi115.byfytg=up:active} 2024-04-16T14:32:55.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:55 smithi115 ceph-mon[37295]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 6 op/s 2024-04-16T14:32:55.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.969+0000 7faf6d1fb700 1 -- 172.21.15.5:0/1116816098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf68066f60 msgr2=0x7faf680ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:55.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.969+0000 7faf6d1fb700 1 --2- 172.21.15.5:0/1116816098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf68066f60 0x7faf680ff9e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7faf58004940 tx=0x7faf58009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:55.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.969+0000 7faf6d1fb700 1 -- 172.21.15.5:0/1116816098 shutdown_connections 2024-04-16T14:32:55.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.969+0000 7faf6d1fb700 1 --2- 172.21.15.5:0/1116816098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf680fff20 0x7faf68102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:55.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.969+0000 7faf6d1fb700 1 --2- 172.21.15.5:0/1116816098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf68066f60 0x7faf680ff9e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:55.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.969+0000 7faf6d1fb700 1 -- 172.21.15.5:0/1116816098 >> 172.21.15.5:0/1116816098 conn(0x7faf680f7450 msgr2=0x7faf680f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:55.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.969+0000 7faf6d1fb700 1 -- 172.21.15.5:0/1116816098 shutdown_connections 2024-04-16T14:32:55.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.969+0000 7faf6d1fb700 1 -- 172.21.15.5:0/1116816098 wait complete. 2024-04-16T14:32:55.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.970+0000 7faf6d1fb700 1 Processor -- start 2024-04-16T14:32:55.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.970+0000 7faf6d1fb700 1 -- start start 2024-04-16T14:32:55.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.970+0000 7faf6d1fb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf68066f60 0x7faf6810dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:55.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.970+0000 7faf6d1fb700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf680fff20 0x7faf6810e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:55.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.970+0000 7faf6d1fb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6810e910 con 0x7faf68066f60 2024-04-16T14:32:55.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.970+0000 7faf6d1fb700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf68113220 con 0x7faf680fff20 2024-04-16T14:32:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.970+0000 7faf66d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf68066f60 0x7faf6810dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.970+0000 7faf66d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf68066f60 0x7faf6810dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52354/0 (socket says 172.21.15.5:52354) 2024-04-16T14:32:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.970+0000 7faf66d9d700 1 -- 172.21.15.5:0/12533970 learned_addr learned my addr 172.21.15.5:0/12533970 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:32:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.970+0000 7faf6659c700 1 --2- 172.21.15.5:0/12533970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf680fff20 0x7faf6810e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.970+0000 7faf66d9d700 1 -- 172.21.15.5:0/12533970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf680fff20 msgr2=0x7faf6810e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.970+0000 7faf66d9d700 1 --2- 172.21.15.5:0/12533970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf680fff20 0x7faf6810e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.970+0000 7faf66d9d700 1 -- 172.21.15.5:0/12533970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf58005040 con 0x7faf68066f60 2024-04-16T14:32:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.970+0000 7faf6659c700 1 --2- 172.21.15.5:0/12533970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf680fff20 0x7faf6810e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:32:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.970+0000 7faf66d9d700 1 --2- 172.21.15.5:0/12533970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf68066f60 0x7faf6810dcc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7faf5800b970 tx=0x7faf58009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:55.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.971+0000 7faf4f7fe700 1 -- 172.21.15.5:0/12533970 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf5800e040 con 0x7faf68066f60 2024-04-16T14:32:55.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.971+0000 7faf6d1fb700 1 -- 172.21.15.5:0/12533970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf68113420 con 0x7faf68066f60 2024-04-16T14:32:55.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.971+0000 7faf4f7fe700 1 -- 172.21.15.5:0/12533970 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faf5800bbf0 con 0x7faf68066f60 2024-04-16T14:32:55.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.971+0000 7faf4f7fe700 1 -- 172.21.15.5:0/12533970 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf5801c630 con 0x7faf68066f60 2024-04-16T14:32:55.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.971+0000 7faf6d1fb700 1 -- 172.21.15.5:0/12533970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf681139b0 con 0x7faf68066f60 2024-04-16T14:32:55.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.972+0000 7faf6d1fb700 1 -- 172.21.15.5:0/12533970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf68106190 con 0x7faf68066f60 2024-04-16T14:32:55.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.972+0000 7faf4f7fe700 1 -- 172.21.15.5:0/12533970 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7faf5800bd60 con 0x7faf68066f60 2024-04-16T14:32:55.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.972+0000 7faf4f7fe700 1 --2- 172.21.15.5:0/12533970 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7faf500692a0 0x7faf5006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:55.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.973+0000 7faf4f7fe700 1 -- 172.21.15.5:0/12533970 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7faf58088590 con 0x7faf68066f60 2024-04-16T14:32:55.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.973+0000 7faf6659c700 1 --2- 172.21.15.5:0/12533970 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7faf500692a0 0x7faf5006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:55.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.973+0000 7faf6659c700 1 --2- 172.21.15.5:0/12533970 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7faf500692a0 0x7faf5006b750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faf5c006fd0 tx=0x7faf5c008040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:55.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:55.977+0000 7faf4f7fe700 1 -- 172.21.15.5:0/12533970 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7faf580548c0 con 0x7faf68066f60 2024-04-16T14:32:56.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:56.230+0000 7faf6d1fb700 1 -- 172.21.15.5:0/12533970 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7faf6804c710 con 0x7faf68066f60 2024-04-16T14:32:56.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:56.374+0000 7faf4f7fe700 1 -- 172.21.15.5:0/12533970 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7faf58057ee0 con 0x7faf68066f60 2024-04-16T14:32:56.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:56.377+0000 7faf6d1fb700 1 -- 172.21.15.5:0/12533970 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7faf500692a0 msgr2=0x7faf5006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:56.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:56.377+0000 7faf6d1fb700 1 --2- 172.21.15.5:0/12533970 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7faf500692a0 0x7faf5006b750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faf5c006fd0 tx=0x7faf5c008040 comp rx=0 tx=0).stop 2024-04-16T14:32:56.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:56.377+0000 7faf6d1fb700 1 -- 172.21.15.5:0/12533970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf68066f60 msgr2=0x7faf6810dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:56.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:56.377+0000 7faf6d1fb700 1 --2- 172.21.15.5:0/12533970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf68066f60 0x7faf6810dcc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7faf5800b970 tx=0x7faf58009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:56.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:56.377+0000 7faf6d1fb700 1 -- 172.21.15.5:0/12533970 shutdown_connections 2024-04-16T14:32:56.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:56.377+0000 7faf6d1fb700 1 --2- 172.21.15.5:0/12533970 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7faf500692a0 0x7faf5006b750 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:56.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:56.377+0000 7faf6d1fb700 1 --2- 172.21.15.5:0/12533970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf68066f60 0x7faf6810dcc0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:56.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:56.377+0000 7faf6d1fb700 1 --2- 172.21.15.5:0/12533970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf680fff20 0x7faf6810e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:56.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:56.377+0000 7faf6d1fb700 1 -- 172.21.15.5:0/12533970 >> 172.21.15.5:0/12533970 conn(0x7faf680f7450 msgr2=0x7faf680f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:56.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:56.377+0000 7faf6d1fb700 1 -- 172.21.15.5:0/12533970 shutdown_connections 2024-04-16T14:32:56.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:56.377+0000 7faf6d1fb700 1 -- 172.21.15.5:0/12533970 wait complete. 2024-04-16T14:32:57.046 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-16T14:32:57.055 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi005.front.sepia.ceph.com 2024-04-16T14:32:57.056 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data false' 2024-04-16T14:32:57.326 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:32:57.448 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:57 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:57.448 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:57 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:57.448 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:57 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/12533970' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-04-16T14:32:57.448 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:57 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:57.449 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:57 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.trkaqh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-16T14:32:57.449 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:57 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.trkaqh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-16T14:32:57.449 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:57 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:32:57.449 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:57 smithi005 ceph-mon[28964]: Deploying daemon mds.cephfs.smithi115.trkaqh on smithi115 2024-04-16T14:32:57.449 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:57 smithi005 ceph-mon[28964]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-04-16T14:32:57.449 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:57 smithi005 ceph-mon[28964]: Cluster is now healthy 2024-04-16T14:32:57.449 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:57 smithi005 ceph-mon[28964]: mds.? [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] up:boot 2024-04-16T14:32:57.449 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:57 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/12533970' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-04-16T14:32:57.449 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:57 smithi005 ceph-mon[28964]: fsmap cephfs:2 {0=cephfs.smithi005.vzoqdl=up:active,1=cephfs.smithi115.byfytg=up:active} 1 up:standby 2024-04-16T14:32:57.449 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:57 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi005.wofqlz"}]: dispatch 2024-04-16T14:32:57.449 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:57 smithi005 ceph-mon[28964]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 7 op/s 2024-04-16T14:32:57.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:57 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:57.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:57 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:57.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:57 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/12533970' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-04-16T14:32:57.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:57 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:57.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:57 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.trkaqh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-16T14:32:57.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:57 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.trkaqh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-16T14:32:57.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:57 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:32:57.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:57 smithi115 ceph-mon[37295]: Deploying daemon mds.cephfs.smithi115.trkaqh on smithi115 2024-04-16T14:32:57.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:57 smithi115 ceph-mon[37295]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-04-16T14:32:57.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:57 smithi115 ceph-mon[37295]: Cluster is now healthy 2024-04-16T14:32:57.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:57 smithi115 ceph-mon[37295]: mds.? [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] up:boot 2024-04-16T14:32:57.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:57 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/12533970' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-04-16T14:32:57.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:57 smithi115 ceph-mon[37295]: fsmap cephfs:2 {0=cephfs.smithi005.vzoqdl=up:active,1=cephfs.smithi115.byfytg=up:active} 1 up:standby 2024-04-16T14:32:57.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:57 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi005.wofqlz"}]: dispatch 2024-04-16T14:32:57.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:57 smithi115 ceph-mon[37295]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 7 op/s 2024-04-16T14:32:58.827 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:58 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.839+0000 7f6a2f54a700 1 -- 172.21.15.5:0/631963747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a280fee60 msgr2=0x7f6a280fafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.839+0000 7f6a2f54a700 1 --2- 172.21.15.5:0/631963747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a280fee60 0x7f6a280fafa0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6a18004940 tx=0x7f6a18009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.839+0000 7f6a2f54a700 1 -- 172.21.15.5:0/631963747 shutdown_connections 2024-04-16T14:32:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.839+0000 7f6a2f54a700 1 --2- 172.21.15.5:0/631963747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a280fee60 0x7f6a280fafa0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.839+0000 7f6a2f54a700 1 --2- 172.21.15.5:0/631963747 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a280fe510 0x7f6a280fe920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.839+0000 7f6a2f54a700 1 -- 172.21.15.5:0/631963747 >> 172.21.15.5:0/631963747 conn(0x7f6a280f6bf0 msgr2=0x7f6a280f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.839+0000 7f6a2f54a700 1 -- 172.21.15.5:0/631963747 shutdown_connections 2024-04-16T14:32:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.839+0000 7f6a2f54a700 1 -- 172.21.15.5:0/631963747 wait complete. 2024-04-16T14:32:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.840+0000 7f6a2f54a700 1 Processor -- start 2024-04-16T14:32:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.840+0000 7f6a2f54a700 1 -- start start 2024-04-16T14:32:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.840+0000 7f6a2f54a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a280fe510 0x7f6a280fdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.840+0000 7f6a2f54a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a280fee60 0x7f6a280fc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:58.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.840+0000 7f6a2f54a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a280fe0b0 con 0x7f6a280fe510 2024-04-16T14:32:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.840+0000 7f6a2f54a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a280fc710 con 0x7f6a280fee60 2024-04-16T14:32:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.840+0000 7f6a2d2e6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a280fe510 0x7f6a280fdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.840+0000 7f6a2d2e6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a280fe510 0x7f6a280fdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39042/0 (socket says 172.21.15.5:39042) 2024-04-16T14:32:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.840+0000 7f6a2d2e6700 1 -- 172.21.15.5:0/703308620 learned_addr learned my addr 172.21.15.5:0/703308620 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:32:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.840+0000 7f6a2cae5700 1 --2- 172.21.15.5:0/703308620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a280fee60 0x7f6a280fc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.840+0000 7f6a2d2e6700 1 -- 172.21.15.5:0/703308620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a280fee60 msgr2=0x7f6a280fc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.840+0000 7f6a2d2e6700 1 --2- 172.21.15.5:0/703308620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a280fee60 0x7f6a280fc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.840+0000 7f6a2d2e6700 1 -- 172.21.15.5:0/703308620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a18005040 con 0x7f6a280fe510 2024-04-16T14:32:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.840+0000 7f6a2cae5700 1 --2- 172.21.15.5:0/703308620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a280fee60 0x7f6a280fc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T14:32:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.840+0000 7f6a2d2e6700 1 --2- 172.21.15.5:0/703308620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a280fe510 0x7f6a280fdab0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400c830 tx=0x7f6a24004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.840+0000 7f6a1dffb700 1 -- 172.21.15.5:0/703308620 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a2400a760 con 0x7f6a280fe510 2024-04-16T14:32:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.841+0000 7f6a1dffb700 1 -- 172.21.15.5:0/703308620 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6a2400ad90 con 0x7f6a280fe510 2024-04-16T14:32:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.841+0000 7f6a2f54a700 1 -- 172.21.15.5:0/703308620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a280fc9f0 con 0x7f6a280fe510 2024-04-16T14:32:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.841+0000 7f6a1dffb700 1 -- 172.21.15.5:0/703308620 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a240113a0 con 0x7f6a280fe510 2024-04-16T14:32:58.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.841+0000 7f6a2f54a700 1 -- 172.21.15.5:0/703308620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a280fcfb0 con 0x7f6a280fe510 2024-04-16T14:32:58.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.842+0000 7f6a2f54a700 1 -- 172.21.15.5:0/703308620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2804c710 con 0x7f6a280fe510 2024-04-16T14:32:58.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.842+0000 7f6a1dffb700 1 -- 172.21.15.5:0/703308620 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f6a24012400 con 0x7f6a280fe510 2024-04-16T14:32:58.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.843+0000 7f6a1dffb700 1 --2- 172.21.15.5:0/703308620 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6a140692a0 0x7f6a1406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:32:58.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.843+0000 7f6a2cae5700 1 --2- 172.21.15.5:0/703308620 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6a140692a0 0x7f6a1406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:32:58.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.843+0000 7f6a1dffb700 1 -- 172.21.15.5:0/703308620 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f6a24087150 con 0x7f6a280fe510 2024-04-16T14:32:58.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.843+0000 7f6a2cae5700 1 --2- 172.21.15.5:0/703308620 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6a140692a0 0x7f6a1406b750 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6a1800b3b0 tx=0x7f6a18009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:32:58.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:58.847+0000 7f6a1dffb700 1 -- 172.21.15.5:0/703308620 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6a24056fb0 con 0x7f6a280fe510 2024-04-16T14:32:59.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:59.091+0000 7f6a2f54a700 1 -- 172.21.15.5:0/703308620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f6a28105920 con 0x7f6a280fe510 2024-04-16T14:32:59.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:58 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:59.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:59.799+0000 7f6a1dffb700 1 -- 172.21.15.5:0/703308620 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v12) v1 ==== 133+0+0 (secure 0 0 0) 0x7f6a2405c070 con 0x7f6a280fe510 2024-04-16T14:32:59.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:59.801+0000 7f6a2f54a700 1 -- 172.21.15.5:0/703308620 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6a140692a0 msgr2=0x7f6a1406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:59.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:59.801+0000 7f6a2f54a700 1 --2- 172.21.15.5:0/703308620 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6a140692a0 0x7f6a1406b750 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6a1800b3b0 tx=0x7f6a18009e30 comp rx=0 tx=0).stop 2024-04-16T14:32:59.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:59.801+0000 7f6a2f54a700 1 -- 172.21.15.5:0/703308620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a280fe510 msgr2=0x7f6a280fdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:32:59.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:59.801+0000 7f6a2f54a700 1 --2- 172.21.15.5:0/703308620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a280fe510 0x7f6a280fdab0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400c830 tx=0x7f6a24004470 comp rx=0 tx=0).stop 2024-04-16T14:32:59.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:59.801+0000 7f6a2f54a700 1 -- 172.21.15.5:0/703308620 shutdown_connections 2024-04-16T14:32:59.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:59.801+0000 7f6a2f54a700 1 --2- 172.21.15.5:0/703308620 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f6a140692a0 0x7f6a1406b750 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:59.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:59.801+0000 7f6a2f54a700 1 --2- 172.21.15.5:0/703308620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a280fe510 0x7f6a280fdab0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:59.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:59.801+0000 7f6a2f54a700 1 --2- 172.21.15.5:0/703308620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a280fee60 0x7f6a280fc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:32:59.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:59.801+0000 7f6a2f54a700 1 -- 172.21.15.5:0/703308620 >> 172.21.15.5:0/703308620 conn(0x7f6a280f6bf0 msgr2=0x7f6a280f8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:32:59.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:59.801+0000 7f6a2f54a700 1 -- 172.21.15.5:0/703308620 shutdown_connections 2024-04-16T14:32:59.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:32:59.801+0000 7f6a2f54a700 1 -- 172.21.15.5:0/703308620 wait complete. 2024-04-16T14:32:59.800 INFO:teuthology.orchestra.run.smithi005.stderr:inline data disabled 2024-04-16T14:32:59.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:59 smithi115 ceph-mon[37295]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s wr, 7 op/s 2024-04-16T14:32:59.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:59 smithi115 ceph-mon[37295]: mds.? [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] up:boot 2024-04-16T14:32:59.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:59 smithi115 ceph-mon[37295]: fsmap cephfs:2 {0=cephfs.smithi005.vzoqdl=up:active,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:32:59.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:59 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.trkaqh"}]: dispatch 2024-04-16T14:32:59.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:59 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:59.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:59 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:59.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:59 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:59.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:59 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:59.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:59 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:32:59.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:59 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:32:59.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:32:59 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/703308620' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-04-16T14:33:00.105 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:59 smithi005 ceph-mon[28964]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s wr, 7 op/s 2024-04-16T14:33:00.105 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:59 smithi005 ceph-mon[28964]: mds.? [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] up:boot 2024-04-16T14:33:00.106 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:59 smithi005 ceph-mon[28964]: fsmap cephfs:2 {0=cephfs.smithi005.vzoqdl=up:active,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:33:00.106 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:59 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.trkaqh"}]: dispatch 2024-04-16T14:33:00.106 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:59 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:00.106 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:59 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:00.106 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:59 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:00.106 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:59 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:00.106 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:59 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:00.106 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:59 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:33:00.106 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:32:59 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/703308620' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-04-16T14:33:00.451 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-16T14:33:00.462 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi005.front.sepia.ceph.com 2024-04-16T14:33:00.463 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-16T14:33:01.113 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:00 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/703308620' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-04-16T14:33:01.113 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:00 smithi005 ceph-mon[28964]: fsmap cephfs:2 {0=cephfs.smithi005.vzoqdl=up:active,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:33:01.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:00 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/703308620' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-04-16T14:33:01.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:00 smithi115 ceph-mon[37295]: fsmap cephfs:2 {0=cephfs.smithi005.vzoqdl=up:active,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:33:01.386 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:33:02.077 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:01 smithi005 ceph-mon[28964]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2024-04-16T14:33:02.078 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:01 smithi005 ceph-mon[28964]: mds.? [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] up:standby 2024-04-16T14:33:02.078 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:01 smithi005 ceph-mon[28964]: Dropping low affinity active daemon mds.cephfs.smithi005.vzoqdl in favor of higher affinity standby. 2024-04-16T14:33:02.078 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:01 smithi005 ceph-mon[28964]: Replacing daemon mds.cephfs.smithi005.vzoqdl as rank 0 with standby daemon mds.cephfs.smithi005.wofqlz 2024-04-16T14:33:02.078 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:01 smithi005 ceph-mon[28964]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-16T14:33:02.078 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:01 smithi005 ceph-mon[28964]: fsmap cephfs:2 {0=cephfs.smithi005.vzoqdl=up:active,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:33:02.078 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:01 smithi005 ceph-mon[28964]: osdmap e47: 6 total, 6 up, 6 in 2024-04-16T14:33:02.078 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:01 smithi005 ceph-mon[28964]: fsmap cephfs:2/2 {0=cephfs.smithi005.wofqlz=up:replay,1=cephfs.smithi115.byfytg=up:active} 1 up:standby 2024-04-16T14:33:02.078 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:01 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:02.078 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:01 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:02.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:01 smithi115 ceph-mon[37295]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2024-04-16T14:33:02.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:01 smithi115 ceph-mon[37295]: mds.? [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] up:standby 2024-04-16T14:33:02.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:01 smithi115 ceph-mon[37295]: Dropping low affinity active daemon mds.cephfs.smithi005.vzoqdl in favor of higher affinity standby. 2024-04-16T14:33:02.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:01 smithi115 ceph-mon[37295]: Replacing daemon mds.cephfs.smithi005.vzoqdl as rank 0 with standby daemon mds.cephfs.smithi005.wofqlz 2024-04-16T14:33:02.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:01 smithi115 ceph-mon[37295]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-16T14:33:02.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:01 smithi115 ceph-mon[37295]: fsmap cephfs:2 {0=cephfs.smithi005.vzoqdl=up:active,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:33:02.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:01 smithi115 ceph-mon[37295]: osdmap e47: 6 total, 6 up, 6 in 2024-04-16T14:33:02.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:01 smithi115 ceph-mon[37295]: fsmap cephfs:2/2 {0=cephfs.smithi005.wofqlz=up:replay,1=cephfs.smithi115.byfytg=up:active} 1 up:standby 2024-04-16T14:33:02.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:01 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:02.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:01 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:03.082 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:02 smithi115 ceph-mon[37295]: mds.? [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] up:resolve 2024-04-16T14:33:03.083 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:02 smithi115 ceph-mon[37295]: mds.? [v2:172.21.15.5:6826/187766809,v1:172.21.15.5:6827/187766809] up:boot 2024-04-16T14:33:03.083 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:02 smithi115 ceph-mon[37295]: mds.? [v2:172.21.15.115:6824/1662994117,v1:172.21.15.115:6825/1662994117] up:active 2024-04-16T14:33:03.083 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:02 smithi115 ceph-mon[37295]: fsmap cephfs:2/2 {0=cephfs.smithi005.wofqlz=up:resolve,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:33:03.083 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:02 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi005.vzoqdl"}]: dispatch 2024-04-16T14:33:03.083 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:02 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:03.083 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:02 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:33:03.083 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:02 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:03.084 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:02 smithi005 ceph-mon[28964]: mds.? [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] up:resolve 2024-04-16T14:33:03.084 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:02 smithi005 ceph-mon[28964]: mds.? [v2:172.21.15.5:6826/187766809,v1:172.21.15.5:6827/187766809] up:boot 2024-04-16T14:33:03.084 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:02 smithi005 ceph-mon[28964]: mds.? [v2:172.21.15.115:6824/1662994117,v1:172.21.15.115:6825/1662994117] up:active 2024-04-16T14:33:03.084 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:02 smithi005 ceph-mon[28964]: fsmap cephfs:2/2 {0=cephfs.smithi005.wofqlz=up:resolve,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:33:03.084 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:02 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi005.vzoqdl"}]: dispatch 2024-04-16T14:33:03.084 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:02 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:03.084 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:02 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:33:03.085 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:02 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:03.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.813+0000 7f3f5048f700 1 -- 172.21.15.5:0/4108784037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f480fbd20 msgr2=0x7f3f480fc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:03.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.813+0000 7f3f5048f700 1 --2- 172.21.15.5:0/4108784037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f480fbd20 0x7f3f480fc130 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3f44004940 tx=0x7f3f44009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:03.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.813+0000 7f3f5048f700 1 -- 172.21.15.5:0/4108784037 shutdown_connections 2024-04-16T14:33:03.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.813+0000 7f3f5048f700 1 --2- 172.21.15.5:0/4108784037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f480fcfd0 0x7f3f480fd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:03.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.813+0000 7f3f5048f700 1 --2- 172.21.15.5:0/4108784037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f480fbd20 0x7f3f480fc130 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:03.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.813+0000 7f3f5048f700 1 -- 172.21.15.5:0/4108784037 >> 172.21.15.5:0/4108784037 conn(0x7f3f480f74a0 msgr2=0x7f3f480f98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:03.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.813+0000 7f3f5048f700 1 -- 172.21.15.5:0/4108784037 shutdown_connections 2024-04-16T14:33:03.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.813+0000 7f3f5048f700 1 -- 172.21.15.5:0/4108784037 wait complete. 2024-04-16T14:33:03.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.814+0000 7f3f5048f700 1 Processor -- start 2024-04-16T14:33:03.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.814+0000 7f3f5048f700 1 -- start start 2024-04-16T14:33:03.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.814+0000 7f3f5048f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f480fbd20 0x7f3f480ffc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:03.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.814+0000 7f3f5048f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f480fcfd0 0x7f3f480fe310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:03.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.814+0000 7f3f5048f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f48100260 con 0x7f3f480fbd20 2024-04-16T14:33:03.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.814+0000 7f3f5048f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f480fe850 con 0x7f3f480fcfd0 2024-04-16T14:33:03.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.814+0000 7f3f4e22b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f480fbd20 0x7f3f480ffc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:03.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.814+0000 7f3f4e22b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f480fbd20 0x7f3f480ffc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39088/0 (socket says 172.21.15.5:39088) 2024-04-16T14:33:03.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.814+0000 7f3f4e22b700 1 -- 172.21.15.5:0/3807734386 learned_addr learned my addr 172.21.15.5:0/3807734386 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:33:03.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.814+0000 7f3f4da2a700 1 --2- 172.21.15.5:0/3807734386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f480fcfd0 0x7f3f480fe310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:03.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.815+0000 7f3f4e22b700 1 -- 172.21.15.5:0/3807734386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f480fcfd0 msgr2=0x7f3f480fe310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:03.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.815+0000 7f3f4e22b700 1 --2- 172.21.15.5:0/3807734386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f480fcfd0 0x7f3f480fe310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:03.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.815+0000 7f3f4e22b700 1 -- 172.21.15.5:0/3807734386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f44005040 con 0x7f3f480fbd20 2024-04-16T14:33:03.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.815+0000 7f3f4e22b700 1 --2- 172.21.15.5:0/3807734386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f480fbd20 0x7f3f480ffc60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400b3b0 tx=0x7f3f44009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:03.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.815+0000 7f3f3effd700 1 -- 172.21.15.5:0/3807734386 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f4400e040 con 0x7f3f480fbd20 2024-04-16T14:33:03.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.815+0000 7f3f3effd700 1 -- 172.21.15.5:0/3807734386 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f4400bbf0 con 0x7f3f480fbd20 2024-04-16T14:33:03.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.815+0000 7f3f5048f700 1 -- 172.21.15.5:0/3807734386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f480feaa0 con 0x7f3f480fbd20 2024-04-16T14:33:03.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.815+0000 7f3f3effd700 1 -- 172.21.15.5:0/3807734386 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f4401c630 con 0x7f3f480fbd20 2024-04-16T14:33:03.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.815+0000 7f3f5048f700 1 -- 172.21.15.5:0/3807734386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f480ff060 con 0x7f3f480fbd20 2024-04-16T14:33:03.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.816+0000 7f3f5048f700 1 -- 172.21.15.5:0/3807734386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f48101b60 con 0x7f3f480fbd20 2024-04-16T14:33:03.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.817+0000 7f3f3effd700 1 -- 172.21.15.5:0/3807734386 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f3f4400bd60 con 0x7f3f480fbd20 2024-04-16T14:33:03.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.817+0000 7f3f3effd700 1 --2- 172.21.15.5:0/3807734386 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f3f340692a0 0x7f3f3406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:03.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.817+0000 7f3f3effd700 1 -- 172.21.15.5:0/3807734386 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f3f44087dd0 con 0x7f3f480fbd20 2024-04-16T14:33:03.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.817+0000 7f3f4da2a700 1 --2- 172.21.15.5:0/3807734386 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f3f340692a0 0x7f3f3406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:03.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.818+0000 7f3f4da2a700 1 --2- 172.21.15.5:0/3807734386 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f3f340692a0 0x7f3f3406b750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3f38004f40 tx=0x7f3f3800b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:03.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:03.824+0000 7f3f3effd700 1 -- 172.21.15.5:0/3807734386 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3f44057be0 con 0x7f3f480fbd20 2024-04-16T14:33:03.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:03 smithi005 ceph-mon[28964]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 716 B/s rd, 1.3 KiB/s wr, 5 op/s 2024-04-16T14:33:03.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:03 smithi005 ceph-mon[28964]: mds.? [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] up:reconnect 2024-04-16T14:33:03.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:03 smithi005 ceph-mon[28964]: mds.? [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] up:standby 2024-04-16T14:33:03.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:03 smithi005 ceph-mon[28964]: fsmap cephfs:2/2 {0=cephfs.smithi005.wofqlz=up:reconnect,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:33:04.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:04.065+0000 7f3f5048f700 1 -- 172.21.15.5:0/3807734386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3f48104810 con 0x7f3f480fbd20 2024-04-16T14:33:04.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:04.065+0000 7f3f3effd700 1 -- 172.21.15.5:0/3807734386 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1812 (secure 0 0 0) 0x7f3f44057770 con 0x7f3f480fbd20 2024-04-16T14:33:04.063 INFO:teuthology.orchestra.run.smithi005.stdout:e17 2024-04-16T14:33:04.064 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:33:04.064 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:33:04.064 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2024-04-16T14:33:04.064 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:33:04.064 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2024-04-16T14:33:04.064 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2024-04-16T14:33:04.064 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 17 2024-04-16T14:33:04.064 INFO:teuthology.orchestra.run.smithi005.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-16T14:33:04.064 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-16T14:32:45.270024+0000 2024-04-16T14:33:04.064 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-04-16T14:33:03.816518+0000 2024-04-16T14:33:04.064 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2024-04-16T14:33:04.064 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2024-04-16T14:33:04.064 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 60 2024-04-16T14:33:04.064 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2024-04-16T14:33:04.065 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2024-04-16T14:33:04.065 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2024-04-16T14:33:04.065 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2024-04-16T14:33:04.065 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 47 2024-04-16T14:33:04.065 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:33:04.065 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 2 2024-04-16T14:33:04.065 INFO:teuthology.orchestra.run.smithi005.stdout:in 0,1 2024-04-16T14:33:04.065 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=14484,1=24269} 2024-04-16T14:33:04.065 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2024-04-16T14:33:04.065 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2024-04-16T14:33:04.065 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 2024-04-16T14:33:04.065 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3] 2024-04-16T14:33:04.065 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2024-04-16T14:33:04.065 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2024-04-16T14:33:04.066 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2024-04-16T14:33:04.066 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 1 2024-04-16T14:33:04.066 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.wofqlz{0:14484} state up:rejoin seq 5 join_fscid=1 addr [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:33:04.066 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.byfytg{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.115:6824/1662994117,v1:172.21.15.115:6825/1662994117] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:33:04.066 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:33:04.066 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:33:04.066 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2024-04-16T14:33:04.066 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:33:04.066 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.vzoqdl{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.5:6826/187766809,v1:172.21.15.5:6827/187766809] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:33:04.066 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.trkaqh{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:33:04.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:04.067+0000 7f3f5048f700 1 -- 172.21.15.5:0/3807734386 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f3f340692a0 msgr2=0x7f3f3406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:04.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:04.067+0000 7f3f5048f700 1 --2- 172.21.15.5:0/3807734386 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f3f340692a0 0x7f3f3406b750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3f38004f40 tx=0x7f3f3800b040 comp rx=0 tx=0).stop 2024-04-16T14:33:04.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:04.067+0000 7f3f5048f700 1 -- 172.21.15.5:0/3807734386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f480fbd20 msgr2=0x7f3f480ffc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:04.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:04.067+0000 7f3f5048f700 1 --2- 172.21.15.5:0/3807734386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f480fbd20 0x7f3f480ffc60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400b3b0 tx=0x7f3f44009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:04.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:04.067+0000 7f3f5048f700 1 -- 172.21.15.5:0/3807734386 shutdown_connections 2024-04-16T14:33:04.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:04.067+0000 7f3f5048f700 1 --2- 172.21.15.5:0/3807734386 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f3f340692a0 0x7f3f3406b750 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:04.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:04.067+0000 7f3f5048f700 1 --2- 172.21.15.5:0/3807734386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f480fbd20 0x7f3f480ffc60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:04.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:04.067+0000 7f3f5048f700 1 --2- 172.21.15.5:0/3807734386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3f480fcfd0 0x7f3f480fe310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:04.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:04.067+0000 7f3f5048f700 1 -- 172.21.15.5:0/3807734386 >> 172.21.15.5:0/3807734386 conn(0x7f3f480f74a0 msgr2=0x7f3f48066850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:04.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:04.067+0000 7f3f5048f700 1 -- 172.21.15.5:0/3807734386 shutdown_connections 2024-04-16T14:33:04.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:04.067+0000 7f3f5048f700 1 -- 172.21.15.5:0/3807734386 wait complete. 2024-04-16T14:33:04.068 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 17 2024-04-16T14:33:04.094 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:03 smithi115 ceph-mon[37295]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 716 B/s rd, 1.3 KiB/s wr, 5 op/s 2024-04-16T14:33:04.094 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:03 smithi115 ceph-mon[37295]: mds.? [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] up:reconnect 2024-04-16T14:33:04.094 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:03 smithi115 ceph-mon[37295]: mds.? [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] up:standby 2024-04-16T14:33:04.094 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:03 smithi115 ceph-mon[37295]: fsmap cephfs:2/2 {0=cephfs.smithi005.wofqlz=up:reconnect,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:33:04.752 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-04-16T14:33:05.180 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:04 smithi005 ceph-mon[28964]: mds.? [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] up:rejoin 2024-04-16T14:33:05.181 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:04 smithi005 ceph-mon[28964]: fsmap cephfs:2/2 {0=cephfs.smithi005.wofqlz=up:rejoin,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:33:05.181 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:04 smithi005 ceph-mon[28964]: daemon mds.cephfs.smithi005.wofqlz is now active in filesystem cephfs as rank 0 2024-04-16T14:33:05.181 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:04 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/3807734386' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:33:05.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:04 smithi115 ceph-mon[37295]: mds.? [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] up:rejoin 2024-04-16T14:33:05.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:04 smithi115 ceph-mon[37295]: fsmap cephfs:2/2 {0=cephfs.smithi005.wofqlz=up:rejoin,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:33:05.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:04 smithi115 ceph-mon[37295]: daemon mds.cephfs.smithi005.wofqlz is now active in filesystem cephfs as rank 0 2024-04-16T14:33:05.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:04 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/3807734386' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:33:05.565 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:33:05.966 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:05 smithi005 ceph-mon[28964]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 716 B/s wr, 4 op/s 2024-04-16T14:33:05.966 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:05 smithi005 ceph-mon[28964]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-16T14:33:05.966 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:05 smithi005 ceph-mon[28964]: Cluster is now healthy 2024-04-16T14:33:05.966 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:05 smithi005 ceph-mon[28964]: mds.? [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] up:active 2024-04-16T14:33:05.966 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:05 smithi005 ceph-mon[28964]: fsmap cephfs:2 {0=cephfs.smithi005.wofqlz=up:active,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:33:06.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:05 smithi115 ceph-mon[37295]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 716 B/s wr, 4 op/s 2024-04-16T14:33:06.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:05 smithi115 ceph-mon[37295]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-16T14:33:06.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:05 smithi115 ceph-mon[37295]: Cluster is now healthy 2024-04-16T14:33:06.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:05 smithi115 ceph-mon[37295]: mds.? [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] up:active 2024-04-16T14:33:06.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:05 smithi115 ceph-mon[37295]: fsmap cephfs:2 {0=cephfs.smithi005.wofqlz=up:active,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:33:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.156+0000 7f38346c6700 1 -- 172.21.15.5:0/1549472308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f382c0fffd0 msgr2=0x7f382c1023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.156+0000 7f38346c6700 1 --2- 172.21.15.5:0/1549472308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f382c0fffd0 0x7f382c1023b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3820004940 tx=0x7f3820009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:07.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.156+0000 7f38346c6700 1 -- 172.21.15.5:0/1549472308 shutdown_connections 2024-04-16T14:33:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.156+0000 7f38346c6700 1 --2- 172.21.15.5:0/1549472308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f382c0fffd0 0x7f382c1023b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.156+0000 7f38346c6700 1 --2- 172.21.15.5:0/1549472308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f382c066290 0x7f382c0ffa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.156+0000 7f38346c6700 1 -- 172.21.15.5:0/1549472308 >> 172.21.15.5:0/1549472308 conn(0x7f382c0f74c0 msgr2=0x7f382c0f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.156+0000 7f38346c6700 1 -- 172.21.15.5:0/1549472308 shutdown_connections 2024-04-16T14:33:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.156+0000 7f38346c6700 1 -- 172.21.15.5:0/1549472308 wait complete. 2024-04-16T14:33:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.157+0000 7f38346c6700 1 Processor -- start 2024-04-16T14:33:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.157+0000 7f38346c6700 1 -- start start 2024-04-16T14:33:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.157+0000 7f38346c6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f382c066290 0x7f382c10d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.157+0000 7f38346c6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f382c0fffd0 0x7f382c10df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.157+0000 7f38346c6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382c10e510 con 0x7f382c066290 2024-04-16T14:33:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.157+0000 7f38346c6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382c10ed10 con 0x7f382c0fffd0 2024-04-16T14:33:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.157+0000 7f3832462700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f382c066290 0x7f382c10d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.157+0000 7f3832462700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f382c066290 0x7f382c10d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39110/0 (socket says 172.21.15.5:39110) 2024-04-16T14:33:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.157+0000 7f3832462700 1 -- 172.21.15.5:0/2115249557 learned_addr learned my addr 172.21.15.5:0/2115249557 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:33:07.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.157+0000 7f3831c61700 1 --2- 172.21.15.5:0/2115249557 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f382c0fffd0 0x7f382c10df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:07.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.157+0000 7f3832462700 1 -- 172.21.15.5:0/2115249557 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f382c0fffd0 msgr2=0x7f382c10df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:07.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.157+0000 7f3832462700 1 --2- 172.21.15.5:0/2115249557 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f382c0fffd0 0x7f382c10df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:07.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.157+0000 7f3832462700 1 -- 172.21.15.5:0/2115249557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3820005040 con 0x7f382c066290 2024-04-16T14:33:07.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.158+0000 7f3832462700 1 --2- 172.21.15.5:0/2115249557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f382c066290 0x7f382c10d9d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f382800eb70 tx=0x7f382800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:07.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.158+0000 7f381effd700 1 -- 172.21.15.5:0/2115249557 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3828007cc0 con 0x7f382c066290 2024-04-16T14:33:07.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.158+0000 7f381effd700 1 -- 172.21.15.5:0/2115249557 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f382800f040 con 0x7f382c066290 2024-04-16T14:33:07.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.158+0000 7f381effd700 1 -- 172.21.15.5:0/2115249557 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f382800cb20 con 0x7f382c066290 2024-04-16T14:33:07.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.158+0000 7f38346c6700 1 -- 172.21.15.5:0/2115249557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f382c10ef90 con 0x7f382c066290 2024-04-16T14:33:07.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.158+0000 7f38346c6700 1 -- 172.21.15.5:0/2115249557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382c10f480 con 0x7f382c066290 2024-04-16T14:33:07.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.159+0000 7f38346c6700 1 -- 172.21.15.5:0/2115249557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f382c05f5f0 con 0x7f382c066290 2024-04-16T14:33:07.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.160+0000 7f381effd700 1 -- 172.21.15.5:0/2115249557 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f382800cc80 con 0x7f382c066290 2024-04-16T14:33:07.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.160+0000 7f381effd700 1 --2- 172.21.15.5:0/2115249557 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f38180692a0 0x7f381806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:07.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.160+0000 7f381effd700 1 -- 172.21.15.5:0/2115249557 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f3828086bf0 con 0x7f382c066290 2024-04-16T14:33:07.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.160+0000 7f3831c61700 1 --2- 172.21.15.5:0/2115249557 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f38180692a0 0x7f381806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:07.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.161+0000 7f3831c61700 1 --2- 172.21.15.5:0/2115249557 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f38180692a0 0x7f381806b750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3820009b30 tx=0x7f3820009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:07.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.165+0000 7f381effd700 1 -- 172.21.15.5:0/2115249557 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f382804e250 con 0x7f382c066290 2024-04-16T14:33:07.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.416+0000 7f38346c6700 1 -- 172.21.15.5:0/2115249557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f382c04bed0 con 0x7f382c066290 2024-04-16T14:33:07.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.417+0000 7f381effd700 1 -- 172.21.15.5:0/2115249557 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4697 (secure 0 0 0) 0x7f3828056990 con 0x7f382c066290 2024-04-16T14:33:07.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.419+0000 7f38346c6700 1 -- 172.21.15.5:0/2115249557 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f38180692a0 msgr2=0x7f381806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:07.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.419+0000 7f38346c6700 1 --2- 172.21.15.5:0/2115249557 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f38180692a0 0x7f381806b750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3820009b30 tx=0x7f3820009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:07.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.419+0000 7f38346c6700 1 -- 172.21.15.5:0/2115249557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f382c066290 msgr2=0x7f382c10d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:07.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.419+0000 7f38346c6700 1 --2- 172.21.15.5:0/2115249557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f382c066290 0x7f382c10d9d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f382800eb70 tx=0x7f382800b040 comp rx=0 tx=0).stop 2024-04-16T14:33:07.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.419+0000 7f38346c6700 1 -- 172.21.15.5:0/2115249557 shutdown_connections 2024-04-16T14:33:07.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.419+0000 7f38346c6700 1 --2- 172.21.15.5:0/2115249557 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f38180692a0 0x7f381806b750 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:07.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.419+0000 7f38346c6700 1 --2- 172.21.15.5:0/2115249557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f382c066290 0x7f382c10d9d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:07.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.419+0000 7f38346c6700 1 --2- 172.21.15.5:0/2115249557 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f382c0fffd0 0x7f382c10df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:07.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.419+0000 7f38346c6700 1 -- 172.21.15.5:0/2115249557 >> 172.21.15.5:0/2115249557 conn(0x7f382c0f74c0 msgr2=0x7f382c0f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:07.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.419+0000 7f38346c6700 1 -- 172.21.15.5:0/2115249557 shutdown_connections 2024-04-16T14:33:07.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:07.420+0000 7f38346c6700 1 -- 172.21.15.5:0/2115249557 wait complete. 2024-04-16T14:33:07.419 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 18 2024-04-16T14:33:07.429 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-04-16T14:33:08.001 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:07 smithi005 ceph-mon[28964]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-16T14:33:08.002 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:07 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:08.002 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:07 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:08.002 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:07 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:33:08.002 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:07 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:33:08.002 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:07 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:08.002 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:07 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:33:08.002 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:07 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/2115249557' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-16T14:33:08.028 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-04-16T14:33:08.361 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:07 smithi115 ceph-mon[37295]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-16T14:33:08.361 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:07 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:08.362 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:07 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:08.362 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:07 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:33:08.362 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:07 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:33:08.362 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:07 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:08.362 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:07 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:33:08.362 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:07 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/2115249557' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-16T14:33:08.687 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:33:10.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.185+0000 7fb69d7b9700 1 -- 172.21.15.5:0/2233587853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6980fff80 msgr2=0x7fb698102360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:10.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.185+0000 7fb69d7b9700 1 --2- 172.21.15.5:0/2233587853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6980fff80 0x7fb698102360 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb68c004940 tx=0x7fb68c009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:10.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.186+0000 7fb69d7b9700 1 -- 172.21.15.5:0/2233587853 shutdown_connections 2024-04-16T14:33:10.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.186+0000 7fb69d7b9700 1 --2- 172.21.15.5:0/2233587853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb6980fff80 0x7fb698102360 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:10.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.186+0000 7fb69d7b9700 1 --2- 172.21.15.5:0/2233587853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb698066ea0 0x7fb6980ffa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:10.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.186+0000 7fb69d7b9700 1 -- 172.21.15.5:0/2233587853 >> 172.21.15.5:0/2233587853 conn(0x7fb6980f7450 msgr2=0x7fb6980f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:10.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.186+0000 7fb69d7b9700 1 -- 172.21.15.5:0/2233587853 shutdown_connections 2024-04-16T14:33:10.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.186+0000 7fb69d7b9700 1 -- 172.21.15.5:0/2233587853 wait complete. 2024-04-16T14:33:10.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.186+0000 7fb69d7b9700 1 Processor -- start 2024-04-16T14:33:10.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.186+0000 7fb69d7b9700 1 -- start start 2024-04-16T14:33:10.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.187+0000 7fb69d7b9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb698066ea0 0x7fb69810d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:10.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.187+0000 7fb69d7b9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6980fff80 0x7fb69810deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:10.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.187+0000 7fb69d7b9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69810e4b0 con 0x7fb698066ea0 2024-04-16T14:33:10.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.187+0000 7fb69d7b9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69810e620 con 0x7fb6980fff80 2024-04-16T14:33:10.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.187+0000 7fb6967fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6980fff80 0x7fb69810deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:10.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.187+0000 7fb6967fc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6980fff80 0x7fb69810deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.5:34668/0 (socket says 172.21.15.5:34668) 2024-04-16T14:33:10.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.187+0000 7fb6967fc700 1 -- 172.21.15.5:0/11422401 learned_addr learned my addr 172.21.15.5:0/11422401 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:33:10.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.187+0000 7fb696ffd700 1 --2- 172.21.15.5:0/11422401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb698066ea0 0x7fb69810d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:10.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.187+0000 7fb696ffd700 1 -- 172.21.15.5:0/11422401 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6980fff80 msgr2=0x7fb69810deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:10.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.187+0000 7fb696ffd700 1 --2- 172.21.15.5:0/11422401 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6980fff80 0x7fb69810deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:10.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.187+0000 7fb696ffd700 1 -- 172.21.15.5:0/11422401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c005040 con 0x7fb698066ea0 2024-04-16T14:33:10.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.187+0000 7fb6967fc700 1 --2- 172.21.15.5:0/11422401 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6980fff80 0x7fb69810deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T14:33:10.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.187+0000 7fb696ffd700 1 --2- 172.21.15.5:0/11422401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb698066ea0 0x7fb69810d970 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb688002840 tx=0x7fb688004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:10.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.187+0000 7fb67f7fe700 1 -- 172.21.15.5:0/11422401 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb688007cc0 con 0x7fb698066ea0 2024-04-16T14:33:10.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.188+0000 7fb67f7fe700 1 -- 172.21.15.5:0/11422401 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb68800f040 con 0x7fb698066ea0 2024-04-16T14:33:10.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.188+0000 7fb69d7b9700 1 -- 172.21.15.5:0/11422401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb698113080 con 0x7fb698066ea0 2024-04-16T14:33:10.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.188+0000 7fb67f7fe700 1 -- 172.21.15.5:0/11422401 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb688013920 con 0x7fb698066ea0 2024-04-16T14:33:10.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.188+0000 7fb69d7b9700 1 -- 172.21.15.5:0/11422401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb698113640 con 0x7fb698066ea0 2024-04-16T14:33:10.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.188+0000 7fb69d7b9700 1 -- 172.21.15.5:0/11422401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb69804c710 con 0x7fb698066ea0 2024-04-16T14:33:10.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.189+0000 7fb67f7fe700 1 -- 172.21.15.5:0/11422401 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7fb68801c400 con 0x7fb698066ea0 2024-04-16T14:33:10.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.189+0000 7fb67f7fe700 1 --2- 172.21.15.5:0/11422401 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fb6800692a0 0x7fb68006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:10.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.190+0000 7fb67f7fe700 1 -- 172.21.15.5:0/11422401 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb688086f40 con 0x7fb698066ea0 2024-04-16T14:33:10.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.190+0000 7fb6967fc700 1 --2- 172.21.15.5:0/11422401 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fb6800692a0 0x7fb68006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:10.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.190+0000 7fb6967fc700 1 --2- 172.21.15.5:0/11422401 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fb6800692a0 0x7fb68006b750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb68c004f90 tx=0x7fb68c009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:10.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.194+0000 7fb67f7fe700 1 -- 172.21.15.5:0/11422401 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb688056c30 con 0x7fb698066ea0 2024-04-16T14:33:10.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:09 smithi005 ceph-mon[28964]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-16T14:33:10.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:09 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:10.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:09 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:10.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:09 smithi115 ceph-mon[37295]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-16T14:33:10.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:09 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:10.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:09 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:10.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.475+0000 7fb69d7b9700 1 -- 172.21.15.5:0/11422401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fb698113a70 con 0x7fb698066ea0 2024-04-16T14:33:10.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.475+0000 7fb67f7fe700 1 -- 172.21.15.5:0/11422401 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v18) v1 ==== 78+0+99 (secure 0 0 0) 0x7fb6880567c0 con 0x7fb698066ea0 2024-04-16T14:33:10.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.477+0000 7fb69d7b9700 1 -- 172.21.15.5:0/11422401 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fb6800692a0 msgr2=0x7fb68006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:10.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.477+0000 7fb69d7b9700 1 --2- 172.21.15.5:0/11422401 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fb6800692a0 0x7fb68006b750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb68c004f90 tx=0x7fb68c009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:10.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.477+0000 7fb69d7b9700 1 -- 172.21.15.5:0/11422401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb698066ea0 msgr2=0x7fb69810d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:10.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.477+0000 7fb69d7b9700 1 --2- 172.21.15.5:0/11422401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb698066ea0 0x7fb69810d970 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb688002840 tx=0x7fb688004570 comp rx=0 tx=0).stop 2024-04-16T14:33:10.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.477+0000 7fb69d7b9700 1 -- 172.21.15.5:0/11422401 shutdown_connections 2024-04-16T14:33:10.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.477+0000 7fb69d7b9700 1 --2- 172.21.15.5:0/11422401 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fb6800692a0 0x7fb68006b750 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:10.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.477+0000 7fb69d7b9700 1 --2- 172.21.15.5:0/11422401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb698066ea0 0x7fb69810d970 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:10.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.477+0000 7fb69d7b9700 1 --2- 172.21.15.5:0/11422401 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6980fff80 0x7fb69810deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:10.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.477+0000 7fb69d7b9700 1 -- 172.21.15.5:0/11422401 >> 172.21.15.5:0/11422401 conn(0x7fb6980f7450 msgr2=0x7fb6980f7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:10.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.477+0000 7fb69d7b9700 1 -- 172.21.15.5:0/11422401 shutdown_connections 2024-04-16T14:33:10.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:10.477+0000 7fb69d7b9700 1 -- 172.21.15.5:0/11422401 wait complete. 2024-04-16T14:33:10.485 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-04-16T14:33:11.053 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:10 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/11422401' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-16T14:33:11.078 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-04-16T14:33:11.090 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T14:33:11.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.222+0000 7fcc5742e640 1 -- 172.21.15.5:0/3355367905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc500fc390 msgr2=0x7fcc500fc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:11.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.222+0000 7fcc5742e640 1 --2- 172.21.15.5:0/3355367905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc500fc390 0x7fcc500fc800 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcc440048d0 tx=0x7fcc44009da0 comp rx=0 tx=0).stop 2024-04-16T14:33:11.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.222+0000 7fcc5742e640 1 -- 172.21.15.5:0/3355367905 shutdown_connections 2024-04-16T14:33:11.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.222+0000 7fcc5742e640 1 --2- 172.21.15.5:0/3355367905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc500fc390 0x7fcc500fc800 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:11.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.222+0000 7fcc5742e640 1 --2- 172.21.15.5:0/3355367905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc500fb0c0 0x7fcc500fb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:11.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.222+0000 7fcc5742e640 1 -- 172.21.15.5:0/3355367905 >> 172.21.15.5:0/3355367905 conn(0x7fcc500f6860 msgr2=0x7fcc500f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:11.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.222+0000 7fcc5742e640 1 -- 172.21.15.5:0/3355367905 shutdown_connections 2024-04-16T14:33:11.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.222+0000 7fcc5742e640 1 -- 172.21.15.5:0/3355367905 wait complete. 2024-04-16T14:33:11.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.223+0000 7fcc5742e640 1 Processor -- start 2024-04-16T14:33:11.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.223+0000 7fcc5742e640 1 -- start start 2024-04-16T14:33:11.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.223+0000 7fcc5742e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc500fb0c0 0x7fcc5010cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:11.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.223+0000 7fcc5742e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc500fc390 0x7fcc5010d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:11.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.223+0000 7fcc5742e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5010d8d0 con 0x7fcc500fc390 2024-04-16T14:33:11.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.223+0000 7fcc5742e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc50112290 con 0x7fcc500fb0c0 2024-04-16T14:33:11.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.223+0000 7fcc549c9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc500fc390 0x7fcc5010d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:11.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.223+0000 7fcc549c9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc500fc390 0x7fcc5010d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43544/0 (socket says 172.21.15.5:43544) 2024-04-16T14:33:11.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.223+0000 7fcc549c9640 1 -- 172.21.15.5:0/111034442 learned_addr learned my addr 172.21.15.5:0/111034442 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:33:11.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.223+0000 7fcc551ca640 1 --2- 172.21.15.5:0/111034442 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc500fb0c0 0x7fcc5010cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:11.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.223+0000 7fcc549c9640 1 -- 172.21.15.5:0/111034442 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc500fb0c0 msgr2=0x7fcc5010cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:11.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.223+0000 7fcc549c9640 1 --2- 172.21.15.5:0/111034442 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc500fb0c0 0x7fcc5010cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:11.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.223+0000 7fcc549c9640 1 -- 172.21.15.5:0/111034442 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc44005040 con 0x7fcc500fc390 2024-04-16T14:33:11.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.224+0000 7fcc549c9640 1 --2- 172.21.15.5:0/111034442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc500fc390 0x7fcc5010d280 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcc44007d20 tx=0x7fcc44009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:11.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.224+0000 7fcc4dffb640 1 -- 172.21.15.5:0/111034442 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc44009590 con 0x7fcc500fc390 2024-04-16T14:33:11.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.224+0000 7fcc4dffb640 1 -- 172.21.15.5:0/111034442 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcc440096f0 con 0x7fcc500fc390 2024-04-16T14:33:11.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.224+0000 7fcc5742e640 1 -- 172.21.15.5:0/111034442 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc501123d0 con 0x7fcc500fc390 2024-04-16T14:33:11.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.224+0000 7fcc4dffb640 1 -- 172.21.15.5:0/111034442 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc4403b6d0 con 0x7fcc500fc390 2024-04-16T14:33:11.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.224+0000 7fcc5742e640 1 -- 172.21.15.5:0/111034442 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc501128a0 con 0x7fcc500fc390 2024-04-16T14:33:11.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.225+0000 7fcc5742e640 1 -- 172.21.15.5:0/111034442 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc5004bcc0 con 0x7fcc500fc390 2024-04-16T14:33:11.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.225+0000 7fcc4dffb640 1 -- 172.21.15.5:0/111034442 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7fcc4402f070 con 0x7fcc500fc390 2024-04-16T14:33:11.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.226+0000 7fcc4dffb640 1 --2- 172.21.15.5:0/111034442 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fcc38069210 0x7fcc3806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:11.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.226+0000 7fcc551ca640 1 --2- 172.21.15.5:0/111034442 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fcc38069210 0x7fcc3806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:11.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.226+0000 7fcc4dffb640 1 -- 172.21.15.5:0/111034442 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fcc440a9880 con 0x7fcc500fc390 2024-04-16T14:33:11.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.227+0000 7fcc551ca640 1 --2- 172.21.15.5:0/111034442 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fcc38069210 0x7fcc3806b6c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcc40004550 tx=0x7fcc40009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:11.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.231+0000 7fcc4dffb640 1 -- 172.21.15.5:0/111034442 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fcc44075ae0 con 0x7fcc500fc390 2024-04-16T14:33:11.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.406+0000 7fcc5742e640 1 -- 172.21.15.5:0/111034442 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc50103c30 con 0x7fcc500fc390 2024-04-16T14:33:11.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.407+0000 7fcc4dffb640 1 -- 172.21.15.5:0/111034442 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+14334 (secure 0 0 0) 0x7fcc44079100 con 0x7fcc500fc390 2024-04-16T14:33:11.405 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:33:11.405 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":47,"fsid":"10609bfa-fbfd-11ee-bc90-c7b262605968","created":"2024-04-16T14:25:45.190718+0000","modified":"2024-04-16T14:33:00.804414+0000","last_up_change":"2024-04-16T14:31:26.654027+0000","last_in_change":"2024-04-16T14:31:07.952511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T14:30:12.985367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-16T14:32:44.205257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-16T14:32:44.506945+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"aa9fa9e4-bdd2-42c5-ba51-8d141fa9c4c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2400102721},{"type":"v1","addr":"172.21.15.5:6803","nonce":2400102721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2400102721},{"type":"v1","addr":"172.21.15.5:6805","nonce":2400102721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2400102721},{"type":"v1","addr":"172.21.15.5:6809","nonce":2400102721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2400102721},{"type":"v1","addr":"172.21.15.5:6807","nonce":2400102721}]},"public_addr":"172.21.15.5:6803/2400102721","cluster_addr":"172.21.15.5:6805/2400102721","heartbeat_back_addr":"172.21.15.5:6809/2400102721","heartbeat_front_addr":"172.21.15.5:6807/2400102721","state":["exists","up"]},{"osd":1,"uuid":"d4074765-a246-412a-8b68-8da402adc7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":755259206},{"type":"v1","addr":"172.21.15.5:6811","nonce":755259206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":755259206},{"type":"v1","addr":"172.21.15.5:6813","nonce":755259206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":755259206},{"type":"v1","addr":"172.21.15.5:6817","nonce":755259206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":755259206},{"type":"v1","addr":"172.21.15.5:6815","nonce":755259206}]},"public_addr":"172.21.15.5:6811/755259206","cluster_addr":"172.21.15.5:6813/755259206","heartbeat_back_addr":"172.21.15.5:6817/755259206","heartbeat_front_addr":"172.21.15.5:6815/755259206","state":["exists","up"]},{"osd":2,"uuid":"1851758c-0015-4f54-b4b8-30c1424394ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2907807829},{"type":"v1","addr":"172.21.15.5:6819","nonce":2907807829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2907807829},{"type":"v1","addr":"172.21.15.5:6821","nonce":2907807829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":2907807829},{"type":"v1","addr":"172.21.15.5:6825","nonce":2907807829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2907807829},{"type":"v1","addr":"172.21.15.5:6823","nonce":2907807829}]},"public_addr":"172.21.15.5:6819/2907807829","cluster_addr":"172.21.15.5:6821/2907807829","heartbeat_back_addr":"172.21.15.5:6825/2907807829","heartbeat_front_addr":"172.21.15.5:6823/2907807829","state":["exists","up"]},{"osd":3,"uuid":"ab6404e2-5cef-4a8a-8b93-a24914c67fc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":2081173791},{"type":"v1","addr":"172.21.15.115:6801","nonce":2081173791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":2081173791},{"type":"v1","addr":"172.21.15.115:6803","nonce":2081173791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":2081173791},{"type":"v1","addr":"172.21.15.115:6807","nonce":2081173791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":2081173791},{"type":"v1","addr":"172.21.15.115:6805","nonce":2081173791}]},"public_addr":"172.21.15.115:6801/2081173791","cluster_addr":"172.21.15.115:6803/2081173791","heartbeat_back_addr":"172.21.15.115:6807/2081173791","heartbeat_front_addr":"172.21.15.115:6805/2081173791","state":["exists","up"]},{"osd":4,"uuid":"4252814c-6811-4b53-a8be-cd65d7aa39a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":3982965260},{"type":"v1","addr":"172.21.15.115:6809","nonce":3982965260}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":3982965260},{"type":"v1","addr":"172.21.15.115:6811","nonce":3982965260}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":3982965260},{"type":"v1","addr":"172.21.15.115:6815","nonce":3982965260}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":3982965260},{"type":"v1","addr":"172.21.15.115:6813","nonce":3982965260}]},"public_addr":"172.21.15.115:6809/3982965260","cluster_addr":"172.21.15.115:6811/3982965260","heartbeat_back_addr":"172.21.15.115:6815/3982965260","heartbeat_front_addr":"172.21.15.115:6813/3982965260","state":["exists","up"]},{"osd":5,"uuid":"124732a1-f6a0-462e-bd5e-2bcd743ab2a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":448370235},{"type":"v1","addr":"172.21.15.115:6817","nonce":448370235}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":448370235},{"type":"v1","addr":"172.21.15.115:6819","nonce":448370235}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":448370235},{"type":"v1","addr":"172.21.15.115:6823","nonce":448370235}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":448370235},{"type":"v1","addr":"172.21.15.115:6821","nonce":448370235}]},"public_addr":"172.21.15.115:6817/448370235","cluster_addr":"172.21.15.115:6819/448370235","heartbeat_back_addr":"172.21.15.115:6823/448370235","heartbeat_front_addr":"172.21.15.115:6821/448370235","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:29:14.299546+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:29:41.658611+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:30:10.127883+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:30:33.310873+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:30:59.158923+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:31:24.898158+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:0/2013882368":"2024-04-17T14:26:48.930147+0000","172.21.15.5:6801/4088193218":"2024-04-17T14:26:48.930147+0000","172.21.15.5:0/1548281910":"2024-04-17T14:28:02.662455+0000","172.21.15.5:6827/3000067296":"2024-04-17T14:33:00.804392+0000","172.21.15.5:6801/1086445367":"2024-04-17T14:26:17.425567+0000","172.21.15.5:0/2015079913":"2024-04-17T14:26:17.425567+0000","172.21.15.5:0/3710869010":"2024-04-17T14:26:17.425567+0000","172.21.15.5:0/2653432440":"2024-04-17T14:28:02.662455+0000","172.21.15.5:6800/1086445367":"2024-04-17T14:26:17.425567+0000","172.21.15.5:0/3364969045":"2024-04-17T14:26:48.930147+0000","172.21.15.5:0/2384405072":"2024-04-17T14:26:17.425567+0000","172.21.15.5:0/801827499":"2024-04-17T14:26:48.930147+0000","172.21.15.5:6800/4088193218":"2024-04-17T14:26:48.930147+0000","172.21.15.5:0/3767913866":"2024-04-17T14:28:02.662455+0000","172.21.15.5:6800/4176454319":"2024-04-17T14:28:02.662455+0000","172.21.15.5:6801/4176454319":"2024-04-17T14:28:02.662455+0000","172.21.15.5:6826/3000067296":"2024-04-17T14:33:00.804392+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T14:33:11.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.409+0000 7fcc5742e640 1 -- 172.21.15.5:0/111034442 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fcc38069210 msgr2=0x7fcc3806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:11.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.409+0000 7fcc5742e640 1 --2- 172.21.15.5:0/111034442 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fcc38069210 0x7fcc3806b6c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcc40004550 tx=0x7fcc40009040 comp rx=0 tx=0).stop 2024-04-16T14:33:11.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.409+0000 7fcc5742e640 1 -- 172.21.15.5:0/111034442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc500fc390 msgr2=0x7fcc5010d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:11.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.409+0000 7fcc5742e640 1 --2- 172.21.15.5:0/111034442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc500fc390 0x7fcc5010d280 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcc44007d20 tx=0x7fcc44009da0 comp rx=0 tx=0).stop 2024-04-16T14:33:11.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.409+0000 7fcc5742e640 1 -- 172.21.15.5:0/111034442 shutdown_connections 2024-04-16T14:33:11.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.409+0000 7fcc5742e640 1 --2- 172.21.15.5:0/111034442 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fcc38069210 0x7fcc3806b6c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:11.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.409+0000 7fcc5742e640 1 --2- 172.21.15.5:0/111034442 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc500fc390 0x7fcc5010d280 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:11.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.409+0000 7fcc5742e640 1 --2- 172.21.15.5:0/111034442 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc500fb0c0 0x7fcc5010cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:11.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.409+0000 7fcc5742e640 1 -- 172.21.15.5:0/111034442 >> 172.21.15.5:0/111034442 conn(0x7fcc500f6860 msgr2=0x7fcc500f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:11.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.409+0000 7fcc5742e640 1 -- 172.21.15.5:0/111034442 shutdown_connections 2024-04-16T14:33:11.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.409+0000 7fcc5742e640 1 -- 172.21.15.5:0/111034442 wait complete. 2024-04-16T14:33:11.420 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T14:30:12.985367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-16T14:32:44.205257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-16T14:32:44.506945+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-16T14:33:11.420 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T14:33:11.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:10 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/11422401' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-16T14:33:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.531+0000 7fdb11258640 1 -- 172.21.15.5:0/3479807278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb0c0fd470 msgr2=0x7fdb0c0fd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.531+0000 7fdb11258640 1 --2- 172.21.15.5:0/3479807278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb0c0fd470 0x7fdb0c0fd8e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdaf40048d0 tx=0x7fdaf4009da0 comp rx=0 tx=0).stop 2024-04-16T14:33:11.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.531+0000 7fdb11258640 1 -- 172.21.15.5:0/3479807278 shutdown_connections 2024-04-16T14:33:11.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.531+0000 7fdb11258640 1 --2- 172.21.15.5:0/3479807278 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb0c0fd470 0x7fdb0c0fd8e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:11.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.531+0000 7fdb11258640 1 --2- 172.21.15.5:0/3479807278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb0c0fc1a0 0x7fdb0c0fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:11.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.531+0000 7fdb11258640 1 -- 172.21.15.5:0/3479807278 >> 172.21.15.5:0/3479807278 conn(0x7fdb0c0f7960 msgr2=0x7fdb0c0f9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:11.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.531+0000 7fdb11258640 1 -- 172.21.15.5:0/3479807278 shutdown_connections 2024-04-16T14:33:11.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.531+0000 7fdb11258640 1 -- 172.21.15.5:0/3479807278 wait complete. 2024-04-16T14:33:11.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.531+0000 7fdb11258640 1 Processor -- start 2024-04-16T14:33:11.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.532+0000 7fdb11258640 1 -- start start 2024-04-16T14:33:11.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.532+0000 7fdb11258640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb0c0fc1a0 0x7fdb0c10ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:11.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.532+0000 7fdb11258640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb0c0fd470 0x7fdb0c10d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:11.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.532+0000 7fdb11258640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c10d880 con 0x7fdb0c0fc1a0 2024-04-16T14:33:11.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.532+0000 7fdb11258640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c112240 con 0x7fdb0c0fd470 2024-04-16T14:33:11.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.532+0000 7fdb0ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb0c0fc1a0 0x7fdb0c10ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:11.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.532+0000 7fdb0ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb0c0fc1a0 0x7fdb0c10ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43564/0 (socket says 172.21.15.5:43564) 2024-04-16T14:33:11.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.532+0000 7fdb0ad9d640 1 -- 172.21.15.5:0/2652811858 learned_addr learned my addr 172.21.15.5:0/2652811858 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:33:11.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.532+0000 7fdb0259c640 1 --2- 172.21.15.5:0/2652811858 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb0c0fd470 0x7fdb0c10d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:11.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.532+0000 7fdb0ad9d640 1 -- 172.21.15.5:0/2652811858 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb0c0fd470 msgr2=0x7fdb0c10d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:11.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.532+0000 7fdb0ad9d640 1 --2- 172.21.15.5:0/2652811858 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb0c0fd470 0x7fdb0c10d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:11.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.532+0000 7fdb0ad9d640 1 -- 172.21.15.5:0/2652811858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf4005040 con 0x7fdb0c0fc1a0 2024-04-16T14:33:11.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.532+0000 7fdb0ad9d640 1 --2- 172.21.15.5:0/2652811858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb0c0fc1a0 0x7fdb0c10ccc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdafc002a80 tx=0x7fdafc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:11.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.532+0000 7fdb03fff640 1 -- 172.21.15.5:0/2652811858 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdafc007c30 con 0x7fdb0c0fc1a0 2024-04-16T14:33:11.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.532+0000 7fdb03fff640 1 -- 172.21.15.5:0/2652811858 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdafc00f040 con 0x7fdb0c0fc1a0 2024-04-16T14:33:11.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.532+0000 7fdb11258640 1 -- 172.21.15.5:0/2652811858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb0c1123e0 con 0x7fdb0c0fc1a0 2024-04-16T14:33:11.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.532+0000 7fdb03fff640 1 -- 172.21.15.5:0/2652811858 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdafc00db80 con 0x7fdb0c0fc1a0 2024-04-16T14:33:11.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.532+0000 7fdb11258640 1 -- 172.21.15.5:0/2652811858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb0c1128d0 con 0x7fdb0c0fc1a0 2024-04-16T14:33:11.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.533+0000 7fdb11258640 1 -- 172.21.15.5:0/2652811858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb0c04bcc0 con 0x7fdb0c0fc1a0 2024-04-16T14:33:11.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.534+0000 7fdb03fff640 1 -- 172.21.15.5:0/2652811858 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7fdafc00dd20 con 0x7fdb0c0fc1a0 2024-04-16T14:33:11.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.534+0000 7fdb03fff640 1 --2- 172.21.15.5:0/2652811858 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fdaf8069210 0x7fdaf806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:11.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.534+0000 7fdb03fff640 1 -- 172.21.15.5:0/2652811858 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fdafc086990 con 0x7fdb0c0fc1a0 2024-04-16T14:33:11.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.534+0000 7fdb0259c640 1 --2- 172.21.15.5:0/2652811858 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fdaf8069210 0x7fdaf806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:11.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.535+0000 7fdb0259c640 1 --2- 172.21.15.5:0/2652811858 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fdaf8069210 0x7fdaf806b6c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdaf40317e0 tx=0x7fdaf4009da0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:11.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.539+0000 7fdb03fff640 1 -- 172.21.15.5:0/2652811858 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fdafc04d250 con 0x7fdb0c0fc1a0 2024-04-16T14:33:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.722+0000 7fdb11258640 1 -- 172.21.15.5:0/2652811858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdb0c112be0 con 0x7fdb0c0fc1a0 2024-04-16T14:33:11.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.722+0000 7fdb03fff640 1 -- 172.21.15.5:0/2652811858 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdafc052de0 con 0x7fdb0c0fc1a0 2024-04-16T14:33:11.721 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-16T14:33:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.724+0000 7fdb11258640 1 -- 172.21.15.5:0/2652811858 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fdaf8069210 msgr2=0x7fdaf806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.724+0000 7fdb11258640 1 --2- 172.21.15.5:0/2652811858 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fdaf8069210 0x7fdaf806b6c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdaf40317e0 tx=0x7fdaf4009da0 comp rx=0 tx=0).stop 2024-04-16T14:33:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.724+0000 7fdb11258640 1 -- 172.21.15.5:0/2652811858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb0c0fc1a0 msgr2=0x7fdb0c10ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.724+0000 7fdb11258640 1 --2- 172.21.15.5:0/2652811858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb0c0fc1a0 0x7fdb0c10ccc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdafc002a80 tx=0x7fdafc004600 comp rx=0 tx=0).stop 2024-04-16T14:33:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.724+0000 7fdb11258640 1 -- 172.21.15.5:0/2652811858 shutdown_connections 2024-04-16T14:33:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.724+0000 7fdb11258640 1 --2- 172.21.15.5:0/2652811858 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fdaf8069210 0x7fdaf806b6c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.724+0000 7fdb11258640 1 --2- 172.21.15.5:0/2652811858 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb0c0fd470 0x7fdb0c10d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.724+0000 7fdb11258640 1 --2- 172.21.15.5:0/2652811858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb0c0fc1a0 0x7fdb0c10ccc0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.724+0000 7fdb11258640 1 -- 172.21.15.5:0/2652811858 >> 172.21.15.5:0/2652811858 conn(0x7fdb0c0f7960 msgr2=0x7fdb0c0f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.724+0000 7fdb11258640 1 -- 172.21.15.5:0/2652811858 shutdown_connections 2024-04-16T14:33:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.724+0000 7fdb11258640 1 -- 172.21.15.5:0/2652811858 wait complete. 2024-04-16T14:33:11.733 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-16T14:33:11.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.840+0000 7f28a66ae640 1 -- 172.21.15.5:0/487220358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a00fb080 msgr2=0x7f28a00fb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:11.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.840+0000 7f28a66ae640 1 --2- 172.21.15.5:0/487220358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a00fb080 0x7f28a00fb490 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f28900048d0 tx=0x7f2890009da0 comp rx=0 tx=0).stop 2024-04-16T14:33:11.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.840+0000 7f28a66ae640 1 -- 172.21.15.5:0/487220358 shutdown_connections 2024-04-16T14:33:11.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.840+0000 7f28a66ae640 1 --2- 172.21.15.5:0/487220358 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28a00fb9d0 0x7f28a00fc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:11.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.840+0000 7f28a66ae640 1 --2- 172.21.15.5:0/487220358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a00fb080 0x7f28a00fb490 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:11.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.840+0000 7f28a66ae640 1 -- 172.21.15.5:0/487220358 >> 172.21.15.5:0/487220358 conn(0x7f28a00f68a0 msgr2=0x7f28a00f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:11.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.840+0000 7f28a66ae640 1 -- 172.21.15.5:0/487220358 shutdown_connections 2024-04-16T14:33:11.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.840+0000 7f28a66ae640 1 -- 172.21.15.5:0/487220358 wait complete. 2024-04-16T14:33:11.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.840+0000 7f28a66ae640 1 Processor -- start 2024-04-16T14:33:11.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.840+0000 7f28a66ae640 1 -- start start 2024-04-16T14:33:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.841+0000 7f28a66ae640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28a00fb080 0x7f28a010cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.841+0000 7f28a66ae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a00fb9d0 0x7f28a010d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.841+0000 7f28a66ae640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a010d8e0 con 0x7f28a00fb9d0 2024-04-16T14:33:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.841+0000 7f28a66ae640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a01122e0 con 0x7f28a00fb080 2024-04-16T14:33:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.841+0000 7f289f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a00fb9d0 0x7f28a010d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.841+0000 7f289f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a00fb9d0 0x7f28a010d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43582/0 (socket says 172.21.15.5:43582) 2024-04-16T14:33:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.841+0000 7f289f7fe640 1 -- 172.21.15.5:0/1640033803 learned_addr learned my addr 172.21.15.5:0/1640033803 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:33:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.841+0000 7f289ffff640 1 --2- 172.21.15.5:0/1640033803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28a00fb080 0x7f28a010cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.841+0000 7f289f7fe640 1 -- 172.21.15.5:0/1640033803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28a00fb080 msgr2=0x7f28a010cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.841+0000 7f289f7fe640 1 --2- 172.21.15.5:0/1640033803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28a00fb080 0x7f28a010cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.841+0000 7f289f7fe640 1 -- 172.21.15.5:0/1640033803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2890005040 con 0x7f28a00fb9d0 2024-04-16T14:33:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.841+0000 7f289ffff640 1 --2- 172.21.15.5:0/1640033803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28a00fb080 0x7f28a010cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T14:33:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.841+0000 7f289f7fe640 1 --2- 172.21.15.5:0/1640033803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a00fb9d0 0x7f28a010d290 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f289400c790 tx=0x7f28940043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:11.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.841+0000 7f289cff9640 1 -- 172.21.15.5:0/1640033803 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f289400a820 con 0x7f28a00fb9d0 2024-04-16T14:33:11.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.841+0000 7f289cff9640 1 -- 172.21.15.5:0/1640033803 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f289400ae50 con 0x7f28a00fb9d0 2024-04-16T14:33:11.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.841+0000 7f28a66ae640 1 -- 172.21.15.5:0/1640033803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a0112480 con 0x7f28a00fb9d0 2024-04-16T14:33:11.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.841+0000 7f289cff9640 1 -- 172.21.15.5:0/1640033803 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28940115e0 con 0x7f28a00fb9d0 2024-04-16T14:33:11.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.841+0000 7f28a66ae640 1 -- 172.21.15.5:0/1640033803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a0112970 con 0x7f28a00fb9d0 2024-04-16T14:33:11.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.842+0000 7f28a66ae640 1 -- 172.21.15.5:0/1640033803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a004bcc0 con 0x7f28a00fb9d0 2024-04-16T14:33:11.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.843+0000 7f289cff9640 1 -- 172.21.15.5:0/1640033803 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f2894012400 con 0x7f28a00fb9d0 2024-04-16T14:33:11.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.843+0000 7f289cff9640 1 --2- 172.21.15.5:0/1640033803 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f2888069220 0x7f288806b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:11.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.843+0000 7f289ffff640 1 --2- 172.21.15.5:0/1640033803 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f2888069220 0x7f288806b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:11.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.844+0000 7f289cff9640 1 -- 172.21.15.5:0/1640033803 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f28940873b0 con 0x7f28a00fb9d0 2024-04-16T14:33:11.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.844+0000 7f289ffff640 1 --2- 172.21.15.5:0/1640033803 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f2888069220 0x7f288806b6d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f289002bda0 tx=0x7f2890009da0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:11.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:11.848+0000 7f289cff9640 1 -- 172.21.15.5:0/1640033803 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2894053690 con 0x7f28a00fb9d0 2024-04-16T14:33:12.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.021+0000 7f28a66ae640 1 -- 172.21.15.5:0/1640033803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f28a0112c20 con 0x7f28a00fb9d0 2024-04-16T14:33:12.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.022+0000 7f289cff9640 1 -- 172.21.15.5:0/1640033803 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v47) v1 ==== 107+0+11 (secure 0 0 0) 0x7f2894056cb0 con 0x7f28a00fb9d0 2024-04-16T14:33:12.020 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-16T14:33:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.024+0000 7f28a66ae640 1 -- 172.21.15.5:0/1640033803 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f2888069220 msgr2=0x7f288806b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.024+0000 7f28a66ae640 1 --2- 172.21.15.5:0/1640033803 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f2888069220 0x7f288806b6d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f289002bda0 tx=0x7f2890009da0 comp rx=0 tx=0).stop 2024-04-16T14:33:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.024+0000 7f28a66ae640 1 -- 172.21.15.5:0/1640033803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a00fb9d0 msgr2=0x7f28a010d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.024+0000 7f28a66ae640 1 --2- 172.21.15.5:0/1640033803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a00fb9d0 0x7f28a010d290 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f289400c790 tx=0x7f28940043c0 comp rx=0 tx=0).stop 2024-04-16T14:33:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.024+0000 7f28a66ae640 1 -- 172.21.15.5:0/1640033803 shutdown_connections 2024-04-16T14:33:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.024+0000 7f28a66ae640 1 --2- 172.21.15.5:0/1640033803 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f2888069220 0x7f288806b6d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.024+0000 7f28a66ae640 1 --2- 172.21.15.5:0/1640033803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f28a00fb9d0 0x7f28a010d290 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.024+0000 7f28a66ae640 1 --2- 172.21.15.5:0/1640033803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28a00fb080 0x7f28a010cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:12.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.024+0000 7f28a66ae640 1 -- 172.21.15.5:0/1640033803 >> 172.21.15.5:0/1640033803 conn(0x7f28a00f68a0 msgr2=0x7f28a00f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:12.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.024+0000 7f28a66ae640 1 -- 172.21.15.5:0/1640033803 shutdown_connections 2024-04-16T14:33:12.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.024+0000 7f28a66ae640 1 -- 172.21.15.5:0/1640033803 wait complete. 2024-04-16T14:33:12.033 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-16T14:33:12.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.179+0000 7f2d07eae640 1 -- 172.21.15.5:0/1554148183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d000faf30 msgr2=0x7f2d000fd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:12.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.179+0000 7f2d07eae640 1 --2- 172.21.15.5:0/1554148183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d000faf30 0x7f2d000fd7b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00048d0 tx=0x7f2cf0009da0 comp rx=0 tx=0).stop 2024-04-16T14:33:12.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.179+0000 7f2d07eae640 1 -- 172.21.15.5:0/1554148183 shutdown_connections 2024-04-16T14:33:12.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.179+0000 7f2d07eae640 1 --2- 172.21.15.5:0/1554148183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d000faf30 0x7f2d000fd7b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:12.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.179+0000 7f2d07eae640 1 --2- 172.21.15.5:0/1554148183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d000fa5e0 0x7f2d000fa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:12.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.179+0000 7f2d07eae640 1 -- 172.21.15.5:0/1554148183 >> 172.21.15.5:0/1554148183 conn(0x7f2d000f6020 msgr2=0x7f2d000f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:12.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.179+0000 7f2d07eae640 1 -- 172.21.15.5:0/1554148183 shutdown_connections 2024-04-16T14:33:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.179+0000 7f2d07eae640 1 -- 172.21.15.5:0/1554148183 wait complete. 2024-04-16T14:33:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.180+0000 7f2d07eae640 1 Processor -- start 2024-04-16T14:33:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.180+0000 7f2d07eae640 1 -- start start 2024-04-16T14:33:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.180+0000 7f2d07eae640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d000fa5e0 0x7f2d0010cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.180+0000 7f2d07eae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d000faf30 0x7f2d0010d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.180+0000 7f2d07eae640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0010dac0 con 0x7f2d000faf30 2024-04-16T14:33:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.180+0000 7f2d07eae640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d001124c0 con 0x7f2d000fa5e0 2024-04-16T14:33:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.180+0000 7f2d05449640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d000faf30 0x7f2d0010d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.180+0000 7f2d05c4a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d000fa5e0 0x7f2d0010cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.180+0000 7f2d05449640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d000faf30 0x7f2d0010d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43608/0 (socket says 172.21.15.5:43608) 2024-04-16T14:33:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.180+0000 7f2d05449640 1 -- 172.21.15.5:0/2980171949 learned_addr learned my addr 172.21.15.5:0/2980171949 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:33:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.181+0000 7f2d05449640 1 -- 172.21.15.5:0/2980171949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d000fa5e0 msgr2=0x7f2d0010cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.181+0000 7f2d05449640 1 --2- 172.21.15.5:0/2980171949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d000fa5e0 0x7f2d0010cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:12.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.181+0000 7f2d05449640 1 -- 172.21.15.5:0/2980171949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf0005040 con 0x7f2d000faf30 2024-04-16T14:33:12.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.181+0000 7f2d05c4a640 1 --2- 172.21.15.5:0/2980171949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d000fa5e0 0x7f2d0010cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T14:33:12.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.181+0000 7f2d05449640 1 --2- 172.21.15.5:0/2980171949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d000faf30 0x7f2d0010d470 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00048a0 tx=0x7f2cf0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:12.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.181+0000 7f2cf67fc640 1 -- 172.21.15.5:0/2980171949 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cf00094c0 con 0x7f2d000faf30 2024-04-16T14:33:12.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.181+0000 7f2cf67fc640 1 -- 172.21.15.5:0/2980171949 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2cf0007cc0 con 0x7f2d000faf30 2024-04-16T14:33:12.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.181+0000 7f2cf67fc640 1 -- 172.21.15.5:0/2980171949 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cf003b400 con 0x7f2d000faf30 2024-04-16T14:33:12.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.182+0000 7f2d07eae640 1 -- 172.21.15.5:0/2980171949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d00112600 con 0x7f2d000faf30 2024-04-16T14:33:12.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.182+0000 7f2d07eae640 1 -- 172.21.15.5:0/2980171949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d00112af0 con 0x7f2d000faf30 2024-04-16T14:33:12.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.183+0000 7f2d07eae640 1 -- 172.21.15.5:0/2980171949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d0004bcc0 con 0x7f2d000faf30 2024-04-16T14:33:12.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.183+0000 7f2cf67fc640 1 -- 172.21.15.5:0/2980171949 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f2cf002f070 con 0x7f2d000faf30 2024-04-16T14:33:12.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.184+0000 7f2cf67fc640 1 --2- 172.21.15.5:0/2980171949 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f2cec069210 0x7f2cec06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:12.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.184+0000 7f2cf67fc640 1 -- 172.21.15.5:0/2980171949 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f2cf00a95a0 con 0x7f2d000faf30 2024-04-16T14:33:12.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.184+0000 7f2d05c4a640 1 --2- 172.21.15.5:0/2980171949 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f2cec069210 0x7f2cec06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:12.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.184+0000 7f2d05c4a640 1 --2- 172.21.15.5:0/2980171949 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f2cec069210 0x7f2cec06b6c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc004fd0 tx=0x7f2cfc00b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:12.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.190+0000 7f2cf67fc640 1 -- 172.21.15.5:0/2980171949 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f2cf0075880 con 0x7f2d000faf30 2024-04-16T14:33:12.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:11 smithi005 ceph-mon[28964]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-16T14:33:12.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:11 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/111034442' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-16T14:33:12.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:11 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/2652811858' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-16T14:33:12.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.364+0000 7f2d07eae640 1 -- 172.21.15.5:0/2980171949 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f2d00105130 con 0x7f2d000faf30 2024-04-16T14:33:12.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.365+0000 7f2cf67fc640 1 -- 172.21.15.5:0/2980171949 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v47) v1 ==== 107+0+11 (secure 0 0 0) 0x7f2cf0078ea0 con 0x7f2d000faf30 2024-04-16T14:33:12.363 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-16T14:33:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.366+0000 7f2d07eae640 1 -- 172.21.15.5:0/2980171949 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f2cec069210 msgr2=0x7f2cec06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.366+0000 7f2d07eae640 1 --2- 172.21.15.5:0/2980171949 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f2cec069210 0x7f2cec06b6c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc004fd0 tx=0x7f2cfc00b040 comp rx=0 tx=0).stop 2024-04-16T14:33:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.366+0000 7f2d07eae640 1 -- 172.21.15.5:0/2980171949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d000faf30 msgr2=0x7f2d0010d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.366+0000 7f2d07eae640 1 --2- 172.21.15.5:0/2980171949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d000faf30 0x7f2d0010d470 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00048a0 tx=0x7f2cf0009da0 comp rx=0 tx=0).stop 2024-04-16T14:33:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.367+0000 7f2d07eae640 1 -- 172.21.15.5:0/2980171949 shutdown_connections 2024-04-16T14:33:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.367+0000 7f2d07eae640 1 --2- 172.21.15.5:0/2980171949 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f2cec069210 0x7f2cec06b6c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.367+0000 7f2d07eae640 1 --2- 172.21.15.5:0/2980171949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2d000faf30 0x7f2d0010d470 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.367+0000 7f2d07eae640 1 --2- 172.21.15.5:0/2980171949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d000fa5e0 0x7f2d0010cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:12.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.367+0000 7f2d07eae640 1 -- 172.21.15.5:0/2980171949 >> 172.21.15.5:0/2980171949 conn(0x7f2d000f6020 msgr2=0x7f2d000f76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:12.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.367+0000 7f2d07eae640 1 -- 172.21.15.5:0/2980171949 shutdown_connections 2024-04-16T14:33:12.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.367+0000 7f2d07eae640 1 -- 172.21.15.5:0/2980171949 wait complete. 2024-04-16T14:33:12.376 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T14:33:12.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:11 smithi115 ceph-mon[37295]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-16T14:33:12.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:11 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/111034442' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-16T14:33:12.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:11 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/2652811858' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-16T14:33:12.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.485+0000 7f007e39d640 1 -- 172.21.15.5:0/2811014020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00780fd470 msgr2=0x7f00780fd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:12.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.485+0000 7f007e39d640 1 --2- 172.21.15.5:0/2811014020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00780fd470 0x7f00780fd8e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f00600048d0 tx=0x7f0060009da0 comp rx=0 tx=0).stop 2024-04-16T14:33:12.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.485+0000 7f007e39d640 1 -- 172.21.15.5:0/2811014020 shutdown_connections 2024-04-16T14:33:12.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.486+0000 7f007e39d640 1 --2- 172.21.15.5:0/2811014020 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00780fd470 0x7f00780fd8e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.486+0000 7f007e39d640 1 --2- 172.21.15.5:0/2811014020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00780fc1a0 0x7f00780fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.486+0000 7f007e39d640 1 -- 172.21.15.5:0/2811014020 >> 172.21.15.5:0/2811014020 conn(0x7f00780f7960 msgr2=0x7f00780f9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.486+0000 7f007e39d640 1 -- 172.21.15.5:0/2811014020 shutdown_connections 2024-04-16T14:33:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.486+0000 7f007e39d640 1 -- 172.21.15.5:0/2811014020 wait complete. 2024-04-16T14:33:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.486+0000 7f007e39d640 1 Processor -- start 2024-04-16T14:33:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.486+0000 7f007e39d640 1 -- start start 2024-04-16T14:33:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.486+0000 7f007e39d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00780fc1a0 0x7f0078071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.486+0000 7f007e39d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00780fd470 0x7f007806f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.486+0000 7f007e39d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00780717a0 con 0x7f00780fc1a0 2024-04-16T14:33:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.486+0000 7f007e39d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007806fd60 con 0x7f00780fd470 2024-04-16T14:33:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.486+0000 7f0077fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00780fc1a0 0x7f0078071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.486+0000 7f0077fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00780fc1a0 0x7f0078071150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43616/0 (socket says 172.21.15.5:43616) 2024-04-16T14:33:12.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.486+0000 7f0077fff640 1 -- 172.21.15.5:0/2169043550 learned_addr learned my addr 172.21.15.5:0/2169043550 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:33:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.487+0000 7f006ffff640 1 --2- 172.21.15.5:0/2169043550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00780fd470 0x7f007806f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.487+0000 7f0077fff640 1 -- 172.21.15.5:0/2169043550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00780fd470 msgr2=0x7f007806f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.487+0000 7f0077fff640 1 --2- 172.21.15.5:0/2169043550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00780fd470 0x7f007806f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.487+0000 7f0077fff640 1 -- 172.21.15.5:0/2169043550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0060005040 con 0x7f00780fc1a0 2024-04-16T14:33:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.487+0000 7f0077fff640 1 --2- 172.21.15.5:0/2169043550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00780fc1a0 0x7f0078071150 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f006800c830 tx=0x7f0068004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.487+0000 7f00757fa640 1 -- 172.21.15.5:0/2169043550 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f006800a7d0 con 0x7f00780fc1a0 2024-04-16T14:33:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.487+0000 7f00757fa640 1 -- 172.21.15.5:0/2169043550 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f006800ae00 con 0x7f00780fc1a0 2024-04-16T14:33:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.487+0000 7f00757fa640 1 -- 172.21.15.5:0/2169043550 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00680113a0 con 0x7f00780fc1a0 2024-04-16T14:33:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.487+0000 7f007e39d640 1 -- 172.21.15.5:0/2169043550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0078070040 con 0x7f00780fc1a0 2024-04-16T14:33:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.487+0000 7f007e39d640 1 -- 172.21.15.5:0/2169043550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0078070530 con 0x7f00780fc1a0 2024-04-16T14:33:12.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.488+0000 7f007e39d640 1 -- 172.21.15.5:0/2169043550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0078105500 con 0x7f00780fc1a0 2024-04-16T14:33:12.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.489+0000 7f00757fa640 1 -- 172.21.15.5:0/2169043550 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f0068012400 con 0x7f00780fc1a0 2024-04-16T14:33:12.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.489+0000 7f00757fa640 1 --2- 172.21.15.5:0/2169043550 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f0064069210 0x7f006406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:12.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.489+0000 7f006ffff640 1 --2- 172.21.15.5:0/2169043550 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f0064069210 0x7f006406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:12.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.489+0000 7f00757fa640 1 -- 172.21.15.5:0/2169043550 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0068087310 con 0x7f00780fc1a0 2024-04-16T14:33:12.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.490+0000 7f006ffff640 1 --2- 172.21.15.5:0/2169043550 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f0064069210 0x7f006406b6c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f00600048a0 tx=0x7f0060009da0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:12.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.494+0000 7f00757fa640 1 -- 172.21.15.5:0/2169043550 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f00680535f0 con 0x7f00780fc1a0 2024-04-16T14:33:12.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.733+0000 7f007e39d640 1 -- 172.21.15.5:0/2169043550 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f007804bcc0 con 0x7f00780fc1a0 2024-04-16T14:33:12.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.734+0000 7f00757fa640 1 -- 172.21.15.5:0/2169043550 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4697 (secure 0 0 0) 0x7f0068056c10 con 0x7f00780fc1a0 2024-04-16T14:33:12.732 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:33:12.732 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14492,"name":"cephfs.smithi005.vzoqdl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6827/187766809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":187766809},{"type":"v1","addr":"172.21.15.5:6827","nonce":187766809}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24275,"name":"cephfs.smithi115.trkaqh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.115:6827/2476249308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2476249308},{"type":"v1","addr":"172.21.15.115:6827","nonce":2476249308}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T14:32:45.270024+0000","modified":"2024-04-16T14:33:04.825498+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14484,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi005.wofqlz","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.5:6829/402035291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":402035291},{"type":"v1","addr":"172.21.15.5:6829","nonce":402035291}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi115.byfytg","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6825/1662994117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1662994117},{"type":"v1","addr":"172.21.15.115:6825","nonce":1662994117}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-04-16T14:33:12.732 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 18 2024-04-16T14:33:12.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.735+0000 7f007e39d640 1 -- 172.21.15.5:0/2169043550 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f0064069210 msgr2=0x7f006406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:12.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.735+0000 7f007e39d640 1 --2- 172.21.15.5:0/2169043550 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f0064069210 0x7f006406b6c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f00600048a0 tx=0x7f0060009da0 comp rx=0 tx=0).stop 2024-04-16T14:33:12.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.735+0000 7f007e39d640 1 -- 172.21.15.5:0/2169043550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00780fc1a0 msgr2=0x7f0078071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:12.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.735+0000 7f007e39d640 1 --2- 172.21.15.5:0/2169043550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00780fc1a0 0x7f0078071150 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f006800c830 tx=0x7f0068004430 comp rx=0 tx=0).stop 2024-04-16T14:33:12.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.735+0000 7f007e39d640 1 -- 172.21.15.5:0/2169043550 shutdown_connections 2024-04-16T14:33:12.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.735+0000 7f007e39d640 1 --2- 172.21.15.5:0/2169043550 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f0064069210 0x7f006406b6c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:12.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.735+0000 7f007e39d640 1 --2- 172.21.15.5:0/2169043550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f00780fd470 0x7f007806f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:12.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.735+0000 7f007e39d640 1 --2- 172.21.15.5:0/2169043550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00780fc1a0 0x7f0078071150 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:12.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.735+0000 7f007e39d640 1 -- 172.21.15.5:0/2169043550 >> 172.21.15.5:0/2169043550 conn(0x7f00780f7960 msgr2=0x7f00780f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:12.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.736+0000 7f007e39d640 1 -- 172.21.15.5:0/2169043550 shutdown_connections 2024-04-16T14:33:12.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:12.736+0000 7f007e39d640 1 -- 172.21.15.5:0/2169043550 wait complete. 2024-04-16T14:33:12.746 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 18, 'max_mds': 2, 'flags': 18} 2024-04-16T14:33:12.746 INFO:teuthology.run_tasks:Running task kclient... 2024-04-16T14:33:12.775 INFO:tasks.kclient:Mounting kernel clients... 2024-04-16T14:33:12.775 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-04-16T14:33:12.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:33:12.775 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-04-16T14:33:12.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:33:12.791 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-04-16T14:33:12.861 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2024-04-16T14:33:12.862 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T14:33:12.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:33:12.863 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2024-04-16T14:33:12.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:33:12.883 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link delete ceph-brx 2024-04-16T14:33:12.961 INFO:teuthology.orchestra.run.smithi115.stderr:Cannot find device "ceph-brx" 2024-04-16T14:33:12.962 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T14:33:12.963 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-04-16T14:33:12.963 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-16T14:33:12.963 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-16T14:33:12.963 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph fs ls 2024-04-16T14:33:13.150 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:12 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/1640033803' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-16T14:33:13.150 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:12 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/2980171949' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-16T14:33:13.150 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:12 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/2169043550' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-16T14:33:13.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:12 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/1640033803' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-16T14:33:13.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:12 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/2980171949' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-16T14:33:13.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:12 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/2169043550' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-16T14:33:13.643 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:33:14.095 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:13 smithi005 ceph-mon[28964]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.3 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-16T14:33:14.434 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:13 smithi115 ceph-mon[37295]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.3 KiB/s rd, 0 B/s wr, 4 op/s 2024-04-16T14:33:15.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.186+0000 7f1db5d36700 1 -- 172.21.15.5:0/3487044576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db0070300 msgr2=0x7f1db00706d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:15.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.186+0000 7f1db5d36700 1 --2- 172.21.15.5:0/3487044576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db0070300 0x7f1db00706d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1da0004970 tx=0x7f1da0009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:15.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.186+0000 7f1db5d36700 1 -- 172.21.15.5:0/3487044576 shutdown_connections 2024-04-16T14:33:15.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.186+0000 7f1db5d36700 1 --2- 172.21.15.5:0/3487044576 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1db0070c10 0x7f1db0109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:15.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.186+0000 7f1db5d36700 1 --2- 172.21.15.5:0/3487044576 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db0070300 0x7f1db00706d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:15.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.186+0000 7f1db5d36700 1 -- 172.21.15.5:0/3487044576 >> 172.21.15.5:0/3487044576 conn(0x7f1db00f8980 msgr2=0x7f1db00fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:15.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.186+0000 7f1db5d36700 1 -- 172.21.15.5:0/3487044576 shutdown_connections 2024-04-16T14:33:15.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.186+0000 7f1db5d36700 1 -- 172.21.15.5:0/3487044576 wait complete. 2024-04-16T14:33:15.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.186+0000 7f1db5d36700 1 Processor -- start 2024-04-16T14:33:15.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.187+0000 7f1db5d36700 1 -- start start 2024-04-16T14:33:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.187+0000 7f1db5d36700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1db0070300 0x7f1db0115d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.187+0000 7f1db5d36700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db0070c10 0x7f1db0116290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.187+0000 7f1db5d36700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db01168e0 con 0x7f1db0070c10 2024-04-16T14:33:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.187+0000 7f1db5d36700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db010fcb0 con 0x7f1db0070300 2024-04-16T14:33:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.187+0000 7f1daeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db0070c10 0x7f1db0116290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.187+0000 7f1daeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db0070c10 0x7f1db0116290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43638/0 (socket says 172.21.15.5:43638) 2024-04-16T14:33:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.187+0000 7f1daeffd700 1 -- 172.21.15.5:0/1630451833 learned_addr learned my addr 172.21.15.5:0/1630451833 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:33:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.187+0000 7f1daf7fe700 1 --2- 172.21.15.5:0/1630451833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1db0070300 0x7f1db0115d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.187+0000 7f1daeffd700 1 -- 172.21.15.5:0/1630451833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1db0070300 msgr2=0x7f1db0115d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.187+0000 7f1daeffd700 1 --2- 172.21.15.5:0/1630451833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1db0070300 0x7f1db0115d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.187+0000 7f1daeffd700 1 -- 172.21.15.5:0/1630451833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da0005040 con 0x7f1db0070c10 2024-04-16T14:33:15.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.188+0000 7f1daeffd700 1 --2- 172.21.15.5:0/1630451833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db0070c10 0x7f1db0116290 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1da4002a50 tx=0x7f1da40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:15.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.188+0000 7f1d97fff700 1 -- 172.21.15.5:0/1630451833 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1da4007cc0 con 0x7f1db0070c10 2024-04-16T14:33:15.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.188+0000 7f1db5d36700 1 -- 172.21.15.5:0/1630451833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db010ff90 con 0x7f1db0070c10 2024-04-16T14:33:15.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.188+0000 7f1d97fff700 1 -- 172.21.15.5:0/1630451833 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1da400f040 con 0x7f1db0070c10 2024-04-16T14:33:15.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.188+0000 7f1d97fff700 1 -- 172.21.15.5:0/1630451833 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1da400da30 con 0x7f1db0070c10 2024-04-16T14:33:15.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.188+0000 7f1db5d36700 1 -- 172.21.15.5:0/1630451833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db01104d0 con 0x7f1db0070c10 2024-04-16T14:33:15.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.189+0000 7f1db5d36700 1 -- 172.21.15.5:0/1630451833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db0105fb0 con 0x7f1db0070c10 2024-04-16T14:33:15.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.189+0000 7f1d97fff700 1 -- 172.21.15.5:0/1630451833 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f1da400db90 con 0x7f1db0070c10 2024-04-16T14:33:15.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.190+0000 7f1d97fff700 1 --2- 172.21.15.5:0/1630451833 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f1d980692a0 0x7f1d9806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:15.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.190+0000 7f1d97fff700 1 -- 172.21.15.5:0/1630451833 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1da4086fa0 con 0x7f1db0070c10 2024-04-16T14:33:15.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.190+0000 7f1daf7fe700 1 --2- 172.21.15.5:0/1630451833 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f1d980692a0 0x7f1d9806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:15.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.190+0000 7f1daf7fe700 1 --2- 172.21.15.5:0/1630451833 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f1d980692a0 0x7f1d9806b750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1da0004f50 tx=0x7f1da0009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:15.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.194+0000 7f1d97fff700 1 -- 172.21.15.5:0/1630451833 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1da4056c90 con 0x7f1db0070c10 2024-04-16T14:33:15.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.439+0000 7f1db5d36700 1 -- 172.21.15.5:0/1630451833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1db01113a0 con 0x7f1db0070c10 2024-04-16T14:33:15.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.440+0000 7f1d97fff700 1 -- 172.21.15.5:0/1630451833 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+83 (secure 0 0 0) 0x7f1da4056820 con 0x7f1db0070c10 2024-04-16T14:33:15.438 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-16T14:33:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.442+0000 7f1db5d36700 1 -- 172.21.15.5:0/1630451833 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f1d980692a0 msgr2=0x7f1d9806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.442+0000 7f1db5d36700 1 --2- 172.21.15.5:0/1630451833 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f1d980692a0 0x7f1d9806b750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1da0004f50 tx=0x7f1da0009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.442+0000 7f1db5d36700 1 -- 172.21.15.5:0/1630451833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db0070c10 msgr2=0x7f1db0116290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.442+0000 7f1db5d36700 1 --2- 172.21.15.5:0/1630451833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db0070c10 0x7f1db0116290 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1da4002a50 tx=0x7f1da40046b0 comp rx=0 tx=0).stop 2024-04-16T14:33:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.442+0000 7f1db5d36700 1 -- 172.21.15.5:0/1630451833 shutdown_connections 2024-04-16T14:33:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.442+0000 7f1db5d36700 1 --2- 172.21.15.5:0/1630451833 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f1d980692a0 0x7f1d9806b750 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.442+0000 7f1db5d36700 1 --2- 172.21.15.5:0/1630451833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1db0070300 0x7f1db0115d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:15.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.442+0000 7f1db5d36700 1 --2- 172.21.15.5:0/1630451833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1db0070c10 0x7f1db0116290 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.442+0000 7f1db5d36700 1 -- 172.21.15.5:0/1630451833 >> 172.21.15.5:0/1630451833 conn(0x7f1db00f8980 msgr2=0x7f1db0103130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.442+0000 7f1db5d36700 1 -- 172.21.15.5:0/1630451833 shutdown_connections 2024-04-16T14:33:15.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:15.442+0000 7f1db5d36700 1 -- 172.21.15.5:0/1630451833 wait complete. 2024-04-16T14:33:16.097 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:15 smithi005 ceph-mon[28964]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-16T14:33:16.097 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:15 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:16.097 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:15 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:16.097 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:15 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:33:16.097 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:15 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:33:16.097 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:15 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:16.097 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:15 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/1630451833' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-16T14:33:16.123 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-16T14:33:16.123 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T14:33:16.123 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-04-16T14:33:16.124 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-16T14:33:16.124 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-16T14:33:16.124 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-16T14:33:16.124 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-16T14:33:16.124 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T14:33:16.124 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-16T14:33:16.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:33:16.124 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-04-16T14:33:16.141 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T14:33:16.141 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T14:33:16.142 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T14:33:16.142 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-16T14:33:16.142 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-04-16T14:33:16.142 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-16T14:33:16.142 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T14:33:16.142 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-04-16T14:33:16.142 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-04-16T14:33:16.142 INFO:teuthology.orchestra.run.smithi005.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T14:33:16.142 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-04-16T14:33:16.142 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-04-16T14:33:16.142 INFO:teuthology.orchestra.run.smithi005.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T14:33:16.142 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-04-16T14:33:16.142 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-04-16T14:33:16.143 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-16T14:33:16.143 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42249sec preferred_lft 42249sec 2024-04-16T14:33:16.143 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link noprefixroute 2024-04-16T14:33:16.143 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-04-16T14:33:16.143 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T14:33:16.143 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-04-16T14:33:16.143 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-04-16T14:33:16.143 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-16T14:33:16.143 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T14:33:16.144 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-16T14:33:16.144 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add name ceph-brx type bridge 2024-04-16T14:33:16.144 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr flush dev ceph-brx 2024-04-16T14:33:16.144 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set ceph-brx up 2024-04-16T14:33:16.144 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-16T14:33:16.144 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-16T14:33:16.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:15 smithi115 ceph-mon[37295]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-16T14:33:16.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:15 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:16.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:15 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:16.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:15 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:33:16.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:15 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:33:16.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:15 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:16.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:15 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/1630451833' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-16T14:33:16.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T14:33:16.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T14:33:16.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:33:16.353 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T14:33:16.381 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-04-16T14:33:16.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:33:16.383 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-04-16T14:33:16.446 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-04-16T14:33:16.446 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T14:33:16.446 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-16T14:33:16.446 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-16T14:33:16.446 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T14:33:16.447 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T14:33:16.447 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-16T14:33:16.447 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-16T14:33:16.447 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-16T14:33:16.447 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-16T14:33:16.447 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-16T14:33:16.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T14:33:16.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T14:33:16.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:33:16.806 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-04-16T14:33:16.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:33:16.822 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2024-04-16T14:33:16.877 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T14:33:16.877 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-16T14:33:16.877 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T14:33:16.877 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-16T14:33:16.877 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-16T14:33:16.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T14:33:16.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T14:33:17.002 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-16T14:33:17.002 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T14:33:17.002 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-16T14:33:17.002 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-16T14:33:17.002 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-16T14:33:17.002 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-16T14:33:17.002 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-16T14:33:17.002 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-16T14:33:17.002 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-16T14:33:17.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T14:33:17.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T14:33:17.152 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T14:33:17.152 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-04-16T14:33:17.152 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-04-16T14:33:17.152 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.0 master ceph-brx 2024-04-16T14:33:17.152 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-04-16T14:33:17.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T14:33:17.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T14:33:17.236 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T14:33:17.237 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-16T14:33:17.251 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-16T14:33:17.252 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T14:33:17.252 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-16T14:33:17.307 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-16T14:33:17.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:33:17.308 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-16T14:33:17.394 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-16T14:33:17.395 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-16T14:33:17.395 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-04-16T14:33:17.495 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-16T14:33:17.495 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-16T14:33:17.495 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-04-16T14:33:17.495 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.115:3300" 2024-04-16T14:33:17.495 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T14:33:17.501 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-16T14:33:17.501 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-16T14:33:17.501 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-04-16T14:33:17.501 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.115:3300" 2024-04-16T14:33:17.501 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T14:33:17.501 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.115:6789" 2024-04-16T14:33:17.501 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.115:6789:/ 2024-04-16T14:33:17.502 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=10609bfa-fbfd-11ee-bc90-c7b262605968" will pass to kernel 2024-04-16T14:33:17.502 INFO:teuthology.orchestra.run.smithi005.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-16T14:33:17.502 INFO:teuthology.orchestra.run.smithi005.stdout: You just mounted a file system that supports labels which does not 2024-04-16T14:33:17.502 INFO:teuthology.orchestra.run.smithi005.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-16T14:33:17.502 INFO:teuthology.orchestra.run.smithi005.stdout: applications will generate AVC messages and not be allowed access to 2024-04-16T14:33:17.502 INFO:teuthology.orchestra.run.smithi005.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-16T14:33:17.504 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-16T14:33:17.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:33:17.504 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-16T14:33:17.541 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T14:33:17.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T14:33:17.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T14:33:17.652 INFO:teuthology.orchestra.run.smithi005.stdout:client14530 2024-04-16T14:33:17.653 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-16T14:33:17.653 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T14:33:17.673 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T14:33:17.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T14:33:17.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T14:33:17.780 INFO:teuthology.orchestra.run.smithi005.stdout:client14530 2024-04-16T14:33:17.781 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T14:33:17.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T14:33:17.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T14:33:17.844 INFO:teuthology.orchestra.run.smithi005.stdout:client14530 2024-04-16T14:33:17.845 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968.client14530/status') 2024-04-16T14:33:17.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T14:33:17.913 INFO:teuthology.orchestra.run.smithi005.stdout:instance: client.14530 (3)192.168.0.1:0/2074550415 2024-04-16T14:33:17.913 INFO:teuthology.orchestra.run.smithi005.stdout:blocklisted: false 2024-04-16T14:33:17.913 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records in 2024-04-16T14:33:17.913 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records out 2024-04-16T14:33:17.913 INFO:teuthology.orchestra.run.smithi005.stderr:70 bytes copied, 2.2541e-05 s, 3.1 MB/s 2024-04-16T14:33:17.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T14:33:17.920 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-04-16T14:33:17.920 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-16T14:33:17.920 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-16T14:33:17.920 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- ceph fs ls 2024-04-16T14:33:18.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:17 smithi115 ceph-mon[37295]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-16T14:33:18.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:17 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:18.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:17 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:33:18.185 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:33:18.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:17 smithi005 ceph-mon[28964]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-16T14:33:18.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:17 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:18.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:17 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:33:19.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.763+0000 7fd6bf724700 1 -- 172.21.15.5:0/2017440164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6b8102f60 msgr2=0x7fd6b8103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:19.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.763+0000 7fd6bf724700 1 --2- 172.21.15.5:0/2017440164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6b8102f60 0x7fd6b8103330 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4004940 tx=0x7fd6b4009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:19.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.763+0000 7fd6bf724700 1 -- 172.21.15.5:0/2017440164 shutdown_connections 2024-04-16T14:33:19.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.763+0000 7fd6bf724700 1 --2- 172.21.15.5:0/2017440164 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6b80fb4d0 0x7fd6b80fb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:19.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.763+0000 7fd6bf724700 1 --2- 172.21.15.5:0/2017440164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6b8102f60 0x7fd6b8103330 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:19.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.763+0000 7fd6bf724700 1 -- 172.21.15.5:0/2017440164 >> 172.21.15.5:0/2017440164 conn(0x7fd6b80714c0 msgr2=0x7fd6b80718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:19.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.763+0000 7fd6bf724700 1 -- 172.21.15.5:0/2017440164 shutdown_connections 2024-04-16T14:33:19.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.763+0000 7fd6bf724700 1 -- 172.21.15.5:0/2017440164 wait complete. 2024-04-16T14:33:19.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.764+0000 7fd6bf724700 1 Processor -- start 2024-04-16T14:33:19.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.764+0000 7fd6bf724700 1 -- start start 2024-04-16T14:33:19.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.764+0000 7fd6bf724700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6b80fb4d0 0x7fd6b8115b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:19.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.764+0000 7fd6bf724700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6b8102f60 0x7fd6b81160c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:19.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.764+0000 7fd6bf724700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b8116710 con 0x7fd6b80fb4d0 2024-04-16T14:33:19.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.764+0000 7fd6bf724700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b810fcf0 con 0x7fd6b8102f60 2024-04-16T14:33:19.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.764+0000 7fd6bd4c0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6b80fb4d0 0x7fd6b8115b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:19.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.764+0000 7fd6bd4c0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6b80fb4d0 0x7fd6b8115b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33270/0 (socket says 172.21.15.5:33270) 2024-04-16T14:33:19.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.764+0000 7fd6bd4c0700 1 -- 172.21.15.5:0/3424782756 learned_addr learned my addr 172.21.15.5:0/3424782756 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:33:19.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.764+0000 7fd6bccbf700 1 --2- 172.21.15.5:0/3424782756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6b8102f60 0x7fd6b81160c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:19.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.764+0000 7fd6bd4c0700 1 -- 172.21.15.5:0/3424782756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6b8102f60 msgr2=0x7fd6b81160c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:19.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.764+0000 7fd6bd4c0700 1 --2- 172.21.15.5:0/3424782756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6b8102f60 0x7fd6b81160c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:19.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.764+0000 7fd6bd4c0700 1 -- 172.21.15.5:0/3424782756 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b4005040 con 0x7fd6b80fb4d0 2024-04-16T14:33:19.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.764+0000 7fd6bd4c0700 1 --2- 172.21.15.5:0/3424782756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6b80fb4d0 0x7fd6b8115b80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd6b400b3b0 tx=0x7fd6b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:19.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.765+0000 7fd6adffb700 1 -- 172.21.15.5:0/3424782756 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6b400e040 con 0x7fd6b80fb4d0 2024-04-16T14:33:19.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.765+0000 7fd6adffb700 1 -- 172.21.15.5:0/3424782756 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd6b400bbc0 con 0x7fd6b80fb4d0 2024-04-16T14:33:19.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.765+0000 7fd6adffb700 1 -- 172.21.15.5:0/3424782756 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6b401c630 con 0x7fd6b80fb4d0 2024-04-16T14:33:19.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.765+0000 7fd6bf724700 1 -- 172.21.15.5:0/3424782756 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b810ff70 con 0x7fd6b80fb4d0 2024-04-16T14:33:19.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.765+0000 7fd6bf724700 1 -- 172.21.15.5:0/3424782756 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b81104e0 con 0x7fd6b80fb4d0 2024-04-16T14:33:19.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.766+0000 7fd6bf724700 1 -- 172.21.15.5:0/3424782756 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b8106a20 con 0x7fd6b80fb4d0 2024-04-16T14:33:19.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.766+0000 7fd6adffb700 1 -- 172.21.15.5:0/3424782756 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7fd6b400bd30 con 0x7fd6b80fb4d0 2024-04-16T14:33:19.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.767+0000 7fd6adffb700 1 --2- 172.21.15.5:0/3424782756 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd6a40692a0 0x7fd6a406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:19.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.767+0000 7fd6adffb700 1 -- 172.21.15.5:0/3424782756 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd6b4088510 con 0x7fd6b80fb4d0 2024-04-16T14:33:19.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.767+0000 7fd6bccbf700 1 --2- 172.21.15.5:0/3424782756 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd6a40692a0 0x7fd6a406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:19.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.767+0000 7fd6bccbf700 1 --2- 172.21.15.5:0/3424782756 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd6a40692a0 0x7fd6a406b750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8111420 tx=0x7fd6a8009ee0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:19.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:19.771+0000 7fd6adffb700 1 -- 172.21.15.5:0/3424782756 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd6b40581e0 con 0x7fd6b80fb4d0 2024-04-16T14:33:20.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:20.013+0000 7fd6bf724700 1 -- 172.21.15.5:0/3424782756 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd6b8109fb0 con 0x7fd6b80fb4d0 2024-04-16T14:33:20.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:20.013+0000 7fd6adffb700 1 -- 172.21.15.5:0/3424782756 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+83 (secure 0 0 0) 0x7fd6b4057d70 con 0x7fd6b80fb4d0 2024-04-16T14:33:20.014 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-16T14:33:20.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:20.015+0000 7fd6bf724700 1 -- 172.21.15.5:0/3424782756 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd6a40692a0 msgr2=0x7fd6a406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:20.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:20.015+0000 7fd6bf724700 1 --2- 172.21.15.5:0/3424782756 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd6a40692a0 0x7fd6a406b750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8111420 tx=0x7fd6a8009ee0 comp rx=0 tx=0).stop 2024-04-16T14:33:20.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:20.015+0000 7fd6bf724700 1 -- 172.21.15.5:0/3424782756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6b80fb4d0 msgr2=0x7fd6b8115b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:20.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:20.015+0000 7fd6bf724700 1 --2- 172.21.15.5:0/3424782756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6b80fb4d0 0x7fd6b8115b80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd6b400b3b0 tx=0x7fd6b4009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:20.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:20.015+0000 7fd6bf724700 1 -- 172.21.15.5:0/3424782756 shutdown_connections 2024-04-16T14:33:20.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:20.015+0000 7fd6bf724700 1 --2- 172.21.15.5:0/3424782756 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd6a40692a0 0x7fd6a406b750 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:20.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:20.015+0000 7fd6bf724700 1 --2- 172.21.15.5:0/3424782756 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6b80fb4d0 0x7fd6b8115b80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:20.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:20.015+0000 7fd6bf724700 1 --2- 172.21.15.5:0/3424782756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6b8102f60 0x7fd6b81160c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:20.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:20.015+0000 7fd6bf724700 1 -- 172.21.15.5:0/3424782756 >> 172.21.15.5:0/3424782756 conn(0x7fd6b80714c0 msgr2=0x7fd6b80fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:20.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:20.015+0000 7fd6bf724700 1 -- 172.21.15.5:0/3424782756 shutdown_connections 2024-04-16T14:33:20.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:20.015+0000 7fd6bf724700 1 -- 172.21.15.5:0/3424782756 wait complete. 2024-04-16T14:33:20.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:19 smithi115 ceph-mon[37295]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-16T14:33:20.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:19 smithi005 ceph-mon[28964]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 2 op/s 2024-04-16T14:33:20.687 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-16T14:33:20.687 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-16T14:33:20.687 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2024-04-16T14:33:20.687 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-16T14:33:20.687 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-16T14:33:20.687 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-16T14:33:20.687 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-16T14:33:20.687 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-16T14:33:20.688 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-16T14:33:20.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:33:20.688 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2024-04-16T14:33:20.707 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-16T14:33:20.707 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-16T14:33:20.707 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2024-04-16T14:33:20.707 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2024-04-16T14:33:20.708 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2024-04-16T14:33:20.708 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2024-04-16T14:33:20.708 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T14:33:20.708 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2024-04-16T14:33:20.708 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2024-04-16T14:33:20.708 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T14:33:20.708 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2024-04-16T14:33:20.708 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2024-04-16T14:33:20.708 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-16T14:33:20.708 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2024-04-16T14:33:20.708 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-16T14:33:20.708 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2024-04-16T14:33:20.708 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-16T14:33:20.708 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 42240sec preferred_lft 42240sec 2024-04-16T14:33:20.709 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2024-04-16T14:33:20.709 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2024-04-16T14:33:20.709 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-16T14:33:20.709 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T14:33:20.709 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2024-04-16T14:33:20.709 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link add name ceph-brx type bridge 2024-04-16T14:33:20.709 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip addr flush dev ceph-brx 2024-04-16T14:33:20.709 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set ceph-brx up 2024-04-16T14:33:20.709 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-16T14:33:20.709 DEBUG:teuthology.orchestra.run.smithi115:> ') 2024-04-16T14:33:20.803 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:33:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T14:33:20.935 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:33:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T14:33:20.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:33:20.942 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-16T14:33:20.970 INFO:teuthology.orchestra.run.smithi115.stdout:1 2024-04-16T14:33:20.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:33:20.972 DEBUG:teuthology.orchestra.run.smithi115:> route 2024-04-16T14:33:20.973 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:20 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/3424782756' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-16T14:33:21.043 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2024-04-16T14:33:21.043 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-16T14:33:21.043 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-16T14:33:21.043 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-16T14:33:21.043 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-16T14:33:21.044 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T14:33:21.044 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2024-04-16T14:33:21.044 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-16T14:33:21.044 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-16T14:33:21.044 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-16T14:33:21.044 DEBUG:teuthology.orchestra.run.smithi115:> ') 2024-04-16T14:33:21.132 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:33:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T14:33:21.143 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:20 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/3424782756' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-16T14:33:21.343 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:33:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T14:33:21.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:33:21.350 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2024-04-16T14:33:21.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:33:21.366 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list-id 2024-04-16T14:33:21.421 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T14:33:21.421 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2024-04-16T14:33:21.421 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T14:33:21.421 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-16T14:33:21.421 DEBUG:teuthology.orchestra.run.smithi115:> ') 2024-04-16T14:33:21.509 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:33:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T14:33:21.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:33:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T14:33:21.545 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-16T14:33:21.546 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T14:33:21.546 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2024-04-16T14:33:21.546 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-16T14:33:21.546 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-16T14:33:21.546 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-16T14:33:21.546 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-16T14:33:21.546 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-16T14:33:21.546 DEBUG:teuthology.orchestra.run.smithi115:> ') 2024-04-16T14:33:21.594 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:33:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T14:33:21.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:33:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T14:33:21.689 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-16T14:33:21.689 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2024-04-16T14:33:21.689 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2024-04-16T14:33:21.689 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set dev brx.0 master ceph-brx 2024-04-16T14:33:21.689 DEBUG:teuthology.orchestra.run.smithi115:> ') 2024-04-16T14:33:21.738 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:33:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T14:33:21.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:33:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T14:33:21.774 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T14:33:21.774 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-16T14:33:21.790 INFO:teuthology.orchestra.run.smithi115.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-16T14:33:21.790 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-16T14:33:21.790 DEBUG:teuthology.orchestra.run.smithi115:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-16T14:33:21.846 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-16T14:33:21.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:33:21.847 DEBUG:teuthology.orchestra.run.smithi115:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-16T14:33:21.940 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-16T14:33:21.940 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-16T14:33:21.941 INFO:teuthology.orchestra.run.smithi115.stdout:invalid new device string format 2024-04-16T14:33:22.054 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-16T14:33:22.054 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-16T14:33:22.054 INFO:teuthology.orchestra.run.smithi115.stdout:invalid new device string format 2024-04-16T14:33:22.054 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.115:3300" 2024-04-16T14:33:22.054 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T14:33:22.058 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-16T14:33:22.059 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-16T14:33:22.059 INFO:teuthology.orchestra.run.smithi115.stdout:invalid new device string format 2024-04-16T14:33:22.059 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.115:3300" 2024-04-16T14:33:22.059 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-16T14:33:22.059 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.5:6789,172.21.15.115:6789" 2024-04-16T14:33:22.059 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:6789,172.21.15.115:6789:/ 2024-04-16T14:33:22.059 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=10609bfa-fbfd-11ee-bc90-c7b262605968" will pass to kernel 2024-04-16T14:33:22.060 INFO:teuthology.orchestra.run.smithi115.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-16T14:33:22.060 INFO:teuthology.orchestra.run.smithi115.stdout: You just mounted a file system that supports labels which does not 2024-04-16T14:33:22.060 INFO:teuthology.orchestra.run.smithi115.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-16T14:33:22.060 INFO:teuthology.orchestra.run.smithi115.stdout: applications will generate AVC messages and not be allowed access to 2024-04-16T14:33:22.060 INFO:teuthology.orchestra.run.smithi115.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-16T14:33:22.061 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-16T14:33:22.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:33:22.061 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-16T14:33:22.086 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:21 smithi115 ceph-mon[37295]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 85 B/s wr, 0 op/s 2024-04-16T14:33:22.090 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T14:33:22.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:33:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T14:33:22.182 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:33:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T14:33:22.189 INFO:teuthology.orchestra.run.smithi115.stdout:client14536 2024-04-16T14:33:22.189 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-16T14:33:22.189 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T14:33:22.206 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T14:33:22.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:21 smithi005 ceph-mon[28964]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 85 B/s wr, 0 op/s 2024-04-16T14:33:22.297 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:33:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T14:33:22.299 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:33:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T14:33:22.305 INFO:teuthology.orchestra.run.smithi115.stdout:client14536 2024-04-16T14:33:22.305 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-16T14:33:22.355 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:33:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-16T14:33:22.356 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:33:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T14:33:22.362 INFO:teuthology.orchestra.run.smithi115.stdout:client14536 2024-04-16T14:33:22.363 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968.client14536/status') 2024-04-16T14:33:22.412 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:33:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-16T14:33:22.427 INFO:teuthology.orchestra.run.smithi115.stdout:instance: client.14536 (3)172.21.15.115:0/382738581 2024-04-16T14:33:22.427 INFO:teuthology.orchestra.run.smithi115.stdout:blocklisted: false 2024-04-16T14:33:22.427 INFO:teuthology.orchestra.run.smithi115.stderr:0+1 records in 2024-04-16T14:33:22.428 INFO:teuthology.orchestra.run.smithi115.stderr:0+1 records out 2024-04-16T14:33:22.428 INFO:teuthology.orchestra.run.smithi115.stderr:71 bytes copied, 2.0775e-05 s, 3.4 MB/s 2024-04-16T14:33:22.428 INFO:teuthology.orchestra.run.smithi115.stderr:2024-04-16T14:33:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-16T14:33:22.435 INFO:teuthology.run_tasks:Running task print... 2024-04-16T14:33:22.447 INFO:teuthology.task.print:**** done client 2024-04-16T14:33:22.447 INFO:teuthology.run_tasks:Running task parallel... 2024-04-16T14:33:22.462 INFO:teuthology.task.parallel:starting parallel... 2024-04-16T14:33:22.462 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-16T14:33:22.463 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-16T14:33:22.463 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi005.front.sepia.ceph.com 2024-04-16T14:33:22.463 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -e sha1=36befe5d41ee8a6ea2e60983e763134278d506cf -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-04-16T14:33:22.464 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-16T14:33:22.464 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-04-16T14:33:22.468 INFO:tasks.workunit:Pulling workunits from ref 36befe5d41ee8a6ea2e60983e763134278d506cf 2024-04-16T14:33:22.469 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-16T14:33:22.469 INFO:tasks.workunit:timeout=3h 2024-04-16T14:33:22.469 INFO:tasks.workunit:cleanup=True 2024-04-16T14:33:22.469 DEBUG:teuthology.orchestra.run.smithi005:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-16T14:33:22.490 INFO:teuthology.orchestra.run.smithi005.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-16T14:33:22.490 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-16T14:33:22.490 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 89h/137d Inode: 1 Links: 2 2024-04-16T14:33:22.490 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T14:33:22.490 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-16T14:33:22.490 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-16T14:33:22.491 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-04-16 14:32:50.292726738 +0000 2024-04-16T14:33:22.491 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-04-16 14:33:17.537179237 +0000 2024-04-16T14:33:22.491 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-04-16 14:32:50.292726738 +0000 2024-04-16T14:33:22.491 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-16T14:33:22.491 DEBUG:teuthology.orchestra.run.smithi005:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-16T14:33:22.566 DEBUG:teuthology.orchestra.run.smithi115:> stat -- /home/ubuntu/cephtest/mnt.1 2024-04-16T14:33:22.584 INFO:teuthology.orchestra.run.smithi115.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-04-16T14:33:22.584 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-04-16T14:33:22.584 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 73h/115d Inode: 1 Links: 3 2024-04-16T14:33:22.584 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T14:33:22.584 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-16T14:33:22.584 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-16T14:33:22.584 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-04-16 14:33:22.562060637 +0000 2024-04-16T14:33:22.584 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-04-16 14:33:22.562060637 +0000 2024-04-16T14:33:22.585 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-04-16 14:32:50.292726738 +0000 2024-04-16T14:33:22.585 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-04-16T14:33:22.585 DEBUG:teuthology.orchestra.run.smithi115:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-04-16T14:33:22.660 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 36befe5d41ee8a6ea2e60983e763134278d506cf 2024-04-16T14:33:22.661 DEBUG:teuthology.orchestra.run.smithi115:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 36befe5d41ee8a6ea2e60983e763134278d506cf 2024-04-16T14:33:22.678 INFO:tasks.workunit.client.0.smithi005.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-16T14:33:22.715 INFO:tasks.workunit.client.1.smithi115.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-04-16T14:33:22.758 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:33:24.037 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:23 smithi005 ceph-mon[28964]: pgmap v195: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-04-16T14:33:24.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:23 smithi115 ceph-mon[37295]: pgmap v195: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-04-16T14:33:24.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.240+0000 7fd43b887700 1 -- 172.21.15.5:0/1815252473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4340ffff0 msgr2=0x7fd4341023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:24.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.240+0000 7fd43b887700 1 --2- 172.21.15.5:0/1815252473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4340ffff0 0x7fd4341023d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd428004940 tx=0x7fd428009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:24.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.240+0000 7fd43b887700 1 -- 172.21.15.5:0/1815252473 shutdown_connections 2024-04-16T14:33:24.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.240+0000 7fd43b887700 1 --2- 172.21.15.5:0/1815252473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4340ffff0 0x7fd4341023d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:24.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.240+0000 7fd43b887700 1 --2- 172.21.15.5:0/1815252473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd434066270 0x7fd4340ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:24.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.240+0000 7fd43b887700 1 -- 172.21.15.5:0/1815252473 >> 172.21.15.5:0/1815252473 conn(0x7fd4340f74c0 msgr2=0x7fd4340f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:24.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.240+0000 7fd43b887700 1 -- 172.21.15.5:0/1815252473 shutdown_connections 2024-04-16T14:33:24.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.240+0000 7fd43b887700 1 -- 172.21.15.5:0/1815252473 wait complete. 2024-04-16T14:33:24.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.241+0000 7fd43b887700 1 Processor -- start 2024-04-16T14:33:24.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.241+0000 7fd43b887700 1 -- start start 2024-04-16T14:33:24.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.241+0000 7fd43b887700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd434066270 0x7fd43410da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:24.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.241+0000 7fd43b887700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4340ffff0 0x7fd43410dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:24.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.241+0000 7fd43b887700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43410e5a0 con 0x7fd434066270 2024-04-16T14:33:24.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.241+0000 7fd43b887700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43410edf0 con 0x7fd4340ffff0 2024-04-16T14:33:24.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.241+0000 7fd439623700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd434066270 0x7fd43410da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:24.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.241+0000 7fd439623700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd434066270 0x7fd43410da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33286/0 (socket says 172.21.15.5:33286) 2024-04-16T14:33:24.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.241+0000 7fd439623700 1 -- 172.21.15.5:0/2513506423 learned_addr learned my addr 172.21.15.5:0/2513506423 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:33:24.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.241+0000 7fd438e22700 1 --2- 172.21.15.5:0/2513506423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4340ffff0 0x7fd43410dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:24.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.241+0000 7fd439623700 1 -- 172.21.15.5:0/2513506423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4340ffff0 msgr2=0x7fd43410dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:24.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.241+0000 7fd439623700 1 --2- 172.21.15.5:0/2513506423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd4340ffff0 0x7fd43410dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:24.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.241+0000 7fd439623700 1 -- 172.21.15.5:0/2513506423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd428005040 con 0x7fd434066270 2024-04-16T14:33:24.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.242+0000 7fd439623700 1 --2- 172.21.15.5:0/2513506423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd434066270 0x7fd43410da60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd42c002a80 tx=0x7fd42c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:24.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.242+0000 7fd431ffb700 1 -- 172.21.15.5:0/2513506423 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd42c007cc0 con 0x7fd434066270 2024-04-16T14:33:24.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.242+0000 7fd431ffb700 1 -- 172.21.15.5:0/2513506423 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd42c00f040 con 0x7fd434066270 2024-04-16T14:33:24.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.242+0000 7fd43b887700 1 -- 172.21.15.5:0/2513506423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd43410f0d0 con 0x7fd434066270 2024-04-16T14:33:24.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.242+0000 7fd431ffb700 1 -- 172.21.15.5:0/2513506423 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd42c00da30 con 0x7fd434066270 2024-04-16T14:33:24.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.242+0000 7fd43b887700 1 -- 172.21.15.5:0/2513506423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd43410f610 con 0x7fd434066270 2024-04-16T14:33:24.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.243+0000 7fd43b887700 1 -- 172.21.15.5:0/2513506423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd43405f5f0 con 0x7fd434066270 2024-04-16T14:33:24.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.243+0000 7fd431ffb700 1 -- 172.21.15.5:0/2513506423 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7fd42c00db90 con 0x7fd434066270 2024-04-16T14:33:24.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.244+0000 7fd431ffb700 1 --2- 172.21.15.5:0/2513506423 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd41c0692a0 0x7fd41c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:24.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.244+0000 7fd431ffb700 1 -- 172.21.15.5:0/2513506423 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd42c086f70 con 0x7fd434066270 2024-04-16T14:33:24.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.244+0000 7fd438e22700 1 --2- 172.21.15.5:0/2513506423 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd41c0692a0 0x7fd41c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:24.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.244+0000 7fd438e22700 1 --2- 172.21.15.5:0/2513506423 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd41c0692a0 0x7fd41c06b750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd42800b970 tx=0x7fd428009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:24.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.248+0000 7fd431ffb700 1 -- 172.21.15.5:0/2513506423 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd42c056c60 con 0x7fd434066270 2024-04-16T14:33:24.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.443+0000 7fd43b887700 1 -- 172.21.15.5:0/2513506423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7fd43404bed0 con 0x7fd434066270 2024-04-16T14:33:24.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:24.444+0000 7fd431ffb700 1 -- 172.21.15.5:0/2513506423 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21)=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21) v1 ==== 179+0+0 (secure 0 0 0) 0x7fd42c0567f0 con 0x7fd434066270 2024-04-16T14:33:24.443 INFO:teuthology.orchestra.run.smithi005.stderr:Error EINVAL: unrecognized config option 'mgr/orchestrator/fail_fs' 2024-04-16T14:33:25.060 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-16T14:33:25.061 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi005.front.sepia.ceph.com 2024-04-16T14:33:25.061 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -e sha1=36befe5d41ee8a6ea2e60983e763134278d506cf -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-04-16T14:33:25.370 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:33:26.032 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:25 smithi005 ceph-mon[28964]: pgmap v196: 65 pgs: 65 active+clean; 582 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-16T14:33:26.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:25 smithi115 ceph-mon[37295]: pgmap v196: 65 pgs: 65 active+clean; 582 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-16T14:33:26.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.846+0000 7f339fe14700 1 -- 172.21.15.5:0/702970489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3398070890 msgr2=0x7f3398070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:26.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.846+0000 7f339fe14700 1 --2- 172.21.15.5:0/702970489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3398070890 0x7f3398070d00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f338c004940 tx=0x7f338c009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:26.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.846+0000 7f339fe14700 1 -- 172.21.15.5:0/702970489 shutdown_connections 2024-04-16T14:33:26.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.846+0000 7f339fe14700 1 --2- 172.21.15.5:0/702970489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3398070890 0x7f3398070d00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:26.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.846+0000 7f339fe14700 1 --2- 172.21.15.5:0/702970489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3398071e40 0x7f3398070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:26.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.846+0000 7f339fe14700 1 -- 172.21.15.5:0/702970489 >> 172.21.15.5:0/702970489 conn(0x7f33980f8570 msgr2=0x7f33980fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:26.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.846+0000 7f339fe14700 1 -- 172.21.15.5:0/702970489 shutdown_connections 2024-04-16T14:33:26.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.846+0000 7f339fe14700 1 -- 172.21.15.5:0/702970489 wait complete. 2024-04-16T14:33:26.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.846+0000 7f339fe14700 1 Processor -- start 2024-04-16T14:33:26.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.847+0000 7f339fe14700 1 -- start start 2024-04-16T14:33:26.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.847+0000 7f339fe14700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3398070890 0x7f339810fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:26.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.847+0000 7f339fe14700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3398071e40 0x7f3398110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:26.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.847+0000 7f339fe14700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3398110800 con 0x7f3398070890 2024-04-16T14:33:26.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.847+0000 7f339fe14700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3398110ff0 con 0x7f3398071e40 2024-04-16T14:33:26.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.847+0000 7f339dbb0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3398070890 0x7f339810fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:26.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.847+0000 7f339dbb0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3398070890 0x7f339810fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33302/0 (socket says 172.21.15.5:33302) 2024-04-16T14:33:26.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.847+0000 7f339dbb0700 1 -- 172.21.15.5:0/549692573 learned_addr learned my addr 172.21.15.5:0/549692573 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:33:26.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.847+0000 7f339d3af700 1 --2- 172.21.15.5:0/549692573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3398071e40 0x7f3398110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:26.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.847+0000 7f339dbb0700 1 -- 172.21.15.5:0/549692573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3398071e40 msgr2=0x7f3398110170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:26.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.847+0000 7f339dbb0700 1 --2- 172.21.15.5:0/549692573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3398071e40 0x7f3398110170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:26.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.847+0000 7f339dbb0700 1 -- 172.21.15.5:0/549692573 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338c005040 con 0x7f3398070890 2024-04-16T14:33:26.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.847+0000 7f339d3af700 1 --2- 172.21.15.5:0/549692573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3398071e40 0x7f3398110170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:33:26.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.847+0000 7f339dbb0700 1 --2- 172.21.15.5:0/549692573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3398070890 0x7f339810fc30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f338800bae0 tx=0x7f3388009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:26.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.847+0000 7f33967fc700 1 -- 172.21.15.5:0/549692573 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f338800c8c0 con 0x7f3398070890 2024-04-16T14:33:26.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.848+0000 7f339fe14700 1 -- 172.21.15.5:0/549692573 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33981112d0 con 0x7f3398070890 2024-04-16T14:33:26.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.848+0000 7f33967fc700 1 -- 172.21.15.5:0/549692573 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3388014410 con 0x7f3398070890 2024-04-16T14:33:26.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.848+0000 7f33967fc700 1 -- 172.21.15.5:0/549692573 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3388007610 con 0x7f3398070890 2024-04-16T14:33:26.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.848+0000 7f339fe14700 1 -- 172.21.15.5:0/549692573 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3398111890 con 0x7f3398070890 2024-04-16T14:33:26.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.849+0000 7f339fe14700 1 -- 172.21.15.5:0/549692573 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f339805f5f0 con 0x7f3398070890 2024-04-16T14:33:26.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.849+0000 7f33967fc700 1 -- 172.21.15.5:0/549692573 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f3388014580 con 0x7f3398070890 2024-04-16T14:33:26.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.849+0000 7f33967fc700 1 --2- 172.21.15.5:0/549692573 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f33800692a0 0x7f338006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:26.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.849+0000 7f33967fc700 1 -- 172.21.15.5:0/549692573 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f33880872f0 con 0x7f3398070890 2024-04-16T14:33:26.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.849+0000 7f339d3af700 1 --2- 172.21.15.5:0/549692573 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f33800692a0 0x7f338006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:26.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.850+0000 7f339d3af700 1 --2- 172.21.15.5:0/549692573 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f33800692a0 0x7f338006b750 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f338c00b970 tx=0x7f338c009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:26.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:26.854+0000 7f33967fc700 1 -- 172.21.15.5:0/549692573 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f338804d250 con 0x7f3398070890 2024-04-16T14:33:27.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:27.049+0000 7f339fe14700 1 -- 172.21.15.5:0/549692573 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f339804bed0 con 0x7f3398070890 2024-04-16T14:33:27.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:27.050+0000 7f33967fc700 1 -- 172.21.15.5:0/549692573 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f3388056fe0 con 0x7f3398070890 2024-04-16T14:33:27.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:27.052+0000 7f339fe14700 1 -- 172.21.15.5:0/549692573 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f33800692a0 msgr2=0x7f338006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:27.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:27.052+0000 7f339fe14700 1 --2- 172.21.15.5:0/549692573 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f33800692a0 0x7f338006b750 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f338c00b970 tx=0x7f338c009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:27.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:27.052+0000 7f339fe14700 1 -- 172.21.15.5:0/549692573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3398070890 msgr2=0x7f339810fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:27.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:27.052+0000 7f339fe14700 1 --2- 172.21.15.5:0/549692573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3398070890 0x7f339810fc30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f338800bae0 tx=0x7f3388009810 comp rx=0 tx=0).stop 2024-04-16T14:33:27.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:27.052+0000 7f339fe14700 1 -- 172.21.15.5:0/549692573 shutdown_connections 2024-04-16T14:33:27.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:27.052+0000 7f339fe14700 1 --2- 172.21.15.5:0/549692573 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f33800692a0 0x7f338006b750 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:27.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:27.052+0000 7f339fe14700 1 --2- 172.21.15.5:0/549692573 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3398070890 0x7f339810fc30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:27.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:27.052+0000 7f339fe14700 1 --2- 172.21.15.5:0/549692573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3398071e40 0x7f3398110170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:27.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:27.052+0000 7f339fe14700 1 -- 172.21.15.5:0/549692573 >> 172.21.15.5:0/549692573 conn(0x7f33980f8570 msgr2=0x7f33980f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:27.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:27.052+0000 7f339fe14700 1 -- 172.21.15.5:0/549692573 shutdown_connections 2024-04-16T14:33:27.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:27.052+0000 7f339fe14700 1 -- 172.21.15.5:0/549692573 wait complete. 2024-04-16T14:33:27.818 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -e sha1=36befe5d41ee8a6ea2e60983e763134278d506cf -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-04-16T14:33:28.088 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:33:28.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:27 smithi115 ceph-mon[37295]: pgmap v197: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-04-16T14:33:28.198 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:27 smithi005 ceph-mon[28964]: pgmap v197: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-04-16T14:33:29.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.619+0000 7fc566e97700 1 -- 172.21.15.5:0/471243984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5600fcfa0 msgr2=0x7fc5600fd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:29.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.619+0000 7fc566e97700 1 --2- 172.21.15.5:0/471243984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5600fcfa0 0x7fc5600fd410 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc54c004940 tx=0x7fc54c009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:29.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.619+0000 7fc566e97700 1 -- 172.21.15.5:0/471243984 shutdown_connections 2024-04-16T14:33:29.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.619+0000 7fc566e97700 1 --2- 172.21.15.5:0/471243984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5600fcfa0 0x7fc5600fd410 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:29.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.619+0000 7fc566e97700 1 --2- 172.21.15.5:0/471243984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5600fbcf0 0x7fc5600fc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.619+0000 7fc566e97700 1 -- 172.21.15.5:0/471243984 >> 172.21.15.5:0/471243984 conn(0x7fc5600f7450 msgr2=0x7fc5600f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.619+0000 7fc566e97700 1 -- 172.21.15.5:0/471243984 shutdown_connections 2024-04-16T14:33:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.619+0000 7fc566e97700 1 -- 172.21.15.5:0/471243984 wait complete. 2024-04-16T14:33:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.620+0000 7fc566e97700 1 Processor -- start 2024-04-16T14:33:29.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.620+0000 7fc566e97700 1 -- start start 2024-04-16T14:33:29.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.620+0000 7fc566e97700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5600fbcf0 0x7fc560066d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:29.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.620+0000 7fc566e97700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5600fcfa0 0x7fc560112750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:29.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.620+0000 7fc566e97700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc560112c90 con 0x7fc5600fbcf0 2024-04-16T14:33:29.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.620+0000 7fc566e97700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc560112dd0 con 0x7fc5600fcfa0 2024-04-16T14:33:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.621+0000 7fc564c33700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5600fbcf0 0x7fc560066d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.621+0000 7fc564c33700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5600fbcf0 0x7fc560066d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46228/0 (socket says 172.21.15.5:46228) 2024-04-16T14:33:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.621+0000 7fc564c33700 1 -- 172.21.15.5:0/206105002 learned_addr learned my addr 172.21.15.5:0/206105002 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:33:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.621+0000 7fc55ffff700 1 --2- 172.21.15.5:0/206105002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5600fcfa0 0x7fc560112750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.621+0000 7fc564c33700 1 -- 172.21.15.5:0/206105002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5600fcfa0 msgr2=0x7fc560112750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.621+0000 7fc564c33700 1 --2- 172.21.15.5:0/206105002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5600fcfa0 0x7fc560112750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.621+0000 7fc564c33700 1 -- 172.21.15.5:0/206105002 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54c005040 con 0x7fc5600fbcf0 2024-04-16T14:33:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.621+0000 7fc564c33700 1 --2- 172.21.15.5:0/206105002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5600fbcf0 0x7fc560066d60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc55400c8c0 tx=0x7fc5540044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.621+0000 7fc55d7fa700 1 -- 172.21.15.5:0/206105002 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc55400a760 con 0x7fc5600fbcf0 2024-04-16T14:33:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.621+0000 7fc55d7fa700 1 -- 172.21.15.5:0/206105002 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc55400ad90 con 0x7fc5600fbcf0 2024-04-16T14:33:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.621+0000 7fc566e97700 1 -- 172.21.15.5:0/206105002 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc560112fd0 con 0x7fc5600fbcf0 2024-04-16T14:33:29.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.621+0000 7fc55d7fa700 1 -- 172.21.15.5:0/206105002 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5540113a0 con 0x7fc5600fbcf0 2024-04-16T14:33:29.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.621+0000 7fc566e97700 1 -- 172.21.15.5:0/206105002 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc560113560 con 0x7fc5600fbcf0 2024-04-16T14:33:29.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.622+0000 7fc566e97700 1 -- 172.21.15.5:0/206105002 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc56004c710 con 0x7fc5600fbcf0 2024-04-16T14:33:29.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.623+0000 7fc55d7fa700 1 -- 172.21.15.5:0/206105002 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7fc554012400 con 0x7fc5600fbcf0 2024-04-16T14:33:29.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.623+0000 7fc55d7fa700 1 --2- 172.21.15.5:0/206105002 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fc5500692a0 0x7fc55006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:29.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.623+0000 7fc55d7fa700 1 -- 172.21.15.5:0/206105002 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc554087240 con 0x7fc5600fbcf0 2024-04-16T14:33:29.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.623+0000 7fc55ffff700 1 --2- 172.21.15.5:0/206105002 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fc5500692a0 0x7fc55006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:29.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.624+0000 7fc55ffff700 1 --2- 172.21.15.5:0/206105002 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fc5500692a0 0x7fc55006b750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc54c00b3b0 tx=0x7fc54c009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:29.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.628+0000 7fc55d7fa700 1 -- 172.21.15.5:0/206105002 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc554056fb0 con 0x7fc5600fbcf0 2024-04-16T14:33:29.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.822+0000 7fc566e97700 1 -- 172.21.15.5:0/206105002 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fc5601047e0 con 0x7fc5600fbcf0 2024-04-16T14:33:29.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.822+0000 7fc55d7fa700 1 -- 172.21.15.5:0/206105002 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7fc55405c020 con 0x7fc5600fbcf0 2024-04-16T14:33:29.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.824+0000 7fc566e97700 1 -- 172.21.15.5:0/206105002 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fc5500692a0 msgr2=0x7fc55006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.824+0000 7fc566e97700 1 --2- 172.21.15.5:0/206105002 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fc5500692a0 0x7fc55006b750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc54c00b3b0 tx=0x7fc54c009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.824+0000 7fc566e97700 1 -- 172.21.15.5:0/206105002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5600fbcf0 msgr2=0x7fc560066d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.824+0000 7fc566e97700 1 --2- 172.21.15.5:0/206105002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5600fbcf0 0x7fc560066d60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc55400c8c0 tx=0x7fc5540044c0 comp rx=0 tx=0).stop 2024-04-16T14:33:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.824+0000 7fc566e97700 1 -- 172.21.15.5:0/206105002 shutdown_connections 2024-04-16T14:33:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.824+0000 7fc566e97700 1 --2- 172.21.15.5:0/206105002 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fc5500692a0 0x7fc55006b750 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.824+0000 7fc566e97700 1 --2- 172.21.15.5:0/206105002 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc5600fbcf0 0x7fc560066d60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.824+0000 7fc566e97700 1 --2- 172.21.15.5:0/206105002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc5600fcfa0 0x7fc560112750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.824+0000 7fc566e97700 1 -- 172.21.15.5:0/206105002 >> 172.21.15.5:0/206105002 conn(0x7fc5600f7450 msgr2=0x7fc5600f8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.824+0000 7fc566e97700 1 -- 172.21.15.5:0/206105002 shutdown_connections 2024-04-16T14:33:29.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:29.824+0000 7fc566e97700 1 -- 172.21.15.5:0/206105002 wait complete. 2024-04-16T14:33:30.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:29 smithi115 ceph-mon[37295]: pgmap v198: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-04-16T14:33:30.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:29 smithi005 ceph-mon[28964]: pgmap v198: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 1 op/s 2024-04-16T14:33:30.430 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -e sha1=36befe5d41ee8a6ea2e60983e763134278d506cf -- bash -c 'ceph config set global log_to_journald false --force' 2024-04-16T14:33:30.707 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:33:31.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:31 smithi005 ceph-mon[28964]: pgmap v199: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-04-16T14:33:32.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:31 smithi115 ceph-mon[37295]: pgmap v199: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-04-16T14:33:32.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.196+0000 7f01bc81e700 1 -- 172.21.15.5:0/3632812177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01b80fce80 msgr2=0x7f01b80fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:32.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.196+0000 7f01bc81e700 1 --2- 172.21.15.5:0/3632812177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01b80fce80 0x7f01b80fd290 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f01a8009ce0 tx=0x7f01a8004d10 comp rx=0 tx=0).stop 2024-04-16T14:33:32.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.196+0000 7f01bc81e700 1 -- 172.21.15.5:0/3632812177 shutdown_connections 2024-04-16T14:33:32.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.196+0000 7f01bc81e700 1 --2- 172.21.15.5:0/3632812177 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01b80fdff0 0x7f01b80fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:32.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.196+0000 7f01bc81e700 1 --2- 172.21.15.5:0/3632812177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01b80fce80 0x7f01b80fd290 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:32.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.196+0000 7f01bc81e700 1 -- 172.21.15.5:0/3632812177 >> 172.21.15.5:0/3632812177 conn(0x7f01b80f8580 msgr2=0x7f01b80fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:32.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.196+0000 7f01bc81e700 1 -- 172.21.15.5:0/3632812177 shutdown_connections 2024-04-16T14:33:32.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.196+0000 7f01bc81e700 1 -- 172.21.15.5:0/3632812177 wait complete. 2024-04-16T14:33:32.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.197+0000 7f01bc81e700 1 Processor -- start 2024-04-16T14:33:32.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.197+0000 7f01bc81e700 1 -- start start 2024-04-16T14:33:32.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.197+0000 7f01bc81e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01b80fce80 0x7f01b8071c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:32.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.197+0000 7f01bc81e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01b80fdff0 0x7f01b8070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:32.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.197+0000 7f01bc81e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b8072260 con 0x7f01b80fce80 2024-04-16T14:33:32.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.197+0000 7f01bc81e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b8070850 con 0x7f01b80fdff0 2024-04-16T14:33:32.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.197+0000 7f01b659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01b80fce80 0x7f01b8071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:32.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.197+0000 7f01b659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01b80fce80 0x7f01b8071c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46246/0 (socket says 172.21.15.5:46246) 2024-04-16T14:33:32.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.197+0000 7f01b659c700 1 -- 172.21.15.5:0/305039843 learned_addr learned my addr 172.21.15.5:0/305039843 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:33:32.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.197+0000 7f01b5d9b700 1 --2- 172.21.15.5:0/305039843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01b80fdff0 0x7f01b8070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:32.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.197+0000 7f01b659c700 1 -- 172.21.15.5:0/305039843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01b80fdff0 msgr2=0x7f01b8070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:32.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.197+0000 7f01b659c700 1 --2- 172.21.15.5:0/305039843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01b80fdff0 0x7f01b8070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:32.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.197+0000 7f01b659c700 1 -- 172.21.15.5:0/305039843 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a8009940 con 0x7f01b80fce80 2024-04-16T14:33:32.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.197+0000 7f01b5d9b700 1 --2- 172.21.15.5:0/305039843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01b80fdff0 0x7f01b8070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:33:32.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.197+0000 7f01b659c700 1 --2- 172.21.15.5:0/305039843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01b80fce80 0x7f01b8071c60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f01a8004740 tx=0x7f01a8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:32.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.198+0000 7f01aeffd700 1 -- 172.21.15.5:0/305039843 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01a800e040 con 0x7f01b80fce80 2024-04-16T14:33:32.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.198+0000 7f01bc81e700 1 -- 172.21.15.5:0/305039843 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b8070aa0 con 0x7f01b80fce80 2024-04-16T14:33:32.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.198+0000 7f01aeffd700 1 -- 172.21.15.5:0/305039843 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f01a80128e0 con 0x7f01b80fce80 2024-04-16T14:33:32.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.198+0000 7f01aeffd700 1 -- 172.21.15.5:0/305039843 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01a801ca80 con 0x7f01b80fce80 2024-04-16T14:33:32.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.198+0000 7f01bc81e700 1 -- 172.21.15.5:0/305039843 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b8071060 con 0x7f01b80fce80 2024-04-16T14:33:32.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.199+0000 7f01bc81e700 1 -- 172.21.15.5:0/305039843 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01b804c710 con 0x7f01b80fce80 2024-04-16T14:33:32.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.199+0000 7f01aeffd700 1 -- 172.21.15.5:0/305039843 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f01a8012a50 con 0x7f01b80fce80 2024-04-16T14:33:32.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.199+0000 7f01aeffd700 1 --2- 172.21.15.5:0/305039843 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f01a40692a0 0x7f01a406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:32.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.200+0000 7f01aeffd700 1 -- 172.21.15.5:0/305039843 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f01a8088ef0 con 0x7f01b80fce80 2024-04-16T14:33:32.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.200+0000 7f01b5d9b700 1 --2- 172.21.15.5:0/305039843 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f01a40692a0 0x7f01a406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:32.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.200+0000 7f01b5d9b700 1 --2- 172.21.15.5:0/305039843 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f01a40692a0 0x7f01a406b750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f01a0007fd0 tx=0x7f01a0009040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:32.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.204+0000 7f01aeffd700 1 -- 172.21.15.5:0/305039843 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f01a8058be0 con 0x7f01b80fce80 2024-04-16T14:33:32.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.401+0000 7f01bc81e700 1 -- 172.21.15.5:0/305039843 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f01b8115d70 con 0x7f01b80fce80 2024-04-16T14:33:32.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.402+0000 7f01aeffd700 1 -- 172.21.15.5:0/305039843 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f01a8058770 con 0x7f01b80fce80 2024-04-16T14:33:32.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.404+0000 7f01bc81e700 1 -- 172.21.15.5:0/305039843 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f01a40692a0 msgr2=0x7f01a406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:32.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.404+0000 7f01bc81e700 1 --2- 172.21.15.5:0/305039843 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f01a40692a0 0x7f01a406b750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f01a0007fd0 tx=0x7f01a0009040 comp rx=0 tx=0).stop 2024-04-16T14:33:32.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.404+0000 7f01bc81e700 1 -- 172.21.15.5:0/305039843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01b80fce80 msgr2=0x7f01b8071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:32.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.404+0000 7f01bc81e700 1 --2- 172.21.15.5:0/305039843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01b80fce80 0x7f01b8071c60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f01a8004740 tx=0x7f01a8004d10 comp rx=0 tx=0).stop 2024-04-16T14:33:32.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.404+0000 7f01bc81e700 1 -- 172.21.15.5:0/305039843 shutdown_connections 2024-04-16T14:33:32.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.404+0000 7f01bc81e700 1 --2- 172.21.15.5:0/305039843 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f01a40692a0 0x7f01a406b750 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:32.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.404+0000 7f01bc81e700 1 --2- 172.21.15.5:0/305039843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f01b80fce80 0x7f01b8071c60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:32.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.404+0000 7f01bc81e700 1 --2- 172.21.15.5:0/305039843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f01b80fdff0 0x7f01b8070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:32.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.404+0000 7f01bc81e700 1 -- 172.21.15.5:0/305039843 >> 172.21.15.5:0/305039843 conn(0x7f01b80f8580 msgr2=0x7f01b80f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:32.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.405+0000 7f01bc81e700 1 -- 172.21.15.5:0/305039843 shutdown_connections 2024-04-16T14:33:32.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:32.405+0000 7f01bc81e700 1 -- 172.21.15.5:0/305039843 wait complete. 2024-04-16T14:33:33.033 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:32 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:33:33.058 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -e sha1=36befe5d41ee8a6ea2e60983e763134278d506cf -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-04-16T14:33:33.082 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:32 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:33:33.325 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:33:34.116 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:33 smithi005 ceph-mon[28964]: pgmap v200: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-04-16T14:33:34.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:33 smithi115 ceph-mon[37295]: pgmap v200: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-04-16T14:33:34.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.959+0000 7f5e27b46700 1 -- 172.21.15.5:0/2358879044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e200fce50 msgr2=0x7f5e200fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:34.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.959+0000 7f5e27b46700 1 --2- 172.21.15.5:0/2358879044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e200fce50 0x7f5e200fd260 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5e18009ce0 tx=0x7f5e18004d10 comp rx=0 tx=0).stop 2024-04-16T14:33:34.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.959+0000 7f5e27b46700 1 -- 172.21.15.5:0/2358879044 shutdown_connections 2024-04-16T14:33:34.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.959+0000 7f5e27b46700 1 --2- 172.21.15.5:0/2358879044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e200fe050 0x7f5e200fe4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:34.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.959+0000 7f5e27b46700 1 --2- 172.21.15.5:0/2358879044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e200fce50 0x7f5e200fd260 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:34.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.959+0000 7f5e27b46700 1 -- 172.21.15.5:0/2358879044 >> 172.21.15.5:0/2358879044 conn(0x7f5e200f8580 msgr2=0x7f5e200fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:34.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.959+0000 7f5e27b46700 1 -- 172.21.15.5:0/2358879044 shutdown_connections 2024-04-16T14:33:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.959+0000 7f5e27b46700 1 -- 172.21.15.5:0/2358879044 wait complete. 2024-04-16T14:33:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.959+0000 7f5e27b46700 1 Processor -- start 2024-04-16T14:33:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.960+0000 7f5e27b46700 1 -- start start 2024-04-16T14:33:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.960+0000 7f5e27b46700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e200fce50 0x7f5e20071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.960+0000 7f5e27b46700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e200fe050 0x7f5e20070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.960+0000 7f5e27b46700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e200708c0 con 0x7f5e200fe050 2024-04-16T14:33:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.960+0000 7f5e27b46700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e20070a30 con 0x7f5e200fce50 2024-04-16T14:33:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.960+0000 7f5e250e1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e200fe050 0x7f5e20070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.960+0000 7f5e250e1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e200fe050 0x7f5e20070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46264/0 (socket says 172.21.15.5:46264) 2024-04-16T14:33:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.960+0000 7f5e250e1700 1 -- 172.21.15.5:0/2282854694 learned_addr learned my addr 172.21.15.5:0/2282854694 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:33:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.960+0000 7f5e258e2700 1 --2- 172.21.15.5:0/2282854694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e200fce50 0x7f5e20071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.960+0000 7f5e250e1700 1 -- 172.21.15.5:0/2282854694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e200fce50 msgr2=0x7f5e20071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.960+0000 7f5e250e1700 1 --2- 172.21.15.5:0/2282854694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e200fce50 0x7f5e20071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:34.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.960+0000 7f5e250e1700 1 -- 172.21.15.5:0/2282854694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e18009940 con 0x7f5e200fe050 2024-04-16T14:33:34.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.960+0000 7f5e250e1700 1 --2- 172.21.15.5:0/2282854694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e200fe050 0x7f5e20070310 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400c8c0 tx=0x7f5e140044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:34.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.960+0000 7f5e1e7fc700 1 -- 172.21.15.5:0/2282854694 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e1400a980 con 0x7f5e200fe050 2024-04-16T14:33:34.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.961+0000 7f5e1e7fc700 1 -- 172.21.15.5:0/2282854694 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5e1400ce60 con 0x7f5e200fe050 2024-04-16T14:33:34.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.961+0000 7f5e27b46700 1 -- 172.21.15.5:0/2282854694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e20070d10 con 0x7f5e200fe050 2024-04-16T14:33:34.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.961+0000 7f5e1e7fc700 1 -- 172.21.15.5:0/2282854694 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e140115e0 con 0x7f5e200fe050 2024-04-16T14:33:34.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.961+0000 7f5e27b46700 1 -- 172.21.15.5:0/2282854694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e20115c50 con 0x7f5e200fe050 2024-04-16T14:33:34.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.962+0000 7f5e27b46700 1 -- 172.21.15.5:0/2282854694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e2005f5f0 con 0x7f5e200fe050 2024-04-16T14:33:34.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.962+0000 7f5e1e7fc700 1 -- 172.21.15.5:0/2282854694 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f5e14012400 con 0x7f5e200fe050 2024-04-16T14:33:34.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.963+0000 7f5e1e7fc700 1 --2- 172.21.15.5:0/2282854694 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f5e080692a0 0x7f5e0806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:34.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.963+0000 7f5e1e7fc700 1 -- 172.21.15.5:0/2282854694 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f5e140872f0 con 0x7f5e200fe050 2024-04-16T14:33:34.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.963+0000 7f5e258e2700 1 --2- 172.21.15.5:0/2282854694 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f5e080692a0 0x7f5e0806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:34.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.963+0000 7f5e258e2700 1 --2- 172.21.15.5:0/2282854694 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f5e080692a0 0x7f5e0806b750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5e18009470 tx=0x7f5e18004d10 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:34.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:34.967+0000 7f5e1e7fc700 1 -- 172.21.15.5:0/2282854694 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5e140535d0 con 0x7f5e200fe050 2024-04-16T14:33:35.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:35.179+0000 7f5e27b46700 1 -- 172.21.15.5:0/2282854694 --> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:36befe5d41ee8a6ea2e60983e763134278d506cf", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e20102430 con 0x7f5e080692a0 2024-04-16T14:33:35.183 INFO:teuthology.orchestra.run.smithi005.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:36befe5d41ee8a6ea2e60983e763134278d506cf 2024-04-16T14:33:35.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:35.184+0000 7f5e1e7fc700 1 -- 172.21.15.5:0/2282854694 <== mgr.14212 v2:172.21.15.5:6800/3841652776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f5e20102430 con 0x7f5e080692a0 2024-04-16T14:33:35.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:35.186+0000 7f5e27b46700 1 -- 172.21.15.5:0/2282854694 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f5e080692a0 msgr2=0x7f5e0806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:35.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:35.186+0000 7f5e27b46700 1 --2- 172.21.15.5:0/2282854694 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f5e080692a0 0x7f5e0806b750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5e18009470 tx=0x7f5e18004d10 comp rx=0 tx=0).stop 2024-04-16T14:33:35.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:35.186+0000 7f5e27b46700 1 -- 172.21.15.5:0/2282854694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e200fe050 msgr2=0x7f5e20070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:35.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:35.186+0000 7f5e27b46700 1 --2- 172.21.15.5:0/2282854694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e200fe050 0x7f5e20070310 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400c8c0 tx=0x7f5e140044c0 comp rx=0 tx=0).stop 2024-04-16T14:33:35.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:35.186+0000 7f5e27b46700 1 -- 172.21.15.5:0/2282854694 shutdown_connections 2024-04-16T14:33:35.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:35.186+0000 7f5e27b46700 1 --2- 172.21.15.5:0/2282854694 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f5e080692a0 0x7f5e0806b750 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:35.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:35.186+0000 7f5e27b46700 1 --2- 172.21.15.5:0/2282854694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e200fce50 0x7f5e20071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:35.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:35.186+0000 7f5e27b46700 1 --2- 172.21.15.5:0/2282854694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e200fe050 0x7f5e20070310 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:35.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:35.187+0000 7f5e27b46700 1 -- 172.21.15.5:0/2282854694 >> 172.21.15.5:0/2282854694 conn(0x7f5e200f8580 msgr2=0x7f5e200f9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:35.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:35.187+0000 7f5e27b46700 1 -- 172.21.15.5:0/2282854694 shutdown_connections 2024-04-16T14:33:35.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:35.187+0000 7f5e27b46700 1 -- 172.21.15.5:0/2282854694 wait complete. 2024-04-16T14:33:35.905 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:35 smithi005 ceph-mon[28964]: pgmap v201: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-04-16T14:33:35.905 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:35 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:35.905 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:35 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:33:35.905 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:35 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:33:35.905 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:35 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:33:35.906 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:35 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:35.907 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-16T14:33:35.907 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi005.front.sepia.ceph.com 2024-04-16T14:33:35.907 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -e sha1=36befe5d41ee8a6ea2e60983e763134278d506cf -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-04-16T14:33:36.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:35 smithi115 ceph-mon[37295]: pgmap v201: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-04-16T14:33:36.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:35 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:36.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:35 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:33:36.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:35 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:33:36.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:35 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:33:36.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:35 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:33:36.188 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:33:37.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:36 smithi115 ceph-mon[37295]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:36befe5d41ee8a6ea2e60983e763134278d506cf", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:33:37.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:36 smithi115 ceph-mon[37295]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:36befe5d41ee8a6ea2e60983e763134278d506cf 2024-04-16T14:33:37.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:36 smithi115 ceph-mon[37295]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:36befe5d41ee8a6ea2e60983e763134278d506cf 2024-04-16T14:33:37.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:36 smithi005 ceph-mon[28964]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:36befe5d41ee8a6ea2e60983e763134278d506cf", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:33:37.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:36 smithi005 ceph-mon[28964]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:36befe5d41ee8a6ea2e60983e763134278d506cf 2024-04-16T14:33:37.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:36 smithi005 ceph-mon[28964]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:36befe5d41ee8a6ea2e60983e763134278d506cf 2024-04-16T14:33:38.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.000+0000 7fd659359700 1 -- 172.21.15.5:0/2955939049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd654066f00 msgr2=0x7fd6540ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:38.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.000+0000 7fd659359700 1 --2- 172.21.15.5:0/2955939049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd654066f00 0x7fd6540ff9e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd644004940 tx=0x7fd644009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:38.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.000+0000 7fd659359700 1 -- 172.21.15.5:0/2955939049 shutdown_connections 2024-04-16T14:33:38.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.000+0000 7fd659359700 1 --2- 172.21.15.5:0/2955939049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6540fff20 0x7fd654102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:38.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.000+0000 7fd659359700 1 --2- 172.21.15.5:0/2955939049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd654066f00 0x7fd6540ff9e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:38.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.000+0000 7fd659359700 1 -- 172.21.15.5:0/2955939049 >> 172.21.15.5:0/2955939049 conn(0x7fd6540f7450 msgr2=0x7fd6540f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:38.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.000+0000 7fd659359700 1 -- 172.21.15.5:0/2955939049 shutdown_connections 2024-04-16T14:33:38.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.000+0000 7fd659359700 1 -- 172.21.15.5:0/2955939049 wait complete. 2024-04-16T14:33:38.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.001+0000 7fd659359700 1 Processor -- start 2024-04-16T14:33:38.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.001+0000 7fd659359700 1 -- start start 2024-04-16T14:33:38.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.001+0000 7fd659359700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd654066f00 0x7fd65410d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:38.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.001+0000 7fd659359700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6540fff20 0x7fd65410ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:38.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.001+0000 7fd659359700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65410e4d0 con 0x7fd654066f00 2024-04-16T14:33:38.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.001+0000 7fd659359700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65410e640 con 0x7fd6540fff20 2024-04-16T14:33:38.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.001+0000 7fd652ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd654066f00 0x7fd65410d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:38.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.001+0000 7fd652ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd654066f00 0x7fd65410d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46294/0 (socket says 172.21.15.5:46294) 2024-04-16T14:33:38.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.001+0000 7fd652ffd700 1 -- 172.21.15.5:0/2141716509 learned_addr learned my addr 172.21.15.5:0/2141716509 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:33:38.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.001+0000 7fd6527fc700 1 --2- 172.21.15.5:0/2141716509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6540fff20 0x7fd65410ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:38.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.002+0000 7fd652ffd700 1 -- 172.21.15.5:0/2141716509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6540fff20 msgr2=0x7fd65410ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:38.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.002+0000 7fd652ffd700 1 --2- 172.21.15.5:0/2141716509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6540fff20 0x7fd65410ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:38.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.002+0000 7fd652ffd700 1 -- 172.21.15.5:0/2141716509 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd644005040 con 0x7fd654066f00 2024-04-16T14:33:38.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.002+0000 7fd652ffd700 1 --2- 172.21.15.5:0/2141716509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd654066f00 0x7fd65410d990 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd64400b3b0 tx=0x7fd644009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:38.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.002+0000 7fd63b7fe700 1 -- 172.21.15.5:0/2141716509 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd64400e040 con 0x7fd654066f00 2024-04-16T14:33:38.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.002+0000 7fd659359700 1 -- 172.21.15.5:0/2141716509 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd654113040 con 0x7fd654066f00 2024-04-16T14:33:38.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.002+0000 7fd63b7fe700 1 -- 172.21.15.5:0/2141716509 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd64400bbf0 con 0x7fd654066f00 2024-04-16T14:33:38.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.002+0000 7fd63b7fe700 1 -- 172.21.15.5:0/2141716509 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd64401c630 con 0x7fd654066f00 2024-04-16T14:33:38.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.002+0000 7fd659359700 1 -- 172.21.15.5:0/2141716509 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd654113600 con 0x7fd654066f00 2024-04-16T14:33:38.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.003+0000 7fd659359700 1 -- 172.21.15.5:0/2141716509 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd65404c710 con 0x7fd654066f00 2024-04-16T14:33:38.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.004+0000 7fd63b7fe700 1 -- 172.21.15.5:0/2141716509 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7fd64400bd60 con 0x7fd654066f00 2024-04-16T14:33:38.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.004+0000 7fd63b7fe700 1 --2- 172.21.15.5:0/2141716509 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd63c0692a0 0x7fd63c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:38.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.004+0000 7fd63b7fe700 1 -- 172.21.15.5:0/2141716509 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd644087e90 con 0x7fd654066f00 2024-04-16T14:33:38.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.004+0000 7fd6527fc700 1 --2- 172.21.15.5:0/2141716509 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd63c0692a0 0x7fd63c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:38.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.005+0000 7fd6527fc700 1 --2- 172.21.15.5:0/2141716509 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd63c0692a0 0x7fd63c06b750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd648004f40 tx=0x7fd64800b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:38.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.009+0000 7fd63b7fe700 1 -- 172.21.15.5:0/2141716509 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd644057c00 con 0x7fd654066f00 2024-04-16T14:33:38.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:37 smithi115 ceph-mon[37295]: pgmap v202: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-04-16T14:33:38.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:37 smithi005 ceph-mon[28964]: pgmap v202: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-04-16T14:33:38.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.234+0000 7fd659359700 1 -- 172.21.15.5:0/2141716509 --> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6540f8f90 con 0x7fd63c0692a0 2024-04-16T14:33:38.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.235+0000 7fd63b7fe700 1 -- 172.21.15.5:0/2141716509 <== mgr.14212 v2:172.21.15.5:6800/3841652776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fd6540f8f90 con 0x7fd63c0692a0 2024-04-16T14:33:38.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.237+0000 7fd659359700 1 -- 172.21.15.5:0/2141716509 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd63c0692a0 msgr2=0x7fd63c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:38.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.237+0000 7fd659359700 1 --2- 172.21.15.5:0/2141716509 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd63c0692a0 0x7fd63c06b750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd648004f40 tx=0x7fd64800b040 comp rx=0 tx=0).stop 2024-04-16T14:33:38.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.237+0000 7fd659359700 1 -- 172.21.15.5:0/2141716509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd654066f00 msgr2=0x7fd65410d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:38.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.237+0000 7fd659359700 1 --2- 172.21.15.5:0/2141716509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd654066f00 0x7fd65410d990 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd64400b3b0 tx=0x7fd644009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:38.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.237+0000 7fd659359700 1 -- 172.21.15.5:0/2141716509 shutdown_connections 2024-04-16T14:33:38.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.237+0000 7fd659359700 1 --2- 172.21.15.5:0/2141716509 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd63c0692a0 0x7fd63c06b750 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:38.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.237+0000 7fd659359700 1 --2- 172.21.15.5:0/2141716509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd654066f00 0x7fd65410d990 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:38.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.237+0000 7fd659359700 1 --2- 172.21.15.5:0/2141716509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6540fff20 0x7fd65410ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:38.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.237+0000 7fd659359700 1 -- 172.21.15.5:0/2141716509 >> 172.21.15.5:0/2141716509 conn(0x7fd6540f7450 msgr2=0x7fd6540f7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:38.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.237+0000 7fd659359700 1 -- 172.21.15.5:0/2141716509 shutdown_connections 2024-04-16T14:33:38.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.237+0000 7fd659359700 1 -- 172.21.15.5:0/2141716509 wait complete. 2024-04-16T14:33:38.245 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-04-16T14:33:38.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.348+0000 7f5615719700 1 -- 172.21.15.5:0/1532979639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56100fe410 msgr2=0x7f56100fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:38.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.348+0000 7f5615719700 1 --2- 172.21.15.5:0/1532979639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56100fe410 0x7f56100fe820 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5600004940 tx=0x7f5600009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:38.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.348+0000 7f5615719700 1 -- 172.21.15.5:0/1532979639 shutdown_connections 2024-04-16T14:33:38.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.348+0000 7f5615719700 1 --2- 172.21.15.5:0/1532979639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56100fed60 0x7f56100faea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:38.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.348+0000 7f5615719700 1 --2- 172.21.15.5:0/1532979639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56100fe410 0x7f56100fe820 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:38.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.348+0000 7f5615719700 1 -- 172.21.15.5:0/1532979639 >> 172.21.15.5:0/1532979639 conn(0x7f56100f6bd0 msgr2=0x7f56100f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:38.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.348+0000 7f5615719700 1 -- 172.21.15.5:0/1532979639 shutdown_connections 2024-04-16T14:33:38.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.349+0000 7f5615719700 1 -- 172.21.15.5:0/1532979639 wait complete. 2024-04-16T14:33:38.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.349+0000 7f5615719700 1 Processor -- start 2024-04-16T14:33:38.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.349+0000 7f5615719700 1 -- start start 2024-04-16T14:33:38.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.349+0000 7f5615719700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56100fe410 0x7f56100fdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:38.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.349+0000 7f5615719700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56100fed60 0x7f56100fc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:38.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.349+0000 7f5615719700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56100fc6f0 con 0x7f56100fe410 2024-04-16T14:33:38.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.349+0000 7f5615719700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56100fc830 con 0x7f56100fed60 2024-04-16T14:33:38.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.350+0000 7f560effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56100fe410 0x7f56100fdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:38.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.350+0000 7f560effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56100fe410 0x7f56100fdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46312/0 (socket says 172.21.15.5:46312) 2024-04-16T14:33:38.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.350+0000 7f560effd700 1 -- 172.21.15.5:0/2624550447 learned_addr learned my addr 172.21.15.5:0/2624550447 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:33:38.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.350+0000 7f560e7fc700 1 --2- 172.21.15.5:0/2624550447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56100fed60 0x7f56100fc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:38.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.350+0000 7f560effd700 1 -- 172.21.15.5:0/2624550447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56100fed60 msgr2=0x7f56100fc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:38.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.350+0000 7f560effd700 1 --2- 172.21.15.5:0/2624550447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56100fed60 0x7f56100fc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:38.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.350+0000 7f560effd700 1 -- 172.21.15.5:0/2624550447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5600005040 con 0x7f56100fe410 2024-04-16T14:33:38.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.350+0000 7f560e7fc700 1 --2- 172.21.15.5:0/2624550447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56100fed60 0x7f56100fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T14:33:38.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.350+0000 7f560effd700 1 --2- 172.21.15.5:0/2624550447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56100fe410 0x7f56100fdbb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f560000b3b0 tx=0x7f5600009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:38.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.350+0000 7f55f77fe700 1 -- 172.21.15.5:0/2624550447 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f560000e040 con 0x7f56100fe410 2024-04-16T14:33:38.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.350+0000 7f55f77fe700 1 -- 172.21.15.5:0/2624550447 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f560000bcc0 con 0x7f56100fe410 2024-04-16T14:33:38.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.350+0000 7f5615719700 1 -- 172.21.15.5:0/2624550447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56100fcab0 con 0x7f56100fe410 2024-04-16T14:33:38.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.350+0000 7f55f77fe700 1 -- 172.21.15.5:0/2624550447 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f560001c630 con 0x7f56100fe410 2024-04-16T14:33:38.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.350+0000 7f5615719700 1 -- 172.21.15.5:0/2624550447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5610115a90 con 0x7f56100fe410 2024-04-16T14:33:38.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.351+0000 7f5615719700 1 -- 172.21.15.5:0/2624550447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f561005f5f0 con 0x7f56100fe410 2024-04-16T14:33:38.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.352+0000 7f55f77fe700 1 -- 172.21.15.5:0/2624550447 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f5600013980 con 0x7f56100fe410 2024-04-16T14:33:38.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.353+0000 7f55f77fe700 1 --2- 172.21.15.5:0/2624550447 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f55f80692a0 0x7f55f806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:38.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.353+0000 7f55f77fe700 1 -- 172.21.15.5:0/2624550447 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f5600088670 con 0x7f56100fe410 2024-04-16T14:33:38.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.353+0000 7f560e7fc700 1 --2- 172.21.15.5:0/2624550447 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f55f80692a0 0x7f55f806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:38.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.353+0000 7f560e7fc700 1 --2- 172.21.15.5:0/2624550447 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f55f80692a0 0x7f55f806b750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f56100fe190 tx=0x7f5604008040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:38.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.357+0000 7f55f77fe700 1 -- 172.21.15.5:0/2624550447 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f56000549f0 con 0x7f56100fe410 2024-04-16T14:33:38.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.594+0000 7f5615719700 1 -- 172.21.15.5:0/2624550447 --> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f56101024b0 con 0x7f55f80692a0 2024-04-16T14:33:38.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.595+0000 7f55f77fe700 1 -- 172.21.15.5:0/2624550447 <== mgr.14212 v2:172.21.15.5:6800/3841652776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f56101024b0 con 0x7f55f80692a0 2024-04-16T14:33:38.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.598+0000 7f5615719700 1 -- 172.21.15.5:0/2624550447 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f55f80692a0 msgr2=0x7f55f806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:38.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.598+0000 7f5615719700 1 --2- 172.21.15.5:0/2624550447 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f55f80692a0 0x7f55f806b750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f56100fe190 tx=0x7f5604008040 comp rx=0 tx=0).stop 2024-04-16T14:33:38.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.598+0000 7f5615719700 1 -- 172.21.15.5:0/2624550447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56100fe410 msgr2=0x7f56100fdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:38.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.598+0000 7f5615719700 1 --2- 172.21.15.5:0/2624550447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56100fe410 0x7f56100fdbb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f560000b3b0 tx=0x7f5600009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:38.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.598+0000 7f5615719700 1 -- 172.21.15.5:0/2624550447 shutdown_connections 2024-04-16T14:33:38.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.598+0000 7f5615719700 1 --2- 172.21.15.5:0/2624550447 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f55f80692a0 0x7f55f806b750 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:38.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.598+0000 7f5615719700 1 --2- 172.21.15.5:0/2624550447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56100fe410 0x7f56100fdbb0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:38.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.598+0000 7f5615719700 1 --2- 172.21.15.5:0/2624550447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56100fed60 0x7f56100fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:38.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.598+0000 7f5615719700 1 -- 172.21.15.5:0/2624550447 >> 172.21.15.5:0/2624550447 conn(0x7f56100f6bd0 msgr2=0x7f56100f8210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:38.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.598+0000 7f5615719700 1 -- 172.21.15.5:0/2624550447 shutdown_connections 2024-04-16T14:33:38.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.599+0000 7f5615719700 1 -- 172.21.15.5:0/2624550447 wait complete. 2024-04-16T14:33:38.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.709+0000 7f2670b49700 1 -- 172.21.15.5:0/2083573621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f266c0fffd0 msgr2=0x7f266c1023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:38.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.709+0000 7f2670b49700 1 --2- 172.21.15.5:0/2083573621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f266c0fffd0 0x7f266c1023b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2660004940 tx=0x7f2660009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:38.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.709+0000 7f2670b49700 1 -- 172.21.15.5:0/2083573621 shutdown_connections 2024-04-16T14:33:38.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.709+0000 7f2670b49700 1 --2- 172.21.15.5:0/2083573621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f266c0fffd0 0x7f266c1023b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:38.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.709+0000 7f2670b49700 1 --2- 172.21.15.5:0/2083573621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f266c066290 0x7f266c0ffa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:38.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.709+0000 7f2670b49700 1 -- 172.21.15.5:0/2083573621 >> 172.21.15.5:0/2083573621 conn(0x7f266c0f74c0 msgr2=0x7f266c0f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:38.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.709+0000 7f2670b49700 1 -- 172.21.15.5:0/2083573621 shutdown_connections 2024-04-16T14:33:38.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.709+0000 7f2670b49700 1 -- 172.21.15.5:0/2083573621 wait complete. 2024-04-16T14:33:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.710+0000 7f2670b49700 1 Processor -- start 2024-04-16T14:33:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.710+0000 7f2670b49700 1 -- start start 2024-04-16T14:33:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.710+0000 7f2670b49700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f266c066290 0x7f266c10da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.710+0000 7f2670b49700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f266c0fffd0 0x7f266c10df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.710+0000 7f2670b49700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266c10e540 con 0x7f266c066290 2024-04-16T14:33:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.710+0000 7f2670b49700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266c10ed90 con 0x7f266c0fffd0 2024-04-16T14:33:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.710+0000 7f266a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f266c066290 0x7f266c10da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.710+0000 7f266a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f266c066290 0x7f266c10da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37192/0 (socket says 172.21.15.5:37192) 2024-04-16T14:33:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.710+0000 7f266a59c700 1 -- 172.21.15.5:0/3509637983 learned_addr learned my addr 172.21.15.5:0/3509637983 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:33:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.710+0000 7f2669d9b700 1 --2- 172.21.15.5:0/3509637983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f266c0fffd0 0x7f266c10df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.711+0000 7f266a59c700 1 -- 172.21.15.5:0/3509637983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f266c0fffd0 msgr2=0x7f266c10df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:38.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.711+0000 7f266a59c700 1 --2- 172.21.15.5:0/3509637983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f266c0fffd0 0x7f266c10df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.711+0000 7f266a59c700 1 -- 172.21.15.5:0/3509637983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2660005040 con 0x7f266c066290 2024-04-16T14:33:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.711+0000 7f266a59c700 1 --2- 172.21.15.5:0/3509637983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f266c066290 0x7f266c10da00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f265c002a80 tx=0x7f265c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.711+0000 7f265affd700 1 -- 172.21.15.5:0/3509637983 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f265c007cc0 con 0x7f266c066290 2024-04-16T14:33:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.711+0000 7f265affd700 1 -- 172.21.15.5:0/3509637983 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f265c00f040 con 0x7f266c066290 2024-04-16T14:33:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.711+0000 7f265affd700 1 -- 172.21.15.5:0/3509637983 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f265c00da30 con 0x7f266c066290 2024-04-16T14:33:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.711+0000 7f2670b49700 1 -- 172.21.15.5:0/3509637983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f266c10f070 con 0x7f266c066290 2024-04-16T14:33:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.711+0000 7f2670b49700 1 -- 172.21.15.5:0/3509637983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266c10f560 con 0x7f266c066290 2024-04-16T14:33:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.712+0000 7f2670b49700 1 -- 172.21.15.5:0/3509637983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f266c05f5f0 con 0x7f266c066290 2024-04-16T14:33:38.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.713+0000 7f265affd700 1 -- 172.21.15.5:0/3509637983 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f265c00db90 con 0x7f266c066290 2024-04-16T14:33:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.713+0000 7f265affd700 1 --2- 172.21.15.5:0/3509637983 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f26540692a0 0x7f265406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.713+0000 7f265affd700 1 -- 172.21.15.5:0/3509637983 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f265c086f80 con 0x7f266c066290 2024-04-16T14:33:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.713+0000 7f2669d9b700 1 --2- 172.21.15.5:0/3509637983 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f26540692a0 0x7f265406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:38.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.714+0000 7f2669d9b700 1 --2- 172.21.15.5:0/3509637983 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f26540692a0 0x7f265406b750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f266000b970 tx=0x7f2660009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:38.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.718+0000 7f265affd700 1 -- 172.21.15.5:0/3509637983 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f265c056c70 con 0x7f266c066290 2024-04-16T14:33:38.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.930+0000 7f2670b49700 1 -- 172.21.15.5:0/3509637983 --> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f266c10f9a0 con 0x7f26540692a0 2024-04-16T14:33:38.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.941+0000 7f265affd700 1 -- 172.21.15.5:0/3509637983 <== mgr.14212 v2:172.21.15.5:6800/3841652776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f266c10f9a0 con 0x7f26540692a0 2024-04-16T14:33:38.939 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-16T14:33:38.940 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.smithi005 smithi005 *:9093,9094 running (4m) 24s ago 6m 25.5M - 0.25.0 c8568f914cd2 0f1dad05c95e 2024-04-16T14:33:38.940 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi005 smithi005 running (6m) 24s ago 6m 6669k - 17.2.7-868-g412a5526 b04d96489b7c 6a380d6ec070 2024-04-16T14:33:38.940 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi115 smithi115 running (5m) 29s ago 5m 6665k - 17.2.7-868-g412a5526 b04d96489b7c df7cb0bfe65b 2024-04-16T14:33:38.940 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.smithi005 smithi005 *:3000 running (4m) 24s ago 6m 88.7M - 9.4.7 954c08fa6188 e6011313e3be 2024-04-16T14:33:38.940 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.vzoqdl smithi005 running (49s) 24s ago 48s 10.4M - 17.2.7-868-g412a5526 b04d96489b7c 84a74a406a1d 2024-04-16T14:33:38.940 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.wofqlz smithi005 running (43s) 24s ago 42s 14.1M - 17.2.7-868-g412a5526 b04d96489b7c d0e053ab2f72 2024-04-16T14:33:38.940 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.byfytg smithi115 running (46s) 29s ago 46s 14.5M - 17.2.7-868-g412a5526 b04d96489b7c 595cd0892f66 2024-04-16T14:33:38.940 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.trkaqh smithi115 running (40s) 29s ago 40s 11.1M - 17.2.7-868-g412a5526 b04d96489b7c 5b60cd2ad79b 2024-04-16T14:33:38.940 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi005.ipwdkc smithi005 *:9283 running (7m) 24s ago 7m 481M - 17.2.7-868-g412a5526 b04d96489b7c 53fb89eec045 2024-04-16T14:33:38.941 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi115.brjkpo smithi115 *:8443,9283 running (5m) 29s ago 5m 434M - 17.2.7-868-g412a5526 b04d96489b7c 6eb664cfe6b2 2024-04-16T14:33:38.941 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi005 smithi005 running (7m) 24s ago 7m 46.5M 2048M 17.2.7-868-g412a5526 b04d96489b7c 764b6a128874 2024-04-16T14:33:38.941 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi115 smithi115 running (5m) 29s ago 5m 34.1M 2048M 17.2.7-868-g412a5526 b04d96489b7c feb5354cdbe9 2024-04-16T14:33:38.941 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi005 smithi005 *:9100 running (6m) 24s ago 6m 14.1M - 1.5.0 0da6a335fe13 16f9701011ea 2024-04-16T14:33:38.941 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi115 smithi115 *:9100 running (5m) 29s ago 5m 16.2M - 1.5.0 0da6a335fe13 38c140c04a1e 2024-04-16T14:33:38.941 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (4m) 24s ago 4m 48.1M 4289M 17.2.7-868-g412a5526 b04d96489b7c ed7aa0542d96 2024-04-16T14:33:38.941 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (4m) 24s ago 4m 49.3M 4289M 17.2.7-868-g412a5526 b04d96489b7c 1868cc6c89f4 2024-04-16T14:33:38.941 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (3m) 24s ago 3m 44.9M 4289M 17.2.7-868-g412a5526 b04d96489b7c b12745ae7d18 2024-04-16T14:33:38.941 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi115 running (3m) 29s ago 3m 44.7M 5312M 17.2.7-868-g412a5526 b04d96489b7c 59f81301ebcf 2024-04-16T14:33:38.941 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi115 running (2m) 29s ago 2m 40.9M 5312M 17.2.7-868-g412a5526 b04d96489b7c e3ea96b7edd9 2024-04-16T14:33:38.942 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi115 running (2m) 29s ago 2m 45.4M 5312M 17.2.7-868-g412a5526 b04d96489b7c 456fa074e453 2024-04-16T14:33:38.942 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.smithi005 smithi005 *:9095 running (4m) 24s ago 5m 54.3M - 2.43.0 a07b618ecd1d 813f7bfd1439 2024-04-16T14:33:38.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.943+0000 7f2670b49700 1 -- 172.21.15.5:0/3509637983 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f26540692a0 msgr2=0x7f265406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:38.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.943+0000 7f2670b49700 1 --2- 172.21.15.5:0/3509637983 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f26540692a0 0x7f265406b750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f266000b970 tx=0x7f2660009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:38.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.943+0000 7f2670b49700 1 -- 172.21.15.5:0/3509637983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f266c066290 msgr2=0x7f266c10da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:38.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.943+0000 7f2670b49700 1 --2- 172.21.15.5:0/3509637983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f266c066290 0x7f266c10da00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f265c002a80 tx=0x7f265c004600 comp rx=0 tx=0).stop 2024-04-16T14:33:38.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.943+0000 7f2670b49700 1 -- 172.21.15.5:0/3509637983 shutdown_connections 2024-04-16T14:33:38.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.943+0000 7f2670b49700 1 --2- 172.21.15.5:0/3509637983 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f26540692a0 0x7f265406b750 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:38.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.943+0000 7f2670b49700 1 --2- 172.21.15.5:0/3509637983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f266c066290 0x7f266c10da00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:38.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.943+0000 7f2670b49700 1 --2- 172.21.15.5:0/3509637983 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f266c0fffd0 0x7f266c10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:38.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.943+0000 7f2670b49700 1 -- 172.21.15.5:0/3509637983 >> 172.21.15.5:0/3509637983 conn(0x7f266c0f74c0 msgr2=0x7f266c0f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:38.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.943+0000 7f2670b49700 1 -- 172.21.15.5:0/3509637983 shutdown_connections 2024-04-16T14:33:38.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:38.943+0000 7f2670b49700 1 -- 172.21.15.5:0/3509637983 wait complete. 2024-04-16T14:33:39.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.062+0000 7f65fb54a700 1 -- 172.21.15.5:0/2634090382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65f40fcff0 msgr2=0x7f65f40fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.062+0000 7f65fb54a700 1 --2- 172.21.15.5:0/2634090382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65f40fcff0 0x7f65f40fd460 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f65e4004940 tx=0x7f65e4009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.062+0000 7f65fb54a700 1 -- 172.21.15.5:0/2634090382 shutdown_connections 2024-04-16T14:33:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.062+0000 7f65fb54a700 1 --2- 172.21.15.5:0/2634090382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65f40fcff0 0x7f65f40fd460 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.062+0000 7f65fb54a700 1 --2- 172.21.15.5:0/2634090382 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65f40fbd40 0x7f65f40fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.062+0000 7f65fb54a700 1 -- 172.21.15.5:0/2634090382 >> 172.21.15.5:0/2634090382 conn(0x7f65f40f74c0 msgr2=0x7f65f40f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.063+0000 7f65fb54a700 1 -- 172.21.15.5:0/2634090382 shutdown_connections 2024-04-16T14:33:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.063+0000 7f65fb54a700 1 -- 172.21.15.5:0/2634090382 wait complete. 2024-04-16T14:33:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.063+0000 7f65fb54a700 1 Processor -- start 2024-04-16T14:33:39.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.063+0000 7f65fb54a700 1 -- start start 2024-04-16T14:33:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.063+0000 7f65fb54a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65f40fbd40 0x7f65f4110700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.063+0000 7f65fb54a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65f40fcff0 0x7f65f4112c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.063+0000 7f65fb54a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f4066310 con 0x7f65f40fcff0 2024-04-16T14:33:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.063+0000 7f65fb54a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f4066450 con 0x7f65f40fbd40 2024-04-16T14:33:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.063+0000 7f65f8ae5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65f40fcff0 0x7f65f4112c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.064+0000 7f65f8ae5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65f40fcff0 0x7f65f4112c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37204/0 (socket says 172.21.15.5:37204) 2024-04-16T14:33:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.064+0000 7f65f8ae5700 1 -- 172.21.15.5:0/485105669 learned_addr learned my addr 172.21.15.5:0/485105669 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:33:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.064+0000 7f65f92e6700 1 --2- 172.21.15.5:0/485105669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65f40fbd40 0x7f65f4110700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.064+0000 7f65f8ae5700 1 -- 172.21.15.5:0/485105669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65f40fbd40 msgr2=0x7f65f4110700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.064+0000 7f65f8ae5700 1 --2- 172.21.15.5:0/485105669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65f40fbd40 0x7f65f4110700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.064+0000 7f65f8ae5700 1 -- 172.21.15.5:0/485105669 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e4005040 con 0x7f65f40fcff0 2024-04-16T14:33:39.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.064+0000 7f65f92e6700 1 --2- 172.21.15.5:0/485105669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65f40fbd40 0x7f65f4110700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T14:33:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.064+0000 7f65f8ae5700 1 --2- 172.21.15.5:0/485105669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65f40fcff0 0x7f65f4112c50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f65e4009150 tx=0x7f65e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.064+0000 7f65e9ffb700 1 -- 172.21.15.5:0/485105669 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65e400e040 con 0x7f65f40fcff0 2024-04-16T14:33:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.064+0000 7f65fb54a700 1 -- 172.21.15.5:0/485105669 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f4113190 con 0x7f65f40fcff0 2024-04-16T14:33:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.064+0000 7f65e9ffb700 1 -- 172.21.15.5:0/485105669 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f65e400bcc0 con 0x7f65f40fcff0 2024-04-16T14:33:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.064+0000 7f65e9ffb700 1 -- 172.21.15.5:0/485105669 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65e401c630 con 0x7f65f40fcff0 2024-04-16T14:33:39.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.064+0000 7f65fb54a700 1 -- 172.21.15.5:0/485105669 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f4113700 con 0x7f65f40fcff0 2024-04-16T14:33:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.066+0000 7f65fb54a700 1 -- 172.21.15.5:0/485105669 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f405f5f0 con 0x7f65f40fcff0 2024-04-16T14:33:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.066+0000 7f65e9ffb700 1 -- 172.21.15.5:0/485105669 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f65e4013420 con 0x7f65f40fcff0 2024-04-16T14:33:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.066+0000 7f65e9ffb700 1 --2- 172.21.15.5:0/485105669 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f65e00692a0 0x7f65e006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.067+0000 7f65f92e6700 1 --2- 172.21.15.5:0/485105669 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f65e00692a0 0x7f65e006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.067+0000 7f65e9ffb700 1 -- 172.21.15.5:0/485105669 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f65e4087ed0 con 0x7f65f40fcff0 2024-04-16T14:33:39.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.067+0000 7f65f92e6700 1 --2- 172.21.15.5:0/485105669 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f65e00692a0 0x7f65e006b750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f65f4065f90 tx=0x7f65f0007f20 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:39.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.071+0000 7f65e9ffb700 1 -- 172.21.15.5:0/485105669 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f65e4054250 con 0x7f65f40fcff0 2024-04-16T14:33:39.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.385+0000 7f65fb54a700 1 -- 172.21.15.5:0/485105669 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f65f404bed0 con 0x7f65f40fcff0 2024-04-16T14:33:39.384 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.385+0000 7f65e9ffb700 1 -- 172.21.15.5:0/485105669 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f65e4057870 con 0x7f65f40fcff0 2024-04-16T14:33:39.384 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:33:39.384 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-04-16T14:33:39.385 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 2 2024-04-16T14:33:39.385 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:33:39.385 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-04-16T14:33:39.385 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 2 2024-04-16T14:33:39.385 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:33:39.385 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-04-16T14:33:39.385 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 6 2024-04-16T14:33:39.385 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:33:39.386 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-04-16T14:33:39.386 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 4 2024-04-16T14:33:39.386 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:33:39.386 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-04-16T14:33:39.386 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 14 2024-04-16T14:33:39.386 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-16T14:33:39.386 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:33:39.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.388+0000 7f65fb54a700 1 -- 172.21.15.5:0/485105669 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f65e00692a0 msgr2=0x7f65e006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:39.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.388+0000 7f65fb54a700 1 --2- 172.21.15.5:0/485105669 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f65e00692a0 0x7f65e006b750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f65f4065f90 tx=0x7f65f0007f20 comp rx=0 tx=0).stop 2024-04-16T14:33:39.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.388+0000 7f65fb54a700 1 -- 172.21.15.5:0/485105669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65f40fcff0 msgr2=0x7f65f4112c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:39.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.388+0000 7f65fb54a700 1 --2- 172.21.15.5:0/485105669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65f40fcff0 0x7f65f4112c50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f65e4009150 tx=0x7f65e4009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:39.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.388+0000 7f65fb54a700 1 -- 172.21.15.5:0/485105669 shutdown_connections 2024-04-16T14:33:39.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.388+0000 7f65fb54a700 1 --2- 172.21.15.5:0/485105669 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f65e00692a0 0x7f65e006b750 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:39.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.388+0000 7f65fb54a700 1 --2- 172.21.15.5:0/485105669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65f40fbd40 0x7f65f4110700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:39.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.388+0000 7f65fb54a700 1 --2- 172.21.15.5:0/485105669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65f40fcff0 0x7f65f4112c50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:39.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.388+0000 7f65fb54a700 1 -- 172.21.15.5:0/485105669 >> 172.21.15.5:0/485105669 conn(0x7f65f40f74c0 msgr2=0x7f65f40f8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:39.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.388+0000 7f65fb54a700 1 -- 172.21.15.5:0/485105669 shutdown_connections 2024-04-16T14:33:39.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.388+0000 7f65fb54a700 1 -- 172.21.15.5:0/485105669 wait complete. 2024-04-16T14:33:39.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.499+0000 7f3e1d039700 1 -- 172.21.15.5:0/1478204312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e180fffd0 msgr2=0x7f3e181023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:39.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.499+0000 7f3e1d039700 1 --2- 172.21.15.5:0/1478204312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e180fffd0 0x7f3e181023b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3e00004940 tx=0x7f3e00009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:39.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.499+0000 7f3e1d039700 1 -- 172.21.15.5:0/1478204312 shutdown_connections 2024-04-16T14:33:39.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.499+0000 7f3e1d039700 1 --2- 172.21.15.5:0/1478204312 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e180fffd0 0x7f3e181023b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:39.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.499+0000 7f3e1d039700 1 --2- 172.21.15.5:0/1478204312 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e18066290 0x7f3e180ffa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:39.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.499+0000 7f3e1d039700 1 -- 172.21.15.5:0/1478204312 >> 172.21.15.5:0/1478204312 conn(0x7f3e180f74c0 msgr2=0x7f3e180f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:39.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.499+0000 7f3e1d039700 1 -- 172.21.15.5:0/1478204312 shutdown_connections 2024-04-16T14:33:39.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.499+0000 7f3e1d039700 1 -- 172.21.15.5:0/1478204312 wait complete. 2024-04-16T14:33:39.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.500+0000 7f3e1d039700 1 Processor -- start 2024-04-16T14:33:39.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.500+0000 7f3e1d039700 1 -- start start 2024-04-16T14:33:39.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.500+0000 7f3e1d039700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e18066290 0x7f3e180fd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:39.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.500+0000 7f3e1d039700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e180fffd0 0x7f3e180fb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:39.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.500+0000 7f3e1d039700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e180fbf20 con 0x7f3e180fffd0 2024-04-16T14:33:39.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.500+0000 7f3e1d039700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e180fc060 con 0x7f3e18066290 2024-04-16T14:33:39.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.500+0000 7f3e16d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e180fffd0 0x7f3e180fb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:39.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.500+0000 7f3e16d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e180fffd0 0x7f3e180fb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37230/0 (socket says 172.21.15.5:37230) 2024-04-16T14:33:39.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.500+0000 7f3e16d9d700 1 -- 172.21.15.5:0/4233034043 learned_addr learned my addr 172.21.15.5:0/4233034043 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:33:39.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.500+0000 7f3e0ed9d700 1 --2- 172.21.15.5:0/4233034043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e18066290 0x7f3e180fd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:39.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.500+0000 7f3e16d9d700 1 -- 172.21.15.5:0/4233034043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e18066290 msgr2=0x7f3e180fd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:39.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.501+0000 7f3e16d9d700 1 --2- 172.21.15.5:0/4233034043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e18066290 0x7f3e180fd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:39.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.501+0000 7f3e16d9d700 1 -- 172.21.15.5:0/4233034043 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e00005040 con 0x7f3e180fffd0 2024-04-16T14:33:39.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.501+0000 7f3e16d9d700 1 --2- 172.21.15.5:0/4233034043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e180fffd0 0x7f3e180fb990 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3e00013870 tx=0x7f3e00009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:39.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.501+0000 7f3e0ffff700 1 -- 172.21.15.5:0/4233034043 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e00021070 con 0x7f3e180fffd0 2024-04-16T14:33:39.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.501+0000 7f3e0ffff700 1 -- 172.21.15.5:0/4233034043 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3e00009430 con 0x7f3e180fffd0 2024-04-16T14:33:39.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.501+0000 7f3e0ffff700 1 -- 172.21.15.5:0/4233034043 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e0000e070 con 0x7f3e180fffd0 2024-04-16T14:33:39.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.501+0000 7f3e1d039700 1 -- 172.21.15.5:0/4233034043 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e180fc2e0 con 0x7f3e180fffd0 2024-04-16T14:33:39.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.501+0000 7f3e1d039700 1 -- 172.21.15.5:0/4233034043 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e18115a00 con 0x7f3e180fffd0 2024-04-16T14:33:39.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.502+0000 7f3e1d039700 1 -- 172.21.15.5:0/4233034043 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e1805f5f0 con 0x7f3e180fffd0 2024-04-16T14:33:39.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.503+0000 7f3e0ffff700 1 -- 172.21.15.5:0/4233034043 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f3e0001c750 con 0x7f3e180fffd0 2024-04-16T14:33:39.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.503+0000 7f3e0ffff700 1 --2- 172.21.15.5:0/4233034043 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f3e040692a0 0x7f3e0406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:39.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.503+0000 7f3e0ffff700 1 -- 172.21.15.5:0/4233034043 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f3e000883f0 con 0x7f3e180fffd0 2024-04-16T14:33:39.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.503+0000 7f3e0ed9d700 1 --2- 172.21.15.5:0/4233034043 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f3e040692a0 0x7f3e0406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:39.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.504+0000 7f3e0ed9d700 1 --2- 172.21.15.5:0/4233034043 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f3e040692a0 0x7f3e0406b750 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3e180fd200 tx=0x7f3e0800b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:39.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.508+0000 7f3e0ffff700 1 -- 172.21.15.5:0/4233034043 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3e00054770 con 0x7f3e180fffd0 2024-04-16T14:33:39.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.764+0000 7f3e1d039700 1 -- 172.21.15.5:0/4233034043 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3e1804bed0 con 0x7f3e180fffd0 2024-04-16T14:33:39.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.764+0000 7f3e0ffff700 1 -- 172.21.15.5:0/4233034043 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1812 (secure 0 0 0) 0x7f3e00057d90 con 0x7f3e180fffd0 2024-04-16T14:33:39.763 INFO:teuthology.orchestra.run.smithi005.stdout:e18 2024-04-16T14:33:39.763 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:33:39.763 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:33:39.763 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2024-04-16T14:33:39.763 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:33:39.763 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2024-04-16T14:33:39.763 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2024-04-16T14:33:39.763 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 18 2024-04-16T14:33:39.763 INFO:teuthology.orchestra.run.smithi005.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-16T14:33:39.763 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-16T14:32:45.270024+0000 2024-04-16T14:33:39.763 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-04-16T14:33:04.825498+0000 2024-04-16T14:33:39.763 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2024-04-16T14:33:39.763 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2024-04-16T14:33:39.764 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 60 2024-04-16T14:33:39.764 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2024-04-16T14:33:39.764 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2024-04-16T14:33:39.764 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2024-04-16T14:33:39.764 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2024-04-16T14:33:39.764 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 47 2024-04-16T14:33:39.764 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:33:39.764 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 2 2024-04-16T14:33:39.764 INFO:teuthology.orchestra.run.smithi005.stdout:in 0,1 2024-04-16T14:33:39.764 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=14484,1=24269} 2024-04-16T14:33:39.764 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2024-04-16T14:33:39.764 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2024-04-16T14:33:39.764 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 2024-04-16T14:33:39.764 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3] 2024-04-16T14:33:39.764 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2024-04-16T14:33:39.765 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2024-04-16T14:33:39.765 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2024-04-16T14:33:39.765 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 1 2024-04-16T14:33:39.765 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.wofqlz{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:33:39.765 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.byfytg{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.115:6824/1662994117,v1:172.21.15.115:6825/1662994117] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:33:39.765 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:33:39.765 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:33:39.765 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2024-04-16T14:33:39.765 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:33:39.765 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.vzoqdl{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.5:6826/187766809,v1:172.21.15.5:6827/187766809] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:33:39.765 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.trkaqh{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:33:39.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.767+0000 7f3e1d039700 1 -- 172.21.15.5:0/4233034043 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f3e040692a0 msgr2=0x7f3e0406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:39.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.767+0000 7f3e1d039700 1 --2- 172.21.15.5:0/4233034043 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f3e040692a0 0x7f3e0406b750 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3e180fd200 tx=0x7f3e0800b040 comp rx=0 tx=0).stop 2024-04-16T14:33:39.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.767+0000 7f3e1d039700 1 -- 172.21.15.5:0/4233034043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e180fffd0 msgr2=0x7f3e180fb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:39.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.767+0000 7f3e1d039700 1 --2- 172.21.15.5:0/4233034043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e180fffd0 0x7f3e180fb990 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3e00013870 tx=0x7f3e00009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:39.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.767+0000 7f3e1d039700 1 -- 172.21.15.5:0/4233034043 shutdown_connections 2024-04-16T14:33:39.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.767+0000 7f3e1d039700 1 --2- 172.21.15.5:0/4233034043 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f3e040692a0 0x7f3e0406b750 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:39.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.767+0000 7f3e1d039700 1 --2- 172.21.15.5:0/4233034043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e18066290 0x7f3e180fd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:39.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.767+0000 7f3e1d039700 1 --2- 172.21.15.5:0/4233034043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e180fffd0 0x7f3e180fb990 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:39.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.767+0000 7f3e1d039700 1 -- 172.21.15.5:0/4233034043 >> 172.21.15.5:0/4233034043 conn(0x7f3e180f74c0 msgr2=0x7f3e180f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:39.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.767+0000 7f3e1d039700 1 -- 172.21.15.5:0/4233034043 shutdown_connections 2024-04-16T14:33:39.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.767+0000 7f3e1d039700 1 -- 172.21.15.5:0/4233034043 wait complete. 2024-04-16T14:33:39.767 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 18 2024-04-16T14:33:39.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.880+0000 7f09e89c3700 1 -- 172.21.15.5:0/1672553015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09e40fe0e0 msgr2=0x7f09e40fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:39.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.880+0000 7f09e89c3700 1 --2- 172.21.15.5:0/1672553015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09e40fe0e0 0x7f09e40fe550 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f09d8004940 tx=0x7f09d8009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:39.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.881+0000 7f09e89c3700 1 -- 172.21.15.5:0/1672553015 shutdown_connections 2024-04-16T14:33:39.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.881+0000 7f09e89c3700 1 --2- 172.21.15.5:0/1672553015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09e40fe0e0 0x7f09e40fe550 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:39.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.881+0000 7f09e89c3700 1 --2- 172.21.15.5:0/1672553015 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e40fcef0 0x7f09e40fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:39.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.881+0000 7f09e89c3700 1 -- 172.21.15.5:0/1672553015 >> 172.21.15.5:0/1672553015 conn(0x7f09e40f8530 msgr2=0x7f09e40fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:39.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.881+0000 7f09e89c3700 1 -- 172.21.15.5:0/1672553015 shutdown_connections 2024-04-16T14:33:39.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.881+0000 7f09e89c3700 1 -- 172.21.15.5:0/1672553015 wait complete. 2024-04-16T14:33:39.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.881+0000 7f09e89c3700 1 Processor -- start 2024-04-16T14:33:39.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.881+0000 7f09e89c3700 1 -- start start 2024-04-16T14:33:39.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.881+0000 7f09e89c3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e40fcef0 0x7f09e410fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:39.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.881+0000 7f09e89c3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09e40fe0e0 0x7f09e4110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:39.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.881+0000 7f09e89c3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e4110f80 con 0x7f09e40fe0e0 2024-04-16T14:33:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.881+0000 7f09e89c3700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e41110f0 con 0x7f09e40fcef0 2024-04-16T14:33:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.882+0000 7f09e1d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09e40fe0e0 0x7f09e4110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.882+0000 7f09e1d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09e40fe0e0 0x7f09e4110270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37240/0 (socket says 172.21.15.5:37240) 2024-04-16T14:33:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.882+0000 7f09e1d9b700 1 -- 172.21.15.5:0/3497483614 learned_addr learned my addr 172.21.15.5:0/3497483614 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:33:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.882+0000 7f09e259c700 1 --2- 172.21.15.5:0/3497483614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e40fcef0 0x7f09e410fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.882+0000 7f09e1d9b700 1 -- 172.21.15.5:0/3497483614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e40fcef0 msgr2=0x7f09e410fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.882+0000 7f09e1d9b700 1 --2- 172.21.15.5:0/3497483614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e40fcef0 0x7f09e410fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.882+0000 7f09e1d9b700 1 -- 172.21.15.5:0/3497483614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d8005040 con 0x7f09e40fe0e0 2024-04-16T14:33:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.882+0000 7f09e259c700 1 --2- 172.21.15.5:0/3497483614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e40fcef0 0x7f09e410fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:33:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.882+0000 7f09e1d9b700 1 --2- 172.21.15.5:0/3497483614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09e40fe0e0 0x7f09e4110270 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f09d800b3b0 tx=0x7f09d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.882+0000 7f09d2ffd700 1 -- 172.21.15.5:0/3497483614 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09d800e040 con 0x7f09e40fe0e0 2024-04-16T14:33:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.882+0000 7f09e89c3700 1 -- 172.21.15.5:0/3497483614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e4111370 con 0x7f09e40fe0e0 2024-04-16T14:33:39.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.882+0000 7f09d2ffd700 1 -- 172.21.15.5:0/3497483614 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f09d800bcc0 con 0x7f09e40fe0e0 2024-04-16T14:33:39.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.882+0000 7f09d2ffd700 1 -- 172.21.15.5:0/3497483614 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09d801c630 con 0x7f09e40fe0e0 2024-04-16T14:33:39.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.882+0000 7f09e89c3700 1 -- 172.21.15.5:0/3497483614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e4111930 con 0x7f09e40fe0e0 2024-04-16T14:33:39.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.883+0000 7f09e89c3700 1 -- 172.21.15.5:0/3497483614 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e4101a70 con 0x7f09e40fe0e0 2024-04-16T14:33:39.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.884+0000 7f09d2ffd700 1 -- 172.21.15.5:0/3497483614 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f09d8013980 con 0x7f09e40fe0e0 2024-04-16T14:33:39.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.884+0000 7f09d2ffd700 1 --2- 172.21.15.5:0/3497483614 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f09cc0692a0 0x7f09cc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:39.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.885+0000 7f09d2ffd700 1 -- 172.21.15.5:0/3497483614 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f09d8088010 con 0x7f09e40fe0e0 2024-04-16T14:33:39.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.885+0000 7f09e259c700 1 --2- 172.21.15.5:0/3497483614 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f09cc0692a0 0x7f09cc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:39.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.885+0000 7f09e259c700 1 --2- 172.21.15.5:0/3497483614 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f09cc0692a0 0x7f09cc06b750 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f09d4006fd0 tx=0x7f09d4008040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:39.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:39.889+0000 7f09d2ffd700 1 -- 172.21.15.5:0/3497483614 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f09d8057d00 con 0x7f09e40fe0e0 2024-04-16T14:33:40.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.119+0000 7f09e89c3700 1 -- 172.21.15.5:0/3497483614 --> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f09e4105b50 con 0x7f09cc0692a0 2024-04-16T14:33:40.118 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:39 smithi005 ceph-mon[28964]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:33:40.118 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:39 smithi005 ceph-mon[28964]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:33:40.118 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:39 smithi005 ceph-mon[28964]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-16T14:33:40.118 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:39 smithi005 ceph-mon[28964]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:33:40.118 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:39 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/485105669' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:33:40.118 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:39 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/4233034043' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:33:40.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.120+0000 7f09d2ffd700 1 -- 172.21.15.5:0/3497483614 <== mgr.14212 v2:172.21.15.5:6800/3841652776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f09e4105b50 con 0x7f09cc0692a0 2024-04-16T14:33:40.119 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:33:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:36befe5d41ee8a6ea2e60983e763134278d506cf", 2024-04-16T14:33:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-04-16T14:33:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-16T14:33:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [], 2024-04-16T14:33:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "", 2024-04-16T14:33:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:36befe5d41ee8a6ea2e60983e763134278d506cf image", 2024-04-16T14:33:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-04-16T14:33:40.120 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:33:40.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.123+0000 7f09e89c3700 1 -- 172.21.15.5:0/3497483614 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f09cc0692a0 msgr2=0x7f09cc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:40.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.123+0000 7f09e89c3700 1 --2- 172.21.15.5:0/3497483614 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f09cc0692a0 0x7f09cc06b750 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f09d4006fd0 tx=0x7f09d4008040 comp rx=0 tx=0).stop 2024-04-16T14:33:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.123+0000 7f09e89c3700 1 -- 172.21.15.5:0/3497483614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09e40fe0e0 msgr2=0x7f09e4110270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.123+0000 7f09e89c3700 1 --2- 172.21.15.5:0/3497483614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09e40fe0e0 0x7f09e4110270 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f09d800b3b0 tx=0x7f09d8009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.123+0000 7f09e89c3700 1 -- 172.21.15.5:0/3497483614 shutdown_connections 2024-04-16T14:33:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.123+0000 7f09e89c3700 1 --2- 172.21.15.5:0/3497483614 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f09cc0692a0 0x7f09cc06b750 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.123+0000 7f09e89c3700 1 --2- 172.21.15.5:0/3497483614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f09e40fcef0 0x7f09e410fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.123+0000 7f09e89c3700 1 --2- 172.21.15.5:0/3497483614 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09e40fe0e0 0x7f09e4110270 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.123+0000 7f09e89c3700 1 -- 172.21.15.5:0/3497483614 >> 172.21.15.5:0/3497483614 conn(0x7f09e40f8530 msgr2=0x7f09e40f9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.123+0000 7f09e89c3700 1 -- 172.21.15.5:0/3497483614 shutdown_connections 2024-04-16T14:33:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.123+0000 7f09e89c3700 1 -- 172.21.15.5:0/3497483614 wait complete. 2024-04-16T14:33:40.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:39 smithi115 ceph-mon[37295]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:33:40.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:39 smithi115 ceph-mon[37295]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:33:40.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:39 smithi115 ceph-mon[37295]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-16T14:33:40.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:39 smithi115 ceph-mon[37295]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:33:40.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:39 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/485105669' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:33:40.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:39 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/4233034043' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:33:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.232+0000 7fa65c05e700 1 -- 172.21.15.5:0/3241653275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6541002d0 msgr2=0x7fa654100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.232+0000 7fa65c05e700 1 --2- 172.21.15.5:0/3241653275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6541002d0 0x7fa654100740 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa644004940 tx=0x7fa644009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.232+0000 7fa65c05e700 1 -- 172.21.15.5:0/3241653275 shutdown_connections 2024-04-16T14:33:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.232+0000 7fa65c05e700 1 --2- 172.21.15.5:0/3241653275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6541002d0 0x7fa654100740 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.232+0000 7fa65c05e700 1 --2- 172.21.15.5:0/3241653275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6540ff020 0x7fa6540ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.232+0000 7fa65c05e700 1 -- 172.21.15.5:0/3241653275 >> 172.21.15.5:0/3241653275 conn(0x7fa6540fa950 msgr2=0x7fa6540fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.232+0000 7fa65c05e700 1 -- 172.21.15.5:0/3241653275 shutdown_connections 2024-04-16T14:33:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.232+0000 7fa65c05e700 1 -- 172.21.15.5:0/3241653275 wait complete. 2024-04-16T14:33:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.233+0000 7fa65c05e700 1 Processor -- start 2024-04-16T14:33:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.233+0000 7fa65c05e700 1 -- start start 2024-04-16T14:33:40.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.233+0000 7fa65c05e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6540ff020 0x7fa65410fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:40.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.233+0000 7fa65c05e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6541002d0 0x7fa654110160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:40.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.233+0000 7fa65c05e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa654110760 con 0x7fa6541002d0 2024-04-16T14:33:40.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.233+0000 7fa65c05e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa654110fb0 con 0x7fa6540ff020 2024-04-16T14:33:40.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.233+0000 7fa6595f9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6541002d0 0x7fa654110160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:40.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.233+0000 7fa6595f9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6541002d0 0x7fa654110160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37254/0 (socket says 172.21.15.5:37254) 2024-04-16T14:33:40.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.233+0000 7fa6595f9700 1 -- 172.21.15.5:0/3699008678 learned_addr learned my addr 172.21.15.5:0/3699008678 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:33:40.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.233+0000 7fa659dfa700 1 --2- 172.21.15.5:0/3699008678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6540ff020 0x7fa65410fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:40.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.233+0000 7fa6595f9700 1 -- 172.21.15.5:0/3699008678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6540ff020 msgr2=0x7fa65410fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:40.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.233+0000 7fa6595f9700 1 --2- 172.21.15.5:0/3699008678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6540ff020 0x7fa65410fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:40.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.233+0000 7fa6595f9700 1 -- 172.21.15.5:0/3699008678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa644005040 con 0x7fa6541002d0 2024-04-16T14:33:40.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.233+0000 7fa6595f9700 1 --2- 172.21.15.5:0/3699008678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6541002d0 0x7fa654110160 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa64400b3b0 tx=0x7fa644009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.234+0000 7fa64a7fc700 1 -- 172.21.15.5:0/3699008678 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa64400e040 con 0x7fa6541002d0 2024-04-16T14:33:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.234+0000 7fa64a7fc700 1 -- 172.21.15.5:0/3699008678 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa64400bbf0 con 0x7fa6541002d0 2024-04-16T14:33:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.234+0000 7fa64a7fc700 1 -- 172.21.15.5:0/3699008678 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa64401c630 con 0x7fa6541002d0 2024-04-16T14:33:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.234+0000 7fa65c05e700 1 -- 172.21.15.5:0/3699008678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa654111230 con 0x7fa6541002d0 2024-04-16T14:33:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.234+0000 7fa65c05e700 1 -- 172.21.15.5:0/3699008678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa654111770 con 0x7fa6541002d0 2024-04-16T14:33:40.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.235+0000 7fa65c05e700 1 -- 172.21.15.5:0/3699008678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa65405f5f0 con 0x7fa6541002d0 2024-04-16T14:33:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.235+0000 7fa64a7fc700 1 -- 172.21.15.5:0/3699008678 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7fa64400bd60 con 0x7fa6541002d0 2024-04-16T14:33:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.236+0000 7fa64a7fc700 1 --2- 172.21.15.5:0/3699008678 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa6400692a0 0x7fa64006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:33:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.236+0000 7fa64a7fc700 1 -- 172.21.15.5:0/3699008678 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa644087df0 con 0x7fa6541002d0 2024-04-16T14:33:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.236+0000 7fa659dfa700 1 --2- 172.21.15.5:0/3699008678 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa6400692a0 0x7fa64006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:33:40.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.236+0000 7fa659dfa700 1 --2- 172.21.15.5:0/3699008678 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa6400692a0 0x7fa64006b750 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa6500041d0 tx=0x7fa6500043c0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:33:40.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.241+0000 7fa64a7fc700 1 -- 172.21.15.5:0/3699008678 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa644057c00 con 0x7fa6541002d0 2024-04-16T14:33:40.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.563+0000 7fa65c05e700 1 -- 172.21.15.5:0/3699008678 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa65404bed0 con 0x7fa6541002d0 2024-04-16T14:33:40.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.563+0000 7fa64a7fc700 1 -- 172.21.15.5:0/3699008678 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fa644057790 con 0x7fa6541002d0 2024-04-16T14:33:40.561 INFO:teuthology.orchestra.run.smithi005.stdout:HEALTH_OK 2024-04-16T14:33:40.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.565+0000 7fa65c05e700 1 -- 172.21.15.5:0/3699008678 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa6400692a0 msgr2=0x7fa64006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:40.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.565+0000 7fa65c05e700 1 --2- 172.21.15.5:0/3699008678 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa6400692a0 0x7fa64006b750 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa6500041d0 tx=0x7fa6500043c0 comp rx=0 tx=0).stop 2024-04-16T14:33:40.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.565+0000 7fa65c05e700 1 -- 172.21.15.5:0/3699008678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6541002d0 msgr2=0x7fa654110160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:33:40.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.565+0000 7fa65c05e700 1 --2- 172.21.15.5:0/3699008678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6541002d0 0x7fa654110160 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa64400b3b0 tx=0x7fa644009e30 comp rx=0 tx=0).stop 2024-04-16T14:33:40.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.565+0000 7fa65c05e700 1 -- 172.21.15.5:0/3699008678 shutdown_connections 2024-04-16T14:33:40.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.565+0000 7fa65c05e700 1 --2- 172.21.15.5:0/3699008678 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa6400692a0 0x7fa64006b750 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:40.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.565+0000 7fa65c05e700 1 --2- 172.21.15.5:0/3699008678 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6540ff020 0x7fa65410fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:40.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.565+0000 7fa65c05e700 1 --2- 172.21.15.5:0/3699008678 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6541002d0 0x7fa654110160 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:33:40.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.565+0000 7fa65c05e700 1 -- 172.21.15.5:0/3699008678 >> 172.21.15.5:0/3699008678 conn(0x7fa6540fa950 msgr2=0x7fa6540fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:33:40.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.565+0000 7fa65c05e700 1 -- 172.21.15.5:0/3699008678 shutdown_connections 2024-04-16T14:33:40.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:33:40.565+0000 7fa65c05e700 1 -- 172.21.15.5:0/3699008678 wait complete. 2024-04-16T14:33:41.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:40 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/3699008678' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:33:41.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:40 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/3699008678' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:33:42.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:41 smithi115 ceph-mon[37295]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:33:42.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:41 smithi115 ceph-mon[37295]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:33:42.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:41 smithi005 ceph-mon[28964]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:33:42.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:41 smithi005 ceph-mon[28964]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:33:44.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:43 smithi115 ceph-mon[37295]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:33:44.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:43 smithi005 ceph-mon[28964]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:33:46.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:45 smithi115 ceph-mon[37295]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:33:46.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:45 smithi005 ceph-mon[28964]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:33:47.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:47 smithi115 ceph-mon[37295]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:33:47.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:47 smithi005 ceph-mon[28964]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:33:48.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:48 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:33:48.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:48 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:33:49.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:49 smithi115 ceph-mon[37295]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:33:49.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:49 smithi005 ceph-mon[28964]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:33:52.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:51 smithi115 ceph-mon[37295]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:33:52.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:51 smithi005 ceph-mon[28964]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:33:54.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:53 smithi115 ceph-mon[37295]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:33:54.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:53 smithi005 ceph-mon[28964]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:33:56.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:55 smithi115 ceph-mon[37295]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:33:56.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:55 smithi005 ceph-mon[28964]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:33:58.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:57 smithi115 ceph-mon[37295]: pgmap v212: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-04-16T14:33:58.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:57 smithi005 ceph-mon[28964]: pgmap v212: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-04-16T14:34:00.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:33:59 smithi115 ceph-mon[37295]: pgmap v213: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-16T14:34:00.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:33:59 smithi005 ceph-mon[28964]: pgmap v213: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-16T14:34:02.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:01 smithi115 ceph-mon[37295]: pgmap v214: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-16T14:34:02.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:01 smithi005 ceph-mon[28964]: pgmap v214: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-16T14:34:03.007 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:02 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:34:03.082 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:02 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:34:04.093 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:03 smithi115 ceph-mon[37295]: pgmap v215: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-16T14:34:04.198 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:03 smithi005 ceph-mon[28964]: pgmap v215: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-16T14:34:05.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:05 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:34:05.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:05 smithi115 ceph-mon[37295]: Upgrade: Target is version 19.0.0-2204-g36befe5d (unknown) 2024-04-16T14:34:05.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:05 smithi115 ceph-mon[37295]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, digests ['quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91'] 2024-04-16T14:34:05.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:05 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:34:05.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:05 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:34:05.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:05 smithi115 ceph-mon[37295]: Upgrade: Need to upgrade myself (mgr.smithi005.ipwdkc) 2024-04-16T14:34:05.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:05 smithi115 ceph-mon[37295]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 on smithi115 2024-04-16T14:34:05.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:05 smithi115 ceph-mon[37295]: pgmap v216: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-16T14:34:05.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:05 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:34:05.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:05 smithi005 ceph-mon[28964]: Upgrade: Target is version 19.0.0-2204-g36befe5d (unknown) 2024-04-16T14:34:05.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:05 smithi005 ceph-mon[28964]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, digests ['quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91'] 2024-04-16T14:34:05.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:05 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:34:05.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:05 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:34:05.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:05 smithi005 ceph-mon[28964]: Upgrade: Need to upgrade myself (mgr.smithi005.ipwdkc) 2024-04-16T14:34:05.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:05 smithi005 ceph-mon[28964]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 on smithi115 2024-04-16T14:34:05.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:05 smithi005 ceph-mon[28964]: pgmap v216: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-16T14:34:08.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:07 smithi115 ceph-mon[37295]: pgmap v217: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-16T14:34:08.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:07 smithi005 ceph-mon[28964]: pgmap v217: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-16T14:34:10.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:09 smithi115 ceph-mon[37295]: pgmap v218: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-16T14:34:10.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:09 smithi005 ceph-mon[28964]: pgmap v218: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-04-16T14:34:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.680+0000 7f900fe4f700 1 -- 172.21.15.5:0/143565474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90080662f0 msgr2=0x7f90080ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.680+0000 7f900fe4f700 1 --2- 172.21.15.5:0/143565474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90080662f0 0x7f90080ffa30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9004004940 tx=0x7f9004009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.680+0000 7f900fe4f700 1 -- 172.21.15.5:0/143565474 shutdown_connections 2024-04-16T14:34:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.680+0000 7f900fe4f700 1 --2- 172.21.15.5:0/143565474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90080fff70 0x7f9008102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.680+0000 7f900fe4f700 1 --2- 172.21.15.5:0/143565474 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90080662f0 0x7f90080ffa30 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.680+0000 7f900fe4f700 1 -- 172.21.15.5:0/143565474 >> 172.21.15.5:0/143565474 conn(0x7f90080f74c0 msgr2=0x7f90080f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.680+0000 7f900fe4f700 1 -- 172.21.15.5:0/143565474 shutdown_connections 2024-04-16T14:34:10.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.680+0000 7f900fe4f700 1 -- 172.21.15.5:0/143565474 wait complete. 2024-04-16T14:34:10.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.681+0000 7f900fe4f700 1 Processor -- start 2024-04-16T14:34:10.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.681+0000 7f900fe4f700 1 -- start start 2024-04-16T14:34:10.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.681+0000 7f900fe4f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90080662f0 0x7f900810da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:10.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.681+0000 7f900fe4f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90080fff70 0x7f900810df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:10.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.681+0000 7f900fe4f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900810e580 con 0x7f90080fff70 2024-04-16T14:34:10.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.681+0000 7f900fe4f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900810ed80 con 0x7f90080662f0 2024-04-16T14:34:10.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.681+0000 7f900d3ea700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90080fff70 0x7f900810df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:10.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.681+0000 7f900dbeb700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90080662f0 0x7f900810da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:10.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.681+0000 7f900d3ea700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90080fff70 0x7f900810df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59928/0 (socket says 172.21.15.5:59928) 2024-04-16T14:34:10.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.681+0000 7f900dbeb700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90080662f0 0x7f900810da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.5:33884/0 (socket says 172.21.15.5:33884) 2024-04-16T14:34:10.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.681+0000 7f900d3ea700 1 -- 172.21.15.5:0/3247010923 learned_addr learned my addr 172.21.15.5:0/3247010923 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:34:10.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.682+0000 7f900d3ea700 1 -- 172.21.15.5:0/3247010923 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90080662f0 msgr2=0x7f900810da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:10.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.682+0000 7f900d3ea700 1 --2- 172.21.15.5:0/3247010923 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90080662f0 0x7f900810da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:10.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.682+0000 7f900d3ea700 1 -- 172.21.15.5:0/3247010923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9004005040 con 0x7f90080fff70 2024-04-16T14:34:10.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.682+0000 7f900d3ea700 1 --2- 172.21.15.5:0/3247010923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90080fff70 0x7f900810df80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8002a80 tx=0x7f8ff80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:10.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.682+0000 7f8ffe7fc700 1 -- 172.21.15.5:0/3247010923 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ff8007cc0 con 0x7f90080fff70 2024-04-16T14:34:10.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.682+0000 7f8ffe7fc700 1 -- 172.21.15.5:0/3247010923 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ff800f040 con 0x7f90080fff70 2024-04-16T14:34:10.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.682+0000 7f900fe4f700 1 -- 172.21.15.5:0/3247010923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f900810f060 con 0x7f90080fff70 2024-04-16T14:34:10.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.682+0000 7f8ffe7fc700 1 -- 172.21.15.5:0/3247010923 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ff800dac0 con 0x7f90080fff70 2024-04-16T14:34:10.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.682+0000 7f900fe4f700 1 -- 172.21.15.5:0/3247010923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f900810f5a0 con 0x7f90080fff70 2024-04-16T14:34:10.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.683+0000 7f900fe4f700 1 -- 172.21.15.5:0/3247010923 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f900805f5f0 con 0x7f90080fff70 2024-04-16T14:34:10.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.684+0000 7f8ffe7fc700 1 -- 172.21.15.5:0/3247010923 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f8ff800dc20 con 0x7f90080fff70 2024-04-16T14:34:10.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.684+0000 7f8ffe7fc700 1 --2- 172.21.15.5:0/3247010923 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f8ff40692b0 0x7f8ff406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:10.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.684+0000 7f8ffe7fc700 1 -- 172.21.15.5:0/3247010923 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8ff8086e30 con 0x7f90080fff70 2024-04-16T14:34:10.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.684+0000 7f900dbeb700 1 --2- 172.21.15.5:0/3247010923 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f8ff40692b0 0x7f8ff406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:10.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.685+0000 7f900dbeb700 1 --2- 172.21.15.5:0/3247010923 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f8ff40692b0 0x7f8ff406b760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9004000c00 tx=0x7f9004009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:10.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.689+0000 7f8ffe7fc700 1 -- 172.21.15.5:0/3247010923 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8ff8056b20 con 0x7f90080fff70 2024-04-16T14:34:10.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.924+0000 7f900fe4f700 1 -- 172.21.15.5:0/3247010923 --> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f900810f870 con 0x7f8ff40692b0 2024-04-16T14:34:10.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.925+0000 7f8ffe7fc700 1 -- 172.21.15.5:0/3247010923 <== mgr.14212 v2:172.21.15.5:6800/3841652776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f900810f870 con 0x7f8ff40692b0 2024-04-16T14:34:10.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.927+0000 7f900fe4f700 1 -- 172.21.15.5:0/3247010923 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f8ff40692b0 msgr2=0x7f8ff406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.927+0000 7f900fe4f700 1 --2- 172.21.15.5:0/3247010923 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f8ff40692b0 0x7f8ff406b760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9004000c00 tx=0x7f9004009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.927+0000 7f900fe4f700 1 -- 172.21.15.5:0/3247010923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90080fff70 msgr2=0x7f900810df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.927+0000 7f900fe4f700 1 --2- 172.21.15.5:0/3247010923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90080fff70 0x7f900810df80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8002a80 tx=0x7f8ff80046b0 comp rx=0 tx=0).stop 2024-04-16T14:34:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.927+0000 7f900fe4f700 1 -- 172.21.15.5:0/3247010923 shutdown_connections 2024-04-16T14:34:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.927+0000 7f900fe4f700 1 --2- 172.21.15.5:0/3247010923 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f8ff40692b0 0x7f8ff406b760 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.927+0000 7f900fe4f700 1 --2- 172.21.15.5:0/3247010923 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90080662f0 0x7f900810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.927+0000 7f900fe4f700 1 --2- 172.21.15.5:0/3247010923 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90080fff70 0x7f900810df80 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.927+0000 7f900fe4f700 1 -- 172.21.15.5:0/3247010923 >> 172.21.15.5:0/3247010923 conn(0x7f90080f74c0 msgr2=0x7f90080f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.927+0000 7f900fe4f700 1 -- 172.21.15.5:0/3247010923 shutdown_connections 2024-04-16T14:34:10.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:10.927+0000 7f900fe4f700 1 -- 172.21.15.5:0/3247010923 wait complete. 2024-04-16T14:34:10.936 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-04-16T14:34:11.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.047+0000 7f66c8a98700 1 -- 172.21.15.5:0/1222054773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c40fcff0 msgr2=0x7f66c40fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:11.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.047+0000 7f66c8a98700 1 --2- 172.21.15.5:0/1222054773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c40fcff0 0x7f66c40fd460 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f66b8004940 tx=0x7f66b8009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:11.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.047+0000 7f66c8a98700 1 -- 172.21.15.5:0/1222054773 shutdown_connections 2024-04-16T14:34:11.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.047+0000 7f66c8a98700 1 --2- 172.21.15.5:0/1222054773 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c40fcff0 0x7f66c40fd460 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:11.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.047+0000 7f66c8a98700 1 --2- 172.21.15.5:0/1222054773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66c40fbd40 0x7f66c40fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:11.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.047+0000 7f66c8a98700 1 -- 172.21.15.5:0/1222054773 >> 172.21.15.5:0/1222054773 conn(0x7f66c40f74c0 msgr2=0x7f66c40f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:11.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.047+0000 7f66c8a98700 1 -- 172.21.15.5:0/1222054773 shutdown_connections 2024-04-16T14:34:11.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.047+0000 7f66c8a98700 1 -- 172.21.15.5:0/1222054773 wait complete. 2024-04-16T14:34:11.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.048+0000 7f66c8a98700 1 Processor -- start 2024-04-16T14:34:11.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.048+0000 7f66c8a98700 1 -- start start 2024-04-16T14:34:11.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.048+0000 7f66c8a98700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c40fbd40 0x7f66c410d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:11.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.048+0000 7f66c8a98700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66c40fcff0 0x7f66c410df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:11.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.048+0000 7f66c8a98700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c410e520 con 0x7f66c40fbd40 2024-04-16T14:34:11.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.048+0000 7f66c8a98700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c410ed20 con 0x7f66c40fcff0 2024-04-16T14:34:11.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.048+0000 7f66c259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c40fbd40 0x7f66c410d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:11.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.048+0000 7f66c259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c40fbd40 0x7f66c410d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59952/0 (socket says 172.21.15.5:59952) 2024-04-16T14:34:11.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.048+0000 7f66c259c700 1 -- 172.21.15.5:0/3633961722 learned_addr learned my addr 172.21.15.5:0/3633961722 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:34:11.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.048+0000 7f66c1d9b700 1 --2- 172.21.15.5:0/3633961722 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66c40fcff0 0x7f66c410df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:11.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.048+0000 7f66c259c700 1 -- 172.21.15.5:0/3633961722 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66c40fcff0 msgr2=0x7f66c410df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:11.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.048+0000 7f66c259c700 1 --2- 172.21.15.5:0/3633961722 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66c40fcff0 0x7f66c410df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:11.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.048+0000 7f66c259c700 1 -- 172.21.15.5:0/3633961722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b8005040 con 0x7f66c40fbd40 2024-04-16T14:34:11.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.048+0000 7f66c1d9b700 1 --2- 172.21.15.5:0/3633961722 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66c40fcff0 0x7f66c410df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T14:34:11.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.049+0000 7f66c259c700 1 --2- 172.21.15.5:0/3633961722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c40fbd40 0x7f66c410d9e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f66b400eb40 tx=0x7f66b400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:11.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.049+0000 7f66b2ffd700 1 -- 172.21.15.5:0/3633961722 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66b4007cc0 con 0x7f66c40fbd40 2024-04-16T14:34:11.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.049+0000 7f66c8a98700 1 -- 172.21.15.5:0/3633961722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c410efa0 con 0x7f66c40fbd40 2024-04-16T14:34:11.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.049+0000 7f66b2ffd700 1 -- 172.21.15.5:0/3633961722 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f66b400f040 con 0x7f66c40fbd40 2024-04-16T14:34:11.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.049+0000 7f66b2ffd700 1 -- 172.21.15.5:0/3633961722 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66b400ca10 con 0x7f66c40fbd40 2024-04-16T14:34:11.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.049+0000 7f66c8a98700 1 -- 172.21.15.5:0/3633961722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c410f4e0 con 0x7f66c40fbd40 2024-04-16T14:34:11.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.050+0000 7f66c8a98700 1 -- 172.21.15.5:0/3633961722 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c4101b80 con 0x7f66c40fbd40 2024-04-16T14:34:11.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.050+0000 7f66b2ffd700 1 -- 172.21.15.5:0/3633961722 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f66b400cb70 con 0x7f66c40fbd40 2024-04-16T14:34:11.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.051+0000 7f66b2ffd700 1 --2- 172.21.15.5:0/3633961722 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f66ac0692a0 0x7f66ac06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:11.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.051+0000 7f66b2ffd700 1 -- 172.21.15.5:0/3633961722 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f66b4086d00 con 0x7f66c40fbd40 2024-04-16T14:34:11.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.051+0000 7f66c1d9b700 1 --2- 172.21.15.5:0/3633961722 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f66ac0692a0 0x7f66ac06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:11.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.052+0000 7f66c1d9b700 1 --2- 172.21.15.5:0/3633961722 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f66ac0692a0 0x7f66ac06b750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f66b800b0d0 tx=0x7f66b8009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:11.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.055+0000 7f66b2ffd700 1 -- 172.21.15.5:0/3633961722 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f66b404e250 con 0x7f66c40fbd40 2024-04-16T14:34:11.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.274+0000 7f66c8a98700 1 -- 172.21.15.5:0/3633961722 --> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f66c410f750 con 0x7f66ac0692a0 2024-04-16T14:34:11.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.275+0000 7f66b2ffd700 1 -- 172.21.15.5:0/3633961722 <== mgr.14212 v2:172.21.15.5:6800/3841652776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f66c410f750 con 0x7f66ac0692a0 2024-04-16T14:34:11.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.277+0000 7f66c8a98700 1 -- 172.21.15.5:0/3633961722 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f66ac0692a0 msgr2=0x7f66ac06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:11.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.277+0000 7f66c8a98700 1 --2- 172.21.15.5:0/3633961722 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f66ac0692a0 0x7f66ac06b750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f66b800b0d0 tx=0x7f66b8009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:11.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.277+0000 7f66c8a98700 1 -- 172.21.15.5:0/3633961722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c40fbd40 msgr2=0x7f66c410d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:11.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.277+0000 7f66c8a98700 1 --2- 172.21.15.5:0/3633961722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c40fbd40 0x7f66c410d9e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f66b400eb40 tx=0x7f66b400b040 comp rx=0 tx=0).stop 2024-04-16T14:34:11.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.278+0000 7f66c8a98700 1 -- 172.21.15.5:0/3633961722 shutdown_connections 2024-04-16T14:34:11.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.278+0000 7f66c8a98700 1 --2- 172.21.15.5:0/3633961722 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f66ac0692a0 0x7f66ac06b750 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:11.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.278+0000 7f66c8a98700 1 --2- 172.21.15.5:0/3633961722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f66c40fbd40 0x7f66c410d9e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:11.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.278+0000 7f66c8a98700 1 --2- 172.21.15.5:0/3633961722 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66c40fcff0 0x7f66c410df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:11.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.278+0000 7f66c8a98700 1 -- 172.21.15.5:0/3633961722 >> 172.21.15.5:0/3633961722 conn(0x7f66c40f74c0 msgr2=0x7f66c4065b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:11.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.278+0000 7f66c8a98700 1 -- 172.21.15.5:0/3633961722 shutdown_connections 2024-04-16T14:34:11.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.278+0000 7f66c8a98700 1 -- 172.21.15.5:0/3633961722 wait complete. 2024-04-16T14:34:11.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.385+0000 7fa50f6cd700 1 -- 172.21.15.5:0/3116621200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5080fbd40 msgr2=0x7fa5080fc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:11.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.385+0000 7fa50f6cd700 1 --2- 172.21.15.5:0/3116621200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5080fbd40 0x7fa5080fc150 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa504004940 tx=0x7fa504009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:11.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.385+0000 7fa50f6cd700 1 -- 172.21.15.5:0/3116621200 shutdown_connections 2024-04-16T14:34:11.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.385+0000 7fa50f6cd700 1 --2- 172.21.15.5:0/3116621200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5080fcff0 0x7fa5080fd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:11.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.385+0000 7fa50f6cd700 1 --2- 172.21.15.5:0/3116621200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5080fbd40 0x7fa5080fc150 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:11.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.385+0000 7fa50f6cd700 1 -- 172.21.15.5:0/3116621200 >> 172.21.15.5:0/3116621200 conn(0x7fa5080f74c0 msgr2=0x7fa5080f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:11.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.386+0000 7fa50f6cd700 1 -- 172.21.15.5:0/3116621200 shutdown_connections 2024-04-16T14:34:11.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.386+0000 7fa50f6cd700 1 -- 172.21.15.5:0/3116621200 wait complete. 2024-04-16T14:34:11.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.386+0000 7fa50f6cd700 1 Processor -- start 2024-04-16T14:34:11.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.386+0000 7fa50f6cd700 1 -- start start 2024-04-16T14:34:11.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.386+0000 7fa50f6cd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5080fbd40 0x7fa50810fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:11.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.386+0000 7fa50f6cd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5080fcff0 0x7fa508110120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:11.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.386+0000 7fa50f6cd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa508110720 con 0x7fa5080fcff0 2024-04-16T14:34:11.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.386+0000 7fa50f6cd700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa508110f20 con 0x7fa5080fbd40 2024-04-16T14:34:11.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.386+0000 7fa50cc68700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5080fcff0 0x7fa508110120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:11.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.387+0000 7fa50d469700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5080fbd40 0x7fa50810fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:11.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.387+0000 7fa50cc68700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5080fcff0 0x7fa508110120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59970/0 (socket says 172.21.15.5:59970) 2024-04-16T14:34:11.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.387+0000 7fa50cc68700 1 -- 172.21.15.5:0/1019325560 learned_addr learned my addr 172.21.15.5:0/1019325560 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:34:11.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.387+0000 7fa50d469700 1 -- 172.21.15.5:0/1019325560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5080fcff0 msgr2=0x7fa508110120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:11.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.387+0000 7fa50d469700 1 --2- 172.21.15.5:0/1019325560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5080fcff0 0x7fa508110120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:11.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.387+0000 7fa50d469700 1 -- 172.21.15.5:0/1019325560 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa504005040 con 0x7fa5080fbd40 2024-04-16T14:34:11.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.387+0000 7fa50cc68700 1 --2- 172.21.15.5:0/1019325560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5080fcff0 0x7fa508110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T14:34:11.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.387+0000 7fa50d469700 1 --2- 172.21.15.5:0/1019325560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5080fbd40 0x7fa50810fbe0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa50400b0d0 tx=0x7fa504009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:11.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.387+0000 7fa4fdffb700 1 -- 172.21.15.5:0/1019325560 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa50400e070 con 0x7fa5080fbd40 2024-04-16T14:34:11.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.387+0000 7fa50f6cd700 1 -- 172.21.15.5:0/1019325560 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5081111a0 con 0x7fa5080fbd40 2024-04-16T14:34:11.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.387+0000 7fa4fdffb700 1 -- 172.21.15.5:0/1019325560 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa504013de0 con 0x7fa5080fbd40 2024-04-16T14:34:11.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.387+0000 7fa4fdffb700 1 -- 172.21.15.5:0/1019325560 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa50400be30 con 0x7fa5080fbd40 2024-04-16T14:34:11.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.388+0000 7fa50f6cd700 1 -- 172.21.15.5:0/1019325560 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5081116e0 con 0x7fa5080fbd40 2024-04-16T14:34:11.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.388+0000 7fa50f6cd700 1 -- 172.21.15.5:0/1019325560 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa508101980 con 0x7fa5080fbd40 2024-04-16T14:34:11.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.389+0000 7fa4fdffb700 1 -- 172.21.15.5:0/1019325560 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7fa50400b680 con 0x7fa5080fbd40 2024-04-16T14:34:11.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.390+0000 7fa4fdffb700 1 --2- 172.21.15.5:0/1019325560 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa4f40692b0 0x7fa4f406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:11.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.390+0000 7fa4fdffb700 1 -- 172.21.15.5:0/1019325560 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa504087a10 con 0x7fa5080fbd40 2024-04-16T14:34:11.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.390+0000 7fa50cc68700 1 --2- 172.21.15.5:0/1019325560 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa4f40692b0 0x7fa4f406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:11.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.390+0000 7fa50cc68700 1 --2- 172.21.15.5:0/1019325560 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa4f40692b0 0x7fa4f406b760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80041d0 tx=0x7fa4f800b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:11.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.395+0000 7fa4fdffb700 1 -- 172.21.15.5:0/1019325560 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa504057810 con 0x7fa5080fbd40 2024-04-16T14:34:11.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.616+0000 7fa50f6cd700 1 -- 172.21.15.5:0/1019325560 --> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5081119c0 con 0x7fa4f40692b0 2024-04-16T14:34:11.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.626+0000 7fa4fdffb700 1 -- 172.21.15.5:0/1019325560 <== mgr.14212 v2:172.21.15.5:6800/3841652776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7fa5081119c0 con 0x7fa4f40692b0 2024-04-16T14:34:11.624 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-16T14:34:11.624 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.smithi005 smithi005 *:9093,9094 running (5m) 56s ago 6m 25.5M - 0.25.0 c8568f914cd2 0f1dad05c95e 2024-04-16T14:34:11.624 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi005 smithi005 running (7m) 56s ago 7m 6669k - 17.2.7-868-g412a5526 b04d96489b7c 6a380d6ec070 2024-04-16T14:34:11.624 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi115 smithi115 running (5m) 62s ago 5m 6665k - 17.2.7-868-g412a5526 b04d96489b7c df7cb0bfe65b 2024-04-16T14:34:11.624 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.smithi005 smithi005 *:3000 running (5m) 56s ago 6m 88.7M - 9.4.7 954c08fa6188 e6011313e3be 2024-04-16T14:34:11.624 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.vzoqdl smithi005 running (81s) 56s ago 81s 10.4M - 17.2.7-868-g412a5526 b04d96489b7c 84a74a406a1d 2024-04-16T14:34:11.624 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.wofqlz smithi005 running (76s) 56s ago 75s 14.1M - 17.2.7-868-g412a5526 b04d96489b7c d0e053ab2f72 2024-04-16T14:34:11.624 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.byfytg smithi115 running (79s) 62s ago 79s 14.5M - 17.2.7-868-g412a5526 b04d96489b7c 595cd0892f66 2024-04-16T14:34:11.625 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.trkaqh smithi115 running (73s) 62s ago 72s 11.1M - 17.2.7-868-g412a5526 b04d96489b7c 5b60cd2ad79b 2024-04-16T14:34:11.625 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi005.ipwdkc smithi005 *:9283 running (8m) 56s ago 8m 481M - 17.2.7-868-g412a5526 b04d96489b7c 53fb89eec045 2024-04-16T14:34:11.625 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi115.brjkpo smithi115 *:8443,9283 running (5m) 62s ago 5m 434M - 17.2.7-868-g412a5526 b04d96489b7c 6eb664cfe6b2 2024-04-16T14:34:11.625 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi005 smithi005 running (8m) 56s ago 8m 46.5M 2048M 17.2.7-868-g412a5526 b04d96489b7c 764b6a128874 2024-04-16T14:34:11.625 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi115 smithi115 running (5m) 62s ago 5m 34.1M 2048M 17.2.7-868-g412a5526 b04d96489b7c feb5354cdbe9 2024-04-16T14:34:11.625 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi005 smithi005 *:9100 running (7m) 56s ago 7m 14.1M - 1.5.0 0da6a335fe13 16f9701011ea 2024-04-16T14:34:11.625 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi115 smithi115 *:9100 running (5m) 62s ago 5m 16.2M - 1.5.0 0da6a335fe13 38c140c04a1e 2024-04-16T14:34:11.625 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (5m) 56s ago 5m 48.1M 4289M 17.2.7-868-g412a5526 b04d96489b7c ed7aa0542d96 2024-04-16T14:34:11.625 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (4m) 56s ago 4m 49.3M 4289M 17.2.7-868-g412a5526 b04d96489b7c 1868cc6c89f4 2024-04-16T14:34:11.625 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (4m) 56s ago 4m 44.9M 4289M 17.2.7-868-g412a5526 b04d96489b7c b12745ae7d18 2024-04-16T14:34:11.625 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi115 running (3m) 62s ago 3m 44.7M 5312M 17.2.7-868-g412a5526 b04d96489b7c 59f81301ebcf 2024-04-16T14:34:11.625 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi115 running (3m) 62s ago 3m 40.9M 5312M 17.2.7-868-g412a5526 b04d96489b7c e3ea96b7edd9 2024-04-16T14:34:11.625 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi115 running (2m) 62s ago 2m 45.4M 5312M 17.2.7-868-g412a5526 b04d96489b7c 456fa074e453 2024-04-16T14:34:11.626 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.smithi005 smithi005 *:9095 running (5m) 56s ago 6m 54.3M - 2.43.0 a07b618ecd1d 813f7bfd1439 2024-04-16T14:34:11.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.628+0000 7fa50f6cd700 1 -- 172.21.15.5:0/1019325560 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa4f40692b0 msgr2=0x7fa4f406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:11.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.628+0000 7fa50f6cd700 1 --2- 172.21.15.5:0/1019325560 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa4f40692b0 0x7fa4f406b760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80041d0 tx=0x7fa4f800b040 comp rx=0 tx=0).stop 2024-04-16T14:34:11.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.628+0000 7fa50f6cd700 1 -- 172.21.15.5:0/1019325560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5080fbd40 msgr2=0x7fa50810fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:11.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.628+0000 7fa50f6cd700 1 --2- 172.21.15.5:0/1019325560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5080fbd40 0x7fa50810fbe0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa50400b0d0 tx=0x7fa504009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:11.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.628+0000 7fa50f6cd700 1 -- 172.21.15.5:0/1019325560 shutdown_connections 2024-04-16T14:34:11.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.628+0000 7fa50f6cd700 1 --2- 172.21.15.5:0/1019325560 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa4f40692b0 0x7fa4f406b760 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:11.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.628+0000 7fa50f6cd700 1 --2- 172.21.15.5:0/1019325560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5080fbd40 0x7fa50810fbe0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:11.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.628+0000 7fa50f6cd700 1 --2- 172.21.15.5:0/1019325560 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5080fcff0 0x7fa508110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:11.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.628+0000 7fa50f6cd700 1 -- 172.21.15.5:0/1019325560 >> 172.21.15.5:0/1019325560 conn(0x7fa5080f74c0 msgr2=0x7fa508065b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:11.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.628+0000 7fa50f6cd700 1 -- 172.21.15.5:0/1019325560 shutdown_connections 2024-04-16T14:34:11.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.628+0000 7fa50f6cd700 1 -- 172.21.15.5:0/1019325560 wait complete. 2024-04-16T14:34:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.737+0000 7f54079f1700 1 -- 172.21.15.5:0/849548062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54000fcff0 msgr2=0x7f54000fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.737+0000 7f54079f1700 1 --2- 172.21.15.5:0/849548062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54000fcff0 0x7f54000fd460 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f53f0004940 tx=0x7f53f0009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.737+0000 7f54079f1700 1 -- 172.21.15.5:0/849548062 shutdown_connections 2024-04-16T14:34:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.737+0000 7f54079f1700 1 --2- 172.21.15.5:0/849548062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54000fcff0 0x7f54000fd460 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.737+0000 7f54079f1700 1 --2- 172.21.15.5:0/849548062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54000fbd40 0x7f54000fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.737+0000 7f54079f1700 1 -- 172.21.15.5:0/849548062 >> 172.21.15.5:0/849548062 conn(0x7f54000f74c0 msgr2=0x7f54000f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.737+0000 7f54079f1700 1 -- 172.21.15.5:0/849548062 shutdown_connections 2024-04-16T14:34:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.737+0000 7f54079f1700 1 -- 172.21.15.5:0/849548062 wait complete. 2024-04-16T14:34:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.738+0000 7f54079f1700 1 Processor -- start 2024-04-16T14:34:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.738+0000 7f54079f1700 1 -- start start 2024-04-16T14:34:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.738+0000 7f54079f1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54000fbd40 0x7f540010c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:11.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.738+0000 7f54079f1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54000fcff0 0x7f540010ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:11.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.738+0000 7f54079f1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540010d400 con 0x7f54000fcff0 2024-04-16T14:34:11.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.738+0000 7f54079f1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540010dc50 con 0x7f54000fbd40 2024-04-16T14:34:11.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.738+0000 7f5404f8c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54000fcff0 0x7f540010ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:11.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.738+0000 7f540578d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54000fbd40 0x7f540010c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:11.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.738+0000 7f5404f8c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54000fcff0 0x7f540010ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59998/0 (socket says 172.21.15.5:59998) 2024-04-16T14:34:11.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.738+0000 7f5404f8c700 1 -- 172.21.15.5:0/3856918258 learned_addr learned my addr 172.21.15.5:0/3856918258 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:34:11.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.739+0000 7f5404f8c700 1 -- 172.21.15.5:0/3856918258 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54000fbd40 msgr2=0x7f540010c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:11.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.739+0000 7f5404f8c700 1 --2- 172.21.15.5:0/3856918258 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54000fbd40 0x7f540010c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:11.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.739+0000 7f5404f8c700 1 -- 172.21.15.5:0/3856918258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f0005040 con 0x7f54000fcff0 2024-04-16T14:34:11.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.739+0000 7f540578d700 1 --2- 172.21.15.5:0/3856918258 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54000fbd40 0x7f540010c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T14:34:11.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.739+0000 7f5404f8c700 1 --2- 172.21.15.5:0/3856918258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54000fcff0 0x7f540010ce00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f53f0013870 tx=0x7f53f0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:11.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.739+0000 7f53f5ffb700 1 -- 172.21.15.5:0/3856918258 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53f000e070 con 0x7f54000fcff0 2024-04-16T14:34:11.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.739+0000 7f53f5ffb700 1 -- 172.21.15.5:0/3856918258 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f53f0013d00 con 0x7f54000fcff0 2024-04-16T14:34:11.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.739+0000 7f53f5ffb700 1 -- 172.21.15.5:0/3856918258 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53f0023650 con 0x7f54000fcff0 2024-04-16T14:34:11.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.739+0000 7f54079f1700 1 -- 172.21.15.5:0/3856918258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540010ded0 con 0x7f54000fcff0 2024-04-16T14:34:11.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.739+0000 7f54079f1700 1 -- 172.21.15.5:0/3856918258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540010e410 con 0x7f54000fcff0 2024-04-16T14:34:11.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.740+0000 7f54079f1700 1 -- 172.21.15.5:0/3856918258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540005f5f0 con 0x7f54000fcff0 2024-04-16T14:34:11.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.741+0000 7f53f5ffb700 1 -- 172.21.15.5:0/3856918258 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f53f001aa30 con 0x7f54000fcff0 2024-04-16T14:34:11.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.741+0000 7f53f5ffb700 1 --2- 172.21.15.5:0/3856918258 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f53ec0692a0 0x7f53ec06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:11.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.741+0000 7f53f5ffb700 1 -- 172.21.15.5:0/3856918258 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f53f008aa80 con 0x7f54000fcff0 2024-04-16T14:34:11.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.741+0000 7f540578d700 1 --2- 172.21.15.5:0/3856918258 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f53ec0692a0 0x7f53ec06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:11.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.742+0000 7f540578d700 1 --2- 172.21.15.5:0/3856918258 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f53ec0692a0 0x7f53ec06b750 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f53fc009b80 tx=0x7f53fc00b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:11.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:11.750+0000 7f53f5ffb700 1 -- 172.21.15.5:0/3856918258 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f53f005a890 con 0x7f54000fcff0 2024-04-16T14:34:11.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:11 smithi005 ceph-mon[28964]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-04-16T14:34:11.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:11 smithi005 ceph-mon[28964]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:34:12.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.040+0000 7f54079f1700 1 -- 172.21.15.5:0/3856918258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f540004bed0 con 0x7f54000fcff0 2024-04-16T14:34:12.039 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.041+0000 7f53f5ffb700 1 -- 172.21.15.5:0/3856918258 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f53f0004490 con 0x7f54000fcff0 2024-04-16T14:34:12.040 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:34:12.040 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-04-16T14:34:12.040 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 2 2024-04-16T14:34:12.040 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:34:12.040 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-04-16T14:34:12.040 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 2 2024-04-16T14:34:12.040 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:34:12.040 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-04-16T14:34:12.040 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 6 2024-04-16T14:34:12.040 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:34:12.040 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-04-16T14:34:12.040 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 4 2024-04-16T14:34:12.040 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:34:12.040 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-04-16T14:34:12.041 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 14 2024-04-16T14:34:12.041 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-16T14:34:12.041 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:34:12.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.043+0000 7f54079f1700 1 -- 172.21.15.5:0/3856918258 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f53ec0692a0 msgr2=0x7f53ec06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:12.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.043+0000 7f54079f1700 1 --2- 172.21.15.5:0/3856918258 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f53ec0692a0 0x7f53ec06b750 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f53fc009b80 tx=0x7f53fc00b040 comp rx=0 tx=0).stop 2024-04-16T14:34:12.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.043+0000 7f54079f1700 1 -- 172.21.15.5:0/3856918258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54000fcff0 msgr2=0x7f540010ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:12.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.043+0000 7f54079f1700 1 --2- 172.21.15.5:0/3856918258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54000fcff0 0x7f540010ce00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f53f0013870 tx=0x7f53f0009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.043+0000 7f54079f1700 1 -- 172.21.15.5:0/3856918258 shutdown_connections 2024-04-16T14:34:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.043+0000 7f54079f1700 1 --2- 172.21.15.5:0/3856918258 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f53ec0692a0 0x7f53ec06b750 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.043+0000 7f54079f1700 1 --2- 172.21.15.5:0/3856918258 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54000fbd40 0x7f540010c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.043+0000 7f54079f1700 1 --2- 172.21.15.5:0/3856918258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54000fcff0 0x7f540010ce00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.043+0000 7f54079f1700 1 -- 172.21.15.5:0/3856918258 >> 172.21.15.5:0/3856918258 conn(0x7f54000f74c0 msgr2=0x7f54000f8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.043+0000 7f54079f1700 1 -- 172.21.15.5:0/3856918258 shutdown_connections 2024-04-16T14:34:12.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.043+0000 7f54079f1700 1 -- 172.21.15.5:0/3856918258 wait complete. 2024-04-16T14:34:12.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.155+0000 7ff8069b4700 1 -- 172.21.15.5:0/3967644502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8000fce40 msgr2=0x7ff8000fd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:12.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.155+0000 7ff8069b4700 1 --2- 172.21.15.5:0/3967644502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8000fce40 0x7ff8000fd250 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0004940 tx=0x7ff7f0009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:12.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.155+0000 7ff8069b4700 1 -- 172.21.15.5:0/3967644502 shutdown_connections 2024-04-16T14:34:12.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.155+0000 7ff8069b4700 1 --2- 172.21.15.5:0/3967644502 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8000fe040 0x7ff8000fe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:12.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.155+0000 7ff8069b4700 1 --2- 172.21.15.5:0/3967644502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8000fce40 0x7ff8000fd250 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:12.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.155+0000 7ff8069b4700 1 -- 172.21.15.5:0/3967644502 >> 172.21.15.5:0/3967644502 conn(0x7ff8000f8570 msgr2=0x7ff8000fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:12.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.155+0000 7ff8069b4700 1 -- 172.21.15.5:0/3967644502 shutdown_connections 2024-04-16T14:34:12.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.155+0000 7ff8069b4700 1 -- 172.21.15.5:0/3967644502 wait complete. 2024-04-16T14:34:12.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.155+0000 7ff8069b4700 1 Processor -- start 2024-04-16T14:34:12.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.156+0000 7ff8069b4700 1 -- start start 2024-04-16T14:34:12.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.156+0000 7ff8069b4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8000fce40 0x7ff80010d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:12.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.156+0000 7ff8069b4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8000fe040 0x7ff80010df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:12.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.156+0000 7ff8069b4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80010e510 con 0x7ff8000fe040 2024-04-16T14:34:12.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.156+0000 7ff8069b4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80010ed60 con 0x7ff8000fce40 2024-04-16T14:34:12.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.156+0000 7ff7ff7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8000fe040 0x7ff80010df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.156+0000 7ff7ff7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8000fe040 0x7ff80010df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60018/0 (socket says 172.21.15.5:60018) 2024-04-16T14:34:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.156+0000 7ff7ff7fe700 1 -- 172.21.15.5:0/4232507879 learned_addr learned my addr 172.21.15.5:0/4232507879 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:34:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.156+0000 7ff7fffff700 1 --2- 172.21.15.5:0/4232507879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8000fce40 0x7ff80010d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.156+0000 7ff7ff7fe700 1 -- 172.21.15.5:0/4232507879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8000fce40 msgr2=0x7ff80010d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.156+0000 7ff7ff7fe700 1 --2- 172.21.15.5:0/4232507879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8000fce40 0x7ff80010d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.156+0000 7ff7ff7fe700 1 -- 172.21.15.5:0/4232507879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f0005040 con 0x7ff8000fe040 2024-04-16T14:34:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.156+0000 7ff7ff7fe700 1 --2- 172.21.15.5:0/4232507879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8000fe040 0x7ff80010df10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400eb40 tx=0x7ff7f400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.157+0000 7ff7fcff9700 1 -- 172.21.15.5:0/4232507879 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7f4007cc0 con 0x7ff8000fe040 2024-04-16T14:34:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.157+0000 7ff7fcff9700 1 -- 172.21.15.5:0/4232507879 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff7f400f040 con 0x7ff8000fe040 2024-04-16T14:34:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.157+0000 7ff8069b4700 1 -- 172.21.15.5:0/4232507879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff80010efe0 con 0x7ff8000fe040 2024-04-16T14:34:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.157+0000 7ff7fcff9700 1 -- 172.21.15.5:0/4232507879 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7f400ca10 con 0x7ff8000fe040 2024-04-16T14:34:12.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.157+0000 7ff8069b4700 1 -- 172.21.15.5:0/4232507879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff80010f520 con 0x7ff8000fe040 2024-04-16T14:34:12.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.158+0000 7ff8069b4700 1 -- 172.21.15.5:0/4232507879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff80005f5f0 con 0x7ff8000fe040 2024-04-16T14:34:12.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.158+0000 7ff7fcff9700 1 -- 172.21.15.5:0/4232507879 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7ff7f400cc80 con 0x7ff8000fe040 2024-04-16T14:34:12.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.159+0000 7ff7fcff9700 1 --2- 172.21.15.5:0/4232507879 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ff7e80692a0 0x7ff7e806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:12.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.159+0000 7ff7fcff9700 1 -- 172.21.15.5:0/4232507879 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff7f4086de0 con 0x7ff8000fe040 2024-04-16T14:34:12.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.159+0000 7ff7fffff700 1 --2- 172.21.15.5:0/4232507879 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ff7e80692a0 0x7ff7e806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:12.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.159+0000 7ff7fffff700 1 --2- 172.21.15.5:0/4232507879 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ff7e80692a0 0x7ff7e806b750 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0004890 tx=0x7ff7f0009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:12.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.163+0000 7ff7fcff9700 1 -- 172.21.15.5:0/4232507879 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff7f404e250 con 0x7ff8000fe040 2024-04-16T14:34:12.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:11 smithi115 ceph-mon[37295]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-04-16T14:34:12.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:11 smithi115 ceph-mon[37295]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:34:12.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.413+0000 7ff8069b4700 1 -- 172.21.15.5:0/4232507879 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff80004bed0 con 0x7ff8000fe040 2024-04-16T14:34:12.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.413+0000 7ff7fcff9700 1 -- 172.21.15.5:0/4232507879 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1812 (secure 0 0 0) 0x7ff7f4056b80 con 0x7ff8000fe040 2024-04-16T14:34:12.412 INFO:teuthology.orchestra.run.smithi005.stdout:e18 2024-04-16T14:34:12.412 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:34:12.412 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:34:12.412 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2024-04-16T14:34:12.412 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:34:12.412 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2024-04-16T14:34:12.412 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2024-04-16T14:34:12.412 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 18 2024-04-16T14:34:12.412 INFO:teuthology.orchestra.run.smithi005.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-16T14:34:12.412 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-16T14:32:45.270024+0000 2024-04-16T14:34:12.412 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-04-16T14:33:04.825498+0000 2024-04-16T14:34:12.412 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2024-04-16T14:34:12.412 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2024-04-16T14:34:12.412 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 60 2024-04-16T14:34:12.413 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2024-04-16T14:34:12.413 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2024-04-16T14:34:12.413 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2024-04-16T14:34:12.413 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2024-04-16T14:34:12.413 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 47 2024-04-16T14:34:12.413 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:34:12.413 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 2 2024-04-16T14:34:12.413 INFO:teuthology.orchestra.run.smithi005.stdout:in 0,1 2024-04-16T14:34:12.413 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=14484,1=24269} 2024-04-16T14:34:12.413 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2024-04-16T14:34:12.413 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2024-04-16T14:34:12.413 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 2024-04-16T14:34:12.413 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3] 2024-04-16T14:34:12.414 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2024-04-16T14:34:12.414 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2024-04-16T14:34:12.414 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2024-04-16T14:34:12.414 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 1 2024-04-16T14:34:12.414 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.wofqlz{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:34:12.414 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.byfytg{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.115:6824/1662994117,v1:172.21.15.115:6825/1662994117] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:34:12.414 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:34:12.414 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:34:12.414 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2024-04-16T14:34:12.414 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:34:12.414 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.vzoqdl{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.5:6826/187766809,v1:172.21.15.5:6827/187766809] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:34:12.414 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.trkaqh{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:34:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.415+0000 7ff8069b4700 1 -- 172.21.15.5:0/4232507879 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ff7e80692a0 msgr2=0x7ff7e806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.415+0000 7ff8069b4700 1 --2- 172.21.15.5:0/4232507879 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ff7e80692a0 0x7ff7e806b750 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0004890 tx=0x7ff7f0009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.415+0000 7ff8069b4700 1 -- 172.21.15.5:0/4232507879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8000fe040 msgr2=0x7ff80010df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.415+0000 7ff8069b4700 1 --2- 172.21.15.5:0/4232507879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8000fe040 0x7ff80010df10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400eb40 tx=0x7ff7f400b040 comp rx=0 tx=0).stop 2024-04-16T14:34:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.415+0000 7ff8069b4700 1 -- 172.21.15.5:0/4232507879 shutdown_connections 2024-04-16T14:34:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.415+0000 7ff8069b4700 1 --2- 172.21.15.5:0/4232507879 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ff7e80692a0 0x7ff7e806b750 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.415+0000 7ff8069b4700 1 --2- 172.21.15.5:0/4232507879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8000fce40 0x7ff80010d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:12.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.415+0000 7ff8069b4700 1 --2- 172.21.15.5:0/4232507879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff8000fe040 0x7ff80010df10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:12.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.415+0000 7ff8069b4700 1 -- 172.21.15.5:0/4232507879 >> 172.21.15.5:0/4232507879 conn(0x7ff8000f8570 msgr2=0x7ff8000f9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:12.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.416+0000 7ff8069b4700 1 -- 172.21.15.5:0/4232507879 shutdown_connections 2024-04-16T14:34:12.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.416+0000 7ff8069b4700 1 -- 172.21.15.5:0/4232507879 wait complete. 2024-04-16T14:34:12.416 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 18 2024-04-16T14:34:12.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.525+0000 7fefb3e27700 1 -- 172.21.15.5:0/1921345740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefac0fce50 msgr2=0x7fefac0fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.525+0000 7fefb3e27700 1 --2- 172.21.15.5:0/1921345740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefac0fce50 0x7fefac0fd260 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fefa8004940 tx=0x7fefa8009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.526+0000 7fefb3e27700 1 -- 172.21.15.5:0/1921345740 shutdown_connections 2024-04-16T14:34:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.526+0000 7fefb3e27700 1 --2- 172.21.15.5:0/1921345740 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefac0fe050 0x7fefac0fe4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.526+0000 7fefb3e27700 1 --2- 172.21.15.5:0/1921345740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefac0fce50 0x7fefac0fd260 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.526+0000 7fefb3e27700 1 -- 172.21.15.5:0/1921345740 >> 172.21.15.5:0/1921345740 conn(0x7fefac0f8540 msgr2=0x7fefac0fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.526+0000 7fefb3e27700 1 -- 172.21.15.5:0/1921345740 shutdown_connections 2024-04-16T14:34:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.526+0000 7fefb3e27700 1 -- 172.21.15.5:0/1921345740 wait complete. 2024-04-16T14:34:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.526+0000 7fefb3e27700 1 Processor -- start 2024-04-16T14:34:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.526+0000 7fefb3e27700 1 -- start start 2024-04-16T14:34:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.526+0000 7fefb3e27700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefac0fce50 0x7fefac071c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.526+0000 7fefb3e27700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefac0fe050 0x7fefac070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:12.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.526+0000 7fefb3e27700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac072260 con 0x7fefac0fce50 2024-04-16T14:34:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.526+0000 7fefb3e27700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac070850 con 0x7fefac0fe050 2024-04-16T14:34:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.527+0000 7fefb1bc3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefac0fce50 0x7fefac071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.527+0000 7fefb1bc3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefac0fce50 0x7fefac071c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60036/0 (socket says 172.21.15.5:60036) 2024-04-16T14:34:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.527+0000 7fefb1bc3700 1 -- 172.21.15.5:0/3026972470 learned_addr learned my addr 172.21.15.5:0/3026972470 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:34:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.527+0000 7fefb13c2700 1 --2- 172.21.15.5:0/3026972470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefac0fe050 0x7fefac070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.527+0000 7fefb13c2700 1 -- 172.21.15.5:0/3026972470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefac0fce50 msgr2=0x7fefac071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.527+0000 7fefb13c2700 1 --2- 172.21.15.5:0/3026972470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefac0fce50 0x7fefac071c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.527+0000 7fefb13c2700 1 -- 172.21.15.5:0/3026972470 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa8005040 con 0x7fefac0fe050 2024-04-16T14:34:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.527+0000 7fefb1bc3700 1 --2- 172.21.15.5:0/3026972470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefac0fce50 0x7fefac071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T14:34:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.527+0000 7fefb13c2700 1 --2- 172.21.15.5:0/3026972470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefac0fe050 0x7fefac070310 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fef9c009fd0 tx=0x7fef9c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.527+0000 7fefa27fc700 1 -- 172.21.15.5:0/3026972470 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef9c004e90 con 0x7fefac0fe050 2024-04-16T14:34:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.527+0000 7fefa27fc700 1 -- 172.21.15.5:0/3026972470 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fef9c00f040 con 0x7fefac0fe050 2024-04-16T14:34:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.527+0000 7fefa27fc700 1 -- 172.21.15.5:0/3026972470 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef9c00ca50 con 0x7fefac0fe050 2024-04-16T14:34:12.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.527+0000 7fefb3e27700 1 -- 172.21.15.5:0/3026972470 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefac070aa0 con 0x7fefac0fe050 2024-04-16T14:34:12.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.528+0000 7fefb3e27700 1 -- 172.21.15.5:0/3026972470 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefac070fe0 con 0x7fefac0fe050 2024-04-16T14:34:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.529+0000 7fefb3e27700 1 -- 172.21.15.5:0/3026972470 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefac04c710 con 0x7fefac0fe050 2024-04-16T14:34:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.529+0000 7fefa27fc700 1 -- 172.21.15.5:0/3026972470 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7fef9c007cc0 con 0x7fefac0fe050 2024-04-16T14:34:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.529+0000 7fefa27fc700 1 --2- 172.21.15.5:0/3026972470 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fef980692a0 0x7fef9806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.530+0000 7fefa27fc700 1 -- 172.21.15.5:0/3026972470 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fef9c086cf0 con 0x7fefac0fe050 2024-04-16T14:34:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.530+0000 7fefb1bc3700 1 --2- 172.21.15.5:0/3026972470 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fef980692a0 0x7fef9806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:12.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.530+0000 7fefb1bc3700 1 --2- 172.21.15.5:0/3026972470 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fef980692a0 0x7fef9806b750 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fefa80045a0 tx=0x7fefa8009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:12.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.535+0000 7fefa27fc700 1 -- 172.21.15.5:0/3026972470 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fef9c04e250 con 0x7fefac0fe050 2024-04-16T14:34:12.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.769+0000 7fefb3e27700 1 -- 172.21.15.5:0/3026972470 --> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fefac1022f0 con 0x7fef980692a0 2024-04-16T14:34:12.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.770+0000 7fefa27fc700 1 -- 172.21.15.5:0/3026972470 <== mgr.14212 v2:172.21.15.5:6800/3841652776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fefac1022f0 con 0x7fef980692a0 2024-04-16T14:34:12.769 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:34:12.769 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91", 2024-04-16T14:34:12.769 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-04-16T14:34:12.769 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-16T14:34:12.769 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [], 2024-04-16T14:34:12.769 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "0/21 daemons upgraded", 2024-04-16T14:34:12.769 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 image on host smithi115", 2024-04-16T14:34:12.769 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-04-16T14:34:12.769 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:34:12.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.772+0000 7fefb3e27700 1 -- 172.21.15.5:0/3026972470 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fef980692a0 msgr2=0x7fef9806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:12.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.772+0000 7fefb3e27700 1 --2- 172.21.15.5:0/3026972470 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fef980692a0 0x7fef9806b750 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fefa80045a0 tx=0x7fefa8009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:12.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.772+0000 7fefb3e27700 1 -- 172.21.15.5:0/3026972470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefac0fe050 msgr2=0x7fefac070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:12.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.772+0000 7fefb3e27700 1 --2- 172.21.15.5:0/3026972470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefac0fe050 0x7fefac070310 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fef9c009fd0 tx=0x7fef9c00b040 comp rx=0 tx=0).stop 2024-04-16T14:34:12.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.772+0000 7fefb3e27700 1 -- 172.21.15.5:0/3026972470 shutdown_connections 2024-04-16T14:34:12.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.773+0000 7fefb3e27700 1 --2- 172.21.15.5:0/3026972470 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fef980692a0 0x7fef9806b750 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:12.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.773+0000 7fefb3e27700 1 --2- 172.21.15.5:0/3026972470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fefac0fce50 0x7fefac071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:12.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.773+0000 7fefb3e27700 1 --2- 172.21.15.5:0/3026972470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefac0fe050 0x7fefac070310 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:12.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.773+0000 7fefb3e27700 1 -- 172.21.15.5:0/3026972470 >> 172.21.15.5:0/3026972470 conn(0x7fefac0f8540 msgr2=0x7fefac0f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:12.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.773+0000 7fefb3e27700 1 -- 172.21.15.5:0/3026972470 shutdown_connections 2024-04-16T14:34:12.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.773+0000 7fefb3e27700 1 -- 172.21.15.5:0/3026972470 wait complete. 2024-04-16T14:34:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.879+0000 7ffa7bc3e700 1 -- 172.21.15.5:0/956278437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa740fcff0 msgr2=0x7ffa740fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.879+0000 7ffa7bc3e700 1 --2- 172.21.15.5:0/956278437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa740fcff0 0x7ffa740fd460 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ffa64004940 tx=0x7ffa64009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.879+0000 7ffa7bc3e700 1 -- 172.21.15.5:0/956278437 shutdown_connections 2024-04-16T14:34:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.879+0000 7ffa7bc3e700 1 --2- 172.21.15.5:0/956278437 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa740fcff0 0x7ffa740fd460 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.879+0000 7ffa7bc3e700 1 --2- 172.21.15.5:0/956278437 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa740fbd40 0x7ffa740fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.879+0000 7ffa7bc3e700 1 -- 172.21.15.5:0/956278437 >> 172.21.15.5:0/956278437 conn(0x7ffa740f74c0 msgr2=0x7ffa740f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.880+0000 7ffa7bc3e700 1 -- 172.21.15.5:0/956278437 shutdown_connections 2024-04-16T14:34:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.880+0000 7ffa7bc3e700 1 -- 172.21.15.5:0/956278437 wait complete. 2024-04-16T14:34:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.880+0000 7ffa7bc3e700 1 Processor -- start 2024-04-16T14:34:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.880+0000 7ffa7bc3e700 1 -- start start 2024-04-16T14:34:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.880+0000 7ffa7bc3e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa740fbd40 0x7ffa7410d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.880+0000 7ffa7bc3e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa740fcff0 0x7ffa7410df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.880+0000 7ffa7bc3e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7410e520 con 0x7ffa740fcff0 2024-04-16T14:34:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.880+0000 7ffa7bc3e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7410ed20 con 0x7ffa740fbd40 2024-04-16T14:34:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.881+0000 7ffa791d9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa740fcff0 0x7ffa7410df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.881+0000 7ffa799da700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa740fbd40 0x7ffa7410d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.881+0000 7ffa791d9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa740fcff0 0x7ffa7410df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60046/0 (socket says 172.21.15.5:60046) 2024-04-16T14:34:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.881+0000 7ffa799da700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa740fbd40 0x7ffa7410d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.5:33986/0 (socket says 172.21.15.5:33986) 2024-04-16T14:34:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.881+0000 7ffa791d9700 1 -- 172.21.15.5:0/887943528 learned_addr learned my addr 172.21.15.5:0/887943528 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:34:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.881+0000 7ffa791d9700 1 -- 172.21.15.5:0/887943528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa740fbd40 msgr2=0x7ffa7410d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.881+0000 7ffa791d9700 1 --2- 172.21.15.5:0/887943528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa740fbd40 0x7ffa7410d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.881+0000 7ffa791d9700 1 -- 172.21.15.5:0/887943528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa64005040 con 0x7ffa740fcff0 2024-04-16T14:34:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.881+0000 7ffa799da700 1 --2- 172.21.15.5:0/887943528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa740fbd40 0x7ffa7410d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T14:34:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.881+0000 7ffa791d9700 1 --2- 172.21.15.5:0/887943528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa740fcff0 0x7ffa7410df20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ffa64013870 tx=0x7ffa64009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.881+0000 7ffa6a7fc700 1 -- 172.21.15.5:0/887943528 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa64021070 con 0x7ffa740fcff0 2024-04-16T14:34:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.881+0000 7ffa6a7fc700 1 -- 172.21.15.5:0/887943528 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa64009430 con 0x7ffa740fcff0 2024-04-16T14:34:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.881+0000 7ffa7bc3e700 1 -- 172.21.15.5:0/887943528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa7410efa0 con 0x7ffa740fcff0 2024-04-16T14:34:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.881+0000 7ffa7bc3e700 1 -- 172.21.15.5:0/887943528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa7410f4e0 con 0x7ffa740fcff0 2024-04-16T14:34:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.881+0000 7ffa6a7fc700 1 -- 172.21.15.5:0/887943528 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa6400e070 con 0x7ffa740fcff0 2024-04-16T14:34:12.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.883+0000 7ffa7bc3e700 1 -- 172.21.15.5:0/887943528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa74101b80 con 0x7ffa740fcff0 2024-04-16T14:34:12.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.883+0000 7ffa6a7fc700 1 -- 172.21.15.5:0/887943528 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7ffa6401c750 con 0x7ffa740fcff0 2024-04-16T14:34:12.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.884+0000 7ffa6a7fc700 1 --2- 172.21.15.5:0/887943528 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ffa60069230 0x7ffa6006b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:12.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.884+0000 7ffa6a7fc700 1 -- 172.21.15.5:0/887943528 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ffa640884b0 con 0x7ffa740fcff0 2024-04-16T14:34:12.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.884+0000 7ffa799da700 1 --2- 172.21.15.5:0/887943528 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ffa60069230 0x7ffa6006b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:12.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.884+0000 7ffa799da700 1 --2- 172.21.15.5:0/887943528 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ffa60069230 0x7ffa6006b6e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ffa70009b80 tx=0x7ffa7000b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:12.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:12.888+0000 7ffa6a7fc700 1 -- 172.21.15.5:0/887943528 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ffa64058220 con 0x7ffa740fcff0 2024-04-16T14:34:13.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:12 smithi115 ceph-mon[37295]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:34:13.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:12 smithi115 ceph-mon[37295]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:34:13.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:12 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/3856918258' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:34:13.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:12 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/4232507879' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:34:13.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:13.187+0000 7ffa7bc3e700 1 -- 172.21.15.5:0/887943528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ffa7405f5f0 con 0x7ffa740fcff0 2024-04-16T14:34:13.185 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:12 smithi005 ceph-mon[28964]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:34:13.185 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:12 smithi005 ceph-mon[28964]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:34:13.185 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:12 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/3856918258' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:34:13.185 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:12 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/4232507879' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:34:13.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:13.187+0000 7ffa6a7fc700 1 -- 172.21.15.5:0/887943528 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ffa64004490 con 0x7ffa740fcff0 2024-04-16T14:34:13.186 INFO:teuthology.orchestra.run.smithi005.stdout:HEALTH_OK 2024-04-16T14:34:13.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:13.189+0000 7ffa7bc3e700 1 -- 172.21.15.5:0/887943528 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ffa60069230 msgr2=0x7ffa6006b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:13.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:13.189+0000 7ffa7bc3e700 1 --2- 172.21.15.5:0/887943528 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ffa60069230 0x7ffa6006b6e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ffa70009b80 tx=0x7ffa7000b040 comp rx=0 tx=0).stop 2024-04-16T14:34:13.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:13.189+0000 7ffa7bc3e700 1 -- 172.21.15.5:0/887943528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa740fcff0 msgr2=0x7ffa7410df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:13.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:13.189+0000 7ffa7bc3e700 1 --2- 172.21.15.5:0/887943528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa740fcff0 0x7ffa7410df20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ffa64013870 tx=0x7ffa64009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:13.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:13.189+0000 7ffa7bc3e700 1 -- 172.21.15.5:0/887943528 shutdown_connections 2024-04-16T14:34:13.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:13.189+0000 7ffa7bc3e700 1 --2- 172.21.15.5:0/887943528 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7ffa60069230 0x7ffa6006b6e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:13.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:13.189+0000 7ffa7bc3e700 1 --2- 172.21.15.5:0/887943528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa740fbd40 0x7ffa7410d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:13.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:13.189+0000 7ffa7bc3e700 1 --2- 172.21.15.5:0/887943528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa740fcff0 0x7ffa7410df20 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:13.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:13.189+0000 7ffa7bc3e700 1 -- 172.21.15.5:0/887943528 >> 172.21.15.5:0/887943528 conn(0x7ffa740f74c0 msgr2=0x7ffa74065b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:13.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:13.189+0000 7ffa7bc3e700 1 -- 172.21.15.5:0/887943528 shutdown_connections 2024-04-16T14:34:13.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:13.189+0000 7ffa7bc3e700 1 -- 172.21.15.5:0/887943528 wait complete. 2024-04-16T14:34:14.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:13 smithi115 ceph-mon[37295]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-04-16T14:34:14.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:13 smithi115 ceph-mon[37295]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:34:14.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:13 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/887943528' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:34:14.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:13 smithi005 ceph-mon[28964]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-04-16T14:34:14.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:13 smithi005 ceph-mon[28964]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:34:14.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:13 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/887943528' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:34:15.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:15 smithi115 ceph-mon[37295]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-04-16T14:34:16.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:15 smithi005 ceph-mon[28964]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-04-16T14:34:18.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:17 smithi115 ceph-mon[37295]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-04-16T14:34:18.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:17 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:34:18.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:17 smithi005 ceph-mon[28964]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-04-16T14:34:18.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:17 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:34:20.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:19 smithi115 ceph-mon[37295]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-04-16T14:34:20.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:19 smithi005 ceph-mon[28964]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-04-16T14:34:22.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:21 smithi115 ceph-mon[37295]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:22.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:21 smithi005 ceph-mon[28964]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:24.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:23 smithi115 ceph-mon[37295]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:24.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:23 smithi005 ceph-mon[28964]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:26.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:25 smithi115 ceph-mon[37295]: pgmap v226: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:26.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:25 smithi005 ceph-mon[28964]: pgmap v226: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:28.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:27 smithi115 ceph-mon[37295]: pgmap v227: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:28.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:27 smithi005 ceph-mon[28964]: pgmap v227: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:30.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:29 smithi115 ceph-mon[37295]: pgmap v228: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:30.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:29 smithi005 ceph-mon[28964]: pgmap v228: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:32.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:31 smithi115 ceph-mon[37295]: pgmap v229: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:32.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:31 smithi005 ceph-mon[28964]: pgmap v229: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:33.082 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:32 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:34:33.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:32 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:34:33.937 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:33 smithi115 ceph-mon[37295]: pgmap v230: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:34.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:33 smithi005 ceph-mon[28964]: pgmap v230: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:35.864 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:35 smithi115 ceph-mon[37295]: Upgrade: Updating mgr.smithi115.brjkpo 2024-04-16T14:34:35.864 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:35 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:34:35.864 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:35 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi115.brjkpo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-16T14:34:35.864 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:35 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-16T14:34:35.864 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:35 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:34:35.864 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:35 smithi115 ceph-mon[37295]: Deploying daemon mgr.smithi115.brjkpo on smithi115 2024-04-16T14:34:35.865 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:35 smithi115 ceph-mon[37295]: pgmap v231: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:35.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:35 smithi005 ceph-mon[28964]: Upgrade: Updating mgr.smithi115.brjkpo 2024-04-16T14:34:35.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:35 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:34:35.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:35 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi115.brjkpo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-16T14:34:35.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:35 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-16T14:34:35.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:35 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:34:35.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:35 smithi005 ceph-mon[28964]: Deploying daemon mgr.smithi115.brjkpo on smithi115 2024-04-16T14:34:35.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:35 smithi005 ceph-mon[28964]: pgmap v231: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:38.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:37 smithi115 ceph-mon[37295]: pgmap v232: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:38.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:37 smithi005 ceph-mon[28964]: pgmap v232: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:40.010 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:40 smithi115 ceph-mon[37295]: pgmap v233: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:40.010 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:40 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:34:40.010 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:40 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:34:40.010 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:40 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:34:40.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:40 smithi005 ceph-mon[28964]: pgmap v233: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:40.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:40 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:34:40.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:40 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:34:40.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:40 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:34:42.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:42 smithi115 ceph-mon[37295]: pgmap v234: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:42.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:42 smithi005 ceph-mon[28964]: pgmap v234: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:43.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.299+0000 7f726865e700 1 -- 172.21.15.5:0/1370819563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72600fce50 msgr2=0x7f72600fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:43.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.299+0000 7f726865e700 1 --2- 172.21.15.5:0/1370819563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72600fce50 0x7f72600fd260 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f725c004940 tx=0x7f725c009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:43.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.299+0000 7f726865e700 1 -- 172.21.15.5:0/1370819563 shutdown_connections 2024-04-16T14:34:43.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.299+0000 7f726865e700 1 --2- 172.21.15.5:0/1370819563 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72600fe050 0x7f72600fe4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:43.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.299+0000 7f726865e700 1 --2- 172.21.15.5:0/1370819563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72600fce50 0x7f72600fd260 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:43.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.299+0000 7f726865e700 1 -- 172.21.15.5:0/1370819563 >> 172.21.15.5:0/1370819563 conn(0x7f72600f8540 msgr2=0x7f72600fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:43.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.300+0000 7f726865e700 1 -- 172.21.15.5:0/1370819563 shutdown_connections 2024-04-16T14:34:43.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.300+0000 7f726865e700 1 -- 172.21.15.5:0/1370819563 wait complete. 2024-04-16T14:34:43.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.300+0000 7f726865e700 1 Processor -- start 2024-04-16T14:34:43.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.300+0000 7f726865e700 1 -- start start 2024-04-16T14:34:43.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.300+0000 7f726865e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72600fce50 0x7f726010da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:43.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.300+0000 7f726865e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72600fe050 0x7f726010df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:43.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.300+0000 7f726865e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726010e600 con 0x7f72600fce50 2024-04-16T14:34:43.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.300+0000 7f726865e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726010edf0 con 0x7f72600fe050 2024-04-16T14:34:43.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.300+0000 7f72663fa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72600fce50 0x7f726010da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:43.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.300+0000 7f72663fa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72600fce50 0x7f726010da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47808/0 (socket says 172.21.15.5:47808) 2024-04-16T14:34:43.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.300+0000 7f72663fa700 1 -- 172.21.15.5:0/1752914305 learned_addr learned my addr 172.21.15.5:0/1752914305 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:34:43.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.301+0000 7f72663fa700 1 -- 172.21.15.5:0/1752914305 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72600fe050 msgr2=0x7f726010df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:43.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.301+0000 7f72663fa700 1 --2- 172.21.15.5:0/1752914305 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72600fe050 0x7f726010df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:43.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.301+0000 7f72663fa700 1 -- 172.21.15.5:0/1752914305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725c005040 con 0x7f72600fce50 2024-04-16T14:34:43.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.301+0000 7f72663fa700 1 --2- 172.21.15.5:0/1752914305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72600fce50 0x7f726010da30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f725c000c00 tx=0x7f725c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:43.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.301+0000 7f7256ffd700 1 -- 172.21.15.5:0/1752914305 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f725c00e040 con 0x7f72600fce50 2024-04-16T14:34:43.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.301+0000 7f7256ffd700 1 -- 172.21.15.5:0/1752914305 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f725c00bcc0 con 0x7f72600fce50 2024-04-16T14:34:43.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.301+0000 7f7256ffd700 1 -- 172.21.15.5:0/1752914305 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f725c01c630 con 0x7f72600fce50 2024-04-16T14:34:43.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.301+0000 7f726865e700 1 -- 172.21.15.5:0/1752914305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f726010f070 con 0x7f72600fce50 2024-04-16T14:34:43.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.301+0000 7f726865e700 1 -- 172.21.15.5:0/1752914305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726010f630 con 0x7f72600fce50 2024-04-16T14:34:43.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.302+0000 7f726865e700 1 -- 172.21.15.5:0/1752914305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f726005f5f0 con 0x7f72600fce50 2024-04-16T14:34:43.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.303+0000 7f7256ffd700 1 -- 172.21.15.5:0/1752914305 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f725c013980 con 0x7f72600fce50 2024-04-16T14:34:43.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.304+0000 7f7256ffd700 1 --2- 172.21.15.5:0/1752914305 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f724c0692a0 0x7f724c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:43.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.304+0000 7f7256ffd700 1 -- 172.21.15.5:0/1752914305 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f725c088560 con 0x7f72600fce50 2024-04-16T14:34:43.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.304+0000 7f7265bf9700 1 --2- 172.21.15.5:0/1752914305 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f724c0692a0 0x7f724c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:43.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.304+0000 7f7265bf9700 1 --2- 172.21.15.5:0/1752914305 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f724c0692a0 0x7f724c06b750 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7250006fd0 tx=0x7f7250006db0 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:43.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.308+0000 7f7256ffd700 1 -- 172.21.15.5:0/1752914305 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f725c058420 con 0x7f72600fce50 2024-04-16T14:34:43.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:43 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:34:43.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:43 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:34:43.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:43 smithi005 ceph-mon[28964]: pgmap v235: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:43.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:43 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:34:43.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:43 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:34:43.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.524+0000 7f726865e700 1 -- 172.21.15.5:0/1752914305 --> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f726010f9b0 con 0x7f724c0692a0 2024-04-16T14:34:43.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.526+0000 7f7256ffd700 1 -- 172.21.15.5:0/1752914305 <== mgr.14212 v2:172.21.15.5:6800/3841652776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f726010f9b0 con 0x7f724c0692a0 2024-04-16T14:34:43.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.528+0000 7f726865e700 1 -- 172.21.15.5:0/1752914305 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f724c0692a0 msgr2=0x7f724c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:43.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.528+0000 7f726865e700 1 --2- 172.21.15.5:0/1752914305 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f724c0692a0 0x7f724c06b750 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7250006fd0 tx=0x7f7250006db0 comp rx=0 tx=0).stop 2024-04-16T14:34:43.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.528+0000 7f726865e700 1 -- 172.21.15.5:0/1752914305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72600fce50 msgr2=0x7f726010da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:43.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.528+0000 7f726865e700 1 --2- 172.21.15.5:0/1752914305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72600fce50 0x7f726010da30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f725c000c00 tx=0x7f725c009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:43.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.528+0000 7f726865e700 1 -- 172.21.15.5:0/1752914305 shutdown_connections 2024-04-16T14:34:43.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.528+0000 7f726865e700 1 --2- 172.21.15.5:0/1752914305 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f724c0692a0 0x7f724c06b750 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:43.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.528+0000 7f726865e700 1 --2- 172.21.15.5:0/1752914305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f72600fce50 0x7f726010da30 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:43.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.528+0000 7f726865e700 1 --2- 172.21.15.5:0/1752914305 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72600fe050 0x7f726010df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:43.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.528+0000 7f726865e700 1 -- 172.21.15.5:0/1752914305 >> 172.21.15.5:0/1752914305 conn(0x7f72600f8540 msgr2=0x7f72600f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:43.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.528+0000 7f726865e700 1 -- 172.21.15.5:0/1752914305 shutdown_connections 2024-04-16T14:34:43.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.528+0000 7f726865e700 1 -- 172.21.15.5:0/1752914305 wait complete. 2024-04-16T14:34:43.537 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-04-16T14:34:43.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.634+0000 7f58161d0700 1 -- 172.21.15.5:0/1330951486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58100fcff0 msgr2=0x7f58100fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:43.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.634+0000 7f58161d0700 1 --2- 172.21.15.5:0/1330951486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58100fcff0 0x7f58100fd460 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5804004940 tx=0x7f5804009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:43.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.634+0000 7f58161d0700 1 -- 172.21.15.5:0/1330951486 shutdown_connections 2024-04-16T14:34:43.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.634+0000 7f58161d0700 1 --2- 172.21.15.5:0/1330951486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58100fcff0 0x7f58100fd460 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:43.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.634+0000 7f58161d0700 1 --2- 172.21.15.5:0/1330951486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58100fbd40 0x7f58100fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:43.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.634+0000 7f58161d0700 1 -- 172.21.15.5:0/1330951486 >> 172.21.15.5:0/1330951486 conn(0x7f58100f74c0 msgr2=0x7f58100f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:43.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.634+0000 7f58161d0700 1 -- 172.21.15.5:0/1330951486 shutdown_connections 2024-04-16T14:34:43.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.634+0000 7f58161d0700 1 -- 172.21.15.5:0/1330951486 wait complete. 2024-04-16T14:34:43.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.634+0000 7f58161d0700 1 Processor -- start 2024-04-16T14:34:43.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.634+0000 7f58161d0700 1 -- start start 2024-04-16T14:34:43.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.635+0000 7f58161d0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58100fbd40 0x7f581010fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:43.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.635+0000 7f58161d0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58100fcff0 0x7f5810110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:43.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.635+0000 7f58161d0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5810110770 con 0x7f58100fcff0 2024-04-16T14:34:43.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.635+0000 7f58161d0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5810110fc0 con 0x7f58100fbd40 2024-04-16T14:34:43.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.635+0000 7f580effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58100fcff0 0x7f5810110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:43.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.635+0000 7f580effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58100fcff0 0x7f5810110170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47826/0 (socket says 172.21.15.5:47826) 2024-04-16T14:34:43.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.635+0000 7f580effd700 1 -- 172.21.15.5:0/1823074112 learned_addr learned my addr 172.21.15.5:0/1823074112 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:34:43.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.635+0000 7f580f7fe700 1 --2- 172.21.15.5:0/1823074112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58100fbd40 0x7f581010fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:43.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.635+0000 7f580effd700 1 -- 172.21.15.5:0/1823074112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58100fbd40 msgr2=0x7f581010fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:43.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.635+0000 7f580effd700 1 --2- 172.21.15.5:0/1823074112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58100fbd40 0x7f581010fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:43.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.635+0000 7f580effd700 1 -- 172.21.15.5:0/1823074112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5804005040 con 0x7f58100fcff0 2024-04-16T14:34:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.635+0000 7f580effd700 1 --2- 172.21.15.5:0/1823074112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58100fcff0 0x7f5810110170 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f580400b3b0 tx=0x7f5804009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.635+0000 7f57f7fff700 1 -- 172.21.15.5:0/1823074112 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f580400e040 con 0x7f58100fcff0 2024-04-16T14:34:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.635+0000 7f58161d0700 1 -- 172.21.15.5:0/1823074112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5810111240 con 0x7f58100fcff0 2024-04-16T14:34:43.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.635+0000 7f57f7fff700 1 -- 172.21.15.5:0/1823074112 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f580400bbf0 con 0x7f58100fcff0 2024-04-16T14:34:43.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.635+0000 7f57f7fff700 1 -- 172.21.15.5:0/1823074112 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f580401c630 con 0x7f58100fcff0 2024-04-16T14:34:43.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.636+0000 7f58161d0700 1 -- 172.21.15.5:0/1823074112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5810111780 con 0x7f58100fcff0 2024-04-16T14:34:43.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.637+0000 7f58161d0700 1 -- 172.21.15.5:0/1823074112 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5810101980 con 0x7f58100fcff0 2024-04-16T14:34:43.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.637+0000 7f57f7fff700 1 -- 172.21.15.5:0/1823074112 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f5804013420 con 0x7f58100fcff0 2024-04-16T14:34:43.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.637+0000 7f57f7fff700 1 --2- 172.21.15.5:0/1823074112 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f57f80692a0 0x7f57f806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:43.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.637+0000 7f57f7fff700 1 -- 172.21.15.5:0/1823074112 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f5804087ec0 con 0x7f58100fcff0 2024-04-16T14:34:43.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.637+0000 7f580f7fe700 1 --2- 172.21.15.5:0/1823074112 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f57f80692a0 0x7f57f806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:43.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.638+0000 7f580f7fe700 1 --2- 172.21.15.5:0/1823074112 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f57f80692a0 0x7f57f806b750 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5800004f40 tx=0x7f580000b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:43.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.642+0000 7f57f7fff700 1 -- 172.21.15.5:0/1823074112 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5804057c30 con 0x7f58100fcff0 2024-04-16T14:34:43.644 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:43 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:34:43.644 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:43 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:34:43.644 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:43 smithi115 ceph-mon[37295]: pgmap v235: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:43.644 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:43 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:34:43.644 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:43 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:34:43.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.860+0000 7f58161d0700 1 -- 172.21.15.5:0/1823074112 --> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f58101119a0 con 0x7f57f80692a0 2024-04-16T14:34:43.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.861+0000 7f57f7fff700 1 -- 172.21.15.5:0/1823074112 <== mgr.14212 v2:172.21.15.5:6800/3841652776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f58101119a0 con 0x7f57f80692a0 2024-04-16T14:34:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.863+0000 7f58161d0700 1 -- 172.21.15.5:0/1823074112 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f57f80692a0 msgr2=0x7f57f806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.863+0000 7f58161d0700 1 --2- 172.21.15.5:0/1823074112 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f57f80692a0 0x7f57f806b750 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5800004f40 tx=0x7f580000b040 comp rx=0 tx=0).stop 2024-04-16T14:34:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.863+0000 7f58161d0700 1 -- 172.21.15.5:0/1823074112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58100fcff0 msgr2=0x7f5810110170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.863+0000 7f58161d0700 1 --2- 172.21.15.5:0/1823074112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58100fcff0 0x7f5810110170 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f580400b3b0 tx=0x7f5804009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.863+0000 7f58161d0700 1 -- 172.21.15.5:0/1823074112 shutdown_connections 2024-04-16T14:34:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.863+0000 7f58161d0700 1 --2- 172.21.15.5:0/1823074112 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f57f80692a0 0x7f57f806b750 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.863+0000 7f58161d0700 1 --2- 172.21.15.5:0/1823074112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58100fbd40 0x7f581010fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.863+0000 7f58161d0700 1 --2- 172.21.15.5:0/1823074112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58100fcff0 0x7f5810110170 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.863+0000 7f58161d0700 1 -- 172.21.15.5:0/1823074112 >> 172.21.15.5:0/1823074112 conn(0x7f58100f74c0 msgr2=0x7f5810065b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.864+0000 7f58161d0700 1 -- 172.21.15.5:0/1823074112 shutdown_connections 2024-04-16T14:34:43.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.864+0000 7f58161d0700 1 -- 172.21.15.5:0/1823074112 wait complete. 2024-04-16T14:34:43.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.971+0000 7fa250c1b700 1 -- 172.21.15.5:0/2731562744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa24c0fdc20 msgr2=0x7fa24c0fc030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:43.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.971+0000 7fa250c1b700 1 --2- 172.21.15.5:0/2731562744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa24c0fdc20 0x7fa24c0fc030 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa240004940 tx=0x7fa240009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:43.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.971+0000 7fa250c1b700 1 -- 172.21.15.5:0/2731562744 shutdown_connections 2024-04-16T14:34:43.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.971+0000 7fa250c1b700 1 --2- 172.21.15.5:0/2731562744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa24c0fdc20 0x7fa24c0fc030 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:43.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.971+0000 7fa250c1b700 1 --2- 172.21.15.5:0/2731562744 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa24c0fd2d0 0x7fa24c0fd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:43.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.971+0000 7fa250c1b700 1 -- 172.21.15.5:0/2731562744 >> 172.21.15.5:0/2731562744 conn(0x7fa24c0f6bd0 msgr2=0x7fa24c0f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:43.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.971+0000 7fa250c1b700 1 -- 172.21.15.5:0/2731562744 shutdown_connections 2024-04-16T14:34:43.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.971+0000 7fa250c1b700 1 -- 172.21.15.5:0/2731562744 wait complete. 2024-04-16T14:34:43.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.971+0000 7fa250c1b700 1 Processor -- start 2024-04-16T14:34:43.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.971+0000 7fa250c1b700 1 -- start start 2024-04-16T14:34:43.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.972+0000 7fa250c1b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa24c0fd2d0 0x7fa24c1106d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:43.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.972+0000 7fa250c1b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa24c0fdc20 0x7fa24c112c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:43.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.972+0000 7fa250c1b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c0fbc70 con 0x7fa24c0fd2d0 2024-04-16T14:34:43.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.972+0000 7fa250c1b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c0fbdb0 con 0x7fa24c0fdc20 2024-04-16T14:34:43.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.972+0000 7fa24a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa24c0fd2d0 0x7fa24c1106d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:43.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.972+0000 7fa24a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa24c0fd2d0 0x7fa24c1106d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47838/0 (socket says 172.21.15.5:47838) 2024-04-16T14:34:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.972+0000 7fa24a59c700 1 -- 172.21.15.5:0/1312567872 learned_addr learned my addr 172.21.15.5:0/1312567872 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:34:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.972+0000 7fa249d9b700 1 --2- 172.21.15.5:0/1312567872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa24c0fdc20 0x7fa24c112c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.972+0000 7fa24a59c700 1 -- 172.21.15.5:0/1312567872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa24c0fdc20 msgr2=0x7fa24c112c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.972+0000 7fa24a59c700 1 --2- 172.21.15.5:0/1312567872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa24c0fdc20 0x7fa24c112c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.972+0000 7fa24a59c700 1 -- 172.21.15.5:0/1312567872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa240005040 con 0x7fa24c0fd2d0 2024-04-16T14:34:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.972+0000 7fa249d9b700 1 --2- 172.21.15.5:0/1312567872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa24c0fdc20 0x7fa24c112c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T14:34:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.972+0000 7fa24a59c700 1 --2- 172.21.15.5:0/1312567872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa24c0fd2d0 0x7fa24c1106d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa23c00eb40 tx=0x7fa23c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.972+0000 7fa23affd700 1 -- 172.21.15.5:0/1312567872 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa23c007cc0 con 0x7fa24c0fd2d0 2024-04-16T14:34:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.973+0000 7fa23affd700 1 -- 172.21.15.5:0/1312567872 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa23c00f040 con 0x7fa24c0fd2d0 2024-04-16T14:34:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.973+0000 7fa250c1b700 1 -- 172.21.15.5:0/1312567872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa24c113160 con 0x7fa24c0fd2d0 2024-04-16T14:34:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.973+0000 7fa23affd700 1 -- 172.21.15.5:0/1312567872 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa23c00ca10 con 0x7fa24c0fd2d0 2024-04-16T14:34:43.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.973+0000 7fa250c1b700 1 -- 172.21.15.5:0/1312567872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24c1136a0 con 0x7fa24c0fd2d0 2024-04-16T14:34:43.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.974+0000 7fa250c1b700 1 -- 172.21.15.5:0/1312567872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24c05f5f0 con 0x7fa24c0fd2d0 2024-04-16T14:34:43.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.975+0000 7fa23affd700 1 -- 172.21.15.5:0/1312567872 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7fa23c00cc80 con 0x7fa24c0fd2d0 2024-04-16T14:34:43.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.975+0000 7fa23affd700 1 --2- 172.21.15.5:0/1312567872 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa2340692a0 0x7fa23406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:43.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.975+0000 7fa23affd700 1 -- 172.21.15.5:0/1312567872 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa23c087020 con 0x7fa24c0fd2d0 2024-04-16T14:34:43.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.975+0000 7fa249d9b700 1 --2- 172.21.15.5:0/1312567872 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa2340692a0 0x7fa23406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:43.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.976+0000 7fa249d9b700 1 --2- 172.21.15.5:0/1312567872 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa2340692a0 0x7fa23406b750 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa240004890 tx=0x7fa240009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:43.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:43.979+0000 7fa23affd700 1 -- 172.21.15.5:0/1312567872 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa23c0533b0 con 0x7fa24c0fd2d0 2024-04-16T14:34:44.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.185+0000 7fa250c1b700 1 -- 172.21.15.5:0/1312567872 --> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa24c101310 con 0x7fa2340692a0 2024-04-16T14:34:44.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.197+0000 7fa23affd700 1 -- 172.21.15.5:0/1312567872 <== mgr.14212 v2:172.21.15.5:6800/3841652776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7fa24c101310 con 0x7fa2340692a0 2024-04-16T14:34:44.196 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-16T14:34:44.196 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.smithi005 smithi005 *:9093,9094 running (5m) 89s ago 7m 25.5M - 0.25.0 c8568f914cd2 0f1dad05c95e 2024-04-16T14:34:44.196 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi005 smithi005 running (7m) 89s ago 7m 6669k - 17.2.7-868-g412a5526 b04d96489b7c 6a380d6ec070 2024-04-16T14:34:44.196 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi115 smithi115 running (6m) 1s ago 6m 6665k - 17.2.7-868-g412a5526 b04d96489b7c df7cb0bfe65b 2024-04-16T14:34:44.196 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.smithi005 smithi005 *:3000 running (5m) 89s ago 7m 88.7M - 9.4.7 954c08fa6188 e6011313e3be 2024-04-16T14:34:44.196 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.vzoqdl smithi005 running (114s) 89s ago 113s 10.4M - 17.2.7-868-g412a5526 b04d96489b7c 84a74a406a1d 2024-04-16T14:34:44.196 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.wofqlz smithi005 running (108s) 89s ago 108s 14.1M - 17.2.7-868-g412a5526 b04d96489b7c d0e053ab2f72 2024-04-16T14:34:44.196 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.byfytg smithi115 running (111s) 1s ago 111s 17.9M - 17.2.7-868-g412a5526 b04d96489b7c 595cd0892f66 2024-04-16T14:34:44.196 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.trkaqh smithi115 running (105s) 1s ago 105s 11.5M - 17.2.7-868-g412a5526 b04d96489b7c 5b60cd2ad79b 2024-04-16T14:34:44.196 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi005.ipwdkc smithi005 *:9283 running (8m) 89s ago 8m 481M - 17.2.7-868-g412a5526 b04d96489b7c 53fb89eec045 2024-04-16T14:34:44.197 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi115.brjkpo smithi115 *:8443,9283 running (5s) 1s ago 6m 47.0M - 19.0.0-2204-g36befe5d b1a78730e0db 5f0019fe08af 2024-04-16T14:34:44.197 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi005 smithi005 running (8m) 89s ago 8m 46.5M 2048M 17.2.7-868-g412a5526 b04d96489b7c 764b6a128874 2024-04-16T14:34:44.197 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi115 smithi115 running (6m) 1s ago 6m 34.7M 2048M 17.2.7-868-g412a5526 b04d96489b7c feb5354cdbe9 2024-04-16T14:34:44.197 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi005 smithi005 *:9100 running (7m) 89s ago 7m 14.1M - 1.5.0 0da6a335fe13 16f9701011ea 2024-04-16T14:34:44.197 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi115 smithi115 *:9100 running (6m) 1s ago 6m 16.1M - 1.5.0 0da6a335fe13 38c140c04a1e 2024-04-16T14:34:44.197 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (5m) 89s ago 5m 48.1M 4289M 17.2.7-868-g412a5526 b04d96489b7c ed7aa0542d96 2024-04-16T14:34:44.197 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (5m) 89s ago 5m 49.3M 4289M 17.2.7-868-g412a5526 b04d96489b7c 1868cc6c89f4 2024-04-16T14:34:44.197 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (4m) 89s ago 4m 44.9M 4289M 17.2.7-868-g412a5526 b04d96489b7c b12745ae7d18 2024-04-16T14:34:44.197 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi115 running (4m) 1s ago 4m 45.7M 5312M 17.2.7-868-g412a5526 b04d96489b7c 59f81301ebcf 2024-04-16T14:34:44.197 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi115 running (3m) 1s ago 3m 42.3M 5312M 17.2.7-868-g412a5526 b04d96489b7c e3ea96b7edd9 2024-04-16T14:34:44.198 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi115 running (3m) 1s ago 3m 46.4M 5312M 17.2.7-868-g412a5526 b04d96489b7c 456fa074e453 2024-04-16T14:34:44.198 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.smithi005 smithi005 *:9095 running (5m) 89s ago 6m 54.3M - 2.43.0 a07b618ecd1d 813f7bfd1439 2024-04-16T14:34:44.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.200+0000 7fa250c1b700 1 -- 172.21.15.5:0/1312567872 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa2340692a0 msgr2=0x7fa23406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:44.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.200+0000 7fa250c1b700 1 --2- 172.21.15.5:0/1312567872 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa2340692a0 0x7fa23406b750 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa240004890 tx=0x7fa240009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:44.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.200+0000 7fa250c1b700 1 -- 172.21.15.5:0/1312567872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa24c0fd2d0 msgr2=0x7fa24c1106d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:44.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.200+0000 7fa250c1b700 1 --2- 172.21.15.5:0/1312567872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa24c0fd2d0 0x7fa24c1106d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa23c00eb40 tx=0x7fa23c00b040 comp rx=0 tx=0).stop 2024-04-16T14:34:44.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.200+0000 7fa250c1b700 1 -- 172.21.15.5:0/1312567872 shutdown_connections 2024-04-16T14:34:44.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.200+0000 7fa250c1b700 1 --2- 172.21.15.5:0/1312567872 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fa2340692a0 0x7fa23406b750 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:44.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.200+0000 7fa250c1b700 1 --2- 172.21.15.5:0/1312567872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa24c0fd2d0 0x7fa24c1106d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:44.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.200+0000 7fa250c1b700 1 --2- 172.21.15.5:0/1312567872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa24c0fdc20 0x7fa24c112c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:44.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.200+0000 7fa250c1b700 1 -- 172.21.15.5:0/1312567872 >> 172.21.15.5:0/1312567872 conn(0x7fa24c0f6bd0 msgr2=0x7fa24c0f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:44.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.200+0000 7fa250c1b700 1 -- 172.21.15.5:0/1312567872 shutdown_connections 2024-04-16T14:34:44.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.200+0000 7fa250c1b700 1 -- 172.21.15.5:0/1312567872 wait complete. 2024-04-16T14:34:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.307+0000 7fe743301700 1 -- 172.21.15.5:0/558126652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe73c0fcff0 msgr2=0x7fe73c0fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:44.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.307+0000 7fe743301700 1 --2- 172.21.15.5:0/558126652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe73c0fcff0 0x7fe73c0fd460 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe72c004940 tx=0x7fe72c009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.307+0000 7fe743301700 1 -- 172.21.15.5:0/558126652 shutdown_connections 2024-04-16T14:34:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.307+0000 7fe743301700 1 --2- 172.21.15.5:0/558126652 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe73c0fcff0 0x7fe73c0fd460 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.307+0000 7fe743301700 1 --2- 172.21.15.5:0/558126652 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe73c0fbd40 0x7fe73c0fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.307+0000 7fe743301700 1 -- 172.21.15.5:0/558126652 >> 172.21.15.5:0/558126652 conn(0x7fe73c0f74c0 msgr2=0x7fe73c0f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.307+0000 7fe743301700 1 -- 172.21.15.5:0/558126652 shutdown_connections 2024-04-16T14:34:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.307+0000 7fe743301700 1 -- 172.21.15.5:0/558126652 wait complete. 2024-04-16T14:34:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.308+0000 7fe743301700 1 Processor -- start 2024-04-16T14:34:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.308+0000 7fe743301700 1 -- start start 2024-04-16T14:34:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.308+0000 7fe743301700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe73c0fbd40 0x7fe73c1106e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.308+0000 7fe743301700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe73c0fcff0 0x7fe73c112c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.308+0000 7fe743301700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c066330 con 0x7fe73c0fcff0 2024-04-16T14:34:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.308+0000 7fe743301700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c066470 con 0x7fe73c0fbd40 2024-04-16T14:34:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.308+0000 7fe74089c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe73c0fcff0 0x7fe73c112c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.308+0000 7fe74089c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe73c0fcff0 0x7fe73c112c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47850/0 (socket says 172.21.15.5:47850) 2024-04-16T14:34:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.308+0000 7fe74109d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe73c0fbd40 0x7fe73c1106e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.308+0000 7fe74089c700 1 -- 172.21.15.5:0/2430136905 learned_addr learned my addr 172.21.15.5:0/2430136905 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:34:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.308+0000 7fe74089c700 1 -- 172.21.15.5:0/2430136905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe73c0fbd40 msgr2=0x7fe73c1106e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.308+0000 7fe74089c700 1 --2- 172.21.15.5:0/2430136905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe73c0fbd40 0x7fe73c1106e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.308+0000 7fe74089c700 1 -- 172.21.15.5:0/2430136905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72c005040 con 0x7fe73c0fcff0 2024-04-16T14:34:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.309+0000 7fe74089c700 1 --2- 172.21.15.5:0/2430136905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe73c0fcff0 0x7fe73c112c30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00b3b0 tx=0x7fe72c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.309+0000 7fe731ffb700 1 -- 172.21.15.5:0/2430136905 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe72c00e040 con 0x7fe73c0fcff0 2024-04-16T14:34:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.309+0000 7fe743301700 1 -- 172.21.15.5:0/2430136905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe73c113170 con 0x7fe73c0fcff0 2024-04-16T14:34:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.309+0000 7fe731ffb700 1 -- 172.21.15.5:0/2430136905 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe72c004290 con 0x7fe73c0fcff0 2024-04-16T14:34:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.309+0000 7fe731ffb700 1 -- 172.21.15.5:0/2430136905 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe72c01c3f0 con 0x7fe73c0fcff0 2024-04-16T14:34:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.309+0000 7fe743301700 1 -- 172.21.15.5:0/2430136905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe73c113700 con 0x7fe73c0fcff0 2024-04-16T14:34:44.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.310+0000 7fe743301700 1 -- 172.21.15.5:0/2430136905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe73c05f5f0 con 0x7fe73c0fcff0 2024-04-16T14:34:44.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.311+0000 7fe731ffb700 1 -- 172.21.15.5:0/2430136905 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7fe72c00bbf0 con 0x7fe73c0fcff0 2024-04-16T14:34:44.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.311+0000 7fe731ffb700 1 --2- 172.21.15.5:0/2430136905 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe7280692b0 0x7fe72806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:44.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.311+0000 7fe731ffb700 1 -- 172.21.15.5:0/2430136905 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe72c088450 con 0x7fe73c0fcff0 2024-04-16T14:34:44.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.311+0000 7fe74109d700 1 --2- 172.21.15.5:0/2430136905 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe7280692b0 0x7fe72806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.312+0000 7fe74109d700 1 --2- 172.21.15.5:0/2430136905 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe7280692b0 0x7fe72806b760 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe73c065fb0 tx=0x7fe73800b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:44.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.316+0000 7fe731ffb700 1 -- 172.21.15.5:0/2430136905 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe72c0547d0 con 0x7fe73c0fcff0 2024-04-16T14:34:44.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:44 smithi005 ceph-mon[28964]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:34:44.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:44 smithi005 ceph-mon[28964]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:34:44.484 INFO:tasks.workunit.client.0.smithi005.stderr:Updating files: 90% (11160/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-16T14:34:44.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.613+0000 7fe743301700 1 -- 172.21.15.5:0/2430136905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe73c04bed0 con 0x7fe73c0fcff0 2024-04-16T14:34:44.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.614+0000 7fe731ffb700 1 -- 172.21.15.5:0/2430136905 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7fe72c057df0 con 0x7fe73c0fcff0 2024-04-16T14:34:44.612 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:34:44.612 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-04-16T14:34:44.612 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 2 2024-04-16T14:34:44.612 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:34:44.613 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-04-16T14:34:44.613 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 2 2024-04-16T14:34:44.613 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:34:44.613 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-04-16T14:34:44.613 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 6 2024-04-16T14:34:44.613 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:34:44.613 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-04-16T14:34:44.613 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 4 2024-04-16T14:34:44.613 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:34:44.613 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-04-16T14:34:44.613 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 14 2024-04-16T14:34:44.613 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-16T14:34:44.613 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:34:44.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.616+0000 7fe743301700 1 -- 172.21.15.5:0/2430136905 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe7280692b0 msgr2=0x7fe72806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:44.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.616+0000 7fe743301700 1 --2- 172.21.15.5:0/2430136905 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe7280692b0 0x7fe72806b760 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe73c065fb0 tx=0x7fe73800b040 comp rx=0 tx=0).stop 2024-04-16T14:34:44.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.616+0000 7fe743301700 1 -- 172.21.15.5:0/2430136905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe73c0fcff0 msgr2=0x7fe73c112c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:44.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.616+0000 7fe743301700 1 --2- 172.21.15.5:0/2430136905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe73c0fcff0 0x7fe73c112c30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00b3b0 tx=0x7fe72c009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:44.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.616+0000 7fe743301700 1 -- 172.21.15.5:0/2430136905 shutdown_connections 2024-04-16T14:34:44.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.616+0000 7fe743301700 1 --2- 172.21.15.5:0/2430136905 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fe7280692b0 0x7fe72806b760 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:44.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.616+0000 7fe743301700 1 --2- 172.21.15.5:0/2430136905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe73c0fbd40 0x7fe73c1106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:44.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.616+0000 7fe743301700 1 --2- 172.21.15.5:0/2430136905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe73c0fcff0 0x7fe73c112c30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:44.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.616+0000 7fe743301700 1 -- 172.21.15.5:0/2430136905 >> 172.21.15.5:0/2430136905 conn(0x7fe73c0f74c0 msgr2=0x7fe73c0f8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:44.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.616+0000 7fe743301700 1 -- 172.21.15.5:0/2430136905 shutdown_connections 2024-04-16T14:34:44.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.616+0000 7fe743301700 1 -- 172.21.15.5:0/2430136905 wait complete. 2024-04-16T14:34:44.663 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:44 smithi115 ceph-mon[37295]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:34:44.663 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:44 smithi115 ceph-mon[37295]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:34:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.720+0000 7f36ac9b6700 1 -- 172.21.15.5:0/717421662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36a80fe050 msgr2=0x7f36a80fe4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.720+0000 7f36ac9b6700 1 --2- 172.21.15.5:0/717421662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36a80fe050 0x7f36a80fe4c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f369c004940 tx=0x7f369c009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.720+0000 7f36ac9b6700 1 -- 172.21.15.5:0/717421662 shutdown_connections 2024-04-16T14:34:44.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.720+0000 7f36ac9b6700 1 --2- 172.21.15.5:0/717421662 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36a80fe050 0x7f36a80fe4c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.720+0000 7f36ac9b6700 1 --2- 172.21.15.5:0/717421662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36a80fce50 0x7f36a80fd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.720+0000 7f36ac9b6700 1 -- 172.21.15.5:0/717421662 >> 172.21.15.5:0/717421662 conn(0x7f36a80f8580 msgr2=0x7f36a80fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.720+0000 7f36ac9b6700 1 -- 172.21.15.5:0/717421662 shutdown_connections 2024-04-16T14:34:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.720+0000 7f36ac9b6700 1 -- 172.21.15.5:0/717421662 wait complete. 2024-04-16T14:34:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.721+0000 7f36ac9b6700 1 Processor -- start 2024-04-16T14:34:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.721+0000 7f36ac9b6700 1 -- start start 2024-04-16T14:34:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.721+0000 7f36ac9b6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36a80fce50 0x7f36a810d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.721+0000 7f36ac9b6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36a80fe050 0x7f36a810df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.721+0000 7f36ac9b6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a810e520 con 0x7f36a80fce50 2024-04-16T14:34:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.721+0000 7f36ac9b6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a810ed70 con 0x7f36a80fe050 2024-04-16T14:34:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.721+0000 7f36a659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36a80fce50 0x7f36a810d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:44.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.721+0000 7f36a659c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36a80fce50 0x7f36a810d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47868/0 (socket says 172.21.15.5:47868) 2024-04-16T14:34:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.721+0000 7f36a659c700 1 -- 172.21.15.5:0/3240881407 learned_addr learned my addr 172.21.15.5:0/3240881407 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:34:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.721+0000 7f36a5d9b700 1 --2- 172.21.15.5:0/3240881407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36a80fe050 0x7f36a810df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.721+0000 7f36a659c700 1 -- 172.21.15.5:0/3240881407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36a80fe050 msgr2=0x7f36a810df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.721+0000 7f36a659c700 1 --2- 172.21.15.5:0/3240881407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36a80fe050 0x7f36a810df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.721+0000 7f36a659c700 1 -- 172.21.15.5:0/3240881407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c005040 con 0x7f36a80fce50 2024-04-16T14:34:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.721+0000 7f36a659c700 1 --2- 172.21.15.5:0/3240881407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36a80fce50 0x7f36a810d9e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3698002a80 tx=0x7f36980046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.722+0000 7f3696ffd700 1 -- 172.21.15.5:0/3240881407 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3698007cc0 con 0x7f36a80fce50 2024-04-16T14:34:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.722+0000 7f3696ffd700 1 -- 172.21.15.5:0/3240881407 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f369800f040 con 0x7f36a80fce50 2024-04-16T14:34:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.722+0000 7f3696ffd700 1 -- 172.21.15.5:0/3240881407 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f369800db30 con 0x7f36a80fce50 2024-04-16T14:34:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.722+0000 7f36ac9b6700 1 -- 172.21.15.5:0/3240881407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a810f050 con 0x7f36a80fce50 2024-04-16T14:34:44.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.722+0000 7f36ac9b6700 1 -- 172.21.15.5:0/3240881407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a810f590 con 0x7f36a80fce50 2024-04-16T14:34:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.723+0000 7f36ac9b6700 1 -- 172.21.15.5:0/3240881407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a805f5f0 con 0x7f36a80fce50 2024-04-16T14:34:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.723+0000 7f3696ffd700 1 -- 172.21.15.5:0/3240881407 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f369800dc90 con 0x7f36a80fce50 2024-04-16T14:34:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.723+0000 7f3696ffd700 1 --2- 172.21.15.5:0/3240881407 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f36900692a0 0x7f369006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.724+0000 7f3696ffd700 1 -- 172.21.15.5:0/3240881407 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f36980868e0 con 0x7f36a80fce50 2024-04-16T14:34:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.724+0000 7f36a5d9b700 1 --2- 172.21.15.5:0/3240881407 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f36900692a0 0x7f369006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:44.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.724+0000 7f36a5d9b700 1 --2- 172.21.15.5:0/3240881407 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f36900692a0 0x7f369006b750 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f369c00b3b0 tx=0x7f369c009e30 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:44.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.728+0000 7f3696ffd700 1 -- 172.21.15.5:0/3240881407 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f369804d250 con 0x7f36a80fce50 2024-04-16T14:34:44.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.985+0000 7f36ac9b6700 1 -- 172.21.15.5:0/3240881407 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f36a810f900 con 0x7f36a80fce50 2024-04-16T14:34:44.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.985+0000 7f3696ffd700 1 -- 172.21.15.5:0/3240881407 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1812 (secure 0 0 0) 0x7f3698056650 con 0x7f36a80fce50 2024-04-16T14:34:44.984 INFO:teuthology.orchestra.run.smithi005.stdout:e18 2024-04-16T14:34:44.984 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:34:44.984 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:34:44.984 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2024-04-16T14:34:44.984 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:34:44.984 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2024-04-16T14:34:44.984 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2024-04-16T14:34:44.984 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 18 2024-04-16T14:34:44.984 INFO:teuthology.orchestra.run.smithi005.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-16T14:34:44.984 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-16T14:32:45.270024+0000 2024-04-16T14:34:44.984 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-04-16T14:33:04.825498+0000 2024-04-16T14:34:44.985 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2024-04-16T14:34:44.985 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2024-04-16T14:34:44.985 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 60 2024-04-16T14:34:44.985 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2024-04-16T14:34:44.985 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2024-04-16T14:34:44.985 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2024-04-16T14:34:44.985 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2024-04-16T14:34:44.985 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 47 2024-04-16T14:34:44.985 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:34:44.985 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 2 2024-04-16T14:34:44.985 INFO:teuthology.orchestra.run.smithi005.stdout:in 0,1 2024-04-16T14:34:44.985 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=14484,1=24269} 2024-04-16T14:34:44.985 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2024-04-16T14:34:44.985 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2024-04-16T14:34:44.985 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 2024-04-16T14:34:44.986 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3] 2024-04-16T14:34:44.986 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2024-04-16T14:34:44.986 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2024-04-16T14:34:44.986 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2024-04-16T14:34:44.986 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 1 2024-04-16T14:34:44.986 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.wofqlz{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:34:44.986 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.byfytg{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.115:6824/1662994117,v1:172.21.15.115:6825/1662994117] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:34:44.986 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:34:44.986 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:34:44.986 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2024-04-16T14:34:44.986 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:34:44.986 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.vzoqdl{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.5:6826/187766809,v1:172.21.15.5:6827/187766809] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:34:44.986 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.trkaqh{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:34:44.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.987+0000 7f36ac9b6700 1 -- 172.21.15.5:0/3240881407 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f36900692a0 msgr2=0x7f369006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:44.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.987+0000 7f36ac9b6700 1 --2- 172.21.15.5:0/3240881407 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f36900692a0 0x7f369006b750 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f369c00b3b0 tx=0x7f369c009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:44.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.987+0000 7f36ac9b6700 1 -- 172.21.15.5:0/3240881407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36a80fce50 msgr2=0x7f36a810d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:44.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.987+0000 7f36ac9b6700 1 --2- 172.21.15.5:0/3240881407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36a80fce50 0x7f36a810d9e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3698002a80 tx=0x7f36980046b0 comp rx=0 tx=0).stop 2024-04-16T14:34:44.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.988+0000 7f36ac9b6700 1 -- 172.21.15.5:0/3240881407 shutdown_connections 2024-04-16T14:34:44.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.988+0000 7f36ac9b6700 1 --2- 172.21.15.5:0/3240881407 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f36900692a0 0x7f369006b750 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:44.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.988+0000 7f36ac9b6700 1 --2- 172.21.15.5:0/3240881407 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f36a80fce50 0x7f36a810d9e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:44.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.988+0000 7f36ac9b6700 1 --2- 172.21.15.5:0/3240881407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36a80fe050 0x7f36a810df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:44.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.988+0000 7f36ac9b6700 1 -- 172.21.15.5:0/3240881407 >> 172.21.15.5:0/3240881407 conn(0x7f36a80f8580 msgr2=0x7f36a80f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:44.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.988+0000 7f36ac9b6700 1 -- 172.21.15.5:0/3240881407 shutdown_connections 2024-04-16T14:34:44.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:44.988+0000 7f36ac9b6700 1 -- 172.21.15.5:0/3240881407 wait complete. 2024-04-16T14:34:44.988 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 18 2024-04-16T14:34:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.095+0000 7fd9d10a1700 1 -- 172.21.15.5:0/2325856180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9cc0fcfa0 msgr2=0x7fd9cc0fd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.095+0000 7fd9d10a1700 1 --2- 172.21.15.5:0/2325856180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9cc0fcfa0 0x7fd9cc0fd410 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4004940 tx=0x7fd9b4009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.095+0000 7fd9d10a1700 1 -- 172.21.15.5:0/2325856180 shutdown_connections 2024-04-16T14:34:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.095+0000 7fd9d10a1700 1 --2- 172.21.15.5:0/2325856180 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9cc0fcfa0 0x7fd9cc0fd410 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.095+0000 7fd9d10a1700 1 --2- 172.21.15.5:0/2325856180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9cc0fbcf0 0x7fd9cc0fc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.095+0000 7fd9d10a1700 1 -- 172.21.15.5:0/2325856180 >> 172.21.15.5:0/2325856180 conn(0x7fd9cc0f7450 msgr2=0x7fd9cc0f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.095+0000 7fd9d10a1700 1 -- 172.21.15.5:0/2325856180 shutdown_connections 2024-04-16T14:34:45.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.095+0000 7fd9d10a1700 1 -- 172.21.15.5:0/2325856180 wait complete. 2024-04-16T14:34:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.096+0000 7fd9d10a1700 1 Processor -- start 2024-04-16T14:34:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.096+0000 7fd9d10a1700 1 -- start start 2024-04-16T14:34:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.096+0000 7fd9d10a1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9cc0fbcf0 0x7fd9cc10fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.096+0000 7fd9d10a1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9cc0fcfa0 0x7fd9cc110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.096+0000 7fd9d10a1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc110790 con 0x7fd9cc0fcfa0 2024-04-16T14:34:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.096+0000 7fd9d10a1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc110f90 con 0x7fd9cc0fbcf0 2024-04-16T14:34:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.096+0000 7fd9ca59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9cc0fcfa0 0x7fd9cc110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.096+0000 7fd9ca59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9cc0fcfa0 0x7fd9cc110190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47892/0 (socket says 172.21.15.5:47892) 2024-04-16T14:34:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.096+0000 7fd9cad9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9cc0fbcf0 0x7fd9cc10fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.097+0000 7fd9ca59c700 1 -- 172.21.15.5:0/2102326238 learned_addr learned my addr 172.21.15.5:0/2102326238 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:34:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.097+0000 7fd9ca59c700 1 -- 172.21.15.5:0/2102326238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9cc0fbcf0 msgr2=0x7fd9cc10fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.097+0000 7fd9ca59c700 1 --2- 172.21.15.5:0/2102326238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9cc0fbcf0 0x7fd9cc10fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.097+0000 7fd9ca59c700 1 -- 172.21.15.5:0/2102326238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b4005040 con 0x7fd9cc0fcfa0 2024-04-16T14:34:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.097+0000 7fd9ca59c700 1 --2- 172.21.15.5:0/2102326238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9cc0fcfa0 0x7fd9cc110190 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4009150 tx=0x7fd9b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.097+0000 7fd9c37fe700 1 -- 172.21.15.5:0/2102326238 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9b400e040 con 0x7fd9cc0fcfa0 2024-04-16T14:34:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.097+0000 7fd9c37fe700 1 -- 172.21.15.5:0/2102326238 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd9b4004290 con 0x7fd9cc0fcfa0 2024-04-16T14:34:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.097+0000 7fd9d10a1700 1 -- 172.21.15.5:0/2102326238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9cc111210 con 0x7fd9cc0fcfa0 2024-04-16T14:34:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.097+0000 7fd9c37fe700 1 -- 172.21.15.5:0/2102326238 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9b401c630 con 0x7fd9cc0fcfa0 2024-04-16T14:34:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.097+0000 7fd9d10a1700 1 -- 172.21.15.5:0/2102326238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9cc111750 con 0x7fd9cc0fcfa0 2024-04-16T14:34:45.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.098+0000 7fd9d10a1700 1 -- 172.21.15.5:0/2102326238 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9cc101930 con 0x7fd9cc0fcfa0 2024-04-16T14:34:45.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.099+0000 7fd9c37fe700 1 -- 172.21.15.5:0/2102326238 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7fd9b4013420 con 0x7fd9cc0fcfa0 2024-04-16T14:34:45.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.099+0000 7fd9c37fe700 1 --2- 172.21.15.5:0/2102326238 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd9b80692a0 0x7fd9b806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:45.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.099+0000 7fd9c37fe700 1 -- 172.21.15.5:0/2102326238 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd9b4087f30 con 0x7fd9cc0fcfa0 2024-04-16T14:34:45.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.099+0000 7fd9cad9d700 1 --2- 172.21.15.5:0/2102326238 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd9b80692a0 0x7fd9b806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:45.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.100+0000 7fd9cad9d700 1 --2- 172.21.15.5:0/2102326238 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd9b80692a0 0x7fd9b806b750 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc007b20 tx=0x7fd9bc009e20 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:45.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.104+0000 7fd9c37fe700 1 -- 172.21.15.5:0/2102326238 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd9b40ba250 con 0x7fd9cc0fcfa0 2024-04-16T14:34:45.106 INFO:tasks.workunit.client.0.smithi005.stderr:Note: switching to '36befe5d41ee8a6ea2e60983e763134278d506cf'. 2024-04-16T14:34:45.106 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-04-16T14:34:45.106 INFO:tasks.workunit.client.0.smithi005.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-16T14:34:45.106 INFO:tasks.workunit.client.0.smithi005.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-16T14:34:45.106 INFO:tasks.workunit.client.0.smithi005.stderr:state without impacting any branches by switching back to a branch. 2024-04-16T14:34:45.107 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-04-16T14:34:45.107 INFO:tasks.workunit.client.0.smithi005.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-16T14:34:45.107 INFO:tasks.workunit.client.0.smithi005.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-16T14:34:45.107 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-04-16T14:34:45.107 INFO:tasks.workunit.client.0.smithi005.stderr: git switch -c 2024-04-16T14:34:45.107 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-04-16T14:34:45.107 INFO:tasks.workunit.client.0.smithi005.stderr:Or undo this operation with: 2024-04-16T14:34:45.107 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-04-16T14:34:45.107 INFO:tasks.workunit.client.0.smithi005.stderr: git switch - 2024-04-16T14:34:45.107 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-04-16T14:34:45.107 INFO:tasks.workunit.client.0.smithi005.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-16T14:34:45.107 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-04-16T14:34:45.107 INFO:tasks.workunit.client.0.smithi005.stderr:HEAD is now at 36befe5d41e Merge branch 'wip-65417-squid' of https://github.com/adk3798/ceph into wip-adk2-testing-2024-04-15-1136-squid 2024-04-16T14:34:45.113 DEBUG:teuthology.orchestra.run.smithi005:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-16T14:34:45.175 INFO:tasks.workunit.client.0.smithi005.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-16T14:34:45.177 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-16T14:34:45.177 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-16T14:34:45.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.318+0000 7fd9d10a1700 1 -- 172.21.15.5:0/2102326238 --> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9cc1048f0 con 0x7fd9b80692a0 2024-04-16T14:34:45.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.319+0000 7fd9c37fe700 1 -- 172.21.15.5:0/2102326238 <== mgr.14212 v2:172.21.15.5:6800/3841652776 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fd9cc1048f0 con 0x7fd9b80692a0 2024-04-16T14:34:45.317 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:34:45.317 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91", 2024-04-16T14:34:45.318 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-04-16T14:34:45.318 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-16T14:34:45.318 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [], 2024-04-16T14:34:45.318 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "1/21 daemons upgraded", 2024-04-16T14:34:45.318 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading mgr daemons", 2024-04-16T14:34:45.318 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-04-16T14:34:45.318 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:34:45.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.321+0000 7fd9d10a1700 1 -- 172.21.15.5:0/2102326238 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd9b80692a0 msgr2=0x7fd9b806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:45.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.321+0000 7fd9d10a1700 1 --2- 172.21.15.5:0/2102326238 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd9b80692a0 0x7fd9b806b750 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc007b20 tx=0x7fd9bc009e20 comp rx=0 tx=0).stop 2024-04-16T14:34:45.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.321+0000 7fd9d10a1700 1 -- 172.21.15.5:0/2102326238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9cc0fcfa0 msgr2=0x7fd9cc110190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:45.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.321+0000 7fd9d10a1700 1 --2- 172.21.15.5:0/2102326238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9cc0fcfa0 0x7fd9cc110190 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4009150 tx=0x7fd9b4009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:45.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.321+0000 7fd9d10a1700 1 -- 172.21.15.5:0/2102326238 shutdown_connections 2024-04-16T14:34:45.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.321+0000 7fd9d10a1700 1 --2- 172.21.15.5:0/2102326238 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7fd9b80692a0 0x7fd9b806b750 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:45.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.321+0000 7fd9d10a1700 1 --2- 172.21.15.5:0/2102326238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9cc0fbcf0 0x7fd9cc10fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:45.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.321+0000 7fd9d10a1700 1 --2- 172.21.15.5:0/2102326238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9cc0fcfa0 0x7fd9cc110190 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:45.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.321+0000 7fd9d10a1700 1 -- 172.21.15.5:0/2102326238 >> 172.21.15.5:0/2102326238 conn(0x7fd9cc0f7450 msgr2=0x7fd9cc066410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:45.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.321+0000 7fd9d10a1700 1 -- 172.21.15.5:0/2102326238 shutdown_connections 2024-04-16T14:34:45.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.321+0000 7fd9d10a1700 1 -- 172.21.15.5:0/2102326238 wait complete. 2024-04-16T14:34:45.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.427+0000 7f25c8899700 1 -- 172.21.15.5:0/2895854947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25c4066ec0 msgr2=0x7f25c40ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:45.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.427+0000 7f25c8899700 1 --2- 172.21.15.5:0/2895854947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25c4066ec0 0x7f25c40ffa30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f25b4004940 tx=0x7f25b4009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:45.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.427+0000 7f25c8899700 1 -- 172.21.15.5:0/2895854947 shutdown_connections 2024-04-16T14:34:45.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.427+0000 7f25c8899700 1 --2- 172.21.15.5:0/2895854947 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c40fff70 0x7f25c4102350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:45.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.427+0000 7f25c8899700 1 --2- 172.21.15.5:0/2895854947 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25c4066ec0 0x7f25c40ffa30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:45.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.427+0000 7f25c8899700 1 -- 172.21.15.5:0/2895854947 >> 172.21.15.5:0/2895854947 conn(0x7f25c40f7440 msgr2=0x7f25c40f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:45.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.427+0000 7f25c8899700 1 -- 172.21.15.5:0/2895854947 shutdown_connections 2024-04-16T14:34:45.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.427+0000 7f25c8899700 1 -- 172.21.15.5:0/2895854947 wait complete. 2024-04-16T14:34:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.427+0000 7f25c8899700 1 Processor -- start 2024-04-16T14:34:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.427+0000 7f25c8899700 1 -- start start 2024-04-16T14:34:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.428+0000 7f25c8899700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25c4066ec0 0x7f25c410d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.428+0000 7f25c8899700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c40fff70 0x7f25c410de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.428+0000 7f25c8899700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c410e480 con 0x7f25c4066ec0 2024-04-16T14:34:45.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.428+0000 7f25c8899700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c410e5f0 con 0x7f25c40fff70 2024-04-16T14:34:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.428+0000 7f25c259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25c4066ec0 0x7f25c410d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.428+0000 7f25c259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25c4066ec0 0x7f25c410d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47910/0 (socket says 172.21.15.5:47910) 2024-04-16T14:34:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.428+0000 7f25c259c700 1 -- 172.21.15.5:0/2128585585 learned_addr learned my addr 172.21.15.5:0/2128585585 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:34:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.428+0000 7f25c1d9b700 1 --2- 172.21.15.5:0/2128585585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c40fff70 0x7f25c410de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.428+0000 7f25c259c700 1 -- 172.21.15.5:0/2128585585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c40fff70 msgr2=0x7f25c410de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.428+0000 7f25c259c700 1 --2- 172.21.15.5:0/2128585585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c40fff70 0x7f25c410de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.428+0000 7f25c259c700 1 -- 172.21.15.5:0/2128585585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b4005040 con 0x7f25c4066ec0 2024-04-16T14:34:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.428+0000 7f25c259c700 1 --2- 172.21.15.5:0/2128585585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25c4066ec0 0x7f25c410d940 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f25b4004090 tx=0x7f25b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.428+0000 7f25baffd700 1 -- 172.21.15.5:0/2128585585 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25b4021070 con 0x7f25c4066ec0 2024-04-16T14:34:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.428+0000 7f25baffd700 1 -- 172.21.15.5:0/2128585585 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f25b401c400 con 0x7f25c4066ec0 2024-04-16T14:34:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.428+0000 7f25c8899700 1 -- 172.21.15.5:0/2128585585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c4112fa0 con 0x7f25c4066ec0 2024-04-16T14:34:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.428+0000 7f25baffd700 1 -- 172.21.15.5:0/2128585585 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25b400e070 con 0x7f25c4066ec0 2024-04-16T14:34:45.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.429+0000 7f25c8899700 1 -- 172.21.15.5:0/2128585585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c4113400 con 0x7f25c4066ec0 2024-04-16T14:34:45.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.429+0000 7f25c8899700 1 -- 172.21.15.5:0/2128585585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c404c710 con 0x7f25c4066ec0 2024-04-16T14:34:45.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.430+0000 7f25baffd700 1 -- 172.21.15.5:0/2128585585 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 19) v1 ==== 86627+0+0 (secure 0 0 0) 0x7f25b401ca50 con 0x7f25c4066ec0 2024-04-16T14:34:45.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.430+0000 7f25baffd700 1 --2- 172.21.15.5:0/2128585585 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f25b00692a0 0x7f25b006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:34:45.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.430+0000 7f25baffd700 1 -- 172.21.15.5:0/2128585585 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f25b4088390 con 0x7f25c4066ec0 2024-04-16T14:34:45.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.430+0000 7f25c1d9b700 1 --2- 172.21.15.5:0/2128585585 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f25b00692a0 0x7f25b006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:34:45.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.431+0000 7f25c1d9b700 1 --2- 172.21.15.5:0/2128585585 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f25b00692a0 0x7f25b006b750 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f25ac009b80 tx=0x7f25ac00b040 comp rx=0 tx=0).ready entity=mgr.14212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:34:45.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.435+0000 7f25baffd700 1 -- 172.21.15.5:0/2128585585 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f25b4058100 con 0x7f25c4066ec0 2024-04-16T14:34:45.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:45 smithi115 ceph-mon[37295]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:34:45.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:45 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/2430136905' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:34:45.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:45 smithi115 ceph-mon[37295]: pgmap v236: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:45.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:45 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/3240881407' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:34:45.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.709+0000 7f25c8899700 1 -- 172.21.15.5:0/2128585585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f25c41138e0 con 0x7f25c4066ec0 2024-04-16T14:34:45.708 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:45 smithi005 ceph-mon[28964]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:34:45.708 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:45 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/2430136905' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:34:45.708 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:45 smithi005 ceph-mon[28964]: pgmap v236: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:45.708 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:45 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/3240881407' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:34:45.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.710+0000 7f25baffd700 1 -- 172.21.15.5:0/2128585585 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f25b4057c90 con 0x7f25c4066ec0 2024-04-16T14:34:45.709 INFO:teuthology.orchestra.run.smithi005.stdout:HEALTH_OK 2024-04-16T14:34:45.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.712+0000 7f25c8899700 1 -- 172.21.15.5:0/2128585585 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f25b00692a0 msgr2=0x7f25b006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:45.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.712+0000 7f25c8899700 1 --2- 172.21.15.5:0/2128585585 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f25b00692a0 0x7f25b006b750 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f25ac009b80 tx=0x7f25ac00b040 comp rx=0 tx=0).stop 2024-04-16T14:34:45.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.712+0000 7f25c8899700 1 -- 172.21.15.5:0/2128585585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25c4066ec0 msgr2=0x7f25c410d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:34:45.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.712+0000 7f25c8899700 1 --2- 172.21.15.5:0/2128585585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25c4066ec0 0x7f25c410d940 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f25b4004090 tx=0x7f25b4009e30 comp rx=0 tx=0).stop 2024-04-16T14:34:45.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.712+0000 7f25c8899700 1 -- 172.21.15.5:0/2128585585 shutdown_connections 2024-04-16T14:34:45.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.712+0000 7f25c8899700 1 --2- 172.21.15.5:0/2128585585 >> [v2:172.21.15.5:6800/3841652776,v1:172.21.15.5:6801/3841652776] conn(0x7f25b00692a0 0x7f25b006b750 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:45.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.712+0000 7f25c8899700 1 --2- 172.21.15.5:0/2128585585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f25c4066ec0 0x7f25c410d940 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:45.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.712+0000 7f25c8899700 1 --2- 172.21.15.5:0/2128585585 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25c40fff70 0x7f25c410de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:34:45.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.712+0000 7f25c8899700 1 -- 172.21.15.5:0/2128585585 >> 172.21.15.5:0/2128585585 conn(0x7f25c40f7440 msgr2=0x7f25c40f7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:34:45.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.712+0000 7f25c8899700 1 -- 172.21.15.5:0/2128585585 shutdown_connections 2024-04-16T14:34:45.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:34:45.712+0000 7f25c8899700 1 -- 172.21.15.5:0/2128585585 wait complete. 2024-04-16T14:34:45.899 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-16T14:34:45.975 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-16T14:34:46.016 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-16T14:34:46.017 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-16T14:34:46.017 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-16T14:34:46.056 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-16T14:34:46.059 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-16T14:34:46.059 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-16T14:34:46.116 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-16T14:34:46.118 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-16T14:34:46.118 DEBUG:teuthology.orchestra.run.smithi005:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=36befe5d41ee8a6ea2e60983e763134278d506cf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-16T14:34:46.178 INFO:tasks.workunit.client.0.smithi005.stderr:+ mkdir -p fsstress 2024-04-16T14:34:46.180 INFO:tasks.workunit.client.0.smithi005.stderr:+ pushd fsstress 2024-04-16T14:34:46.180 INFO:tasks.workunit.client.0.smithi005.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-16T14:34:46.180 INFO:tasks.workunit.client.0.smithi005.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-16T14:34:46.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:46 smithi115 ceph-mon[37295]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:34:46.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:46 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/2128585585' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:34:46.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:46 smithi005 ceph-mon[28964]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:34:46.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:46 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/2128585585' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:34:47.041 INFO:tasks.workunit.client.0.smithi005.stderr:+ tar xzf ltp-full.tgz 2024-04-16T14:34:47.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:47 smithi115 ceph-mon[37295]: pgmap v237: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:47.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:47 smithi005 ceph-mon[28964]: pgmap v237: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:48.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:48 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:34:48.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:48 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:34:49.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:49 smithi115 ceph-mon[37295]: Standby manager daemon smithi115.brjkpo restarted 2024-04-16T14:34:49.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:49 smithi115 ceph-mon[37295]: Standby manager daemon smithi115.brjkpo started 2024-04-16T14:34:49.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:49 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.brjkpo/crt"}]: dispatch 2024-04-16T14:34:49.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:49 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-16T14:34:49.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:49 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.brjkpo/key"}]: dispatch 2024-04-16T14:34:49.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:49 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-16T14:34:49.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:49 smithi115 ceph-mon[37295]: pgmap v238: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:49.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:49 smithi005 ceph-mon[28964]: Standby manager daemon smithi115.brjkpo restarted 2024-04-16T14:34:49.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:49 smithi005 ceph-mon[28964]: Standby manager daemon smithi115.brjkpo started 2024-04-16T14:34:49.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:49 smithi005 ceph-mon[28964]: from='mgr.? 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.brjkpo/crt"}]: dispatch 2024-04-16T14:34:49.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:49 smithi005 ceph-mon[28964]: from='mgr.? 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-16T14:34:49.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:49 smithi005 ceph-mon[28964]: from='mgr.? 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.brjkpo/key"}]: dispatch 2024-04-16T14:34:49.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:49 smithi005 ceph-mon[28964]: from='mgr.? 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-16T14:34:49.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:49 smithi005 ceph-mon[28964]: pgmap v238: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:50.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:50 smithi115 ceph-mon[37295]: mgrmap e20: smithi005.ipwdkc(active, since 6m), standbys: smithi115.brjkpo 2024-04-16T14:34:50.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:50 smithi005 ceph-mon[28964]: mgrmap e20: smithi005.ipwdkc(active, since 6m), standbys: smithi115.brjkpo 2024-04-16T14:34:51.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:51 smithi115 ceph-mon[37295]: pgmap v239: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:51.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:51 smithi005 ceph-mon[28964]: pgmap v239: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:34:53.164 INFO:tasks.workunit.client.1.smithi115.stderr:Updating files: 68% (8432/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-16T14:34:53.589 INFO:tasks.workunit.client.1.smithi115.stderr:Note: switching to '36befe5d41ee8a6ea2e60983e763134278d506cf'. 2024-04-16T14:34:53.589 INFO:tasks.workunit.client.1.smithi115.stderr: 2024-04-16T14:34:53.590 INFO:tasks.workunit.client.1.smithi115.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-16T14:34:53.590 INFO:tasks.workunit.client.1.smithi115.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-16T14:34:53.590 INFO:tasks.workunit.client.1.smithi115.stderr:state without impacting any branches by switching back to a branch. 2024-04-16T14:34:53.590 INFO:tasks.workunit.client.1.smithi115.stderr: 2024-04-16T14:34:53.590 INFO:tasks.workunit.client.1.smithi115.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-16T14:34:53.590 INFO:tasks.workunit.client.1.smithi115.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-16T14:34:53.590 INFO:tasks.workunit.client.1.smithi115.stderr: 2024-04-16T14:34:53.590 INFO:tasks.workunit.client.1.smithi115.stderr: git switch -c 2024-04-16T14:34:53.590 INFO:tasks.workunit.client.1.smithi115.stderr: 2024-04-16T14:34:53.590 INFO:tasks.workunit.client.1.smithi115.stderr:Or undo this operation with: 2024-04-16T14:34:53.590 INFO:tasks.workunit.client.1.smithi115.stderr: 2024-04-16T14:34:53.590 INFO:tasks.workunit.client.1.smithi115.stderr: git switch - 2024-04-16T14:34:53.591 INFO:tasks.workunit.client.1.smithi115.stderr: 2024-04-16T14:34:53.591 INFO:tasks.workunit.client.1.smithi115.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-16T14:34:53.591 INFO:tasks.workunit.client.1.smithi115.stderr: 2024-04-16T14:34:53.591 INFO:tasks.workunit.client.1.smithi115.stderr:HEAD is now at 36befe5d41e Merge branch 'wip-65417-squid' of https://github.com/adk3798/ceph into wip-adk2-testing-2024-04-15-1136-squid 2024-04-16T14:34:53.595 DEBUG:teuthology.orchestra.run.smithi115:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-04-16T14:34:53.762 INFO:tasks.workunit.client.1.smithi115.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-16T14:34:53.763 INFO:tasks.workunit.client.1.smithi115.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-16T14:34:53.764 INFO:tasks.workunit.client.1.smithi115.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-16T14:34:54.112 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:53 smithi115 ceph-mon[37295]: pgmap v240: 65 pgs: 65 active+clean; 10 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 862 KiB/s wr, 56 op/s 2024-04-16T14:34:54.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:53 smithi005 ceph-mon[28964]: pgmap v240: 65 pgs: 65 active+clean; 10 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 862 KiB/s wr, 56 op/s 2024-04-16T14:34:54.961 INFO:tasks.workunit.client.1.smithi115.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-16T14:34:55.080 INFO:tasks.workunit.client.1.smithi115.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-16T14:34:55.121 INFO:tasks.workunit.client.1.smithi115.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-16T14:34:55.122 INFO:tasks.workunit.client.1.smithi115.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-16T14:34:55.122 INFO:tasks.workunit.client.1.smithi115.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-16T14:34:55.176 INFO:tasks.workunit.client.1.smithi115.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-16T14:34:55.179 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-16T14:34:55.179 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-04-16T14:34:55.195 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-04-16T14:34:55.197 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-16T14:34:55.197 DEBUG:teuthology.orchestra.run.smithi115:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=36befe5d41ee8a6ea2e60983e763134278d506cf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-04-16T14:34:55.260 INFO:tasks.workunit.client.1.smithi115.stderr:+ mkdir -p fsstress 2024-04-16T14:34:55.264 INFO:tasks.workunit.client.1.smithi115.stderr:+ pushd fsstress 2024-04-16T14:34:55.265 INFO:tasks.workunit.client.1.smithi115.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-16T14:34:55.265 INFO:tasks.workunit.client.1.smithi115.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-16T14:34:56.024 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:55 smithi115 ceph-mon[37295]: pgmap v241: 65 pgs: 65 active+clean; 18 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s wr, 127 op/s 2024-04-16T14:34:56.024 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:55 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:34:56.075 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:55 smithi005 ceph-mon[28964]: pgmap v241: 65 pgs: 65 active+clean; 18 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s wr, 127 op/s 2024-04-16T14:34:56.075 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:55 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:34:56.396 INFO:tasks.workunit.client.1.smithi115.stderr:+ tar xzf ltp-full.tgz 2024-04-16T14:34:56.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:34:56.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:34:56.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:34:56.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:34:56.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:34:56.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr fail", "who": "smithi005.ipwdkc"}]: dispatch 2024-04-16T14:34:56.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: Activating manager daemon smithi115.brjkpo 2024-04-16T14:34:56.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: osdmap e48: 6 total, 6 up, 6 in 2024-04-16T14:34:56.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "mgr fail", "who": "smithi005.ipwdkc"}]': finished 2024-04-16T14:34:56.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: mgrmap e21: smithi115.brjkpo(active, starting, since 0.00728686s) 2024-04-16T14:34:56.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-04-16T14:34:56.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:34:56.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi005.wofqlz"}]: dispatch 2024-04-16T14:34:56.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi005.vzoqdl"}]: dispatch 2024-04-16T14:34:56.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.byfytg"}]: dispatch 2024-04-16T14:34:56.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.trkaqh"}]: dispatch 2024-04-16T14:34:56.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "mgr metadata", "who": "smithi115.brjkpo", "id": "smithi115.brjkpo"}]: dispatch 2024-04-16T14:34:56.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-16T14:34:56.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-16T14:34:56.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-16T14:34:56.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-16T14:34:56.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-16T14:34:56.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-16T14:34:56.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-16T14:34:56.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-16T14:34:56.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-16T14:34:56.977 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: Manager daemon smithi115.brjkpo is now available 2024-04-16T14:34:56.977 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:34:56.977 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:34:56.977 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.brjkpo/mirror_snapshot_schedule"}]: dispatch 2024-04-16T14:34:56.977 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.brjkpo/trash_purge_schedule"}]: dispatch 2024-04-16T14:34:56.977 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:34:56.977 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:56 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:34:57.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:34:57.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:34:57.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:34:57.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:34:57.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:34:57.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr fail", "who": "smithi005.ipwdkc"}]: dispatch 2024-04-16T14:34:57.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: Activating manager daemon smithi115.brjkpo 2024-04-16T14:34:57.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: osdmap e48: 6 total, 6 up, 6 in 2024-04-16T14:34:57.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14212 172.21.15.5:0/2958209659' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "mgr fail", "who": "smithi005.ipwdkc"}]': finished 2024-04-16T14:34:57.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: mgrmap e21: smithi115.brjkpo(active, starting, since 0.00728686s) 2024-04-16T14:34:57.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-04-16T14:34:57.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:34:57.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi005.wofqlz"}]: dispatch 2024-04-16T14:34:57.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi005.vzoqdl"}]: dispatch 2024-04-16T14:34:57.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.byfytg"}]: dispatch 2024-04-16T14:34:57.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.trkaqh"}]: dispatch 2024-04-16T14:34:57.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "mgr metadata", "who": "smithi115.brjkpo", "id": "smithi115.brjkpo"}]: dispatch 2024-04-16T14:34:57.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-16T14:34:57.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-16T14:34:57.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-16T14:34:57.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-16T14:34:57.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-16T14:34:57.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-16T14:34:57.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-16T14:34:57.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-16T14:34:57.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-16T14:34:57.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: Manager daemon smithi115.brjkpo is now available 2024-04-16T14:34:57.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:34:57.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:34:57.184 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.brjkpo/mirror_snapshot_schedule"}]: dispatch 2024-04-16T14:34:57.184 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi115.brjkpo/trash_purge_schedule"}]: dispatch 2024-04-16T14:34:57.184 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:34:57.184 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:56 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:34:58.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:57 smithi115 ceph-mon[37295]: Deploying cephadm binary to smithi115 2024-04-16T14:34:58.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:57 smithi115 ceph-mon[37295]: Deploying cephadm binary to smithi005 2024-04-16T14:34:58.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:57 smithi115 ceph-mon[37295]: mgrmap e22: smithi115.brjkpo(active, since 1.00998s) 2024-04-16T14:34:58.189 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:57 smithi005 ceph-mon[28964]: Deploying cephadm binary to smithi115 2024-04-16T14:34:58.189 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:57 smithi005 ceph-mon[28964]: Deploying cephadm binary to smithi005 2024-04-16T14:34:58.189 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:57 smithi005 ceph-mon[28964]: mgrmap e22: smithi115.brjkpo(active, since 1.00998s) 2024-04-16T14:34:59.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:58 smithi115 ceph-mon[37295]: pgmap v3: 65 pgs: 65 active+clean; 60 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:34:59.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:58 smithi005 ceph-mon[28964]: pgmap v3: 65 pgs: 65 active+clean; 60 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:35:00.102 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:59 smithi005 ceph-mon[28964]: pgmap v4: 65 pgs: 65 active+clean; 60 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:35:00.102 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:59 smithi005 ceph-mon[28964]: [16/Apr/2024:14:34:58] ENGINE Bus STARTING 2024-04-16T14:35:00.102 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:59 smithi005 ceph-mon[28964]: [16/Apr/2024:14:34:58] ENGINE Serving on http://172.21.15.115:8765 2024-04-16T14:35:00.102 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:59 smithi005 ceph-mon[28964]: [16/Apr/2024:14:34:58] ENGINE Serving on https://172.21.15.115:7150 2024-04-16T14:35:00.102 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:59 smithi005 ceph-mon[28964]: [16/Apr/2024:14:34:58] ENGINE Bus STARTED 2024-04-16T14:35:00.102 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:34:59 smithi005 ceph-mon[28964]: mgrmap e23: smithi115.brjkpo(active, since 3s) 2024-04-16T14:35:00.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:59 smithi115 ceph-mon[37295]: pgmap v4: 65 pgs: 65 active+clean; 60 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:35:00.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:59 smithi115 ceph-mon[37295]: [16/Apr/2024:14:34:58] ENGINE Bus STARTING 2024-04-16T14:35:00.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:59 smithi115 ceph-mon[37295]: [16/Apr/2024:14:34:58] ENGINE Serving on http://172.21.15.115:8765 2024-04-16T14:35:00.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:59 smithi115 ceph-mon[37295]: [16/Apr/2024:14:34:58] ENGINE Serving on https://172.21.15.115:7150 2024-04-16T14:35:00.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:59 smithi115 ceph-mon[37295]: [16/Apr/2024:14:34:58] ENGINE Bus STARTED 2024-04-16T14:35:00.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:34:59 smithi115 ceph-mon[37295]: mgrmap e23: smithi115.brjkpo(active, since 3s) 2024-04-16T14:35:02.068 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:01 smithi005 ceph-mon[28964]: pgmap v5: 65 pgs: 65 active+clean; 60 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:35:02.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:01 smithi115 ceph-mon[37295]: pgmap v5: 65 pgs: 65 active+clean; 60 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:35:02.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:02 smithi005 ceph-mon[28964]: fsmap cephfs:2 {0=cephfs.smithi005.wofqlz=up:active,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:35:03.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:02 smithi115 ceph-mon[37295]: fsmap cephfs:2 {0=cephfs.smithi005.wofqlz=up:active,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:35:04.125 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:03 smithi115 ceph-mon[37295]: pgmap v6: 65 pgs: 65 active+clean; 63 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 604 KiB/s wr, 84 op/s 2024-04-16T14:35:04.139 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:03 smithi005 ceph-mon[28964]: pgmap v6: 65 pgs: 65 active+clean; 63 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 604 KiB/s wr, 84 op/s 2024-04-16T14:35:05.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:04 smithi115 ceph-mon[37295]: Standby manager daemon smithi005.ipwdkc started 2024-04-16T14:35:05.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:04 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.5:0/1850059807' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi005.ipwdkc/crt"}]: dispatch 2024-04-16T14:35:05.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:04 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.5:0/1850059807' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-16T14:35:05.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:04 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.5:0/1850059807' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi005.ipwdkc/key"}]: dispatch 2024-04-16T14:35:05.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:04 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.5:0/1850059807' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-16T14:35:05.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:04 smithi005 ceph-mon[28964]: Standby manager daemon smithi005.ipwdkc started 2024-04-16T14:35:05.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:04 smithi005 ceph-mon[28964]: from='mgr.? 172.21.15.5:0/1850059807' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi005.ipwdkc/crt"}]: dispatch 2024-04-16T14:35:05.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:04 smithi005 ceph-mon[28964]: from='mgr.? 172.21.15.5:0/1850059807' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-16T14:35:05.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:04 smithi005 ceph-mon[28964]: from='mgr.? 172.21.15.5:0/1850059807' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi005.ipwdkc/key"}]: dispatch 2024-04-16T14:35:05.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:04 smithi005 ceph-mon[28964]: from='mgr.? 172.21.15.5:0/1850059807' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-16T14:35:06.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:05 smithi115 ceph-mon[37295]: pgmap v7: 65 pgs: 65 active+clean; 90 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 4.6 MiB/s wr, 335 op/s 2024-04-16T14:35:06.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:05 smithi115 ceph-mon[37295]: mgrmap e24: smithi115.brjkpo(active, since 8s), standbys: smithi005.ipwdkc 2024-04-16T14:35:06.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:05 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "mgr metadata", "who": "smithi005.ipwdkc", "id": "smithi005.ipwdkc"}]: dispatch 2024-04-16T14:35:06.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:05 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:06.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:05 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:06.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:05 smithi005 ceph-mon[28964]: pgmap v7: 65 pgs: 65 active+clean; 90 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 4.6 MiB/s wr, 335 op/s 2024-04-16T14:35:06.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:05 smithi005 ceph-mon[28964]: mgrmap e24: smithi115.brjkpo(active, since 8s), standbys: smithi005.ipwdkc 2024-04-16T14:35:06.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:05 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "mgr metadata", "who": "smithi005.ipwdkc", "id": "smithi005.ipwdkc"}]: dispatch 2024-04-16T14:35:06.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:05 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:06.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:05 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:07.319 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:07 smithi005 ceph-mon[28964]: pgmap v8: 65 pgs: 65 active+clean; 90 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 3.6 MiB/s wr, 260 op/s 2024-04-16T14:35:07.319 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:07 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:07.319 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:07 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:07.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:07 smithi115 ceph-mon[37295]: pgmap v8: 65 pgs: 65 active+clean; 90 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 3.6 MiB/s wr, 260 op/s 2024-04-16T14:35:07.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:07 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:07.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:07 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:09.327 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:09 smithi115 ceph-mon[37295]: pgmap v9: 65 pgs: 65 active+clean; 103 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 4.1 MiB/s wr, 228 op/s 2024-04-16T14:35:09.327 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:09 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:09.327 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:09 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:09.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:09 smithi005 ceph-mon[28964]: pgmap v9: 65 pgs: 65 active+clean; 103 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 4.1 MiB/s wr, 228 op/s 2024-04-16T14:35:09.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:09 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:09.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:09 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:11.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:11 smithi115 ceph-mon[37295]: pgmap v10: 65 pgs: 65 active+clean; 103 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 209 op/s 2024-04-16T14:35:11.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:11 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:11.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:11 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:11.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:11 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:35:11.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:11 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:35:11.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:11 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:35:11.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:11 smithi115 ceph-mon[37295]: Adjusting osd_memory_target on smithi005 to 1559M 2024-04-16T14:35:11.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:11 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:11.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:11 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:11.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:11 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:11.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:11 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:35:11.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:11 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:35:11.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:11 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:35:11.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:11 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:11.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:11 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:35:11.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:11 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:35:11.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:11 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:35:11.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:11 smithi005 ceph-mon[28964]: pgmap v10: 65 pgs: 65 active+clean; 103 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 209 op/s 2024-04-16T14:35:11.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:11 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:11.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:11 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:11.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:11 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:35:11.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:11 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:35:11.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:11 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:35:11.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:11 smithi005 ceph-mon[28964]: Adjusting osd_memory_target on smithi005 to 1559M 2024-04-16T14:35:11.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:11 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:11.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:11 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:11.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:11 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:11.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:11 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:35:11.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:11 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:35:11.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:11 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-16T14:35:11.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:11 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:11.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:11 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:35:11.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:11 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:35:11.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:11 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:35:12.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:12 smithi115 ceph-mon[37295]: Adjusting osd_memory_target on smithi115 to 2581M 2024-04-16T14:35:12.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:12 smithi115 ceph-mon[37295]: Updating smithi005:/etc/ceph/ceph.conf 2024-04-16T14:35:12.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:12 smithi115 ceph-mon[37295]: Updating smithi115:/etc/ceph/ceph.conf 2024-04-16T14:35:12.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:12 smithi115 ceph-mon[37295]: Updating smithi115:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.conf 2024-04-16T14:35:12.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:12 smithi115 ceph-mon[37295]: Updating smithi005:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.conf 2024-04-16T14:35:12.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:12 smithi115 ceph-mon[37295]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-04-16T14:35:12.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:12 smithi115 ceph-mon[37295]: Updating smithi005:/etc/ceph/ceph.client.admin.keyring 2024-04-16T14:35:12.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:12 smithi115 ceph-mon[37295]: Updating smithi115:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.client.admin.keyring 2024-04-16T14:35:12.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:12 smithi115 ceph-mon[37295]: Updating smithi005:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.client.admin.keyring 2024-04-16T14:35:12.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:12 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:12.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:12 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:12.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:12 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:12.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:12 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:12.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:12 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:12.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:12 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:12.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:12 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:12.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:12 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:12.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:12 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:12.690 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:12 smithi005 ceph-mon[28964]: Adjusting osd_memory_target on smithi115 to 2581M 2024-04-16T14:35:12.690 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:12 smithi005 ceph-mon[28964]: Updating smithi005:/etc/ceph/ceph.conf 2024-04-16T14:35:12.691 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:12 smithi005 ceph-mon[28964]: Updating smithi115:/etc/ceph/ceph.conf 2024-04-16T14:35:12.691 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:12 smithi005 ceph-mon[28964]: Updating smithi115:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.conf 2024-04-16T14:35:12.691 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:12 smithi005 ceph-mon[28964]: Updating smithi005:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.conf 2024-04-16T14:35:12.691 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:12 smithi005 ceph-mon[28964]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-04-16T14:35:12.691 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:12 smithi005 ceph-mon[28964]: Updating smithi005:/etc/ceph/ceph.client.admin.keyring 2024-04-16T14:35:12.691 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:12 smithi005 ceph-mon[28964]: Updating smithi115:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.client.admin.keyring 2024-04-16T14:35:12.691 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:12 smithi005 ceph-mon[28964]: Updating smithi005:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.client.admin.keyring 2024-04-16T14:35:12.691 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:12 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:12.691 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:12 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:12.691 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:12 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:12.691 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:12 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:12.691 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:12 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:12.691 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:12 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:12.691 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:12 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:12.691 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:12 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:12.692 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:12 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:12.961 INFO:tasks.workunit.client.0.smithi005.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-16T14:35:12.961 INFO:tasks.workunit.client.0.smithi005.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-16T14:35:12.961 INFO:tasks.workunit.client.0.smithi005.stderr:+ make 2024-04-16T14:35:13.635 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:13 smithi005 ceph-mon[28964]: pgmap v11: 65 pgs: 65 active+clean; 111 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 4.4 MiB/s wr, 283 op/s 2024-04-16T14:35:13.635 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:13 smithi005 ceph-mon[28964]: Reconfiguring node-exporter.smithi005 (dependencies changed)... 2024-04-16T14:35:13.635 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:13 smithi005 ceph-mon[28964]: Reconfiguring daemon node-exporter.smithi005 on smithi005 2024-04-16T14:35:13.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:13 smithi115 ceph-mon[37295]: pgmap v11: 65 pgs: 65 active+clean; 111 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 4.4 MiB/s wr, 283 op/s 2024-04-16T14:35:13.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:13 smithi115 ceph-mon[37295]: Reconfiguring node-exporter.smithi005 (dependencies changed)... 2024-04-16T14:35:13.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:13 smithi115 ceph-mon[37295]: Reconfiguring daemon node-exporter.smithi005 on smithi005 2024-04-16T14:35:13.786 INFO:tasks.workunit.client.0.smithi005.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-16T14:35:14.123 INFO:tasks.workunit.client.0.smithi005.stderr:++ readlink -f fsstress 2024-04-16T14:35:14.124 INFO:tasks.workunit.client.0.smithi005.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-16T14:35:14.124 INFO:tasks.workunit.client.0.smithi005.stderr:+ popd 2024-04-16T14:35:14.124 INFO:tasks.workunit.client.0.smithi005.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-16T14:35:14.125 INFO:tasks.workunit.client.0.smithi005.stderr:+ popd 2024-04-16T14:35:14.125 INFO:tasks.workunit.client.0.smithi005.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-16T14:35:14.125 INFO:tasks.workunit.client.0.smithi005.stderr:++ mktemp -d -p . 2024-04-16T14:35:14.126 INFO:tasks.workunit.client.0.smithi005.stderr:+ T=./tmp.0MRASCfz55 2024-04-16T14:35:14.126 INFO:tasks.workunit.client.0.smithi005.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.0MRASCfz55 -l 1 -n 1000 -p 10 -v 2024-04-16T14:35:14.127 INFO:tasks.workunit.client.0.smithi005.stdout:seed = 1713337085 2024-04-16T14:35:14.129 INFO:tasks.workunit.client.0.smithi005.stdout:0/0: unlink - no file 2024-04-16T14:35:14.129 INFO:tasks.workunit.client.0.smithi005.stdout:0/1: write - no filename 2024-04-16T14:35:14.131 INFO:tasks.workunit.client.0.smithi005.stdout:0/2: creat f0 x:0 0 0 2024-04-16T14:35:14.131 INFO:tasks.workunit.client.0.smithi005.stdout:0/3: stat f0 0 2024-04-16T14:35:14.131 INFO:tasks.workunit.client.0.smithi005.stdout:0/4: fdatasync f0 0 2024-04-16T14:35:14.133 INFO:tasks.workunit.client.0.smithi005.stdout:1/0: creat f0 x:0 0 0 2024-04-16T14:35:14.134 INFO:tasks.workunit.client.0.smithi005.stdout:3/0: dwrite - no filename 2024-04-16T14:35:14.135 INFO:tasks.workunit.client.0.smithi005.stdout:2/0: mkdir d0 0 2024-04-16T14:35:14.136 INFO:tasks.workunit.client.0.smithi005.stdout:2/1: rename d0 to d0/d1 22 2024-04-16T14:35:14.136 INFO:tasks.workunit.client.0.smithi005.stdout:2/2: unlink - no file 2024-04-16T14:35:14.136 INFO:tasks.workunit.client.0.smithi005.stdout:2/3: fdatasync - no filename 2024-04-16T14:35:14.136 INFO:tasks.workunit.client.0.smithi005.stdout:1/1: symlink l1 0 2024-04-16T14:35:14.136 INFO:tasks.workunit.client.0.smithi005.stdout:1/2: chown f0 29 1 2024-04-16T14:35:14.137 INFO:tasks.workunit.client.0.smithi005.stdout:4/0: read - no filename 2024-04-16T14:35:14.138 INFO:tasks.workunit.client.0.smithi005.stdout:3/1: creat f0 x:0 0 0 2024-04-16T14:35:14.139 INFO:tasks.workunit.client.0.smithi005.stdout:2/4: creat d0/f2 x:0 0 0 2024-04-16T14:35:14.140 INFO:tasks.workunit.client.0.smithi005.stdout:2/5: chown d0/f2 5 1 2024-04-16T14:35:14.142 INFO:tasks.workunit.client.0.smithi005.stdout:4/1: mkdir d0 0 2024-04-16T14:35:14.142 INFO:tasks.workunit.client.0.smithi005.stdout:4/2: chown d0 89 1 2024-04-16T14:35:14.142 INFO:tasks.workunit.client.0.smithi005.stdout:4/3: stat d0 0 2024-04-16T14:35:14.143 INFO:tasks.workunit.client.0.smithi005.stdout:3/2: rename f0 to f1 0 2024-04-16T14:35:14.143 INFO:tasks.workunit.client.0.smithi005.stdout:3/3: write f1 [278268,70300] 0 2024-04-16T14:35:14.144 INFO:tasks.workunit.client.0.smithi005.stdout:2/6: symlink d0/l3 0 2024-04-16T14:35:14.145 INFO:tasks.workunit.client.0.smithi005.stdout:2/7: chown d0/l3 407821 1 2024-04-16T14:35:14.145 INFO:tasks.workunit.client.0.smithi005.stdout:2/8: dread - d0/f2 zero size 2024-04-16T14:35:14.145 INFO:tasks.workunit.client.0.smithi005.stdout:2/9: chown d0/f2 418 1 2024-04-16T14:35:14.146 INFO:tasks.workunit.client.0.smithi005.stdout:6/0: rename - no filename 2024-04-16T14:35:14.146 INFO:tasks.workunit.client.0.smithi005.stdout:6/1: chown . 105251709 1 2024-04-16T14:35:14.146 INFO:tasks.workunit.client.0.smithi005.stdout:6/2: write - no filename 2024-04-16T14:35:14.147 INFO:tasks.workunit.client.0.smithi005.stdout:5/0: mkdir d0 0 2024-04-16T14:35:14.147 INFO:tasks.workunit.client.0.smithi005.stdout:5/1: write - no filename 2024-04-16T14:35:14.147 INFO:tasks.workunit.client.0.smithi005.stdout:5/2: write - no filename 2024-04-16T14:35:14.147 INFO:tasks.workunit.client.0.smithi005.stdout:5/3: chown d0 1354139 1 2024-04-16T14:35:14.147 INFO:tasks.workunit.client.0.smithi005.stdout:5/4: stat d0 0 2024-04-16T14:35:14.147 INFO:tasks.workunit.client.0.smithi005.stdout:5/5: unlink - no file 2024-04-16T14:35:14.147 INFO:tasks.workunit.client.0.smithi005.stdout:5/6: chown d0 31894955 1 2024-04-16T14:35:14.147 INFO:tasks.workunit.client.0.smithi005.stdout:5/7: dread - no filename 2024-04-16T14:35:14.147 INFO:tasks.workunit.client.0.smithi005.stdout:5/8: dread - no filename 2024-04-16T14:35:14.148 INFO:tasks.workunit.client.0.smithi005.stdout:5/9: chown d0 435 1 2024-04-16T14:35:14.148 INFO:tasks.workunit.client.0.smithi005.stdout:5/10: write - no filename 2024-04-16T14:35:14.148 INFO:tasks.workunit.client.0.smithi005.stdout:5/11: dwrite - no filename 2024-04-16T14:35:14.148 INFO:tasks.workunit.client.0.smithi005.stdout:4/4: mknod d0/c1 0 2024-04-16T14:35:14.148 INFO:tasks.workunit.client.0.smithi005.stdout:4/5: rename d0 to d0/d2 22 2024-04-16T14:35:14.148 INFO:tasks.workunit.client.0.smithi005.stdout:3/4: mkdir d2 0 2024-04-16T14:35:14.149 INFO:tasks.workunit.client.0.smithi005.stdout:2/10: mkdir d0/d4 0 2024-04-16T14:35:14.150 INFO:tasks.workunit.client.0.smithi005.stdout:7/0: dread - no filename 2024-04-16T14:35:14.150 INFO:tasks.workunit.client.0.smithi005.stdout:7/1: getdents . 0 2024-04-16T14:35:14.151 INFO:tasks.workunit.client.0.smithi005.stdout:6/3: creat f0 x:0 0 0 2024-04-16T14:35:14.152 INFO:tasks.workunit.client.0.smithi005.stdout:5/12: mknod d0/c1 0 2024-04-16T14:35:14.153 INFO:tasks.workunit.client.0.smithi005.stdout:4/6: mknod d0/c3 0 2024-04-16T14:35:14.154 INFO:tasks.workunit.client.0.smithi005.stdout:3/5: mknod d2/c3 0 2024-04-16T14:35:14.155 INFO:tasks.workunit.client.0.smithi005.stdout:1/3: dwrite f0 [0,4194304] 0 2024-04-16T14:35:14.155 INFO:tasks.workunit.client.0.smithi005.stdout:7/2: symlink l0 0 2024-04-16T14:35:14.155 INFO:tasks.workunit.client.0.smithi005.stdout:7/3: write - no filename 2024-04-16T14:35:14.156 INFO:tasks.workunit.client.0.smithi005.stdout:7/4: truncate - no filename 2024-04-16T14:35:14.156 INFO:tasks.workunit.client.0.smithi005.stdout:7/5: dread - no filename 2024-04-16T14:35:14.157 INFO:tasks.workunit.client.0.smithi005.stdout:8/0: truncate - no filename 2024-04-16T14:35:14.157 INFO:tasks.workunit.client.0.smithi005.stdout:8/1: read - no filename 2024-04-16T14:35:14.157 INFO:tasks.workunit.client.0.smithi005.stdout:8/2: link - no file 2024-04-16T14:35:14.157 INFO:tasks.workunit.client.0.smithi005.stdout:8/3: write - no filename 2024-04-16T14:35:14.158 INFO:tasks.workunit.client.0.smithi005.stdout:6/4: symlink l1 0 2024-04-16T14:35:14.159 INFO:tasks.workunit.client.0.smithi005.stdout:5/13: creat d0/f2 x:0 0 0 2024-04-16T14:35:14.159 INFO:tasks.workunit.client.0.smithi005.stdout:5/14: dread - d0/f2 zero size 2024-04-16T14:35:14.160 INFO:tasks.workunit.client.0.smithi005.stdout:4/7: mknod d0/c4 0 2024-04-16T14:35:14.160 INFO:tasks.workunit.client.0.smithi005.stdout:4/8: truncate - no filename 2024-04-16T14:35:14.160 INFO:tasks.workunit.client.0.smithi005.stdout:4/9: truncate - no filename 2024-04-16T14:35:14.160 INFO:tasks.workunit.client.0.smithi005.stdout:4/10: chown d0 15490 1 2024-04-16T14:35:14.160 INFO:tasks.workunit.client.0.smithi005.stdout:4/11: chown d0 1852919596 1 2024-04-16T14:35:14.161 INFO:tasks.workunit.client.0.smithi005.stdout:3/6: dread f1 [0,4194304] 0 2024-04-16T14:35:14.162 INFO:tasks.workunit.client.0.smithi005.stdout:1/4: mkdir d2 0 2024-04-16T14:35:14.164 INFO:tasks.workunit.client.0.smithi005.stdout:7/6: unlink l0 0 2024-04-16T14:35:14.164 INFO:tasks.workunit.client.0.smithi005.stdout:7/7: dread - no filename 2024-04-16T14:35:14.164 INFO:tasks.workunit.client.0.smithi005.stdout:7/8: link - no file 2024-04-16T14:35:14.164 INFO:tasks.workunit.client.0.smithi005.stdout:7/9: write - no filename 2024-04-16T14:35:14.164 INFO:tasks.workunit.client.0.smithi005.stdout:7/10: chown . 6806 1 2024-04-16T14:35:14.164 INFO:tasks.workunit.client.0.smithi005.stdout:7/11: dread - no filename 2024-04-16T14:35:14.165 INFO:tasks.workunit.client.0.smithi005.stdout:9/0: write - no filename 2024-04-16T14:35:14.166 INFO:tasks.workunit.client.0.smithi005.stdout:8/4: creat f0 x:0 0 0 2024-04-16T14:35:14.167 INFO:tasks.workunit.client.0.smithi005.stdout:6/5: mkdir d2 0 2024-04-16T14:35:14.167 INFO:tasks.workunit.client.0.smithi005.stdout:6/6: chown d2 0 1 2024-04-16T14:35:14.169 INFO:tasks.workunit.client.0.smithi005.stdout:4/12: creat d0/f5 x:0 0 0 2024-04-16T14:35:14.169 INFO:tasks.workunit.client.0.smithi005.stdout:4/13: fdatasync d0/f5 0 2024-04-16T14:35:14.172 INFO:tasks.workunit.client.0.smithi005.stdout:7/12: mkdir d1 0 2024-04-16T14:35:14.172 INFO:tasks.workunit.client.0.smithi005.stdout:7/13: rename d1 to d1/d2 22 2024-04-16T14:35:14.173 INFO:tasks.workunit.client.0.smithi005.stdout:9/1: mknod c0 0 2024-04-16T14:35:14.173 INFO:tasks.workunit.client.0.smithi005.stdout:9/2: dread - no filename 2024-04-16T14:35:14.173 INFO:tasks.workunit.client.0.smithi005.stdout:9/3: dwrite - no filename 2024-04-16T14:35:14.173 INFO:tasks.workunit.client.0.smithi005.stdout:9/4: dwrite - no filename 2024-04-16T14:35:14.174 INFO:tasks.workunit.client.0.smithi005.stdout:9/5: chown c0 1124181798 1 2024-04-16T14:35:14.174 INFO:tasks.workunit.client.0.smithi005.stdout:8/5: link f0 f1 0 2024-04-16T14:35:14.175 INFO:tasks.workunit.client.0.smithi005.stdout:8/6: rmdir - no directory 2024-04-16T14:35:14.176 INFO:tasks.workunit.client.0.smithi005.stdout:4/14: rename d0/c1 to d0/c6 0 2024-04-16T14:35:14.177 INFO:tasks.workunit.client.0.smithi005.stdout:7/14: mknod d1/c3 0 2024-04-16T14:35:14.177 INFO:tasks.workunit.client.0.smithi005.stdout:9/6: symlink l1 0 2024-04-16T14:35:14.178 INFO:tasks.workunit.client.0.smithi005.stdout:2/11: dwrite d0/f2 [0,4194304] 0 2024-04-16T14:35:14.178 INFO:tasks.workunit.client.0.smithi005.stdout:1/5: dread f0 [0,4194304] 0 2024-04-16T14:35:14.179 INFO:tasks.workunit.client.0.smithi005.stdout:8/7: symlink l2 0 2024-04-16T14:35:14.180 INFO:tasks.workunit.client.0.smithi005.stdout:7/15: symlink d1/l4 0 2024-04-16T14:35:14.182 INFO:tasks.workunit.client.0.smithi005.stdout:9/7: symlink l2 0 2024-04-16T14:35:14.187 INFO:tasks.workunit.client.0.smithi005.stdout:1/6: symlink d2/l3 0 2024-04-16T14:35:14.188 INFO:tasks.workunit.client.0.smithi005.stdout:7/16: mkdir d1/d5 0 2024-04-16T14:35:14.188 INFO:tasks.workunit.client.0.smithi005.stdout:6/7: dwrite f0 [0,4194304] 0 2024-04-16T14:35:14.189 INFO:tasks.workunit.client.0.smithi005.stdout:9/8: mkdir d3 0 2024-04-16T14:35:14.189 INFO:tasks.workunit.client.0.smithi005.stdout:9/9: read - no filename 2024-04-16T14:35:14.189 INFO:tasks.workunit.client.0.smithi005.stdout:9/10: dwrite - no filename 2024-04-16T14:35:14.191 INFO:tasks.workunit.client.0.smithi005.stdout:8/8: dwrite f1 [0,4194304] 0 2024-04-16T14:35:14.192 INFO:tasks.workunit.client.0.smithi005.stdout:7/17: mknod d1/d5/c6 0 2024-04-16T14:35:14.192 INFO:tasks.workunit.client.0.smithi005.stdout:7/18: read - no filename 2024-04-16T14:35:14.192 INFO:tasks.workunit.client.0.smithi005.stdout:7/19: read - no filename 2024-04-16T14:35:14.193 INFO:tasks.workunit.client.0.smithi005.stdout:1/7: read f0 [129276,95914] 0 2024-04-16T14:35:14.196 INFO:tasks.workunit.client.0.smithi005.stdout:9/11: creat d3/f4 x:0 0 0 2024-04-16T14:35:14.196 INFO:tasks.workunit.client.0.smithi005.stdout:9/12: dread - d3/f4 zero size 2024-04-16T14:35:14.197 INFO:tasks.workunit.client.0.smithi005.stdout:6/8: write f0 [2353730,127343] 0 2024-04-16T14:35:14.199 INFO:tasks.workunit.client.0.smithi005.stdout:8/9: dread f0 [0,4194304] 0 2024-04-16T14:35:14.201 INFO:tasks.workunit.client.0.smithi005.stdout:9/13: rename d3/f4 to d3/f5 0 2024-04-16T14:35:14.202 INFO:tasks.workunit.client.0.smithi005.stdout:9/14: write d3/f5 [622830,33472] 0 2024-04-16T14:35:14.203 INFO:tasks.workunit.client.0.smithi005.stdout:6/9: mknod d2/c3 0 2024-04-16T14:35:14.221 INFO:tasks.workunit.client.0.smithi005.stdout:9/15: dwrite d3/f5 [0,4194304] 0 2024-04-16T14:35:14.230 INFO:tasks.workunit.client.0.smithi005.stdout:6/10: dwrite f0 [0,4194304] 0 2024-04-16T14:35:14.231 INFO:tasks.workunit.client.0.smithi005.stdout:9/16: write d3/f5 [192669,59940] 0 2024-04-16T14:35:14.232 INFO:tasks.workunit.client.0.smithi005.stdout:6/11: rename l1 to d2/l4 0 2024-04-16T14:35:14.232 INFO:tasks.workunit.client.0.smithi005.stdout:6/12: mkdir d2/d5 0 2024-04-16T14:35:14.450 INFO:tasks.workunit.client.0.smithi005.stdout:0/5: fsync f0 0 2024-04-16T14:35:14.451 INFO:tasks.workunit.client.0.smithi005.stdout:0/6: write f0 [893350,40428] 0 2024-04-16T14:35:14.452 INFO:tasks.workunit.client.0.smithi005.stdout:1/8: fsync f0 0 2024-04-16T14:35:14.452 INFO:tasks.workunit.client.0.smithi005.stdout:1/9: write f0 [4066572,109662] 0 2024-04-16T14:35:14.459 INFO:tasks.workunit.client.0.smithi005.stdout:3/7: fsync f1 0 2024-04-16T14:35:14.471 INFO:tasks.workunit.client.0.smithi005.stdout:5/15: getdents d0 0 2024-04-16T14:35:14.480 INFO:tasks.workunit.client.0.smithi005.stdout:1/10: dwrite f0 [0,4194304] 0 2024-04-16T14:35:14.480 INFO:tasks.workunit.client.0.smithi005.stdout:1/11: chown d2 10527281 1 2024-04-16T14:35:14.480 INFO:tasks.workunit.client.0.smithi005.stdout:3/8: dwrite f1 [0,4194304] 0 2024-04-16T14:35:14.485 INFO:tasks.workunit.client.0.smithi005.stdout:4/15: unlink d0/c6 0 2024-04-16T14:35:14.485 INFO:tasks.workunit.client.0.smithi005.stdout:4/16: creat d0/f7 x:0 0 0 2024-04-16T14:35:14.485 INFO:tasks.workunit.client.0.smithi005.stdout:4/17: chown d0/f5 128797784 1 2024-04-16T14:35:14.485 INFO:tasks.workunit.client.0.smithi005.stdout:4/18: write d0/f5 [839513,3966] 0 2024-04-16T14:35:14.488 INFO:tasks.workunit.client.0.smithi005.stdout:8/10: getdents . 0 2024-04-16T14:35:14.489 INFO:tasks.workunit.client.0.smithi005.stdout:5/16: dwrite d0/f2 [0,4194304] 0 2024-04-16T14:35:14.494 INFO:tasks.workunit.client.0.smithi005.stdout:2/12: truncate d0/f2 3494326 0 2024-04-16T14:35:14.494 INFO:tasks.workunit.client.0.smithi005.stdout:2/13: chown d0/d4 12193413 1 2024-04-16T14:35:14.494 INFO:tasks.workunit.client.0.smithi005.stdout:2/14: creat d0/f5 x:0 0 0 2024-04-16T14:35:14.494 INFO:tasks.workunit.client.0.smithi005.stdout:2/15: write d0/f5 [788348,100032] 0 2024-04-16T14:35:14.500 INFO:tasks.workunit.client.0.smithi005.stdout:5/17: dread d0/f2 [0,4194304] 0 2024-04-16T14:35:14.500 INFO:tasks.workunit.client.0.smithi005.stdout:7/20: getdents d1/d5 0 2024-04-16T14:35:14.500 INFO:tasks.workunit.client.0.smithi005.stdout:7/21: chown d1/d5/c6 41 1 2024-04-16T14:35:14.500 INFO:tasks.workunit.client.0.smithi005.stdout:7/22: truncate - no filename 2024-04-16T14:35:14.500 INFO:tasks.workunit.client.0.smithi005.stdout:7/23: chown d1/d5 31912756 1 2024-04-16T14:35:14.500 INFO:tasks.workunit.client.0.smithi005.stdout:7/24: dwrite - no filename 2024-04-16T14:35:14.501 INFO:tasks.workunit.client.0.smithi005.stdout:7/25: dwrite - no filename 2024-04-16T14:35:14.503 INFO:tasks.workunit.client.0.smithi005.stdout:8/11: dwrite f0 [0,4194304] 0 2024-04-16T14:35:14.506 INFO:tasks.workunit.client.0.smithi005.stdout:5/18: read d0/f2 [151475,65605] 0 2024-04-16T14:35:14.511 INFO:tasks.workunit.client.0.smithi005.stdout:6/13: rename d2/l4 to d2/l6 0 2024-04-16T14:35:14.569 INFO:tasks.workunit.client.0.smithi005.stdout:0/7: link f0 f1 0 2024-04-16T14:35:14.569 INFO:tasks.workunit.client.0.smithi005.stdout:0/8: write f0 [1706790,68446] 0 2024-04-16T14:35:14.569 INFO:tasks.workunit.client.0.smithi005.stdout:0/9: write f0 [1854393,32623] 0 2024-04-16T14:35:14.573 INFO:tasks.workunit.client.0.smithi005.stdout:1/12: mkdir d2/d4 0 2024-04-16T14:35:14.573 INFO:tasks.workunit.client.0.smithi005.stdout:1/13: chown f0 453776220 1 2024-04-16T14:35:14.574 INFO:tasks.workunit.client.0.smithi005.stdout:1/14: fsync f0 0 2024-04-16T14:35:14.584 INFO:tasks.workunit.client.0.smithi005.stdout:0/10: dwrite f0 [0,4194304] 0 2024-04-16T14:35:14.586 INFO:tasks.workunit.client.0.smithi005.stdout:7/26: link d1/d5/c6 d1/d5/c7 0 2024-04-16T14:35:14.586 INFO:tasks.workunit.client.0.smithi005.stdout:7/27: chown d1 4 1 2024-04-16T14:35:14.589 INFO:tasks.workunit.client.0.smithi005.stdout:8/12: creat f3 x:0 0 0 2024-04-16T14:35:14.589 INFO:tasks.workunit.client.0.smithi005.stdout:8/13: creat f4 x:0 0 0 2024-04-16T14:35:14.591 INFO:tasks.workunit.client.0.smithi005.stdout:0/11: dread f1 [0,4194304] 0 2024-04-16T14:35:14.592 INFO:tasks.workunit.client.0.smithi005.stdout:5/19: mknod d0/c3 0 2024-04-16T14:35:14.592 INFO:tasks.workunit.client.0.smithi005.stdout:5/20: stat d0/f2 0 2024-04-16T14:35:14.592 INFO:tasks.workunit.client.0.smithi005.stdout:5/21: write d0/f2 [2605997,46123] 0 2024-04-16T14:35:14.593 INFO:tasks.workunit.client.0.smithi005.stdout:6/14: unlink d2/c3 0 2024-04-16T14:35:14.601 INFO:tasks.workunit.client.0.smithi005.stdout:1/15: unlink d2/l3 0 2024-04-16T14:35:14.607 INFO:tasks.workunit.client.0.smithi005.stdout:8/14: dwrite f0 [0,4194304] 0 2024-04-16T14:35:14.607 INFO:tasks.workunit.client.0.smithi005.stdout:8/15: truncate f0 4843151 0 2024-04-16T14:35:14.607 INFO:tasks.workunit.client.0.smithi005.stdout:7/28: mknod d1/c8 0 2024-04-16T14:35:14.609 INFO:tasks.workunit.client.0.smithi005.stdout:6/15: dwrite f0 [4194304,4194304] 0 2024-04-16T14:35:14.613 INFO:tasks.workunit.client.0.smithi005.stdout:1/16: symlink d2/d4/l5 0 2024-04-16T14:35:14.619 INFO:tasks.workunit.client.0.smithi005.stdout:6/16: creat d2/f7 x:0 0 0 2024-04-16T14:35:14.622 INFO:tasks.workunit.client.0.smithi005.stdout:8/16: dwrite f0 [4194304,4194304] 0 2024-04-16T14:35:14.623 INFO:tasks.workunit.client.0.smithi005.stdout:1/17: link f0 d2/d4/f6 0 2024-04-16T14:35:14.626 INFO:tasks.workunit.client.0.smithi005.stdout:7/29: mknod d1/d5/c9 0 2024-04-16T14:35:14.626 INFO:tasks.workunit.client.0.smithi005.stdout:7/30: dread - no filename 2024-04-16T14:35:14.626 INFO:tasks.workunit.client.0.smithi005.stdout:7/31: dread - no filename 2024-04-16T14:35:14.626 INFO:tasks.workunit.client.0.smithi005.stdout:7/32: fsync - no filename 2024-04-16T14:35:14.628 INFO:tasks.workunit.client.0.smithi005.stdout:6/17: creat d2/d5/f8 x:0 0 0 2024-04-16T14:35:14.630 INFO:tasks.workunit.client.0.smithi005.stdout:8/17: mkdir d5 0 2024-04-16T14:35:14.631 INFO:tasks.workunit.client.0.smithi005.stdout:7/33: creat d1/fa x:0 0 0 2024-04-16T14:35:14.631 INFO:tasks.workunit.client.0.smithi005.stdout:7/34: read - d1/fa zero size 2024-04-16T14:35:14.634 INFO:tasks.workunit.client.0.smithi005.stdout:1/18: dwrite f0 [4194304,4194304] 0 2024-04-16T14:35:14.635 INFO:tasks.workunit.client.0.smithi005.stdout:8/18: link f4 d5/f6 0 2024-04-16T14:35:14.635 INFO:tasks.workunit.client.0.smithi005.stdout:8/19: chown d5 120968050 1 2024-04-16T14:35:14.636 INFO:tasks.workunit.client.0.smithi005.stdout:8/20: read - d5/f6 zero size 2024-04-16T14:35:14.637 INFO:tasks.workunit.client.0.smithi005.stdout:7/35: unlink d1/c3 0 2024-04-16T14:35:14.641 INFO:tasks.workunit.client.0.smithi005.stdout:1/19: rename l1 to d2/l7 0 2024-04-16T14:35:14.643 INFO:tasks.workunit.client.0.smithi005.stdout:8/21: symlink d5/l7 0 2024-04-16T14:35:14.643 INFO:tasks.workunit.client.0.smithi005.stdout:8/22: chown l2 189828 1 2024-04-16T14:35:14.644 INFO:tasks.workunit.client.0.smithi005.stdout:7/36: rename d1 to d1/d5/db 22 2024-04-16T14:35:14.649 INFO:tasks.workunit.client.0.smithi005.stdout:8/23: mknod d5/c8 0 2024-04-16T14:35:14.649 INFO:tasks.workunit.client.0.smithi005.stdout:8/24: chown f4 1890957 1 2024-04-16T14:35:14.649 INFO:tasks.workunit.client.0.smithi005.stdout:8/25: readlink l2 0 2024-04-16T14:35:14.660 INFO:tasks.workunit.client.0.smithi005.stdout:7/37: dwrite d1/fa [0,4194304] 0 2024-04-16T14:35:14.667 INFO:tasks.workunit.client.0.smithi005.stdout:7/38: mkdir d1/dc 0 2024-04-16T14:35:14.675 INFO:tasks.workunit.client.0.smithi005.stdout:7/39: dread d1/fa [0,4194304] 0 2024-04-16T14:35:14.679 INFO:tasks.workunit.client.0.smithi005.stdout:7/40: symlink d1/d5/ld 0 2024-04-16T14:35:14.810 INFO:tasks.workunit.client.0.smithi005.stdout:4/19: rmdir d0 39 2024-04-16T14:35:14.810 INFO:tasks.workunit.client.0.smithi005.stdout:4/20: chown d0 46 1 2024-04-16T14:35:14.812 INFO:tasks.workunit.client.0.smithi005.stdout:4/21: link d0/f7 d0/f8 0 2024-04-16T14:35:14.814 INFO:tasks.workunit.client.0.smithi005.stdout:4/22: creat d0/f9 x:0 0 0 2024-04-16T14:35:14.816 INFO:tasks.workunit.client.0.smithi005.stdout:2/16: fsync d0/f5 0 2024-04-16T14:35:14.816 INFO:tasks.workunit.client.0.smithi005.stdout:2/17: readlink d0/l3 0 2024-04-16T14:35:14.818 INFO:tasks.workunit.client.0.smithi005.stdout:2/18: creat d0/d4/f6 x:0 0 0 2024-04-16T14:35:14.820 INFO:tasks.workunit.client.0.smithi005.stdout:2/19: mkdir d0/d4/d7 0 2024-04-16T14:35:14.829 INFO:tasks.workunit.client.0.smithi005.stdout:4/23: dwrite d0/f9 [0,4194304] 0 2024-04-16T14:35:14.842 INFO:tasks.workunit.client.0.smithi005.stdout:0/12: truncate f1 1531554 0 2024-04-16T14:35:14.844 INFO:tasks.workunit.client.0.smithi005.stdout:5/22: truncate d0/f2 3117362 0 2024-04-16T14:35:14.846 INFO:tasks.workunit.client.0.smithi005.stdout:1/20: fsync f0 0 2024-04-16T14:35:14.846 INFO:tasks.workunit.client.0.smithi005.stdout:1/21: rename d2/d4 to d2/d4/d8 22 2024-04-16T14:35:14.851 INFO:tasks.workunit.client.0.smithi005.stdout:6/18: rmdir d2 39 2024-04-16T14:35:14.851 INFO:tasks.workunit.client.0.smithi005.stdout:6/19: chown f0 217295 1 2024-04-16T14:35:14.861 INFO:tasks.workunit.client.0.smithi005.stdout:1/22: dwrite f0 [4194304,4194304] 0 2024-04-16T14:35:14.871 INFO:tasks.workunit.client.0.smithi005.stdout:1/23: write d2/d4/f6 [7471867,85243] 0 2024-04-16T14:35:14.872 INFO:tasks.workunit.client.0.smithi005.stdout:6/20: dwrite d2/f7 [0,4194304] 0 2024-04-16T14:35:14.872 INFO:tasks.workunit.client.0.smithi005.stdout:6/21: fsync d2/d5/f8 0 2024-04-16T14:35:14.878 INFO:tasks.workunit.client.0.smithi005.stdout:6/22: rmdir d2 39 2024-04-16T14:35:14.881 INFO:tasks.workunit.client.0.smithi005.stdout:6/23: symlink d2/d5/l9 0 2024-04-16T14:35:14.885 INFO:tasks.workunit.client.0.smithi005.stdout:6/24: getdents d2 0 2024-04-16T14:35:14.885 INFO:tasks.workunit.client.0.smithi005.stdout:6/25: read - d2/d5/f8 zero size 2024-04-16T14:35:14.885 INFO:tasks.workunit.client.0.smithi005.stdout:6/26: truncate d2/f7 5106297 0 2024-04-16T14:35:14.905 INFO:tasks.workunit.client.0.smithi005.stdout:7/41: dwrite d1/fa [4194304,4194304] 0 2024-04-16T14:35:14.905 INFO:tasks.workunit.client.0.smithi005.stdout:6/27: dwrite d2/d5/f8 [0,4194304] 0 2024-04-16T14:35:14.913 INFO:tasks.workunit.client.0.smithi005.stdout:7/42: dread d1/fa [4194304,4194304] 0 2024-04-16T14:35:14.913 INFO:tasks.workunit.client.0.smithi005.stdout:6/28: mkdir d2/da 0 2024-04-16T14:35:14.916 INFO:tasks.workunit.client.0.smithi005.stdout:7/43: dread d1/fa [0,4194304] 0 2024-04-16T14:35:14.997 INFO:tasks.workunit.client.0.smithi005.stdout:7/44: mknod d1/dc/ce 0 2024-04-16T14:35:14.997 INFO:tasks.workunit.client.0.smithi005.stdout:7/45: chown d1/c8 147437 1 2024-04-16T14:35:15.103 INFO:tasks.workunit.client.0.smithi005.stdout:4/24: truncate d0/f9 237951 0 2024-04-16T14:35:15.103 INFO:tasks.workunit.client.0.smithi005.stdout:4/25: creat d0/fa x:0 0 0 2024-04-16T14:35:15.103 INFO:tasks.workunit.client.0.smithi005.stdout:4/26: stat d0/c3 0 2024-04-16T14:35:15.103 INFO:tasks.workunit.client.0.smithi005.stdout:4/27: creat d0/fb x:0 0 0 2024-04-16T14:35:15.103 INFO:tasks.workunit.client.0.smithi005.stdout:4/28: dread - d0/f8 zero size 2024-04-16T14:35:15.109 INFO:tasks.workunit.client.0.smithi005.stdout:4/29: symlink d0/lc 0 2024-04-16T14:35:15.117 INFO:tasks.workunit.client.0.smithi005.stdout:0/13: read f0 [203573,1801] 0 2024-04-16T14:35:15.118 INFO:tasks.workunit.client.0.smithi005.stdout:0/14: readlink - no filename 2024-04-16T14:35:15.122 INFO:tasks.workunit.client.0.smithi005.stdout:5/23: dread d0/f2 [0,4194304] 0 2024-04-16T14:35:15.123 INFO:tasks.workunit.client.0.smithi005.stdout:5/24: fdatasync d0/f2 0 2024-04-16T14:35:15.124 INFO:tasks.workunit.client.0.smithi005.stdout:5/25: rmdir d0 39 2024-04-16T14:35:15.128 INFO:tasks.workunit.client.0.smithi005.stdout:5/26: mknod d0/c4 0 2024-04-16T14:35:15.130 INFO:tasks.workunit.client.0.smithi005.stdout:5/27: link d0/c1 d0/c5 0 2024-04-16T14:35:15.132 INFO:tasks.workunit.client.0.smithi005.stdout:0/15: dwrite f0 [0,4194304] 0 2024-04-16T14:35:15.134 INFO:tasks.workunit.client.0.smithi005.stdout:5/28: dread d0/f2 [0,4194304] 0 2024-04-16T14:35:15.135 INFO:tasks.workunit.client.0.smithi005.stdout:5/29: chown d0 1599135 1 2024-04-16T14:35:15.137 INFO:tasks.workunit.client.0.smithi005.stdout:0/16: mknod c2 0 2024-04-16T14:35:15.138 INFO:tasks.workunit.client.0.smithi005.stdout:5/30: mkdir d0/d6 0 2024-04-16T14:35:15.138 INFO:tasks.workunit.client.0.smithi005.stdout:5/31: write d0/f2 [3783419,90688] 0 2024-04-16T14:35:15.138 INFO:tasks.workunit.client.0.smithi005.stdout:5/32: read d0/f2 [2674677,65309] 0 2024-04-16T14:35:15.140 INFO:tasks.workunit.client.0.smithi005.stdout:5/33: fsync d0/f2 0 2024-04-16T14:35:15.145 INFO:tasks.workunit.client.0.smithi005.stdout:1/24: truncate f0 6344902 0 2024-04-16T14:35:15.148 INFO:tasks.workunit.client.0.smithi005.stdout:0/17: dwrite f1 [4194304,4194304] 0 2024-04-16T14:35:15.148 INFO:tasks.workunit.client.0.smithi005.stdout:0/18: chown f0 145083 1 2024-04-16T14:35:15.148 INFO:tasks.workunit.client.0.smithi005.stdout:0/19: creat f3 x:0 0 0 2024-04-16T14:35:15.162 INFO:tasks.workunit.client.0.smithi005.stdout:0/20: dwrite f1 [0,4194304] 0 2024-04-16T14:35:15.162 INFO:tasks.workunit.client.0.smithi005.stdout:0/21: creat f4 x:0 0 0 2024-04-16T14:35:15.179 INFO:tasks.workunit.client.0.smithi005.stdout:6/29: truncate f0 1836390 0 2024-04-16T14:35:15.274 INFO:tasks.workunit.client.0.smithi005.stdout:4/30: getdents d0 0 2024-04-16T14:35:15.274 INFO:tasks.workunit.client.0.smithi005.stdout:4/31: dread - d0/f8 zero size 2024-04-16T14:35:15.274 INFO:tasks.workunit.client.0.smithi005.stdout:4/32: dread - d0/f8 zero size 2024-04-16T14:35:15.277 INFO:tasks.workunit.client.0.smithi005.stdout:4/33: creat d0/fd x:0 0 0 2024-04-16T14:35:15.277 INFO:tasks.workunit.client.0.smithi005.stdout:4/34: dread - d0/fd zero size 2024-04-16T14:35:15.279 INFO:tasks.workunit.client.0.smithi005.stdout:4/35: truncate d0/fa 714149 0 2024-04-16T14:35:15.283 INFO:tasks.workunit.client.0.smithi005.stdout:4/36: dread d0/f9 [0,4194304] 0 2024-04-16T14:35:15.285 INFO:tasks.workunit.client.0.smithi005.stdout:4/37: symlink d0/le 0 2024-04-16T14:35:15.290 INFO:tasks.workunit.client.0.smithi005.stdout:4/38: dread d0/f5 [0,4194304] 0 2024-04-16T14:35:15.308 INFO:tasks.workunit.client.0.smithi005.stdout:0/22: fsync f3 0 2024-04-16T14:35:15.308 INFO:tasks.workunit.client.0.smithi005.stdout:0/23: dread - f4 zero size 2024-04-16T14:35:15.313 INFO:tasks.workunit.client.0.smithi005.stdout:1/25: dread d2/d4/f6 [0,4194304] 0 2024-04-16T14:35:15.313 INFO:tasks.workunit.client.0.smithi005.stdout:4/39: dwrite d0/f8 [0,4194304] 0 2024-04-16T14:35:15.315 INFO:tasks.workunit.client.0.smithi005.stdout:1/26: rmdir d2/d4 39 2024-04-16T14:35:15.315 INFO:tasks.workunit.client.0.smithi005.stdout:1/27: write f0 [5291502,105746] 0 2024-04-16T14:35:15.315 INFO:tasks.workunit.client.0.smithi005.stdout:1/28: rename d2 to d2/d9 22 2024-04-16T14:35:15.322 INFO:tasks.workunit.client.0.smithi005.stdout:1/29: mknod d2/d4/ca 0 2024-04-16T14:35:15.327 INFO:tasks.workunit.client.0.smithi005.stdout:4/40: dread d0/f7 [0,4194304] 0 2024-04-16T14:35:15.329 INFO:tasks.workunit.client.0.smithi005.stdout:4/41: truncate d0/fb 856912 0 2024-04-16T14:35:15.334 INFO:tasks.workunit.client.0.smithi005.stdout:4/42: dread d0/f8 [0,4194304] 0 2024-04-16T14:35:15.337 INFO:tasks.workunit.client.0.smithi005.stdout:4/43: symlink d0/lf 0 2024-04-16T14:35:15.338 INFO:tasks.workunit.client.0.smithi005.stdout:4/44: unlink d0/f8 0 2024-04-16T14:35:15.445 INFO:tasks.workunit.client.0.smithi005.stdout:6/30: write f0 [894122,27345] 0 2024-04-16T14:35:15.449 INFO:tasks.workunit.client.0.smithi005.stdout:6/31: rename d2/d5/l9 to d2/da/lb 0 2024-04-16T14:35:15.449 INFO:tasks.workunit.client.0.smithi005.stdout:6/32: stat d2/da 0 2024-04-16T14:35:15.452 INFO:tasks.workunit.client.0.smithi005.stdout:6/33: rename d2/f7 to d2/d5/fc 0 2024-04-16T14:35:15.454 INFO:tasks.workunit.client.0.smithi005.stdout:4/45: dwrite d0/fa [0,4194304] 0 2024-04-16T14:35:15.454 INFO:tasks.workunit.client.0.smithi005.stdout:1/30: dwrite f0 [4194304,4194304] 0 2024-04-16T14:35:15.464 INFO:tasks.workunit.client.0.smithi005.stdout:4/46: creat d0/f10 x:0 0 0 2024-04-16T14:35:15.464 INFO:tasks.workunit.client.0.smithi005.stdout:4/47: chown d0/f9 367 1 2024-04-16T14:35:15.469 INFO:tasks.workunit.client.0.smithi005.stdout:4/48: unlink d0/c3 0 2024-04-16T14:35:15.471 INFO:tasks.workunit.client.0.smithi005.stdout:1/31: dwrite f0 [0,4194304] 0 2024-04-16T14:35:15.473 INFO:tasks.workunit.client.0.smithi005.stdout:4/49: mknod d0/c11 0 2024-04-16T14:35:15.476 INFO:tasks.workunit.client.0.smithi005.stdout:1/32: unlink d2/l7 0 2024-04-16T14:35:15.480 INFO:tasks.workunit.client.0.smithi005.stdout:1/33: creat d2/fb x:0 0 0 2024-04-16T14:35:15.484 INFO:tasks.workunit.client.0.smithi005.stdout:4/50: dwrite d0/f5 [0,4194304] 0 2024-04-16T14:35:15.489 INFO:tasks.workunit.client.0.smithi005.stdout:1/34: read d2/d4/f6 [832223,103515] 0 2024-04-16T14:35:15.489 INFO:tasks.workunit.client.0.smithi005.stdout:1/35: chown d2 62620 1 2024-04-16T14:35:15.491 INFO:tasks.workunit.client.0.smithi005.stdout:1/36: symlink d2/lc 0 2024-04-16T14:35:15.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:15 smithi115 ceph-mon[37295]: pgmap v12: 65 pgs: 65 active+clean; 141 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 7.0 MiB/s wr, 580 op/s 2024-04-16T14:35:15.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:15 smithi005 ceph-mon[28964]: pgmap v12: 65 pgs: 65 active+clean; 141 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 7.0 MiB/s wr, 580 op/s 2024-04-16T14:35:15.850 INFO:tasks.workunit.client.0.smithi005.stdout:6/34: unlink d2/d5/fc 0 2024-04-16T14:35:15.853 INFO:tasks.workunit.client.0.smithi005.stdout:6/35: unlink d2/da/lb 0 2024-04-16T14:35:15.861 INFO:tasks.workunit.client.0.smithi005.stdout:4/51: truncate d0/fa 3121160 0 2024-04-16T14:35:15.861 INFO:tasks.workunit.client.0.smithi005.stdout:4/52: fsync d0/f7 0 2024-04-16T14:35:15.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.882+0000 7f6f52a0e700 1 -- 172.21.15.5:0/1707334242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4c06e9b0 msgr2=0x7f6f4c06ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:15.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.882+0000 7f6f52a0e700 1 --2- 172.21.15.5:0/1707334242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4c06e9b0 0x7f6f4c06ee20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6f40004940 tx=0x7f6f40009e30 comp rx=0 tx=0).stop 2024-04-16T14:35:15.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.883+0000 7f6f52a0e700 1 -- 172.21.15.5:0/1707334242 shutdown_connections 2024-04-16T14:35:15.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.883+0000 7f6f52a0e700 1 --2- 172.21.15.5:0/1707334242 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4c06e9b0 0x7f6f4c06ee20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:15.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.883+0000 7f6f52a0e700 1 --2- 172.21.15.5:0/1707334242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f4c06f9c0 0x7f6f4c06e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:15.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.883+0000 7f6f52a0e700 1 -- 172.21.15.5:0/1707334242 >> 172.21.15.5:0/1707334242 conn(0x7f6f4c069df0 msgr2=0x7f6f4c06c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:15.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.885+0000 7f6f52a0e700 1 -- 172.21.15.5:0/1707334242 shutdown_connections 2024-04-16T14:35:15.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.886+0000 7f6f52a0e700 1 -- 172.21.15.5:0/1707334242 wait complete. 2024-04-16T14:35:15.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.887+0000 7f6f52a0e700 1 Processor -- start 2024-04-16T14:35:15.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.887+0000 7f6f52a0e700 1 -- start start 2024-04-16T14:35:15.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.887+0000 7f6f52a0e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f4c06e9b0 0x7f6f4c11c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:15.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.887+0000 7f6f52a0e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4c06f9c0 0x7f6f4c11cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:15.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.887+0000 7f6f52a0e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c11d230 con 0x7f6f4c06f9c0 2024-04-16T14:35:15.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.887+0000 7f6f52a0e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c11d3a0 con 0x7f6f4c06e9b0 2024-04-16T14:35:15.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.888+0000 7f6f4b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4c06f9c0 0x7f6f4c11cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:15.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.888+0000 7f6f4b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4c06f9c0 0x7f6f4c11cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34718/0 (socket says 172.21.15.5:34718) 2024-04-16T14:35:15.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.888+0000 7f6f4b7fe700 1 -- 172.21.15.5:0/1094813337 learned_addr learned my addr 172.21.15.5:0/1094813337 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:35:15.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.889+0000 7f6f4b7fe700 1 -- 172.21.15.5:0/1094813337 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f4c06e9b0 msgr2=0x7f6f4c11c6f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-16T14:35:15.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.889+0000 7f6f4b7fe700 1 --2- 172.21.15.5:0/1094813337 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f4c06e9b0 0x7f6f4c11c6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:15.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.889+0000 7f6f4b7fe700 1 -- 172.21.15.5:0/1094813337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f40005040 con 0x7f6f4c06f9c0 2024-04-16T14:35:15.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.889+0000 7f6f4b7fe700 1 --2- 172.21.15.5:0/1094813337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4c06f9c0 0x7f6f4c11cc30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6f4000b970 tx=0x7f6f40009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:15.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.890+0000 7f6f48ff9700 1 -- 172.21.15.5:0/1094813337 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f4000e030 con 0x7f6f4c06f9c0 2024-04-16T14:35:15.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.890+0000 7f6f48ff9700 1 -- 172.21.15.5:0/1094813337 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6f40013420 con 0x7f6f4c06f9c0 2024-04-16T14:35:15.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.891+0000 7f6f52a0e700 1 -- 172.21.15.5:0/1094813337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f4c121da0 con 0x7f6f4c06f9c0 2024-04-16T14:35:15.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.891+0000 7f6f52a0e700 1 -- 172.21.15.5:0/1094813337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f4c122330 con 0x7f6f4c06f9c0 2024-04-16T14:35:15.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.891+0000 7f6f48ff9700 1 -- 172.21.15.5:0/1094813337 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f4000bee0 con 0x7f6f4c06f9c0 2024-04-16T14:35:15.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.893+0000 7f6f52a0e700 1 -- 172.21.15.5:0/1094813337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f4c04c710 con 0x7f6f4c06f9c0 2024-04-16T14:35:15.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.893+0000 7f6f48ff9700 1 -- 172.21.15.5:0/1094813337 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 89381+0+0 (secure 0 0 0) 0x7f6f40013a20 con 0x7f6f4c06f9c0 2024-04-16T14:35:15.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.894+0000 7f6f48ff9700 1 --2- 172.21.15.5:0/1094813337 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f6f3406b8a0 0x7f6f3406dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:15.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.894+0000 7f6f48ff9700 1 -- 172.21.15.5:0/1094813337 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f6f4008bc20 con 0x7f6f4c06f9c0 2024-04-16T14:35:15.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.896+0000 7f6f4bfff700 1 --2- 172.21.15.5:0/1094813337 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f6f3406b8a0 0x7f6f3406dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:15.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.900+0000 7f6f4bfff700 1 --2- 172.21.15.5:0/1094813337 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f6f3406b8a0 0x7f6f3406dd50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c004ad0 tx=0x7f6f3c007d40 comp rx=0 tx=0).ready entity=mgr.14616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:15.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:15.907+0000 7f6f48ff9700 1 -- 172.21.15.5:0/1094813337 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f6f40059350 con 0x7f6f4c06f9c0 2024-04-16T14:35:15.916 INFO:tasks.workunit.client.0.smithi005.stdout:1/37: getdents d2 0 2024-04-16T14:35:16.124 INFO:tasks.workunit.client.0.smithi005.stdout:4/53: dwrite d0/f7 [0,4194304] 0 2024-04-16T14:35:16.124 INFO:tasks.workunit.client.0.smithi005.stdout:4/54: fdatasync d0/f10 0 2024-04-16T14:35:16.167 INFO:tasks.workunit.client.0.smithi005.stdout:1/38: dread d2/d4/f6 [0,4194304] 0 2024-04-16T14:35:16.167 INFO:tasks.workunit.client.0.smithi005.stdout:1/39: readlink d2/lc 0 2024-04-16T14:35:16.167 INFO:tasks.workunit.client.0.smithi005.stdout:1/40: chown d2/lc 1878512261 1 2024-04-16T14:35:16.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.306+0000 7f6f52a0e700 1 -- 172.21.15.5:0/1094813337 --> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f4c108100 con 0x7f6f3406b8a0 2024-04-16T14:35:16.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.311+0000 7f6f48ff9700 1 -- 172.21.15.5:0/1094813337 <== mgr.14616 v2:172.21.15.115:6828/460631486 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f6f4c108100 con 0x7f6f3406b8a0 2024-04-16T14:35:16.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.316+0000 7f6f52a0e700 1 -- 172.21.15.5:0/1094813337 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f6f3406b8a0 msgr2=0x7f6f3406dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:16.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.316+0000 7f6f52a0e700 1 --2- 172.21.15.5:0/1094813337 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f6f3406b8a0 0x7f6f3406dd50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c004ad0 tx=0x7f6f3c007d40 comp rx=0 tx=0).stop 2024-04-16T14:35:16.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.316+0000 7f6f52a0e700 1 -- 172.21.15.5:0/1094813337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4c06f9c0 msgr2=0x7f6f4c11cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:16.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.316+0000 7f6f52a0e700 1 --2- 172.21.15.5:0/1094813337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4c06f9c0 0x7f6f4c11cc30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6f4000b970 tx=0x7f6f40009e30 comp rx=0 tx=0).stop 2024-04-16T14:35:16.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.316+0000 7f6f52a0e700 1 -- 172.21.15.5:0/1094813337 shutdown_connections 2024-04-16T14:35:16.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.316+0000 7f6f52a0e700 1 --2- 172.21.15.5:0/1094813337 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f6f3406b8a0 0x7f6f3406dd50 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c004ad0 tx=0x7f6f3c007d40 comp rx=0 tx=0).stop 2024-04-16T14:35:16.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.316+0000 7f6f52a0e700 1 --2- 172.21.15.5:0/1094813337 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f4c06e9b0 0x7f6f4c11c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:16.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.316+0000 7f6f52a0e700 1 --2- 172.21.15.5:0/1094813337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f4c06f9c0 0x7f6f4c11cc30 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:16.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.316+0000 7f6f52a0e700 1 -- 172.21.15.5:0/1094813337 >> 172.21.15.5:0/1094813337 conn(0x7f6f4c069df0 msgr2=0x7f6f4c06b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:16.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.317+0000 7f6f52a0e700 1 -- 172.21.15.5:0/1094813337 shutdown_connections 2024-04-16T14:35:16.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.317+0000 7f6f52a0e700 1 -- 172.21.15.5:0/1094813337 wait complete. 2024-04-16T14:35:16.323 INFO:tasks.workunit.client.0.smithi005.stdout:4/55: creat d0/f12 x:0 0 0 2024-04-16T14:35:16.323 INFO:tasks.workunit.client.0.smithi005.stdout:4/56: readlink d0/lf 0 2024-04-16T14:35:16.328 INFO:tasks.workunit.client.0.smithi005.stdout:4/57: dread d0/fb [0,4194304] 0 2024-04-16T14:35:16.335 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-04-16T14:35:16.380 INFO:tasks.workunit.client.0.smithi005.stdout:1/41: creat d2/d4/fd x:0 0 0 2024-04-16T14:35:16.380 INFO:tasks.workunit.client.0.smithi005.stdout:1/42: write d2/d4/f6 [1735658,65848] 0 2024-04-16T14:35:16.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.520+0000 7fd742f26700 1 -- 172.21.15.5:0/4856017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0fce20 msgr2=0x7fd73c0fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:16.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.520+0000 7fd742f26700 1 --2- 172.21.15.5:0/4856017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0fce20 0x7fd73c0fd290 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd738004dd0 tx=0x7fd7380048d0 comp rx=0 tx=0).stop 2024-04-16T14:35:16.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.521+0000 7fd742f26700 1 -- 172.21.15.5:0/4856017 shutdown_connections 2024-04-16T14:35:16.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.521+0000 7fd742f26700 1 --2- 172.21.15.5:0/4856017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0fce20 0x7fd73c0fd290 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd738004dd0 tx=0x7fd7380048d0 comp rx=0 tx=0).stop 2024-04-16T14:35:16.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.521+0000 7fd742f26700 1 --2- 172.21.15.5:0/4856017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c0fbb70 0x7fd73c0fbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:16.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.521+0000 7fd742f26700 1 -- 172.21.15.5:0/4856017 >> 172.21.15.5:0/4856017 conn(0x7fd73c0f72d0 msgr2=0x7fd73c0f9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:16.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.526+0000 7fd742f26700 1 -- 172.21.15.5:0/4856017 shutdown_connections 2024-04-16T14:35:16.525 INFO:tasks.workunit.client.0.smithi005.stdout:1/43: dread d2/d4/f6 [4194304,4194304] 0 2024-04-16T14:35:16.525 INFO:tasks.workunit.client.0.smithi005.stdout:1/44: chown d2/d4/fd 56322150 1 2024-04-16T14:35:16.525 INFO:tasks.workunit.client.0.smithi005.stdout:1/45: dread - d2/d4/fd zero size 2024-04-16T14:35:16.525 INFO:tasks.workunit.client.0.smithi005.stdout:1/46: write d2/d4/fd [824556,6046] 0 2024-04-16T14:35:16.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.527+0000 7fd742f26700 1 -- 172.21.15.5:0/4856017 wait complete. 2024-04-16T14:35:16.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.528+0000 7fd742f26700 1 Processor -- start 2024-04-16T14:35:16.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.528+0000 7fd742f26700 1 -- start start 2024-04-16T14:35:16.526 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.528+0000 7fd742f26700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0fbb70 0x7fd73c10b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:16.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.529+0000 7fd742f26700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c10bd30 0x7fd73c10cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:16.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.529+0000 7fd742f26700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c10c1f0 con 0x7fd73c10bd30 2024-04-16T14:35:16.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.529+0000 7fd742f26700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c10c360 con 0x7fd73c0fbb70 2024-04-16T14:35:16.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.531+0000 7fd741f24700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0fbb70 0x7fd73c10b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:16.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.531+0000 7fd741f24700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0fbb70 0x7fd73c10b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.5:40816/0 (socket says 172.21.15.5:40816) 2024-04-16T14:35:16.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.531+0000 7fd741f24700 1 -- 172.21.15.5:0/3150359320 learned_addr learned my addr 172.21.15.5:0/3150359320 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:35:16.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.532+0000 7fd741723700 1 --2- 172.21.15.5:0/3150359320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c10bd30 0x7fd73c10cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:16.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.532+0000 7fd741723700 1 -- 172.21.15.5:0/3150359320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0fbb70 msgr2=0x7fd73c10b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:16.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.532+0000 7fd741723700 1 --2- 172.21.15.5:0/3150359320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0fbb70 0x7fd73c10b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:16.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.532+0000 7fd741723700 1 -- 172.21.15.5:0/3150359320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd738005040 con 0x7fd73c10bd30 2024-04-16T14:35:16.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.532+0000 7fd741723700 1 --2- 172.21.15.5:0/3150359320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c10bd30 0x7fd73c10cb80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd73800a000 tx=0x7fd7380048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:16.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.535+0000 7fd7327fc700 1 -- 172.21.15.5:0/3150359320 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd738021070 con 0x7fd73c10bd30 2024-04-16T14:35:16.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.535+0000 7fd7327fc700 1 -- 172.21.15.5:0/3150359320 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd73800deb0 con 0x7fd73c10bd30 2024-04-16T14:35:16.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.535+0000 7fd742f26700 1 -- 172.21.15.5:0/3150359320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd73c10d180 con 0x7fd73c10bd30 2024-04-16T14:35:16.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.535+0000 7fd742f26700 1 -- 172.21.15.5:0/3150359320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd73c10d5a0 con 0x7fd73c10bd30 2024-04-16T14:35:16.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.535+0000 7fd7327fc700 1 -- 172.21.15.5:0/3150359320 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd738010040 con 0x7fd73c10bd30 2024-04-16T14:35:16.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.537+0000 7fd7327fc700 1 -- 172.21.15.5:0/3150359320 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 89381+0+0 (secure 0 0 0) 0x7fd73800b700 con 0x7fd73c10bd30 2024-04-16T14:35:16.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.538+0000 7fd7327fc700 1 --2- 172.21.15.5:0/3150359320 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fd72806b970 0x7fd72806de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:16.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.538+0000 7fd7327fc700 1 -- 172.21.15.5:0/3150359320 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fd73808b7b0 con 0x7fd73c10bd30 2024-04-16T14:35:16.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.540+0000 7fd741f24700 1 --2- 172.21.15.5:0/3150359320 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fd72806b970 0x7fd72806de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:16.539 INFO:tasks.workunit.client.0.smithi005.stdout:1/47: link d2/d4/f6 d2/d4/fe 0 2024-04-16T14:35:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.541+0000 7fd741f24700 1 --2- 172.21.15.5:0/3150359320 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fd72806b970 0x7fd72806de20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd73c10b580 tx=0x7fd72c00b040 comp rx=0 tx=0).ready entity=mgr.14616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:16.540 INFO:tasks.workunit.client.0.smithi005.stdout:6/36: truncate f0 1442636 0 2024-04-16T14:35:16.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.542+0000 7fd742f26700 1 -- 172.21.15.5:0/3150359320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7200052e0 con 0x7fd73c10bd30 2024-04-16T14:35:16.546 INFO:tasks.workunit.client.0.smithi005.stdout:1/48: link f0 d2/d4/ff 0 2024-04-16T14:35:16.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:16.554+0000 7fd7327fc700 1 -- 172.21.15.5:0/3150359320 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7fd7380552f0 con 0x7fd73c10bd30 2024-04-16T14:35:16.639 INFO:tasks.workunit.client.0.smithi005.stdout:1/49: dread d2/d4/f6 [0,4194304] 0 2024-04-16T14:35:16.655 INFO:tasks.workunit.client.0.smithi005.stdout:1/50: rmdir d2 39 2024-04-16T14:35:16.711 INFO:tasks.workunit.client.0.smithi005.stdout:1/51: dwrite f0 [4194304,4194304] 0 2024-04-16T14:35:16.711 INFO:tasks.workunit.client.0.smithi005.stdout:1/52: dread - d2/fb zero size 2024-04-16T14:35:17.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.007+0000 7fd742f26700 1 -- 172.21.15.5:0/3150359320 --> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd720000bf0 con 0x7fd72806b970 2024-04-16T14:35:17.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.009+0000 7fd7327fc700 1 -- 172.21.15.5:0/3150359320 <== mgr.14616 v2:172.21.15.115:6828/460631486 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fd720000bf0 con 0x7fd72806b970 2024-04-16T14:35:17.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.011+0000 7fd742f26700 1 -- 172.21.15.5:0/3150359320 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fd72806b970 msgr2=0x7fd72806de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:17.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.011+0000 7fd742f26700 1 --2- 172.21.15.5:0/3150359320 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fd72806b970 0x7fd72806de20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd73c10b580 tx=0x7fd72c00b040 comp rx=0 tx=0).stop 2024-04-16T14:35:17.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.011+0000 7fd742f26700 1 -- 172.21.15.5:0/3150359320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c10bd30 msgr2=0x7fd73c10cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:17.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.011+0000 7fd742f26700 1 --2- 172.21.15.5:0/3150359320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c10bd30 0x7fd73c10cb80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd73800a000 tx=0x7fd7380048d0 comp rx=0 tx=0).stop 2024-04-16T14:35:17.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.011+0000 7fd742f26700 1 -- 172.21.15.5:0/3150359320 shutdown_connections 2024-04-16T14:35:17.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.011+0000 7fd742f26700 1 --2- 172.21.15.5:0/3150359320 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fd72806b970 0x7fd72806de20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:17.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.011+0000 7fd742f26700 1 --2- 172.21.15.5:0/3150359320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd73c0fbb70 0x7fd73c10b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:17.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.011+0000 7fd742f26700 1 --2- 172.21.15.5:0/3150359320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd73c10bd30 0x7fd73c10cb80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:17.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.011+0000 7fd742f26700 1 -- 172.21.15.5:0/3150359320 >> 172.21.15.5:0/3150359320 conn(0x7fd73c0f72d0 msgr2=0x7fd73c0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:17.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.011+0000 7fd742f26700 1 -- 172.21.15.5:0/3150359320 shutdown_connections 2024-04-16T14:35:17.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.011+0000 7fd742f26700 1 -- 172.21.15.5:0/3150359320 wait complete. 2024-04-16T14:35:17.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.116+0000 7f12e7e32700 1 -- 172.21.15.5:0/3693395137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12e00fcff0 msgr2=0x7f12e00fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:17.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.116+0000 7f12e7e32700 1 --2- 172.21.15.5:0/3693395137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12e00fcff0 0x7f12e00fd460 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f12d0004940 tx=0x7f12d0009e30 comp rx=0 tx=0).stop 2024-04-16T14:35:17.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.116+0000 7f12e7e32700 1 -- 172.21.15.5:0/3693395137 shutdown_connections 2024-04-16T14:35:17.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.116+0000 7f12e7e32700 1 --2- 172.21.15.5:0/3693395137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12e00fcff0 0x7f12e00fd460 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:17.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.116+0000 7f12e7e32700 1 --2- 172.21.15.5:0/3693395137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12e00fbd40 0x7f12e00fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:17.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.116+0000 7f12e7e32700 1 -- 172.21.15.5:0/3693395137 >> 172.21.15.5:0/3693395137 conn(0x7f12e00f74c0 msgr2=0x7f12e00f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:17.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.116+0000 7f12e7e32700 1 -- 172.21.15.5:0/3693395137 shutdown_connections 2024-04-16T14:35:17.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.116+0000 7f12e7e32700 1 -- 172.21.15.5:0/3693395137 wait complete. 2024-04-16T14:35:17.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.117+0000 7f12e7e32700 1 Processor -- start 2024-04-16T14:35:17.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.117+0000 7f12e7e32700 1 -- start start 2024-04-16T14:35:17.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.117+0000 7f12e7e32700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12e00fbd40 0x7f12e0112ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:17.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.117+0000 7f12e7e32700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12e00fcff0 0x7f12e0115030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:17.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.117+0000 7f12e7e32700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e0066250 con 0x7f12e00fbd40 2024-04-16T14:35:17.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.117+0000 7f12e7e32700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e0066390 con 0x7f12e00fcff0 2024-04-16T14:35:17.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.117+0000 7f12e5bce700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12e00fbd40 0x7f12e0112ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:17.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.117+0000 7f12e5bce700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12e00fbd40 0x7f12e0112ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34778/0 (socket says 172.21.15.5:34778) 2024-04-16T14:35:17.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.117+0000 7f12e5bce700 1 -- 172.21.15.5:0/423519500 learned_addr learned my addr 172.21.15.5:0/423519500 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:35:17.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.117+0000 7f12e53cd700 1 --2- 172.21.15.5:0/423519500 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12e00fcff0 0x7f12e0115030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:17.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.117+0000 7f12e5bce700 1 -- 172.21.15.5:0/423519500 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12e00fcff0 msgr2=0x7f12e0115030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:17.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.117+0000 7f12e5bce700 1 --2- 172.21.15.5:0/423519500 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12e00fcff0 0x7f12e0115030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:17.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.117+0000 7f12e5bce700 1 -- 172.21.15.5:0/423519500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d0005040 con 0x7f12e00fbd40 2024-04-16T14:35:17.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.118+0000 7f12e5bce700 1 --2- 172.21.15.5:0/423519500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12e00fbd40 0x7f12e0112ae0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f12dc00eb70 tx=0x7f12dc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:17.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.118+0000 7f12d67fc700 1 -- 172.21.15.5:0/423519500 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12dc007cc0 con 0x7f12e00fbd40 2024-04-16T14:35:17.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.118+0000 7f12e7e32700 1 -- 172.21.15.5:0/423519500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e0115570 con 0x7f12e00fbd40 2024-04-16T14:35:17.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.118+0000 7f12d67fc700 1 -- 172.21.15.5:0/423519500 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f12dc00f040 con 0x7f12e00fbd40 2024-04-16T14:35:17.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.118+0000 7f12d67fc700 1 -- 172.21.15.5:0/423519500 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12dc00ca90 con 0x7f12e00fbd40 2024-04-16T14:35:17.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.118+0000 7f12e7e32700 1 -- 172.21.15.5:0/423519500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e01158c0 con 0x7f12e00fbd40 2024-04-16T14:35:17.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.119+0000 7f12e7e32700 1 -- 172.21.15.5:0/423519500 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e005f5f0 con 0x7f12e00fbd40 2024-04-16T14:35:17.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.120+0000 7f12d67fc700 1 -- 172.21.15.5:0/423519500 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 89381+0+0 (secure 0 0 0) 0x7f12dc00cbf0 con 0x7f12e00fbd40 2024-04-16T14:35:17.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.120+0000 7f12d67fc700 1 --2- 172.21.15.5:0/423519500 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f12cc06b790 0x7f12cc06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:17.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.120+0000 7f12d67fc700 1 -- 172.21.15.5:0/423519500 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f12dc089ff0 con 0x7f12e00fbd40 2024-04-16T14:35:17.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.120+0000 7f12e53cd700 1 --2- 172.21.15.5:0/423519500 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f12cc06b790 0x7f12cc06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:17.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.121+0000 7f12e53cd700 1 --2- 172.21.15.5:0/423519500 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f12cc06b790 0x7f12cc06dc40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f12d0009b30 tx=0x7f12d0009e30 comp rx=0 tx=0).ready entity=mgr.14616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:17.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.125+0000 7f12d67fc700 1 -- 172.21.15.5:0/423519500 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f12dc053ab0 con 0x7f12e00fbd40 2024-04-16T14:35:17.324 INFO:tasks.workunit.client.0.smithi005.stdout:6/37: dread f0 [0,4194304] 0 2024-04-16T14:35:17.328 INFO:tasks.workunit.client.0.smithi005.stdout:6/38: creat d2/fd x:0 0 0 2024-04-16T14:35:17.329 INFO:tasks.workunit.client.0.smithi005.stdout:6/39: write f0 [831518,93088] 0 2024-04-16T14:35:17.354 INFO:tasks.workunit.client.0.smithi005.stdout:6/40: dwrite f0 [0,4194304] 0 2024-04-16T14:35:17.372 INFO:tasks.workunit.client.0.smithi005.stdout:6/41: dwrite d2/d5/f8 [0,4194304] 0 2024-04-16T14:35:17.372 INFO:tasks.workunit.client.0.smithi005.stdout:6/42: chown d2/d5/f8 37702 1 2024-04-16T14:35:17.373 INFO:tasks.workunit.client.0.smithi005.stdout:6/43: stat d2/d5 0 2024-04-16T14:35:17.373 INFO:tasks.workunit.client.0.smithi005.stdout:6/44: chown f0 2 1 2024-04-16T14:35:17.381 INFO:tasks.workunit.client.0.smithi005.stdout:6/45: creat d2/d5/fe x:0 0 0 2024-04-16T14:35:17.394 INFO:tasks.workunit.client.0.smithi005.stdout:6/46: rename d2/da to d2/df 0 2024-04-16T14:35:17.399 INFO:tasks.workunit.client.0.smithi005.stdout:4/58: dwrite d0/f9 [0,4194304] 0 2024-04-16T14:35:17.399 INFO:tasks.workunit.client.0.smithi005.stdout:4/59: dread - d0/f10 zero size 2024-04-16T14:35:17.400 INFO:tasks.workunit.client.0.smithi005.stdout:6/47: mkdir d2/d5/d10 0 2024-04-16T14:35:17.408 INFO:tasks.workunit.client.0.smithi005.stdout:4/60: dread d0/f9 [0,4194304] 0 2024-04-16T14:35:17.416 INFO:tasks.workunit.client.0.smithi005.stdout:6/48: dwrite d2/d5/f8 [4194304,4194304] 0 2024-04-16T14:35:17.418 INFO:tasks.workunit.client.0.smithi005.stdout:4/61: write d0/f7 [1489320,97428] 0 2024-04-16T14:35:17.418 INFO:tasks.workunit.client.0.smithi005.stdout:4/62: chown d0/f10 13271815 1 2024-04-16T14:35:17.418 INFO:tasks.workunit.client.0.smithi005.stdout:4/63: write d0/f7 [930855,27688] 0 2024-04-16T14:35:17.420 INFO:tasks.workunit.client.0.smithi005.stdout:6/49: mknod d2/df/c11 0 2024-04-16T14:35:17.428 INFO:tasks.workunit.client.0.smithi005.stdout:6/50: mkdir d2/d5/d10/d12 0 2024-04-16T14:35:17.433 INFO:tasks.workunit.client.0.smithi005.stdout:4/64: rmdir d0 39 2024-04-16T14:35:17.436 INFO:tasks.workunit.client.0.smithi005.stdout:4/65: creat d0/f13 x:0 0 0 2024-04-16T14:35:17.442 INFO:tasks.workunit.client.0.smithi005.stdout:4/66: mknod d0/c14 0 2024-04-16T14:35:17.449 INFO:tasks.workunit.client.0.smithi005.stdout:4/67: mknod d0/c15 0 2024-04-16T14:35:17.454 INFO:tasks.workunit.client.0.smithi005.stdout:4/68: unlink d0/fb 0 2024-04-16T14:35:17.462 INFO:tasks.workunit.client.0.smithi005.stdout:4/69: rename d0/le to d0/l16 0 2024-04-16T14:35:17.468 INFO:tasks.workunit.client.0.smithi005.stdout:4/70: mknod d0/c17 0 2024-04-16T14:35:17.474 INFO:tasks.workunit.client.0.smithi005.stdout:4/71: symlink d0/l18 0 2024-04-16T14:35:17.475 INFO:tasks.workunit.client.0.smithi005.stdout:4/72: chown d0/f7 7105 1 2024-04-16T14:35:17.475 INFO:tasks.workunit.client.0.smithi005.stdout:4/73: stat d0/f13 0 2024-04-16T14:35:17.475 INFO:tasks.workunit.client.0.smithi005.stdout:4/74: write d0/f7 [799648,55518] 0 2024-04-16T14:35:17.475 INFO:tasks.workunit.client.0.smithi005.stdout:4/75: stat d0/c17 0 2024-04-16T14:35:17.481 INFO:tasks.workunit.client.0.smithi005.stdout:4/76: link d0/f10 d0/f19 0 2024-04-16T14:35:17.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.495+0000 7f12e7e32700 1 -- 172.21.15.5:0/423519500 --> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f12e01012c0 con 0x7f12cc06b790 2024-04-16T14:35:17.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.505+0000 7f12d67fc700 1 -- 172.21.15.5:0/423519500 <== mgr.14616 v2:172.21.15.115:6828/460631486 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f12e01012c0 con 0x7f12cc06b790 2024-04-16T14:35:17.503 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-16T14:35:17.504 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.smithi005 smithi005 *:9093,9094 running (6m) 8s ago 7m 25.0M - 0.25.0 c8568f914cd2 0f1dad05c95e 2024-04-16T14:35:17.504 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi005 smithi005 running (8m) 8s ago 8m 6669k - 17.2.7-868-g412a5526 b04d96489b7c 6a380d6ec070 2024-04-16T14:35:17.504 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi115 smithi115 running (7m) 12s ago 7m 6665k - 17.2.7-868-g412a5526 b04d96489b7c df7cb0bfe65b 2024-04-16T14:35:17.504 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.smithi005 smithi005 *:3000 running (6m) 8s ago 7m 90.4M - 9.4.7 954c08fa6188 e6011313e3be 2024-04-16T14:35:17.504 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.vzoqdl smithi005 running (2m) 8s ago 2m 11.5M - 17.2.7-868-g412a5526 b04d96489b7c 84a74a406a1d 2024-04-16T14:35:17.504 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.wofqlz smithi005 running (2m) 8s ago 2m 138M - 17.2.7-868-g412a5526 b04d96489b7c d0e053ab2f72 2024-04-16T14:35:17.504 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.byfytg smithi115 running (2m) 12s ago 2m 19.3M - 17.2.7-868-g412a5526 b04d96489b7c 595cd0892f66 2024-04-16T14:35:17.504 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.trkaqh smithi115 running (2m) 12s ago 2m 12.2M - 17.2.7-868-g412a5526 b04d96489b7c 5b60cd2ad79b 2024-04-16T14:35:17.504 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi005.ipwdkc smithi005 *:9283 running (9m) 8s ago 9m 343M - 17.2.7-868-g412a5526 b04d96489b7c 53fb89eec045 2024-04-16T14:35:17.504 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi115.brjkpo smithi115 *:8443,9283 running (38s) 12s ago 6m 487M - 19.0.0-2204-g36befe5d b1a78730e0db 5f0019fe08af 2024-04-16T14:35:17.504 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi005 smithi005 running (9m) 8s ago 9m 48.3M 2048M 17.2.7-868-g412a5526 b04d96489b7c 764b6a128874 2024-04-16T14:35:17.505 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi115 smithi115 running (6m) 12s ago 6m 37.9M 2048M 17.2.7-868-g412a5526 b04d96489b7c feb5354cdbe9 2024-04-16T14:35:17.505 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi005 smithi005 *:9100 running (8m) 8s ago 8m 14.6M - 1.5.0 0da6a335fe13 16f9701011ea 2024-04-16T14:35:17.505 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi115 smithi115 *:9100 running (6m) 12s ago 6m 16.4M - 1.5.0 0da6a335fe13 38c140c04a1e 2024-04-16T14:35:17.505 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (6m) 8s ago 6m 87.7M 1559M 17.2.7-868-g412a5526 b04d96489b7c ed7aa0542d96 2024-04-16T14:35:17.505 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (5m) 8s ago 5m 95.0M 1559M 17.2.7-868-g412a5526 b04d96489b7c 1868cc6c89f4 2024-04-16T14:35:17.505 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (5m) 8s ago 5m 80.6M 1559M 17.2.7-868-g412a5526 b04d96489b7c b12745ae7d18 2024-04-16T14:35:17.505 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi115 running (4m) 12s ago 4m 100M 2581M 17.2.7-868-g412a5526 b04d96489b7c 59f81301ebcf 2024-04-16T14:35:17.505 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi115 running (4m) 12s ago 4m 82.8M 2581M 17.2.7-868-g412a5526 b04d96489b7c e3ea96b7edd9 2024-04-16T14:35:17.505 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi115 running (3m) 12s ago 3m 89.7M 2581M 17.2.7-868-g412a5526 b04d96489b7c 456fa074e453 2024-04-16T14:35:17.505 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.smithi005 smithi005 *:9095 running (6m) 8s ago 7m 56.3M - 2.43.0 a07b618ecd1d 813f7bfd1439 2024-04-16T14:35:17.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.508+0000 7f12e7e32700 1 -- 172.21.15.5:0/423519500 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f12cc06b790 msgr2=0x7f12cc06dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:17.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.508+0000 7f12e7e32700 1 --2- 172.21.15.5:0/423519500 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f12cc06b790 0x7f12cc06dc40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f12d0009b30 tx=0x7f12d0009e30 comp rx=0 tx=0).stop 2024-04-16T14:35:17.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.509+0000 7f12e7e32700 1 -- 172.21.15.5:0/423519500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12e00fbd40 msgr2=0x7f12e0112ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:17.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.509+0000 7f12e7e32700 1 --2- 172.21.15.5:0/423519500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12e00fbd40 0x7f12e0112ae0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f12dc00eb70 tx=0x7f12dc00b040 comp rx=0 tx=0).stop 2024-04-16T14:35:17.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.509+0000 7f12e7e32700 1 -- 172.21.15.5:0/423519500 shutdown_connections 2024-04-16T14:35:17.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.509+0000 7f12e7e32700 1 --2- 172.21.15.5:0/423519500 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f12cc06b790 0x7f12cc06dc40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:17.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.509+0000 7f12e7e32700 1 --2- 172.21.15.5:0/423519500 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f12e00fbd40 0x7f12e0112ae0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:17.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.509+0000 7f12e7e32700 1 --2- 172.21.15.5:0/423519500 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12e00fcff0 0x7f12e0115030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:17.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.509+0000 7f12e7e32700 1 -- 172.21.15.5:0/423519500 >> 172.21.15.5:0/423519500 conn(0x7f12e00f74c0 msgr2=0x7f12e00f8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:17.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.509+0000 7f12e7e32700 1 -- 172.21.15.5:0/423519500 shutdown_connections 2024-04-16T14:35:17.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.509+0000 7f12e7e32700 1 -- 172.21.15.5:0/423519500 wait complete. 2024-04-16T14:35:17.551 INFO:tasks.workunit.client.0.smithi005.stdout:6/51: dwrite d2/d5/fe [0,4194304] 0 2024-04-16T14:35:17.562 INFO:tasks.workunit.client.0.smithi005.stdout:6/52: read f0 [512875,64183] 0 2024-04-16T14:35:17.562 INFO:tasks.workunit.client.0.smithi005.stdout:6/53: truncate d2/d5/fe 4772459 0 2024-04-16T14:35:17.562 INFO:tasks.workunit.client.0.smithi005.stdout:6/54: readlink d2/l6 0 2024-04-16T14:35:17.572 INFO:tasks.workunit.client.0.smithi005.stdout:6/55: write d2/d5/fe [2046660,114910] 0 2024-04-16T14:35:17.576 INFO:tasks.workunit.client.0.smithi005.stdout:6/56: link d2/d5/fe d2/d5/d10/f13 0 2024-04-16T14:35:17.591 INFO:tasks.workunit.client.0.smithi005.stdout:6/57: dwrite d2/fd [0,4194304] 0 2024-04-16T14:35:17.592 INFO:tasks.workunit.client.0.smithi005.stdout:6/58: chown d2/df/c11 236 1 2024-04-16T14:35:17.592 INFO:tasks.workunit.client.0.smithi005.stdout:6/59: truncate d2/fd 5036518 0 2024-04-16T14:35:17.592 INFO:tasks.workunit.client.0.smithi005.stdout:6/60: write f0 [3675541,102196] 0 2024-04-16T14:35:17.592 INFO:tasks.workunit.client.0.smithi005.stdout:6/61: stat d2/l6 0 2024-04-16T14:35:17.601 INFO:tasks.workunit.client.0.smithi005.stdout:6/62: mkdir d2/d5/d10/d14 0 2024-04-16T14:35:17.601 INFO:tasks.workunit.client.0.smithi005.stdout:6/63: truncate d2/d5/d10/f13 5134395 0 2024-04-16T14:35:17.612 INFO:tasks.workunit.client.0.smithi005.stdout:6/64: dwrite d2/d5/f8 [8388608,4194304] 0 2024-04-16T14:35:17.626 INFO:tasks.workunit.client.0.smithi005.stdout:6/65: dwrite d2/d5/f8 [4194304,4194304] 0 2024-04-16T14:35:17.627 INFO:tasks.workunit.client.0.smithi005.stdout:6/66: mknod d2/c15 0 2024-04-16T14:35:17.628 INFO:tasks.workunit.client.0.smithi005.stdout:6/67: chown d2/d5/d10/d14 3785 1 2024-04-16T14:35:17.628 INFO:tasks.workunit.client.0.smithi005.stdout:6/68: stat d2/l6 0 2024-04-16T14:35:17.633 INFO:tasks.workunit.client.0.smithi005.stdout:6/69: dread d2/d5/d10/f13 [0,4194304] 0 2024-04-16T14:35:17.634 INFO:tasks.workunit.client.0.smithi005.stdout:6/70: chown d2/l6 5776046 1 2024-04-16T14:35:17.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.652+0000 7f1a5b74b700 1 -- 172.21.15.5:0/4232414459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a540fff80 msgr2=0x7f1a54102360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:17.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.652+0000 7f1a5b74b700 1 --2- 172.21.15.5:0/4232414459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a540fff80 0x7f1a54102360 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1a44004940 tx=0x7f1a44009e30 comp rx=0 tx=0).stop 2024-04-16T14:35:17.651 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:17 smithi005 ceph-mon[28964]: pgmap v13: 65 pgs: 65 active+clean; 141 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.5 MiB/s wr, 419 op/s 2024-04-16T14:35:17.651 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:17 smithi005 ceph-mon[28964]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:35:17.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.652+0000 7f1a5b74b700 1 -- 172.21.15.5:0/4232414459 shutdown_connections 2024-04-16T14:35:17.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.652+0000 7f1a5b74b700 1 --2- 172.21.15.5:0/4232414459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a540fff80 0x7f1a54102360 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:17.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.652+0000 7f1a5b74b700 1 --2- 172.21.15.5:0/4232414459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a54066b20 0x7f1a540ffa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:17.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.652+0000 7f1a5b74b700 1 -- 172.21.15.5:0/4232414459 >> 172.21.15.5:0/4232414459 conn(0x7f1a540f7450 msgr2=0x7f1a540f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:17.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.653+0000 7f1a5b74b700 1 -- 172.21.15.5:0/4232414459 shutdown_connections 2024-04-16T14:35:17.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.653+0000 7f1a5b74b700 1 -- 172.21.15.5:0/4232414459 wait complete. 2024-04-16T14:35:17.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.653+0000 7f1a5b74b700 1 Processor -- start 2024-04-16T14:35:17.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.653+0000 7f1a5b74b700 1 -- start start 2024-04-16T14:35:17.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.653+0000 7f1a5b74b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a54066b20 0x7f1a5410da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:17.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.653+0000 7f1a5b74b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a540fff80 0x7f1a5410dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:17.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.653+0000 7f1a5b74b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5410e5b0 con 0x7f1a54066b20 2024-04-16T14:35:17.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.653+0000 7f1a5b74b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5410ee00 con 0x7f1a540fff80 2024-04-16T14:35:17.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.653+0000 7f1a594e7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a54066b20 0x7f1a5410da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:17.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.653+0000 7f1a594e7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a54066b20 0x7f1a5410da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34804/0 (socket says 172.21.15.5:34804) 2024-04-16T14:35:17.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.653+0000 7f1a594e7700 1 -- 172.21.15.5:0/4055197286 learned_addr learned my addr 172.21.15.5:0/4055197286 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:35:17.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.654+0000 7f1a58ce6700 1 --2- 172.21.15.5:0/4055197286 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a540fff80 0x7f1a5410dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:17.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.654+0000 7f1a594e7700 1 -- 172.21.15.5:0/4055197286 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a540fff80 msgr2=0x7f1a5410dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:17.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.654+0000 7f1a594e7700 1 --2- 172.21.15.5:0/4055197286 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a540fff80 0x7f1a5410dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:17.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.654+0000 7f1a594e7700 1 -- 172.21.15.5:0/4055197286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a44005040 con 0x7f1a54066b20 2024-04-16T14:35:17.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.654+0000 7f1a594e7700 1 --2- 172.21.15.5:0/4055197286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a54066b20 0x7f1a5410da70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1a50002a80 tx=0x7f1a50004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:17.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.654+0000 7f1a49ffb700 1 -- 172.21.15.5:0/4055197286 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a50007cc0 con 0x7f1a54066b20 2024-04-16T14:35:17.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.654+0000 7f1a5b74b700 1 -- 172.21.15.5:0/4055197286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5410f0e0 con 0x7f1a54066b20 2024-04-16T14:35:17.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.654+0000 7f1a49ffb700 1 -- 172.21.15.5:0/4055197286 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1a5000f040 con 0x7f1a54066b20 2024-04-16T14:35:17.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.654+0000 7f1a49ffb700 1 -- 172.21.15.5:0/4055197286 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a5000da30 con 0x7f1a54066b20 2024-04-16T14:35:17.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.654+0000 7f1a5b74b700 1 -- 172.21.15.5:0/4055197286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a5410f620 con 0x7f1a54066b20 2024-04-16T14:35:17.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.655+0000 7f1a5b74b700 1 -- 172.21.15.5:0/4055197286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a5405f5f0 con 0x7f1a54066b20 2024-04-16T14:35:17.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.656+0000 7f1a49ffb700 1 -- 172.21.15.5:0/4055197286 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 89381+0+0 (secure 0 0 0) 0x7f1a5000db90 con 0x7f1a54066b20 2024-04-16T14:35:17.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.657+0000 7f1a49ffb700 1 --2- 172.21.15.5:0/4055197286 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f1a4006b790 0x7f1a4006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:17.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.657+0000 7f1a49ffb700 1 -- 172.21.15.5:0/4055197286 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f1a5008a1d0 con 0x7f1a54066b20 2024-04-16T14:35:17.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.657+0000 7f1a58ce6700 1 --2- 172.21.15.5:0/4055197286 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f1a4006b790 0x7f1a4006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:17.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.658+0000 7f1a58ce6700 1 --2- 172.21.15.5:0/4055197286 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f1a4006b790 0x7f1a4006dc40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400b970 tx=0x7f1a44009e30 comp rx=0 tx=0).ready entity=mgr.14616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:17.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.664+0000 7f1a49ffb700 1 -- 172.21.15.5:0/4055197286 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f1a500577c0 con 0x7f1a54066b20 2024-04-16T14:35:17.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:17 smithi115 ceph-mon[37295]: pgmap v13: 65 pgs: 65 active+clean; 141 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.5 MiB/s wr, 419 op/s 2024-04-16T14:35:17.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:17 smithi115 ceph-mon[37295]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:35:17.810 INFO:tasks.workunit.client.0.smithi005.stdout:4/77: truncate d0/f7 2716212 0 2024-04-16T14:35:17.811 INFO:tasks.workunit.client.0.smithi005.stdout:4/78: readlink d0/l18 0 2024-04-16T14:35:17.813 INFO:tasks.workunit.client.0.smithi005.stdout:4/79: creat d0/f1a x:0 0 0 2024-04-16T14:35:17.819 INFO:tasks.workunit.client.0.smithi005.stdout:4/80: mkdir d0/d1b 0 2024-04-16T14:35:17.822 INFO:tasks.workunit.client.0.smithi005.stdout:4/81: mknod d0/d1b/c1c 0 2024-04-16T14:35:17.865 INFO:tasks.workunit.client.0.smithi005.stdout:6/71: write d2/fd [5604661,48171] 0 2024-04-16T14:35:17.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.991+0000 7f1a5b74b700 1 -- 172.21.15.5:0/4055197286 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1a541058d0 con 0x7f1a54066b20 2024-04-16T14:35:17.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.991+0000 7f1a49ffb700 1 -- 172.21.15.5:0/4055197286 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f1a50057350 con 0x7f1a54066b20 2024-04-16T14:35:17.989 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:35:17.990 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-04-16T14:35:17.990 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 2 2024-04-16T14:35:17.990 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:35:17.990 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-04-16T14:35:17.990 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 1, 2024-04-16T14:35:17.990 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 1 2024-04-16T14:35:17.990 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:35:17.990 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-04-16T14:35:17.990 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 6 2024-04-16T14:35:17.990 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:35:17.990 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-04-16T14:35:17.990 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 4 2024-04-16T14:35:17.990 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:35:17.991 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-04-16T14:35:17.991 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 13, 2024-04-16T14:35:17.991 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 1 2024-04-16T14:35:17.991 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-16T14:35:17.991 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:35:17.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.994+0000 7f1a5b74b700 1 -- 172.21.15.5:0/4055197286 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f1a4006b790 msgr2=0x7f1a4006dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:17.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.994+0000 7f1a5b74b700 1 --2- 172.21.15.5:0/4055197286 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f1a4006b790 0x7f1a4006dc40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400b970 tx=0x7f1a44009e30 comp rx=0 tx=0).stop 2024-04-16T14:35:17.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.994+0000 7f1a5b74b700 1 -- 172.21.15.5:0/4055197286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a54066b20 msgr2=0x7f1a5410da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:17.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.994+0000 7f1a5b74b700 1 --2- 172.21.15.5:0/4055197286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a54066b20 0x7f1a5410da70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1a50002a80 tx=0x7f1a50004600 comp rx=0 tx=0).stop 2024-04-16T14:35:17.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.994+0000 7f1a5b74b700 1 -- 172.21.15.5:0/4055197286 shutdown_connections 2024-04-16T14:35:17.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.994+0000 7f1a5b74b700 1 --2- 172.21.15.5:0/4055197286 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f1a4006b790 0x7f1a4006dc40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:17.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.994+0000 7f1a5b74b700 1 --2- 172.21.15.5:0/4055197286 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1a54066b20 0x7f1a5410da70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:17.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.994+0000 7f1a5b74b700 1 --2- 172.21.15.5:0/4055197286 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a540fff80 0x7f1a5410dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:17.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.994+0000 7f1a5b74b700 1 -- 172.21.15.5:0/4055197286 >> 172.21.15.5:0/4055197286 conn(0x7f1a540f7450 msgr2=0x7f1a540f7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:17.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.994+0000 7f1a5b74b700 1 -- 172.21.15.5:0/4055197286 shutdown_connections 2024-04-16T14:35:17.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:17.994+0000 7f1a5b74b700 1 -- 172.21.15.5:0/4055197286 wait complete. 2024-04-16T14:35:18.094 INFO:tasks.workunit.client.0.smithi005.stdout:4/82: dread d0/f7 [0,4194304] 0 2024-04-16T14:35:18.096 INFO:tasks.workunit.client.0.smithi005.stdout:4/83: mkdir d0/d1b/d1d 0 2024-04-16T14:35:18.096 INFO:tasks.workunit.client.0.smithi005.stdout:4/84: chown d0/fa 13838 1 2024-04-16T14:35:18.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.106+0000 7f06112a6700 1 -- 172.21.15.5:0/4129475856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f060c0fbd00 msgr2=0x7f060c0fc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:18.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.106+0000 7f06112a6700 1 --2- 172.21.15.5:0/4129475856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f060c0fbd00 0x7f060c0fc110 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f05fc004940 tx=0x7f05fc009e30 comp rx=0 tx=0).stop 2024-04-16T14:35:18.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.106+0000 7f06112a6700 1 -- 172.21.15.5:0/4129475856 shutdown_connections 2024-04-16T14:35:18.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.106+0000 7f06112a6700 1 --2- 172.21.15.5:0/4129475856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f060c0fcfb0 0x7f060c0fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:18.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.106+0000 7f06112a6700 1 --2- 172.21.15.5:0/4129475856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f060c0fbd00 0x7f060c0fc110 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:18.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.106+0000 7f06112a6700 1 -- 172.21.15.5:0/4129475856 >> 172.21.15.5:0/4129475856 conn(0x7f060c0f7440 msgr2=0x7f060c0f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:18.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.106+0000 7f06112a6700 1 -- 172.21.15.5:0/4129475856 shutdown_connections 2024-04-16T14:35:18.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.106+0000 7f06112a6700 1 -- 172.21.15.5:0/4129475856 wait complete. 2024-04-16T14:35:18.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.107+0000 7f06112a6700 1 Processor -- start 2024-04-16T14:35:18.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.107+0000 7f06112a6700 1 -- start start 2024-04-16T14:35:18.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.107+0000 7f06112a6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f060c0fbd00 0x7f060c10c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:18.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.107+0000 7f06112a6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f060c0fcfb0 0x7f060c10cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:18.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.107+0000 7f06112a6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c10d360 con 0x7f060c0fcfb0 2024-04-16T14:35:18.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.107+0000 7f06112a6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c10d4d0 con 0x7f060c0fbd00 2024-04-16T14:35:18.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.107+0000 7f060a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f060c0fcfb0 0x7f060c10cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:18.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.107+0000 7f060a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f060c0fcfb0 0x7f060c10cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34828/0 (socket says 172.21.15.5:34828) 2024-04-16T14:35:18.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.107+0000 7f060a7fc700 1 -- 172.21.15.5:0/1341421495 learned_addr learned my addr 172.21.15.5:0/1341421495 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:35:18.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.108+0000 7f060affd700 1 --2- 172.21.15.5:0/1341421495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f060c0fbd00 0x7f060c10c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:18.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.108+0000 7f060a7fc700 1 -- 172.21.15.5:0/1341421495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f060c0fbd00 msgr2=0x7f060c10c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:18.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.108+0000 7f060a7fc700 1 --2- 172.21.15.5:0/1341421495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f060c0fbd00 0x7f060c10c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:18.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.108+0000 7f060a7fc700 1 -- 172.21.15.5:0/1341421495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05fc005040 con 0x7f060c0fcfb0 2024-04-16T14:35:18.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.108+0000 7f060a7fc700 1 --2- 172.21.15.5:0/1341421495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f060c0fcfb0 0x7f060c10cd60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f060000fce0 tx=0x7f06000046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:18.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.108+0000 7f05f37fe700 1 -- 172.21.15.5:0/1341421495 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0600007ea0 con 0x7f060c0fcfb0 2024-04-16T14:35:18.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.108+0000 7f05f37fe700 1 -- 172.21.15.5:0/1341421495 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f060000dda0 con 0x7f060c0fcfb0 2024-04-16T14:35:18.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.108+0000 7f06112a6700 1 -- 172.21.15.5:0/1341421495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f060c066280 con 0x7f060c0fcfb0 2024-04-16T14:35:18.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.109+0000 7f05f37fe700 1 -- 172.21.15.5:0/1341421495 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06000099b0 con 0x7f060c0fcfb0 2024-04-16T14:35:18.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.109+0000 7f06112a6700 1 -- 172.21.15.5:0/1341421495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f060c066780 con 0x7f060c0fcfb0 2024-04-16T14:35:18.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.110+0000 7f06112a6700 1 -- 172.21.15.5:0/1341421495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f060c04c710 con 0x7f060c0fcfb0 2024-04-16T14:35:18.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.111+0000 7f05f37fe700 1 -- 172.21.15.5:0/1341421495 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 89381+0+0 (secure 0 0 0) 0x7f060000d8d0 con 0x7f060c0fcfb0 2024-04-16T14:35:18.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.112+0000 7f05f37fe700 1 --2- 172.21.15.5:0/1341421495 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f05f406b7a0 0x7f05f406dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:18.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.112+0000 7f05f37fe700 1 -- 172.21.15.5:0/1341421495 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f060008cba0 con 0x7f060c0fcfb0 2024-04-16T14:35:18.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.112+0000 7f060affd700 1 --2- 172.21.15.5:0/1341421495 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f05f406b7a0 0x7f05f406dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:18.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.112+0000 7f060affd700 1 --2- 172.21.15.5:0/1341421495 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f05f406b7a0 0x7f05f406dc50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009fd0 tx=0x7f05fc009e30 comp rx=0 tx=0).ready entity=mgr.14616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:18.113 INFO:tasks.workunit.client.0.smithi005.stdout:4/85: dwrite d0/f10 [0,4194304] 0 2024-04-16T14:35:18.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.117+0000 7f05f37fe700 1 -- 172.21.15.5:0/1341421495 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f060005a190 con 0x7f060c0fcfb0 2024-04-16T14:35:18.119 INFO:tasks.workunit.client.0.smithi005.stdout:4/86: mknod d0/c1e 0 2024-04-16T14:35:18.119 INFO:tasks.workunit.client.0.smithi005.stdout:4/87: dread - d0/fd zero size 2024-04-16T14:35:18.120 INFO:tasks.workunit.client.0.smithi005.stdout:4/88: fsync d0/f9 0 2024-04-16T14:35:18.121 INFO:tasks.workunit.client.0.smithi005.stdout:4/89: mkdir d0/d1b/d1d/d1f 0 2024-04-16T14:35:18.124 INFO:tasks.workunit.client.0.smithi005.stdout:4/90: creat d0/d1b/d1d/d1f/f20 x:0 0 0 2024-04-16T14:35:18.124 INFO:tasks.workunit.client.0.smithi005.stdout:4/91: chown d0/f12 1 1 2024-04-16T14:35:18.124 INFO:tasks.workunit.client.0.smithi005.stdout:4/92: write d0/f13 [570366,50899] 0 2024-04-16T14:35:18.126 INFO:tasks.workunit.client.0.smithi005.stdout:4/93: creat d0/d1b/d1d/f21 x:0 0 0 2024-04-16T14:35:18.127 INFO:tasks.workunit.client.0.smithi005.stdout:4/94: write d0/d1b/d1d/d1f/f20 [51351,26065] 0 2024-04-16T14:35:18.143 INFO:tasks.workunit.client.0.smithi005.stdout:4/95: dwrite d0/f1a [0,4194304] 0 2024-04-16T14:35:18.144 INFO:tasks.workunit.client.0.smithi005.stdout:6/72: truncate f0 2931757 0 2024-04-16T14:35:18.144 INFO:tasks.workunit.client.0.smithi005.stdout:6/73: chown d2/d5/d10/d14 31 1 2024-04-16T14:35:18.148 INFO:tasks.workunit.client.0.smithi005.stdout:4/96: dread d0/f9 [0,4194304] 0 2024-04-16T14:35:18.151 INFO:tasks.workunit.client.0.smithi005.stdout:6/74: rename d2/l6 to d2/d5/d10/l16 0 2024-04-16T14:35:18.152 INFO:tasks.workunit.client.0.smithi005.stdout:6/75: rename d2 to d2/d5/d10/d17 22 2024-04-16T14:35:18.156 INFO:tasks.workunit.client.0.smithi005.stdout:4/97: read d0/f10 [4036644,68366] 0 2024-04-16T14:35:18.160 INFO:tasks.workunit.client.0.smithi005.stdout:6/76: dread d2/fd [0,4194304] 0 2024-04-16T14:35:18.163 INFO:tasks.workunit.client.0.smithi005.stdout:4/98: mkdir d0/d22 0 2024-04-16T14:35:18.165 INFO:tasks.workunit.client.0.smithi005.stdout:4/99: truncate d0/fa 3044026 0 2024-04-16T14:35:18.166 INFO:tasks.workunit.client.0.smithi005.stdout:4/100: fdatasync d0/f5 0 2024-04-16T14:35:18.166 INFO:tasks.workunit.client.0.smithi005.stdout:4/101: getdents d0/d22 0 2024-04-16T14:35:18.178 INFO:tasks.workunit.client.0.smithi005.stdout:4/102: dwrite d0/fd [0,4194304] 0 2024-04-16T14:35:18.178 INFO:tasks.workunit.client.0.smithi005.stdout:4/103: stat d0/fd 0 2024-04-16T14:35:18.181 INFO:tasks.workunit.client.0.smithi005.stdout:4/104: fdatasync d0/d1b/d1d/d1f/f20 0 2024-04-16T14:35:18.183 INFO:tasks.workunit.client.0.smithi005.stdout:4/105: mknod d0/d1b/d1d/d1f/c23 0 2024-04-16T14:35:18.185 INFO:tasks.workunit.client.0.smithi005.stdout:4/106: mknod d0/d1b/d1d/d1f/c24 0 2024-04-16T14:35:18.199 INFO:tasks.workunit.client.0.smithi005.stdout:4/107: dwrite d0/f5 [0,4194304] 0 2024-04-16T14:35:18.202 INFO:tasks.workunit.client.0.smithi005.stdout:4/108: symlink d0/d1b/d1d/d1f/l25 0 2024-04-16T14:35:18.209 INFO:tasks.workunit.client.0.smithi005.stdout:4/109: dread d0/f5 [0,4194304] 0 2024-04-16T14:35:18.211 INFO:tasks.workunit.client.0.smithi005.stdout:4/110: creat d0/f26 x:0 0 0 2024-04-16T14:35:18.211 INFO:tasks.workunit.client.0.smithi005.stdout:4/111: readlink d0/l18 0 2024-04-16T14:35:18.213 INFO:tasks.workunit.client.0.smithi005.stdout:4/112: symlink d0/l27 0 2024-04-16T14:35:18.218 INFO:tasks.workunit.client.0.smithi005.stdout:4/113: write d0/f9 [3921683,32302] 0 2024-04-16T14:35:18.222 INFO:tasks.workunit.client.0.smithi005.stdout:4/114: mknod d0/c28 0 2024-04-16T14:35:18.223 INFO:tasks.workunit.client.0.smithi005.stdout:4/115: mkdir d0/d22/d29 0 2024-04-16T14:35:18.228 INFO:tasks.workunit.client.0.smithi005.stdout:4/116: dread d0/f5 [0,4194304] 0 2024-04-16T14:35:18.229 INFO:tasks.workunit.client.0.smithi005.stdout:4/117: read d0/f13 [291955,97986] 0 2024-04-16T14:35:18.232 INFO:tasks.workunit.client.0.smithi005.stdout:4/118: rename d0/d1b/d1d/d1f/c24 to d0/d1b/c2a 0 2024-04-16T14:35:18.235 INFO:tasks.workunit.client.0.smithi005.stdout:4/119: creat d0/f2b x:0 0 0 2024-04-16T14:35:18.235 INFO:tasks.workunit.client.0.smithi005.stdout:4/120: fdatasync d0/d1b/d1d/d1f/f20 0 2024-04-16T14:35:18.235 INFO:tasks.workunit.client.0.smithi005.stdout:4/121: chown d0/c17 0 1 2024-04-16T14:35:18.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.470+0000 7f06112a6700 1 -- 172.21.15.5:0/1341421495 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f060c1047f0 con 0x7f060c0fcfb0 2024-04-16T14:35:18.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.471+0000 7f05f37fe700 1 -- 172.21.15.5:0/1341421495 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1829 (secure 0 0 0) 0x7f0600059d20 con 0x7f060c0fcfb0 2024-04-16T14:35:18.469 INFO:teuthology.orchestra.run.smithi005.stdout:e19 2024-04-16T14:35:18.469 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:35:18.470 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:35:18.470 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2024-04-16T14:35:18.470 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:35:18.470 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2024-04-16T14:35:18.470 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2024-04-16T14:35:18.470 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 19 2024-04-16T14:35:18.470 INFO:teuthology.orchestra.run.smithi005.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-16T14:35:18.470 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-16T14:32:45.270024+0000 2024-04-16T14:35:18.470 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-04-16T14:35:01.805796+0000 2024-04-16T14:35:18.470 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2024-04-16T14:35:18.470 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2024-04-16T14:35:18.470 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 60 2024-04-16T14:35:18.471 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2024-04-16T14:35:18.471 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2024-04-16T14:35:18.471 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2024-04-16T14:35:18.471 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2024-04-16T14:35:18.471 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 47 2024-04-16T14:35:18.471 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:35:18.471 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 2 2024-04-16T14:35:18.471 INFO:teuthology.orchestra.run.smithi005.stdout:in 0,1 2024-04-16T14:35:18.471 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=14484,1=24269} 2024-04-16T14:35:18.471 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2024-04-16T14:35:18.471 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2024-04-16T14:35:18.471 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 2024-04-16T14:35:18.471 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3] 2024-04-16T14:35:18.472 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2024-04-16T14:35:18.472 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2024-04-16T14:35:18.472 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2024-04-16T14:35:18.472 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 1 2024-04-16T14:35:18.472 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.wofqlz{0:14484} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:35:18.472 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.byfytg{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.115:6824/1662994117,v1:172.21.15.115:6825/1662994117] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:35:18.472 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:35:18.472 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:35:18.472 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2024-04-16T14:35:18.472 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:35:18.472 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.vzoqdl{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.5:6826/187766809,v1:172.21.15.5:6827/187766809] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:35:18.472 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.trkaqh{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:35:18.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.474+0000 7f06112a6700 1 -- 172.21.15.5:0/1341421495 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f05f406b7a0 msgr2=0x7f05f406dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:18.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.474+0000 7f06112a6700 1 --2- 172.21.15.5:0/1341421495 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f05f406b7a0 0x7f05f406dc50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009fd0 tx=0x7f05fc009e30 comp rx=0 tx=0).stop 2024-04-16T14:35:18.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.474+0000 7f06112a6700 1 -- 172.21.15.5:0/1341421495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f060c0fcfb0 msgr2=0x7f060c10cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:18.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.474+0000 7f06112a6700 1 --2- 172.21.15.5:0/1341421495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f060c0fcfb0 0x7f060c10cd60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f060000fce0 tx=0x7f06000046b0 comp rx=0 tx=0).stop 2024-04-16T14:35:18.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.474+0000 7f06112a6700 1 -- 172.21.15.5:0/1341421495 shutdown_connections 2024-04-16T14:35:18.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.474+0000 7f06112a6700 1 --2- 172.21.15.5:0/1341421495 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f05f406b7a0 0x7f05f406dc50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:18.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.474+0000 7f06112a6700 1 --2- 172.21.15.5:0/1341421495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f060c0fbd00 0x7f060c10c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:18.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.474+0000 7f06112a6700 1 --2- 172.21.15.5:0/1341421495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f060c0fcfb0 0x7f060c10cd60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:18.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.474+0000 7f06112a6700 1 -- 172.21.15.5:0/1341421495 >> 172.21.15.5:0/1341421495 conn(0x7f060c0f7440 msgr2=0x7f060c0f8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:18.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.474+0000 7f06112a6700 1 -- 172.21.15.5:0/1341421495 shutdown_connections 2024-04-16T14:35:18.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.474+0000 7f06112a6700 1 -- 172.21.15.5:0/1341421495 wait complete. 2024-04-16T14:35:18.474 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 19 2024-04-16T14:35:18.474 INFO:tasks.workunit.client.0.smithi005.stdout:4/122: getdents d0 0 2024-04-16T14:35:18.475 INFO:tasks.workunit.client.0.smithi005.stdout:4/123: write d0/f19 [4454312,71087] 0 2024-04-16T14:35:18.476 INFO:tasks.workunit.client.0.smithi005.stdout:4/124: creat d0/f2c x:0 0 0 2024-04-16T14:35:18.476 INFO:tasks.workunit.client.0.smithi005.stdout:4/125: write d0/f19 [649959,100218] 0 2024-04-16T14:35:18.496 INFO:tasks.workunit.client.0.smithi005.stdout:4/126: dwrite d0/f7 [0,4194304] 0 2024-04-16T14:35:18.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.580+0000 7f7405641700 1 -- 172.21.15.5:0/3871767689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74000fbcf0 msgr2=0x7f74000fc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:18.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.580+0000 7f7405641700 1 --2- 172.21.15.5:0/3871767689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74000fbcf0 0x7f74000fc100 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009ce0 tx=0x7f73f0004d10 comp rx=0 tx=0).stop 2024-04-16T14:35:18.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.580+0000 7f7405641700 1 -- 172.21.15.5:0/3871767689 shutdown_connections 2024-04-16T14:35:18.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.580+0000 7f7405641700 1 --2- 172.21.15.5:0/3871767689 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74000fcfa0 0x7f74000fd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:18.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.580+0000 7f7405641700 1 --2- 172.21.15.5:0/3871767689 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74000fbcf0 0x7f74000fc100 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:18.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.580+0000 7f7405641700 1 -- 172.21.15.5:0/3871767689 >> 172.21.15.5:0/3871767689 conn(0x7f74000f7450 msgr2=0x7f74000f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:18.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.580+0000 7f7405641700 1 -- 172.21.15.5:0/3871767689 shutdown_connections 2024-04-16T14:35:18.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.580+0000 7f7405641700 1 -- 172.21.15.5:0/3871767689 wait complete. 2024-04-16T14:35:18.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.581+0000 7f7405641700 1 Processor -- start 2024-04-16T14:35:18.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.581+0000 7f7405641700 1 -- start start 2024-04-16T14:35:18.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.581+0000 7f7405641700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74000fbcf0 0x7f7400066dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:18.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.581+0000 7f7405641700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74000fcfa0 0x7f7400112890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:18.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.581+0000 7f7405641700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7400112dd0 con 0x7f74000fbcf0 2024-04-16T14:35:18.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.581+0000 7f7405641700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7400112f10 con 0x7f74000fcfa0 2024-04-16T14:35:18.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.581+0000 7f73feffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74000fbcf0 0x7f7400066dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:18.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.581+0000 7f73feffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74000fbcf0 0x7f7400066dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39518/0 (socket says 172.21.15.5:39518) 2024-04-16T14:35:18.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.581+0000 7f73feffd700 1 -- 172.21.15.5:0/3953212685 learned_addr learned my addr 172.21.15.5:0/3953212685 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:35:18.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.581+0000 7f73fe7fc700 1 --2- 172.21.15.5:0/3953212685 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74000fcfa0 0x7f7400112890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:18.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.581+0000 7f73feffd700 1 -- 172.21.15.5:0/3953212685 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74000fcfa0 msgr2=0x7f7400112890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:18.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.581+0000 7f73feffd700 1 --2- 172.21.15.5:0/3953212685 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74000fcfa0 0x7f7400112890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:18.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.581+0000 7f73feffd700 1 -- 172.21.15.5:0/3953212685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f0009940 con 0x7f74000fbcf0 2024-04-16T14:35:18.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.582+0000 7f73feffd700 1 --2- 172.21.15.5:0/3953212685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74000fbcf0 0x7f7400066dc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009380 tx=0x7f73f0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:18.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.582+0000 7f73f77fe700 1 -- 172.21.15.5:0/3953212685 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73f000e040 con 0x7f74000fbcf0 2024-04-16T14:35:18.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.582+0000 7f73f77fe700 1 -- 172.21.15.5:0/3953212685 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f73f00128e0 con 0x7f74000fbcf0 2024-04-16T14:35:18.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.582+0000 7f7405641700 1 -- 172.21.15.5:0/3953212685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7400113190 con 0x7f74000fbcf0 2024-04-16T14:35:18.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.582+0000 7f73f77fe700 1 -- 172.21.15.5:0/3953212685 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73f001c930 con 0x7f74000fbcf0 2024-04-16T14:35:18.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.582+0000 7f7405641700 1 -- 172.21.15.5:0/3953212685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7400113750 con 0x7f74000fbcf0 2024-04-16T14:35:18.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.583+0000 7f7405641700 1 -- 172.21.15.5:0/3953212685 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f740004c710 con 0x7f74000fbcf0 2024-04-16T14:35:18.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.583+0000 7f73f77fe700 1 -- 172.21.15.5:0/3953212685 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 89381+0+0 (secure 0 0 0) 0x7f73f0012a50 con 0x7f74000fbcf0 2024-04-16T14:35:18.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.584+0000 7f73f77fe700 1 --2- 172.21.15.5:0/3953212685 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f73ec06b7a0 0x7f73ec06dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:18.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.584+0000 7f73f77fe700 1 -- 172.21.15.5:0/3953212685 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f73f008bf10 con 0x7f74000fbcf0 2024-04-16T14:35:18.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.584+0000 7f73fe7fc700 1 --2- 172.21.15.5:0/3953212685 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f73ec06b7a0 0x7f73ec06dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:18.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.584+0000 7f73fe7fc700 1 --2- 172.21.15.5:0/3953212685 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f73ec06b7a0 0x7f73ec06dc50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f73e8004f60 tx=0x7f73e800b040 comp rx=0 tx=0).ready entity=mgr.14616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:18.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.588+0000 7f73f77fe700 1 -- 172.21.15.5:0/3953212685 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f73f0059580 con 0x7f74000fbcf0 2024-04-16T14:35:18.592 INFO:tasks.workunit.client.0.smithi005.stdout:4/127: creat d0/d22/d29/f2d x:0 0 0 2024-04-16T14:35:18.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:18 smithi115 ceph-mon[37295]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:35:18.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:18 smithi115 ceph-mon[37295]: from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:35:18.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:18 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/4055197286' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:35:18.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:18 smithi005 ceph-mon[28964]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:35:18.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:18 smithi005 ceph-mon[28964]: from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:35:18.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:18 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/4055197286' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:35:18.728 INFO:tasks.workunit.client.0.smithi005.stdout:6/77: truncate f0 2432566 0 2024-04-16T14:35:18.728 INFO:tasks.workunit.client.0.smithi005.stdout:6/78: creat d2/f18 x:0 0 0 2024-04-16T14:35:18.730 INFO:tasks.workunit.client.0.smithi005.stdout:6/79: link d2/d5/fe d2/f19 0 2024-04-16T14:35:18.730 INFO:tasks.workunit.client.0.smithi005.stdout:6/80: chown d2/d5/d10/d12 13848538 1 2024-04-16T14:35:18.731 INFO:tasks.workunit.client.0.smithi005.stdout:6/81: creat d2/d5/d10/d12/f1a x:0 0 0 2024-04-16T14:35:18.819 INFO:tasks.workunit.client.0.smithi005.stdout:6/82: getdents d2 0 2024-04-16T14:35:18.820 INFO:tasks.workunit.client.0.smithi005.stdout:6/83: symlink d2/l1b 0 2024-04-16T14:35:18.822 INFO:tasks.workunit.client.0.smithi005.stdout:6/84: fsync d2/d5/fe 0 2024-04-16T14:35:18.824 INFO:tasks.workunit.client.0.smithi005.stdout:6/85: chown d2/df 43644099 1 2024-04-16T14:35:18.824 INFO:tasks.workunit.client.0.smithi005.stdout:6/86: chown d2/d5/d10 22 1 2024-04-16T14:35:18.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.838+0000 7f7405641700 1 -- 172.21.15.5:0/3953212685 --> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f74001012d0 con 0x7f73ec06b7a0 2024-04-16T14:35:18.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.840+0000 7f73f77fe700 1 -- 172.21.15.5:0/3953212685 <== mgr.14616 v2:172.21.15.115:6828/460631486 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f74001012d0 con 0x7f73ec06b7a0 2024-04-16T14:35:18.838 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:35:18.838 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91", 2024-04-16T14:35:18.838 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-04-16T14:35:18.839 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-16T14:35:18.839 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [], 2024-04-16T14:35:18.839 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "1/21 daemons upgraded", 2024-04-16T14:35:18.839 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "", 2024-04-16T14:35:18.839 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-04-16T14:35:18.839 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:35:18.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.843+0000 7f7405641700 1 -- 172.21.15.5:0/3953212685 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f73ec06b7a0 msgr2=0x7f73ec06dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:18.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.843+0000 7f7405641700 1 --2- 172.21.15.5:0/3953212685 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f73ec06b7a0 0x7f73ec06dc50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f73e8004f60 tx=0x7f73e800b040 comp rx=0 tx=0).stop 2024-04-16T14:35:18.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.843+0000 7f7405641700 1 -- 172.21.15.5:0/3953212685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74000fbcf0 msgr2=0x7f7400066dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:18.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.843+0000 7f7405641700 1 --2- 172.21.15.5:0/3953212685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74000fbcf0 0x7f7400066dc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009380 tx=0x7f73f0004d10 comp rx=0 tx=0).stop 2024-04-16T14:35:18.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.843+0000 7f7405641700 1 -- 172.21.15.5:0/3953212685 shutdown_connections 2024-04-16T14:35:18.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.843+0000 7f7405641700 1 --2- 172.21.15.5:0/3953212685 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f73ec06b7a0 0x7f73ec06dc50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:18.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.843+0000 7f7405641700 1 --2- 172.21.15.5:0/3953212685 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74000fbcf0 0x7f7400066dc0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:18.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.843+0000 7f7405641700 1 --2- 172.21.15.5:0/3953212685 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74000fcfa0 0x7f7400112890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:18.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.843+0000 7f7405641700 1 -- 172.21.15.5:0/3953212685 >> 172.21.15.5:0/3953212685 conn(0x7f74000f7450 msgr2=0x7f74000f8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:18.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.844+0000 7f7405641700 1 -- 172.21.15.5:0/3953212685 shutdown_connections 2024-04-16T14:35:18.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.844+0000 7f7405641700 1 -- 172.21.15.5:0/3953212685 wait complete. 2024-04-16T14:35:18.879 INFO:tasks.workunit.client.0.smithi005.stdout:6/87: truncate d2/d5/d10/f13 3060349 0 2024-04-16T14:35:18.881 INFO:tasks.workunit.client.0.smithi005.stdout:6/88: symlink d2/l1c 0 2024-04-16T14:35:18.881 INFO:tasks.workunit.client.0.smithi005.stdout:6/89: write d2/f18 [601674,51202] 0 2024-04-16T14:35:18.883 INFO:tasks.workunit.client.0.smithi005.stdout:6/90: creat d2/d5/d10/f1d x:0 0 0 2024-04-16T14:35:18.899 INFO:tasks.workunit.client.0.smithi005.stdout:6/91: dwrite d2/f18 [0,4194304] 0 2024-04-16T14:35:18.921 INFO:tasks.workunit.client.0.smithi005.stdout:6/92: dwrite f0 [0,4194304] 0 2024-04-16T14:35:18.921 INFO:tasks.workunit.client.0.smithi005.stdout:6/93: dread - d2/d5/d10/f1d zero size 2024-04-16T14:35:18.922 INFO:tasks.workunit.client.0.smithi005.stdout:6/94: mknod d2/d5/c1e 0 2024-04-16T14:35:18.922 INFO:tasks.workunit.client.0.smithi005.stdout:6/95: readlink d2/d5/d10/l16 0 2024-04-16T14:35:18.937 INFO:tasks.workunit.client.0.smithi005.stdout:6/96: dwrite d2/fd [4194304,4194304] 0 2024-04-16T14:35:18.942 INFO:tasks.workunit.client.0.smithi005.stdout:6/97: getdents d2/d5/d10/d12 0 2024-04-16T14:35:18.947 INFO:tasks.workunit.client.0.smithi005.stdout:6/98: write d2/fd [3645383,10765] 0 2024-04-16T14:35:18.947 INFO:tasks.workunit.client.0.smithi005.stdout:6/99: write d2/d5/d10/f13 [2574609,16697] 0 2024-04-16T14:35:18.953 INFO:tasks.workunit.client.0.smithi005.stdout:6/100: dread d2/f18 [0,4194304] 0 2024-04-16T14:35:18.954 INFO:tasks.workunit.client.0.smithi005.stdout:6/101: stat f0 0 2024-04-16T14:35:18.956 INFO:tasks.workunit.client.0.smithi005.stdout:6/102: creat d2/d5/d10/d14/f1f x:0 0 0 2024-04-16T14:35:18.958 INFO:tasks.workunit.client.0.smithi005.stdout:6/103: write d2/f19 [2686452,36306] 0 2024-04-16T14:35:18.958 INFO:tasks.workunit.client.0.smithi005.stdout:6/104: chown d2/d5/d10/d14/f1f 2226 1 2024-04-16T14:35:18.958 INFO:tasks.workunit.client.0.smithi005.stdout:6/105: dread - d2/d5/d10/f1d zero size 2024-04-16T14:35:18.958 INFO:tasks.workunit.client.0.smithi005.stdout:6/106: truncate f0 4889395 0 2024-04-16T14:35:18.958 INFO:tasks.workunit.client.0.smithi005.stdout:6/107: truncate d2/d5/d10/d14/f1f 898365 0 2024-04-16T14:35:18.960 INFO:tasks.workunit.client.0.smithi005.stdout:6/108: unlink d2/d5/d10/d14/f1f 0 2024-04-16T14:35:18.964 INFO:tasks.workunit.client.0.smithi005.stdout:6/109: mkdir d2/d20 0 2024-04-16T14:35:18.971 INFO:tasks.workunit.client.0.smithi005.stdout:6/110: dread f0 [0,4194304] 0 2024-04-16T14:35:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.974+0000 7efebe8fb700 1 -- 172.21.15.5:0/1796071791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeb80fb450 msgr2=0x7efeb80fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.975+0000 7efebe8fb700 1 --2- 172.21.15.5:0/1796071791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeb80fb450 0x7efeb80fb860 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7efea8004940 tx=0x7efea8009e30 comp rx=0 tx=0).stop 2024-04-16T14:35:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.975+0000 7efebe8fb700 1 -- 172.21.15.5:0/1796071791 shutdown_connections 2024-04-16T14:35:18.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.975+0000 7efebe8fb700 1 --2- 172.21.15.5:0/1796071791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efeb80fc700 0x7efeb80fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:18.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.975+0000 7efebe8fb700 1 --2- 172.21.15.5:0/1796071791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeb80fb450 0x7efeb80fb860 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:18.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.975+0000 7efebe8fb700 1 -- 172.21.15.5:0/1796071791 >> 172.21.15.5:0/1796071791 conn(0x7efeb80f6bd0 msgr2=0x7efeb80f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:18.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.975+0000 7efebe8fb700 1 -- 172.21.15.5:0/1796071791 shutdown_connections 2024-04-16T14:35:18.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.975+0000 7efebe8fb700 1 -- 172.21.15.5:0/1796071791 wait complete. 2024-04-16T14:35:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.975+0000 7efebe8fb700 1 Processor -- start 2024-04-16T14:35:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.976+0000 7efebe8fb700 1 -- start start 2024-04-16T14:35:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.976+0000 7efebe8fb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeb80fb450 0x7efeb810da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.976+0000 7efebe8fb700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efeb80fc700 0x7efeb810df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.976+0000 7efebe8fb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb810e540 con 0x7efeb80fb450 2024-04-16T14:35:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.976+0000 7efebe8fb700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb810ed90 con 0x7efeb80fc700 2024-04-16T14:35:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.976+0000 7efeaffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efeb80fc700 0x7efeb810df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.976+0000 7efeb7fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeb80fb450 0x7efeb810da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.976+0000 7efeaffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efeb80fc700 0x7efeb810df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.5:48306/0 (socket says 172.21.15.5:48306) 2024-04-16T14:35:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.976+0000 7efeaffff700 1 -- 172.21.15.5:0/3401117954 learned_addr learned my addr 172.21.15.5:0/3401117954 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:35:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.977+0000 7efeaffff700 1 -- 172.21.15.5:0/3401117954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeb80fb450 msgr2=0x7efeb810da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.977+0000 7efeaffff700 1 --2- 172.21.15.5:0/3401117954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeb80fb450 0x7efeb810da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:18.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.977+0000 7efeaffff700 1 -- 172.21.15.5:0/3401117954 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea8005040 con 0x7efeb80fc700 2024-04-16T14:35:18.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.977+0000 7efeb7fff700 1 --2- 172.21.15.5:0/3401117954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeb80fb450 0x7efeb810da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T14:35:18.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.977+0000 7efeaffff700 1 --2- 172.21.15.5:0/3401117954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efeb80fc700 0x7efeb810df40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efea000a6e0 tx=0x7efea000c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:18.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.977+0000 7efeb57fa700 1 -- 172.21.15.5:0/3401117954 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efea000f040 con 0x7efeb80fc700 2024-04-16T14:35:18.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.977+0000 7efeb57fa700 1 -- 172.21.15.5:0/3401117954 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efea000de70 con 0x7efeb80fc700 2024-04-16T14:35:18.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.977+0000 7efebe8fb700 1 -- 172.21.15.5:0/3401117954 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb810f070 con 0x7efeb80fc700 2024-04-16T14:35:18.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.977+0000 7efeb57fa700 1 -- 172.21.15.5:0/3401117954 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efea00133e0 con 0x7efeb80fc700 2024-04-16T14:35:18.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.977+0000 7efebe8fb700 1 -- 172.21.15.5:0/3401117954 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb810f5b0 con 0x7efeb80fc700 2024-04-16T14:35:18.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.979+0000 7efebe8fb700 1 -- 172.21.15.5:0/3401117954 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb805f5f0 con 0x7efeb80fc700 2024-04-16T14:35:18.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.979+0000 7efeb57fa700 1 -- 172.21.15.5:0/3401117954 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 89381+0+0 (secure 0 0 0) 0x7efea0013540 con 0x7efeb80fc700 2024-04-16T14:35:18.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.980+0000 7efeb57fa700 1 --2- 172.21.15.5:0/3401117954 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7efea406b790 0x7efea406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:18.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.980+0000 7efeb57fa700 1 -- 172.21.15.5:0/3401117954 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7efea008a0b0 con 0x7efeb80fc700 2024-04-16T14:35:18.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.980+0000 7efeb7fff700 1 --2- 172.21.15.5:0/3401117954 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7efea406b790 0x7efea406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:18.979 INFO:tasks.workunit.client.0.smithi005.stdout:6/111: dread d2/d5/d10/f13 [0,4194304] 0 2024-04-16T14:35:18.979 INFO:tasks.workunit.client.0.smithi005.stdout:6/112: creat d2/d5/d10/d14/f21 x:0 0 0 2024-04-16T14:35:18.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.981+0000 7efeb7fff700 1 --2- 172.21.15.5:0/3401117954 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7efea406b790 0x7efea406dc40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efea8009fd0 tx=0x7efea8009e30 comp rx=0 tx=0).ready entity=mgr.14616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:18.981 INFO:tasks.workunit.client.0.smithi005.stdout:6/113: dread d2/d5/fe [0,4194304] 0 2024-04-16T14:35:18.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:18.985+0000 7efeb57fa700 1 -- 172.21.15.5:0/3401117954 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7efea0050100 con 0x7efeb80fc700 2024-04-16T14:35:18.997 INFO:tasks.workunit.client.0.smithi005.stdout:6/114: dwrite d2/f18 [0,4194304] 0 2024-04-16T14:35:19.000 INFO:tasks.workunit.client.0.smithi005.stdout:6/115: read f0 [2800874,3374] 0 2024-04-16T14:35:19.000 INFO:tasks.workunit.client.0.smithi005.stdout:6/116: chown d2/f18 263074 1 2024-04-16T14:35:19.000 INFO:tasks.workunit.client.0.smithi005.stdout:6/117: creat d2/d5/f22 x:0 0 0 2024-04-16T14:35:19.004 INFO:tasks.workunit.client.0.smithi005.stdout:6/118: link d2/d5/d10/d14/f21 d2/f23 0 2024-04-16T14:35:19.006 INFO:tasks.workunit.client.0.smithi005.stdout:6/119: rmdir d2/df 39 2024-04-16T14:35:19.020 INFO:tasks.workunit.client.0.smithi005.stdout:6/120: dwrite d2/d5/f8 [8388608,4194304] 0 2024-04-16T14:35:19.021 INFO:tasks.workunit.client.0.smithi005.stdout:6/121: chown d2/f19 7801178 1 2024-04-16T14:35:19.023 INFO:tasks.workunit.client.0.smithi005.stdout:6/122: link d2/d5/d10/d12/f1a d2/df/f24 0 2024-04-16T14:35:19.024 INFO:tasks.workunit.client.0.smithi005.stdout:6/123: symlink d2/d5/d10/d14/l25 0 2024-04-16T14:35:19.024 INFO:tasks.workunit.client.0.smithi005.stdout:6/124: chown d2/d5/d10/d12 3955 1 2024-04-16T14:35:19.025 INFO:tasks.workunit.client.0.smithi005.stdout:6/125: creat d2/f26 x:0 0 0 2024-04-16T14:35:19.027 INFO:tasks.workunit.client.0.smithi005.stdout:6/126: mknod d2/d20/c27 0 2024-04-16T14:35:19.096 INFO:tasks.workunit.client.0.smithi005.stdout:6/127: rename d2/d5/d10/d14 to d2/d5/d28 0 2024-04-16T14:35:19.098 INFO:tasks.workunit.client.0.smithi005.stdout:6/128: creat d2/d5/d28/f29 x:0 0 0 2024-04-16T14:35:19.098 INFO:tasks.workunit.client.0.smithi005.stdout:6/129: write d2/f19 [120245,103347] 0 2024-04-16T14:35:19.098 INFO:tasks.workunit.client.0.smithi005.stdout:6/130: chown d2/d5/c1e 5316 1 2024-04-16T14:35:19.098 INFO:tasks.workunit.client.0.smithi005.stdout:6/131: creat d2/d5/f2a x:0 0 0 2024-04-16T14:35:19.098 INFO:tasks.workunit.client.0.smithi005.stdout:6/132: write d2/d5/d28/f29 [1011589,102353] 0 2024-04-16T14:35:19.098 INFO:tasks.workunit.client.0.smithi005.stdout:6/133: creat d2/d5/d10/f2b x:0 0 0 2024-04-16T14:35:19.100 INFO:tasks.workunit.client.0.smithi005.stdout:6/134: creat d2/d5/d28/f2c x:0 0 0 2024-04-16T14:35:19.101 INFO:tasks.workunit.client.0.smithi005.stdout:6/135: creat d2/f2d x:0 0 0 2024-04-16T14:35:19.102 INFO:tasks.workunit.client.0.smithi005.stdout:6/136: creat d2/f2e x:0 0 0 2024-04-16T14:35:19.102 INFO:tasks.workunit.client.0.smithi005.stdout:6/137: creat d2/d5/f2f x:0 0 0 2024-04-16T14:35:19.147 INFO:tasks.workunit.client.0.smithi005.stdout:6/138: rmdir d2/d5/d10 39 2024-04-16T14:35:19.147 INFO:tasks.workunit.client.0.smithi005.stdout:6/139: chown d2/d5/d28/f21 203453257 1 2024-04-16T14:35:19.147 INFO:tasks.workunit.client.0.smithi005.stdout:6/140: fsync d2/f26 0 2024-04-16T14:35:19.147 INFO:tasks.workunit.client.0.smithi005.stdout:6/141: read - d2/f2d zero size 2024-04-16T14:35:19.147 INFO:tasks.workunit.client.0.smithi005.stdout:6/142: dread - d2/f26 zero size 2024-04-16T14:35:19.161 INFO:tasks.workunit.client.0.smithi005.stdout:6/143: dwrite d2/d5/f2a [0,4194304] 0 2024-04-16T14:35:19.166 INFO:tasks.workunit.client.0.smithi005.stdout:6/144: dread d2/f19 [0,4194304] 0 2024-04-16T14:35:19.167 INFO:tasks.workunit.client.0.smithi005.stdout:6/145: rmdir d2/d5/d28 39 2024-04-16T14:35:19.187 INFO:tasks.workunit.client.0.smithi005.stdout:6/146: dwrite d2/f2e [0,4194304] 0 2024-04-16T14:35:19.191 INFO:tasks.workunit.client.0.smithi005.stdout:6/147: creat d2/df/f30 x:0 0 0 2024-04-16T14:35:19.191 INFO:tasks.workunit.client.0.smithi005.stdout:6/148: chown d2/df/c11 234 1 2024-04-16T14:35:19.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:19.365+0000 7efebe8fb700 1 -- 172.21.15.5:0/3401117954 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7efeb81036b0 con 0x7efeb80fc700 2024-04-16T14:35:19.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:19.365+0000 7efeb57fa700 1 -- 172.21.15.5:0/3401117954 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7efea0058780 con 0x7efeb80fc700 2024-04-16T14:35:19.364 INFO:teuthology.orchestra.run.smithi005.stdout:HEALTH_OK 2024-04-16T14:35:19.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:19.367+0000 7efebe8fb700 1 -- 172.21.15.5:0/3401117954 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7efea406b790 msgr2=0x7efea406dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:19.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:19.367+0000 7efebe8fb700 1 --2- 172.21.15.5:0/3401117954 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7efea406b790 0x7efea406dc40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efea8009fd0 tx=0x7efea8009e30 comp rx=0 tx=0).stop 2024-04-16T14:35:19.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:19.367+0000 7efebe8fb700 1 -- 172.21.15.5:0/3401117954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efeb80fc700 msgr2=0x7efeb810df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:19.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:19.367+0000 7efebe8fb700 1 --2- 172.21.15.5:0/3401117954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efeb80fc700 0x7efeb810df40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efea000a6e0 tx=0x7efea000c040 comp rx=0 tx=0).stop 2024-04-16T14:35:19.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:19.367+0000 7efebe8fb700 1 -- 172.21.15.5:0/3401117954 shutdown_connections 2024-04-16T14:35:19.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:19.367+0000 7efebe8fb700 1 --2- 172.21.15.5:0/3401117954 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7efea406b790 0x7efea406dc40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:19.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:19.367+0000 7efebe8fb700 1 --2- 172.21.15.5:0/3401117954 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeb80fb450 0x7efeb810da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:19.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:19.367+0000 7efebe8fb700 1 --2- 172.21.15.5:0/3401117954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efeb80fc700 0x7efeb810df40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:19.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:19.367+0000 7efebe8fb700 1 -- 172.21.15.5:0/3401117954 >> 172.21.15.5:0/3401117954 conn(0x7efeb80f6bd0 msgr2=0x7efeb80f82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:19.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:19.368+0000 7efebe8fb700 1 -- 172.21.15.5:0/3401117954 shutdown_connections 2024-04-16T14:35:19.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:19.368+0000 7efebe8fb700 1 -- 172.21.15.5:0/3401117954 wait complete. 2024-04-16T14:35:19.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:19 smithi115 ceph-mon[37295]: pgmap v14: 65 pgs: 65 active+clean; 258 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 7.2 MiB/s rd, 19 MiB/s wr, 903 op/s 2024-04-16T14:35:19.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:19 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/1341421495' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:35:19.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:19 smithi115 ceph-mon[37295]: from='client.14696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:35:19.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:19 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/3401117954' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:35:19.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:19 smithi005 ceph-mon[28964]: pgmap v14: 65 pgs: 65 active+clean; 258 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 7.2 MiB/s rd, 19 MiB/s wr, 903 op/s 2024-04-16T14:35:19.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:19 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/1341421495' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:35:19.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:19 smithi005 ceph-mon[28964]: from='client.14696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:35:19.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:19 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/3401117954' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:35:21.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:21 smithi115 ceph-mon[37295]: pgmap v15: 65 pgs: 65 active+clean; 258 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 7.2 MiB/s rd, 18 MiB/s wr, 890 op/s 2024-04-16T14:35:21.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:21 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:21.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:21 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:21.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:21 smithi115 ceph-mon[37295]: Reconfiguring alertmanager.smithi005 (dependencies changed)... 2024-04-16T14:35:21.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:21 smithi115 ceph-mon[37295]: Reconfiguring daemon alertmanager.smithi005 on smithi005 2024-04-16T14:35:21.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:21 smithi005 ceph-mon[28964]: pgmap v15: 65 pgs: 65 active+clean; 258 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 7.2 MiB/s rd, 18 MiB/s wr, 890 op/s 2024-04-16T14:35:21.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:21 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:21.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:21 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:21.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:21 smithi005 ceph-mon[28964]: Reconfiguring alertmanager.smithi005 (dependencies changed)... 2024-04-16T14:35:21.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:21 smithi005 ceph-mon[28964]: Reconfiguring daemon alertmanager.smithi005 on smithi005 2024-04-16T14:35:23.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:23 smithi115 ceph-mon[37295]: pgmap v16: 65 pgs: 65 active+clean; 258 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 7.2 MiB/s rd, 18 MiB/s wr, 890 op/s 2024-04-16T14:35:23.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:23 smithi005 ceph-mon[28964]: pgmap v16: 65 pgs: 65 active+clean; 258 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 7.2 MiB/s rd, 18 MiB/s wr, 890 op/s 2024-04-16T14:35:25.686 INFO:tasks.workunit.client.0.smithi005.stdout:8/26: sync 2024-04-16T14:35:25.686 INFO:tasks.workunit.client.0.smithi005.stdout:3/9: sync 2024-04-16T14:35:25.686 INFO:tasks.workunit.client.0.smithi005.stdout:4/128: sync 2024-04-16T14:35:25.686 INFO:tasks.workunit.client.0.smithi005.stdout:5/34: sync 2024-04-16T14:35:25.686 INFO:tasks.workunit.client.0.smithi005.stdout:3/10: chown d2 4 1 2024-04-16T14:35:25.686 INFO:tasks.workunit.client.0.smithi005.stdout:0/24: sync 2024-04-16T14:35:25.686 INFO:tasks.workunit.client.0.smithi005.stdout:4/129: dread - d0/f2c zero size 2024-04-16T14:35:25.686 INFO:tasks.workunit.client.0.smithi005.stdout:6/149: sync 2024-04-16T14:35:25.686 INFO:tasks.workunit.client.0.smithi005.stdout:5/35: chown d0/c4 873 1 2024-04-16T14:35:25.687 INFO:tasks.workunit.client.0.smithi005.stdout:1/53: sync 2024-04-16T14:35:25.687 INFO:tasks.workunit.client.0.smithi005.stdout:0/25: creat f5 x:0 0 0 2024-04-16T14:35:25.687 INFO:tasks.workunit.client.0.smithi005.stdout:9/17: sync 2024-04-16T14:35:25.687 INFO:tasks.workunit.client.0.smithi005.stdout:7/46: sync 2024-04-16T14:35:25.687 INFO:tasks.workunit.client.0.smithi005.stdout:2/20: sync 2024-04-16T14:35:25.687 INFO:tasks.workunit.client.0.smithi005.stdout:9/18: readlink l1 0 2024-04-16T14:35:25.687 INFO:tasks.workunit.client.0.smithi005.stdout:8/27: rename f0 to d5/f9 0 2024-04-16T14:35:25.687 INFO:tasks.workunit.client.0.smithi005.stdout:3/11: unlink d2/c3 0 2024-04-16T14:35:25.688 INFO:tasks.workunit.client.0.smithi005.stdout:4/130: mkdir d0/d1b/d2e 0 2024-04-16T14:35:25.689 INFO:tasks.workunit.client.0.smithi005.stdout:6/150: getdents d2/d5/d10 0 2024-04-16T14:35:25.689 INFO:tasks.workunit.client.0.smithi005.stdout:6/151: dread - d2/d5/d28/f2c zero size 2024-04-16T14:35:25.690 INFO:tasks.workunit.client.0.smithi005.stdout:1/54: mkdir d2/d4/d10 0 2024-04-16T14:35:25.690 INFO:tasks.workunit.client.0.smithi005.stdout:1/55: chown d2/d4/ff 43 1 2024-04-16T14:35:25.691 INFO:tasks.workunit.client.0.smithi005.stdout:5/36: symlink d0/d6/l7 0 2024-04-16T14:35:25.691 INFO:tasks.workunit.client.0.smithi005.stdout:5/37: write d0/f2 [357439,3293] 0 2024-04-16T14:35:25.691 INFO:tasks.workunit.client.0.smithi005.stdout:5/38: chown d0/f2 18 1 2024-04-16T14:35:25.691 INFO:tasks.workunit.client.0.smithi005.stdout:5/39: read d0/f2 [2296023,79065] 0 2024-04-16T14:35:25.691 INFO:tasks.workunit.client.0.smithi005.stdout:0/26: rename c2 to c6 0 2024-04-16T14:35:25.691 INFO:tasks.workunit.client.0.smithi005.stdout:0/27: write f5 [54646,30213] 0 2024-04-16T14:35:25.693 INFO:tasks.workunit.client.0.smithi005.stdout:2/21: unlink d0/l3 0 2024-04-16T14:35:25.695 INFO:tasks.workunit.client.0.smithi005.stdout:8/28: creat d5/fa x:0 0 0 2024-04-16T14:35:25.695 INFO:tasks.workunit.client.0.smithi005.stdout:8/29: stat f3 0 2024-04-16T14:35:25.695 INFO:tasks.workunit.client.0.smithi005.stdout:8/30: creat d5/fb x:0 0 0 2024-04-16T14:35:25.695 INFO:tasks.workunit.client.0.smithi005.stdout:8/31: chown d5/fa 3414369 1 2024-04-16T14:35:25.695 INFO:tasks.workunit.client.0.smithi005.stdout:8/32: chown d5 712858945 1 2024-04-16T14:35:25.695 INFO:tasks.workunit.client.0.smithi005.stdout:3/12: symlink d2/l4 0 2024-04-16T14:35:25.699 INFO:tasks.workunit.client.0.smithi005.stdout:6/152: rename d2/df/f24 to d2/d5/d10/d12/f31 0 2024-04-16T14:35:25.702 INFO:tasks.workunit.client.0.smithi005.stdout:5/40: link d0/f2 d0/f8 0 2024-04-16T14:35:25.703 INFO:tasks.workunit.client.0.smithi005.stdout:0/28: unlink f4 0 2024-04-16T14:35:25.705 INFO:tasks.workunit.client.0.smithi005.stdout:9/19: rmdir d3 39 2024-04-16T14:35:25.709 INFO:tasks.workunit.client.0.smithi005.stdout:6/153: rmdir d2/d5/d10 39 2024-04-16T14:35:25.711 INFO:tasks.workunit.client.0.smithi005.stdout:5/41: creat d0/d6/f9 x:0 0 0 2024-04-16T14:35:25.711 INFO:tasks.workunit.client.0.smithi005.stdout:7/47: write d1/fa [8250005,122290] 0 2024-04-16T14:35:25.711 INFO:tasks.workunit.client.0.smithi005.stdout:7/48: stat d1/d5 0 2024-04-16T14:35:25.713 INFO:tasks.workunit.client.0.smithi005.stdout:5/42: mknod d0/ca 0 2024-04-16T14:35:25.713 INFO:tasks.workunit.client.0.smithi005.stdout:5/43: write d0/d6/f9 [154439,124680] 0 2024-04-16T14:35:25.713 INFO:tasks.workunit.client.0.smithi005.stdout:5/44: chown d0/ca 13 1 2024-04-16T14:35:25.713 INFO:tasks.workunit.client.0.smithi005.stdout:1/56: write d2/d4/ff [3952065,65646] 0 2024-04-16T14:35:25.713 INFO:tasks.workunit.client.0.smithi005.stdout:7/49: rmdir d1 39 2024-04-16T14:35:25.713 INFO:tasks.workunit.client.0.smithi005.stdout:7/50: write d1/fa [5142296,71983] 0 2024-04-16T14:35:25.714 INFO:tasks.workunit.client.0.smithi005.stdout:5/45: rmdir d0 39 2024-04-16T14:35:25.715 INFO:tasks.workunit.client.0.smithi005.stdout:6/154: dread d2/fd [0,4194304] 0 2024-04-16T14:35:25.715 INFO:tasks.workunit.client.0.smithi005.stdout:6/155: truncate d2/f26 93147 0 2024-04-16T14:35:25.715 INFO:tasks.workunit.client.0.smithi005.stdout:6/156: write d2/d5/f22 [362107,72887] 0 2024-04-16T14:35:25.716 INFO:tasks.workunit.client.0.smithi005.stdout:7/51: rename d1/c8 to d1/cf 0 2024-04-16T14:35:25.716 INFO:tasks.workunit.client.0.smithi005.stdout:7/52: chown d1/cf 3 1 2024-04-16T14:35:25.716 INFO:tasks.workunit.client.0.smithi005.stdout:3/13: write f1 [1079348,52519] 0 2024-04-16T14:35:25.716 INFO:tasks.workunit.client.0.smithi005.stdout:3/14: stat d2 0 2024-04-16T14:35:25.719 INFO:tasks.workunit.client.0.smithi005.stdout:3/15: link f1 d2/f5 0 2024-04-16T14:35:25.721 INFO:tasks.workunit.client.0.smithi005.stdout:7/53: symlink d1/d5/l10 0 2024-04-16T14:35:25.721 INFO:tasks.workunit.client.0.smithi005.stdout:7/54: rmdir d1 39 2024-04-16T14:35:25.722 INFO:tasks.workunit.client.0.smithi005.stdout:7/55: creat d1/d5/f11 x:0 0 0 2024-04-16T14:35:25.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:25 smithi005 ceph-mon[28964]: pgmap v17: 65 pgs: 65 active+clean; 314 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 13 MiB/s rd, 25 MiB/s wr, 862 op/s 2024-04-16T14:35:25.724 INFO:tasks.workunit.client.0.smithi005.stdout:5/46: truncate d0/f2 949628 0 2024-04-16T14:35:25.725 INFO:tasks.workunit.client.0.smithi005.stdout:5/47: creat d0/fb x:0 0 0 2024-04-16T14:35:25.726 INFO:tasks.workunit.client.0.smithi005.stdout:5/48: write d0/d6/f9 [41538,36890] 0 2024-04-16T14:35:25.726 INFO:tasks.workunit.client.0.smithi005.stdout:5/49: creat d0/fc x:0 0 0 2024-04-16T14:35:25.726 INFO:tasks.workunit.client.0.smithi005.stdout:5/50: truncate d0/d6/f9 1288862 0 2024-04-16T14:35:25.729 INFO:tasks.workunit.client.0.smithi005.stdout:4/131: write d0/f7 [3368632,12023] 0 2024-04-16T14:35:25.730 INFO:tasks.workunit.client.0.smithi005.stdout:8/33: dwrite d5/fb [0,4194304] 0 2024-04-16T14:35:25.730 INFO:tasks.workunit.client.0.smithi005.stdout:5/51: mknod d0/cd 0 2024-04-16T14:35:25.730 INFO:tasks.workunit.client.0.smithi005.stdout:5/52: write d0/fb [153238,67193] 0 2024-04-16T14:35:25.730 INFO:tasks.workunit.client.0.smithi005.stdout:4/132: unlink d0/l16 0 2024-04-16T14:35:25.730 INFO:tasks.workunit.client.0.smithi005.stdout:0/29: dwrite f3 [0,4194304] 0 2024-04-16T14:35:25.730 INFO:tasks.workunit.client.0.smithi005.stdout:0/30: fsync f5 0 2024-04-16T14:35:25.731 INFO:tasks.workunit.client.0.smithi005.stdout:8/34: symlink d5/lc 0 2024-04-16T14:35:25.734 INFO:tasks.workunit.client.0.smithi005.stdout:8/35: symlink d5/ld 0 2024-04-16T14:35:25.735 INFO:tasks.workunit.client.0.smithi005.stdout:9/20: dwrite d3/f5 [0,4194304] 0 2024-04-16T14:35:25.737 INFO:tasks.workunit.client.0.smithi005.stdout:8/36: mkdir d5/de 0 2024-04-16T14:35:25.737 INFO:tasks.workunit.client.0.smithi005.stdout:8/37: stat f4 0 2024-04-16T14:35:25.741 INFO:tasks.workunit.client.0.smithi005.stdout:0/31: dread f1 [0,4194304] 0 2024-04-16T14:35:25.741 INFO:tasks.workunit.client.0.smithi005.stdout:0/32: rmdir - no directory 2024-04-16T14:35:25.747 INFO:tasks.workunit.client.0.smithi005.stdout:7/56: dwrite d1/d5/f11 [0,4194304] 0 2024-04-16T14:35:25.747 INFO:tasks.workunit.client.0.smithi005.stdout:7/57: write d1/fa [8659872,73758] 0 2024-04-16T14:35:25.749 INFO:tasks.workunit.client.0.smithi005.stdout:0/33: dread f0 [0,4194304] 0 2024-04-16T14:35:25.752 INFO:tasks.workunit.client.0.smithi005.stdout:3/16: dread d2/f5 [0,4194304] 0 2024-04-16T14:35:25.757 INFO:tasks.workunit.client.0.smithi005.stdout:0/34: symlink l7 0 2024-04-16T14:35:25.757 INFO:tasks.workunit.client.0.smithi005.stdout:0/35: fsync f1 0 2024-04-16T14:35:25.757 INFO:tasks.workunit.client.0.smithi005.stdout:0/36: chown l7 871709 1 2024-04-16T14:35:25.759 INFO:tasks.workunit.client.0.smithi005.stdout:3/17: symlink d2/l6 0 2024-04-16T14:35:25.759 INFO:tasks.workunit.client.0.smithi005.stdout:3/18: rename d2 to d2/d7 22 2024-04-16T14:35:25.759 INFO:tasks.workunit.client.0.smithi005.stdout:3/19: write d2/f5 [5139049,98565] 0 2024-04-16T14:35:25.760 INFO:tasks.workunit.client.0.smithi005.stdout:3/20: mknod d2/c8 0 2024-04-16T14:35:25.761 INFO:tasks.workunit.client.0.smithi005.stdout:3/21: mkdir d2/d9 0 2024-04-16T14:35:25.762 INFO:tasks.workunit.client.0.smithi005.stdout:4/133: dwrite d0/f10 [0,4194304] 0 2024-04-16T14:35:25.764 INFO:tasks.workunit.client.0.smithi005.stdout:4/134: getdents d0/d1b/d1d 0 2024-04-16T14:35:25.765 INFO:tasks.workunit.client.0.smithi005.stdout:4/135: readlink d0/d1b/d1d/d1f/l25 0 2024-04-16T14:35:25.766 INFO:tasks.workunit.client.0.smithi005.stdout:4/136: rmdir d0/d1b 39 2024-04-16T14:35:25.773 INFO:tasks.workunit.client.0.smithi005.stdout:8/38: write f1 [1461986,28124] 0 2024-04-16T14:35:25.773 INFO:tasks.workunit.client.0.smithi005.stdout:8/39: stat d5 0 2024-04-16T14:35:25.774 INFO:tasks.workunit.client.0.smithi005.stdout:1/57: dwrite d2/d4/ff [0,4194304] 0 2024-04-16T14:35:25.774 INFO:tasks.workunit.client.0.smithi005.stdout:8/40: mknod d5/cf 0 2024-04-16T14:35:25.774 INFO:tasks.workunit.client.0.smithi005.stdout:8/41: fdatasync f4 0 2024-04-16T14:35:25.775 INFO:tasks.workunit.client.0.smithi005.stdout:1/58: read d2/d4/fd [208150,51359] 0 2024-04-16T14:35:25.776 INFO:tasks.workunit.client.0.smithi005.stdout:1/59: rename d2/d4 to d2/d4/d11 22 2024-04-16T14:35:25.776 INFO:tasks.workunit.client.0.smithi005.stdout:8/42: mknod d5/de/c10 0 2024-04-16T14:35:25.778 INFO:tasks.workunit.client.0.smithi005.stdout:6/157: dwrite d2/f19 [0,4194304] 0 2024-04-16T14:35:25.779 INFO:tasks.workunit.client.0.smithi005.stdout:6/158: fsync d2/d5/d10/d12/f1a 0 2024-04-16T14:35:25.779 INFO:tasks.workunit.client.0.smithi005.stdout:5/53: dwrite d0/f8 [0,4194304] 0 2024-04-16T14:35:25.779 INFO:tasks.workunit.client.0.smithi005.stdout:5/54: dread - d0/fc zero size 2024-04-16T14:35:25.779 INFO:tasks.workunit.client.0.smithi005.stdout:5/55: fdatasync d0/d6/f9 0 2024-04-16T14:35:25.780 INFO:tasks.workunit.client.0.smithi005.stdout:5/56: truncate d0/fb 500994 0 2024-04-16T14:35:25.783 INFO:tasks.workunit.client.0.smithi005.stdout:6/159: unlink d2/c15 0 2024-04-16T14:35:25.785 INFO:tasks.workunit.client.0.smithi005.stdout:4/137: dread d0/f9 [0,4194304] 0 2024-04-16T14:35:25.785 INFO:tasks.workunit.client.0.smithi005.stdout:4/138: write d0/d1b/d1d/f21 [381099,128236] 0 2024-04-16T14:35:25.785 INFO:tasks.workunit.client.0.smithi005.stdout:4/139: fsync d0/f10 0 2024-04-16T14:35:25.785 INFO:tasks.workunit.client.0.smithi005.stdout:6/160: unlink d2/f2d 0 2024-04-16T14:35:25.788 INFO:tasks.workunit.client.0.smithi005.stdout:4/140: link d0/f10 d0/d1b/d2e/f2f 0 2024-04-16T14:35:25.791 INFO:tasks.workunit.client.0.smithi005.stdout:6/161: unlink d2/d5/d28/l25 0 2024-04-16T14:35:25.793 INFO:tasks.workunit.client.0.smithi005.stdout:4/141: mknod d0/d22/d29/c30 0 2024-04-16T14:35:25.793 INFO:tasks.workunit.client.0.smithi005.stdout:8/43: dread d5/fb [0,4194304] 0 2024-04-16T14:35:25.794 INFO:tasks.workunit.client.0.smithi005.stdout:8/44: write f3 [564427,46925] 0 2024-04-16T14:35:25.794 INFO:tasks.workunit.client.0.smithi005.stdout:6/162: rmdir d2/d5/d10 39 2024-04-16T14:35:25.794 INFO:tasks.workunit.client.0.smithi005.stdout:6/163: write d2/d5/f2f [443513,50851] 0 2024-04-16T14:35:25.796 INFO:tasks.workunit.client.0.smithi005.stdout:4/142: symlink d0/d22/d29/l31 0 2024-04-16T14:35:25.797 INFO:tasks.workunit.client.0.smithi005.stdout:3/22: dread f1 [0,4194304] 0 2024-04-16T14:35:25.797 INFO:tasks.workunit.client.0.smithi005.stdout:8/45: mkdir d5/d11 0 2024-04-16T14:35:25.800 INFO:tasks.workunit.client.0.smithi005.stdout:6/164: rename d2/d5/d28/f29 to d2/df/f32 0 2024-04-16T14:35:25.800 INFO:tasks.workunit.client.0.smithi005.stdout:8/46: rename d5/de to d5/de/d12 22 2024-04-16T14:35:25.800 INFO:tasks.workunit.client.0.smithi005.stdout:7/58: dwrite d1/fa [4194304,4194304] 0 2024-04-16T14:35:25.801 INFO:tasks.workunit.client.0.smithi005.stdout:4/143: symlink d0/d1b/d1d/d1f/l32 0 2024-04-16T14:35:25.801 INFO:tasks.workunit.client.0.smithi005.stdout:4/144: write d0/f13 [1031637,12081] 0 2024-04-16T14:35:25.801 INFO:tasks.workunit.client.0.smithi005.stdout:4/145: chown d0/f1a 1 1 2024-04-16T14:35:25.802 INFO:tasks.workunit.client.0.smithi005.stdout:3/23: creat d2/fa x:0 0 0 2024-04-16T14:35:25.802 INFO:tasks.workunit.client.0.smithi005.stdout:3/24: write d2/f5 [780890,8256] 0 2024-04-16T14:35:25.803 INFO:tasks.workunit.client.0.smithi005.stdout:3/25: creat d2/fb x:0 0 0 2024-04-16T14:35:25.803 INFO:tasks.workunit.client.0.smithi005.stdout:3/26: write d2/fb [642083,92832] 0 2024-04-16T14:35:25.804 INFO:tasks.workunit.client.0.smithi005.stdout:5/57: dwrite d0/fb [0,4194304] 0 2024-04-16T14:35:25.804 INFO:tasks.workunit.client.0.smithi005.stdout:5/58: chown d0/d6/f9 78957 1 2024-04-16T14:35:25.804 INFO:tasks.workunit.client.0.smithi005.stdout:5/59: chown d0/c3 189318183 1 2024-04-16T14:35:25.805 INFO:tasks.workunit.client.0.smithi005.stdout:5/60: dread d0/d6/f9 [0,4194304] 0 2024-04-16T14:35:25.805 INFO:tasks.workunit.client.0.smithi005.stdout:5/61: fsync d0/fb 0 2024-04-16T14:35:25.805 INFO:tasks.workunit.client.0.smithi005.stdout:8/47: rename l2 to d5/d11/l13 0 2024-04-16T14:35:25.805 INFO:tasks.workunit.client.0.smithi005.stdout:5/62: creat d0/fe x:0 0 0 2024-04-16T14:35:25.805 INFO:tasks.workunit.client.0.smithi005.stdout:5/63: fsync d0/f8 0 2024-04-16T14:35:25.806 INFO:tasks.workunit.client.0.smithi005.stdout:0/37: dwrite f0 [4194304,4194304] 0 2024-04-16T14:35:25.806 INFO:tasks.workunit.client.0.smithi005.stdout:6/165: mkdir d2/d20/d33 0 2024-04-16T14:35:25.806 INFO:tasks.workunit.client.0.smithi005.stdout:6/166: chown d2/f2e 99600586 1 2024-04-16T14:35:25.807 INFO:tasks.workunit.client.0.smithi005.stdout:7/59: creat d1/dc/f12 x:0 0 0 2024-04-16T14:35:25.810 INFO:tasks.workunit.client.0.smithi005.stdout:3/27: unlink f1 0 2024-04-16T14:35:25.810 INFO:tasks.workunit.client.0.smithi005.stdout:3/28: chown d2/fb 225 1 2024-04-16T14:35:25.815 INFO:tasks.workunit.client.0.smithi005.stdout:4/146: rename d0/d1b/d1d/d1f/c23 to d0/d1b/d1d/c33 0 2024-04-16T14:35:25.815 INFO:tasks.workunit.client.0.smithi005.stdout:4/147: chown d0/c17 0 1 2024-04-16T14:35:25.815 INFO:tasks.workunit.client.0.smithi005.stdout:4/148: chown d0/d1b/d2e/f2f 76038 1 2024-04-16T14:35:25.815 INFO:tasks.workunit.client.0.smithi005.stdout:4/149: write d0/f26 [402351,33143] 0 2024-04-16T14:35:25.815 INFO:tasks.workunit.client.0.smithi005.stdout:8/48: mknod d5/c14 0 2024-04-16T14:35:25.817 INFO:tasks.workunit.client.0.smithi005.stdout:6/167: dwrite d2/d5/d28/f2c [0,4194304] 0 2024-04-16T14:35:25.819 INFO:tasks.workunit.client.0.smithi005.stdout:5/64: link d0/c1 d0/d6/cf 0 2024-04-16T14:35:25.819 INFO:tasks.workunit.client.0.smithi005.stdout:5/65: chown d0/c3 266404 1 2024-04-16T14:35:25.819 INFO:tasks.workunit.client.0.smithi005.stdout:5/66: truncate d0/fe 943405 0 2024-04-16T14:35:25.819 INFO:tasks.workunit.client.0.smithi005.stdout:5/67: creat d0/d6/f10 x:0 0 0 2024-04-16T14:35:25.819 INFO:tasks.workunit.client.0.smithi005.stdout:5/68: truncate d0/fc 453631 0 2024-04-16T14:35:25.821 INFO:tasks.workunit.client.0.smithi005.stdout:0/38: unlink f3 0 2024-04-16T14:35:25.822 INFO:tasks.workunit.client.0.smithi005.stdout:7/60: mknod d1/c13 0 2024-04-16T14:35:25.823 INFO:tasks.workunit.client.0.smithi005.stdout:4/150: creat d0/d1b/f34 x:0 0 0 2024-04-16T14:35:25.827 INFO:tasks.workunit.client.0.smithi005.stdout:6/168: symlink d2/d5/d28/l34 0 2024-04-16T14:35:25.827 INFO:tasks.workunit.client.0.smithi005.stdout:6/169: write d2/d5/d28/f21 [481537,92327] 0 2024-04-16T14:35:25.832 INFO:tasks.workunit.client.0.smithi005.stdout:4/151: truncate d0/d1b/d1d/d1f/f20 777317 0 2024-04-16T14:35:25.836 INFO:tasks.workunit.client.0.smithi005.stdout:4/152: mknod d0/d1b/d1d/d1f/c35 0 2024-04-16T14:35:25.836 INFO:tasks.workunit.client.0.smithi005.stdout:4/153: fdatasync d0/fd 0 2024-04-16T14:35:25.836 INFO:tasks.workunit.client.0.smithi005.stdout:4/154: fsync d0/fa 0 2024-04-16T14:35:25.837 INFO:tasks.workunit.client.0.smithi005.stdout:6/170: link d2/d5/d28/f21 d2/f35 0 2024-04-16T14:35:25.842 INFO:tasks.workunit.client.0.smithi005.stdout:3/29: dwrite d2/fa [0,4194304] 0 2024-04-16T14:35:25.843 INFO:tasks.workunit.client.0.smithi005.stdout:8/49: dwrite f3 [0,4194304] 0 2024-04-16T14:35:25.843 INFO:tasks.workunit.client.0.smithi005.stdout:0/39: dwrite f5 [0,4194304] 0 2024-04-16T14:35:25.843 INFO:tasks.workunit.client.0.smithi005.stdout:8/50: readlink d5/d11/l13 0 2024-04-16T14:35:25.843 INFO:tasks.workunit.client.0.smithi005.stdout:0/40: creat f8 x:0 0 0 2024-04-16T14:35:25.848 INFO:tasks.workunit.client.0.smithi005.stdout:7/61: getdents d1 0 2024-04-16T14:35:25.848 INFO:tasks.workunit.client.0.smithi005.stdout:4/155: dread d0/d1b/d1d/f21 [0,4194304] 0 2024-04-16T14:35:25.851 INFO:tasks.workunit.client.0.smithi005.stdout:8/51: unlink d5/fa 0 2024-04-16T14:35:25.853 INFO:tasks.workunit.client.0.smithi005.stdout:7/62: symlink d1/dc/l14 0 2024-04-16T14:35:25.854 INFO:tasks.workunit.client.0.smithi005.stdout:8/52: getdents d5/de 0 2024-04-16T14:35:25.855 INFO:tasks.workunit.client.0.smithi005.stdout:5/69: rmdir d0 39 2024-04-16T14:35:25.856 INFO:tasks.workunit.client.0.smithi005.stdout:4/156: write d0/fd [3728843,15805] 0 2024-04-16T14:35:25.856 INFO:tasks.workunit.client.0.smithi005.stdout:4/157: creat d0/d1b/d1d/d1f/f36 x:0 0 0 2024-04-16T14:35:25.856 INFO:tasks.workunit.client.0.smithi005.stdout:4/158: stat d0/f1a 0 2024-04-16T14:35:25.856 INFO:tasks.workunit.client.0.smithi005.stdout:4/159: dread - d0/d1b/d1d/d1f/f36 zero size 2024-04-16T14:35:25.858 INFO:tasks.workunit.client.0.smithi005.stdout:5/70: creat d0/f11 x:0 0 0 2024-04-16T14:35:25.860 INFO:tasks.workunit.client.0.smithi005.stdout:8/53: write d5/fb [2988321,87026] 0 2024-04-16T14:35:25.860 INFO:tasks.workunit.client.0.smithi005.stdout:8/54: chown d5/f9 0 1 2024-04-16T14:35:25.864 INFO:tasks.workunit.client.0.smithi005.stdout:4/160: symlink d0/d22/l37 0 2024-04-16T14:35:25.864 INFO:tasks.workunit.client.0.smithi005.stdout:4/161: readlink d0/d1b/d1d/d1f/l25 0 2024-04-16T14:35:25.865 INFO:tasks.workunit.client.0.smithi005.stdout:3/30: dread d2/fa [0,4194304] 0 2024-04-16T14:35:25.866 INFO:tasks.workunit.client.0.smithi005.stdout:6/171: dwrite d2/d5/d10/d12/f31 [0,4194304] 0 2024-04-16T14:35:25.866 INFO:tasks.workunit.client.0.smithi005.stdout:7/63: mknod d1/d5/c15 0 2024-04-16T14:35:25.866 INFO:tasks.workunit.client.0.smithi005.stdout:0/41: dwrite f8 [0,4194304] 0 2024-04-16T14:35:25.868 INFO:tasks.workunit.client.0.smithi005.stdout:8/55: rmdir d5/de 39 2024-04-16T14:35:25.868 INFO:tasks.workunit.client.0.smithi005.stdout:8/56: fdatasync d5/f9 0 2024-04-16T14:35:25.869 INFO:tasks.workunit.client.0.smithi005.stdout:4/162: symlink d0/d1b/d1d/d1f/l38 0 2024-04-16T14:35:25.872 INFO:tasks.workunit.client.0.smithi005.stdout:0/42: read f1 [2224475,105036] 0 2024-04-16T14:35:25.873 INFO:tasks.workunit.client.0.smithi005.stdout:0/43: creat f9 x:0 0 0 2024-04-16T14:35:25.874 INFO:tasks.workunit.client.0.smithi005.stdout:5/71: dwrite d0/fc [0,4194304] 0 2024-04-16T14:35:25.875 INFO:tasks.workunit.client.0.smithi005.stdout:5/72: chown d0 53157 1 2024-04-16T14:35:25.875 INFO:tasks.workunit.client.0.smithi005.stdout:5/73: write d0/d6/f10 [915322,85237] 0 2024-04-16T14:35:25.876 INFO:tasks.workunit.client.0.smithi005.stdout:8/57: creat d5/de/f15 x:0 0 0 2024-04-16T14:35:25.877 INFO:tasks.workunit.client.0.smithi005.stdout:6/172: getdents d2/d5/d28 0 2024-04-16T14:35:25.882 INFO:tasks.workunit.client.0.smithi005.stdout:0/44: unlink f5 0 2024-04-16T14:35:25.882 INFO:tasks.workunit.client.0.smithi005.stdout:3/31: dread d2/f5 [0,4194304] 0 2024-04-16T14:35:25.883 INFO:tasks.workunit.client.0.smithi005.stdout:7/64: mkdir d1/d5/d16 0 2024-04-16T14:35:25.883 INFO:tasks.workunit.client.0.smithi005.stdout:7/65: stat d1/dc/ce 0 2024-04-16T14:35:25.886 INFO:tasks.workunit.client.0.smithi005.stdout:8/58: symlink d5/de/l16 0 2024-04-16T14:35:25.886 INFO:tasks.workunit.client.0.smithi005.stdout:8/59: chown f4 707240344 1 2024-04-16T14:35:25.888 INFO:tasks.workunit.client.0.smithi005.stdout:6/173: symlink d2/d5/d28/l36 0 2024-04-16T14:35:25.888 INFO:tasks.workunit.client.0.smithi005.stdout:6/174: write d2/f19 [4472838,8790] 0 2024-04-16T14:35:25.888 INFO:tasks.workunit.client.0.smithi005.stdout:6/175: write d2/d5/d10/f2b [775115,6575] 0 2024-04-16T14:35:25.888 INFO:tasks.workunit.client.0.smithi005.stdout:6/176: creat d2/d5/f37 x:0 0 0 2024-04-16T14:35:25.889 INFO:tasks.workunit.client.0.smithi005.stdout:4/163: dwrite d0/fa [0,4194304] 0 2024-04-16T14:35:25.889 INFO:tasks.workunit.client.0.smithi005.stdout:4/164: write d0/f13 [381637,12056] 0 2024-04-16T14:35:25.890 INFO:tasks.workunit.client.0.smithi005.stdout:7/66: dread d1/fa [4194304,4194304] 0 2024-04-16T14:35:25.892 INFO:tasks.workunit.client.0.smithi005.stdout:0/45: mkdir da 0 2024-04-16T14:35:25.892 INFO:tasks.workunit.client.0.smithi005.stdout:0/46: chown da 530 1 2024-04-16T14:35:25.896 INFO:tasks.workunit.client.0.smithi005.stdout:6/177: rmdir d2/d20 39 2024-04-16T14:35:25.896 INFO:tasks.workunit.client.0.smithi005.stdout:6/178: truncate d2/d5/d10/f2b 1298823 0 2024-04-16T14:35:25.896 INFO:tasks.workunit.client.0.smithi005.stdout:7/67: truncate d1/fa 540880 0 2024-04-16T14:35:25.898 INFO:tasks.workunit.client.0.smithi005.stdout:0/47: creat da/fb x:0 0 0 2024-04-16T14:35:25.898 INFO:tasks.workunit.client.0.smithi005.stdout:0/48: creat da/fc x:0 0 0 2024-04-16T14:35:25.898 INFO:tasks.workunit.client.0.smithi005.stdout:3/32: symlink d2/d9/lc 0 2024-04-16T14:35:25.899 INFO:tasks.workunit.client.0.smithi005.stdout:3/33: write d2/f5 [5617755,58364] 0 2024-04-16T14:35:25.900 INFO:tasks.workunit.client.0.smithi005.stdout:4/165: write d0/f19 [2355114,65693] 0 2024-04-16T14:35:25.902 INFO:tasks.workunit.client.0.smithi005.stdout:6/179: link d2/f35 d2/d5/d28/f38 0 2024-04-16T14:35:25.904 INFO:tasks.workunit.client.0.smithi005.stdout:6/180: mknod d2/d5/c39 0 2024-04-16T14:35:25.904 INFO:tasks.workunit.client.0.smithi005.stdout:6/181: symlink d2/d5/d10/d12/l3a 0 2024-04-16T14:35:25.905 INFO:tasks.workunit.client.0.smithi005.stdout:8/60: dwrite f4 [0,4194304] 0 2024-04-16T14:35:25.905 INFO:tasks.workunit.client.0.smithi005.stdout:8/61: creat d5/f17 x:0 0 0 2024-04-16T14:35:25.905 INFO:tasks.workunit.client.0.smithi005.stdout:8/62: read - d5/de/f15 zero size 2024-04-16T14:35:25.905 INFO:tasks.workunit.client.0.smithi005.stdout:0/49: dread f1 [4194304,4194304] 0 2024-04-16T14:35:25.906 INFO:tasks.workunit.client.0.smithi005.stdout:0/50: write f9 [659800,56011] 0 2024-04-16T14:35:25.911 INFO:tasks.workunit.client.0.smithi005.stdout:0/51: mknod da/cd 0 2024-04-16T14:35:25.911 INFO:tasks.workunit.client.0.smithi005.stdout:0/52: truncate f0 8533001 0 2024-04-16T14:35:25.911 INFO:tasks.workunit.client.0.smithi005.stdout:0/53: read - da/fb zero size 2024-04-16T14:35:25.911 INFO:tasks.workunit.client.0.smithi005.stdout:0/54: creat da/fe x:0 0 0 2024-04-16T14:35:25.911 INFO:tasks.workunit.client.0.smithi005.stdout:0/55: write da/fe [681997,4126] 0 2024-04-16T14:35:25.912 INFO:tasks.workunit.client.0.smithi005.stdout:6/182: write d2/d5/d10/d12/f31 [197100,11073] 0 2024-04-16T14:35:25.917 INFO:tasks.workunit.client.0.smithi005.stdout:6/183: truncate d2/fd 1967018 0 2024-04-16T14:35:25.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:25 smithi115 ceph-mon[37295]: pgmap v17: 65 pgs: 65 active+clean; 314 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 13 MiB/s rd, 25 MiB/s wr, 862 op/s 2024-04-16T14:35:25.942 INFO:tasks.workunit.client.0.smithi005.stdout:0/56: dwrite f0 [4194304,4194304] 0 2024-04-16T14:35:25.943 INFO:tasks.workunit.client.0.smithi005.stdout:3/34: dwrite d2/fa [0,4194304] 0 2024-04-16T14:35:25.943 INFO:tasks.workunit.client.0.smithi005.stdout:4/166: dwrite d0/f1a [0,4194304] 0 2024-04-16T14:35:25.943 INFO:tasks.workunit.client.0.smithi005.stdout:0/57: mkdir da/df 0 2024-04-16T14:35:25.943 INFO:tasks.workunit.client.0.smithi005.stdout:0/58: read - da/fb zero size 2024-04-16T14:35:25.944 INFO:tasks.workunit.client.0.smithi005.stdout:4/167: creat d0/d1b/d1d/f39 x:0 0 0 2024-04-16T14:35:25.944 INFO:tasks.workunit.client.0.smithi005.stdout:4/168: chown d0/c11 0 1 2024-04-16T14:35:25.946 INFO:tasks.workunit.client.0.smithi005.stdout:0/59: symlink da/l10 0 2024-04-16T14:35:25.946 INFO:tasks.workunit.client.0.smithi005.stdout:0/60: stat f0 0 2024-04-16T14:35:25.946 INFO:tasks.workunit.client.0.smithi005.stdout:0/61: chown da 1337437 1 2024-04-16T14:35:25.946 INFO:tasks.workunit.client.0.smithi005.stdout:7/68: dwrite d1/fa [0,4194304] 0 2024-04-16T14:35:25.947 INFO:tasks.workunit.client.0.smithi005.stdout:6/184: dwrite d2/d5/f22 [0,4194304] 0 2024-04-16T14:35:25.947 INFO:tasks.workunit.client.0.smithi005.stdout:6/185: chown d2/d5/d10/d12/f1a 31 1 2024-04-16T14:35:25.947 INFO:tasks.workunit.client.0.smithi005.stdout:7/69: creat d1/d5/f17 x:0 0 0 2024-04-16T14:35:25.947 INFO:tasks.workunit.client.0.smithi005.stdout:7/70: creat d1/dc/f18 x:0 0 0 2024-04-16T14:35:25.950 INFO:tasks.workunit.client.0.smithi005.stdout:0/62: dread da/fe [0,4194304] 0 2024-04-16T14:35:25.952 INFO:tasks.workunit.client.0.smithi005.stdout:6/186: unlink d2/f19 0 2024-04-16T14:35:25.952 INFO:tasks.workunit.client.0.smithi005.stdout:4/169: dread d0/fa [0,4194304] 0 2024-04-16T14:35:25.953 INFO:tasks.workunit.client.0.smithi005.stdout:4/170: write d0/d1b/d1d/f21 [1388477,58098] 0 2024-04-16T14:35:25.953 INFO:tasks.workunit.client.0.smithi005.stdout:4/171: fsync d0/d1b/f34 0 2024-04-16T14:35:25.953 INFO:tasks.workunit.client.0.smithi005.stdout:4/172: read d0/fd [3309400,100871] 0 2024-04-16T14:35:25.957 INFO:tasks.workunit.client.0.smithi005.stdout:4/173: mknod d0/d22/c3a 0 2024-04-16T14:35:25.958 INFO:tasks.workunit.client.0.smithi005.stdout:3/35: dread d2/f5 [0,4194304] 0 2024-04-16T14:35:25.959 INFO:tasks.workunit.client.0.smithi005.stdout:6/187: symlink d2/d5/d28/l3b 0 2024-04-16T14:35:25.963 INFO:tasks.workunit.client.0.smithi005.stdout:4/174: creat d0/d1b/d2e/f3b x:0 0 0 2024-04-16T14:35:25.963 INFO:tasks.workunit.client.0.smithi005.stdout:4/175: write d0/d1b/d1d/f39 [545982,18409] 0 2024-04-16T14:35:25.964 INFO:tasks.workunit.client.0.smithi005.stdout:4/176: fsync d0/d1b/d1d/d1f/f20 0 2024-04-16T14:35:25.964 INFO:tasks.workunit.client.0.smithi005.stdout:3/36: mknod d2/d9/cd 0 2024-04-16T14:35:25.964 INFO:tasks.workunit.client.0.smithi005.stdout:3/37: readlink d2/d9/lc 0 2024-04-16T14:35:25.970 INFO:tasks.workunit.client.0.smithi005.stdout:7/71: dwrite d1/dc/f18 [0,4194304] 0 2024-04-16T14:35:25.973 INFO:tasks.workunit.client.0.smithi005.stdout:7/72: link d1/d5/ld d1/d5/l19 0 2024-04-16T14:35:25.975 INFO:tasks.workunit.client.0.smithi005.stdout:8/63: dwrite d5/f6 [4194304,4194304] 0 2024-04-16T14:35:25.975 INFO:tasks.workunit.client.0.smithi005.stdout:8/64: rename d5/d11 to d5/d11/d18 22 2024-04-16T14:35:25.975 INFO:tasks.workunit.client.0.smithi005.stdout:8/65: creat d5/de/f19 x:0 0 0 2024-04-16T14:35:25.975 INFO:tasks.workunit.client.0.smithi005.stdout:0/63: dwrite f0 [0,4194304] 0 2024-04-16T14:35:25.975 INFO:tasks.workunit.client.0.smithi005.stdout:6/188: write d2/d5/f8 [320001,20040] 0 2024-04-16T14:35:25.976 INFO:tasks.workunit.client.0.smithi005.stdout:6/189: dread - d2/d5/f37 zero size 2024-04-16T14:35:25.978 INFO:tasks.workunit.client.0.smithi005.stdout:8/66: mknod d5/de/c1a 0 2024-04-16T14:35:25.979 INFO:tasks.workunit.client.0.smithi005.stdout:0/64: symlink da/l11 0 2024-04-16T14:35:25.979 INFO:tasks.workunit.client.0.smithi005.stdout:0/65: creat da/f12 x:0 0 0 2024-04-16T14:35:25.981 INFO:tasks.workunit.client.0.smithi005.stdout:6/190: mkdir d2/d20/d3c 0 2024-04-16T14:35:25.982 INFO:tasks.workunit.client.0.smithi005.stdout:6/191: fdatasync d2/d5/d28/f38 0 2024-04-16T14:35:25.982 INFO:tasks.workunit.client.0.smithi005.stdout:6/192: truncate d2/d5/f37 488051 0 2024-04-16T14:35:25.985 INFO:tasks.workunit.client.0.smithi005.stdout:3/38: truncate d2/f5 742593 0 2024-04-16T14:35:25.985 INFO:tasks.workunit.client.0.smithi005.stdout:3/39: chown d2/d9 2060088 1 2024-04-16T14:35:25.987 INFO:tasks.workunit.client.0.smithi005.stdout:0/66: dread f1 [0,4194304] 0 2024-04-16T14:35:25.987 INFO:tasks.workunit.client.0.smithi005.stdout:0/67: truncate da/fc 457912 0 2024-04-16T14:35:25.988 INFO:tasks.workunit.client.0.smithi005.stdout:3/40: creat d2/fe x:0 0 0 2024-04-16T14:35:25.989 INFO:tasks.workunit.client.0.smithi005.stdout:0/68: mknod da/c13 0 2024-04-16T14:35:25.990 INFO:tasks.workunit.client.0.smithi005.stdout:0/69: write da/f12 [868800,115864] 0 2024-04-16T14:35:25.990 INFO:tasks.workunit.client.0.smithi005.stdout:0/70: fsync f1 0 2024-04-16T14:35:25.990 INFO:tasks.workunit.client.0.smithi005.stdout:0/71: truncate da/f12 1910228 0 2024-04-16T14:35:25.990 INFO:tasks.workunit.client.0.smithi005.stdout:3/41: mkdir d2/d9/df 0 2024-04-16T14:35:25.992 INFO:tasks.workunit.client.0.smithi005.stdout:7/73: dwrite d1/fa [0,4194304] 0 2024-04-16T14:35:25.992 INFO:tasks.workunit.client.0.smithi005.stdout:7/74: dread - d1/d5/f17 zero size 2024-04-16T14:35:25.993 INFO:tasks.workunit.client.0.smithi005.stdout:4/177: write d0/f5 [2709374,66279] 0 2024-04-16T14:35:25.993 INFO:tasks.workunit.client.0.smithi005.stdout:0/72: mknod da/c14 0 2024-04-16T14:35:25.993 INFO:tasks.workunit.client.0.smithi005.stdout:0/73: write f9 [410297,33987] 0 2024-04-16T14:35:25.995 INFO:tasks.workunit.client.0.smithi005.stdout:0/74: read da/fe [663822,39949] 0 2024-04-16T14:35:25.996 INFO:tasks.workunit.client.0.smithi005.stdout:0/75: write da/f12 [1241768,125138] 0 2024-04-16T14:35:25.997 INFO:tasks.workunit.client.0.smithi005.stdout:0/76: dread da/fe [0,4194304] 0 2024-04-16T14:35:25.997 INFO:tasks.workunit.client.0.smithi005.stdout:0/77: getdents da/df 0 2024-04-16T14:35:25.997 INFO:tasks.workunit.client.0.smithi005.stdout:3/42: unlink d2/fb 0 2024-04-16T14:35:25.998 INFO:tasks.workunit.client.0.smithi005.stdout:0/78: write da/fc [35402,1453] 0 2024-04-16T14:35:26.000 INFO:tasks.workunit.client.0.smithi005.stdout:7/75: rename d1/fa to d1/d5/f1a 0 2024-04-16T14:35:26.015 INFO:tasks.workunit.client.0.smithi005.stdout:8/67: dwrite f3 [0,4194304] 0 2024-04-16T14:35:26.015 INFO:tasks.workunit.client.0.smithi005.stdout:8/68: write d5/de/f15 [295046,80689] 0 2024-04-16T14:35:26.016 INFO:tasks.workunit.client.0.smithi005.stdout:7/76: dread d1/d5/f1a [0,4194304] 0 2024-04-16T14:35:26.016 INFO:tasks.workunit.client.0.smithi005.stdout:7/77: dread - d1/d5/f17 zero size 2024-04-16T14:35:26.017 INFO:tasks.workunit.client.0.smithi005.stdout:7/78: truncate d1/d5/f11 2335614 0 2024-04-16T14:35:26.020 INFO:tasks.workunit.client.0.smithi005.stdout:8/69: dread d5/f9 [0,4194304] 0 2024-04-16T14:35:26.020 INFO:tasks.workunit.client.0.smithi005.stdout:8/70: fdatasync f3 0 2024-04-16T14:35:26.020 INFO:tasks.workunit.client.0.smithi005.stdout:8/71: fsync d5/fb 0 2024-04-16T14:35:26.023 INFO:tasks.workunit.client.0.smithi005.stdout:6/193: dwrite d2/f35 [0,4194304] 0 2024-04-16T14:35:26.023 INFO:tasks.workunit.client.0.smithi005.stdout:6/194: stat d2 0 2024-04-16T14:35:26.023 INFO:tasks.workunit.client.0.smithi005.stdout:4/178: dwrite d0/f1a [0,4194304] 0 2024-04-16T14:35:26.024 INFO:tasks.workunit.client.0.smithi005.stdout:4/179: chown d0/d1b/d1d 49582485 1 2024-04-16T14:35:26.024 INFO:tasks.workunit.client.0.smithi005.stdout:0/79: dwrite da/fe [0,4194304] 0 2024-04-16T14:35:26.024 INFO:tasks.workunit.client.0.smithi005.stdout:0/80: write f1 [9408805,126450] 0 2024-04-16T14:35:26.026 INFO:tasks.workunit.client.0.smithi005.stdout:6/195: mknod d2/df/c3d 0 2024-04-16T14:35:26.027 INFO:tasks.workunit.client.0.smithi005.stdout:4/180: link d0/f10 d0/d1b/f3c 0 2024-04-16T14:35:26.028 INFO:tasks.workunit.client.0.smithi005.stdout:4/181: read - d0/f12 zero size 2024-04-16T14:35:26.028 INFO:tasks.workunit.client.0.smithi005.stdout:4/182: chown d0/f13 144945111 1 2024-04-16T14:35:26.031 INFO:tasks.workunit.client.0.smithi005.stdout:6/196: creat d2/d5/d10/f3e x:0 0 0 2024-04-16T14:35:26.031 INFO:tasks.workunit.client.0.smithi005.stdout:8/72: dwrite d5/f17 [0,4194304] 0 2024-04-16T14:35:26.032 INFO:tasks.workunit.client.0.smithi005.stdout:4/183: symlink d0/d1b/d1d/l3d 0 2024-04-16T14:35:26.036 INFO:tasks.workunit.client.0.smithi005.stdout:8/73: mknod d5/d11/c1b 0 2024-04-16T14:35:26.036 INFO:tasks.workunit.client.0.smithi005.stdout:8/74: dread - d5/de/f19 zero size 2024-04-16T14:35:26.037 INFO:tasks.workunit.client.0.smithi005.stdout:6/197: mkdir d2/d3f 0 2024-04-16T14:35:26.040 INFO:tasks.workunit.client.0.smithi005.stdout:8/75: rename d5/c14 to d5/de/c1c 0 2024-04-16T14:35:26.042 INFO:tasks.workunit.client.0.smithi005.stdout:6/198: truncate d2/fd 911169 0 2024-04-16T14:35:26.042 INFO:tasks.workunit.client.0.smithi005.stdout:6/199: stat d2/f2e 0 2024-04-16T14:35:26.044 INFO:tasks.workunit.client.0.smithi005.stdout:8/76: rename d5/f9 to d5/de/f1d 0 2024-04-16T14:35:26.046 INFO:tasks.workunit.client.0.smithi005.stdout:6/200: symlink d2/d5/d28/l40 0 2024-04-16T14:35:26.047 INFO:tasks.workunit.client.0.smithi005.stdout:4/184: dwrite d0/f12 [0,4194304] 0 2024-04-16T14:35:26.048 INFO:tasks.workunit.client.0.smithi005.stdout:4/185: truncate d0/f26 1321746 0 2024-04-16T14:35:26.048 INFO:tasks.workunit.client.0.smithi005.stdout:6/201: creat d2/d5/d10/d12/f41 x:0 0 0 2024-04-16T14:35:26.050 INFO:tasks.workunit.client.0.smithi005.stdout:0/81: truncate f1 6559995 0 2024-04-16T14:35:26.050 INFO:tasks.workunit.client.0.smithi005.stdout:0/82: truncate f9 1034902 0 2024-04-16T14:35:26.053 INFO:tasks.workunit.client.0.smithi005.stdout:4/186: rmdir d0/d1b/d1d 39 2024-04-16T14:35:26.056 INFO:tasks.workunit.client.0.smithi005.stdout:3/43: truncate d2/f5 559191 0 2024-04-16T14:35:26.062 INFO:tasks.workunit.client.0.smithi005.stdout:6/202: dread d2/f23 [0,4194304] 0 2024-04-16T14:35:26.063 INFO:tasks.workunit.client.0.smithi005.stdout:6/203: mkdir d2/d5/d42 0 2024-04-16T14:35:26.064 INFO:tasks.workunit.client.0.smithi005.stdout:8/77: getdents d5/de 0 2024-04-16T14:35:26.064 INFO:tasks.workunit.client.0.smithi005.stdout:8/78: stat d5/cf 0 2024-04-16T14:35:26.064 INFO:tasks.workunit.client.0.smithi005.stdout:8/79: creat d5/f1e x:0 0 0 2024-04-16T14:35:26.065 INFO:tasks.workunit.client.0.smithi005.stdout:6/204: symlink d2/d20/d3c/l43 0 2024-04-16T14:35:26.065 INFO:tasks.workunit.client.0.smithi005.stdout:6/205: dread - d2/d5/d10/d12/f41 zero size 2024-04-16T14:35:26.066 INFO:tasks.workunit.client.0.smithi005.stdout:6/206: write d2/d5/d10/f3e [394169,62673] 0 2024-04-16T14:35:26.066 INFO:tasks.workunit.client.0.smithi005.stdout:6/207: chown d2/d20/d33 5764533 1 2024-04-16T14:35:26.066 INFO:tasks.workunit.client.0.smithi005.stdout:6/208: creat d2/d5/d10/f44 x:0 0 0 2024-04-16T14:35:26.066 INFO:tasks.workunit.client.0.smithi005.stdout:6/209: chown d2/d5/d28/l36 10417 1 2024-04-16T14:35:26.067 INFO:tasks.workunit.client.0.smithi005.stdout:0/83: write f8 [3050855,101189] 0 2024-04-16T14:35:26.067 INFO:tasks.workunit.client.0.smithi005.stdout:7/79: dwrite d1/d5/f11 [0,4194304] 0 2024-04-16T14:35:26.068 INFO:tasks.workunit.client.0.smithi005.stdout:7/80: chown d1/l4 166652 1 2024-04-16T14:35:26.068 INFO:tasks.workunit.client.0.smithi005.stdout:8/80: mkdir d5/d11/d1f 0 2024-04-16T14:35:26.068 INFO:tasks.workunit.client.0.smithi005.stdout:8/81: truncate d5/f6 9188682 0 2024-04-16T14:35:26.069 INFO:tasks.workunit.client.0.smithi005.stdout:4/187: write d0/f12 [3073264,70138] 0 2024-04-16T14:35:26.073 INFO:tasks.workunit.client.0.smithi005.stdout:0/84: creat da/df/f15 x:0 0 0 2024-04-16T14:35:26.074 INFO:tasks.workunit.client.0.smithi005.stdout:7/81: write d1/dc/f18 [313864,119331] 0 2024-04-16T14:35:26.075 INFO:tasks.workunit.client.0.smithi005.stdout:8/82: creat d5/d11/f20 x:0 0 0 2024-04-16T14:35:26.075 INFO:tasks.workunit.client.0.smithi005.stdout:8/83: chown d5/f6 888 1 2024-04-16T14:35:26.077 INFO:tasks.workunit.client.0.smithi005.stdout:4/188: mkdir d0/d1b/d1d/d1f/d3e 0 2024-04-16T14:35:26.078 INFO:tasks.workunit.client.0.smithi005.stdout:4/189: write d0/f19 [5492347,70649] 0 2024-04-16T14:35:26.078 INFO:tasks.workunit.client.0.smithi005.stdout:4/190: write d0/f12 [2210618,11584] 0 2024-04-16T14:35:26.078 INFO:tasks.workunit.client.0.smithi005.stdout:7/82: unlink d1/d5/c7 0 2024-04-16T14:35:26.081 INFO:tasks.workunit.client.0.smithi005.stdout:0/85: write da/fe [3007808,22033] 0 2024-04-16T14:35:26.081 INFO:tasks.workunit.client.0.smithi005.stdout:0/86: stat da/fc 0 2024-04-16T14:35:26.083 INFO:tasks.workunit.client.0.smithi005.stdout:0/87: rename da/c14 to da/c16 0 2024-04-16T14:35:26.084 INFO:tasks.workunit.client.0.smithi005.stdout:6/210: dwrite d2/f26 [0,4194304] 0 2024-04-16T14:35:26.084 INFO:tasks.workunit.client.0.smithi005.stdout:6/211: readlink d2/l1b 0 2024-04-16T14:35:26.084 INFO:tasks.workunit.client.0.smithi005.stdout:6/212: chown d2/d5/d10/d12/f41 533479224 1 2024-04-16T14:35:26.088 INFO:tasks.workunit.client.0.smithi005.stdout:7/83: dread d1/dc/f18 [0,4194304] 0 2024-04-16T14:35:26.093 INFO:tasks.workunit.client.0.smithi005.stdout:3/44: dwrite d2/f5 [0,4194304] 0 2024-04-16T14:35:26.093 INFO:tasks.workunit.client.0.smithi005.stdout:0/88: symlink da/l17 0 2024-04-16T14:35:26.093 INFO:tasks.workunit.client.0.smithi005.stdout:0/89: fdatasync f0 0 2024-04-16T14:35:26.094 INFO:tasks.workunit.client.0.smithi005.stdout:0/90: fdatasync f0 0 2024-04-16T14:35:26.094 INFO:tasks.workunit.client.0.smithi005.stdout:0/91: fdatasync da/df/f15 0 2024-04-16T14:35:26.109 INFO:tasks.workunit.client.0.smithi005.stdout:8/84: dwrite d5/f6 [0,4194304] 0 2024-04-16T14:35:26.109 INFO:tasks.workunit.client.0.smithi005.stdout:4/191: dread d0/f7 [0,4194304] 0 2024-04-16T14:35:26.109 INFO:tasks.workunit.client.0.smithi005.stdout:4/192: chown d0/d22/l37 61520403 1 2024-04-16T14:35:26.109 INFO:tasks.workunit.client.0.smithi005.stdout:4/193: dread - d0/d1b/d1d/d1f/f36 zero size 2024-04-16T14:35:26.110 INFO:tasks.workunit.client.0.smithi005.stdout:6/213: mkdir d2/d45 0 2024-04-16T14:35:26.112 INFO:tasks.workunit.client.0.smithi005.stdout:0/92: dread f8 [0,4194304] 0 2024-04-16T14:35:26.112 INFO:tasks.workunit.client.0.smithi005.stdout:8/85: unlink d5/de/l16 0 2024-04-16T14:35:26.117 INFO:tasks.workunit.client.0.smithi005.stdout:7/84: dwrite d1/dc/f18 [0,4194304] 0 2024-04-16T14:35:26.117 INFO:tasks.workunit.client.0.smithi005.stdout:7/85: read - d1/d5/f17 zero size 2024-04-16T14:35:26.117 INFO:tasks.workunit.client.0.smithi005.stdout:7/86: readlink d1/d5/ld 0 2024-04-16T14:35:26.117 INFO:tasks.workunit.client.0.smithi005.stdout:3/45: dwrite d2/fe [0,4194304] 0 2024-04-16T14:35:26.117 INFO:tasks.workunit.client.0.smithi005.stdout:3/46: chown d2/fa 274034 1 2024-04-16T14:35:26.126 INFO:tasks.workunit.client.0.smithi005.stdout:6/214: rmdir d2/d5/d42 0 2024-04-16T14:35:26.134 INFO:tasks.workunit.client.0.smithi005.stdout:4/194: rename d0/c14 to d0/d1b/d1d/d1f/d3e/c3f 0 2024-04-16T14:35:26.138 INFO:tasks.workunit.client.0.smithi005.stdout:0/93: rename l7 to da/df/l18 0 2024-04-16T14:35:26.139 INFO:tasks.workunit.client.0.smithi005.stdout:7/87: rename d1/dc to d1/dc/d1b 22 2024-04-16T14:35:26.140 INFO:tasks.workunit.client.0.smithi005.stdout:0/94: truncate f0 1712987 0 2024-04-16T14:35:26.140 INFO:tasks.workunit.client.0.smithi005.stdout:0/95: rename da/l17 to da/df/l19 0 2024-04-16T14:35:26.141 INFO:tasks.workunit.client.0.smithi005.stdout:0/96: creat da/f1a x:0 0 0 2024-04-16T14:35:26.141 INFO:tasks.workunit.client.0.smithi005.stdout:0/97: mkdir da/df/d1b 0 2024-04-16T14:35:26.146 INFO:tasks.workunit.client.0.smithi005.stdout:3/47: dwrite d2/f5 [4194304,4194304] 0 2024-04-16T14:35:26.149 INFO:tasks.workunit.client.0.smithi005.stdout:8/86: dwrite d5/de/f15 [0,4194304] 0 2024-04-16T14:35:26.154 INFO:tasks.workunit.client.0.smithi005.stdout:0/98: truncate f1 2294049 0 2024-04-16T14:35:26.156 INFO:tasks.workunit.client.0.smithi005.stdout:0/99: mknod da/df/c1c 0 2024-04-16T14:35:26.160 INFO:tasks.workunit.client.0.smithi005.stdout:3/48: write d2/f5 [3613047,54895] 0 2024-04-16T14:35:26.163 INFO:tasks.workunit.client.0.smithi005.stdout:4/195: dwrite d0/d1b/d1d/d1f/f20 [0,4194304] 0 2024-04-16T14:35:26.163 INFO:tasks.workunit.client.0.smithi005.stdout:4/196: write d0/d1b/f3c [2169279,15884] 0 2024-04-16T14:35:26.163 INFO:tasks.workunit.client.0.smithi005.stdout:4/197: dread - d0/d1b/d2e/f3b zero size 2024-04-16T14:35:26.164 INFO:tasks.workunit.client.0.smithi005.stdout:7/88: dwrite d1/d5/f11 [0,4194304] 0 2024-04-16T14:35:26.164 INFO:tasks.workunit.client.0.smithi005.stdout:7/89: creat d1/dc/f1c x:0 0 0 2024-04-16T14:35:26.164 INFO:tasks.workunit.client.0.smithi005.stdout:8/87: dread d5/fb [0,4194304] 0 2024-04-16T14:35:26.165 INFO:tasks.workunit.client.0.smithi005.stdout:4/198: symlink d0/d22/l40 0 2024-04-16T14:35:26.167 INFO:tasks.workunit.client.0.smithi005.stdout:4/199: write d0/d1b/d1d/f21 [1361979,3144] 0 2024-04-16T14:35:26.168 INFO:tasks.workunit.client.0.smithi005.stdout:3/49: write d2/f5 [5014768,82577] 0 2024-04-16T14:35:26.170 INFO:tasks.workunit.client.0.smithi005.stdout:7/90: mkdir d1/d5/d1d 0 2024-04-16T14:35:26.170 INFO:tasks.workunit.client.0.smithi005.stdout:7/91: getdents d1/d5/d1d 0 2024-04-16T14:35:26.173 INFO:tasks.workunit.client.0.smithi005.stdout:7/92: creat d1/d5/d16/f1e x:0 0 0 2024-04-16T14:35:26.175 INFO:tasks.workunit.client.0.smithi005.stdout:8/88: write d5/de/f15 [3785035,18536] 0 2024-04-16T14:35:26.175 INFO:tasks.workunit.client.0.smithi005.stdout:8/89: chown d5/ld 474643889 1 2024-04-16T14:35:26.175 INFO:tasks.workunit.client.0.smithi005.stdout:8/90: dread - d5/de/f19 zero size 2024-04-16T14:35:26.177 INFO:tasks.workunit.client.0.smithi005.stdout:3/50: link d2/c8 d2/c10 0 2024-04-16T14:35:26.179 INFO:tasks.workunit.client.0.smithi005.stdout:7/93: rmdir d1/d5/d1d 0 2024-04-16T14:35:26.180 INFO:tasks.workunit.client.0.smithi005.stdout:0/100: rmdir da/df 39 2024-04-16T14:35:26.190 INFO:tasks.workunit.client.0.smithi005.stdout:7/94: write d1/dc/f18 [1206396,10460] 0 2024-04-16T14:35:26.190 INFO:tasks.workunit.client.0.smithi005.stdout:7/95: chown d1/dc/f12 204996302 1 2024-04-16T14:35:26.190 INFO:tasks.workunit.client.0.smithi005.stdout:7/96: chown d1/d5/ld 602 1 2024-04-16T14:35:26.204 INFO:tasks.workunit.client.0.smithi005.stdout:8/91: dwrite d5/d11/f20 [0,4194304] 0 2024-04-16T14:35:26.204 INFO:tasks.workunit.client.0.smithi005.stdout:0/101: dwrite da/fb [0,4194304] 0 2024-04-16T14:35:26.204 INFO:tasks.workunit.client.0.smithi005.stdout:3/51: dwrite d2/f5 [8388608,4194304] 0 2024-04-16T14:35:26.208 INFO:tasks.workunit.client.0.smithi005.stdout:0/102: link f0 da/df/f1d 0 2024-04-16T14:35:26.209 INFO:tasks.workunit.client.0.smithi005.stdout:8/92: symlink d5/d11/d1f/l21 0 2024-04-16T14:35:26.212 INFO:tasks.workunit.client.0.smithi005.stdout:0/103: dread f0 [0,4194304] 0 2024-04-16T14:35:26.213 INFO:tasks.workunit.client.0.smithi005.stdout:3/52: dread d2/fe [0,4194304] 0 2024-04-16T14:35:26.214 INFO:tasks.workunit.client.0.smithi005.stdout:0/104: creat da/df/f1e x:0 0 0 2024-04-16T14:35:26.215 INFO:tasks.workunit.client.0.smithi005.stdout:0/105: fsync da/fb 0 2024-04-16T14:35:26.215 INFO:tasks.workunit.client.0.smithi005.stdout:0/106: truncate da/df/f15 490192 0 2024-04-16T14:35:26.215 INFO:tasks.workunit.client.0.smithi005.stdout:0/107: creat da/f1f x:0 0 0 2024-04-16T14:35:26.215 INFO:tasks.workunit.client.0.smithi005.stdout:7/97: truncate d1/dc/f18 3233948 0 2024-04-16T14:35:26.216 INFO:tasks.workunit.client.0.smithi005.stdout:3/53: creat d2/d9/df/f11 x:0 0 0 2024-04-16T14:35:26.218 INFO:tasks.workunit.client.0.smithi005.stdout:0/108: truncate da/fc 341117 0 2024-04-16T14:35:26.218 INFO:tasks.workunit.client.0.smithi005.stdout:0/109: fdatasync da/f12 0 2024-04-16T14:35:26.218 INFO:tasks.workunit.client.0.smithi005.stdout:0/110: truncate da/f12 2281224 0 2024-04-16T14:35:26.219 INFO:tasks.workunit.client.0.smithi005.stdout:3/54: mknod d2/d9/df/c12 0 2024-04-16T14:35:26.219 INFO:tasks.workunit.client.0.smithi005.stdout:0/111: rename f9 to da/f20 0 2024-04-16T14:35:26.221 INFO:tasks.workunit.client.0.smithi005.stdout:0/112: unlink c6 0 2024-04-16T14:35:26.222 INFO:tasks.workunit.client.0.smithi005.stdout:3/55: unlink d2/l6 0 2024-04-16T14:35:26.223 INFO:tasks.workunit.client.0.smithi005.stdout:8/93: dwrite d5/f17 [4194304,4194304] 0 2024-04-16T14:35:26.224 INFO:tasks.workunit.client.0.smithi005.stdout:0/113: rename da/f12 to da/df/f21 0 2024-04-16T14:35:26.224 INFO:tasks.workunit.client.0.smithi005.stdout:0/114: chown da/cd 181577490 1 2024-04-16T14:35:26.226 INFO:tasks.workunit.client.0.smithi005.stdout:3/56: dread d2/f5 [4194304,4194304] 0 2024-04-16T14:35:26.227 INFO:tasks.workunit.client.0.smithi005.stdout:3/57: truncate d2/d9/df/f11 611062 0 2024-04-16T14:35:26.227 INFO:tasks.workunit.client.0.smithi005.stdout:0/115: creat da/df/d1b/f22 x:0 0 0 2024-04-16T14:35:26.228 INFO:tasks.workunit.client.0.smithi005.stdout:3/58: symlink d2/d9/df/l13 0 2024-04-16T14:35:26.230 INFO:tasks.workunit.client.0.smithi005.stdout:0/116: mknod da/df/c23 0 2024-04-16T14:35:26.230 INFO:tasks.workunit.client.0.smithi005.stdout:0/117: write da/df/d1b/f22 [182267,18437] 0 2024-04-16T14:35:26.231 INFO:tasks.workunit.client.0.smithi005.stdout:0/118: mkdir da/df/d1b/d24 0 2024-04-16T14:35:26.232 INFO:tasks.workunit.client.0.smithi005.stdout:0/119: creat da/df/d1b/f25 x:0 0 0 2024-04-16T14:35:26.234 INFO:tasks.workunit.client.0.smithi005.stdout:8/94: dread f1 [4194304,4194304] 0 2024-04-16T14:35:26.238 INFO:tasks.workunit.client.0.smithi005.stdout:3/59: dread d2/fa [0,4194304] 0 2024-04-16T14:35:26.241 INFO:tasks.workunit.client.0.smithi005.stdout:7/98: truncate d1/dc/f18 1590734 0 2024-04-16T14:35:26.245 INFO:tasks.workunit.client.0.smithi005.stdout:7/99: rename d1/d5/c6 to d1/dc/c1f 0 2024-04-16T14:35:26.252 INFO:tasks.workunit.client.0.smithi005.stdout:3/60: read d2/fa [2525333,7870] 0 2024-04-16T14:35:26.261 INFO:tasks.workunit.client.0.smithi005.stdout:0/120: dwrite f8 [0,4194304] 0 2024-04-16T14:35:26.262 INFO:tasks.workunit.client.0.smithi005.stdout:8/95: dwrite d5/de/f19 [0,4194304] 0 2024-04-16T14:35:26.262 INFO:tasks.workunit.client.0.smithi005.stdout:0/121: getdents da 0 2024-04-16T14:35:26.263 INFO:tasks.workunit.client.0.smithi005.stdout:8/96: write f1 [2320848,49746] 0 2024-04-16T14:35:26.267 INFO:tasks.workunit.client.0.smithi005.stdout:0/122: mkdir da/df/d26 0 2024-04-16T14:35:26.267 INFO:tasks.workunit.client.0.smithi005.stdout:0/123: fsync f8 0 2024-04-16T14:35:26.267 INFO:tasks.workunit.client.0.smithi005.stdout:0/124: write da/f1a [32346,19479] 0 2024-04-16T14:35:26.272 INFO:tasks.workunit.client.0.smithi005.stdout:7/100: dwrite d1/dc/f18 [0,4194304] 0 2024-04-16T14:35:26.273 INFO:tasks.workunit.client.0.smithi005.stdout:0/125: getdents da/df 0 2024-04-16T14:35:26.274 INFO:tasks.workunit.client.0.smithi005.stdout:7/101: link d1/dc/ce d1/d5/c20 0 2024-04-16T14:35:26.275 INFO:tasks.workunit.client.0.smithi005.stdout:7/102: rename d1/d5 to d1/d5/d21 22 2024-04-16T14:35:26.275 INFO:tasks.workunit.client.0.smithi005.stdout:7/103: truncate d1/dc/f12 40885 0 2024-04-16T14:35:26.275 INFO:tasks.workunit.client.0.smithi005.stdout:0/126: dread f1 [0,4194304] 0 2024-04-16T14:35:26.275 INFO:tasks.workunit.client.0.smithi005.stdout:0/127: truncate da/f1a 126612 0 2024-04-16T14:35:26.276 INFO:tasks.workunit.client.0.smithi005.stdout:7/104: stat d1/dc/c1f 0 2024-04-16T14:35:26.276 INFO:tasks.workunit.client.0.smithi005.stdout:0/128: symlink da/df/l27 0 2024-04-16T14:35:26.277 INFO:tasks.workunit.client.0.smithi005.stdout:0/129: creat da/df/d1b/d24/f28 x:0 0 0 2024-04-16T14:35:26.277 INFO:tasks.workunit.client.0.smithi005.stdout:7/105: mkdir d1/d5/d22 0 2024-04-16T14:35:26.278 INFO:tasks.workunit.client.0.smithi005.stdout:0/130: truncate f8 760579 0 2024-04-16T14:35:26.279 INFO:tasks.workunit.client.0.smithi005.stdout:0/131: mknod da/df/d1b/d24/c29 0 2024-04-16T14:35:26.279 INFO:tasks.workunit.client.0.smithi005.stdout:0/132: chown da/f20 13217 1 2024-04-16T14:35:26.279 INFO:tasks.workunit.client.0.smithi005.stdout:0/133: chown da/fc 64961 1 2024-04-16T14:35:26.280 INFO:tasks.workunit.client.0.smithi005.stdout:0/134: truncate da/fc 148409 0 2024-04-16T14:35:26.280 INFO:tasks.workunit.client.0.smithi005.stdout:0/135: readlink da/l10 0 2024-04-16T14:35:26.282 INFO:tasks.workunit.client.0.smithi005.stdout:7/106: dread d1/d5/f1a [0,4194304] 0 2024-04-16T14:35:26.282 INFO:tasks.workunit.client.0.smithi005.stdout:0/136: rename da/df/l19 to da/df/l2a 0 2024-04-16T14:35:26.284 INFO:tasks.workunit.client.0.smithi005.stdout:7/107: creat d1/f23 x:0 0 0 2024-04-16T14:35:26.284 INFO:tasks.workunit.client.0.smithi005.stdout:7/108: write d1/dc/f1c [606825,79540] 0 2024-04-16T14:35:26.285 INFO:tasks.workunit.client.0.smithi005.stdout:7/109: dread d1/dc/f12 [0,4194304] 0 2024-04-16T14:35:26.285 INFO:tasks.workunit.client.0.smithi005.stdout:7/110: stat d1/d5 0 2024-04-16T14:35:26.290 INFO:tasks.workunit.client.0.smithi005.stdout:7/111: dread d1/d5/f1a [0,4194304] 0 2024-04-16T14:35:26.290 INFO:tasks.workunit.client.0.smithi005.stdout:7/112: stat d1/d5/l10 0 2024-04-16T14:35:26.290 INFO:tasks.workunit.client.0.smithi005.stdout:0/137: dread da/f1a [0,4194304] 0 2024-04-16T14:35:26.290 INFO:tasks.workunit.client.0.smithi005.stdout:7/113: write d1/dc/f18 [4384197,61143] 0 2024-04-16T14:35:26.291 INFO:tasks.workunit.client.0.smithi005.stdout:7/114: creat d1/d5/f24 x:0 0 0 2024-04-16T14:35:26.291 INFO:tasks.workunit.client.0.smithi005.stdout:7/115: chown d1/c13 390625 1 2024-04-16T14:35:26.291 INFO:tasks.workunit.client.0.smithi005.stdout:7/116: fsync d1/d5/f17 0 2024-04-16T14:35:26.291 INFO:tasks.workunit.client.0.smithi005.stdout:7/117: creat d1/dc/f25 x:0 0 0 2024-04-16T14:35:26.314 INFO:tasks.workunit.client.0.smithi005.stdout:0/138: dwrite da/fe [0,4194304] 0 2024-04-16T14:35:26.314 INFO:tasks.workunit.client.0.smithi005.stdout:0/139: creat da/df/d1b/f2b x:0 0 0 2024-04-16T14:35:26.315 INFO:tasks.workunit.client.0.smithi005.stdout:0/140: link da/c16 da/df/d26/c2c 0 2024-04-16T14:35:26.316 INFO:tasks.workunit.client.0.smithi005.stdout:7/118: dwrite d1/dc/f18 [0,4194304] 0 2024-04-16T14:35:26.316 INFO:tasks.workunit.client.0.smithi005.stdout:7/119: fsync d1/d5/f1a 0 2024-04-16T14:35:26.316 INFO:tasks.workunit.client.0.smithi005.stdout:7/120: write d1/d5/d16/f1e [941854,90097] 0 2024-04-16T14:35:26.317 INFO:tasks.workunit.client.0.smithi005.stdout:0/141: dread f1 [0,4194304] 0 2024-04-16T14:35:26.317 INFO:tasks.workunit.client.0.smithi005.stdout:7/121: mknod d1/d5/d22/c26 0 2024-04-16T14:35:26.317 INFO:tasks.workunit.client.0.smithi005.stdout:7/122: chown d1/dc/f25 3969355 1 2024-04-16T14:35:26.318 INFO:tasks.workunit.client.0.smithi005.stdout:0/142: creat da/f2d x:0 0 0 2024-04-16T14:35:26.318 INFO:tasks.workunit.client.0.smithi005.stdout:0/143: chown da/df/l27 0 1 2024-04-16T14:35:26.319 INFO:tasks.workunit.client.0.smithi005.stdout:7/123: mkdir d1/d5/d22/d27 0 2024-04-16T14:35:26.320 INFO:tasks.workunit.client.0.smithi005.stdout:7/124: write d1/dc/f1c [1658617,104264] 0 2024-04-16T14:35:26.320 INFO:tasks.workunit.client.0.smithi005.stdout:7/125: dread - d1/dc/f25 zero size 2024-04-16T14:35:26.326 INFO:tasks.workunit.client.0.smithi005.stdout:7/126: rmdir d1/d5 39 2024-04-16T14:35:26.331 INFO:tasks.workunit.client.0.smithi005.stdout:0/144: dwrite da/df/d1b/f25 [0,4194304] 0 2024-04-16T14:35:26.360 INFO:tasks.workunit.client.0.smithi005.stdout:7/127: dwrite d1/dc/f1c [0,4194304] 0 2024-04-16T14:35:26.360 INFO:tasks.workunit.client.0.smithi005.stdout:7/128: truncate d1/d5/f17 680420 0 2024-04-16T14:35:26.362 INFO:tasks.workunit.client.0.smithi005.stdout:0/145: dwrite da/fc [0,4194304] 0 2024-04-16T14:35:26.363 INFO:tasks.workunit.client.0.smithi005.stdout:0/146: write da/df/f1d [848630,58668] 0 2024-04-16T14:35:26.365 INFO:tasks.workunit.client.0.smithi005.stdout:7/129: truncate d1/d5/d16/f1e 909504 0 2024-04-16T14:35:26.365 INFO:tasks.workunit.client.0.smithi005.stdout:7/130: chown d1/cf 22 1 2024-04-16T14:35:26.366 INFO:tasks.workunit.client.0.smithi005.stdout:7/131: creat d1/d5/d22/f28 x:0 0 0 2024-04-16T14:35:26.367 INFO:tasks.workunit.client.0.smithi005.stdout:0/147: dread f1 [0,4194304] 0 2024-04-16T14:35:26.367 INFO:tasks.workunit.client.0.smithi005.stdout:7/132: rename d1/d5/f24 to d1/f29 0 2024-04-16T14:35:26.368 INFO:tasks.workunit.client.0.smithi005.stdout:0/148: link da/f2d da/df/d26/f2e 0 2024-04-16T14:35:26.369 INFO:tasks.workunit.client.0.smithi005.stdout:7/133: mknod d1/d5/d22/d27/c2a 0 2024-04-16T14:35:26.371 INFO:tasks.workunit.client.0.smithi005.stdout:0/149: link da/df/c1c da/df/d1b/c2f 0 2024-04-16T14:35:26.371 INFO:tasks.workunit.client.0.smithi005.stdout:0/150: creat da/f30 x:0 0 0 2024-04-16T14:35:26.373 INFO:tasks.workunit.client.0.smithi005.stdout:7/134: creat d1/d5/d22/d27/f2b x:0 0 0 2024-04-16T14:35:26.374 INFO:tasks.workunit.client.0.smithi005.stdout:7/135: dread d1/dc/f12 [0,4194304] 0 2024-04-16T14:35:26.374 INFO:tasks.workunit.client.0.smithi005.stdout:7/136: fdatasync d1/d5/f11 0 2024-04-16T14:35:26.383 INFO:tasks.workunit.client.0.smithi005.stdout:7/137: dread d1/dc/f1c [0,4194304] 0 2024-04-16T14:35:26.383 INFO:tasks.workunit.client.0.smithi005.stdout:7/138: stat d1/d5/c9 0 2024-04-16T14:35:26.384 INFO:tasks.workunit.client.0.smithi005.stdout:7/139: getdents d1/d5/d22 0 2024-04-16T14:35:26.386 INFO:tasks.workunit.client.0.smithi005.stdout:7/140: creat d1/d5/d16/f2c x:0 0 0 2024-04-16T14:35:26.386 INFO:tasks.workunit.client.0.smithi005.stdout:7/141: creat d1/d5/d16/f2d x:0 0 0 2024-04-16T14:35:26.386 INFO:tasks.workunit.client.0.smithi005.stdout:0/151: dwrite da/df/f15 [0,4194304] 0 2024-04-16T14:35:26.386 INFO:tasks.workunit.client.0.smithi005.stdout:0/152: creat da/df/d1b/f31 x:0 0 0 2024-04-16T14:35:26.386 INFO:tasks.workunit.client.0.smithi005.stdout:0/153: dread - da/df/d1b/f31 zero size 2024-04-16T14:35:26.445 INFO:tasks.workunit.client.0.smithi005.stdout:7/142: mkdir d1/d5/d22/d27/d2e 0 2024-04-16T14:35:26.447 INFO:tasks.workunit.client.0.smithi005.stdout:0/154: stat da/c16 0 2024-04-16T14:35:26.448 INFO:tasks.workunit.client.0.smithi005.stdout:7/143: mkdir d1/dc/d2f 0 2024-04-16T14:35:26.449 INFO:tasks.workunit.client.0.smithi005.stdout:0/155: getdents da/df 0 2024-04-16T14:35:26.463 INFO:tasks.workunit.client.0.smithi005.stdout:7/144: dwrite d1/d5/f1a [4194304,4194304] 0 2024-04-16T14:35:26.464 INFO:tasks.workunit.client.0.smithi005.stdout:7/145: creat d1/d5/d22/f30 x:0 0 0 2024-04-16T14:35:26.605 INFO:tasks.workunit.client.0.smithi005.stdout:2/22: sync 2024-04-16T14:35:26.605 INFO:tasks.workunit.client.0.smithi005.stdout:9/21: sync 2024-04-16T14:35:26.605 INFO:tasks.workunit.client.0.smithi005.stdout:1/60: sync 2024-04-16T14:35:26.605 INFO:tasks.workunit.client.0.smithi005.stdout:2/23: write d0/f2 [3655181,56803] 0 2024-04-16T14:35:26.606 INFO:tasks.workunit.client.0.smithi005.stdout:9/22: rename c0 to d3/c6 0 2024-04-16T14:35:26.606 INFO:tasks.workunit.client.0.smithi005.stdout:2/24: rename d0/d4/d7 to d0/d4/d7/d8 22 2024-04-16T14:35:26.606 INFO:tasks.workunit.client.0.smithi005.stdout:2/25: getdents d0/d4/d7 0 2024-04-16T14:35:26.607 INFO:tasks.workunit.client.0.smithi005.stdout:1/61: mkdir d2/d12 0 2024-04-16T14:35:26.610 INFO:tasks.workunit.client.0.smithi005.stdout:1/62: unlink d2/d4/f6 0 2024-04-16T14:35:26.611 INFO:tasks.workunit.client.0.smithi005.stdout:1/63: link f0 d2/f13 0 2024-04-16T14:35:26.614 INFO:tasks.workunit.client.0.smithi005.stdout:1/64: link d2/d4/fd d2/d12/f14 0 2024-04-16T14:35:26.624 INFO:tasks.workunit.client.0.smithi005.stdout:1/65: write d2/d4/ff [3234419,106568] 0 2024-04-16T14:35:26.625 INFO:tasks.workunit.client.0.smithi005.stdout:1/66: mkdir d2/d4/d15 0 2024-04-16T14:35:26.626 INFO:tasks.workunit.client.0.smithi005.stdout:1/67: truncate d2/d4/fd 746046 0 2024-04-16T14:35:26.637 INFO:tasks.workunit.client.0.smithi005.stdout:1/68: fdatasync d2/d4/fe 0 2024-04-16T14:35:26.638 INFO:tasks.workunit.client.0.smithi005.stdout:2/26: dwrite d0/f5 [0,4194304] 0 2024-04-16T14:35:26.638 INFO:tasks.workunit.client.0.smithi005.stdout:9/23: dwrite d3/f5 [0,4194304] 0 2024-04-16T14:35:26.638 INFO:tasks.workunit.client.0.smithi005.stdout:9/24: chown l2 6032 1 2024-04-16T14:35:26.641 INFO:tasks.workunit.client.0.smithi005.stdout:9/25: creat d3/f7 x:0 0 0 2024-04-16T14:35:26.641 INFO:tasks.workunit.client.0.smithi005.stdout:9/26: readlink l2 0 2024-04-16T14:35:26.645 INFO:tasks.workunit.client.0.smithi005.stdout:1/69: write d2/d4/fe [8303260,4258] 0 2024-04-16T14:35:26.646 INFO:tasks.workunit.client.0.smithi005.stdout:1/70: creat d2/d4/d10/f16 x:0 0 0 2024-04-16T14:35:26.648 INFO:tasks.workunit.client.0.smithi005.stdout:1/71: unlink d2/d4/l5 0 2024-04-16T14:35:26.648 INFO:tasks.workunit.client.0.smithi005.stdout:1/72: creat d2/d4/f17 x:0 0 0 2024-04-16T14:35:26.650 INFO:tasks.workunit.client.0.smithi005.stdout:2/27: write d0/f2 [2434729,3590] 0 2024-04-16T14:35:26.650 INFO:tasks.workunit.client.0.smithi005.stdout:2/28: chown d0/f5 28 1 2024-04-16T14:35:26.650 INFO:tasks.workunit.client.0.smithi005.stdout:2/29: write d0/d4/f6 [300355,11794] 0 2024-04-16T14:35:26.650 INFO:tasks.workunit.client.0.smithi005.stdout:1/73: fdatasync d2/d4/fe 0 2024-04-16T14:35:26.650 INFO:tasks.workunit.client.0.smithi005.stdout:1/74: truncate d2/fb 543855 0 2024-04-16T14:35:26.652 INFO:tasks.workunit.client.0.smithi005.stdout:1/75: creat d2/f18 x:0 0 0 2024-04-16T14:35:26.659 INFO:tasks.workunit.client.0.smithi005.stdout:9/27: dwrite d3/f5 [0,4194304] 0 2024-04-16T14:35:26.660 INFO:tasks.workunit.client.0.smithi005.stdout:1/76: dread d2/d4/ff [0,4194304] 0 2024-04-16T14:35:26.660 INFO:tasks.workunit.client.0.smithi005.stdout:9/28: creat d3/f8 x:0 0 0 2024-04-16T14:35:26.661 INFO:tasks.workunit.client.0.smithi005.stdout:1/77: mkdir d2/d4/d10/d19 0 2024-04-16T14:35:26.663 INFO:tasks.workunit.client.0.smithi005.stdout:9/29: symlink d3/l9 0 2024-04-16T14:35:26.664 INFO:tasks.workunit.client.0.smithi005.stdout:1/78: mkdir d2/d4/d10/d1a 0 2024-04-16T14:35:26.666 INFO:tasks.workunit.client.0.smithi005.stdout:1/79: rename f0 to d2/d4/f1b 0 2024-04-16T14:35:26.684 INFO:tasks.workunit.client.0.smithi005.stdout:9/30: dwrite d3/f5 [0,4194304] 0 2024-04-16T14:35:26.684 INFO:tasks.workunit.client.0.smithi005.stdout:1/80: dwrite d2/d12/f14 [0,4194304] 0 2024-04-16T14:35:26.685 INFO:tasks.workunit.client.0.smithi005.stdout:9/31: symlink d3/la 0 2024-04-16T14:35:26.685 INFO:tasks.workunit.client.0.smithi005.stdout:9/32: creat d3/fb x:0 0 0 2024-04-16T14:35:26.686 INFO:tasks.workunit.client.0.smithi005.stdout:1/81: rmdir d2/d12 39 2024-04-16T14:35:26.687 INFO:tasks.workunit.client.0.smithi005.stdout:9/33: symlink d3/lc 0 2024-04-16T14:35:26.694 INFO:tasks.workunit.client.0.smithi005.stdout:1/82: rename d2/d4 to d2/d1c 0 2024-04-16T14:35:26.694 INFO:tasks.workunit.client.0.smithi005.stdout:1/83: getdents d2/d12 0 2024-04-16T14:35:26.696 INFO:tasks.workunit.client.0.smithi005.stdout:1/84: rename d2/fb to d2/d1c/d15/f1d 0 2024-04-16T14:35:26.699 INFO:tasks.workunit.client.0.smithi005.stdout:1/85: creat d2/d1c/f1e x:0 0 0 2024-04-16T14:35:26.715 INFO:tasks.workunit.client.0.smithi005.stdout:1/86: dwrite d2/d1c/f1e [0,4194304] 0 2024-04-16T14:35:26.717 INFO:tasks.workunit.client.0.smithi005.stdout:1/87: rename d2/d12/f14 to d2/d1c/f1f 0 2024-04-16T14:35:26.721 INFO:tasks.workunit.client.0.smithi005.stdout:1/88: dread d2/d1c/ff [4194304,4194304] 0 2024-04-16T14:35:26.722 INFO:tasks.workunit.client.0.smithi005.stdout:1/89: mkdir d2/d1c/d10/d19/d20 0 2024-04-16T14:35:26.722 INFO:tasks.workunit.client.0.smithi005.stdout:1/90: mkdir d2/d1c/d10/d1a/d21 0 2024-04-16T14:35:26.723 INFO:tasks.workunit.client.0.smithi005.stdout:1/91: symlink d2/d12/l22 0 2024-04-16T14:35:26.724 INFO:tasks.workunit.client.0.smithi005.stdout:1/92: symlink d2/d1c/d10/d19/l23 0 2024-04-16T14:35:26.724 INFO:tasks.workunit.client.0.smithi005.stdout:1/93: mknod d2/d1c/d10/d19/c24 0 2024-04-16T14:35:26.735 INFO:tasks.workunit.client.0.smithi005.stdout:1/94: dwrite d2/d1c/d15/f1d [0,4194304] 0 2024-04-16T14:35:26.737 INFO:tasks.workunit.client.0.smithi005.stdout:1/95: truncate d2/d1c/fd 1810687 0 2024-04-16T14:35:26.737 INFO:tasks.workunit.client.0.smithi005.stdout:1/96: chown d2/d1c/d15/f1d 0 1 2024-04-16T14:35:26.755 INFO:tasks.workunit.client.0.smithi005.stdout:1/97: dwrite d2/d1c/fd [0,4194304] 0 2024-04-16T14:35:26.759 INFO:tasks.workunit.client.0.smithi005.stdout:6/215: sync 2024-04-16T14:35:26.759 INFO:tasks.workunit.client.0.smithi005.stdout:5/74: sync 2024-04-16T14:35:26.760 INFO:tasks.workunit.client.0.smithi005.stdout:5/75: mkdir d0/d6/d12 0 2024-04-16T14:35:26.769 INFO:tasks.workunit.client.0.smithi005.stdout:6/216: write d2/d5/d10/f13 [2384699,36040] 0 2024-04-16T14:35:26.769 INFO:tasks.workunit.client.0.smithi005.stdout:6/217: chown d2/d5/f2a 285674590 1 2024-04-16T14:35:26.769 INFO:tasks.workunit.client.0.smithi005.stdout:6/218: chown d2/d5/d10/d12/f31 20293 1 2024-04-16T14:35:26.769 INFO:tasks.workunit.client.0.smithi005.stdout:1/98: dwrite d2/d1c/f1f [0,4194304] 0 2024-04-16T14:35:26.769 INFO:tasks.workunit.client.0.smithi005.stdout:6/219: write d2/d5/d10/f44 [839941,70826] 0 2024-04-16T14:35:26.773 INFO:tasks.workunit.client.0.smithi005.stdout:1/99: truncate d2/d1c/f1f 2193145 0 2024-04-16T14:35:26.775 INFO:tasks.workunit.client.0.smithi005.stdout:1/100: mkdir d2/d1c/d10/d25 0 2024-04-16T14:35:26.775 INFO:tasks.workunit.client.0.smithi005.stdout:1/101: truncate d2/d1c/f17 952869 0 2024-04-16T14:35:26.776 INFO:tasks.workunit.client.0.smithi005.stdout:1/102: mkdir d2/d1c/d10/d19/d26 0 2024-04-16T14:35:26.778 INFO:tasks.workunit.client.0.smithi005.stdout:1/103: mkdir d2/d1c/d10/d19/d20/d27 0 2024-04-16T14:35:26.785 INFO:tasks.workunit.client.0.smithi005.stdout:6/220: dwrite d2/d5/d10/d12/f41 [0,4194304] 0 2024-04-16T14:35:26.790 INFO:tasks.workunit.client.0.smithi005.stdout:6/221: dread d2/d5/d10/d12/f1a [0,4194304] 0 2024-04-16T14:35:26.792 INFO:tasks.workunit.client.0.smithi005.stdout:1/104: dwrite d2/d1c/f1f [0,4194304] 0 2024-04-16T14:35:26.792 INFO:tasks.workunit.client.0.smithi005.stdout:1/105: read d2/f13 [3838799,61962] 0 2024-04-16T14:35:26.792 INFO:tasks.workunit.client.0.smithi005.stdout:1/106: unlink d2/f18 0 2024-04-16T14:35:26.795 INFO:tasks.workunit.client.0.smithi005.stdout:1/107: rmdir d2/d1c/d10/d19/d26 0 2024-04-16T14:35:26.795 INFO:tasks.workunit.client.0.smithi005.stdout:1/108: read - d2/d1c/d10/f16 zero size 2024-04-16T14:35:26.797 INFO:tasks.workunit.client.0.smithi005.stdout:1/109: link d2/d1c/f1f d2/d1c/f28 0 2024-04-16T14:35:26.797 INFO:tasks.workunit.client.0.smithi005.stdout:1/110: write d2/d1c/fd [4658315,123634] 0 2024-04-16T14:35:26.798 INFO:tasks.workunit.client.0.smithi005.stdout:1/111: rename d2/d1c/f1b to d2/d1c/d10/d1a/d21/f29 0 2024-04-16T14:35:26.803 INFO:tasks.workunit.client.0.smithi005.stdout:6/222: dwrite d2/d5/d28/f2c [0,4194304] 0 2024-04-16T14:35:26.806 INFO:tasks.workunit.client.0.smithi005.stdout:1/112: write d2/d1c/d15/f1d [1956949,116285] 0 2024-04-16T14:35:26.806 INFO:tasks.workunit.client.0.smithi005.stdout:1/113: chown d2/d1c/fe 3730790 1 2024-04-16T14:35:26.810 INFO:tasks.workunit.client.0.smithi005.stdout:6/223: dread d2/d5/f2a [0,4194304] 0 2024-04-16T14:35:26.810 INFO:tasks.workunit.client.0.smithi005.stdout:6/224: stat d2/d5/d10/l16 0 2024-04-16T14:35:26.812 INFO:tasks.workunit.client.0.smithi005.stdout:6/225: creat d2/d5/d28/f46 x:0 0 0 2024-04-16T14:35:26.812 INFO:tasks.workunit.client.0.smithi005.stdout:1/114: rename d2/d1c/d10 to d2/d1c/d15/d2a 0 2024-04-16T14:35:26.815 INFO:tasks.workunit.client.0.smithi005.stdout:1/115: creat d2/d1c/d15/d2a/d1a/d21/f2b x:0 0 0 2024-04-16T14:35:26.815 INFO:tasks.workunit.client.0.smithi005.stdout:1/116: stat d2/d1c/f1e 0 2024-04-16T14:35:26.815 INFO:tasks.workunit.client.0.smithi005.stdout:1/117: readlink d2/d1c/d15/d2a/d19/l23 0 2024-04-16T14:35:26.817 INFO:tasks.workunit.client.0.smithi005.stdout:1/118: rename d2/d12 to d2/d2c 0 2024-04-16T14:35:26.817 INFO:tasks.workunit.client.0.smithi005.stdout:1/119: truncate d2/d1c/d15/d2a/d1a/d21/f2b 738323 0 2024-04-16T14:35:26.819 INFO:tasks.workunit.client.0.smithi005.stdout:6/226: rename d2/d5/d10/d12 to d2/d3f/d47 0 2024-04-16T14:35:26.819 INFO:tasks.workunit.client.0.smithi005.stdout:1/120: rename d2/d1c to d2/d1c/d15/d2a/d1a/d2d 22 2024-04-16T14:35:26.819 INFO:tasks.workunit.client.0.smithi005.stdout:1/121: chown d2/d1c/ca 365595 1 2024-04-16T14:35:26.820 INFO:tasks.workunit.client.0.smithi005.stdout:1/122: read d2/d1c/f17 [521300,80365] 0 2024-04-16T14:35:26.820 INFO:tasks.workunit.client.0.smithi005.stdout:6/227: rename d2/d3f/d47/f1a to d2/d45/f48 0 2024-04-16T14:35:26.823 INFO:tasks.workunit.client.0.smithi005.stdout:1/123: mkdir d2/d1c/d15/d2a/d1a/d2e 0 2024-04-16T14:35:26.823 INFO:tasks.workunit.client.0.smithi005.stdout:1/124: write d2/d1c/d15/d2a/d1a/d21/f29 [2548926,48956] 0 2024-04-16T14:35:26.823 INFO:tasks.workunit.client.0.smithi005.stdout:1/125: stat d2/d1c/d15/f1d 0 2024-04-16T14:35:26.823 INFO:tasks.workunit.client.0.smithi005.stdout:6/228: link d2/d5/c1e d2/df/c49 0 2024-04-16T14:35:26.824 INFO:tasks.workunit.client.0.smithi005.stdout:1/126: symlink d2/d2c/l2f 0 2024-04-16T14:35:26.824 INFO:tasks.workunit.client.0.smithi005.stdout:1/127: getdents d2/d1c 0 2024-04-16T14:35:26.828 INFO:tasks.workunit.client.0.smithi005.stdout:6/229: dread d2/d5/d28/f21 [0,4194304] 0 2024-04-16T14:35:26.834 INFO:tasks.workunit.client.0.smithi005.stdout:1/128: truncate d2/f13 6973538 0 2024-04-16T14:35:26.834 INFO:tasks.workunit.client.0.smithi005.stdout:1/129: stat d2/d1c/d15/d2a/d19/c24 0 2024-04-16T14:35:26.834 INFO:tasks.workunit.client.0.smithi005.stdout:1/130: link d2/d1c/f1e d2/d1c/d15/d2a/d1a/d21/f30 0 2024-04-16T14:35:26.838 INFO:tasks.workunit.client.0.smithi005.stdout:0/156: sync 2024-04-16T14:35:26.838 INFO:tasks.workunit.client.0.smithi005.stdout:8/97: sync 2024-04-16T14:35:26.838 INFO:tasks.workunit.client.0.smithi005.stdout:4/200: sync 2024-04-16T14:35:26.838 INFO:tasks.workunit.client.0.smithi005.stdout:7/146: sync 2024-04-16T14:35:26.838 INFO:tasks.workunit.client.0.smithi005.stdout:3/61: sync 2024-04-16T14:35:26.840 INFO:tasks.workunit.client.0.smithi005.stdout:0/157: rename da/df/d1b/f2b to da/f32 0 2024-04-16T14:35:26.843 INFO:tasks.workunit.client.0.smithi005.stdout:7/147: mknod d1/d5/d22/c31 0 2024-04-16T14:35:26.843 INFO:tasks.workunit.client.0.smithi005.stdout:7/148: fdatasync d1/d5/f11 0 2024-04-16T14:35:26.844 INFO:tasks.workunit.client.0.smithi005.stdout:8/98: mknod d5/c22 0 2024-04-16T14:35:26.848 INFO:tasks.workunit.client.0.smithi005.stdout:0/158: rename da/df/c23 to da/df/d26/c33 0 2024-04-16T14:35:26.848 INFO:tasks.workunit.client.0.smithi005.stdout:4/201: getdents d0/d22/d29 0 2024-04-16T14:35:26.850 INFO:tasks.workunit.client.0.smithi005.stdout:6/230: dwrite d2/d5/f37 [0,4194304] 0 2024-04-16T14:35:26.850 INFO:tasks.workunit.client.0.smithi005.stdout:6/231: write d2/df/f30 [976400,49121] 0 2024-04-16T14:35:26.851 INFO:tasks.workunit.client.0.smithi005.stdout:7/149: write d1/d5/f1a [2357832,109238] 0 2024-04-16T14:35:26.856 INFO:tasks.workunit.client.0.smithi005.stdout:1/131: dwrite d2/d1c/f1f [0,4194304] 0 2024-04-16T14:35:26.863 INFO:tasks.workunit.client.0.smithi005.stdout:1/132: dread d2/d1c/f1f [0,4194304] 0 2024-04-16T14:35:26.864 INFO:tasks.workunit.client.0.smithi005.stdout:1/133: mknod d2/d1c/d15/d2a/d19/c31 0 2024-04-16T14:35:26.864 INFO:tasks.workunit.client.0.smithi005.stdout:1/134: fdatasync d2/d1c/d15/d2a/d1a/d21/f30 0 2024-04-16T14:35:26.865 INFO:tasks.workunit.client.0.smithi005.stdout:1/135: symlink d2/d1c/d15/d2a/d19/d20/l32 0 2024-04-16T14:35:26.866 INFO:tasks.workunit.client.0.smithi005.stdout:7/150: dread d1/dc/f1c [0,4194304] 0 2024-04-16T14:35:26.866 INFO:tasks.workunit.client.0.smithi005.stdout:7/151: chown d1/c13 1471896 1 2024-04-16T14:35:26.867 INFO:tasks.workunit.client.0.smithi005.stdout:7/152: write d1/d5/d22/f28 [253305,28095] 0 2024-04-16T14:35:26.867 INFO:tasks.workunit.client.0.smithi005.stdout:1/136: mknod d2/d1c/d15/d2a/d25/c33 0 2024-04-16T14:35:26.867 INFO:tasks.workunit.client.0.smithi005.stdout:7/153: symlink d1/d5/l32 0 2024-04-16T14:35:26.871 INFO:tasks.workunit.client.0.smithi005.stdout:1/137: write d2/d1c/f28 [2319353,17474] 0 2024-04-16T14:35:26.873 INFO:tasks.workunit.client.0.smithi005.stdout:1/138: creat d2/d1c/d15/d2a/d19/d20/d27/f34 x:0 0 0 2024-04-16T14:35:26.875 INFO:tasks.workunit.client.0.smithi005.stdout:1/139: creat d2/d1c/d15/d2a/d1a/d2e/f35 x:0 0 0 2024-04-16T14:35:26.877 INFO:tasks.workunit.client.0.smithi005.stdout:1/140: unlink d2/d1c/d15/d2a/d19/c24 0 2024-04-16T14:35:26.877 INFO:tasks.workunit.client.0.smithi005.stdout:1/141: write d2/d1c/fd [3274403,108080] 0 2024-04-16T14:35:26.877 INFO:tasks.workunit.client.0.smithi005.stdout:1/142: read d2/d1c/d15/d2a/d1a/d21/f2b [362191,60231] 0 2024-04-16T14:35:26.882 INFO:tasks.workunit.client.0.smithi005.stdout:3/62: dwrite d2/f5 [8388608,4194304] 0 2024-04-16T14:35:26.892 INFO:tasks.workunit.client.0.smithi005.stdout:7/154: write d1/d5/f11 [2409640,125098] 0 2024-04-16T14:35:26.892 INFO:tasks.workunit.client.0.smithi005.stdout:7/155: fsync d1/f29 0 2024-04-16T14:35:26.898 INFO:tasks.workunit.client.0.smithi005.stdout:1/143: dread d2/d1c/d15/d2a/d1a/d21/f30 [0,4194304] 0 2024-04-16T14:35:26.899 INFO:tasks.workunit.client.0.smithi005.stdout:8/99: dwrite d5/de/f15 [0,4194304] 0 2024-04-16T14:35:26.899 INFO:tasks.workunit.client.0.smithi005.stdout:8/100: creat d5/f23 x:0 0 0 2024-04-16T14:35:26.899 INFO:tasks.workunit.client.0.smithi005.stdout:1/144: creat d2/d1c/d15/d2a/d25/f36 x:0 0 0 2024-04-16T14:35:26.904 INFO:tasks.workunit.client.0.smithi005.stdout:8/101: dread f1 [4194304,4194304] 0 2024-04-16T14:35:26.909 INFO:tasks.workunit.client.0.smithi005.stdout:0/159: dwrite da/df/d26/f2e [0,4194304] 0 2024-04-16T14:35:26.909 INFO:tasks.workunit.client.0.smithi005.stdout:4/202: dwrite d0/f12 [0,4194304] 0 2024-04-16T14:35:26.909 INFO:tasks.workunit.client.0.smithi005.stdout:6/232: dwrite d2/d3f/d47/f31 [4194304,4194304] 0 2024-04-16T14:35:26.909 INFO:tasks.workunit.client.0.smithi005.stdout:3/63: dwrite d2/fa [0,4194304] 0 2024-04-16T14:35:26.911 INFO:tasks.workunit.client.0.smithi005.stdout:0/160: getdents da/df 0 2024-04-16T14:35:26.914 INFO:tasks.workunit.client.0.smithi005.stdout:8/102: read d5/f17 [2193922,65616] 0 2024-04-16T14:35:26.915 INFO:tasks.workunit.client.0.smithi005.stdout:7/156: dread d1/d5/f1a [0,4194304] 0 2024-04-16T14:35:26.915 INFO:tasks.workunit.client.0.smithi005.stdout:7/157: fdatasync d1/d5/d16/f2d 0 2024-04-16T14:35:26.915 INFO:tasks.workunit.client.0.smithi005.stdout:7/158: getdents d1/d5/d22/d27/d2e 0 2024-04-16T14:35:26.915 INFO:tasks.workunit.client.0.smithi005.stdout:7/159: write d1/d5/d22/d27/f2b [673861,77026] 0 2024-04-16T14:35:26.916 INFO:tasks.workunit.client.0.smithi005.stdout:4/203: dread d0/d1b/d1d/d1f/f20 [0,4194304] 0 2024-04-16T14:35:26.921 INFO:tasks.workunit.client.0.smithi005.stdout:1/145: dwrite d2/d1c/d15/d2a/d19/d20/d27/f34 [0,4194304] 0 2024-04-16T14:35:26.923 INFO:tasks.workunit.client.0.smithi005.stdout:1/146: fsync d2/d1c/d15/d2a/d1a/d21/f29 0 2024-04-16T14:35:26.924 INFO:tasks.workunit.client.0.smithi005.stdout:6/233: rename d2/d5/d28/l36 to d2/d5/d10/l4a 0 2024-04-16T14:35:26.924 INFO:tasks.workunit.client.0.smithi005.stdout:1/147: dread d2/d1c/d15/d2a/d1a/d21/f2b [0,4194304] 0 2024-04-16T14:35:26.926 INFO:tasks.workunit.client.0.smithi005.stdout:0/161: rmdir da/df 39 2024-04-16T14:35:26.927 INFO:tasks.workunit.client.0.smithi005.stdout:8/103: creat d5/d11/d1f/f24 x:0 0 0 2024-04-16T14:35:26.929 INFO:tasks.workunit.client.0.smithi005.stdout:7/160: truncate d1/d5/d16/f1e 334995 0 2024-04-16T14:35:26.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:26 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:35:26.931 INFO:tasks.workunit.client.0.smithi005.stdout:4/204: mknod d0/d1b/d1d/d1f/c41 0 2024-04-16T14:35:26.935 INFO:tasks.workunit.client.0.smithi005.stdout:6/234: link d2/d3f/d47/l3a d2/d20/d33/l4b 0 2024-04-16T14:35:26.935 INFO:tasks.workunit.client.0.smithi005.stdout:6/235: read d2/d3f/d47/f31 [2966296,32001] 0 2024-04-16T14:35:26.935 INFO:tasks.workunit.client.0.smithi005.stdout:6/236: readlink d2/l1c 0 2024-04-16T14:35:26.938 INFO:tasks.workunit.client.0.smithi005.stdout:3/64: rmdir d2 39 2024-04-16T14:35:26.940 INFO:tasks.workunit.client.0.smithi005.stdout:0/162: mkdir da/df/d26/d34 0 2024-04-16T14:35:26.941 INFO:tasks.workunit.client.0.smithi005.stdout:4/205: symlink d0/d1b/d1d/d1f/l42 0 2024-04-16T14:35:26.941 INFO:tasks.workunit.client.0.smithi005.stdout:4/206: chown d0/f12 1060625474 1 2024-04-16T14:35:26.941 INFO:tasks.workunit.client.0.smithi005.stdout:4/207: dread - d0/f2c zero size 2024-04-16T14:35:26.941 INFO:tasks.workunit.client.0.smithi005.stdout:4/208: creat d0/d1b/d2e/f43 x:0 0 0 2024-04-16T14:35:26.942 INFO:tasks.workunit.client.0.smithi005.stdout:1/148: dwrite d2/d1c/ff [4194304,4194304] 0 2024-04-16T14:35:26.942 INFO:tasks.workunit.client.0.smithi005.stdout:9/34: sync 2024-04-16T14:35:26.942 INFO:tasks.workunit.client.0.smithi005.stdout:5/76: sync 2024-04-16T14:35:26.942 INFO:tasks.workunit.client.0.smithi005.stdout:2/30: sync 2024-04-16T14:35:26.943 INFO:tasks.workunit.client.0.smithi005.stdout:9/35: chown d3/l9 1 1 2024-04-16T14:35:26.943 INFO:tasks.workunit.client.0.smithi005.stdout:9/36: dread - d3/f7 zero size 2024-04-16T14:35:26.943 INFO:tasks.workunit.client.0.smithi005.stdout:9/37: creat d3/fd x:0 0 0 2024-04-16T14:35:26.943 INFO:tasks.workunit.client.0.smithi005.stdout:5/77: write d0/f8 [4421499,77946] 0 2024-04-16T14:35:26.943 INFO:tasks.workunit.client.0.smithi005.stdout:3/65: unlink d2/f5 0 2024-04-16T14:35:26.945 INFO:tasks.workunit.client.0.smithi005.stdout:0/163: rename da/df/d26/f2e to da/df/d1b/d24/f35 0 2024-04-16T14:35:26.948 INFO:tasks.workunit.client.0.smithi005.stdout:4/209: mknod d0/d22/c44 0 2024-04-16T14:35:26.949 INFO:tasks.workunit.client.0.smithi005.stdout:1/149: rmdir d2/d1c/d15/d2a/d1a/d21 39 2024-04-16T14:35:26.950 INFO:tasks.workunit.client.1.smithi115.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-16T14:35:26.954 INFO:tasks.workunit.client.0.smithi005.stdout:2/31: link d0/f5 d0/d4/f9 0 2024-04-16T14:35:26.954 INFO:tasks.workunit.client.0.smithi005.stdout:5/78: rmdir d0/d6 39 2024-04-16T14:35:26.955 INFO:tasks.workunit.client.0.smithi005.stdout:3/66: symlink d2/d9/l14 0 2024-04-16T14:35:26.956 INFO:tasks.workunit.client.0.smithi005.stdout:0/164: truncate da/fe 401998 0 2024-04-16T14:35:26.957 INFO:tasks.workunit.client.0.smithi005.stdout:5/79: symlink d0/d6/d12/l13 0 2024-04-16T14:35:26.958 INFO:tasks.workunit.client.0.smithi005.stdout:1/150: dread d2/f13 [4194304,4194304] 0 2024-04-16T14:35:26.959 INFO:tasks.workunit.client.1.smithi115.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-16T14:35:26.959 INFO:tasks.workunit.client.1.smithi115.stderr:+ make 2024-04-16T14:35:26.959 INFO:tasks.workunit.client.0.smithi005.stdout:0/165: creat da/df/f36 x:0 0 0 2024-04-16T14:35:26.959 INFO:tasks.workunit.client.0.smithi005.stdout:0/166: fdatasync f8 0 2024-04-16T14:35:26.960 INFO:tasks.workunit.client.0.smithi005.stdout:4/210: dread d0/f1a [0,4194304] 0 2024-04-16T14:35:26.960 INFO:tasks.workunit.client.0.smithi005.stdout:5/80: rename d0/fc to d0/d6/d12/f14 0 2024-04-16T14:35:26.961 INFO:tasks.workunit.client.0.smithi005.stdout:3/67: mknod d2/c15 0 2024-04-16T14:35:26.961 INFO:tasks.workunit.client.0.smithi005.stdout:3/68: chown d2/d9/df/f11 2 1 2024-04-16T14:35:26.962 INFO:tasks.workunit.client.0.smithi005.stdout:1/151: truncate d2/d1c/f1f 2669170 0 2024-04-16T14:35:26.962 INFO:tasks.workunit.client.0.smithi005.stdout:1/152: creat d2/f37 x:0 0 0 2024-04-16T14:35:26.963 INFO:tasks.workunit.client.0.smithi005.stdout:4/211: rename d0/c4 to d0/d1b/c45 0 2024-04-16T14:35:26.963 INFO:tasks.workunit.client.0.smithi005.stdout:3/69: rename d2/d9 to d2/d9/df/d16 22 2024-04-16T14:35:26.963 INFO:tasks.workunit.client.0.smithi005.stdout:3/70: write d2/d9/df/f11 [854893,17042] 0 2024-04-16T14:35:26.963 INFO:tasks.workunit.client.0.smithi005.stdout:4/212: write d0/fd [4197834,74843] 0 2024-04-16T14:35:26.963 INFO:tasks.workunit.client.0.smithi005.stdout:5/81: mknod d0/c15 0 2024-04-16T14:35:26.968 INFO:tasks.workunit.client.0.smithi005.stdout:2/32: write d0/d4/f9 [2190127,13928] 0 2024-04-16T14:35:26.968 INFO:tasks.workunit.client.0.smithi005.stdout:2/33: write d0/d4/f9 [4735266,72248] 0 2024-04-16T14:35:26.969 INFO:tasks.workunit.client.0.smithi005.stdout:7/161: dwrite d1/d5/d16/f2c [0,4194304] 0 2024-04-16T14:35:26.969 INFO:tasks.workunit.client.0.smithi005.stdout:7/162: chown d1/f29 2048 1 2024-04-16T14:35:26.970 INFO:tasks.workunit.client.0.smithi005.stdout:7/163: dread - d1/f29 zero size 2024-04-16T14:35:26.970 INFO:tasks.workunit.client.0.smithi005.stdout:7/164: chown d1/d5/f11 1138574643 1 2024-04-16T14:35:26.970 INFO:tasks.workunit.client.0.smithi005.stdout:7/165: truncate d1/f23 18620 0 2024-04-16T14:35:26.971 INFO:tasks.workunit.client.0.smithi005.stdout:4/213: write d0/fa [3931117,130274] 0 2024-04-16T14:35:26.972 INFO:tasks.workunit.client.0.smithi005.stdout:6/237: dwrite d2/d5/f8 [0,4194304] 0 2024-04-16T14:35:26.972 INFO:tasks.workunit.client.0.smithi005.stdout:8/104: dwrite f4 [4194304,4194304] 0 2024-04-16T14:35:26.972 INFO:tasks.workunit.client.0.smithi005.stdout:6/238: write d2/fd [1449949,39710] 0 2024-04-16T14:35:26.972 INFO:tasks.workunit.client.0.smithi005.stdout:6/239: fsync d2/d5/d10/f44 0 2024-04-16T14:35:26.972 INFO:tasks.workunit.client.0.smithi005.stdout:0/167: dread da/fc [0,4194304] 0 2024-04-16T14:35:26.972 INFO:tasks.workunit.client.0.smithi005.stdout:2/34: dread d0/d4/f6 [0,4194304] 0 2024-04-16T14:35:26.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:26 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:35:26.977 INFO:tasks.workunit.client.0.smithi005.stdout:1/153: dwrite d2/f37 [0,4194304] 0 2024-04-16T14:35:26.977 INFO:tasks.workunit.client.0.smithi005.stdout:1/154: stat d2/d1c/ff 0 2024-04-16T14:35:26.978 INFO:tasks.workunit.client.0.smithi005.stdout:5/82: write d0/d6/d12/f14 [1237117,119376] 0 2024-04-16T14:35:26.978 INFO:tasks.workunit.client.0.smithi005.stdout:5/83: stat d0/d6/l7 0 2024-04-16T14:35:26.978 INFO:tasks.workunit.client.0.smithi005.stdout:5/84: chown d0/d6/f9 7304 1 2024-04-16T14:35:26.979 INFO:tasks.workunit.client.0.smithi005.stdout:0/168: truncate f0 2127689 0 2024-04-16T14:35:26.980 INFO:tasks.workunit.client.0.smithi005.stdout:7/166: write d1/dc/f18 [2640749,79843] 0 2024-04-16T14:35:26.980 INFO:tasks.workunit.client.0.smithi005.stdout:7/167: readlink d1/d5/l10 0 2024-04-16T14:35:26.980 INFO:tasks.workunit.client.0.smithi005.stdout:7/168: write d1/dc/f25 [801775,117131] 0 2024-04-16T14:35:26.980 INFO:tasks.workunit.client.0.smithi005.stdout:7/169: write d1/f29 [1038538,20339] 0 2024-04-16T14:35:26.981 INFO:tasks.workunit.client.0.smithi005.stdout:7/170: dread d1/dc/f12 [0,4194304] 0 2024-04-16T14:35:26.983 INFO:tasks.workunit.client.0.smithi005.stdout:8/105: write d5/de/f1d [4876294,6321] 0 2024-04-16T14:35:26.984 INFO:tasks.workunit.client.0.smithi005.stdout:9/38: rmdir d3 39 2024-04-16T14:35:26.986 INFO:tasks.workunit.client.0.smithi005.stdout:5/85: mkdir d0/d6/d12/d16 0 2024-04-16T14:35:26.986 INFO:tasks.workunit.client.0.smithi005.stdout:5/86: write d0/d6/d12/f14 [2299361,116185] 0 2024-04-16T14:35:26.986 INFO:tasks.workunit.client.0.smithi005.stdout:5/87: dread - d0/f11 zero size 2024-04-16T14:35:26.988 INFO:tasks.workunit.client.0.smithi005.stdout:0/169: mknod da/df/d1b/d24/c37 0 2024-04-16T14:35:26.990 INFO:tasks.workunit.client.0.smithi005.stdout:7/171: rename d1/c13 to d1/dc/c33 0 2024-04-16T14:35:26.991 INFO:tasks.workunit.client.0.smithi005.stdout:7/172: write d1/dc/f18 [860746,94982] 0 2024-04-16T14:35:26.993 INFO:tasks.workunit.client.0.smithi005.stdout:9/39: mknod d3/ce 0 2024-04-16T14:35:26.993 INFO:tasks.workunit.client.0.smithi005.stdout:9/40: read - d3/f7 zero size 2024-04-16T14:35:26.993 INFO:tasks.workunit.client.0.smithi005.stdout:9/41: write d3/f5 [5159824,26777] 0 2024-04-16T14:35:26.993 INFO:tasks.workunit.client.0.smithi005.stdout:9/42: write d3/f7 [61909,83863] 0 2024-04-16T14:35:26.995 INFO:tasks.workunit.client.0.smithi005.stdout:5/88: stat d0/c1 0 2024-04-16T14:35:26.999 INFO:tasks.workunit.client.0.smithi005.stdout:3/71: dwrite d2/d9/df/f11 [0,4194304] 0 2024-04-16T14:35:26.999 INFO:tasks.workunit.client.0.smithi005.stdout:7/173: rename d1/d5/l19 to d1/d5/d22/d27/l34 0 2024-04-16T14:35:27.009 INFO:tasks.workunit.client.0.smithi005.stdout:7/174: rename d1/dc/f12 to d1/dc/d2f/f35 0 2024-04-16T14:35:27.009 INFO:tasks.workunit.client.0.smithi005.stdout:7/175: write d1/f29 [1985034,72508] 0 2024-04-16T14:35:27.009 INFO:tasks.workunit.client.0.smithi005.stdout:1/155: dread d2/d1c/f1f [0,4194304] 0 2024-04-16T14:35:27.011 INFO:tasks.workunit.client.0.smithi005.stdout:3/72: mkdir d2/d17 0 2024-04-16T14:35:27.016 INFO:tasks.workunit.client.0.smithi005.stdout:7/176: rename d1/d5/d16/f1e to d1/d5/d22/d27/f36 0 2024-04-16T14:35:27.016 INFO:tasks.workunit.client.0.smithi005.stdout:7/177: write d1/dc/f1c [4665408,16323] 0 2024-04-16T14:35:27.018 INFO:tasks.workunit.client.0.smithi005.stdout:1/156: symlink d2/d1c/d15/d2a/d1a/d2e/l38 0 2024-04-16T14:35:27.018 INFO:tasks.workunit.client.0.smithi005.stdout:1/157: fdatasync d2/d1c/f1f 0 2024-04-16T14:35:27.018 INFO:tasks.workunit.client.0.smithi005.stdout:1/158: write d2/d1c/d15/d2a/d19/d20/d27/f34 [5224957,35679] 0 2024-04-16T14:35:27.020 INFO:tasks.workunit.client.0.smithi005.stdout:7/178: truncate d1/d5/f17 272515 0 2024-04-16T14:35:27.020 INFO:tasks.workunit.client.0.smithi005.stdout:7/179: read d1/d5/f11 [3308831,94992] 0 2024-04-16T14:35:27.038 INFO:tasks.workunit.client.0.smithi005.stdout:4/214: dwrite d0/d1b/d2e/f3b [0,4194304] 0 2024-04-16T14:35:27.041 INFO:tasks.workunit.client.0.smithi005.stdout:4/215: unlink d0/d1b/c2a 0 2024-04-16T14:35:27.042 INFO:tasks.workunit.client.0.smithi005.stdout:4/216: write d0/d1b/d1d/f39 [278395,129175] 0 2024-04-16T14:35:27.043 INFO:tasks.workunit.client.0.smithi005.stdout:2/35: dwrite d0/d4/f9 [4194304,4194304] 0 2024-04-16T14:35:27.043 INFO:tasks.workunit.client.0.smithi005.stdout:2/36: write d0/f2 [926567,46404] 0 2024-04-16T14:35:27.043 INFO:tasks.workunit.client.0.smithi005.stdout:8/106: dwrite d5/f1e [0,4194304] 0 2024-04-16T14:35:27.043 INFO:tasks.workunit.client.0.smithi005.stdout:8/107: dread - d5/d11/d1f/f24 zero size 2024-04-16T14:35:27.043 INFO:tasks.workunit.client.0.smithi005.stdout:8/108: chown d5/de/f15 17548 1 2024-04-16T14:35:27.044 INFO:tasks.workunit.client.0.smithi005.stdout:6/240: dwrite d2/df/f30 [0,4194304] 0 2024-04-16T14:35:27.044 INFO:tasks.workunit.client.0.smithi005.stdout:6/241: truncate d2/d5/d28/f46 410055 0 2024-04-16T14:35:27.044 INFO:tasks.workunit.client.0.smithi005.stdout:6/242: stat d2/d5 0 2024-04-16T14:35:27.044 INFO:tasks.workunit.client.0.smithi005.stdout:6/243: fdatasync f0 0 2024-04-16T14:35:27.044 INFO:tasks.workunit.client.0.smithi005.stdout:9/43: dwrite d3/fd [0,4194304] 0 2024-04-16T14:35:27.044 INFO:tasks.workunit.client.0.smithi005.stdout:6/244: chown d2/df/c3d 300 1 2024-04-16T14:35:27.044 INFO:tasks.workunit.client.0.smithi005.stdout:7/180: write d1/dc/f25 [491994,127677] 0 2024-04-16T14:35:27.044 INFO:tasks.workunit.client.0.smithi005.stdout:0/170: dwrite da/df/d1b/f22 [0,4194304] 0 2024-04-16T14:35:27.046 INFO:tasks.workunit.client.0.smithi005.stdout:2/37: mknod d0/d4/ca 0 2024-04-16T14:35:27.046 INFO:tasks.workunit.client.0.smithi005.stdout:5/89: dwrite d0/fe [0,4194304] 0 2024-04-16T14:35:27.046 INFO:tasks.workunit.client.0.smithi005.stdout:5/90: chown d0/d6/f10 3 1 2024-04-16T14:35:27.047 INFO:tasks.workunit.client.0.smithi005.stdout:5/91: write d0/d6/f9 [1096464,3602] 0 2024-04-16T14:35:27.047 INFO:tasks.workunit.client.0.smithi005.stdout:5/92: write d0/f11 [24377,62349] 0 2024-04-16T14:35:27.053 INFO:tasks.workunit.client.0.smithi005.stdout:4/217: dread d0/fd [0,4194304] 0 2024-04-16T14:35:27.053 INFO:tasks.workunit.client.0.smithi005.stdout:4/218: chown d0/d22/d29/f2d 163 1 2024-04-16T14:35:27.054 INFO:tasks.workunit.client.0.smithi005.stdout:4/219: truncate d0/d1b/d1d/f21 1530780 0 2024-04-16T14:35:27.054 INFO:tasks.workunit.client.0.smithi005.stdout:4/220: write d0/f1a [4555337,106032] 0 2024-04-16T14:35:27.056 INFO:tasks.workunit.client.0.smithi005.stdout:9/44: dread d3/fd [0,4194304] 0 2024-04-16T14:35:27.060 INFO:tasks.workunit.client.0.smithi005.stdout:6/245: creat d2/d20/d33/f4c x:0 0 0 2024-04-16T14:35:27.064 INFO:tasks.workunit.client.0.smithi005.stdout:1/159: truncate d2/d1c/ff 6303274 0 2024-04-16T14:35:27.064 INFO:tasks.workunit.client.0.smithi005.stdout:1/160: stat d2/d1c/d15/f1d 0 2024-04-16T14:35:27.067 INFO:tasks.workunit.client.0.smithi005.stdout:0/171: rmdir da/df/d26/d34 0 2024-04-16T14:35:27.067 INFO:tasks.workunit.client.0.smithi005.stdout:0/172: creat da/df/d1b/d24/f38 x:0 0 0 2024-04-16T14:35:27.070 INFO:tasks.workunit.client.0.smithi005.stdout:4/221: dwrite d0/f12 [0,4194304] 0 2024-04-16T14:35:27.095 INFO:tasks.workunit.client.1.smithi115.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-16T14:35:27.130 INFO:tasks.workunit.client.0.smithi005.stdout:2/38: creat d0/fb x:0 0 0 2024-04-16T14:35:27.135 INFO:tasks.workunit.client.0.smithi005.stdout:5/93: rename d0/c15 to d0/d6/d12/d16/c17 0 2024-04-16T14:35:27.135 INFO:tasks.workunit.client.0.smithi005.stdout:5/94: read d0/d6/f9 [117977,30124] 0 2024-04-16T14:35:27.136 INFO:tasks.workunit.client.0.smithi005.stdout:8/109: rmdir d5/d11/d1f 39 2024-04-16T14:35:27.144 INFO:tasks.workunit.client.0.smithi005.stdout:6/246: mkdir d2/d5/d10/d4d 0 2024-04-16T14:35:27.150 INFO:tasks.workunit.client.0.smithi005.stdout:5/95: write d0/fe [1455682,123070] 0 2024-04-16T14:35:27.153 INFO:tasks.workunit.client.0.smithi005.stdout:2/39: dwrite d0/f5 [4194304,4194304] 0 2024-04-16T14:35:27.153 INFO:tasks.workunit.client.0.smithi005.stdout:1/161: mknod d2/d1c/d15/d2a/d1a/d2e/c39 0 2024-04-16T14:35:27.153 INFO:tasks.workunit.client.0.smithi005.stdout:1/162: write d2/d1c/fd [620998,50725] 0 2024-04-16T14:35:27.156 INFO:tasks.workunit.client.0.smithi005.stdout:8/110: dwrite d5/f23 [0,4194304] 0 2024-04-16T14:35:27.157 INFO:tasks.workunit.client.0.smithi005.stdout:4/222: creat d0/d1b/d1d/d1f/f46 x:0 0 0 2024-04-16T14:35:27.157 INFO:tasks.workunit.client.0.smithi005.stdout:4/223: chown d0/d1b/d2e 3 1 2024-04-16T14:35:27.157 INFO:tasks.workunit.client.0.smithi005.stdout:4/224: readlink d0/d1b/d1d/d1f/l32 0 2024-04-16T14:35:27.159 INFO:tasks.workunit.client.0.smithi005.stdout:1/163: dread d2/d1c/fd [0,4194304] 0 2024-04-16T14:35:27.159 INFO:tasks.workunit.client.0.smithi005.stdout:6/247: truncate d2/d3f/d47/f41 3578095 0 2024-04-16T14:35:27.159 INFO:tasks.workunit.client.0.smithi005.stdout:2/40: dread d0/f5 [0,4194304] 0 2024-04-16T14:35:27.161 INFO:tasks.workunit.client.0.smithi005.stdout:5/96: mkdir d0/d18 0 2024-04-16T14:35:27.162 INFO:tasks.workunit.client.0.smithi005.stdout:0/173: getdents da/df/d1b 0 2024-04-16T14:35:27.165 INFO:tasks.workunit.client.0.smithi005.stdout:8/111: creat d5/de/f25 x:0 0 0 2024-04-16T14:35:27.165 INFO:tasks.workunit.client.0.smithi005.stdout:8/112: write d5/de/f25 [716361,51928] 0 2024-04-16T14:35:27.165 INFO:tasks.workunit.client.0.smithi005.stdout:8/113: chown d5/f1e 1726719 1 2024-04-16T14:35:27.166 INFO:tasks.workunit.client.0.smithi005.stdout:4/225: mkdir d0/d47 0 2024-04-16T14:35:27.166 INFO:tasks.workunit.client.0.smithi005.stdout:4/226: stat d0/d1b/d1d/d1f/l38 0 2024-04-16T14:35:27.167 INFO:tasks.workunit.client.0.smithi005.stdout:6/248: symlink d2/d45/l4e 0 2024-04-16T14:35:27.169 INFO:tasks.workunit.client.0.smithi005.stdout:0/174: mkdir da/df/d26/d39 0 2024-04-16T14:35:27.169 INFO:tasks.workunit.client.0.smithi005.stdout:0/175: stat da/df/d26 0 2024-04-16T14:35:27.171 INFO:tasks.workunit.client.0.smithi005.stdout:0/176: mkdir da/df/d1b/d3a 0 2024-04-16T14:35:27.172 INFO:tasks.workunit.client.0.smithi005.stdout:0/177: dread da/f1a [0,4194304] 0 2024-04-16T14:35:27.180 INFO:tasks.workunit.client.0.smithi005.stdout:2/41: dread d0/f2 [0,4194304] 0 2024-04-16T14:35:27.180 INFO:tasks.workunit.client.0.smithi005.stdout:2/42: creat d0/d4/fc x:0 0 0 2024-04-16T14:35:27.180 INFO:tasks.workunit.client.0.smithi005.stdout:2/43: rename d0/d4 to d0/d4/dd 22 2024-04-16T14:35:27.180 INFO:tasks.workunit.client.0.smithi005.stdout:2/44: stat d0/d4/fc 0 2024-04-16T14:35:27.180 INFO:tasks.workunit.client.0.smithi005.stdout:2/45: truncate d0/f2 3763656 0 2024-04-16T14:35:27.181 INFO:tasks.workunit.client.0.smithi005.stdout:2/46: creat d0/d4/fe x:0 0 0 2024-04-16T14:35:27.182 INFO:tasks.workunit.client.0.smithi005.stdout:6/249: write d2/f2e [1471416,65513] 0 2024-04-16T14:35:27.186 INFO:tasks.workunit.client.0.smithi005.stdout:8/114: dread d5/d11/f20 [0,4194304] 0 2024-04-16T14:35:27.188 INFO:tasks.workunit.client.0.smithi005.stdout:8/115: rename d5/de/c1c to d5/c26 0 2024-04-16T14:35:27.193 INFO:tasks.workunit.client.0.smithi005.stdout:0/178: dread da/df/d1b/d24/f35 [0,4194304] 0 2024-04-16T14:35:27.193 INFO:tasks.workunit.client.0.smithi005.stdout:0/179: chown da/f1a 3539 1 2024-04-16T14:35:27.194 INFO:tasks.workunit.client.0.smithi005.stdout:2/47: dread d0/f2 [0,4194304] 0 2024-04-16T14:35:27.194 INFO:tasks.workunit.client.0.smithi005.stdout:1/164: dwrite d2/d1c/d15/d2a/f16 [0,4194304] 0 2024-04-16T14:35:27.194 INFO:tasks.workunit.client.0.smithi005.stdout:1/165: write d2/f13 [6551404,105439] 0 2024-04-16T14:35:27.194 INFO:tasks.workunit.client.0.smithi005.stdout:1/166: chown d2/d1c/d15/d2a/f16 1713980 1 2024-04-16T14:35:27.194 INFO:tasks.workunit.client.0.smithi005.stdout:6/250: dread d2/df/f32 [0,4194304] 0 2024-04-16T14:35:27.195 INFO:tasks.workunit.client.0.smithi005.stdout:4/227: dwrite d0/d1b/f3c [0,4194304] 0 2024-04-16T14:35:27.202 INFO:tasks.workunit.client.0.smithi005.stdout:8/116: dwrite d5/f17 [0,4194304] 0 2024-04-16T14:35:27.202 INFO:tasks.workunit.client.0.smithi005.stdout:1/167: mknod d2/d1c/d15/d2a/d25/c3a 0 2024-04-16T14:35:27.203 INFO:tasks.workunit.client.0.smithi005.stdout:6/251: rename d2/df/f30 to d2/d3f/f4f 0 2024-04-16T14:35:27.204 INFO:tasks.workunit.client.0.smithi005.stdout:4/228: mkdir d0/d1b/d1d/d1f/d48 0 2024-04-16T14:35:27.205 INFO:tasks.workunit.client.0.smithi005.stdout:8/117: mknod d5/d11/c27 0 2024-04-16T14:35:27.205 INFO:tasks.workunit.client.0.smithi005.stdout:8/118: read d5/fb [1637291,61798] 0 2024-04-16T14:35:27.205 INFO:tasks.workunit.client.0.smithi005.stdout:8/119: creat d5/de/f28 x:0 0 0 2024-04-16T14:35:27.205 INFO:tasks.workunit.client.0.smithi005.stdout:6/252: symlink d2/d5/d10/l50 0 2024-04-16T14:35:27.207 INFO:tasks.workunit.client.0.smithi005.stdout:6/253: mkdir d2/d5/d10/d4d/d51 0 2024-04-16T14:35:27.208 INFO:tasks.workunit.client.0.smithi005.stdout:6/254: chown d2/d20/d33/l4b 1293255159 1 2024-04-16T14:35:27.208 INFO:tasks.workunit.client.0.smithi005.stdout:6/255: fsync d2/d45/f48 0 2024-04-16T14:35:27.210 INFO:tasks.workunit.client.0.smithi005.stdout:6/256: unlink d2/d5/d28/l34 0 2024-04-16T14:35:27.213 INFO:tasks.workunit.client.0.smithi005.stdout:4/229: truncate d0/f19 4696680 0 2024-04-16T14:35:27.215 INFO:tasks.workunit.client.0.smithi005.stdout:4/230: unlink d0/c28 0 2024-04-16T14:35:27.216 INFO:tasks.workunit.client.0.smithi005.stdout:4/231: unlink d0/fa 0 2024-04-16T14:35:27.216 INFO:tasks.workunit.client.0.smithi005.stdout:4/232: dread - d0/d22/d29/f2d zero size 2024-04-16T14:35:27.217 INFO:tasks.workunit.client.0.smithi005.stdout:1/168: read d2/d1c/d15/d2a/f16 [1533067,128428] 0 2024-04-16T14:35:27.221 INFO:tasks.workunit.client.0.smithi005.stdout:8/120: dread d5/f6 [0,4194304] 0 2024-04-16T14:35:27.221 INFO:tasks.workunit.client.0.smithi005.stdout:8/121: write d5/de/f28 [412906,118812] 0 2024-04-16T14:35:27.221 INFO:tasks.workunit.client.0.smithi005.stdout:8/122: truncate f3 5164661 0 2024-04-16T14:35:27.221 INFO:tasks.workunit.client.0.smithi005.stdout:1/169: unlink d2/d1c/d15/d2a/d1a/d21/f2b 0 2024-04-16T14:35:27.221 INFO:tasks.workunit.client.0.smithi005.stdout:1/170: fsync d2/d1c/f28 0 2024-04-16T14:35:27.222 INFO:tasks.workunit.client.0.smithi005.stdout:8/123: getdents d5/d11/d1f 0 2024-04-16T14:35:27.222 INFO:tasks.workunit.client.0.smithi005.stdout:8/124: write d5/de/f1d [4701538,51049] 0 2024-04-16T14:35:27.222 INFO:tasks.workunit.client.0.smithi005.stdout:8/125: truncate d5/de/f28 737783 0 2024-04-16T14:35:27.231 INFO:tasks.workunit.client.0.smithi005.stdout:8/126: write d5/d11/f20 [3895743,30020] 0 2024-04-16T14:35:27.231 INFO:tasks.workunit.client.0.smithi005.stdout:6/257: dwrite d2/d5/d10/f3e [0,4194304] 0 2024-04-16T14:35:27.236 INFO:tasks.workunit.client.0.smithi005.stdout:6/258: link d2/d3f/d47/f41 d2/d3f/d47/f52 0 2024-04-16T14:35:27.237 INFO:tasks.workunit.client.0.smithi005.stdout:6/259: mkdir d2/d3f/d53 0 2024-04-16T14:35:27.238 INFO:tasks.workunit.client.0.smithi005.stdout:6/260: mkdir d2/d3f/d53/d54 0 2024-04-16T14:35:27.242 INFO:tasks.workunit.client.0.smithi005.stdout:1/171: dwrite d2/d1c/fe [4194304,4194304] 0 2024-04-16T14:35:27.242 INFO:tasks.workunit.client.0.smithi005.stdout:4/233: dwrite d0/d22/d29/f2d [0,4194304] 0 2024-04-16T14:35:27.244 INFO:tasks.workunit.client.0.smithi005.stdout:1/172: creat d2/d1c/d15/d2a/d1a/f3b x:0 0 0 2024-04-16T14:35:27.244 INFO:tasks.workunit.client.0.smithi005.stdout:1/173: truncate d2/d1c/f17 733020 0 2024-04-16T14:35:27.245 INFO:tasks.workunit.client.0.smithi005.stdout:1/174: link d2/d2c/l2f d2/d1c/d15/d2a/l3c 0 2024-04-16T14:35:27.246 INFO:tasks.workunit.client.0.smithi005.stdout:1/175: creat d2/d1c/f3d x:0 0 0 2024-04-16T14:35:27.249 INFO:tasks.workunit.client.0.smithi005.stdout:1/176: mkdir d2/d2c/d3e 0 2024-04-16T14:35:27.249 INFO:tasks.workunit.client.0.smithi005.stdout:8/127: write f3 [3168260,107348] 0 2024-04-16T14:35:27.249 INFO:tasks.workunit.client.0.smithi005.stdout:1/177: write d2/d1c/d15/d2a/d25/f36 [1033735,117269] 0 2024-04-16T14:35:27.254 INFO:tasks.workunit.client.0.smithi005.stdout:4/234: dread d0/f10 [0,4194304] 0 2024-04-16T14:35:27.254 INFO:tasks.workunit.client.0.smithi005.stdout:4/235: dread - d0/d1b/d2e/f43 zero size 2024-04-16T14:35:27.254 INFO:tasks.workunit.client.0.smithi005.stdout:4/236: fsync d0/f2b 0 2024-04-16T14:35:27.254 INFO:tasks.workunit.client.0.smithi005.stdout:4/237: fdatasync d0/d1b/d2e/f43 0 2024-04-16T14:35:27.254 INFO:tasks.workunit.client.0.smithi005.stdout:1/178: write d2/d1c/f17 [771349,47234] 0 2024-04-16T14:35:27.256 INFO:tasks.workunit.client.0.smithi005.stdout:1/179: truncate d2/d1c/d15/d2a/d19/d20/d27/f34 549419 0 2024-04-16T14:35:27.256 INFO:tasks.workunit.client.0.smithi005.stdout:1/180: chown d2/d1c/d15/d2a/d1a/d21 47 1 2024-04-16T14:35:27.256 INFO:tasks.workunit.client.0.smithi005.stdout:1/181: creat d2/f3f x:0 0 0 2024-04-16T14:35:27.256 INFO:tasks.workunit.client.0.smithi005.stdout:1/182: truncate d2/f13 8896021 0 2024-04-16T14:35:27.257 INFO:tasks.workunit.client.0.smithi005.stdout:4/238: rmdir d0/d1b/d1d/d1f 39 2024-04-16T14:35:27.257 INFO:tasks.workunit.client.0.smithi005.stdout:4/239: readlink d0/d1b/d1d/d1f/l25 0 2024-04-16T14:35:27.257 INFO:tasks.workunit.client.0.smithi005.stdout:4/240: readlink d0/d1b/d1d/l3d 0 2024-04-16T14:35:27.259 INFO:tasks.workunit.client.0.smithi005.stdout:6/261: dwrite d2/d5/d28/f21 [4194304,4194304] 0 2024-04-16T14:35:27.260 INFO:tasks.workunit.client.0.smithi005.stdout:4/241: rename d0/d22/l40 to d0/d1b/d1d/d1f/d48/l49 0 2024-04-16T14:35:27.265 INFO:tasks.workunit.client.0.smithi005.stdout:8/128: write d5/de/f15 [1893233,36894] 0 2024-04-16T14:35:27.273 INFO:tasks.workunit.client.0.smithi005.stdout:6/262: write d2/d5/d28/f21 [5549649,127004] 0 2024-04-16T14:35:27.275 INFO:tasks.workunit.client.0.smithi005.stdout:6/263: mknod d2/d3f/c55 0 2024-04-16T14:35:27.275 INFO:tasks.workunit.client.0.smithi005.stdout:6/264: fdatasync d2/d5/d10/f1d 0 2024-04-16T14:35:27.275 INFO:tasks.workunit.client.0.smithi005.stdout:6/265: stat d2/d5/d10/f44 0 2024-04-16T14:35:27.275 INFO:tasks.workunit.client.0.smithi005.stdout:4/242: dread d0/f7 [0,4194304] 0 2024-04-16T14:35:27.275 INFO:tasks.workunit.client.0.smithi005.stdout:3/73: sync 2024-04-16T14:35:27.276 INFO:tasks.workunit.client.0.smithi005.stdout:4/243: rename d0/d1b/d1d/d1f/c35 to d0/d1b/d2e/c4a 0 2024-04-16T14:35:27.277 INFO:tasks.workunit.client.0.smithi005.stdout:1/183: dwrite d2/d1c/d15/d2a/d1a/d21/f30 [0,4194304] 0 2024-04-16T14:35:27.277 INFO:tasks.workunit.client.0.smithi005.stdout:4/244: truncate d0/d1b/f3c 2925468 0 2024-04-16T14:35:27.279 INFO:tasks.workunit.client.0.smithi005.stdout:1/184: creat d2/d1c/d15/d2a/d19/f40 x:0 0 0 2024-04-16T14:35:27.281 INFO:tasks.workunit.client.0.smithi005.stdout:8/129: dread d5/f1e [0,4194304] 0 2024-04-16T14:35:27.281 INFO:tasks.workunit.client.0.smithi005.stdout:8/130: dread - d5/d11/d1f/f24 zero size 2024-04-16T14:35:27.282 INFO:tasks.workunit.client.0.smithi005.stdout:4/245: symlink d0/l4b 0 2024-04-16T14:35:27.283 INFO:tasks.workunit.client.0.smithi005.stdout:1/185: mknod d2/d1c/d15/d2a/d19/c41 0 2024-04-16T14:35:27.284 INFO:tasks.workunit.client.0.smithi005.stdout:4/246: link d0/f1a d0/f4c 0 2024-04-16T14:35:27.284 INFO:tasks.workunit.client.0.smithi005.stdout:4/247: read - d0/d1b/d2e/f43 zero size 2024-04-16T14:35:27.286 INFO:tasks.workunit.client.0.smithi005.stdout:4/248: mkdir d0/d4d 0 2024-04-16T14:35:27.289 INFO:tasks.workunit.client.0.smithi005.stdout:3/74: write d2/fa [1933930,42295] 0 2024-04-16T14:35:27.294 INFO:tasks.workunit.client.0.smithi005.stdout:8/131: write d5/de/f19 [2294578,83081] 0 2024-04-16T14:35:27.307 INFO:tasks.workunit.client.0.smithi005.stdout:8/132: dread d5/f23 [0,4194304] 0 2024-04-16T14:35:27.308 INFO:tasks.workunit.client.0.smithi005.stdout:8/133: mknod d5/de/c29 0 2024-04-16T14:35:27.309 INFO:tasks.workunit.client.0.smithi005.stdout:8/134: rename f1 to d5/de/f2a 0 2024-04-16T14:35:27.309 INFO:tasks.workunit.client.0.smithi005.stdout:8/135: chown d5/de/f1d 463501 1 2024-04-16T14:35:27.309 INFO:tasks.workunit.client.0.smithi005.stdout:8/136: truncate d5/f1e 1647986 0 2024-04-16T14:35:27.317 INFO:tasks.workunit.client.0.smithi005.stdout:1/186: dwrite d2/d1c/d15/d2a/d1a/d21/f29 [4194304,4194304] 0 2024-04-16T14:35:27.318 INFO:tasks.workunit.client.0.smithi005.stdout:1/187: mkdir d2/d1c/d15/d2a/d19/d42 0 2024-04-16T14:35:27.319 INFO:tasks.workunit.client.0.smithi005.stdout:1/188: mknod d2/d1c/d15/d2a/c43 0 2024-04-16T14:35:27.319 INFO:tasks.workunit.client.0.smithi005.stdout:1/189: creat d2/d1c/d15/d2a/d1a/f44 x:0 0 0 2024-04-16T14:35:27.319 INFO:tasks.workunit.client.0.smithi005.stdout:4/249: dwrite d0/d1b/d1d/d1f/f46 [0,4194304] 0 2024-04-16T14:35:27.319 INFO:tasks.workunit.client.0.smithi005.stdout:4/250: chown d0/d1b/f3c 4 1 2024-04-16T14:35:27.320 INFO:tasks.workunit.client.0.smithi005.stdout:1/190: unlink d2/f37 0 2024-04-16T14:35:27.323 INFO:tasks.workunit.client.0.smithi005.stdout:4/251: rename d0/d1b/d2e/f43 to d0/d22/f4e 0 2024-04-16T14:35:27.323 INFO:tasks.workunit.client.0.smithi005.stdout:6/266: dwrite d2/d5/d28/f21 [0,4194304] 0 2024-04-16T14:35:27.324 INFO:tasks.workunit.client.0.smithi005.stdout:1/191: mknod d2/d2c/c45 0 2024-04-16T14:35:27.324 INFO:tasks.workunit.client.0.smithi005.stdout:1/192: truncate d2/d1c/d15/d2a/d1a/d2e/f35 486084 0 2024-04-16T14:35:27.325 INFO:tasks.workunit.client.0.smithi005.stdout:6/267: creat d2/d3f/d47/f56 x:0 0 0 2024-04-16T14:35:27.325 INFO:tasks.workunit.client.0.smithi005.stdout:1/193: mknod d2/d1c/d15/d2a/d19/d42/c46 0 2024-04-16T14:35:27.327 INFO:tasks.workunit.client.0.smithi005.stdout:6/268: rename d2/f35 to d2/d5/d10/d4d/f57 0 2024-04-16T14:35:27.327 INFO:tasks.workunit.client.0.smithi005.stdout:1/194: mknod d2/d1c/d15/d2a/d19/d20/d27/c47 0 2024-04-16T14:35:27.332 INFO:tasks.workunit.client.0.smithi005.stdout:1/195: dread d2/d1c/d15/d2a/f16 [0,4194304] 0 2024-04-16T14:35:27.332 INFO:tasks.workunit.client.0.smithi005.stdout:1/196: write d2/f3f [267812,78765] 0 2024-04-16T14:35:27.343 INFO:tasks.workunit.client.0.smithi005.stdout:6/269: write d2/f23 [3206126,109959] 0 2024-04-16T14:35:27.345 INFO:tasks.workunit.client.0.smithi005.stdout:3/75: dwrite d2/fa [4194304,4194304] 0 2024-04-16T14:35:27.350 INFO:tasks.workunit.client.0.smithi005.stdout:1/197: read d2/d1c/f1e [3218222,125386] 0 2024-04-16T14:35:27.350 INFO:tasks.workunit.client.0.smithi005.stdout:1/198: read d2/d1c/f17 [155262,33326] 0 2024-04-16T14:35:27.350 INFO:tasks.workunit.client.0.smithi005.stdout:8/137: dwrite d5/f6 [0,4194304] 0 2024-04-16T14:35:27.350 INFO:tasks.workunit.client.0.smithi005.stdout:1/199: creat d2/d1c/d15/d2a/d25/f48 x:0 0 0 2024-04-16T14:35:27.350 INFO:tasks.workunit.client.0.smithi005.stdout:1/200: stat d2/d1c/ff 0 2024-04-16T14:35:27.350 INFO:tasks.workunit.client.0.smithi005.stdout:1/201: truncate d2/d1c/d15/d2a/d1a/f3b 197925 0 2024-04-16T14:35:27.350 INFO:tasks.workunit.client.0.smithi005.stdout:1/202: write d2/d1c/d15/d2a/d1a/d21/f30 [224622,79437] 0 2024-04-16T14:35:27.351 INFO:tasks.workunit.client.0.smithi005.stdout:8/138: read d5/de/f2a [2304850,118887] 0 2024-04-16T14:35:27.351 INFO:tasks.workunit.client.0.smithi005.stdout:8/139: write d5/de/f28 [114517,18761] 0 2024-04-16T14:35:27.353 INFO:tasks.workunit.client.0.smithi005.stdout:8/140: unlink d5/c26 0 2024-04-16T14:35:27.353 INFO:tasks.workunit.client.0.smithi005.stdout:8/141: chown d5/d11 6 1 2024-04-16T14:35:27.356 INFO:tasks.workunit.client.0.smithi005.stdout:8/142: symlink d5/d11/d1f/l2b 0 2024-04-16T14:35:27.356 INFO:tasks.workunit.client.0.smithi005.stdout:8/143: readlink d5/lc 0 2024-04-16T14:35:27.357 INFO:tasks.workunit.client.0.smithi005.stdout:1/203: write d2/d1c/d15/d2a/d1a/d21/f29 [8085993,120544] 0 2024-04-16T14:35:27.357 INFO:tasks.workunit.client.0.smithi005.stdout:6/270: rmdir d2/d3f/d47 39 2024-04-16T14:35:27.361 INFO:tasks.workunit.client.0.smithi005.stdout:6/271: mknod d2/d5/d28/c58 0 2024-04-16T14:35:27.362 INFO:tasks.workunit.client.0.smithi005.stdout:6/272: creat d2/d20/d3c/f59 x:0 0 0 2024-04-16T14:35:27.362 INFO:tasks.workunit.client.0.smithi005.stdout:6/273: fdatasync d2/d5/f2a 0 2024-04-16T14:35:27.363 INFO:tasks.workunit.client.0.smithi005.stdout:3/76: dwrite d2/d9/df/f11 [0,4194304] 0 2024-04-16T14:35:27.364 INFO:tasks.workunit.client.0.smithi005.stdout:6/274: creat d2/d5/d10/f5a x:0 0 0 2024-04-16T14:35:27.364 INFO:tasks.workunit.client.0.smithi005.stdout:6/275: fsync d2/d5/f2a 0 2024-04-16T14:35:27.365 INFO:tasks.workunit.client.0.smithi005.stdout:8/144: getdents d5 0 2024-04-16T14:35:27.367 INFO:tasks.workunit.client.0.smithi005.stdout:8/145: mknod d5/d11/c2c 0 2024-04-16T14:35:27.368 INFO:tasks.workunit.client.0.smithi005.stdout:6/276: dread d2/d45/f48 [0,4194304] 0 2024-04-16T14:35:27.368 INFO:tasks.workunit.client.0.smithi005.stdout:1/204: dread d2/d1c/f1e [0,4194304] 0 2024-04-16T14:35:27.369 INFO:tasks.workunit.client.0.smithi005.stdout:6/277: mknod d2/d3f/d53/c5b 0 2024-04-16T14:35:27.372 INFO:tasks.workunit.client.0.smithi005.stdout:1/205: creat d2/d1c/d15/d2a/f49 x:0 0 0 2024-04-16T14:35:27.373 INFO:tasks.workunit.client.0.smithi005.stdout:6/278: fsync d2/d5/d10/d4d/f57 0 2024-04-16T14:35:27.373 INFO:tasks.workunit.client.0.smithi005.stdout:1/206: rename d2/d1c/f28 to d2/d1c/d15/d2a/d19/f4a 0 2024-04-16T14:35:27.375 INFO:tasks.workunit.client.0.smithi005.stdout:6/279: unlink d2/d3f/d53/c5b 0 2024-04-16T14:35:27.376 INFO:tasks.workunit.client.0.smithi005.stdout:6/280: mknod d2/d5/d10/c5c 0 2024-04-16T14:35:27.376 INFO:tasks.workunit.client.0.smithi005.stdout:6/281: fsync d2/d5/d28/f2c 0 2024-04-16T14:35:27.377 INFO:tasks.workunit.client.0.smithi005.stdout:3/77: dread d2/d9/df/f11 [0,4194304] 0 2024-04-16T14:35:27.377 INFO:tasks.workunit.client.0.smithi005.stdout:1/207: write d2/f3f [205667,69514] 0 2024-04-16T14:35:27.379 INFO:tasks.workunit.client.0.smithi005.stdout:1/208: symlink d2/d1c/d15/d2a/d25/l4b 0 2024-04-16T14:35:27.379 INFO:tasks.workunit.client.0.smithi005.stdout:1/209: truncate d2/d1c/d15/d2a/d1a/f44 889930 0 2024-04-16T14:35:27.379 INFO:tasks.workunit.client.0.smithi005.stdout:1/210: chown d2/f3f 24 1 2024-04-16T14:35:27.380 INFO:tasks.workunit.client.0.smithi005.stdout:8/146: dwrite d5/d11/f20 [4194304,4194304] 0 2024-04-16T14:35:27.380 INFO:tasks.workunit.client.0.smithi005.stdout:3/78: rename d2/l4 to d2/d9/df/l18 0 2024-04-16T14:35:27.380 INFO:tasks.workunit.client.0.smithi005.stdout:3/79: fsync d2/fa 0 2024-04-16T14:35:27.380 INFO:tasks.workunit.client.0.smithi005.stdout:3/80: chown d2/d9/df/l18 0 1 2024-04-16T14:35:27.381 INFO:tasks.workunit.client.0.smithi005.stdout:3/81: stat d2/d9/df/l13 0 2024-04-16T14:35:27.381 INFO:tasks.workunit.client.0.smithi005.stdout:3/82: readlink d2/d9/df/l13 0 2024-04-16T14:35:27.381 INFO:tasks.workunit.client.0.smithi005.stdout:1/211: link d2/f13 d2/d1c/d15/d2a/d19/d20/d27/f4c 0 2024-04-16T14:35:27.384 INFO:tasks.workunit.client.0.smithi005.stdout:6/282: dread d2/d5/d28/f2c [0,4194304] 0 2024-04-16T14:35:27.389 INFO:tasks.workunit.client.0.smithi005.stdout:6/283: dread d2/d5/d28/f38 [0,4194304] 0 2024-04-16T14:35:27.389 INFO:tasks.workunit.client.0.smithi005.stdout:6/284: stat f0 0 2024-04-16T14:35:27.389 INFO:tasks.workunit.client.0.smithi005.stdout:6/285: creat d2/d20/d3c/f5d x:0 0 0 2024-04-16T14:35:27.399 INFO:tasks.workunit.client.0.smithi005.stdout:8/147: symlink d5/l2d 0 2024-04-16T14:35:27.400 INFO:tasks.workunit.client.0.smithi005.stdout:1/212: creat d2/d1c/d15/f4d x:0 0 0 2024-04-16T14:35:27.402 INFO:tasks.workunit.client.0.smithi005.stdout:6/286: creat d2/d3f/d53/d54/f5e x:0 0 0 2024-04-16T14:35:27.404 INFO:tasks.workunit.client.0.smithi005.stdout:3/83: symlink d2/l19 0 2024-04-16T14:35:27.404 INFO:tasks.workunit.client.0.smithi005.stdout:6/287: mknod d2/d20/d3c/c5f 0 2024-04-16T14:35:27.407 INFO:tasks.workunit.client.0.smithi005.stdout:3/84: symlink d2/l1a 0 2024-04-16T14:35:27.418 INFO:tasks.workunit.client.0.smithi005.stdout:7/181: sync 2024-04-16T14:35:27.423 INFO:tasks.workunit.client.0.smithi005.stdout:8/148: dwrite d5/f1e [0,4194304] 0 2024-04-16T14:35:27.423 INFO:tasks.workunit.client.0.smithi005.stdout:8/149: chown d5/d11 330614392 1 2024-04-16T14:35:27.424 INFO:tasks.workunit.client.0.smithi005.stdout:8/150: dread - d5/d11/d1f/f24 zero size 2024-04-16T14:35:27.425 INFO:tasks.workunit.client.0.smithi005.stdout:8/151: symlink d5/d11/d1f/l2e 0 2024-04-16T14:35:27.427 INFO:tasks.workunit.client.0.smithi005.stdout:8/152: mkdir d5/d11/d1f/d2f 0 2024-04-16T14:35:27.427 INFO:tasks.workunit.client.0.smithi005.stdout:8/153: chown d5/c22 874525127 1 2024-04-16T14:35:27.436 INFO:tasks.workunit.client.1.smithi115.stderr:++ readlink -f fsstress 2024-04-16T14:35:27.437 INFO:tasks.workunit.client.1.smithi115.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-16T14:35:27.437 INFO:tasks.workunit.client.1.smithi115.stderr:+ popd 2024-04-16T14:35:27.438 INFO:tasks.workunit.client.1.smithi115.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-16T14:35:27.438 INFO:tasks.workunit.client.1.smithi115.stderr:+ popd 2024-04-16T14:35:27.438 INFO:tasks.workunit.client.1.smithi115.stdout:~/cephtest/mnt.1/client.1/tmp 2024-04-16T14:35:27.439 INFO:tasks.workunit.client.1.smithi115.stderr:++ mktemp -d -p . 2024-04-16T14:35:27.440 INFO:tasks.workunit.client.1.smithi115.stderr:+ T=./tmp.FxWnJ36DUi 2024-04-16T14:35:27.440 INFO:tasks.workunit.client.1.smithi115.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.FxWnJ36DUi -l 1 -n 1000 -p 10 -v 2024-04-16T14:35:27.441 INFO:tasks.workunit.client.1.smithi115.stdout:seed = 1712866383 2024-04-16T14:35:27.443 INFO:tasks.workunit.client.0.smithi005.stdout:1/213: dwrite d2/d1c/ff [0,4194304] 0 2024-04-16T14:35:27.443 INFO:tasks.workunit.client.0.smithi005.stdout:1/214: dread - d2/d1c/d15/d2a/f49 zero size 2024-04-16T14:35:27.443 INFO:tasks.workunit.client.0.smithi005.stdout:1/215: mknod d2/d1c/d15/d2a/d19/d20/c4e 0 2024-04-16T14:35:27.444 INFO:tasks.workunit.client.1.smithi115.stdout:1/0: rename - no filename 2024-04-16T14:35:27.444 INFO:tasks.workunit.client.0.smithi005.stdout:1/216: dread d2/f13 [8388608,4194304] 0 2024-04-16T14:35:27.444 INFO:tasks.workunit.client.1.smithi115.stdout:0/0: creat f0 x:0 0 0 2024-04-16T14:35:27.445 INFO:tasks.workunit.client.1.smithi115.stdout:0/1: readlink - no filename 2024-04-16T14:35:27.445 INFO:tasks.workunit.client.1.smithi115.stdout:0/2: rmdir - no directory 2024-04-16T14:35:27.445 INFO:tasks.workunit.client.0.smithi005.stdout:1/217: unlink d2/d2c/l2f 0 2024-04-16T14:35:27.446 INFO:tasks.workunit.client.1.smithi115.stdout:1/1: creat f0 x:0 0 0 2024-04-16T14:35:27.446 INFO:tasks.workunit.client.1.smithi115.stdout:3/0: dread - no filename 2024-04-16T14:35:27.447 INFO:tasks.workunit.client.0.smithi005.stdout:1/218: creat d2/d2c/f4f x:0 0 0 2024-04-16T14:35:27.447 INFO:tasks.workunit.client.1.smithi115.stdout:2/0: mkdir d0 0 2024-04-16T14:35:27.447 INFO:tasks.workunit.client.1.smithi115.stdout:2/1: write - no filename 2024-04-16T14:35:27.448 INFO:tasks.workunit.client.1.smithi115.stdout:4/0: rename - no filename 2024-04-16T14:35:27.448 INFO:tasks.workunit.client.1.smithi115.stdout:4/1: dread - no filename 2024-04-16T14:35:27.448 INFO:tasks.workunit.client.1.smithi115.stdout:4/2: write - no filename 2024-04-16T14:35:27.448 INFO:tasks.workunit.client.1.smithi115.stdout:4/3: stat - no entries 2024-04-16T14:35:27.449 INFO:tasks.workunit.client.1.smithi115.stdout:3/1: creat f0 x:0 0 0 2024-04-16T14:35:27.449 INFO:tasks.workunit.client.1.smithi115.stdout:3/2: creat f1 x:0 0 0 2024-04-16T14:35:27.449 INFO:tasks.workunit.client.1.smithi115.stdout:3/3: chown f1 7516918 1 2024-04-16T14:35:27.450 INFO:tasks.workunit.client.1.smithi115.stdout:2/2: symlink d0/l1 0 2024-04-16T14:35:27.451 INFO:tasks.workunit.client.0.smithi005.stdout:6/288: dwrite d2/f2e [0,4194304] 0 2024-04-16T14:35:27.451 INFO:tasks.workunit.client.0.smithi005.stdout:6/289: stat d2/d20/d3c/c5f 0 2024-04-16T14:35:27.452 INFO:tasks.workunit.client.0.smithi005.stdout:6/290: creat d2/d5/d10/f60 x:0 0 0 2024-04-16T14:35:27.452 INFO:tasks.workunit.client.0.smithi005.stdout:3/85: dwrite d2/d9/df/f11 [0,4194304] 0 2024-04-16T14:35:27.452 INFO:tasks.workunit.client.1.smithi115.stdout:4/4: mknod c0 0 2024-04-16T14:35:27.452 INFO:tasks.workunit.client.1.smithi115.stdout:4/5: fdatasync - no filename 2024-04-16T14:35:27.452 INFO:tasks.workunit.client.1.smithi115.stdout:4/6: dwrite - no filename 2024-04-16T14:35:27.452 INFO:tasks.workunit.client.1.smithi115.stdout:4/7: write - no filename 2024-04-16T14:35:27.453 INFO:tasks.workunit.client.0.smithi005.stdout:7/182: dwrite d1/d5/d22/d27/f36 [0,4194304] 0 2024-04-16T14:35:27.454 INFO:tasks.workunit.client.0.smithi005.stdout:8/154: dwrite d5/de/f1d [4194304,4194304] 0 2024-04-16T14:35:27.454 INFO:tasks.workunit.client.1.smithi115.stdout:3/4: link f0 f2 0 2024-04-16T14:35:27.454 INFO:tasks.workunit.client.1.smithi115.stdout:3/5: truncate f2 564380 0 2024-04-16T14:35:27.454 INFO:tasks.workunit.client.1.smithi115.stdout:3/6: readlink - no filename 2024-04-16T14:35:27.454 INFO:tasks.workunit.client.1.smithi115.stdout:3/7: write f2 [1134056,73581] 0 2024-04-16T14:35:27.455 INFO:tasks.workunit.client.1.smithi115.stdout:2/3: creat d0/f2 x:0 0 0 2024-04-16T14:35:27.455 INFO:tasks.workunit.client.1.smithi115.stdout:2/4: creat d0/f3 x:0 0 0 2024-04-16T14:35:27.456 INFO:tasks.workunit.client.1.smithi115.stdout:6/0: dwrite - no filename 2024-04-16T14:35:27.456 INFO:tasks.workunit.client.1.smithi115.stdout:6/1: chown . 3 1 2024-04-16T14:35:27.457 INFO:tasks.workunit.client.1.smithi115.stdout:6/2: chown . 234534398 1 2024-04-16T14:35:27.457 INFO:tasks.workunit.client.1.smithi115.stdout:6/3: read - no filename 2024-04-16T14:35:27.457 INFO:tasks.workunit.client.1.smithi115.stdout:6/4: rmdir - no directory 2024-04-16T14:35:27.457 INFO:tasks.workunit.client.1.smithi115.stdout:6/5: chown . 2744 1 2024-04-16T14:35:27.457 INFO:tasks.workunit.client.1.smithi115.stdout:5/0: creat f0 x:0 0 0 2024-04-16T14:35:27.458 INFO:tasks.workunit.client.0.smithi005.stdout:6/291: creat d2/d5/d10/d4d/d51/f61 x:0 0 0 2024-04-16T14:35:27.458 INFO:tasks.workunit.client.0.smithi005.stdout:3/86: dread d2/fe [0,4194304] 0 2024-04-16T14:35:27.459 INFO:tasks.workunit.client.1.smithi115.stdout:4/8: mkdir d1 0 2024-04-16T14:35:27.462 INFO:tasks.workunit.client.1.smithi115.stdout:6/6: creat f0 x:0 0 0 2024-04-16T14:35:27.463 INFO:tasks.workunit.client.1.smithi115.stdout:6/7: write f0 [49396,64511] 0 2024-04-16T14:35:27.463 INFO:tasks.workunit.client.1.smithi115.stdout:6/8: chown f0 766 1 2024-04-16T14:35:27.463 INFO:tasks.workunit.client.1.smithi115.stdout:5/1: link f0 f1 0 2024-04-16T14:35:27.464 INFO:tasks.workunit.client.1.smithi115.stdout:4/9: mkdir d1/d2 0 2024-04-16T14:35:27.464 INFO:tasks.workunit.client.1.smithi115.stdout:4/10: dwrite - no filename 2024-04-16T14:35:27.465 INFO:tasks.workunit.client.0.smithi005.stdout:6/292: truncate d2/d5/fe 1096489 0 2024-04-16T14:35:27.465 INFO:tasks.workunit.client.1.smithi115.stdout:7/0: mkdir d0 0 2024-04-16T14:35:27.465 INFO:tasks.workunit.client.1.smithi115.stdout:7/1: link - no file 2024-04-16T14:35:27.465 INFO:tasks.workunit.client.1.smithi115.stdout:7/2: fsync - no filename 2024-04-16T14:35:27.466 INFO:tasks.workunit.client.1.smithi115.stdout:7/3: write - no filename 2024-04-16T14:35:27.466 INFO:tasks.workunit.client.1.smithi115.stdout:7/4: truncate - no filename 2024-04-16T14:35:27.466 INFO:tasks.workunit.client.1.smithi115.stdout:7/5: read - no filename 2024-04-16T14:35:27.466 INFO:tasks.workunit.client.1.smithi115.stdout:7/6: link - no file 2024-04-16T14:35:27.466 INFO:tasks.workunit.client.0.smithi005.stdout:6/293: getdents d2/df 0 2024-04-16T14:35:27.467 INFO:tasks.workunit.client.1.smithi115.stdout:6/9: symlink l1 0 2024-04-16T14:35:27.468 INFO:tasks.workunit.client.1.smithi115.stdout:4/11: creat d1/f3 x:0 0 0 2024-04-16T14:35:27.468 INFO:tasks.workunit.client.1.smithi115.stdout:4/12: creat d1/f4 x:0 0 0 2024-04-16T14:35:27.468 INFO:tasks.workunit.client.1.smithi115.stdout:7/7: mkdir d0/d1 0 2024-04-16T14:35:27.469 INFO:tasks.workunit.client.0.smithi005.stdout:6/294: link d2/f26 d2/d20/f62 0 2024-04-16T14:35:27.470 INFO:tasks.workunit.client.1.smithi115.stdout:9/0: dwrite - no filename 2024-04-16T14:35:27.470 INFO:tasks.workunit.client.1.smithi115.stdout:9/1: read - no filename 2024-04-16T14:35:27.470 INFO:tasks.workunit.client.1.smithi115.stdout:9/2: write - no filename 2024-04-16T14:35:27.470 INFO:tasks.workunit.client.1.smithi115.stdout:9/3: dread - no filename 2024-04-16T14:35:27.470 INFO:tasks.workunit.client.1.smithi115.stdout:9/4: truncate - no filename 2024-04-16T14:35:27.470 INFO:tasks.workunit.client.1.smithi115.stdout:9/5: fdatasync - no filename 2024-04-16T14:35:27.470 INFO:tasks.workunit.client.1.smithi115.stdout:8/0: mkdir d0 0 2024-04-16T14:35:27.471 INFO:tasks.workunit.client.1.smithi115.stdout:8/1: chown d0 284 1 2024-04-16T14:35:27.471 INFO:tasks.workunit.client.1.smithi115.stdout:8/2: read - no filename 2024-04-16T14:35:27.471 INFO:tasks.workunit.client.1.smithi115.stdout:8/3: dwrite - no filename 2024-04-16T14:35:27.471 INFO:tasks.workunit.client.1.smithi115.stdout:8/4: dwrite - no filename 2024-04-16T14:35:27.471 INFO:tasks.workunit.client.1.smithi115.stdout:8/5: unlink - no file 2024-04-16T14:35:27.471 INFO:tasks.workunit.client.1.smithi115.stdout:8/6: write - no filename 2024-04-16T14:35:27.471 INFO:tasks.workunit.client.1.smithi115.stdout:8/7: read - no filename 2024-04-16T14:35:27.471 INFO:tasks.workunit.client.1.smithi115.stdout:8/8: write - no filename 2024-04-16T14:35:27.472 INFO:tasks.workunit.client.1.smithi115.stdout:7/8: mkdir d0/d2 0 2024-04-16T14:35:27.472 INFO:tasks.workunit.client.0.smithi005.stdout:7/183: write d1/d5/d16/f2c [3836801,63071] 0 2024-04-16T14:35:27.473 INFO:tasks.workunit.client.1.smithi115.stdout:9/6: creat f0 x:0 0 0 2024-04-16T14:35:27.473 INFO:tasks.workunit.client.1.smithi115.stdout:8/9: mknod d0/c1 0 2024-04-16T14:35:27.473 INFO:tasks.workunit.client.1.smithi115.stdout:8/10: rename d0 to d0/d2 22 2024-04-16T14:35:27.474 INFO:tasks.workunit.client.1.smithi115.stdout:8/11: dread - no filename 2024-04-16T14:35:27.474 INFO:tasks.workunit.client.1.smithi115.stdout:8/12: chown d0 25 1 2024-04-16T14:35:27.474 INFO:tasks.workunit.client.1.smithi115.stdout:7/9: symlink d0/l3 0 2024-04-16T14:35:27.478 INFO:tasks.workunit.client.0.smithi005.stdout:7/184: symlink d1/d5/d22/d27/d2e/l37 0 2024-04-16T14:35:27.478 INFO:tasks.workunit.client.0.smithi005.stdout:8/155: write d5/f17 [7102953,11089] 0 2024-04-16T14:35:27.478 INFO:tasks.workunit.client.0.smithi005.stdout:8/156: chown d5/de/c10 34765307 1 2024-04-16T14:35:27.479 INFO:tasks.workunit.client.0.smithi005.stdout:7/185: symlink d1/l38 0 2024-04-16T14:35:27.479 INFO:tasks.workunit.client.0.smithi005.stdout:7/186: chown d1/d5/c20 1757834 1 2024-04-16T14:35:27.479 INFO:tasks.workunit.client.1.smithi115.stdout:9/7: mkdir d1 0 2024-04-16T14:35:27.479 INFO:tasks.workunit.client.1.smithi115.stdout:9/8: chown f0 107057804 1 2024-04-16T14:35:27.479 INFO:tasks.workunit.client.1.smithi115.stdout:8/13: creat d0/f3 x:0 0 0 2024-04-16T14:35:27.479 INFO:tasks.workunit.client.1.smithi115.stdout:8/14: write d0/f3 [853505,98087] 0 2024-04-16T14:35:27.479 INFO:tasks.workunit.client.1.smithi115.stdout:7/10: mknod d0/c4 0 2024-04-16T14:35:27.480 INFO:tasks.workunit.client.1.smithi115.stdout:9/9: creat d1/f2 x:0 0 0 2024-04-16T14:35:27.480 INFO:tasks.workunit.client.1.smithi115.stdout:9/10: truncate d1/f2 133679 0 2024-04-16T14:35:27.480 INFO:tasks.workunit.client.1.smithi115.stdout:7/11: symlink d0/d1/l5 0 2024-04-16T14:35:27.480 INFO:tasks.workunit.client.0.smithi005.stdout:8/157: rename d5/c8 to d5/d11/d1f/d2f/c30 0 2024-04-16T14:35:27.480 INFO:tasks.workunit.client.0.smithi005.stdout:7/187: truncate d1/d5/d22/f28 20572 0 2024-04-16T14:35:27.481 INFO:tasks.workunit.client.1.smithi115.stdout:1/2: dwrite f0 [0,4194304] 0 2024-04-16T14:35:27.481 INFO:tasks.workunit.client.1.smithi115.stdout:1/3: truncate f0 5019400 0 2024-04-16T14:35:27.481 INFO:tasks.workunit.client.1.smithi115.stdout:9/11: link d1/f2 d1/f3 0 2024-04-16T14:35:27.482 INFO:tasks.workunit.client.1.smithi115.stdout:7/12: rmdir d0/d1 39 2024-04-16T14:35:27.482 INFO:tasks.workunit.client.1.smithi115.stdout:7/13: fdatasync - no filename 2024-04-16T14:35:27.482 INFO:tasks.workunit.client.1.smithi115.stdout:7/14: stat d0/d2 0 2024-04-16T14:35:27.482 INFO:tasks.workunit.client.1.smithi115.stdout:7/15: getdents d0/d2 0 2024-04-16T14:35:27.482 INFO:tasks.workunit.client.1.smithi115.stdout:7/16: dwrite - no filename 2024-04-16T14:35:27.482 INFO:tasks.workunit.client.0.smithi005.stdout:3/87: dread d2/fa [4194304,4194304] 0 2024-04-16T14:35:27.482 INFO:tasks.workunit.client.0.smithi005.stdout:7/188: mkdir d1/dc/d39 0 2024-04-16T14:35:27.483 INFO:tasks.workunit.client.0.smithi005.stdout:7/189: mkdir d1/d5/d22/d27/d3a 0 2024-04-16T14:35:27.483 INFO:tasks.workunit.client.0.smithi005.stdout:7/190: fsync d1/dc/d2f/f35 0 2024-04-16T14:35:27.483 INFO:tasks.workunit.client.1.smithi115.stdout:1/4: symlink l1 0 2024-04-16T14:35:27.484 INFO:tasks.workunit.client.0.smithi005.stdout:1/219: dwrite d2/d1c/f1f [0,4194304] 0 2024-04-16T14:35:27.486 INFO:tasks.workunit.client.1.smithi115.stdout:7/17: mknod d0/d1/c6 0 2024-04-16T14:35:27.486 INFO:tasks.workunit.client.1.smithi115.stdout:7/18: fdatasync - no filename 2024-04-16T14:35:27.486 INFO:tasks.workunit.client.1.smithi115.stdout:7/19: fdatasync - no filename 2024-04-16T14:35:27.486 INFO:tasks.workunit.client.0.smithi005.stdout:1/220: mknod d2/d1c/d15/d2a/d19/d20/d27/c50 0 2024-04-16T14:35:27.486 INFO:tasks.workunit.client.0.smithi005.stdout:1/221: truncate d2/d1c/d15/f1d 2593672 0 2024-04-16T14:35:27.490 INFO:tasks.workunit.client.1.smithi115.stdout:2/5: dwrite d0/f3 [0,4194304] 0 2024-04-16T14:35:27.490 INFO:tasks.workunit.client.1.smithi115.stdout:7/20: symlink d0/d1/l7 0 2024-04-16T14:35:27.490 INFO:tasks.workunit.client.1.smithi115.stdout:7/21: chown d0/d1/l7 164006 1 2024-04-16T14:35:27.490 INFO:tasks.workunit.client.1.smithi115.stdout:7/22: dwrite - no filename 2024-04-16T14:35:27.490 INFO:tasks.workunit.client.1.smithi115.stdout:3/8: dwrite f1 [0,4194304] 0 2024-04-16T14:35:27.491 INFO:tasks.workunit.client.1.smithi115.stdout:3/9: chown f1 4693569 1 2024-04-16T14:35:27.491 INFO:tasks.workunit.client.1.smithi115.stdout:0/3: dwrite f0 [0,4194304] 0 2024-04-16T14:35:27.491 INFO:tasks.workunit.client.1.smithi115.stdout:0/4: creat f1 x:0 0 0 2024-04-16T14:35:27.494 INFO:tasks.workunit.client.1.smithi115.stdout:8/15: dread d0/f3 [0,4194304] 0 2024-04-16T14:35:27.494 INFO:tasks.workunit.client.1.smithi115.stdout:8/16: chown d0/c1 1 1 2024-04-16T14:35:27.495 INFO:tasks.workunit.client.1.smithi115.stdout:2/6: mkdir d0/d4 0 2024-04-16T14:35:27.495 INFO:tasks.workunit.client.1.smithi115.stdout:2/7: creat d0/f5 x:0 0 0 2024-04-16T14:35:27.495 INFO:tasks.workunit.client.1.smithi115.stdout:2/8: readlink d0/l1 0 2024-04-16T14:35:27.497 INFO:tasks.workunit.client.1.smithi115.stdout:7/23: rename d0/d1/l5 to d0/l8 0 2024-04-16T14:35:27.497 INFO:tasks.workunit.client.0.smithi005.stdout:5/97: sync 2024-04-16T14:35:27.498 INFO:tasks.workunit.client.0.smithi005.stdout:9/45: sync 2024-04-16T14:35:27.499 INFO:tasks.workunit.client.0.smithi005.stdout:5/98: rename d0/c5 to d0/d6/d12/c19 0 2024-04-16T14:35:27.500 INFO:tasks.workunit.client.0.smithi005.stdout:3/88: write d2/d9/df/f11 [2364866,68228] 0 2024-04-16T14:35:27.502 INFO:tasks.workunit.client.0.smithi005.stdout:9/46: rename d3/f5 to d3/ff 0 2024-04-16T14:35:27.502 INFO:tasks.workunit.client.0.smithi005.stdout:7/191: dread d1/d5/f11 [0,4194304] 0 2024-04-16T14:35:27.502 INFO:tasks.workunit.client.0.smithi005.stdout:7/192: chown d1/dc/f25 5205052 1 2024-04-16T14:35:27.502 INFO:tasks.workunit.client.0.smithi005.stdout:7/193: readlink d1/d5/l10 0 2024-04-16T14:35:27.502 INFO:tasks.workunit.client.0.smithi005.stdout:7/194: readlink d1/l4 0 2024-04-16T14:35:27.503 INFO:tasks.workunit.client.0.smithi005.stdout:7/195: creat d1/d5/d16/f3b x:0 0 0 2024-04-16T14:35:27.503 INFO:tasks.workunit.client.1.smithi115.stdout:0/5: symlink l2 0 2024-04-16T14:35:27.504 INFO:tasks.workunit.client.0.smithi005.stdout:5/99: unlink d0/fb 0 2024-04-16T14:35:27.504 INFO:tasks.workunit.client.0.smithi005.stdout:5/100: getdents d0/d18 0 2024-04-16T14:35:27.504 INFO:tasks.workunit.client.0.smithi005.stdout:5/101: chown d0/fe 7087 1 2024-04-16T14:35:27.505 INFO:tasks.workunit.client.1.smithi115.stdout:2/9: symlink d0/l6 0 2024-04-16T14:35:27.506 INFO:tasks.workunit.client.0.smithi005.stdout:9/47: creat d3/f10 x:0 0 0 2024-04-16T14:35:27.508 INFO:tasks.workunit.client.1.smithi115.stdout:7/24: creat d0/f9 x:0 0 0 2024-04-16T14:35:27.508 INFO:tasks.workunit.client.0.smithi005.stdout:7/196: unlink d1/f23 0 2024-04-16T14:35:27.511 INFO:tasks.workunit.client.0.smithi005.stdout:3/89: link d2/c10 d2/c1b 0 2024-04-16T14:35:27.511 INFO:tasks.workunit.client.1.smithi115.stdout:6/10: dwrite f0 [0,4194304] 0 2024-04-16T14:35:27.512 INFO:tasks.workunit.client.0.smithi005.stdout:9/48: truncate d3/fd 404958 0 2024-04-16T14:35:27.512 INFO:tasks.workunit.client.0.smithi005.stdout:9/49: read - d3/f8 zero size 2024-04-16T14:35:27.512 INFO:tasks.workunit.client.0.smithi005.stdout:9/50: write d3/f10 [457090,5739] 0 2024-04-16T14:35:27.512 INFO:tasks.workunit.client.1.smithi115.stdout:5/2: dwrite f1 [0,4194304] 0 2024-04-16T14:35:27.513 INFO:tasks.workunit.client.1.smithi115.stdout:9/12: dwrite d1/f3 [0,4194304] 0 2024-04-16T14:35:27.513 INFO:tasks.workunit.client.1.smithi115.stdout:9/13: fdatasync d1/f2 0 2024-04-16T14:35:27.513 INFO:tasks.workunit.client.1.smithi115.stdout:9/14: chown f0 77574124 1 2024-04-16T14:35:27.514 INFO:tasks.workunit.client.0.smithi005.stdout:7/197: creat d1/dc/d2f/f3c x:0 0 0 2024-04-16T14:35:27.514 INFO:tasks.workunit.client.1.smithi115.stdout:7/25: rename d0/d1/c6 to d0/ca 0 2024-04-16T14:35:27.517 INFO:tasks.workunit.client.0.smithi005.stdout:3/90: creat d2/d9/df/f1c x:0 0 0 2024-04-16T14:35:27.518 INFO:tasks.workunit.client.0.smithi005.stdout:3/91: write d2/d9/df/f11 [1971074,58231] 0 2024-04-16T14:35:27.519 INFO:tasks.workunit.client.0.smithi005.stdout:8/158: rmdir d5/d11 39 2024-04-16T14:35:27.520 INFO:tasks.workunit.client.0.smithi005.stdout:7/198: mknod d1/dc/d2f/c3d 0 2024-04-16T14:35:27.522 INFO:tasks.workunit.client.1.smithi115.stdout:7/26: creat d0/d2/fb x:0 0 0 2024-04-16T14:35:27.523 INFO:tasks.workunit.client.0.smithi005.stdout:5/102: rmdir d0/d18 0 2024-04-16T14:35:27.525 INFO:tasks.workunit.client.1.smithi115.stdout:7/27: mkdir d0/d2/dc 0 2024-04-16T14:35:27.525 INFO:tasks.workunit.client.1.smithi115.stdout:6/11: write f0 [1805591,101162] 0 2024-04-16T14:35:27.526 INFO:tasks.workunit.client.0.smithi005.stdout:8/159: creat d5/d11/d1f/d2f/f31 x:0 0 0 2024-04-16T14:35:27.526 INFO:tasks.workunit.client.0.smithi005.stdout:4/252: sync 2024-04-16T14:35:27.526 INFO:tasks.workunit.client.0.smithi005.stdout:0/180: sync 2024-04-16T14:35:27.526 INFO:tasks.workunit.client.0.smithi005.stdout:2/48: sync 2024-04-16T14:35:27.526 INFO:tasks.workunit.client.0.smithi005.stdout:2/49: fdatasync d0/d4/f9 0 2024-04-16T14:35:27.527 INFO:tasks.workunit.client.1.smithi115.stdout:7/28: mknod d0/d2/cd 0 2024-04-16T14:35:27.528 INFO:tasks.workunit.client.0.smithi005.stdout:5/103: symlink d0/d6/d12/l1a 0 2024-04-16T14:35:27.528 INFO:tasks.workunit.client.0.smithi005.stdout:5/104: read d0/fe [3474961,36400] 0 2024-04-16T14:35:27.528 INFO:tasks.workunit.client.0.smithi005.stdout:5/105: chown d0/cd 21 1 2024-04-16T14:35:27.529 INFO:tasks.workunit.client.1.smithi115.stdout:6/12: mknod c2 0 2024-04-16T14:35:27.529 INFO:tasks.workunit.client.0.smithi005.stdout:8/160: truncate f4 3283475 0 2024-04-16T14:35:27.529 INFO:tasks.workunit.client.0.smithi005.stdout:8/161: chown d5/d11/d1f/d2f/c30 0 1 2024-04-16T14:35:27.529 INFO:tasks.workunit.client.0.smithi005.stdout:8/162: write d5/fb [967208,61383] 0 2024-04-16T14:35:27.530 INFO:tasks.workunit.client.0.smithi005.stdout:8/163: chown d5/d11/l13 97 1 2024-04-16T14:35:27.530 INFO:tasks.workunit.client.1.smithi115.stdout:2/10: dwrite d0/f2 [0,4194304] 0 2024-04-16T14:35:27.532 INFO:tasks.workunit.client.0.smithi005.stdout:4/253: mkdir d0/d1b/d1d/d4f 0 2024-04-16T14:35:27.533 INFO:tasks.workunit.client.1.smithi115.stdout:7/29: rmdir d0/d2/dc 0 2024-04-16T14:35:27.533 INFO:tasks.workunit.client.1.smithi115.stdout:7/30: write d0/d2/fb [686459,49758] 0 2024-04-16T14:35:27.533 INFO:tasks.workunit.client.1.smithi115.stdout:0/6: dwrite f0 [0,4194304] 0 2024-04-16T14:35:27.533 INFO:tasks.workunit.client.1.smithi115.stdout:0/7: readlink l2 0 2024-04-16T14:35:27.533 INFO:tasks.workunit.client.1.smithi115.stdout:0/8: creat f3 x:0 0 0 2024-04-16T14:35:27.533 INFO:tasks.workunit.client.1.smithi115.stdout:0/9: write f1 [890656,87165] 0 2024-04-16T14:35:27.534 INFO:tasks.workunit.client.0.smithi005.stdout:2/50: mknod d0/d4/cf 0 2024-04-16T14:35:27.535 INFO:tasks.workunit.client.1.smithi115.stdout:4/13: getdents d1 0 2024-04-16T14:35:27.535 INFO:tasks.workunit.client.1.smithi115.stdout:4/14: fsync d1/f3 0 2024-04-16T14:35:27.535 INFO:tasks.workunit.client.1.smithi115.stdout:4/15: getdents d1/d2 0 2024-04-16T14:35:27.538 INFO:tasks.workunit.client.1.smithi115.stdout:0/10: mknod c4 0 2024-04-16T14:35:27.539 INFO:tasks.workunit.client.0.smithi005.stdout:5/106: rename d0/d6/f10 to d0/f1b 0 2024-04-16T14:35:27.542 INFO:tasks.workunit.client.1.smithi115.stdout:8/17: getdents d0 0 2024-04-16T14:35:27.544 INFO:tasks.workunit.client.0.smithi005.stdout:0/181: dwrite da/df/d1b/f25 [4194304,4194304] 0 2024-04-16T14:35:27.544 INFO:tasks.workunit.client.0.smithi005.stdout:8/164: link d5/cf d5/c32 0 2024-04-16T14:35:27.544 INFO:tasks.workunit.client.1.smithi115.stdout:8/18: creat d0/f4 x:0 0 0 2024-04-16T14:35:27.545 INFO:tasks.workunit.client.0.smithi005.stdout:2/51: symlink d0/d4/d7/l10 0 2024-04-16T14:35:27.545 INFO:tasks.workunit.client.0.smithi005.stdout:2/52: write d0/f2 [3974002,96016] 0 2024-04-16T14:35:27.545 INFO:tasks.workunit.client.0.smithi005.stdout:2/53: dread - d0/d4/fe zero size 2024-04-16T14:35:27.546 INFO:tasks.workunit.client.0.smithi005.stdout:5/107: mkdir d0/d6/d12/d1c 0 2024-04-16T14:35:27.546 INFO:tasks.workunit.client.1.smithi115.stdout:8/19: rename d0/c1 to d0/c5 0 2024-04-16T14:35:27.546 INFO:tasks.workunit.client.1.smithi115.stdout:8/20: readlink - no filename 2024-04-16T14:35:27.547 INFO:tasks.workunit.client.1.smithi115.stdout:8/21: truncate d0/f3 1674273 0 2024-04-16T14:35:27.547 INFO:tasks.workunit.client.1.smithi115.stdout:1/5: write f0 [5168764,39901] 0 2024-04-16T14:35:27.548 INFO:tasks.workunit.client.1.smithi115.stdout:1/6: link l1 l2 0 2024-04-16T14:35:27.549 INFO:tasks.workunit.client.0.smithi005.stdout:0/182: unlink da/fb 0 2024-04-16T14:35:27.551 INFO:tasks.workunit.client.0.smithi005.stdout:8/165: link d5/f1e d5/d11/d1f/f33 0 2024-04-16T14:35:27.553 INFO:tasks.workunit.client.0.smithi005.stdout:2/54: creat d0/d4/d7/f11 x:0 0 0 2024-04-16T14:35:27.555 INFO:tasks.workunit.client.0.smithi005.stdout:0/183: link da/f1f da/df/d1b/d3a/f3b 0 2024-04-16T14:35:27.557 INFO:tasks.workunit.client.0.smithi005.stdout:3/92: getdents d2/d9/df 0 2024-04-16T14:35:27.557 INFO:tasks.workunit.client.0.smithi005.stdout:3/93: stat d2/d9/df/l18 0 2024-04-16T14:35:27.564 INFO:tasks.workunit.client.0.smithi005.stdout:0/184: link da/df/l27 da/df/d26/l3c 0 2024-04-16T14:35:27.565 INFO:tasks.workunit.client.0.smithi005.stdout:5/108: write d0/f8 [3495424,53590] 0 2024-04-16T14:35:27.568 INFO:tasks.workunit.client.1.smithi115.stdout:5/3: dwrite f1 [0,4194304] 0 2024-04-16T14:35:27.568 INFO:tasks.workunit.client.1.smithi115.stdout:5/4: fsync f1 0 2024-04-16T14:35:27.568 INFO:tasks.workunit.client.1.smithi115.stdout:9/15: truncate d1/f3 1081294 0 2024-04-16T14:35:27.568 INFO:tasks.workunit.client.1.smithi115.stdout:9/16: chown f0 364 1 2024-04-16T14:35:27.568 INFO:tasks.workunit.client.1.smithi115.stdout:9/17: truncate f0 247638 0 2024-04-16T14:35:27.568 INFO:tasks.workunit.client.1.smithi115.stdout:9/18: write f0 [416975,56030] 0 2024-04-16T14:35:27.569 INFO:tasks.workunit.client.0.smithi005.stdout:5/109: link d0/ca d0/d6/d12/c1d 0 2024-04-16T14:35:27.576 INFO:tasks.workunit.client.0.smithi005.stdout:5/110: mkdir d0/d6/d12/d1c/d1e 0 2024-04-16T14:35:27.576 INFO:tasks.workunit.client.0.smithi005.stdout:5/111: write d0/d6/d12/f14 [2733263,120913] 0 2024-04-16T14:35:27.576 INFO:tasks.workunit.client.0.smithi005.stdout:5/112: write d0/d6/f9 [633607,18938] 0 2024-04-16T14:35:27.579 INFO:tasks.workunit.client.0.smithi005.stdout:5/113: creat d0/d6/d12/d1c/f1f x:0 0 0 2024-04-16T14:35:27.588 INFO:tasks.workunit.client.0.smithi005.stdout:4/254: dwrite d0/f2c [0,4194304] 0 2024-04-16T14:35:27.588 INFO:tasks.workunit.client.0.smithi005.stdout:4/255: read d0/f5 [3318584,93041] 0 2024-04-16T14:35:27.588 INFO:tasks.workunit.client.0.smithi005.stdout:4/256: chown d0/d1b/d1d/d1f/l32 13622 1 2024-04-16T14:35:27.588 INFO:tasks.workunit.client.0.smithi005.stdout:4/257: dread - d0/d1b/f34 zero size 2024-04-16T14:35:27.590 INFO:tasks.workunit.client.0.smithi005.stdout:4/258: creat d0/d4d/f50 x:0 0 0 2024-04-16T14:35:27.606 INFO:tasks.workunit.client.0.smithi005.stdout:4/259: rmdir d0/d1b 39 2024-04-16T14:35:27.607 INFO:tasks.workunit.client.1.smithi115.stdout:2/11: dread d0/f3 [0,4194304] 0 2024-04-16T14:35:27.607 INFO:tasks.workunit.client.1.smithi115.stdout:2/12: readlink d0/l1 0 2024-04-16T14:35:27.607 INFO:tasks.workunit.client.1.smithi115.stdout:2/13: readlink d0/l1 0 2024-04-16T14:35:27.607 INFO:tasks.workunit.client.0.smithi005.stdout:0/185: write da/fc [3283521,33727] 0 2024-04-16T14:35:27.610 INFO:tasks.workunit.client.0.smithi005.stdout:0/186: link f1 da/df/d1b/d24/f3d 0 2024-04-16T14:35:27.641 INFO:tasks.workunit.client.0.smithi005.stdout:8/166: write d5/f6 [3090739,24861] 0 2024-04-16T14:35:27.642 INFO:tasks.workunit.client.0.smithi005.stdout:8/167: fdatasync d5/d11/d1f/d2f/f31 0 2024-04-16T14:35:27.660 INFO:tasks.workunit.client.0.smithi005.stdout:7/199: dwrite d1/d5/d22/f30 [0,4194304] 0 2024-04-16T14:35:27.660 INFO:tasks.workunit.client.0.smithi005.stdout:7/200: stat d1/l38 0 2024-04-16T14:35:27.660 INFO:tasks.workunit.client.0.smithi005.stdout:7/201: getdents d1/d5/d22/d27/d3a 0 2024-04-16T14:35:27.666 INFO:tasks.workunit.client.0.smithi005.stdout:7/202: rmdir d1/d5/d22 39 2024-04-16T14:35:27.666 INFO:tasks.workunit.client.1.smithi115.stdout:4/16: dwrite d1/f4 [0,4194304] 0 2024-04-16T14:35:27.666 INFO:tasks.workunit.client.1.smithi115.stdout:4/17: chown c0 487 1 2024-04-16T14:35:27.667 INFO:tasks.workunit.client.0.smithi005.stdout:9/51: dwrite d3/fd [0,4194304] 0 2024-04-16T14:35:27.667 INFO:tasks.workunit.client.0.smithi005.stdout:9/52: dread - d3/f8 zero size 2024-04-16T14:35:27.669 INFO:tasks.workunit.client.0.smithi005.stdout:7/203: rename d1/d5/d16/f2c to d1/dc/d2f/f3e 0 2024-04-16T14:35:27.729 INFO:tasks.workunit.client.1.smithi115.stdout:2/14: rename d0/f3 to d0/d4/f7 0 2024-04-16T14:35:27.738 INFO:tasks.workunit.client.0.smithi005.stdout:0/187: dwrite da/df/f21 [0,4194304] 0 2024-04-16T14:35:27.740 INFO:tasks.workunit.client.0.smithi005.stdout:0/188: creat da/df/d1b/f3e x:0 0 0 2024-04-16T14:35:27.740 INFO:tasks.workunit.client.0.smithi005.stdout:0/189: dread - da/df/d1b/d24/f38 zero size 2024-04-16T14:35:27.741 INFO:tasks.workunit.client.0.smithi005.stdout:0/190: write da/df/d1b/f3e [992935,112455] 0 2024-04-16T14:35:27.782 INFO:tasks.workunit.client.1.smithi115.stdout:8/22: dread d0/f3 [0,4194304] 0 2024-04-16T14:35:27.782 INFO:tasks.workunit.client.1.smithi115.stdout:8/23: rename d0 to d0/d6 22 2024-04-16T14:35:27.840 INFO:tasks.workunit.client.0.smithi005.stdout:3/94: dwrite d2/d9/df/f1c [0,4194304] 0 2024-04-16T14:35:27.844 INFO:tasks.workunit.client.0.smithi005.stdout:3/95: rename d2/c8 to d2/d9/c1d 0 2024-04-16T14:35:27.844 INFO:tasks.workunit.client.0.smithi005.stdout:3/96: chown d2/d9/df/f1c 310500435 1 2024-04-16T14:35:27.861 INFO:tasks.workunit.client.1.smithi115.stdout:3/10: truncate f2 1019031 0 2024-04-16T14:35:27.861 INFO:tasks.workunit.client.1.smithi115.stdout:3/11: stat f2 0 2024-04-16T14:35:27.868 INFO:tasks.workunit.client.1.smithi115.stdout:3/12: read f0 [378850,6830] 0 2024-04-16T14:35:27.882 INFO:tasks.workunit.client.0.smithi005.stdout:3/97: getdents d2 0 2024-04-16T14:35:27.887 INFO:tasks.workunit.client.0.smithi005.stdout:0/191: dread da/f2d [0,4194304] 0 2024-04-16T14:35:27.887 INFO:tasks.workunit.client.1.smithi115.stdout:8/24: dwrite d0/f3 [0,4194304] 0 2024-04-16T14:35:27.888 INFO:tasks.workunit.client.0.smithi005.stdout:0/192: getdents da/df/d1b/d3a 0 2024-04-16T14:35:27.888 INFO:tasks.workunit.client.0.smithi005.stdout:0/193: fdatasync da/df/f36 0 2024-04-16T14:35:27.890 INFO:tasks.workunit.client.0.smithi005.stdout:0/194: mknod da/c3f 0 2024-04-16T14:35:27.890 INFO:tasks.workunit.client.0.smithi005.stdout:0/195: truncate da/fe 966082 0 2024-04-16T14:35:27.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:27 smithi115 ceph-mon[37295]: pgmap v18: 65 pgs: 65 active+clean; 314 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 13 MiB/s rd, 22 MiB/s wr, 530 op/s 2024-04-16T14:35:27.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:27 smithi005 ceph-mon[28964]: pgmap v18: 65 pgs: 65 active+clean; 314 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 13 MiB/s rd, 22 MiB/s wr, 530 op/s 2024-04-16T14:35:27.982 INFO:tasks.workunit.client.1.smithi115.stdout:7/31: dread d0/d2/fb [0,4194304] 0 2024-04-16T14:35:27.987 INFO:tasks.workunit.client.1.smithi115.stdout:7/32: dread d0/d2/fb [0,4194304] 0 2024-04-16T14:35:27.988 INFO:tasks.workunit.client.0.smithi005.stdout:0/196: dwrite da/f30 [0,4194304] 0 2024-04-16T14:35:27.991 INFO:tasks.workunit.client.0.smithi005.stdout:0/197: symlink da/df/d1b/d24/l40 0 2024-04-16T14:35:27.993 INFO:tasks.workunit.client.0.smithi005.stdout:0/198: mknod da/c41 0 2024-04-16T14:35:27.994 INFO:tasks.workunit.client.0.smithi005.stdout:0/199: truncate f1 31611 0 2024-04-16T14:35:27.995 INFO:tasks.workunit.client.0.smithi005.stdout:0/200: symlink da/df/l42 0 2024-04-16T14:35:27.997 INFO:tasks.workunit.client.0.smithi005.stdout:0/201: mkdir da/df/d26/d39/d43 0 2024-04-16T14:35:28.016 INFO:tasks.workunit.client.0.smithi005.stdout:8/168: dwrite d5/de/f19 [0,4194304] 0 2024-04-16T14:35:28.016 INFO:tasks.workunit.client.0.smithi005.stdout:8/169: creat d5/d11/d1f/d2f/f34 x:0 0 0 2024-04-16T14:35:28.019 INFO:tasks.workunit.client.0.smithi005.stdout:8/170: mknod d5/d11/c35 0 2024-04-16T14:35:28.032 INFO:tasks.workunit.client.0.smithi005.stdout:0/202: read da/df/f1d [13774,19667] 0 2024-04-16T14:35:28.032 INFO:tasks.workunit.client.0.smithi005.stdout:0/203: chown da/df/c1c 63550 1 2024-04-16T14:35:28.032 INFO:tasks.workunit.client.0.smithi005.stdout:0/204: write da/df/d1b/d24/f38 [679118,108084] 0 2024-04-16T14:35:28.033 INFO:tasks.workunit.client.0.smithi005.stdout:0/205: unlink da/df/l2a 0 2024-04-16T14:35:28.033 INFO:tasks.workunit.client.0.smithi005.stdout:0/206: chown da/df/d1b/f25 52 1 2024-04-16T14:35:28.033 INFO:tasks.workunit.client.0.smithi005.stdout:0/207: write da/f32 [37134,40024] 0 2024-04-16T14:35:28.033 INFO:tasks.workunit.client.0.smithi005.stdout:0/208: mknod da/df/d1b/d24/c44 0 2024-04-16T14:35:28.034 INFO:tasks.workunit.client.0.smithi005.stdout:0/209: creat da/df/d26/f45 x:0 0 0 2024-04-16T14:35:28.039 INFO:tasks.workunit.client.0.smithi005.stdout:7/204: dwrite d1/d5/d22/f28 [0,4194304] 0 2024-04-16T14:35:28.039 INFO:tasks.workunit.client.0.smithi005.stdout:7/205: chown d1/d5 0 1 2024-04-16T14:35:28.048 INFO:tasks.workunit.client.0.smithi005.stdout:7/206: rmdir d1/dc/d39 0 2024-04-16T14:35:28.050 INFO:tasks.workunit.client.0.smithi005.stdout:7/207: mknod d1/c3f 0 2024-04-16T14:35:28.061 INFO:tasks.workunit.client.0.smithi005.stdout:7/208: write d1/d5/f1a [7966283,79733] 0 2024-04-16T14:35:28.061 INFO:tasks.workunit.client.0.smithi005.stdout:7/209: fdatasync d1/dc/d2f/f3c 0 2024-04-16T14:35:28.061 INFO:tasks.workunit.client.0.smithi005.stdout:7/210: write d1/d5/d22/d27/f36 [5121765,130184] 0 2024-04-16T14:35:28.061 INFO:tasks.workunit.client.0.smithi005.stdout:7/211: fdatasync d1/dc/f1c 0 2024-04-16T14:35:28.064 INFO:tasks.workunit.client.0.smithi005.stdout:2/55: dwrite d0/f2 [0,4194304] 0 2024-04-16T14:35:28.064 INFO:tasks.workunit.client.0.smithi005.stdout:2/56: creat d0/d4/f12 x:0 0 0 2024-04-16T14:35:28.064 INFO:tasks.workunit.client.0.smithi005.stdout:2/57: chown d0/d4/f12 0 1 2024-04-16T14:35:28.064 INFO:tasks.workunit.client.0.smithi005.stdout:2/58: read - d0/fb zero size 2024-04-16T14:35:28.118 INFO:tasks.workunit.client.1.smithi115.stdout:1/7: write f0 [2523930,94073] 0 2024-04-16T14:35:28.119 INFO:tasks.workunit.client.1.smithi115.stdout:1/8: creat f3 x:0 0 0 2024-04-16T14:35:28.119 INFO:tasks.workunit.client.1.smithi115.stdout:1/9: write f0 [2045381,20506] 0 2024-04-16T14:35:28.119 INFO:tasks.workunit.client.1.smithi115.stdout:1/10: dread - f3 zero size 2024-04-16T14:35:28.127 INFO:tasks.workunit.client.0.smithi005.stdout:0/210: dread da/fc [0,4194304] 0 2024-04-16T14:35:28.127 INFO:tasks.workunit.client.0.smithi005.stdout:0/211: write da/df/d1b/f31 [131773,11383] 0 2024-04-16T14:35:28.136 INFO:tasks.workunit.client.0.smithi005.stdout:0/212: write da/df/f21 [3911813,38807] 0 2024-04-16T14:35:28.145 INFO:tasks.workunit.client.0.smithi005.stdout:0/213: dread da/df/d1b/f25 [0,4194304] 0 2024-04-16T14:35:28.145 INFO:tasks.workunit.client.0.smithi005.stdout:0/214: write da/df/d26/f45 [337335,90301] 0 2024-04-16T14:35:28.149 INFO:tasks.workunit.client.0.smithi005.stdout:0/215: mknod da/df/d26/d39/d43/c46 0 2024-04-16T14:35:28.149 INFO:tasks.workunit.client.0.smithi005.stdout:0/216: truncate da/df/f1d 947345 0 2024-04-16T14:35:28.149 INFO:tasks.workunit.client.0.smithi005.stdout:0/217: creat da/df/d1b/f47 x:0 0 0 2024-04-16T14:35:28.149 INFO:tasks.workunit.client.0.smithi005.stdout:7/212: dwrite d1/d5/d22/f28 [0,4194304] 0 2024-04-16T14:35:28.150 INFO:tasks.workunit.client.0.smithi005.stdout:2/59: rmdir d0 39 2024-04-16T14:35:28.154 INFO:tasks.workunit.client.0.smithi005.stdout:0/218: unlink da/df/d1b/f3e 0 2024-04-16T14:35:28.155 INFO:tasks.workunit.client.0.smithi005.stdout:2/60: creat d0/d4/d7/f13 x:0 0 0 2024-04-16T14:35:28.160 INFO:tasks.workunit.client.0.smithi005.stdout:7/213: dread d1/d5/d22/f30 [0,4194304] 0 2024-04-16T14:35:28.167 INFO:tasks.workunit.client.0.smithi005.stdout:2/61: unlink d0/f5 0 2024-04-16T14:35:28.167 INFO:tasks.workunit.client.0.smithi005.stdout:2/62: write d0/fb [449029,77020] 0 2024-04-16T14:35:28.168 INFO:tasks.workunit.client.0.smithi005.stdout:7/214: creat d1/d5/d22/d27/d3a/f40 x:0 0 0 2024-04-16T14:35:28.170 INFO:tasks.workunit.client.0.smithi005.stdout:2/63: mknod d0/d4/c14 0 2024-04-16T14:35:28.174 INFO:tasks.workunit.client.1.smithi115.stdout:2/15: rmdir d0/d4 39 2024-04-16T14:35:28.174 INFO:tasks.workunit.client.1.smithi115.stdout:2/16: stat d0/f2 0 2024-04-16T14:35:28.178 INFO:tasks.workunit.client.1.smithi115.stdout:5/5: write f0 [1534796,43856] 0 2024-04-16T14:35:28.178 INFO:tasks.workunit.client.1.smithi115.stdout:5/6: creat f2 x:0 0 0 2024-04-16T14:35:28.246 INFO:tasks.workunit.client.0.smithi005.stdout:5/114: dwrite d0/f8 [0,4194304] 0 2024-04-16T14:35:28.247 INFO:tasks.workunit.client.0.smithi005.stdout:5/115: creat d0/d6/d12/d1c/f20 x:0 0 0 2024-04-16T14:35:28.248 INFO:tasks.workunit.client.0.smithi005.stdout:5/116: symlink d0/d6/d12/d1c/d1e/l21 0 2024-04-16T14:35:28.251 INFO:tasks.workunit.client.0.smithi005.stdout:5/117: rename d0/d6/f9 to d0/d6/d12/d1c/f22 0 2024-04-16T14:35:28.251 INFO:tasks.workunit.client.1.smithi115.stdout:9/19: dwrite d1/f3 [0,4194304] 0 2024-04-16T14:35:28.252 INFO:tasks.workunit.client.0.smithi005.stdout:5/118: creat d0/d6/d12/f23 x:0 0 0 2024-04-16T14:35:28.253 INFO:tasks.workunit.client.0.smithi005.stdout:5/119: truncate d0/d6/d12/d1c/f22 70710 0 2024-04-16T14:35:28.254 INFO:tasks.workunit.client.1.smithi115.stdout:5/7: dwrite f1 [0,4194304] 0 2024-04-16T14:35:28.254 INFO:tasks.workunit.client.1.smithi115.stdout:5/8: stat f2 0 2024-04-16T14:35:28.257 INFO:tasks.workunit.client.1.smithi115.stdout:6/13: dwrite f0 [0,4194304] 0 2024-04-16T14:35:28.267 INFO:tasks.workunit.client.0.smithi005.stdout:5/120: dread d0/f1b [0,4194304] 0 2024-04-16T14:35:28.267 INFO:tasks.workunit.client.0.smithi005.stdout:5/121: write d0/f11 [1114791,119980] 0 2024-04-16T14:35:28.267 INFO:tasks.workunit.client.0.smithi005.stdout:5/122: fsync d0/f2 0 2024-04-16T14:35:28.267 INFO:tasks.workunit.client.0.smithi005.stdout:5/123: read - d0/d6/d12/d1c/f20 zero size 2024-04-16T14:35:28.268 INFO:tasks.workunit.client.0.smithi005.stdout:9/53: dwrite d3/ff [0,4194304] 0 2024-04-16T14:35:28.298 INFO:tasks.workunit.client.0.smithi005.stdout:0/219: read da/f20 [914498,11895] 0 2024-04-16T14:35:28.299 INFO:tasks.workunit.client.0.smithi005.stdout:0/220: mknod da/df/c48 0 2024-04-16T14:35:28.299 INFO:tasks.workunit.client.0.smithi005.stdout:0/221: unlink da/df/l27 0 2024-04-16T14:35:28.309 INFO:tasks.workunit.client.0.smithi005.stdout:7/215: dread d1/d5/f1a [0,4194304] 0 2024-04-16T14:35:28.310 INFO:tasks.workunit.client.0.smithi005.stdout:7/216: symlink d1/l41 0 2024-04-16T14:35:28.310 INFO:tasks.workunit.client.0.smithi005.stdout:7/217: write d1/d5/d22/d27/f2b [1272566,93395] 0 2024-04-16T14:35:28.390 INFO:tasks.workunit.client.0.smithi005.stdout:2/64: dwrite d0/d4/f6 [0,4194304] 0 2024-04-16T14:35:28.393 INFO:tasks.workunit.client.0.smithi005.stdout:9/54: dread d3/f10 [0,4194304] 0 2024-04-16T14:35:28.393 INFO:tasks.workunit.client.0.smithi005.stdout:9/55: readlink d3/l9 0 2024-04-16T14:35:28.394 INFO:tasks.workunit.client.0.smithi005.stdout:2/65: dread - d0/d4/fe zero size 2024-04-16T14:35:28.394 INFO:tasks.workunit.client.0.smithi005.stdout:2/66: chown d0/d4/f6 865 1 2024-04-16T14:35:28.397 INFO:tasks.workunit.client.0.smithi005.stdout:2/67: chown d0/d4/d7/l10 6236 1 2024-04-16T14:35:28.402 INFO:tasks.workunit.client.0.smithi005.stdout:2/68: rmdir d0/d4 39 2024-04-16T14:35:28.402 INFO:tasks.workunit.client.0.smithi005.stdout:5/124: dwrite d0/d6/d12/f23 [0,4194304] 0 2024-04-16T14:35:28.409 INFO:tasks.workunit.client.0.smithi005.stdout:5/125: mknod d0/d6/d12/c24 0 2024-04-16T14:35:28.410 INFO:tasks.workunit.client.0.smithi005.stdout:5/126: write d0/f8 [4320764,91795] 0 2024-04-16T14:35:28.410 INFO:tasks.workunit.client.0.smithi005.stdout:5/127: rename d0 to d0/d6/d12/d1c/d25 22 2024-04-16T14:35:28.410 INFO:tasks.workunit.client.0.smithi005.stdout:3/98: dwrite d2/d9/df/f11 [0,4194304] 0 2024-04-16T14:35:28.416 INFO:tasks.workunit.client.0.smithi005.stdout:3/99: write d2/fa [4924031,94793] 0 2024-04-16T14:35:28.440 INFO:tasks.workunit.client.1.smithi115.stdout:5/9: dwrite f2 [0,4194304] 0 2024-04-16T14:35:28.440 INFO:tasks.workunit.client.1.smithi115.stdout:5/10: chown f1 1339759808 1 2024-04-16T14:35:28.444 INFO:tasks.workunit.client.0.smithi005.stdout:2/69: dwrite d0/d4/d7/f11 [0,4194304] 0 2024-04-16T14:35:28.446 INFO:tasks.workunit.client.0.smithi005.stdout:5/128: dwrite d0/d6/d12/d1c/f20 [0,4194304] 0 2024-04-16T14:35:28.446 INFO:tasks.workunit.client.0.smithi005.stdout:5/129: creat d0/f26 x:0 0 0 2024-04-16T14:35:28.447 INFO:tasks.workunit.client.0.smithi005.stdout:9/56: dread d3/fd [0,4194304] 0 2024-04-16T14:35:28.448 INFO:tasks.workunit.client.0.smithi005.stdout:7/218: dwrite d1/dc/f1c [0,4194304] 0 2024-04-16T14:35:28.460 INFO:tasks.workunit.client.0.smithi005.stdout:5/130: dread d0/d6/d12/d1c/f20 [0,4194304] 0 2024-04-16T14:35:28.463 INFO:tasks.workunit.client.1.smithi115.stdout:1/11: dwrite f3 [0,4194304] 0 2024-04-16T14:35:28.463 INFO:tasks.workunit.client.1.smithi115.stdout:1/12: write f0 [878785,37414] 0 2024-04-16T14:35:28.464 INFO:tasks.workunit.client.1.smithi115.stdout:1/13: chown f3 1 1 2024-04-16T14:35:28.464 INFO:tasks.workunit.client.1.smithi115.stdout:1/14: creat f4 x:0 0 0 2024-04-16T14:35:28.467 INFO:tasks.workunit.client.0.smithi005.stdout:3/100: write d2/d9/df/f11 [2796075,40105] 0 2024-04-16T14:35:28.473 INFO:tasks.workunit.client.0.smithi005.stdout:1/222: sync 2024-04-16T14:35:28.473 INFO:tasks.workunit.client.0.smithi005.stdout:6/295: sync 2024-04-16T14:35:28.474 INFO:tasks.workunit.client.0.smithi005.stdout:6/296: write d2/d5/d28/f21 [2827538,124862] 0 2024-04-16T14:35:28.474 INFO:tasks.workunit.client.0.smithi005.stdout:6/297: creat d2/d20/d33/f63 x:0 0 0 2024-04-16T14:35:28.474 INFO:tasks.workunit.client.0.smithi005.stdout:1/223: write d2/d1c/d15/d2a/d1a/f3b [1091684,30158] 0 2024-04-16T14:35:28.474 INFO:tasks.workunit.client.0.smithi005.stdout:9/57: read d3/fd [3517571,49068] 0 2024-04-16T14:35:28.479 INFO:tasks.workunit.client.0.smithi005.stdout:9/58: mknod d3/c11 0 2024-04-16T14:35:28.479 INFO:tasks.workunit.client.0.smithi005.stdout:9/59: read d3/f7 [102005,84513] 0 2024-04-16T14:35:28.480 INFO:tasks.workunit.client.0.smithi005.stdout:9/60: read d3/f7 [1142,58262] 0 2024-04-16T14:35:28.480 INFO:tasks.workunit.client.0.smithi005.stdout:1/224: truncate d2/d1c/d15/d2a/d19/d20/d27/f4c 4261743 0 2024-04-16T14:35:28.485 INFO:tasks.workunit.client.0.smithi005.stdout:9/61: dread d3/fd [0,4194304] 0 2024-04-16T14:35:28.485 INFO:tasks.workunit.client.0.smithi005.stdout:9/62: chown d3/c11 29 1 2024-04-16T14:35:28.486 INFO:tasks.workunit.client.0.smithi005.stdout:5/131: dwrite d0/d6/d12/d1c/f20 [0,4194304] 0 2024-04-16T14:35:28.489 INFO:tasks.workunit.client.0.smithi005.stdout:9/63: rmdir d3 39 2024-04-16T14:35:28.489 INFO:tasks.workunit.client.0.smithi005.stdout:9/64: fdatasync d3/ff 0 2024-04-16T14:35:28.489 INFO:tasks.workunit.client.0.smithi005.stdout:3/101: dwrite d2/d9/df/f1c [0,4194304] 0 2024-04-16T14:35:28.490 INFO:tasks.workunit.client.0.smithi005.stdout:5/132: mknod d0/d6/d12/d1c/c27 0 2024-04-16T14:35:28.491 INFO:tasks.workunit.client.0.smithi005.stdout:9/65: mkdir d3/d12 0 2024-04-16T14:35:28.500 INFO:tasks.workunit.client.0.smithi005.stdout:1/225: write d2/d1c/d15/d2a/d1a/d21/f29 [490658,119846] 0 2024-04-16T14:35:28.503 INFO:tasks.workunit.client.0.smithi005.stdout:1/226: mkdir d2/d1c/d15/d2a/d1a/d2e/d51 0 2024-04-16T14:35:28.504 INFO:tasks.workunit.client.0.smithi005.stdout:3/102: write d2/d9/df/f1c [2440837,62361] 0 2024-04-16T14:35:28.504 INFO:tasks.workunit.client.0.smithi005.stdout:3/103: write d2/d9/df/f11 [882824,95181] 0 2024-04-16T14:35:28.507 INFO:tasks.workunit.client.0.smithi005.stdout:1/227: link d2/d2c/l22 d2/d2c/d3e/l52 0 2024-04-16T14:35:28.507 INFO:tasks.workunit.client.0.smithi005.stdout:9/66: dwrite d3/f7 [0,4194304] 0 2024-04-16T14:35:28.507 INFO:tasks.workunit.client.0.smithi005.stdout:9/67: write d3/fd [1381277,16350] 0 2024-04-16T14:35:28.507 INFO:tasks.workunit.client.0.smithi005.stdout:9/68: chown l2 94804 1 2024-04-16T14:35:28.510 INFO:tasks.workunit.client.0.smithi005.stdout:3/104: unlink d2/d9/df/l18 0 2024-04-16T14:35:28.514 INFO:tasks.workunit.client.0.smithi005.stdout:1/228: rename d2/f13 to d2/d1c/d15/d2a/d19/d20/f53 0 2024-04-16T14:35:28.514 INFO:tasks.workunit.client.0.smithi005.stdout:1/229: write d2/d1c/d15/d2a/d19/d20/f53 [4851882,77763] 0 2024-04-16T14:35:28.518 INFO:tasks.workunit.client.0.smithi005.stdout:9/69: rename l2 to d3/d12/l13 0 2024-04-16T14:35:28.518 INFO:tasks.workunit.client.0.smithi005.stdout:9/70: read - d3/f8 zero size 2024-04-16T14:35:28.522 INFO:tasks.workunit.client.0.smithi005.stdout:1/230: write d2/d1c/d15/d2a/d19/f4a [1619869,54223] 0 2024-04-16T14:35:28.527 INFO:tasks.workunit.client.0.smithi005.stdout:9/71: dread d3/ff [0,4194304] 0 2024-04-16T14:35:28.527 INFO:tasks.workunit.client.0.smithi005.stdout:9/72: chown d3/fd 24811 1 2024-04-16T14:35:28.527 INFO:tasks.workunit.client.0.smithi005.stdout:9/73: stat d3/f7 0 2024-04-16T14:35:28.528 INFO:tasks.workunit.client.0.smithi005.stdout:1/231: link d2/d1c/d15/d2a/d25/f36 d2/d1c/d15/d2a/d19/d20/d27/f54 0 2024-04-16T14:35:28.528 INFO:tasks.workunit.client.0.smithi005.stdout:1/232: write d2/d1c/d15/d2a/d1a/d21/f29 [4949869,153] 0 2024-04-16T14:35:28.528 INFO:tasks.workunit.client.0.smithi005.stdout:1/233: chown d2/d2c/f4f 198 1 2024-04-16T14:35:28.528 INFO:tasks.workunit.client.0.smithi005.stdout:1/234: creat d2/f55 x:0 0 0 2024-04-16T14:35:28.531 INFO:tasks.workunit.client.0.smithi005.stdout:1/235: creat d2/d1c/d15/d2a/d19/d42/f56 x:0 0 0 2024-04-16T14:35:28.546 INFO:tasks.workunit.client.0.smithi005.stdout:1/236: dwrite d2/d1c/d15/d2a/d1a/f3b [0,4194304] 0 2024-04-16T14:35:28.546 INFO:tasks.workunit.client.0.smithi005.stdout:1/237: truncate d2/d1c/d15/d2a/d25/f48 249868 0 2024-04-16T14:35:28.554 INFO:tasks.workunit.client.0.smithi005.stdout:1/238: dread d2/d1c/fe [0,4194304] 0 2024-04-16T14:35:28.555 INFO:tasks.workunit.client.0.smithi005.stdout:1/239: getdents d2/d2c 0 2024-04-16T14:35:28.557 INFO:tasks.workunit.client.0.smithi005.stdout:1/240: link d2/d2c/d3e/l52 d2/d1c/d15/d2a/d1a/d2e/l57 0 2024-04-16T14:35:28.558 INFO:tasks.workunit.client.0.smithi005.stdout:1/241: fsync d2/d1c/d15/d2a/d1a/d2e/f35 0 2024-04-16T14:35:28.558 INFO:tasks.workunit.client.0.smithi005.stdout:1/242: stat d2/d1c/ca 0 2024-04-16T14:35:28.559 INFO:tasks.workunit.client.0.smithi005.stdout:1/243: rename d2/d1c/f1f to d2/d1c/f58 0 2024-04-16T14:35:28.573 INFO:tasks.workunit.client.0.smithi005.stdout:1/244: dwrite d2/d1c/d15/f1d [0,4194304] 0 2024-04-16T14:35:28.591 INFO:tasks.workunit.client.0.smithi005.stdout:1/245: dwrite d2/d1c/ff [0,4194304] 0 2024-04-16T14:35:28.591 INFO:tasks.workunit.client.0.smithi005.stdout:1/246: chown d2/d1c/d15/d2a/d19/d20/d27/f54 51089 1 2024-04-16T14:35:28.642 INFO:tasks.workunit.client.1.smithi115.stdout:4/18: truncate d1/f4 430384 0 2024-04-16T14:35:28.642 INFO:tasks.workunit.client.1.smithi115.stdout:4/19: write d1/f3 [497733,56738] 0 2024-04-16T14:35:28.713 INFO:tasks.workunit.client.1.smithi115.stdout:3/13: rename f1 to f3 0 2024-04-16T14:35:28.767 INFO:tasks.workunit.client.1.smithi115.stdout:8/25: link d0/c5 d0/c7 0 2024-04-16T14:35:28.790 INFO:tasks.workunit.client.1.smithi115.stdout:3/14: dwrite f2 [0,4194304] 0 2024-04-16T14:35:28.790 INFO:tasks.workunit.client.1.smithi115.stdout:3/15: rmdir - no directory 2024-04-16T14:35:28.791 INFO:tasks.workunit.client.0.smithi005.stdout:1/247: dwrite d2/d2c/f4f [0,4194304] 0 2024-04-16T14:35:28.796 INFO:tasks.workunit.client.0.smithi005.stdout:1/248: truncate d2/d1c/fe 2799723 0 2024-04-16T14:35:28.859 INFO:tasks.workunit.client.0.smithi005.stdout:4/260: sync 2024-04-16T14:35:28.866 INFO:tasks.workunit.client.0.smithi005.stdout:4/261: write d0/d1b/d2e/f2f [443640,80190] 0 2024-04-16T14:35:28.872 INFO:tasks.workunit.client.0.smithi005.stdout:4/262: dread d0/d1b/d1d/d1f/f20 [0,4194304] 0 2024-04-16T14:35:28.889 INFO:tasks.workunit.client.0.smithi005.stdout:4/263: dwrite d0/f4c [0,4194304] 0 2024-04-16T14:35:28.889 INFO:tasks.workunit.client.0.smithi005.stdout:4/264: write d0/f13 [1314898,28819] 0 2024-04-16T14:35:28.889 INFO:tasks.workunit.client.0.smithi005.stdout:4/265: truncate d0/d1b/f34 800391 0 2024-04-16T14:35:28.889 INFO:tasks.workunit.client.0.smithi005.stdout:4/266: readlink d0/d1b/d1d/d1f/l32 0 2024-04-16T14:35:28.889 INFO:tasks.workunit.client.0.smithi005.stdout:4/267: readlink d0/l4b 0 2024-04-16T14:35:28.889 INFO:tasks.workunit.client.0.smithi005.stdout:4/268: write d0/d4d/f50 [783586,89690] 0 2024-04-16T14:35:28.890 INFO:tasks.workunit.client.0.smithi005.stdout:4/269: truncate d0/f7 3888758 0 2024-04-16T14:35:28.896 INFO:tasks.workunit.client.0.smithi005.stdout:4/270: write d0/f2c [1394974,15072] 0 2024-04-16T14:35:28.897 INFO:tasks.workunit.client.0.smithi005.stdout:4/271: truncate d0/f9 1769181 0 2024-04-16T14:35:28.907 INFO:tasks.workunit.client.0.smithi005.stdout:4/272: dread d0/f4c [0,4194304] 0 2024-04-16T14:35:28.908 INFO:tasks.workunit.client.0.smithi005.stdout:4/273: mkdir d0/d1b/d51 0 2024-04-16T14:35:28.912 INFO:tasks.workunit.client.0.smithi005.stdout:4/274: dread d0/f9 [0,4194304] 0 2024-04-16T14:35:28.927 INFO:tasks.workunit.client.0.smithi005.stdout:4/275: dwrite d0/d1b/d2e/f3b [0,4194304] 0 2024-04-16T14:35:28.941 INFO:tasks.workunit.client.0.smithi005.stdout:4/276: write d0/d1b/d1d/d1f/f46 [1041936,51223] 0 2024-04-16T14:35:28.942 INFO:tasks.workunit.client.0.smithi005.stdout:4/277: write d0/d1b/d1d/d1f/f36 [552496,84488] 0 2024-04-16T14:35:28.958 INFO:tasks.workunit.client.0.smithi005.stdout:4/278: dwrite d0/d22/d29/f2d [0,4194304] 0 2024-04-16T14:35:28.964 INFO:tasks.workunit.client.0.smithi005.stdout:4/279: dread d0/d1b/d1d/d1f/f46 [0,4194304] 0 2024-04-16T14:35:28.966 INFO:tasks.workunit.client.0.smithi005.stdout:4/280: rename d0/d22/d29/c30 to d0/d22/d29/c52 0 2024-04-16T14:35:28.967 INFO:tasks.workunit.client.0.smithi005.stdout:4/281: write d0/f10 [452757,44313] 0 2024-04-16T14:35:28.967 INFO:tasks.workunit.client.0.smithi005.stdout:4/282: write d0/d22/f4e [144774,103443] 0 2024-04-16T14:35:28.977 INFO:tasks.workunit.client.0.smithi005.stdout:4/283: write d0/d22/d29/f2d [328270,76479] 0 2024-04-16T14:35:28.977 INFO:tasks.workunit.client.0.smithi005.stdout:4/284: read d0/fd [577368,28881] 0 2024-04-16T14:35:28.978 INFO:tasks.workunit.client.0.smithi005.stdout:4/285: unlink d0/d1b/f3c 0 2024-04-16T14:35:28.981 INFO:tasks.workunit.client.0.smithi005.stdout:4/286: creat d0/d1b/d1d/f53 x:0 0 0 2024-04-16T14:35:28.981 INFO:tasks.workunit.client.0.smithi005.stdout:4/287: chown d0/d1b/c45 26602574 1 2024-04-16T14:35:28.981 INFO:tasks.workunit.client.0.smithi005.stdout:4/288: readlink d0/d1b/d1d/d1f/l38 0 2024-04-16T14:35:28.981 INFO:tasks.workunit.client.0.smithi005.stdout:4/289: chown d0 1074618219 1 2024-04-16T14:35:28.981 INFO:tasks.workunit.client.0.smithi005.stdout:4/290: fsync d0/f4c 0 2024-04-16T14:35:28.982 INFO:tasks.workunit.client.0.smithi005.stdout:4/291: dread - d0/f2b zero size 2024-04-16T14:35:28.982 INFO:tasks.workunit.client.0.smithi005.stdout:4/292: link d0/d1b/d1d/d1f/l32 d0/d1b/d1d/d4f/l54 0 2024-04-16T14:35:28.982 INFO:tasks.workunit.client.0.smithi005.stdout:4/293: creat d0/d1b/d1d/d1f/d3e/f55 x:0 0 0 2024-04-16T14:35:28.982 INFO:tasks.workunit.client.0.smithi005.stdout:4/294: chown d0/f4c 3273094 1 2024-04-16T14:35:28.982 INFO:tasks.workunit.client.0.smithi005.stdout:4/295: creat d0/d4d/f56 x:0 0 0 2024-04-16T14:35:28.983 INFO:tasks.workunit.client.1.smithi115.stdout:4/20: write d1/f4 [1234034,83286] 0 2024-04-16T14:35:28.983 INFO:tasks.workunit.client.1.smithi115.stdout:4/21: write d1/f4 [1932891,122417] 0 2024-04-16T14:35:28.987 INFO:tasks.workunit.client.1.smithi115.stdout:4/22: dread d1/f3 [0,4194304] 0 2024-04-16T14:35:28.987 INFO:tasks.workunit.client.0.smithi005.stdout:4/296: dread d0/f5 [0,4194304] 0 2024-04-16T14:35:28.994 INFO:tasks.workunit.client.0.smithi005.stdout:4/297: write d0/d1b/d1d/d1f/f20 [2522915,80695] 0 2024-04-16T14:35:28.994 INFO:tasks.workunit.client.0.smithi005.stdout:4/298: write d0/d1b/d1d/d1f/f46 [3190095,122904] 0 2024-04-16T14:35:28.996 INFO:tasks.workunit.client.0.smithi005.stdout:4/299: dread d0/f5 [0,4194304] 0 2024-04-16T14:35:28.996 INFO:tasks.workunit.client.0.smithi005.stdout:4/300: stat d0/d1b/d1d/d1f/f36 0 2024-04-16T14:35:28.996 INFO:tasks.workunit.client.0.smithi005.stdout:4/301: chown d0/d1b/d2e/c4a 739631 1 2024-04-16T14:35:29.002 INFO:tasks.workunit.client.0.smithi005.stdout:4/302: dread d0/d1b/d2e/f2f [0,4194304] 0 2024-04-16T14:35:29.004 INFO:tasks.workunit.client.0.smithi005.stdout:4/303: fsync d0/d22/f4e 0 2024-04-16T14:35:29.006 INFO:tasks.workunit.client.0.smithi005.stdout:4/304: fdatasync d0/d1b/d1d/d1f/f46 0 2024-04-16T14:35:29.006 INFO:tasks.workunit.client.0.smithi005.stdout:4/305: chown d0/d1b/d2e/f2f 7654733 1 2024-04-16T14:35:29.007 INFO:tasks.workunit.client.0.smithi005.stdout:4/306: truncate d0/d1b/d1d/d1f/f36 1358749 0 2024-04-16T14:35:29.007 INFO:tasks.workunit.client.0.smithi005.stdout:4/307: link d0/f2c d0/d1b/d1d/d1f/f57 0 2024-04-16T14:35:29.009 INFO:tasks.workunit.client.0.smithi005.stdout:4/308: getdents d0/d1b 0 2024-04-16T14:35:29.025 INFO:tasks.workunit.client.0.smithi005.stdout:4/309: dwrite d0/d1b/d1d/f21 [0,4194304] 0 2024-04-16T14:35:29.025 INFO:tasks.workunit.client.0.smithi005.stdout:4/310: write d0/d22/d29/f2d [3333416,63594] 0 2024-04-16T14:35:29.025 INFO:tasks.workunit.client.0.smithi005.stdout:4/311: getdents d0/d1b/d1d/d4f 0 2024-04-16T14:35:29.026 INFO:tasks.workunit.client.0.smithi005.stdout:4/312: creat d0/f58 x:0 0 0 2024-04-16T14:35:29.031 INFO:tasks.workunit.client.0.smithi005.stdout:4/313: rmdir d0/d1b/d2e 39 2024-04-16T14:35:29.032 INFO:tasks.workunit.client.0.smithi005.stdout:4/314: symlink d0/d4d/l59 0 2024-04-16T14:35:29.032 INFO:tasks.workunit.client.0.smithi005.stdout:4/315: mkdir d0/d5a 0 2024-04-16T14:35:29.032 INFO:tasks.workunit.client.0.smithi005.stdout:4/316: mknod d0/d1b/d51/c5b 0 2024-04-16T14:35:29.032 INFO:tasks.workunit.client.0.smithi005.stdout:4/317: getdents d0/d47 0 2024-04-16T14:35:29.032 INFO:tasks.workunit.client.0.smithi005.stdout:4/318: fdatasync d0/f2b 0 2024-04-16T14:35:29.033 INFO:tasks.workunit.client.0.smithi005.stdout:4/319: dread d0/d1b/d2e/f2f [0,4194304] 0 2024-04-16T14:35:29.033 INFO:tasks.workunit.client.0.smithi005.stdout:4/320: fdatasync d0/f2b 0 2024-04-16T14:35:29.041 INFO:tasks.workunit.client.0.smithi005.stdout:2/70: sync 2024-04-16T14:35:29.041 INFO:tasks.workunit.client.0.smithi005.stdout:3/105: sync 2024-04-16T14:35:29.042 INFO:tasks.workunit.client.0.smithi005.stdout:0/222: sync 2024-04-16T14:35:29.042 INFO:tasks.workunit.client.0.smithi005.stdout:5/133: sync 2024-04-16T14:35:29.042 INFO:tasks.workunit.client.0.smithi005.stdout:8/171: sync 2024-04-16T14:35:29.042 INFO:tasks.workunit.client.0.smithi005.stdout:7/219: sync 2024-04-16T14:35:29.042 INFO:tasks.workunit.client.0.smithi005.stdout:9/74: sync 2024-04-16T14:35:29.042 INFO:tasks.workunit.client.0.smithi005.stdout:8/172: stat d5/d11/d1f/d2f/f34 0 2024-04-16T14:35:29.042 INFO:tasks.workunit.client.0.smithi005.stdout:1/249: sync 2024-04-16T14:35:29.042 INFO:tasks.workunit.client.0.smithi005.stdout:6/298: sync 2024-04-16T14:35:29.042 INFO:tasks.workunit.client.0.smithi005.stdout:1/250: write d2/d1c/d15/d2a/d25/f48 [796432,17600] 0 2024-04-16T14:35:29.043 INFO:tasks.workunit.client.0.smithi005.stdout:4/321: write d0/d1b/d2e/f3b [415235,19612] 0 2024-04-16T14:35:29.043 INFO:tasks.workunit.client.0.smithi005.stdout:0/223: stat da/df/c1c 0 2024-04-16T14:35:29.043 INFO:tasks.workunit.client.0.smithi005.stdout:4/322: creat d0/f5c x:0 0 0 2024-04-16T14:35:29.045 INFO:tasks.workunit.client.0.smithi005.stdout:5/134: rmdir d0/d6/d12/d1c/d1e 39 2024-04-16T14:35:29.046 INFO:tasks.workunit.client.0.smithi005.stdout:3/106: mkdir d2/d17/d1e 0 2024-04-16T14:35:29.048 INFO:tasks.workunit.client.0.smithi005.stdout:6/299: mkdir d2/d20/d33/d64 0 2024-04-16T14:35:29.053 INFO:tasks.workunit.client.0.smithi005.stdout:9/75: write d3/f7 [559110,84353] 0 2024-04-16T14:35:29.053 INFO:tasks.workunit.client.0.smithi005.stdout:1/251: rename d2/d1c/d15/d2a/d25/c3a to d2/d1c/d15/d2a/d1a/c59 0 2024-04-16T14:35:29.055 INFO:tasks.workunit.client.0.smithi005.stdout:3/107: mknod d2/d9/df/c1f 0 2024-04-16T14:35:29.056 INFO:tasks.workunit.client.0.smithi005.stdout:1/252: read d2/d1c/d15/d2a/d19/d20/d27/f34 [205726,38607] 0 2024-04-16T14:35:29.057 INFO:tasks.workunit.client.0.smithi005.stdout:1/253: fsync d2/d1c/d15/d2a/d1a/d2e/f35 0 2024-04-16T14:35:29.057 INFO:tasks.workunit.client.0.smithi005.stdout:1/254: readlink d2/d2c/l22 0 2024-04-16T14:35:29.057 INFO:tasks.workunit.client.0.smithi005.stdout:9/76: creat d3/f14 x:0 0 0 2024-04-16T14:35:29.058 INFO:tasks.workunit.client.0.smithi005.stdout:2/71: dread d0/d4/f6 [0,4194304] 0 2024-04-16T14:35:29.058 INFO:tasks.workunit.client.0.smithi005.stdout:2/72: fsync d0/d4/f6 0 2024-04-16T14:35:29.061 INFO:tasks.workunit.client.0.smithi005.stdout:6/300: rename d2/d5/d10/l50 to d2/d5/l65 0 2024-04-16T14:35:29.061 INFO:tasks.workunit.client.0.smithi005.stdout:6/301: fdatasync d2/d20/d3c/f5d 0 2024-04-16T14:35:29.061 INFO:tasks.workunit.client.0.smithi005.stdout:6/302: chown d2/l1b 2122 1 2024-04-16T14:35:29.061 INFO:tasks.workunit.client.0.smithi005.stdout:6/303: readlink d2/d5/d10/l16 0 2024-04-16T14:35:29.061 INFO:tasks.workunit.client.0.smithi005.stdout:3/108: creat d2/f20 x:0 0 0 2024-04-16T14:35:29.063 INFO:tasks.workunit.client.0.smithi005.stdout:1/255: mkdir d2/d2c/d3e/d5a 0 2024-04-16T14:35:29.063 INFO:tasks.workunit.client.0.smithi005.stdout:1/256: fsync d2/d1c/d15/d2a/d19/d42/f56 0 2024-04-16T14:35:29.064 INFO:tasks.workunit.client.0.smithi005.stdout:9/77: unlink d3/fb 0 2024-04-16T14:35:29.066 INFO:tasks.workunit.client.0.smithi005.stdout:2/73: link d0/d4/d7/l10 d0/d4/d7/l15 0 2024-04-16T14:35:29.067 INFO:tasks.workunit.client.0.smithi005.stdout:1/257: mknod d2/d2c/d3e/d5a/c5b 0 2024-04-16T14:35:29.067 INFO:tasks.workunit.client.0.smithi005.stdout:1/258: chown d2/d1c/d15/d2a/d19/d42/f56 6190223 1 2024-04-16T14:35:29.068 INFO:tasks.workunit.client.0.smithi005.stdout:2/74: mknod d0/c16 0 2024-04-16T14:35:29.069 INFO:tasks.workunit.client.0.smithi005.stdout:2/75: chown d0/d4/c14 121661281 1 2024-04-16T14:35:29.070 INFO:tasks.workunit.client.0.smithi005.stdout:2/76: creat d0/d4/d7/f17 x:0 0 0 2024-04-16T14:35:29.070 INFO:tasks.workunit.client.0.smithi005.stdout:2/77: read - d0/d4/fe zero size 2024-04-16T14:35:29.073 INFO:tasks.workunit.client.0.smithi005.stdout:1/259: rename d2/d1c/d15/d2a/f49 to d2/d1c/d15/d2a/d25/f5c 0 2024-04-16T14:35:29.074 INFO:tasks.workunit.client.0.smithi005.stdout:2/78: mknod d0/d4/d7/c18 0 2024-04-16T14:35:29.075 INFO:tasks.workunit.client.0.smithi005.stdout:1/260: symlink d2/d1c/d15/l5d 0 2024-04-16T14:35:29.075 INFO:tasks.workunit.client.0.smithi005.stdout:1/261: fdatasync d2/d1c/d15/d2a/d19/d42/f56 0 2024-04-16T14:35:29.076 INFO:tasks.workunit.client.0.smithi005.stdout:1/262: symlink d2/d1c/l5e 0 2024-04-16T14:35:29.078 INFO:tasks.workunit.client.0.smithi005.stdout:1/263: link d2/d1c/d15/d2a/d25/f36 d2/d1c/d15/d2a/d25/f5f 0 2024-04-16T14:35:29.085 INFO:tasks.workunit.client.1.smithi115.stdout:7/33: unlink d0/f9 0 2024-04-16T14:35:29.085 INFO:tasks.workunit.client.1.smithi115.stdout:7/34: fdatasync d0/d2/fb 0 2024-04-16T14:35:29.086 INFO:tasks.workunit.client.1.smithi115.stdout:7/35: read d0/d2/fb [639945,95397] 0 2024-04-16T14:35:29.088 INFO:tasks.workunit.client.0.smithi005.stdout:8/173: dwrite f4 [0,4194304] 0 2024-04-16T14:35:29.088 INFO:tasks.workunit.client.0.smithi005.stdout:8/174: creat d5/de/f36 x:0 0 0 2024-04-16T14:35:29.105 INFO:tasks.workunit.client.0.smithi005.stdout:4/323: dwrite d0/f5 [0,4194304] 0 2024-04-16T14:35:29.110 INFO:tasks.workunit.client.0.smithi005.stdout:5/135: dwrite d0/d6/d12/d1c/f20 [4194304,4194304] 0 2024-04-16T14:35:29.110 INFO:tasks.workunit.client.0.smithi005.stdout:5/136: fsync d0/d6/d12/d1c/f1f 0 2024-04-16T14:35:29.110 INFO:tasks.workunit.client.0.smithi005.stdout:8/175: write d5/f6 [3844543,18481] 0 2024-04-16T14:35:29.111 INFO:tasks.workunit.client.0.smithi005.stdout:5/137: creat d0/f28 x:0 0 0 2024-04-16T14:35:29.111 INFO:tasks.workunit.client.0.smithi005.stdout:5/138: stat d0/f8 0 2024-04-16T14:35:29.111 INFO:tasks.workunit.client.0.smithi005.stdout:9/78: dwrite d3/f8 [0,4194304] 0 2024-04-16T14:35:29.115 INFO:tasks.workunit.client.0.smithi005.stdout:2/79: dwrite d0/d4/f12 [0,4194304] 0 2024-04-16T14:35:29.115 INFO:tasks.workunit.client.0.smithi005.stdout:6/304: dwrite d2/d5/f2f [0,4194304] 0 2024-04-16T14:35:29.115 INFO:tasks.workunit.client.0.smithi005.stdout:7/220: dwrite d1/d5/d22/f30 [0,4194304] 0 2024-04-16T14:35:29.115 INFO:tasks.workunit.client.0.smithi005.stdout:7/221: stat d1/d5/d22/f30 0 2024-04-16T14:35:29.115 INFO:tasks.workunit.client.0.smithi005.stdout:0/224: dwrite f1 [0,4194304] 0 2024-04-16T14:35:29.117 INFO:tasks.workunit.client.0.smithi005.stdout:3/109: dwrite d2/fe [0,4194304] 0 2024-04-16T14:35:29.117 INFO:tasks.workunit.client.0.smithi005.stdout:3/110: creat d2/f21 x:0 0 0 2024-04-16T14:35:29.117 INFO:tasks.workunit.client.0.smithi005.stdout:3/111: write d2/d9/df/f11 [1165921,39405] 0 2024-04-16T14:35:29.117 INFO:tasks.workunit.client.0.smithi005.stdout:3/112: write d2/f21 [538361,65351] 0 2024-04-16T14:35:29.122 INFO:tasks.workunit.client.0.smithi005.stdout:6/305: write d2/d5/f2a [3191338,84866] 0 2024-04-16T14:35:29.126 INFO:tasks.workunit.client.0.smithi005.stdout:0/225: rename da/df/d26 to da/df/d26/d39/d49 22 2024-04-16T14:35:29.126 INFO:tasks.workunit.client.0.smithi005.stdout:8/176: write d5/f23 [203477,62238] 0 2024-04-16T14:35:29.127 INFO:tasks.workunit.client.0.smithi005.stdout:0/226: dread da/f1a [0,4194304] 0 2024-04-16T14:35:29.133 INFO:tasks.workunit.client.0.smithi005.stdout:1/264: getdents d2/d1c 0 2024-04-16T14:35:29.136 INFO:tasks.workunit.client.0.smithi005.stdout:2/80: dread d0/f2 [0,4194304] 0 2024-04-16T14:35:29.136 INFO:tasks.workunit.client.0.smithi005.stdout:6/306: unlink d2/fd 0 2024-04-16T14:35:29.136 INFO:tasks.workunit.client.0.smithi005.stdout:8/177: dread d5/de/f25 [0,4194304] 0 2024-04-16T14:35:29.138 INFO:tasks.workunit.client.0.smithi005.stdout:6/307: dread d2/d5/d28/f46 [0,4194304] 0 2024-04-16T14:35:29.138 INFO:tasks.workunit.client.0.smithi005.stdout:6/308: fsync d2/d5/d10/d4d/d51/f61 0 2024-04-16T14:35:29.138 INFO:tasks.workunit.client.0.smithi005.stdout:6/309: write d2/d5/d10/f1d [197371,4284] 0 2024-04-16T14:35:29.140 INFO:tasks.workunit.client.0.smithi005.stdout:8/178: creat d5/d11/f37 x:0 0 0 2024-04-16T14:35:29.141 INFO:tasks.workunit.client.0.smithi005.stdout:8/179: write d5/d11/d1f/f24 [598008,19096] 0 2024-04-16T14:35:29.141 INFO:tasks.workunit.client.0.smithi005.stdout:2/81: getdents d0 0 2024-04-16T14:35:29.143 INFO:tasks.workunit.client.0.smithi005.stdout:8/180: creat d5/f38 x:0 0 0 2024-04-16T14:35:29.146 INFO:tasks.workunit.client.0.smithi005.stdout:2/82: rename d0/d4/c14 to d0/d4/d7/c19 0 2024-04-16T14:35:29.146 INFO:tasks.workunit.client.0.smithi005.stdout:2/83: readlink d0/d4/d7/l15 0 2024-04-16T14:35:29.146 INFO:tasks.workunit.client.0.smithi005.stdout:2/84: chown d0/d4/d7/f11 3951 1 2024-04-16T14:35:29.146 INFO:tasks.workunit.client.0.smithi005.stdout:2/85: write d0/f2 [4762907,87766] 0 2024-04-16T14:35:29.146 INFO:tasks.workunit.client.0.smithi005.stdout:2/86: readlink d0/d4/d7/l10 0 2024-04-16T14:35:29.146 INFO:tasks.workunit.client.0.smithi005.stdout:2/87: truncate d0/d4/d7/f13 56642 0 2024-04-16T14:35:29.147 INFO:tasks.workunit.client.0.smithi005.stdout:8/181: symlink d5/de/l39 0 2024-04-16T14:35:29.148 INFO:tasks.workunit.client.0.smithi005.stdout:8/182: creat d5/f3a x:0 0 0 2024-04-16T14:35:29.148 INFO:tasks.workunit.client.0.smithi005.stdout:8/183: creat d5/de/f3b x:0 0 0 2024-04-16T14:35:29.148 INFO:tasks.workunit.client.0.smithi005.stdout:8/184: truncate d5/d11/d1f/d2f/f34 159438 0 2024-04-16T14:35:29.149 INFO:tasks.workunit.client.0.smithi005.stdout:2/88: link d0/d4/fe d0/d4/d7/f1a 0 2024-04-16T14:35:29.150 INFO:tasks.workunit.client.0.smithi005.stdout:2/89: write d0/d4/d7/f1a [692695,9036] 0 2024-04-16T14:35:29.150 INFO:tasks.workunit.client.0.smithi005.stdout:2/90: write d0/fb [623364,58047] 0 2024-04-16T14:35:29.152 INFO:tasks.workunit.client.0.smithi005.stdout:8/185: symlink d5/d11/l3c 0 2024-04-16T14:35:29.153 INFO:tasks.workunit.client.0.smithi005.stdout:2/91: rmdir d0/d4 39 2024-04-16T14:35:29.154 INFO:tasks.workunit.client.0.smithi005.stdout:8/186: mkdir d5/d11/d1f/d2f/d3d 0 2024-04-16T14:35:29.156 INFO:tasks.workunit.client.0.smithi005.stdout:8/187: mknod d5/d11/d1f/c3e 0 2024-04-16T14:35:29.157 INFO:tasks.workunit.client.0.smithi005.stdout:8/188: creat d5/d11/d1f/d2f/d3d/f3f x:0 0 0 2024-04-16T14:35:29.157 INFO:tasks.workunit.client.0.smithi005.stdout:2/92: dread d0/d4/f6 [0,4194304] 0 2024-04-16T14:35:29.158 INFO:tasks.workunit.client.0.smithi005.stdout:4/324: dwrite d0/f2c [0,4194304] 0 2024-04-16T14:35:29.158 INFO:tasks.workunit.client.0.smithi005.stdout:5/139: dwrite d0/f28 [0,4194304] 0 2024-04-16T14:35:29.158 INFO:tasks.workunit.client.0.smithi005.stdout:8/189: mkdir d5/d40 0 2024-04-16T14:35:29.161 INFO:tasks.workunit.client.0.smithi005.stdout:8/190: mknod d5/d40/c41 0 2024-04-16T14:35:29.163 INFO:tasks.workunit.client.0.smithi005.stdout:8/191: unlink d5/d11/d1f/l21 0 2024-04-16T14:35:29.163 INFO:tasks.workunit.client.0.smithi005.stdout:8/192: truncate d5/d11/d1f/f24 1450919 0 2024-04-16T14:35:29.164 INFO:tasks.workunit.client.0.smithi005.stdout:8/193: rename d5/d11/l13 to d5/de/l42 0 2024-04-16T14:35:29.164 INFO:tasks.workunit.client.0.smithi005.stdout:4/325: dread d0/f5 [0,4194304] 0 2024-04-16T14:35:29.165 INFO:tasks.workunit.client.0.smithi005.stdout:7/222: dwrite d1/dc/f1c [0,4194304] 0 2024-04-16T14:35:29.165 INFO:tasks.workunit.client.0.smithi005.stdout:0/227: dwrite da/df/f21 [0,4194304] 0 2024-04-16T14:35:29.166 INFO:tasks.workunit.client.0.smithi005.stdout:8/194: rename d5/f6 to d5/f43 0 2024-04-16T14:35:29.166 INFO:tasks.workunit.client.0.smithi005.stdout:3/113: dwrite d2/d9/df/f1c [0,4194304] 0 2024-04-16T14:35:29.166 INFO:tasks.workunit.client.0.smithi005.stdout:3/114: fdatasync d2/d9/df/f11 0 2024-04-16T14:35:29.167 INFO:tasks.workunit.client.0.smithi005.stdout:1/265: dwrite d2/d1c/d15/d2a/d19/d42/f56 [0,4194304] 0 2024-04-16T14:35:29.167 INFO:tasks.workunit.client.0.smithi005.stdout:4/326: mkdir d0/d1b/d1d/d1f/d5d 0 2024-04-16T14:35:29.168 INFO:tasks.workunit.client.0.smithi005.stdout:7/223: rename d1/dc/f25 to d1/d5/d22/f42 0 2024-04-16T14:35:29.169 INFO:tasks.workunit.client.0.smithi005.stdout:0/228: creat da/df/d26/f4a x:0 0 0 2024-04-16T14:35:29.170 INFO:tasks.workunit.client.0.smithi005.stdout:8/195: truncate d5/de/f28 76981 0 2024-04-16T14:35:29.170 INFO:tasks.workunit.client.0.smithi005.stdout:8/196: write d5/f23 [1449929,17967] 0 2024-04-16T14:35:29.170 INFO:tasks.workunit.client.0.smithi005.stdout:8/197: chown d5/d11/d1f/d2f/f34 22 1 2024-04-16T14:35:29.174 INFO:tasks.workunit.client.0.smithi005.stdout:4/327: write d0/f5 [778246,97919] 0 2024-04-16T14:35:29.175 INFO:tasks.workunit.client.0.smithi005.stdout:5/140: dread d0/d6/d12/f23 [0,4194304] 0 2024-04-16T14:35:29.175 INFO:tasks.workunit.client.0.smithi005.stdout:5/141: creat d0/d6/d12/f29 x:0 0 0 2024-04-16T14:35:29.175 INFO:tasks.workunit.client.0.smithi005.stdout:5/142: truncate d0/d6/d12/d1c/f22 956366 0 2024-04-16T14:35:29.183 INFO:tasks.workunit.client.0.smithi005.stdout:7/224: write d1/d5/d22/f28 [2893394,26119] 0 2024-04-16T14:35:29.183 INFO:tasks.workunit.client.0.smithi005.stdout:7/225: write d1/d5/d22/d27/d3a/f40 [747527,124214] 0 2024-04-16T14:35:29.183 INFO:tasks.workunit.client.0.smithi005.stdout:7/226: creat d1/d5/d22/d27/d3a/f43 x:0 0 0 2024-04-16T14:35:29.183 INFO:tasks.workunit.client.0.smithi005.stdout:7/227: truncate d1/d5/d22/d27/f2b 2252144 0 2024-04-16T14:35:29.183 INFO:tasks.workunit.client.0.smithi005.stdout:7/228: write d1/d5/d22/d27/d3a/f40 [1361358,68719] 0 2024-04-16T14:35:29.184 INFO:tasks.workunit.client.0.smithi005.stdout:8/198: rename d5/d11/f37 to d5/d11/f44 0 2024-04-16T14:35:29.184 INFO:tasks.workunit.client.0.smithi005.stdout:8/199: readlink d5/de/l42 0 2024-04-16T14:35:29.184 INFO:tasks.workunit.client.0.smithi005.stdout:8/200: read - d5/f38 zero size 2024-04-16T14:35:29.184 INFO:tasks.workunit.client.0.smithi005.stdout:8/201: creat d5/d11/f45 x:0 0 0 2024-04-16T14:35:29.184 INFO:tasks.workunit.client.0.smithi005.stdout:8/202: truncate d5/de/f36 675467 0 2024-04-16T14:35:29.185 INFO:tasks.workunit.client.0.smithi005.stdout:7/229: dread d1/d5/f17 [0,4194304] 0 2024-04-16T14:35:29.185 INFO:tasks.workunit.client.0.smithi005.stdout:7/230: write d1/d5/f17 [155995,17114] 0 2024-04-16T14:35:29.185 INFO:tasks.workunit.client.0.smithi005.stdout:3/115: getdents d2/d9/df 0 2024-04-16T14:35:29.185 INFO:tasks.workunit.client.0.smithi005.stdout:3/116: dread - d2/f20 zero size 2024-04-16T14:35:29.185 INFO:tasks.workunit.client.0.smithi005.stdout:1/266: dwrite d2/d1c/d15/d2a/d1a/d2e/f35 [0,4194304] 0 2024-04-16T14:35:29.188 INFO:tasks.workunit.client.0.smithi005.stdout:4/328: rename d0/f2b to d0/d1b/d1d/d1f/d3e/f5e 0 2024-04-16T14:35:29.188 INFO:tasks.workunit.client.0.smithi005.stdout:4/329: fdatasync d0/f12 0 2024-04-16T14:35:29.188 INFO:tasks.workunit.client.0.smithi005.stdout:4/330: fdatasync d0/d1b/d1d/d1f/d3e/f5e 0 2024-04-16T14:35:29.188 INFO:tasks.workunit.client.0.smithi005.stdout:0/229: dwrite f0 [0,4194304] 0 2024-04-16T14:35:29.194 INFO:tasks.workunit.client.0.smithi005.stdout:8/203: truncate d5/fb 3483699 0 2024-04-16T14:35:29.198 INFO:tasks.workunit.client.0.smithi005.stdout:7/231: truncate d1/dc/f18 2801392 0 2024-04-16T14:35:29.198 INFO:tasks.workunit.client.0.smithi005.stdout:0/230: read da/df/f15 [3820287,29975] 0 2024-04-16T14:35:29.201 INFO:tasks.workunit.client.0.smithi005.stdout:5/143: dwrite d0/f28 [0,4194304] 0 2024-04-16T14:35:29.202 INFO:tasks.workunit.client.0.smithi005.stdout:3/117: rename d2/d9/df/c12 to d2/d9/c22 0 2024-04-16T14:35:29.204 INFO:tasks.workunit.client.0.smithi005.stdout:8/204: creat d5/d40/f46 x:0 0 0 2024-04-16T14:35:29.207 INFO:tasks.workunit.client.0.smithi005.stdout:4/331: dwrite d0/d1b/d1d/f39 [0,4194304] 0 2024-04-16T14:35:29.207 INFO:tasks.workunit.client.0.smithi005.stdout:4/332: creat d0/f5f x:0 0 0 2024-04-16T14:35:29.208 INFO:tasks.workunit.client.0.smithi005.stdout:3/118: symlink d2/l23 0 2024-04-16T14:35:29.208 INFO:tasks.workunit.client.0.smithi005.stdout:3/119: stat d2/d9 0 2024-04-16T14:35:29.210 INFO:tasks.workunit.client.0.smithi005.stdout:1/267: rename d2/d1c/d15/d2a/c43 to d2/d1c/d15/d2a/c60 0 2024-04-16T14:35:29.210 INFO:tasks.workunit.client.0.smithi005.stdout:1/268: chown d2/d1c/d15/d2a/d1a/f44 245 1 2024-04-16T14:35:29.212 INFO:tasks.workunit.client.0.smithi005.stdout:8/205: dread d5/de/f1d [0,4194304] 0 2024-04-16T14:35:29.212 INFO:tasks.workunit.client.0.smithi005.stdout:8/206: dread - d5/d11/f45 zero size 2024-04-16T14:35:29.213 INFO:tasks.workunit.client.0.smithi005.stdout:5/144: write d0/f2 [2821479,79869] 0 2024-04-16T14:35:29.223 INFO:tasks.workunit.client.0.smithi005.stdout:5/145: dread d0/f2 [0,4194304] 0 2024-04-16T14:35:29.223 INFO:tasks.workunit.client.0.smithi005.stdout:4/333: dwrite d0/d1b/f34 [0,4194304] 0 2024-04-16T14:35:29.228 INFO:tasks.workunit.client.0.smithi005.stdout:3/120: symlink d2/l24 0 2024-04-16T14:35:29.229 INFO:tasks.workunit.client.0.smithi005.stdout:1/269: creat d2/d1c/d15/d2a/d1a/d21/f61 x:0 0 0 2024-04-16T14:35:29.231 INFO:tasks.workunit.client.0.smithi005.stdout:1/270: write d2/d1c/d15/d2a/d25/f36 [444508,121372] 0 2024-04-16T14:35:29.231 INFO:tasks.workunit.client.0.smithi005.stdout:1/271: creat d2/f62 x:0 0 0 2024-04-16T14:35:29.231 INFO:tasks.workunit.client.0.smithi005.stdout:1/272: creat d2/d1c/d15/f63 x:0 0 0 2024-04-16T14:35:29.234 INFO:tasks.workunit.client.0.smithi005.stdout:5/146: dread d0/fe [0,4194304] 0 2024-04-16T14:35:29.235 INFO:tasks.workunit.client.0.smithi005.stdout:5/147: chown d0/d6/d12/d1c/f20 51 1 2024-04-16T14:35:29.235 INFO:tasks.workunit.client.0.smithi005.stdout:4/334: truncate d0/d1b/d1d/d1f/f20 1053952 0 2024-04-16T14:35:29.236 INFO:tasks.workunit.client.0.smithi005.stdout:3/121: mkdir d2/d9/d25 0 2024-04-16T14:35:29.236 INFO:tasks.workunit.client.0.smithi005.stdout:3/122: write d2/fa [4168947,12455] 0 2024-04-16T14:35:29.236 INFO:tasks.workunit.client.0.smithi005.stdout:3/123: write d2/d9/df/f1c [4292088,70664] 0 2024-04-16T14:35:29.237 INFO:tasks.workunit.client.0.smithi005.stdout:8/207: getdents d5/d11/d1f/d2f 0 2024-04-16T14:35:29.242 INFO:tasks.workunit.client.0.smithi005.stdout:1/273: mkdir d2/d1c/d15/d2a/d19/d42/d64 0 2024-04-16T14:35:29.243 INFO:tasks.workunit.client.0.smithi005.stdout:7/232: dread d1/dc/f18 [0,4194304] 0 2024-04-16T14:35:29.246 INFO:tasks.workunit.client.0.smithi005.stdout:3/124: rename d2/d9/l14 to d2/d9/df/l26 0 2024-04-16T14:35:29.246 INFO:tasks.workunit.client.0.smithi005.stdout:3/125: write d2/f20 [626174,101378] 0 2024-04-16T14:35:29.248 INFO:tasks.workunit.client.0.smithi005.stdout:8/208: link d5/de/f28 d5/d11/f47 0 2024-04-16T14:35:29.249 INFO:tasks.workunit.client.0.smithi005.stdout:7/233: dread d1/d5/d22/f28 [0,4194304] 0 2024-04-16T14:35:29.249 INFO:tasks.workunit.client.0.smithi005.stdout:7/234: dread - d1/d5/d22/d27/d3a/f43 zero size 2024-04-16T14:35:29.250 INFO:tasks.workunit.client.0.smithi005.stdout:1/274: mknod d2/d2c/c65 0 2024-04-16T14:35:29.251 INFO:tasks.workunit.client.0.smithi005.stdout:5/148: truncate d0/f28 1832101 0 2024-04-16T14:35:29.251 INFO:tasks.workunit.client.0.smithi005.stdout:5/149: creat d0/d6/d12/d1c/f2a x:0 0 0 2024-04-16T14:35:29.252 INFO:tasks.workunit.client.0.smithi005.stdout:3/126: truncate d2/d9/df/f11 2789897 0 2024-04-16T14:35:29.253 INFO:tasks.workunit.client.0.smithi005.stdout:4/335: dwrite d0/d1b/d1d/f21 [0,4194304] 0 2024-04-16T14:35:29.253 INFO:tasks.workunit.client.0.smithi005.stdout:4/336: fsync d0/f5 0 2024-04-16T14:35:29.254 INFO:tasks.workunit.client.0.smithi005.stdout:8/209: truncate d5/f23 693338 0 2024-04-16T14:35:29.255 INFO:tasks.workunit.client.0.smithi005.stdout:7/235: unlink d1/d5/d22/d27/d3a/f43 0 2024-04-16T14:35:29.257 INFO:tasks.workunit.client.0.smithi005.stdout:1/275: truncate d2/d1c/f58 3040023 0 2024-04-16T14:35:29.257 INFO:tasks.workunit.client.0.smithi005.stdout:1/276: fdatasync d2/f62 0 2024-04-16T14:35:29.257 INFO:tasks.workunit.client.0.smithi005.stdout:1/277: readlink d2/d1c/l5e 0 2024-04-16T14:35:29.260 INFO:tasks.workunit.client.0.smithi005.stdout:5/150: creat d0/d6/d12/d1c/d1e/f2b x:0 0 0 2024-04-16T14:35:29.261 INFO:tasks.workunit.client.0.smithi005.stdout:4/337: symlink d0/d1b/d1d/d4f/l60 0 2024-04-16T14:35:29.261 INFO:tasks.workunit.client.0.smithi005.stdout:4/338: fdatasync d0/d1b/d1d/f53 0 2024-04-16T14:35:29.261 INFO:tasks.workunit.client.0.smithi005.stdout:4/339: chown d0/d1b/d1d/d1f/f36 321 1 2024-04-16T14:35:29.261 INFO:tasks.workunit.client.0.smithi005.stdout:4/340: write d0/f9 [947338,4782] 0 2024-04-16T14:35:29.263 INFO:tasks.workunit.client.0.smithi005.stdout:8/210: rename d5/d11/d1f/l2b to d5/d11/l48 0 2024-04-16T14:35:29.265 INFO:tasks.workunit.client.0.smithi005.stdout:1/278: mkdir d2/d1c/d15/d2a/d19/d42/d64/d66 0 2024-04-16T14:35:29.267 INFO:tasks.workunit.client.0.smithi005.stdout:5/151: link d0/d6/d12/c19 d0/d6/d12/d16/c2c 0 2024-04-16T14:35:29.267 INFO:tasks.workunit.client.0.smithi005.stdout:7/236: write d1/dc/f1c [3789791,16885] 0 2024-04-16T14:35:29.267 INFO:tasks.workunit.client.0.smithi005.stdout:7/237: chown d1/d5/d22/d27 24 1 2024-04-16T14:35:29.268 INFO:tasks.workunit.client.0.smithi005.stdout:7/238: fdatasync d1/d5/d22/f42 0 2024-04-16T14:35:29.268 INFO:tasks.workunit.client.0.smithi005.stdout:7/239: chown d1/d5/f1a 3311 1 2024-04-16T14:35:29.268 INFO:tasks.workunit.client.0.smithi005.stdout:4/341: mkdir d0/d22/d61 0 2024-04-16T14:35:29.270 INFO:tasks.workunit.client.0.smithi005.stdout:8/211: symlink d5/d11/d1f/d2f/l49 0 2024-04-16T14:35:29.271 INFO:tasks.workunit.client.0.smithi005.stdout:1/279: symlink d2/d1c/l67 0 2024-04-16T14:35:29.271 INFO:tasks.workunit.client.0.smithi005.stdout:1/280: truncate d2/d1c/d15/d2a/d1a/f44 1798145 0 2024-04-16T14:35:29.272 INFO:tasks.workunit.client.0.smithi005.stdout:5/152: mkdir d0/d2d 0 2024-04-16T14:35:29.273 INFO:tasks.workunit.client.0.smithi005.stdout:5/153: dread d0/d6/d12/d1c/f22 [0,4194304] 0 2024-04-16T14:35:29.273 INFO:tasks.workunit.client.0.smithi005.stdout:5/154: write d0/f1b [997060,35996] 0 2024-04-16T14:35:29.273 INFO:tasks.workunit.client.0.smithi005.stdout:5/155: chown d0/f28 257188 1 2024-04-16T14:35:29.273 INFO:tasks.workunit.client.0.smithi005.stdout:5/156: write d0/f2 [28288,97991] 0 2024-04-16T14:35:29.274 INFO:tasks.workunit.client.0.smithi005.stdout:8/212: rename d5/f17 to d5/d11/f4a 0 2024-04-16T14:35:29.274 INFO:tasks.workunit.client.0.smithi005.stdout:8/213: dread d5/d11/d1f/d2f/f34 [0,4194304] 0 2024-04-16T14:35:29.274 INFO:tasks.workunit.client.0.smithi005.stdout:8/214: write d5/de/f3b [289829,68191] 0 2024-04-16T14:35:29.274 INFO:tasks.workunit.client.0.smithi005.stdout:1/281: creat d2/d1c/d15/d2a/d19/d42/d64/d66/f68 x:0 0 0 2024-04-16T14:35:29.275 INFO:tasks.workunit.client.0.smithi005.stdout:5/157: mknod d0/d6/d12/c2e 0 2024-04-16T14:35:29.275 INFO:tasks.workunit.client.0.smithi005.stdout:5/158: read - d0/d6/d12/d1c/f2a zero size 2024-04-16T14:35:29.275 INFO:tasks.workunit.client.0.smithi005.stdout:5/159: write d0/f2 [4863431,58837] 0 2024-04-16T14:35:29.276 INFO:tasks.workunit.client.0.smithi005.stdout:3/127: dwrite d2/f20 [0,4194304] 0 2024-04-16T14:35:29.277 INFO:tasks.workunit.client.0.smithi005.stdout:1/282: creat d2/d1c/d15/d2a/d19/d42/d64/f69 x:0 0 0 2024-04-16T14:35:29.279 INFO:tasks.workunit.client.0.smithi005.stdout:3/128: symlink d2/d9/d25/l27 0 2024-04-16T14:35:29.283 INFO:tasks.workunit.client.0.smithi005.stdout:4/342: dread d0/f7 [0,4194304] 0 2024-04-16T14:35:29.285 INFO:tasks.workunit.client.0.smithi005.stdout:3/129: creat d2/d9/f28 x:0 0 0 2024-04-16T14:35:29.285 INFO:tasks.workunit.client.0.smithi005.stdout:1/283: dread d2/d1c/d15/d2a/d19/d20/d27/f4c [0,4194304] 0 2024-04-16T14:35:29.286 INFO:tasks.workunit.client.0.smithi005.stdout:4/343: creat d0/d1b/f62 x:0 0 0 2024-04-16T14:35:29.286 INFO:tasks.workunit.client.0.smithi005.stdout:4/344: fsync d0/f7 0 2024-04-16T14:35:29.286 INFO:tasks.workunit.client.0.smithi005.stdout:4/345: truncate d0/d1b/d1d/f53 1030698 0 2024-04-16T14:35:29.287 INFO:tasks.workunit.client.0.smithi005.stdout:4/346: write d0/f13 [593997,97057] 0 2024-04-16T14:35:29.287 INFO:tasks.workunit.client.0.smithi005.stdout:4/347: truncate d0/d1b/d1d/d1f/d3e/f5e 571307 0 2024-04-16T14:35:29.287 INFO:tasks.workunit.client.0.smithi005.stdout:3/130: mkdir d2/d17/d1e/d29 0 2024-04-16T14:35:29.288 INFO:tasks.workunit.client.0.smithi005.stdout:8/215: fsync d5/d11/f47 0 2024-04-16T14:35:29.289 INFO:tasks.workunit.client.0.smithi005.stdout:1/284: creat d2/d1c/d15/d2a/d1a/d2e/d51/f6a x:0 0 0 2024-04-16T14:35:29.291 INFO:tasks.workunit.client.0.smithi005.stdout:4/348: rename d0/d1b/d2e to d0/d22/d29/d63 0 2024-04-16T14:35:29.293 INFO:tasks.workunit.client.0.smithi005.stdout:8/216: mkdir d5/d40/d4b 0 2024-04-16T14:35:29.293 INFO:tasks.workunit.client.0.smithi005.stdout:8/217: write f4 [3637319,48989] 0 2024-04-16T14:35:29.293 INFO:tasks.workunit.client.0.smithi005.stdout:8/218: chown d5/l7 147542966 1 2024-04-16T14:35:29.293 INFO:tasks.workunit.client.0.smithi005.stdout:4/349: dread d0/d1b/d1d/d1f/f20 [0,4194304] 0 2024-04-16T14:35:29.294 INFO:tasks.workunit.client.0.smithi005.stdout:1/285: truncate d2/d1c/ff 2377855 0 2024-04-16T14:35:29.296 INFO:tasks.workunit.client.0.smithi005.stdout:8/219: creat d5/d11/d1f/d2f/f4c x:0 0 0 2024-04-16T14:35:29.297 INFO:tasks.workunit.client.0.smithi005.stdout:4/350: truncate d0/f4c 4526076 0 2024-04-16T14:35:29.300 INFO:tasks.workunit.client.0.smithi005.stdout:1/286: creat d2/d1c/f6b x:0 0 0 2024-04-16T14:35:29.302 INFO:tasks.workunit.client.0.smithi005.stdout:8/220: unlink d5/de/f3b 0 2024-04-16T14:35:29.302 INFO:tasks.workunit.client.0.smithi005.stdout:8/221: chown d5/d11/d1f/d2f/f34 25 1 2024-04-16T14:35:29.304 INFO:tasks.workunit.client.0.smithi005.stdout:4/351: unlink d0/d22/d29/d63/c4a 0 2024-04-16T14:35:29.305 INFO:tasks.workunit.client.0.smithi005.stdout:4/352: chown d0/f5c 559 1 2024-04-16T14:35:29.305 INFO:tasks.workunit.client.0.smithi005.stdout:3/131: dwrite d2/d9/df/f1c [0,4194304] 0 2024-04-16T14:35:29.305 INFO:tasks.workunit.client.0.smithi005.stdout:8/222: mknod d5/d11/d1f/d2f/c4d 0 2024-04-16T14:35:29.309 INFO:tasks.workunit.client.0.smithi005.stdout:3/132: unlink d2/d9/df/c1f 0 2024-04-16T14:35:29.311 INFO:tasks.workunit.client.0.smithi005.stdout:3/133: symlink d2/d9/df/l2a 0 2024-04-16T14:35:29.311 INFO:tasks.workunit.client.0.smithi005.stdout:3/134: fsync d2/f20 0 2024-04-16T14:35:29.311 INFO:tasks.workunit.client.0.smithi005.stdout:3/135: creat d2/f2b x:0 0 0 2024-04-16T14:35:29.311 INFO:tasks.workunit.client.0.smithi005.stdout:3/136: fsync d2/d9/df/f11 0 2024-04-16T14:35:29.315 INFO:tasks.workunit.client.0.smithi005.stdout:4/353: write d0/f12 [3279849,3597] 0 2024-04-16T14:35:29.319 INFO:tasks.workunit.client.0.smithi005.stdout:5/160: getdents d0 0 2024-04-16T14:35:29.319 INFO:tasks.workunit.client.0.smithi005.stdout:5/161: stat d0/d6/d12/l1a 0 2024-04-16T14:35:29.319 INFO:tasks.workunit.client.0.smithi005.stdout:5/162: chown d0/c3 12 1 2024-04-16T14:35:29.319 INFO:tasks.workunit.client.0.smithi005.stdout:5/163: fsync d0/f8 0 2024-04-16T14:35:29.320 INFO:tasks.workunit.client.0.smithi005.stdout:4/354: symlink d0/d22/d61/l64 0 2024-04-16T14:35:29.321 INFO:tasks.workunit.client.0.smithi005.stdout:5/164: rmdir d0/d6 39 2024-04-16T14:35:29.335 INFO:tasks.workunit.client.0.smithi005.stdout:3/137: truncate d2/f20 1436233 0 2024-04-16T14:35:29.340 INFO:tasks.workunit.client.0.smithi005.stdout:5/165: dwrite d0/d6/d12/f29 [0,4194304] 0 2024-04-16T14:35:29.342 INFO:tasks.workunit.client.0.smithi005.stdout:5/166: symlink d0/d6/l2f 0 2024-04-16T14:35:29.342 INFO:tasks.workunit.client.0.smithi005.stdout:1/287: dread d2/d1c/ff [0,4194304] 0 2024-04-16T14:35:29.342 INFO:tasks.workunit.client.0.smithi005.stdout:1/288: dread - d2/d1c/d15/d2a/d25/f5c zero size 2024-04-16T14:35:29.342 INFO:tasks.workunit.client.0.smithi005.stdout:1/289: write d2/d1c/d15/d2a/d1a/d21/f30 [287222,18108] 0 2024-04-16T14:35:29.347 INFO:tasks.workunit.client.0.smithi005.stdout:1/290: truncate d2/d1c/d15/d2a/d1a/d21/f29 39715 0 2024-04-16T14:35:29.348 INFO:tasks.workunit.client.0.smithi005.stdout:3/138: rename d2/f20 to d2/f2c 0 2024-04-16T14:35:29.350 INFO:tasks.workunit.client.0.smithi005.stdout:5/167: rename d0/d2d to d0/d6/d12/d16/d30 0 2024-04-16T14:35:29.355 INFO:tasks.workunit.client.0.smithi005.stdout:3/139: dread d2/d9/df/f11 [0,4194304] 0 2024-04-16T14:35:29.355 INFO:tasks.workunit.client.0.smithi005.stdout:3/140: getdents d2/d17 0 2024-04-16T14:35:29.356 INFO:tasks.workunit.client.0.smithi005.stdout:3/141: rmdir d2/d17/d1e 39 2024-04-16T14:35:29.357 INFO:tasks.workunit.client.0.smithi005.stdout:3/142: mknod d2/d17/c2d 0 2024-04-16T14:35:29.358 INFO:tasks.workunit.client.0.smithi005.stdout:3/143: rename d2/l23 to d2/d9/df/l2e 0 2024-04-16T14:35:29.358 INFO:tasks.workunit.client.0.smithi005.stdout:3/144: dread - d2/d9/f28 zero size 2024-04-16T14:35:29.359 INFO:tasks.workunit.client.0.smithi005.stdout:3/145: creat d2/d9/df/f2f x:0 0 0 2024-04-16T14:35:29.361 INFO:tasks.workunit.client.0.smithi005.stdout:3/146: mkdir d2/d9/df/d30 0 2024-04-16T14:35:29.366 INFO:tasks.workunit.client.0.smithi005.stdout:1/291: dwrite d2/d1c/d15/d2a/d19/d20/d27/f34 [0,4194304] 0 2024-04-16T14:35:29.366 INFO:tasks.workunit.client.0.smithi005.stdout:1/292: chown d2/d1c/d15/d2a/d19/d42 21 1 2024-04-16T14:35:29.367 INFO:tasks.workunit.client.0.smithi005.stdout:1/293: dread d2/d1c/d15/d2a/d25/f36 [0,4194304] 0 2024-04-16T14:35:29.367 INFO:tasks.workunit.client.0.smithi005.stdout:1/294: rename d2/d2c to d2/d2c/d3e/d6c 22 2024-04-16T14:35:29.382 INFO:tasks.workunit.client.0.smithi005.stdout:1/295: dwrite d2/d1c/d15/d2a/d19/d20/d27/f4c [0,4194304] 0 2024-04-16T14:35:29.382 INFO:tasks.workunit.client.0.smithi005.stdout:1/296: symlink d2/d2c/d3e/l6d 0 2024-04-16T14:35:29.389 INFO:tasks.workunit.client.0.smithi005.stdout:1/297: dread d2/d1c/d15/f1d [0,4194304] 0 2024-04-16T14:35:29.398 INFO:tasks.workunit.client.0.smithi005.stdout:1/298: dread d2/d1c/d15/d2a/d19/d42/f56 [0,4194304] 0 2024-04-16T14:35:29.398 INFO:tasks.workunit.client.0.smithi005.stdout:1/299: mkdir d2/d1c/d15/d2a/d19/d6e 0 2024-04-16T14:35:29.414 INFO:tasks.workunit.client.0.smithi005.stdout:1/300: dwrite d2/d1c/d15/d2a/d19/d42/d64/d66/f68 [0,4194304] 0 2024-04-16T14:35:29.415 INFO:tasks.workunit.client.0.smithi005.stdout:1/301: chown d2/d1c/f3d 16 1 2024-04-16T14:35:29.415 INFO:tasks.workunit.client.0.smithi005.stdout:1/302: dread - d2/d1c/d15/d2a/d1a/d2e/d51/f6a zero size 2024-04-16T14:35:29.415 INFO:tasks.workunit.client.0.smithi005.stdout:1/303: stat d2/d1c/d15/d2a/d25/f48 0 2024-04-16T14:35:29.421 INFO:tasks.workunit.client.0.smithi005.stdout:9/79: sync 2024-04-16T14:35:29.421 INFO:tasks.workunit.client.0.smithi005.stdout:6/310: sync 2024-04-16T14:35:29.421 INFO:tasks.workunit.client.0.smithi005.stdout:9/80: stat d3/fd 0 2024-04-16T14:35:29.422 INFO:tasks.workunit.client.0.smithi005.stdout:6/311: rmdir d2/d5 39 2024-04-16T14:35:29.422 INFO:tasks.workunit.client.0.smithi005.stdout:6/312: readlink d2/d45/l4e 0 2024-04-16T14:35:29.422 INFO:tasks.workunit.client.0.smithi005.stdout:6/313: fdatasync d2/d5/d10/f5a 0 2024-04-16T14:35:29.422 INFO:tasks.workunit.client.0.smithi005.stdout:6/314: write d2/df/f32 [1303723,27174] 0 2024-04-16T14:35:29.422 INFO:tasks.workunit.client.0.smithi005.stdout:1/304: write d2/d1c/d15/d2a/d19/d42/d64/d66/f68 [421380,109647] 0 2024-04-16T14:35:29.425 INFO:tasks.workunit.client.0.smithi005.stdout:1/305: mkdir d2/d1c/d15/d6f 0 2024-04-16T14:35:29.425 INFO:tasks.workunit.client.0.smithi005.stdout:1/306: fsync d2/d1c/d15/d2a/d19/f40 0 2024-04-16T14:35:29.425 INFO:tasks.workunit.client.0.smithi005.stdout:1/307: stat d2/d1c 0 2024-04-16T14:35:29.430 INFO:tasks.workunit.client.0.smithi005.stdout:6/315: dread d2/d5/f37 [0,4194304] 0 2024-04-16T14:35:29.441 INFO:tasks.workunit.client.0.smithi005.stdout:6/316: write d2/d3f/f4f [3769248,118569] 0 2024-04-16T14:35:29.442 INFO:tasks.workunit.client.0.smithi005.stdout:6/317: symlink d2/d5/d10/d4d/l66 0 2024-04-16T14:35:29.442 INFO:tasks.workunit.client.0.smithi005.stdout:6/318: rmdir d2/df 39 2024-04-16T14:35:29.443 INFO:tasks.workunit.client.0.smithi005.stdout:9/81: dwrite d3/f10 [0,4194304] 0 2024-04-16T14:35:29.443 INFO:tasks.workunit.client.0.smithi005.stdout:6/319: creat d2/d5/d28/f67 x:0 0 0 2024-04-16T14:35:29.444 INFO:tasks.workunit.client.0.smithi005.stdout:1/308: dwrite d2/f55 [0,4194304] 0 2024-04-16T14:35:29.445 INFO:tasks.workunit.client.0.smithi005.stdout:9/82: symlink d3/d12/l15 0 2024-04-16T14:35:29.445 INFO:tasks.workunit.client.0.smithi005.stdout:9/83: truncate d3/f14 382653 0 2024-04-16T14:35:29.445 INFO:tasks.workunit.client.0.smithi005.stdout:9/84: chown d3/d12/l13 24456590 1 2024-04-16T14:35:29.445 INFO:tasks.workunit.client.0.smithi005.stdout:9/85: chown d3/f14 23964919 1 2024-04-16T14:35:29.445 INFO:tasks.workunit.client.0.smithi005.stdout:6/320: mkdir d2/d5/d10/d68 0 2024-04-16T14:35:29.447 INFO:tasks.workunit.client.0.smithi005.stdout:1/309: mknod d2/d1c/d15/d2a/d19/d42/c70 0 2024-04-16T14:35:29.448 INFO:tasks.workunit.client.0.smithi005.stdout:9/86: mkdir d3/d12/d16 0 2024-04-16T14:35:29.449 INFO:tasks.workunit.client.0.smithi005.stdout:6/321: symlink d2/d3f/d53/d54/l69 0 2024-04-16T14:35:29.450 INFO:tasks.workunit.client.0.smithi005.stdout:1/310: mkdir d2/d1c/d15/d2a/d19/d42/d71 0 2024-04-16T14:35:29.451 INFO:tasks.workunit.client.0.smithi005.stdout:9/87: symlink d3/d12/d16/l17 0 2024-04-16T14:35:29.452 INFO:tasks.workunit.client.0.smithi005.stdout:6/322: creat d2/d5/f6a x:0 0 0 2024-04-16T14:35:29.455 INFO:tasks.workunit.client.0.smithi005.stdout:1/311: link d2/d1c/fe d2/d2c/d3e/f72 0 2024-04-16T14:35:29.456 INFO:tasks.workunit.client.0.smithi005.stdout:9/88: symlink d3/l18 0 2024-04-16T14:35:29.458 INFO:tasks.workunit.client.0.smithi005.stdout:1/312: mkdir d2/d1c/d15/d2a/d19/d20/d27/d73 0 2024-04-16T14:35:29.458 INFO:tasks.workunit.client.0.smithi005.stdout:1/313: chown d2/d1c/d15/d2a/d19 7749587 1 2024-04-16T14:35:29.459 INFO:tasks.workunit.client.0.smithi005.stdout:9/89: creat d3/d12/d16/f19 x:0 0 0 2024-04-16T14:35:29.460 INFO:tasks.workunit.client.0.smithi005.stdout:9/90: creat d3/d12/d16/f1a x:0 0 0 2024-04-16T14:35:29.460 INFO:tasks.workunit.client.0.smithi005.stdout:9/91: creat d3/d12/d16/f1b x:0 0 0 2024-04-16T14:35:29.466 INFO:tasks.workunit.client.0.smithi005.stdout:9/92: write d3/f8 [1729038,70947] 0 2024-04-16T14:35:29.467 INFO:tasks.workunit.client.0.smithi005.stdout:9/93: write d3/d12/d16/f1a [612440,97501] 0 2024-04-16T14:35:29.468 INFO:tasks.workunit.client.0.smithi005.stdout:9/94: mknod d3/c1c 0 2024-04-16T14:35:29.469 INFO:tasks.workunit.client.0.smithi005.stdout:9/95: creat d3/d12/d16/f1d x:0 0 0 2024-04-16T14:35:29.475 INFO:tasks.workunit.client.0.smithi005.stdout:9/96: dread d3/f7 [0,4194304] 0 2024-04-16T14:35:29.476 INFO:tasks.workunit.client.0.smithi005.stdout:1/314: dwrite d2/d1c/d15/d2a/f16 [0,4194304] 0 2024-04-16T14:35:29.476 INFO:tasks.workunit.client.0.smithi005.stdout:1/315: truncate d2/d1c/d15/d2a/d1a/d21/f61 375293 0 2024-04-16T14:35:29.476 INFO:tasks.workunit.client.0.smithi005.stdout:1/316: write d2/d1c/d15/d2a/d1a/d21/f30 [1027648,17882] 0 2024-04-16T14:35:29.478 INFO:tasks.workunit.client.0.smithi005.stdout:1/317: mkdir d2/d74 0 2024-04-16T14:35:29.483 INFO:tasks.workunit.client.0.smithi005.stdout:9/97: dread d3/d12/d16/f1a [0,4194304] 0 2024-04-16T14:35:29.486 INFO:tasks.workunit.client.0.smithi005.stdout:1/318: getdents d2/d2c/d3e 0 2024-04-16T14:35:29.488 INFO:tasks.workunit.client.0.smithi005.stdout:1/319: dread d2/f3f [0,4194304] 0 2024-04-16T14:35:29.488 INFO:tasks.workunit.client.0.smithi005.stdout:1/320: chown d2/d1c 13574154 1 2024-04-16T14:35:29.488 INFO:tasks.workunit.client.0.smithi005.stdout:1/321: fdatasync d2/d1c/d15/d2a/d1a/d21/f29 0 2024-04-16T14:35:29.489 INFO:tasks.workunit.client.0.smithi005.stdout:1/322: creat d2/d1c/d15/d2a/d19/d42/d71/f75 x:0 0 0 2024-04-16T14:35:29.491 INFO:tasks.workunit.client.0.smithi005.stdout:9/98: truncate d3/d12/d16/f1a 355649 0 2024-04-16T14:35:29.492 INFO:tasks.workunit.client.0.smithi005.stdout:9/99: write d3/fd [810761,48657] 0 2024-04-16T14:35:29.492 INFO:tasks.workunit.client.0.smithi005.stdout:9/100: chown d3/d12/l13 21298 1 2024-04-16T14:35:29.492 INFO:tasks.workunit.client.0.smithi005.stdout:9/101: chown d3/la 39 1 2024-04-16T14:35:29.492 INFO:tasks.workunit.client.0.smithi005.stdout:9/102: dread - d3/d12/d16/f19 zero size 2024-04-16T14:35:29.492 INFO:tasks.workunit.client.0.smithi005.stdout:9/103: dread - d3/d12/d16/f19 zero size 2024-04-16T14:35:29.492 INFO:tasks.workunit.client.0.smithi005.stdout:9/104: truncate d3/d12/d16/f1d 903781 0 2024-04-16T14:35:29.492 INFO:tasks.workunit.client.0.smithi005.stdout:9/105: stat d3 0 2024-04-16T14:35:29.495 INFO:tasks.workunit.client.0.smithi005.stdout:9/106: unlink l1 0 2024-04-16T14:35:29.495 INFO:tasks.workunit.client.0.smithi005.stdout:9/107: dread - d3/d12/d16/f19 zero size 2024-04-16T14:35:29.501 INFO:tasks.workunit.client.0.smithi005.stdout:1/323: dwrite d2/d1c/d15/d2a/d19/d20/d27/f4c [4194304,4194304] 0 2024-04-16T14:35:29.501 INFO:tasks.workunit.client.0.smithi005.stdout:1/324: write d2/d1c/f6b [1024659,3673] 0 2024-04-16T14:35:29.503 INFO:tasks.workunit.client.0.smithi005.stdout:1/325: rename d2/d2c/d3e to d2/d1c/d15/d2a/d19/d42/d64/d76 0 2024-04-16T14:35:29.503 INFO:tasks.workunit.client.0.smithi005.stdout:1/326: stat d2/d1c/d15/d2a/d19/c31 0 2024-04-16T14:35:29.503 INFO:tasks.workunit.client.0.smithi005.stdout:1/327: creat d2/d1c/d15/d2a/d1a/f77 x:0 0 0 2024-04-16T14:35:29.504 INFO:tasks.workunit.client.0.smithi005.stdout:1/328: stat d2/d1c/d15/d2a/d1a/f77 0 2024-04-16T14:35:29.505 INFO:tasks.workunit.client.0.smithi005.stdout:1/329: unlink d2/d1c/d15/l5d 0 2024-04-16T14:35:29.511 INFO:tasks.workunit.client.0.smithi005.stdout:1/330: link d2/d1c/d15/d2a/d1a/c59 d2/d1c/d15/d2a/d19/d42/d64/d76/c78 0 2024-04-16T14:35:29.511 INFO:tasks.workunit.client.0.smithi005.stdout:9/108: dwrite d3/d12/d16/f1d [0,4194304] 0 2024-04-16T14:35:29.511 INFO:tasks.workunit.client.0.smithi005.stdout:1/331: truncate d2/d2c/f4f 3134958 0 2024-04-16T14:35:29.512 INFO:tasks.workunit.client.0.smithi005.stdout:1/332: creat d2/d1c/d15/d2a/d19/d20/d27/f79 x:0 0 0 2024-04-16T14:35:29.512 INFO:tasks.workunit.client.0.smithi005.stdout:1/333: dread d2/d1c/d15/d2a/d1a/d21/f61 [0,4194304] 0 2024-04-16T14:35:29.514 INFO:tasks.workunit.client.0.smithi005.stdout:9/109: getdents d3 0 2024-04-16T14:35:29.516 INFO:tasks.workunit.client.0.smithi005.stdout:9/110: mkdir d3/d12/d1e 0 2024-04-16T14:35:29.516 INFO:tasks.workunit.client.0.smithi005.stdout:9/111: fsync d3/d12/d16/f1b 0 2024-04-16T14:35:29.516 INFO:tasks.workunit.client.0.smithi005.stdout:9/112: write d3/f14 [451718,58432] 0 2024-04-16T14:35:29.517 INFO:tasks.workunit.client.0.smithi005.stdout:9/113: creat d3/d12/f1f x:0 0 0 2024-04-16T14:35:29.517 INFO:tasks.workunit.client.0.smithi005.stdout:9/114: write d3/f14 [1287262,38561] 0 2024-04-16T14:35:29.518 INFO:tasks.workunit.client.0.smithi005.stdout:9/115: symlink d3/d12/d16/l20 0 2024-04-16T14:35:29.519 INFO:tasks.workunit.client.0.smithi005.stdout:9/116: write d3/f14 [1055912,105949] 0 2024-04-16T14:35:29.519 INFO:tasks.workunit.client.0.smithi005.stdout:9/117: dread - d3/d12/d16/f1b zero size 2024-04-16T14:35:29.520 INFO:tasks.workunit.client.0.smithi005.stdout:9/118: symlink d3/d12/d16/l21 0 2024-04-16T14:35:29.520 INFO:tasks.workunit.client.0.smithi005.stdout:1/334: getdents d2/d1c/d15/d2a/d19/d20/d27 0 2024-04-16T14:35:29.522 INFO:tasks.workunit.client.0.smithi005.stdout:1/335: mkdir d2/d74/d7a 0 2024-04-16T14:35:29.523 INFO:tasks.workunit.client.0.smithi005.stdout:1/336: getdents d2 0 2024-04-16T14:35:29.525 INFO:tasks.workunit.client.0.smithi005.stdout:1/337: mkdir d2/d1c/d15/d2a/d19/d6e/d7b 0 2024-04-16T14:35:29.526 INFO:tasks.workunit.client.0.smithi005.stdout:1/338: mknod d2/d1c/d15/d2a/d19/d6e/d7b/c7c 0 2024-04-16T14:35:29.528 INFO:tasks.workunit.client.0.smithi005.stdout:9/119: dread d3/f10 [0,4194304] 0 2024-04-16T14:35:29.528 INFO:tasks.workunit.client.0.smithi005.stdout:9/120: dread - d3/d12/d16/f19 zero size 2024-04-16T14:35:29.529 INFO:tasks.workunit.client.0.smithi005.stdout:9/121: unlink d3/d12/d16/l21 0 2024-04-16T14:35:29.534 INFO:tasks.workunit.client.0.smithi005.stdout:9/122: dread d3/f14 [0,4194304] 0 2024-04-16T14:35:29.535 INFO:tasks.workunit.client.0.smithi005.stdout:9/123: dread d3/d12/d16/f1a [0,4194304] 0 2024-04-16T14:35:29.536 INFO:tasks.workunit.client.0.smithi005.stdout:9/124: truncate d3/f7 3640559 0 2024-04-16T14:35:29.538 INFO:tasks.workunit.client.0.smithi005.stdout:9/125: rmdir d3/d12/d1e 0 2024-04-16T14:35:29.539 INFO:tasks.workunit.client.0.smithi005.stdout:1/339: dwrite d2/d1c/d15/d2a/d25/f5c [0,4194304] 0 2024-04-16T14:35:29.539 INFO:tasks.workunit.client.0.smithi005.stdout:1/340: fsync d2/d1c/f17 0 2024-04-16T14:35:29.539 INFO:tasks.workunit.client.0.smithi005.stdout:1/341: chown d2/f55 3 1 2024-04-16T14:35:29.539 INFO:tasks.workunit.client.0.smithi005.stdout:1/342: chown d2/d2c/c65 1660244 1 2024-04-16T14:35:29.539 INFO:tasks.workunit.client.0.smithi005.stdout:1/343: readlink d2/d2c/l22 0 2024-04-16T14:35:29.539 INFO:tasks.workunit.client.0.smithi005.stdout:9/126: truncate d3/fd 144213 0 2024-04-16T14:35:29.540 INFO:tasks.workunit.client.0.smithi005.stdout:9/127: readlink d3/d12/l15 0 2024-04-16T14:35:29.543 INFO:tasks.workunit.client.0.smithi005.stdout:9/128: mknod d3/c22 0 2024-04-16T14:35:29.543 INFO:tasks.workunit.client.0.smithi005.stdout:9/129: creat d3/d12/f23 x:0 0 0 2024-04-16T14:35:29.543 INFO:tasks.workunit.client.0.smithi005.stdout:9/130: truncate d3/d12/d16/f1b 509812 0 2024-04-16T14:35:29.545 INFO:tasks.workunit.client.0.smithi005.stdout:9/131: mkdir d3/d12/d16/d24 0 2024-04-16T14:35:29.547 INFO:tasks.workunit.client.0.smithi005.stdout:9/132: rename d3/fd to d3/f25 0 2024-04-16T14:35:29.547 INFO:tasks.workunit.client.0.smithi005.stdout:9/133: dread - d3/d12/f1f zero size 2024-04-16T14:35:29.552 INFO:tasks.workunit.client.0.smithi005.stdout:2/93: sync 2024-04-16T14:35:29.552 INFO:tasks.workunit.client.0.smithi005.stdout:2/94: truncate d0/d4/d7/f17 597580 0 2024-04-16T14:35:29.553 INFO:tasks.workunit.client.0.smithi005.stdout:2/95: rmdir d0/d4 39 2024-04-16T14:35:29.554 INFO:tasks.workunit.client.0.smithi005.stdout:9/134: write d3/d12/d16/f1d [3754449,100961] 0 2024-04-16T14:35:29.555 INFO:tasks.workunit.client.0.smithi005.stdout:9/135: fdatasync d3/d12/d16/f1d 0 2024-04-16T14:35:29.571 INFO:tasks.workunit.client.0.smithi005.stdout:9/136: dwrite d3/ff [4194304,4194304] 0 2024-04-16T14:35:29.571 INFO:tasks.workunit.client.0.smithi005.stdout:9/137: creat d3/d12/f26 x:0 0 0 2024-04-16T14:35:29.572 INFO:tasks.workunit.client.0.smithi005.stdout:9/138: symlink d3/d12/d16/l27 0 2024-04-16T14:35:29.683 INFO:tasks.workunit.client.0.smithi005.stdout:5/168: sync 2024-04-16T14:35:29.684 INFO:tasks.workunit.client.0.smithi005.stdout:3/147: sync 2024-04-16T14:35:29.684 INFO:tasks.workunit.client.0.smithi005.stdout:5/169: truncate d0/d6/d12/d1c/f1f 309475 0 2024-04-16T14:35:29.684 INFO:tasks.workunit.client.0.smithi005.stdout:0/231: sync 2024-04-16T14:35:29.684 INFO:tasks.workunit.client.0.smithi005.stdout:8/223: sync 2024-04-16T14:35:29.684 INFO:tasks.workunit.client.0.smithi005.stdout:6/323: sync 2024-04-16T14:35:29.684 INFO:tasks.workunit.client.0.smithi005.stdout:4/355: sync 2024-04-16T14:35:29.684 INFO:tasks.workunit.client.0.smithi005.stdout:7/240: sync 2024-04-16T14:35:29.684 INFO:tasks.workunit.client.0.smithi005.stdout:0/232: write da/fc [4734275,55382] 0 2024-04-16T14:35:29.685 INFO:tasks.workunit.client.0.smithi005.stdout:3/148: mknod d2/d9/d25/c31 0 2024-04-16T14:35:29.685 INFO:tasks.workunit.client.0.smithi005.stdout:3/149: chown d2/d9/c1d 1824 1 2024-04-16T14:35:29.686 INFO:tasks.workunit.client.0.smithi005.stdout:8/224: creat d5/d11/d1f/f4e x:0 0 0 2024-04-16T14:35:29.687 INFO:tasks.workunit.client.0.smithi005.stdout:4/356: truncate d0/d22/d29/d63/f3b 439908 0 2024-04-16T14:35:29.689 INFO:tasks.workunit.client.0.smithi005.stdout:6/324: dread d2/d3f/f4f [0,4194304] 0 2024-04-16T14:35:29.689 INFO:tasks.workunit.client.0.smithi005.stdout:6/325: getdents d2/d20/d33/d64 0 2024-04-16T14:35:29.689 INFO:tasks.workunit.client.0.smithi005.stdout:7/241: rename d1/dc/d2f/f3c to d1/d5/d22/d27/f44 0 2024-04-16T14:35:29.689 INFO:tasks.workunit.client.0.smithi005.stdout:4/357: dread d0/d1b/d1d/f53 [0,4194304] 0 2024-04-16T14:35:29.690 INFO:tasks.workunit.client.0.smithi005.stdout:5/170: truncate d0/f2 1103221 0 2024-04-16T14:35:29.691 INFO:tasks.workunit.client.0.smithi005.stdout:3/150: creat d2/d9/d25/f32 x:0 0 0 2024-04-16T14:35:29.693 INFO:tasks.workunit.client.0.smithi005.stdout:7/242: dread d1/f29 [0,4194304] 0 2024-04-16T14:35:29.693 INFO:tasks.workunit.client.0.smithi005.stdout:5/171: creat d0/d6/f31 x:0 0 0 2024-04-16T14:35:29.695 INFO:tasks.workunit.client.0.smithi005.stdout:8/225: getdents d5/d40 0 2024-04-16T14:35:29.697 INFO:tasks.workunit.client.0.smithi005.stdout:7/243: creat d1/d5/d22/d27/f45 x:0 0 0 2024-04-16T14:35:29.699 INFO:tasks.workunit.client.0.smithi005.stdout:5/172: creat d0/f32 x:0 0 0 2024-04-16T14:35:29.699 INFO:tasks.workunit.client.0.smithi005.stdout:5/173: dread - d0/f32 zero size 2024-04-16T14:35:29.701 INFO:tasks.workunit.client.0.smithi005.stdout:3/151: rmdir d2/d17/d1e/d29 0 2024-04-16T14:35:29.704 INFO:tasks.workunit.client.0.smithi005.stdout:8/226: unlink d5/d11/d1f/d2f/c4d 0 2024-04-16T14:35:29.706 INFO:tasks.workunit.client.0.smithi005.stdout:5/174: write d0/fe [1793758,3037] 0 2024-04-16T14:35:29.706 INFO:tasks.workunit.client.0.smithi005.stdout:5/175: fsync d0/d6/d12/f14 0 2024-04-16T14:35:29.706 INFO:tasks.workunit.client.0.smithi005.stdout:0/233: dwrite da/df/f1d [0,4194304] 0 2024-04-16T14:35:29.706 INFO:tasks.workunit.client.0.smithi005.stdout:0/234: readlink da/l10 0 2024-04-16T14:35:29.707 INFO:tasks.workunit.client.0.smithi005.stdout:3/152: mknod d2/d17/d1e/c33 0 2024-04-16T14:35:29.710 INFO:tasks.workunit.client.0.smithi005.stdout:8/227: rename d5/d40/f46 to d5/d11/d1f/f4f 0 2024-04-16T14:35:29.710 INFO:tasks.workunit.client.0.smithi005.stdout:8/228: dread d5/de/f28 [0,4194304] 0 2024-04-16T14:35:29.711 INFO:tasks.workunit.client.0.smithi005.stdout:6/326: dwrite d2/d20/d3c/f59 [0,4194304] 0 2024-04-16T14:35:29.712 INFO:tasks.workunit.client.0.smithi005.stdout:5/176: symlink d0/d6/d12/d16/l33 0 2024-04-16T14:35:29.712 INFO:tasks.workunit.client.0.smithi005.stdout:0/235: chown da/df/d26/l3c 8 1 2024-04-16T14:35:29.714 INFO:tasks.workunit.client.0.smithi005.stdout:3/153: symlink d2/d9/d25/l34 0 2024-04-16T14:35:29.718 INFO:tasks.workunit.client.0.smithi005.stdout:7/244: dwrite d1/d5/d22/d27/f45 [0,4194304] 0 2024-04-16T14:35:29.718 INFO:tasks.workunit.client.0.smithi005.stdout:7/245: creat d1/d5/d22/d27/f46 x:0 0 0 2024-04-16T14:35:29.718 INFO:tasks.workunit.client.0.smithi005.stdout:6/327: rename d2/d5/d10/d4d/l66 to d2/d45/l6b 0 2024-04-16T14:35:29.723 INFO:tasks.workunit.client.0.smithi005.stdout:3/154: unlink d2/fa 0 2024-04-16T14:35:29.723 INFO:tasks.workunit.client.0.smithi005.stdout:0/236: write da/df/d1b/f22 [2920542,39236] 0 2024-04-16T14:35:29.723 INFO:tasks.workunit.client.0.smithi005.stdout:8/229: getdents d5/de 0 2024-04-16T14:35:29.723 INFO:tasks.workunit.client.0.smithi005.stdout:8/230: creat d5/f50 x:0 0 0 2024-04-16T14:35:29.727 INFO:tasks.workunit.client.0.smithi005.stdout:5/177: rename d0/d6/d12/d16 to d0/d6/d12/d34 0 2024-04-16T14:35:29.729 INFO:tasks.workunit.client.0.smithi005.stdout:7/246: truncate d1/d5/f11 2893183 0 2024-04-16T14:35:29.730 INFO:tasks.workunit.client.0.smithi005.stdout:6/328: creat d2/d5/d28/f6c x:0 0 0 2024-04-16T14:35:29.733 INFO:tasks.workunit.client.0.smithi005.stdout:3/155: rename d2/d9/f28 to d2/d9/f35 0 2024-04-16T14:35:29.733 INFO:tasks.workunit.client.0.smithi005.stdout:3/156: chown d2/d9/df/f11 1 1 2024-04-16T14:35:29.733 INFO:tasks.workunit.client.0.smithi005.stdout:3/157: read - d2/f2b zero size 2024-04-16T14:35:29.733 INFO:tasks.workunit.client.0.smithi005.stdout:3/158: chown d2/d9 88269 1 2024-04-16T14:35:29.737 INFO:tasks.workunit.client.0.smithi005.stdout:8/231: creat d5/de/f51 x:0 0 0 2024-04-16T14:35:29.737 INFO:tasks.workunit.client.0.smithi005.stdout:8/232: write d5/d11/d1f/f4e [814384,31171] 0 2024-04-16T14:35:29.737 INFO:tasks.workunit.client.0.smithi005.stdout:8/233: creat d5/d11/d1f/d2f/d3d/f52 x:0 0 0 2024-04-16T14:35:29.738 INFO:tasks.workunit.client.0.smithi005.stdout:5/178: symlink d0/d6/d12/d1c/l35 0 2024-04-16T14:35:29.738 INFO:tasks.workunit.client.0.smithi005.stdout:5/179: dread - d0/d6/d12/d1c/d1e/f2b zero size 2024-04-16T14:35:29.739 INFO:tasks.workunit.client.0.smithi005.stdout:6/329: rename d2/f2e to d2/d5/d10/d4d/f6d 0 2024-04-16T14:35:29.741 INFO:tasks.workunit.client.0.smithi005.stdout:8/234: mknod d5/d11/d1f/c53 0 2024-04-16T14:35:29.741 INFO:tasks.workunit.client.0.smithi005.stdout:8/235: write d5/f23 [1368117,87442] 0 2024-04-16T14:35:29.741 INFO:tasks.workunit.client.0.smithi005.stdout:8/236: fdatasync d5/d11/d1f/f33 0 2024-04-16T14:35:29.741 INFO:tasks.workunit.client.0.smithi005.stdout:5/180: fsync d0/f1b 0 2024-04-16T14:35:29.743 INFO:tasks.workunit.client.0.smithi005.stdout:0/237: dwrite da/f1a [0,4194304] 0 2024-04-16T14:35:29.743 INFO:tasks.workunit.client.0.smithi005.stdout:0/238: fsync da/df/f15 0 2024-04-16T14:35:29.744 INFO:tasks.workunit.client.0.smithi005.stdout:6/330: mkdir d2/d5/d10/d4d/d51/d6e 0 2024-04-16T14:35:29.746 INFO:tasks.workunit.client.0.smithi005.stdout:7/247: dwrite d1/d5/d22/d27/f46 [0,4194304] 0 2024-04-16T14:35:29.746 INFO:tasks.workunit.client.0.smithi005.stdout:3/159: read d2/d9/df/f1c [3588618,88791] 0 2024-04-16T14:35:29.748 INFO:tasks.workunit.client.0.smithi005.stdout:8/237: mknod d5/d11/c54 0 2024-04-16T14:35:29.751 INFO:tasks.workunit.client.0.smithi005.stdout:0/239: symlink da/df/l4b 0 2024-04-16T14:35:29.753 INFO:tasks.workunit.client.0.smithi005.stdout:3/160: creat d2/d17/d1e/f36 x:0 0 0 2024-04-16T14:35:29.754 INFO:tasks.workunit.client.0.smithi005.stdout:6/331: write d2/d3f/d47/f52 [1074026,36082] 0 2024-04-16T14:35:29.755 INFO:tasks.workunit.client.0.smithi005.stdout:8/238: unlink d5/d11/d1f/f4f 0 2024-04-16T14:35:29.755 INFO:tasks.workunit.client.0.smithi005.stdout:8/239: chown d5/d11/f44 1 1 2024-04-16T14:35:29.755 INFO:tasks.workunit.client.0.smithi005.stdout:8/240: chown d5/d11/c1b 618028 1 2024-04-16T14:35:29.756 INFO:tasks.workunit.client.0.smithi005.stdout:3/161: symlink d2/d9/df/l37 0 2024-04-16T14:35:29.757 INFO:tasks.workunit.client.0.smithi005.stdout:3/162: write d2/f2b [74898,39746] 0 2024-04-16T14:35:29.759 INFO:tasks.workunit.client.0.smithi005.stdout:6/332: creat d2/df/f6f x:0 0 0 2024-04-16T14:35:29.759 INFO:tasks.workunit.client.0.smithi005.stdout:6/333: creat d2/d5/d10/d4d/d51/f70 x:0 0 0 2024-04-16T14:35:29.762 INFO:tasks.workunit.client.0.smithi005.stdout:0/240: rename da/df/f36 to da/df/d26/f4c 0 2024-04-16T14:35:29.762 INFO:tasks.workunit.client.0.smithi005.stdout:0/241: stat f8 0 2024-04-16T14:35:29.768 INFO:tasks.workunit.client.0.smithi005.stdout:0/242: rename da/df/d1b/d24/f35 to da/df/d1b/d3a/f4d 0 2024-04-16T14:35:29.769 INFO:tasks.workunit.client.0.smithi005.stdout:0/243: write da/df/d1b/d24/f28 [773559,40043] 0 2024-04-16T14:35:29.769 INFO:tasks.workunit.client.0.smithi005.stdout:0/244: chown f0 1519 1 2024-04-16T14:35:29.769 INFO:tasks.workunit.client.0.smithi005.stdout:0/245: creat da/f4e x:0 0 0 2024-04-16T14:35:29.770 INFO:tasks.workunit.client.0.smithi005.stdout:0/246: truncate f0 638982 0 2024-04-16T14:35:29.775 INFO:tasks.workunit.client.0.smithi005.stdout:6/334: dread d2/d5/d28/f21 [0,4194304] 0 2024-04-16T14:35:29.775 INFO:tasks.workunit.client.0.smithi005.stdout:6/335: chown d2/d20/d3c/l43 3697 1 2024-04-16T14:35:29.775 INFO:tasks.workunit.client.0.smithi005.stdout:6/336: truncate d2/d5/d10/f2b 2338147 0 2024-04-16T14:35:29.775 INFO:tasks.workunit.client.0.smithi005.stdout:0/247: dread da/df/d1b/f31 [0,4194304] 0 2024-04-16T14:35:29.775 INFO:tasks.workunit.client.0.smithi005.stdout:0/248: chown da/c3f 51009168 1 2024-04-16T14:35:29.775 INFO:tasks.workunit.client.0.smithi005.stdout:0/249: fdatasync da/fc 0 2024-04-16T14:35:29.775 INFO:tasks.workunit.client.0.smithi005.stdout:5/181: dwrite d0/d6/d12/d1c/f22 [0,4194304] 0 2024-04-16T14:35:29.776 INFO:tasks.workunit.client.0.smithi005.stdout:8/241: dread d5/d11/f20 [0,4194304] 0 2024-04-16T14:35:29.776 INFO:tasks.workunit.client.0.smithi005.stdout:7/248: dwrite d1/d5/d22/d27/f44 [0,4194304] 0 2024-04-16T14:35:29.781 INFO:tasks.workunit.client.0.smithi005.stdout:0/250: dread da/df/d1b/f25 [0,4194304] 0 2024-04-16T14:35:29.782 INFO:tasks.workunit.client.0.smithi005.stdout:0/251: write da/df/d26/f4a [458302,79240] 0 2024-04-16T14:35:29.782 INFO:tasks.workunit.client.0.smithi005.stdout:5/182: dread d0/f11 [0,4194304] 0 2024-04-16T14:35:29.782 INFO:tasks.workunit.client.0.smithi005.stdout:5/183: truncate d0/f32 383198 0 2024-04-16T14:35:29.784 INFO:tasks.workunit.client.0.smithi005.stdout:8/242: mkdir d5/d55 0 2024-04-16T14:35:29.785 INFO:tasks.workunit.client.0.smithi005.stdout:6/337: write d2/d5/f2f [281513,109995] 0 2024-04-16T14:35:29.786 INFO:tasks.workunit.client.0.smithi005.stdout:6/338: write d2/d5/d10/f60 [498532,72722] 0 2024-04-16T14:35:29.786 INFO:tasks.workunit.client.0.smithi005.stdout:7/249: mkdir d1/d5/d16/d47 0 2024-04-16T14:35:29.791 INFO:tasks.workunit.client.0.smithi005.stdout:0/252: write da/df/d1b/f25 [4461591,33808] 0 2024-04-16T14:35:29.791 INFO:tasks.workunit.client.0.smithi005.stdout:0/253: chown da/fc 67 1 2024-04-16T14:35:29.792 INFO:tasks.workunit.client.0.smithi005.stdout:6/339: creat d2/d3f/f71 x:0 0 0 2024-04-16T14:35:29.795 INFO:tasks.workunit.client.0.smithi005.stdout:7/250: write d1/d5/d22/f30 [104516,44371] 0 2024-04-16T14:35:29.795 INFO:tasks.workunit.client.0.smithi005.stdout:7/251: dread - d1/d5/d16/f3b zero size 2024-04-16T14:35:29.796 INFO:tasks.workunit.client.0.smithi005.stdout:7/252: write d1/f29 [1373038,41398] 0 2024-04-16T14:35:29.797 INFO:tasks.workunit.client.0.smithi005.stdout:0/254: creat da/df/d26/d39/d43/f4f x:0 0 0 2024-04-16T14:35:29.797 INFO:tasks.workunit.client.0.smithi005.stdout:7/253: chown d1/dc/c1f 85 1 2024-04-16T14:35:29.799 INFO:tasks.workunit.client.0.smithi005.stdout:6/340: mkdir d2/d20/d72 0 2024-04-16T14:35:29.799 INFO:tasks.workunit.client.0.smithi005.stdout:6/341: write d2/d5/d10/f13 [2029781,67967] 0 2024-04-16T14:35:29.799 INFO:tasks.workunit.client.0.smithi005.stdout:6/342: stat d2/d3f/f4f 0 2024-04-16T14:35:29.801 INFO:tasks.workunit.client.0.smithi005.stdout:0/255: truncate da/df/d26/f45 1341594 0 2024-04-16T14:35:29.802 INFO:tasks.workunit.client.0.smithi005.stdout:5/184: dwrite d0/f1b [0,4194304] 0 2024-04-16T14:35:29.803 INFO:tasks.workunit.client.0.smithi005.stdout:8/243: dwrite d5/de/f36 [0,4194304] 0 2024-04-16T14:35:29.803 INFO:tasks.workunit.client.0.smithi005.stdout:7/254: link d1/d5/d22/f28 d1/d5/d22/d27/d2e/f48 0 2024-04-16T14:35:29.804 INFO:tasks.workunit.client.0.smithi005.stdout:6/343: creat d2/d5/d10/d68/f73 x:0 0 0 2024-04-16T14:35:29.806 INFO:tasks.workunit.client.0.smithi005.stdout:0/256: mkdir da/df/d50 0 2024-04-16T14:35:29.817 INFO:tasks.workunit.client.0.smithi005.stdout:8/244: symlink d5/d11/l56 0 2024-04-16T14:35:29.818 INFO:tasks.workunit.client.0.smithi005.stdout:7/255: mkdir d1/d49 0 2024-04-16T14:35:29.818 INFO:tasks.workunit.client.0.smithi005.stdout:7/256: creat d1/d5/d16/f4a x:0 0 0 2024-04-16T14:35:29.819 INFO:tasks.workunit.client.0.smithi005.stdout:5/185: write d0/f1b [5102381,38252] 0 2024-04-16T14:35:29.820 INFO:tasks.workunit.client.0.smithi005.stdout:6/344: truncate d2/d5/d28/f21 4551786 0 2024-04-16T14:35:29.820 INFO:tasks.workunit.client.0.smithi005.stdout:5/186: creat d0/d6/f36 x:0 0 0 2024-04-16T14:35:29.823 INFO:tasks.workunit.client.0.smithi005.stdout:8/245: write d5/de/f25 [500462,60924] 0 2024-04-16T14:35:29.825 INFO:tasks.workunit.client.0.smithi005.stdout:6/345: creat d2/d45/f74 x:0 0 0 2024-04-16T14:35:29.826 INFO:tasks.workunit.client.0.smithi005.stdout:5/187: mknod d0/d6/c37 0 2024-04-16T14:35:29.827 INFO:tasks.workunit.client.0.smithi005.stdout:5/188: write d0/d6/f36 [266447,96232] 0 2024-04-16T14:35:29.827 INFO:tasks.workunit.client.0.smithi005.stdout:5/189: write d0/d6/d12/d1c/f22 [4291663,85034] 0 2024-04-16T14:35:29.827 INFO:tasks.workunit.client.0.smithi005.stdout:0/257: rmdir da/df/d26/d39/d43 39 2024-04-16T14:35:29.831 INFO:tasks.workunit.client.0.smithi005.stdout:1/344: sync 2024-04-16T14:35:29.831 INFO:tasks.workunit.client.0.smithi005.stdout:9/139: sync 2024-04-16T14:35:29.831 INFO:tasks.workunit.client.0.smithi005.stdout:2/96: sync 2024-04-16T14:35:29.831 INFO:tasks.workunit.client.0.smithi005.stdout:2/97: chown d0/fb 121635184 1 2024-04-16T14:35:29.831 INFO:tasks.workunit.client.0.smithi005.stdout:1/345: fsync d2/d1c/d15/d2a/d1a/d21/f29 0 2024-04-16T14:35:29.831 INFO:tasks.workunit.client.0.smithi005.stdout:1/346: creat d2/d1c/d15/d2a/d19/d42/f7d x:0 0 0 2024-04-16T14:35:29.831 INFO:tasks.workunit.client.0.smithi005.stdout:9/140: write d3/d12/f23 [72522,114700] 0 2024-04-16T14:35:29.832 INFO:tasks.workunit.client.0.smithi005.stdout:9/141: creat d3/d12/f28 x:0 0 0 2024-04-16T14:35:29.832 INFO:tasks.workunit.client.0.smithi005.stdout:1/347: write d2/d1c/d15/d2a/d19/d20/d27/f54 [1021009,114743] 0 2024-04-16T14:35:29.832 INFO:tasks.workunit.client.0.smithi005.stdout:7/257: dwrite d1/d5/f17 [0,4194304] 0 2024-04-16T14:35:29.832 INFO:tasks.workunit.client.0.smithi005.stdout:5/190: mknod d0/d6/d12/d34/d30/c38 0 2024-04-16T14:35:29.832 INFO:tasks.workunit.client.0.smithi005.stdout:2/98: write d0/d4/fe [527192,90588] 0 2024-04-16T14:35:29.832 INFO:tasks.workunit.client.0.smithi005.stdout:2/99: fsync d0/d4/f12 0 2024-04-16T14:35:29.832 INFO:tasks.workunit.client.0.smithi005.stdout:0/258: mknod da/df/d50/c51 0 2024-04-16T14:35:29.833 INFO:tasks.workunit.client.0.smithi005.stdout:0/259: truncate da/f32 298462 0 2024-04-16T14:35:29.833 INFO:tasks.workunit.client.0.smithi005.stdout:8/246: truncate d5/de/f1d 1838380 0 2024-04-16T14:35:29.833 INFO:tasks.workunit.client.0.smithi005.stdout:8/247: write d5/d11/f47 [47246,124419] 0 2024-04-16T14:35:29.834 INFO:tasks.workunit.client.0.smithi005.stdout:6/346: getdents d2/d20/d33 0 2024-04-16T14:35:29.837 INFO:tasks.workunit.client.0.smithi005.stdout:7/258: dread d1/dc/d2f/f3e [0,4194304] 0 2024-04-16T14:35:29.837 INFO:tasks.workunit.client.0.smithi005.stdout:2/100: dread d0/d4/d7/f13 [0,4194304] 0 2024-04-16T14:35:29.837 INFO:tasks.workunit.client.0.smithi005.stdout:2/101: fdatasync d0/d4/d7/f11 0 2024-04-16T14:35:29.838 INFO:tasks.workunit.client.0.smithi005.stdout:9/142: symlink d3/l29 0 2024-04-16T14:35:29.838 INFO:tasks.workunit.client.0.smithi005.stdout:9/143: write d3/d12/f26 [180227,7214] 0 2024-04-16T14:35:29.840 INFO:tasks.workunit.client.0.smithi005.stdout:1/348: unlink d2/d2c/l22 0 2024-04-16T14:35:29.840 INFO:tasks.workunit.client.0.smithi005.stdout:1/349: creat d2/d1c/d15/d2a/d19/d42/d64/f7e x:0 0 0 2024-04-16T14:35:29.843 INFO:tasks.workunit.client.0.smithi005.stdout:0/260: symlink da/df/d1b/d24/l52 0 2024-04-16T14:35:29.847 INFO:tasks.workunit.client.0.smithi005.stdout:6/347: rename d2/d3f/d47/f56 to d2/d5/f75 0 2024-04-16T14:35:29.848 INFO:tasks.workunit.client.0.smithi005.stdout:7/259: mknod d1/d5/d16/c4b 0 2024-04-16T14:35:29.849 INFO:tasks.workunit.client.0.smithi005.stdout:2/102: mknod d0/d4/d7/c1b 0 2024-04-16T14:35:29.851 INFO:tasks.workunit.client.0.smithi005.stdout:1/350: symlink d2/d74/d7a/l7f 0 2024-04-16T14:35:29.855 INFO:tasks.workunit.client.0.smithi005.stdout:8/248: rmdir d5 39 2024-04-16T14:35:29.857 INFO:tasks.workunit.client.0.smithi005.stdout:0/261: rename da/df/d26/d39/d43 to da/df/d1b/d3a/d53 0 2024-04-16T14:35:29.859 INFO:tasks.workunit.client.0.smithi005.stdout:2/103: unlink d0/d4/fe 0 2024-04-16T14:35:29.860 INFO:tasks.workunit.client.0.smithi005.stdout:8/249: unlink d5/ld 0 2024-04-16T14:35:29.860 INFO:tasks.workunit.client.0.smithi005.stdout:8/250: fsync d5/d11/f20 0 2024-04-16T14:35:29.861 INFO:tasks.workunit.client.0.smithi005.stdout:8/251: chown d5/de 35031 1 2024-04-16T14:35:29.861 INFO:tasks.workunit.client.0.smithi005.stdout:8/252: chown f4 65179 1 2024-04-16T14:35:29.863 INFO:tasks.workunit.client.0.smithi005.stdout:2/104: mkdir d0/d1c 0 2024-04-16T14:35:29.867 INFO:tasks.workunit.client.0.smithi005.stdout:9/144: dwrite d3/d12/d16/f1a [0,4194304] 0 2024-04-16T14:35:29.867 INFO:tasks.workunit.client.0.smithi005.stdout:5/191: dwrite d0/d6/d12/d1c/f20 [4194304,4194304] 0 2024-04-16T14:35:29.867 INFO:tasks.workunit.client.0.smithi005.stdout:9/145: dread - d3/d12/f1f zero size 2024-04-16T14:35:29.867 INFO:tasks.workunit.client.0.smithi005.stdout:9/146: chown d3/lc 85119151 1 2024-04-16T14:35:29.867 INFO:tasks.workunit.client.0.smithi005.stdout:7/260: dread d1/d5/d22/d27/f36 [0,4194304] 0 2024-04-16T14:35:29.867 INFO:tasks.workunit.client.0.smithi005.stdout:9/147: creat d3/d12/f2a x:0 0 0 2024-04-16T14:35:29.867 INFO:tasks.workunit.client.0.smithi005.stdout:9/148: write d3/d12/d16/f1d [1508591,66838] 0 2024-04-16T14:35:29.868 INFO:tasks.workunit.client.0.smithi005.stdout:8/253: link d5/de/c29 d5/d11/d1f/d2f/c57 0 2024-04-16T14:35:29.868 INFO:tasks.workunit.client.0.smithi005.stdout:8/254: fsync d5/d11/f4a 0 2024-04-16T14:35:29.869 INFO:tasks.workunit.client.1.smithi115.stdout:9/20: symlink d1/l4 0 2024-04-16T14:35:29.869 INFO:tasks.workunit.client.0.smithi005.stdout:2/105: rename d0/d4/cf to d0/c1d 0 2024-04-16T14:35:29.875 INFO:tasks.workunit.client.0.smithi005.stdout:6/348: dwrite d2/d5/d28/f6c [0,4194304] 0 2024-04-16T14:35:29.881 INFO:tasks.workunit.client.0.smithi005.stdout:5/192: read d0/d6/d12/f29 [2815865,121580] 0 2024-04-16T14:35:29.881 INFO:tasks.workunit.client.1.smithi115.stdout:6/14: link f0 f3 0 2024-04-16T14:35:29.884 INFO:tasks.workunit.client.0.smithi005.stdout:7/261: unlink d1/dc/d2f/f35 0 2024-04-16T14:35:29.884 INFO:tasks.workunit.client.0.smithi005.stdout:7/262: write d1/d5/d22/d27/f2b [2852298,32855] 0 2024-04-16T14:35:29.884 INFO:tasks.workunit.client.0.smithi005.stdout:7/263: fdatasync d1/d5/d16/f4a 0 2024-04-16T14:35:29.896 INFO:tasks.workunit.client.0.smithi005.stdout:6/349: unlink d2/d5/f75 0 2024-04-16T14:35:29.897 INFO:tasks.workunit.client.0.smithi005.stdout:7/264: rename d1/d5/f1a to d1/dc/d2f/f4c 0 2024-04-16T14:35:29.899 INFO:tasks.workunit.client.0.smithi005.stdout:1/351: dwrite d2/d1c/d15/d2a/d1a/d2e/d51/f6a [0,4194304] 0 2024-04-16T14:35:29.900 INFO:tasks.workunit.client.0.smithi005.stdout:6/350: mknod d2/d5/d10/d4d/d51/d6e/c76 0 2024-04-16T14:35:29.900 INFO:tasks.workunit.client.0.smithi005.stdout:6/351: dread - d2/d5/f6a zero size 2024-04-16T14:35:29.901 INFO:tasks.workunit.client.0.smithi005.stdout:7/265: link d1/d5/c9 d1/d5/d22/c4d 0 2024-04-16T14:35:29.904 INFO:tasks.workunit.client.0.smithi005.stdout:1/352: symlink d2/d1c/d15/d2a/d1a/d2e/d51/l80 0 2024-04-16T14:35:29.905 INFO:tasks.workunit.client.0.smithi005.stdout:1/353: rmdir d2/d1c/d15/d2a/d19/d6e/d7b 39 2024-04-16T14:35:29.906 INFO:tasks.workunit.client.0.smithi005.stdout:1/354: chown d2/d1c/l67 1130443 1 2024-04-16T14:35:29.906 INFO:tasks.workunit.client.0.smithi005.stdout:1/355: chown d2/d1c/ff 15 1 2024-04-16T14:35:29.909 INFO:tasks.workunit.client.0.smithi005.stdout:0/262: dwrite da/fe [0,4194304] 0 2024-04-16T14:35:29.909 INFO:tasks.workunit.client.0.smithi005.stdout:0/263: fsync da/df/d26/f45 0 2024-04-16T14:35:29.909 INFO:tasks.workunit.client.0.smithi005.stdout:2/106: dwrite d0/d4/f6 [0,4194304] 0 2024-04-16T14:35:29.909 INFO:tasks.workunit.client.0.smithi005.stdout:1/356: rename d2/f55 to d2/d1c/d15/d2a/d19/d42/d64/d66/f81 0 2024-04-16T14:35:29.910 INFO:tasks.workunit.client.0.smithi005.stdout:5/193: dwrite d0/d6/d12/f29 [0,4194304] 0 2024-04-16T14:35:29.911 INFO:tasks.workunit.client.0.smithi005.stdout:8/255: dwrite d5/d11/d1f/f33 [0,4194304] 0 2024-04-16T14:35:29.911 INFO:tasks.workunit.client.0.smithi005.stdout:8/256: read d5/fb [2886730,112039] 0 2024-04-16T14:35:29.915 INFO:tasks.workunit.client.0.smithi005.stdout:0/264: dread da/f30 [0,4194304] 0 2024-04-16T14:35:29.916 INFO:tasks.workunit.client.0.smithi005.stdout:0/265: dread - da/df/d1b/f47 zero size 2024-04-16T14:35:29.916 INFO:tasks.workunit.client.0.smithi005.stdout:5/194: fsync d0/f28 0 2024-04-16T14:35:29.916 INFO:tasks.workunit.client.0.smithi005.stdout:5/195: creat d0/d6/f39 x:0 0 0 2024-04-16T14:35:29.917 INFO:tasks.workunit.client.0.smithi005.stdout:8/257: stat d5/de/f19 0 2024-04-16T14:35:29.918 INFO:tasks.workunit.client.0.smithi005.stdout:0/266: mkdir da/df/d1b/d3a/d54 0 2024-04-16T14:35:29.919 INFO:tasks.workunit.client.0.smithi005.stdout:8/258: truncate d5/d11/f20 4166833 0 2024-04-16T14:35:29.920 INFO:tasks.workunit.client.0.smithi005.stdout:0/267: mkdir da/df/d26/d39/d55 0 2024-04-16T14:35:29.920 INFO:tasks.workunit.client.0.smithi005.stdout:0/268: getdents da/df/d1b/d3a/d54 0 2024-04-16T14:35:29.921 INFO:tasks.workunit.client.0.smithi005.stdout:9/149: rmdir d3/d12 39 2024-04-16T14:35:29.922 INFO:tasks.workunit.client.0.smithi005.stdout:9/150: stat d3/d12/l15 0 2024-04-16T14:35:29.923 INFO:tasks.workunit.client.0.smithi005.stdout:8/259: symlink d5/d40/d4b/l58 0 2024-04-16T14:35:29.926 INFO:tasks.workunit.client.0.smithi005.stdout:1/357: dread d2/d1c/fe [0,4194304] 0 2024-04-16T14:35:29.927 INFO:tasks.workunit.client.0.smithi005.stdout:0/269: dread da/df/d26/f45 [0,4194304] 0 2024-04-16T14:35:29.928 INFO:tasks.workunit.client.0.smithi005.stdout:8/260: creat d5/de/f59 x:0 0 0 2024-04-16T14:35:29.928 INFO:tasks.workunit.client.0.smithi005.stdout:6/352: dwrite d2/d5/d28/f21 [4194304,4194304] 0 2024-04-16T14:35:29.929 INFO:tasks.workunit.client.0.smithi005.stdout:0/270: mknod da/df/d1b/d3a/d53/c56 0 2024-04-16T14:35:29.930 INFO:tasks.workunit.client.0.smithi005.stdout:5/196: dread d0/d6/f36 [0,4194304] 0 2024-04-16T14:35:29.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:29 smithi115 ceph-mon[37295]: pgmap v19: 65 pgs: 65 active+clean; 487 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 39 MiB/s rd, 51 MiB/s wr, 568 op/s 2024-04-16T14:35:29.932 INFO:tasks.workunit.client.0.smithi005.stdout:5/197: write d0/d6/d12/d1c/f1f [160480,54896] 0 2024-04-16T14:35:29.932 INFO:tasks.workunit.client.0.smithi005.stdout:5/198: chown d0/d6/d12/d34/d30/c38 1383607903 1 2024-04-16T14:35:29.932 INFO:tasks.workunit.client.0.smithi005.stdout:8/261: rmdir d5/d11 39 2024-04-16T14:35:29.934 INFO:tasks.workunit.client.0.smithi005.stdout:1/358: dread d2/d1c/d15/d2a/d1a/d2e/d51/f6a [0,4194304] 0 2024-04-16T14:35:29.934 INFO:tasks.workunit.client.0.smithi005.stdout:7/266: dwrite d1/d5/d16/f4a [0,4194304] 0 2024-04-16T14:35:29.935 INFO:tasks.workunit.client.0.smithi005.stdout:8/262: mkdir d5/d55/d5a 0 2024-04-16T14:35:29.937 INFO:tasks.workunit.client.0.smithi005.stdout:2/107: rename d0/d4/d7 to d0/d1e 0 2024-04-16T14:35:29.943 INFO:tasks.workunit.client.0.smithi005.stdout:4/358: sync 2024-04-16T14:35:29.946 INFO:tasks.workunit.client.0.smithi005.stdout:1/359: mknod d2/d1c/d15/d2a/d19/d42/d64/c82 0 2024-04-16T14:35:29.947 INFO:tasks.workunit.client.0.smithi005.stdout:8/263: creat d5/de/f5b x:0 0 0 2024-04-16T14:35:29.948 INFO:tasks.workunit.client.0.smithi005.stdout:8/264: truncate d5/de/f59 12080 0 2024-04-16T14:35:29.948 INFO:tasks.workunit.client.0.smithi005.stdout:8/265: chown d5/d55/d5a 58763 1 2024-04-16T14:35:29.950 INFO:tasks.workunit.client.0.smithi005.stdout:5/199: read d0/d6/d12/d1c/f20 [147360,29388] 0 2024-04-16T14:35:29.950 INFO:tasks.workunit.client.0.smithi005.stdout:5/200: creat d0/d6/d12/f3a x:0 0 0 2024-04-16T14:35:29.950 INFO:tasks.workunit.client.0.smithi005.stdout:0/271: dwrite da/df/f1e [0,4194304] 0 2024-04-16T14:35:29.950 INFO:tasks.workunit.client.0.smithi005.stdout:6/353: rename d2/df/f6f to d2/d5/f77 0 2024-04-16T14:35:29.950 INFO:tasks.workunit.client.0.smithi005.stdout:3/163: sync 2024-04-16T14:35:29.951 INFO:tasks.workunit.client.0.smithi005.stdout:2/108: mknod d0/c1f 0 2024-04-16T14:35:29.951 INFO:tasks.workunit.client.0.smithi005.stdout:4/359: rmdir d0/d1b/d1d/d4f 39 2024-04-16T14:35:29.953 INFO:tasks.workunit.client.0.smithi005.stdout:7/267: rmdir d1/dc/d2f 39 2024-04-16T14:35:29.954 INFO:tasks.workunit.client.0.smithi005.stdout:1/360: dread d2/d1c/d15/f1d [0,4194304] 0 2024-04-16T14:35:29.954 INFO:tasks.workunit.client.0.smithi005.stdout:9/151: dwrite d3/f10 [0,4194304] 0 2024-04-16T14:35:29.956 INFO:tasks.workunit.client.0.smithi005.stdout:8/266: dread d5/de/f25 [0,4194304] 0 2024-04-16T14:35:29.959 INFO:tasks.workunit.client.0.smithi005.stdout:5/201: rmdir d0/d6/d12/d34 39 2024-04-16T14:35:29.961 INFO:tasks.workunit.client.0.smithi005.stdout:0/272: creat da/df/d1b/d3a/f57 x:0 0 0 2024-04-16T14:35:29.962 INFO:tasks.workunit.client.0.smithi005.stdout:6/354: creat d2/d20/d72/f78 x:0 0 0 2024-04-16T14:35:29.963 INFO:tasks.workunit.client.0.smithi005.stdout:3/164: creat d2/d17/f38 x:0 0 0 2024-04-16T14:35:29.963 INFO:tasks.workunit.client.0.smithi005.stdout:3/165: fsync d2/f2c 0 2024-04-16T14:35:29.963 INFO:tasks.workunit.client.0.smithi005.stdout:3/166: write d2/d9/df/f11 [1618972,66145] 0 2024-04-16T14:35:29.965 INFO:tasks.workunit.client.0.smithi005.stdout:2/109: creat d0/d1c/f20 x:0 0 0 2024-04-16T14:35:29.966 INFO:tasks.workunit.client.0.smithi005.stdout:4/360: symlink d0/d1b/l65 0 2024-04-16T14:35:29.966 INFO:tasks.workunit.client.0.smithi005.stdout:4/361: chown d0/f26 202155578 1 2024-04-16T14:35:29.971 INFO:tasks.workunit.client.0.smithi005.stdout:1/361: mkdir d2/d1c/d15/d2a/d1a/d2e/d83 0 2024-04-16T14:35:29.972 INFO:tasks.workunit.client.0.smithi005.stdout:7/268: dwrite d1/dc/f1c [4194304,4194304] 0 2024-04-16T14:35:29.972 INFO:tasks.workunit.client.0.smithi005.stdout:9/152: mkdir d3/d12/d2b 0 2024-04-16T14:35:29.973 INFO:tasks.workunit.client.0.smithi005.stdout:9/153: chown d3/l9 637529 1 2024-04-16T14:35:29.973 INFO:tasks.workunit.client.0.smithi005.stdout:9/154: write d3/d12/f26 [891441,64457] 0 2024-04-16T14:35:29.973 INFO:tasks.workunit.client.0.smithi005.stdout:9/155: write d3/d12/f23 [250115,58524] 0 2024-04-16T14:35:29.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:29 smithi005 ceph-mon[28964]: pgmap v19: 65 pgs: 65 active+clean; 487 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 39 MiB/s rd, 51 MiB/s wr, 568 op/s 2024-04-16T14:35:29.974 INFO:tasks.workunit.client.0.smithi005.stdout:8/267: link d5/cf d5/d11/d1f/c5c 0 2024-04-16T14:35:29.976 INFO:tasks.workunit.client.0.smithi005.stdout:0/273: symlink da/df/d26/d39/l58 0 2024-04-16T14:35:29.976 INFO:tasks.workunit.client.0.smithi005.stdout:6/355: creat d2/d5/d28/f79 x:0 0 0 2024-04-16T14:35:29.978 INFO:tasks.workunit.client.0.smithi005.stdout:3/167: mkdir d2/d9/d25/d39 0 2024-04-16T14:35:29.980 INFO:tasks.workunit.client.0.smithi005.stdout:2/110: creat d0/f21 x:0 0 0 2024-04-16T14:35:29.982 INFO:tasks.workunit.client.0.smithi005.stdout:1/362: link d2/d1c/d15/d2a/d19/d42/d64/d66/f81 d2/d1c/d15/d2a/d19/f84 0 2024-04-16T14:35:29.982 INFO:tasks.workunit.client.0.smithi005.stdout:1/363: read - d2/d1c/f3d zero size 2024-04-16T14:35:29.982 INFO:tasks.workunit.client.0.smithi005.stdout:1/364: dread - d2/d1c/d15/d2a/d19/d42/f7d zero size 2024-04-16T14:35:29.984 INFO:tasks.workunit.client.0.smithi005.stdout:7/269: rename d1/dc/l14 to d1/d5/d22/d27/d2e/l4e 0 2024-04-16T14:35:29.986 INFO:tasks.workunit.client.0.smithi005.stdout:9/156: truncate d3/d12/d16/f1b 309558 0 2024-04-16T14:35:29.988 INFO:tasks.workunit.client.0.smithi005.stdout:5/202: getdents d0/d6/d12/d34 0 2024-04-16T14:35:29.988 INFO:tasks.workunit.client.0.smithi005.stdout:5/203: write d0/f32 [531301,20686] 0 2024-04-16T14:35:29.988 INFO:tasks.workunit.client.0.smithi005.stdout:5/204: chown d0/d6/d12/c2e 164035 1 2024-04-16T14:35:29.990 INFO:tasks.workunit.client.0.smithi005.stdout:6/356: mkdir d2/d5/d10/d4d/d7a 0 2024-04-16T14:35:29.990 INFO:tasks.workunit.client.0.smithi005.stdout:6/357: stat d2/d5/d10/f1d 0 2024-04-16T14:35:29.991 INFO:tasks.workunit.client.0.smithi005.stdout:2/111: mknod d0/d1c/c22 0 2024-04-16T14:35:29.992 INFO:tasks.workunit.client.0.smithi005.stdout:7/270: mkdir d1/dc/d2f/d4f 0 2024-04-16T14:35:29.992 INFO:tasks.workunit.client.0.smithi005.stdout:7/271: readlink d1/d5/l32 0 2024-04-16T14:35:29.992 INFO:tasks.workunit.client.0.smithi005.stdout:9/157: getdents d3/d12/d16 0 2024-04-16T14:35:29.994 INFO:tasks.workunit.client.0.smithi005.stdout:5/205: symlink d0/d6/d12/d1c/d1e/l3b 0 2024-04-16T14:35:29.995 INFO:tasks.workunit.client.0.smithi005.stdout:2/112: chown d0/d1e/l15 100679232 1 2024-04-16T14:35:29.996 INFO:tasks.workunit.client.0.smithi005.stdout:5/206: mknod d0/d6/d12/d1c/c3c 0 2024-04-16T14:35:29.999 INFO:tasks.workunit.client.0.smithi005.stdout:0/274: rmdir da/df/d1b/d3a/d54 0 2024-04-16T14:35:30.001 INFO:tasks.workunit.client.0.smithi005.stdout:0/275: mkdir da/df/d1b/d59 0 2024-04-16T14:35:30.002 INFO:tasks.workunit.client.0.smithi005.stdout:2/113: mknod d0/d1e/c23 0 2024-04-16T14:35:30.002 INFO:tasks.workunit.client.0.smithi005.stdout:2/114: stat d0/d1c 0 2024-04-16T14:35:30.003 INFO:tasks.workunit.client.0.smithi005.stdout:0/276: mkdir da/df/d1b/d3a/d53/d5a 0 2024-04-16T14:35:30.005 INFO:tasks.workunit.client.0.smithi005.stdout:2/115: stat d0/c1d 0 2024-04-16T14:35:30.005 INFO:tasks.workunit.client.0.smithi005.stdout:0/277: symlink da/df/d1b/l5b 0 2024-04-16T14:35:30.007 INFO:tasks.workunit.client.0.smithi005.stdout:2/116: mknod d0/c24 0 2024-04-16T14:35:30.007 INFO:tasks.workunit.client.0.smithi005.stdout:2/117: fsync d0/d1e/f13 0 2024-04-16T14:35:30.007 INFO:tasks.workunit.client.0.smithi005.stdout:2/118: stat d0/fb 0 2024-04-16T14:35:30.014 INFO:tasks.workunit.client.0.smithi005.stdout:0/278: dread da/df/d1b/f22 [0,4194304] 0 2024-04-16T14:35:30.014 INFO:tasks.workunit.client.0.smithi005.stdout:0/279: chown da/df/d1b/d3a/f4d 117561693 1 2024-04-16T14:35:30.014 INFO:tasks.workunit.client.0.smithi005.stdout:0/280: write da/df/d26/f4a [1084343,36819] 0 2024-04-16T14:35:30.020 INFO:tasks.workunit.client.0.smithi005.stdout:8/268: dwrite d5/f43 [0,4194304] 0 2024-04-16T14:35:30.022 INFO:tasks.workunit.client.0.smithi005.stdout:8/269: rename d5/f50 to d5/de/f5d 0 2024-04-16T14:35:30.023 INFO:tasks.workunit.client.0.smithi005.stdout:8/270: dread d5/d11/d1f/d2f/f34 [0,4194304] 0 2024-04-16T14:35:30.028 INFO:tasks.workunit.client.0.smithi005.stdout:2/119: dread d0/d4/f9 [4194304,4194304] 0 2024-04-16T14:35:30.033 INFO:tasks.workunit.client.0.smithi005.stdout:2/120: dread d0/d4/f9 [4194304,4194304] 0 2024-04-16T14:35:30.034 INFO:tasks.workunit.client.0.smithi005.stdout:2/121: readlink d0/d1e/l10 0 2024-04-16T14:35:30.034 INFO:tasks.workunit.client.0.smithi005.stdout:2/122: readlink d0/d1e/l10 0 2024-04-16T14:35:30.034 INFO:tasks.workunit.client.0.smithi005.stdout:2/123: fdatasync d0/f21 0 2024-04-16T14:35:30.038 INFO:tasks.workunit.client.0.smithi005.stdout:1/365: dwrite d2/d1c/d15/d2a/d1a/f77 [0,4194304] 0 2024-04-16T14:35:30.038 INFO:tasks.workunit.client.0.smithi005.stdout:3/168: dwrite d2/d9/df/f2f [0,4194304] 0 2024-04-16T14:35:30.043 INFO:tasks.workunit.client.0.smithi005.stdout:1/366: mkdir d2/d2c/d85 0 2024-04-16T14:35:30.044 INFO:tasks.workunit.client.0.smithi005.stdout:6/358: dwrite d2/d5/d28/f46 [0,4194304] 0 2024-04-16T14:35:30.044 INFO:tasks.workunit.client.0.smithi005.stdout:6/359: truncate d2/d5/d10/d68/f73 855626 0 2024-04-16T14:35:30.045 INFO:tasks.workunit.client.0.smithi005.stdout:7/272: dwrite d1/d5/d22/d27/d3a/f40 [0,4194304] 0 2024-04-16T14:35:30.045 INFO:tasks.workunit.client.0.smithi005.stdout:7/273: chown d1/d5/d22/d27/d2e/f48 1341 1 2024-04-16T14:35:30.045 INFO:tasks.workunit.client.0.smithi005.stdout:7/274: fsync d1/f29 0 2024-04-16T14:35:30.045 INFO:tasks.workunit.client.0.smithi005.stdout:7/275: chown d1/dc 433646396 1 2024-04-16T14:35:30.045 INFO:tasks.workunit.client.0.smithi005.stdout:3/169: mknod d2/d9/df/c3a 0 2024-04-16T14:35:30.046 INFO:tasks.workunit.client.0.smithi005.stdout:8/271: dwrite d5/d11/d1f/d2f/f34 [0,4194304] 0 2024-04-16T14:35:30.046 INFO:tasks.workunit.client.0.smithi005.stdout:5/207: dwrite d0/fe [0,4194304] 0 2024-04-16T14:35:30.046 INFO:tasks.workunit.client.0.smithi005.stdout:0/281: dwrite da/df/d1b/f31 [0,4194304] 0 2024-04-16T14:35:30.046 INFO:tasks.workunit.client.0.smithi005.stdout:1/367: unlink d2/d1c/d15/d2a/d1a/d21/f61 0 2024-04-16T14:35:30.050 INFO:tasks.workunit.client.0.smithi005.stdout:6/360: mkdir d2/d45/d7b 0 2024-04-16T14:35:30.050 INFO:tasks.workunit.client.0.smithi005.stdout:6/361: chown f0 1959071 1 2024-04-16T14:35:30.051 INFO:tasks.workunit.client.0.smithi005.stdout:6/362: write d2/d5/d28/f38 [2582495,15264] 0 2024-04-16T14:35:30.053 INFO:tasks.workunit.client.0.smithi005.stdout:2/124: dwrite d0/d1e/f1a [0,4194304] 0 2024-04-16T14:35:30.054 INFO:tasks.workunit.client.0.smithi005.stdout:7/276: mknod d1/d5/d22/d27/c50 0 2024-04-16T14:35:30.058 INFO:tasks.workunit.client.0.smithi005.stdout:3/170: link d2/d17/f38 d2/d9/d25/d39/f3b 0 2024-04-16T14:35:30.058 INFO:tasks.workunit.client.0.smithi005.stdout:3/171: write d2/d9/df/f1c [3369617,13316] 0 2024-04-16T14:35:30.060 INFO:tasks.workunit.client.0.smithi005.stdout:8/272: write d5/d11/d1f/f33 [1755993,130177] 0 2024-04-16T14:35:30.060 INFO:tasks.workunit.client.0.smithi005.stdout:8/273: chown d5/d11/c27 22567 1 2024-04-16T14:35:30.061 INFO:tasks.workunit.client.0.smithi005.stdout:1/368: dwrite d2/d1c/d15/d2a/d25/f5c [0,4194304] 0 2024-04-16T14:35:30.069 INFO:tasks.workunit.client.0.smithi005.stdout:6/363: dwrite d2/d5/d10/d68/f73 [0,4194304] 0 2024-04-16T14:35:30.069 INFO:tasks.workunit.client.0.smithi005.stdout:6/364: chown d2/d20/d72 224703 1 2024-04-16T14:35:30.069 INFO:tasks.workunit.client.0.smithi005.stdout:6/365: truncate d2/d45/f74 444456 0 2024-04-16T14:35:30.070 INFO:tasks.workunit.client.0.smithi005.stdout:0/282: mkdir da/df/d26/d39/d55/d5c 0 2024-04-16T14:35:30.086 INFO:tasks.workunit.client.0.smithi005.stdout:7/277: link d1/d5/c15 d1/dc/d2f/c51 0 2024-04-16T14:35:30.086 INFO:tasks.workunit.client.0.smithi005.stdout:7/278: chown d1/c3f 45610 1 2024-04-16T14:35:30.086 INFO:tasks.workunit.client.1.smithi115.stdout:3/16: rename f0 to f4 0 2024-04-16T14:35:30.087 INFO:tasks.workunit.client.1.smithi115.stdout:4/23: mknod d1/c5 0 2024-04-16T14:35:30.087 INFO:tasks.workunit.client.0.smithi005.stdout:8/274: unlink d5/d11/l56 0 2024-04-16T14:35:30.090 INFO:tasks.workunit.client.0.smithi005.stdout:1/369: rename d2/d1c/d15/d2a/d19/d20/c4e to d2/d1c/d15/d2a/d19/d20/d27/d73/c86 0 2024-04-16T14:35:30.090 INFO:tasks.workunit.client.0.smithi005.stdout:1/370: readlink d2/d1c/d15/d2a/d1a/d2e/l38 0 2024-04-16T14:35:30.091 INFO:tasks.workunit.client.1.smithi115.stdout:6/15: rename f3 to f4 0 2024-04-16T14:35:30.091 INFO:tasks.workunit.client.1.smithi115.stdout:8/26: getdents d0 0 2024-04-16T14:35:30.093 INFO:tasks.workunit.client.1.smithi115.stdout:3/17: mknod c5 0 2024-04-16T14:35:30.093 INFO:tasks.workunit.client.1.smithi115.stdout:3/18: creat f6 x:0 0 0 2024-04-16T14:35:30.093 INFO:tasks.workunit.client.1.smithi115.stdout:7/36: rmdir d0/d2 39 2024-04-16T14:35:30.095 INFO:tasks.workunit.client.0.smithi005.stdout:6/366: mkdir d2/d20/d3c/d7c 0 2024-04-16T14:35:30.096 INFO:tasks.workunit.client.0.smithi005.stdout:7/279: write d1/d5/d22/d27/f46 [796751,121836] 0 2024-04-16T14:35:30.097 INFO:tasks.workunit.client.0.smithi005.stdout:7/280: rename d1/d5/d22/d27 to d1/d5/d22/d27/d3a/d52 22 2024-04-16T14:35:30.097 INFO:tasks.workunit.client.1.smithi115.stdout:8/27: creat d0/f8 x:0 0 0 2024-04-16T14:35:30.097 INFO:tasks.workunit.client.1.smithi115.stdout:7/37: dread d0/d2/fb [0,4194304] 0 2024-04-16T14:35:30.097 INFO:tasks.workunit.client.1.smithi115.stdout:7/38: stat d0/l3 0 2024-04-16T14:35:30.097 INFO:tasks.workunit.client.1.smithi115.stdout:7/39: chown d0/d2/cd 7 1 2024-04-16T14:35:30.097 INFO:tasks.workunit.client.1.smithi115.stdout:7/40: chown d0/ca 229 1 2024-04-16T14:35:30.098 INFO:tasks.workunit.client.1.smithi115.stdout:8/28: fdatasync d0/f4 0 2024-04-16T14:35:30.098 INFO:tasks.workunit.client.0.smithi005.stdout:0/283: symlink da/df/d26/d39/d55/l5d 0 2024-04-16T14:35:30.098 INFO:tasks.workunit.client.0.smithi005.stdout:2/125: mknod d0/d1e/c25 0 2024-04-16T14:35:30.099 INFO:tasks.workunit.client.0.smithi005.stdout:9/158: dwrite d3/d12/d16/f1b [0,4194304] 0 2024-04-16T14:35:30.100 INFO:tasks.workunit.client.0.smithi005.stdout:3/172: dwrite d2/d9/df/f1c [0,4194304] 0 2024-04-16T14:35:30.100 INFO:tasks.workunit.client.0.smithi005.stdout:3/173: write d2/f21 [1498078,21954] 0 2024-04-16T14:35:30.100 INFO:tasks.workunit.client.0.smithi005.stdout:8/275: readlink d5/de/l42 0 2024-04-16T14:35:30.107 INFO:tasks.workunit.client.0.smithi005.stdout:1/371: unlink d2/d1c/d15/d2a/d19/d6e/d7b/c7c 0 2024-04-16T14:35:30.108 INFO:tasks.workunit.client.0.smithi005.stdout:1/372: readlink d2/d1c/d15/d2a/d19/d20/l32 0 2024-04-16T14:35:30.110 INFO:tasks.workunit.client.0.smithi005.stdout:5/208: rename d0/cd to d0/c3d 0 2024-04-16T14:35:30.112 INFO:tasks.workunit.client.0.smithi005.stdout:7/281: dread d1/d5/d16/f4a [0,4194304] 0 2024-04-16T14:35:30.113 INFO:tasks.workunit.client.0.smithi005.stdout:7/282: readlink d1/d5/d22/d27/d2e/l4e 0 2024-04-16T14:35:30.113 INFO:tasks.workunit.client.0.smithi005.stdout:3/174: dread d2/fe [0,4194304] 0 2024-04-16T14:35:30.113 INFO:tasks.workunit.client.0.smithi005.stdout:3/175: creat d2/d9/df/f3c x:0 0 0 2024-04-16T14:35:30.120 INFO:tasks.workunit.client.1.smithi115.stdout:8/29: dread d0/f3 [0,4194304] 0 2024-04-16T14:35:30.121 INFO:tasks.workunit.client.0.smithi005.stdout:1/373: link d2/d1c/d15/d2a/c60 d2/d1c/d15/d2a/d19/d42/c87 0 2024-04-16T14:35:30.123 INFO:tasks.workunit.client.0.smithi005.stdout:6/367: getdents d2/d5/d10/d4d/d51 0 2024-04-16T14:35:30.124 INFO:tasks.workunit.client.1.smithi115.stdout:8/30: symlink d0/l9 0 2024-04-16T14:35:30.124 INFO:tasks.workunit.client.1.smithi115.stdout:8/31: write d0/f8 [843394,95284] 0 2024-04-16T14:35:30.125 INFO:tasks.workunit.client.0.smithi005.stdout:7/283: write d1/d5/d22/d27/d3a/f40 [4915092,69280] 0 2024-04-16T14:35:30.127 INFO:tasks.workunit.client.0.smithi005.stdout:3/176: unlink d2/d9/df/f11 0 2024-04-16T14:35:30.128 INFO:tasks.workunit.client.0.smithi005.stdout:2/126: symlink d0/d4/l26 0 2024-04-16T14:35:30.130 INFO:tasks.workunit.client.0.smithi005.stdout:1/374: rename d2/d1c/d15/d2a/d1a/f77 to d2/d1c/d15/d2a/d19/d20/f88 0 2024-04-16T14:35:30.130 INFO:tasks.workunit.client.0.smithi005.stdout:1/375: readlink d2/d74/d7a/l7f 0 2024-04-16T14:35:30.132 INFO:tasks.workunit.client.0.smithi005.stdout:5/209: getdents d0/d6/d12/d1c/d1e 0 2024-04-16T14:35:30.132 INFO:tasks.workunit.client.0.smithi005.stdout:5/210: chown d0/d6/d12/d1c/d1e/l21 18 1 2024-04-16T14:35:30.133 INFO:tasks.workunit.client.0.smithi005.stdout:7/284: dread d1/dc/d2f/f4c [4194304,4194304] 0 2024-04-16T14:35:30.136 INFO:tasks.workunit.client.0.smithi005.stdout:8/276: dwrite d5/d11/f44 [0,4194304] 0 2024-04-16T14:35:30.136 INFO:tasks.workunit.client.0.smithi005.stdout:8/277: write d5/d11/d1f/d2f/f4c [997997,75112] 0 2024-04-16T14:35:30.136 INFO:tasks.workunit.client.0.smithi005.stdout:9/159: dwrite d3/d12/f23 [0,4194304] 0 2024-04-16T14:35:30.136 INFO:tasks.workunit.client.0.smithi005.stdout:9/160: fdatasync d3/f10 0 2024-04-16T14:35:30.136 INFO:tasks.workunit.client.1.smithi115.stdout:3/19: dwrite f6 [0,4194304] 0 2024-04-16T14:35:30.137 INFO:tasks.workunit.client.0.smithi005.stdout:0/284: dwrite da/df/d26/f4c [0,4194304] 0 2024-04-16T14:35:30.137 INFO:tasks.workunit.client.0.smithi005.stdout:0/285: readlink da/df/l18 0 2024-04-16T14:35:30.138 INFO:tasks.workunit.client.0.smithi005.stdout:1/376: link d2/d1c/d15/d2a/d25/f5c d2/d1c/d15/d2a/d1a/d21/f89 0 2024-04-16T14:35:30.138 INFO:tasks.workunit.client.0.smithi005.stdout:1/377: fdatasync d2/d1c/f17 0 2024-04-16T14:35:30.138 INFO:tasks.workunit.client.0.smithi005.stdout:6/368: mknod d2/d5/d28/c7d 0 2024-04-16T14:35:30.140 INFO:tasks.workunit.client.1.smithi115.stdout:7/41: dwrite d0/d2/fb [0,4194304] 0 2024-04-16T14:35:30.140 INFO:tasks.workunit.client.0.smithi005.stdout:3/177: symlink d2/d17/l3d 0 2024-04-16T14:35:30.143 INFO:tasks.workunit.client.0.smithi005.stdout:2/127: unlink d0/d1e/c1b 0 2024-04-16T14:35:30.143 INFO:tasks.workunit.client.0.smithi005.stdout:2/128: write d0/f21 [407390,57632] 0 2024-04-16T14:35:30.143 INFO:tasks.workunit.client.0.smithi005.stdout:7/285: write d1/d5/d22/d27/d3a/f40 [2341243,96501] 0 2024-04-16T14:35:30.148 INFO:tasks.workunit.client.1.smithi115.stdout:3/20: dread f2 [0,4194304] 0 2024-04-16T14:35:30.148 INFO:tasks.workunit.client.1.smithi115.stdout:3/21: creat f7 x:0 0 0 2024-04-16T14:35:30.149 INFO:tasks.workunit.client.0.smithi005.stdout:1/378: mkdir d2/d1c/d8a 0 2024-04-16T14:35:30.149 INFO:tasks.workunit.client.0.smithi005.stdout:1/379: creat d2/d1c/d15/f8b x:0 0 0 2024-04-16T14:35:30.149 INFO:tasks.workunit.client.0.smithi005.stdout:1/380: chown d2/d1c/d15/d2a/d19/d20/f53 1132 1 2024-04-16T14:35:30.149 INFO:tasks.workunit.client.0.smithi005.stdout:1/381: fdatasync d2/d1c/d15/f63 0 2024-04-16T14:35:30.149 INFO:tasks.workunit.client.1.smithi115.stdout:7/42: getdents d0 0 2024-04-16T14:35:30.151 INFO:tasks.workunit.client.0.smithi005.stdout:7/286: mknod d1/d5/d16/d47/c53 0 2024-04-16T14:35:30.153 INFO:tasks.workunit.client.0.smithi005.stdout:2/129: dread d0/fb [0,4194304] 0 2024-04-16T14:35:30.153 INFO:tasks.workunit.client.0.smithi005.stdout:2/130: chown d0/c16 65270163 1 2024-04-16T14:35:30.153 INFO:tasks.workunit.client.0.smithi005.stdout:8/278: unlink d5/de/f28 0 2024-04-16T14:35:30.153 INFO:tasks.workunit.client.1.smithi115.stdout:3/22: symlink l8 0 2024-04-16T14:35:30.154 INFO:tasks.workunit.client.1.smithi115.stdout:3/23: unlink f7 0 2024-04-16T14:35:30.156 INFO:tasks.workunit.client.0.smithi005.stdout:6/369: read d2/d20/d3c/f59 [1169109,21293] 0 2024-04-16T14:35:30.156 INFO:tasks.workunit.client.0.smithi005.stdout:6/370: chown d2/d3f/d53 13455 1 2024-04-16T14:35:30.157 INFO:tasks.workunit.client.0.smithi005.stdout:3/178: symlink d2/d17/l3e 0 2024-04-16T14:35:30.157 INFO:tasks.workunit.client.0.smithi005.stdout:7/287: rmdir d1/d5/d16/d47 39 2024-04-16T14:35:30.157 INFO:tasks.workunit.client.0.smithi005.stdout:7/288: readlink d1/l41 0 2024-04-16T14:35:30.159 INFO:tasks.workunit.client.0.smithi005.stdout:0/286: write da/df/f1e [65692,128767] 0 2024-04-16T14:35:30.160 INFO:tasks.workunit.client.0.smithi005.stdout:2/131: unlink d0/d1e/c25 0 2024-04-16T14:35:30.161 INFO:tasks.workunit.client.1.smithi115.stdout:7/43: read d0/d2/fb [950388,57291] 0 2024-04-16T14:35:30.161 INFO:tasks.workunit.client.1.smithi115.stdout:7/44: write d0/d2/fb [3452488,55282] 0 2024-04-16T14:35:30.162 INFO:tasks.workunit.client.0.smithi005.stdout:6/371: symlink d2/d3f/d53/d54/l7e 0 2024-04-16T14:35:30.163 INFO:tasks.workunit.client.0.smithi005.stdout:3/179: symlink d2/d17/d1e/l3f 0 2024-04-16T14:35:30.164 INFO:tasks.workunit.client.1.smithi115.stdout:7/45: creat d0/fe x:0 0 0 2024-04-16T14:35:30.164 INFO:tasks.workunit.client.0.smithi005.stdout:7/289: dread d1/d5/d22/f30 [0,4194304] 0 2024-04-16T14:35:30.164 INFO:tasks.workunit.client.0.smithi005.stdout:7/290: write d1/dc/d2f/f4c [1532915,21140] 0 2024-04-16T14:35:30.166 INFO:tasks.workunit.client.1.smithi115.stdout:7/46: creat d0/d2/ff x:0 0 0 2024-04-16T14:35:30.168 INFO:tasks.workunit.client.1.smithi115.stdout:7/47: rename d0/d1/l7 to d0/d1/l10 0 2024-04-16T14:35:30.168 INFO:tasks.workunit.client.1.smithi115.stdout:7/48: creat d0/d2/f11 x:0 0 0 2024-04-16T14:35:30.170 INFO:tasks.workunit.client.1.smithi115.stdout:7/49: rmdir d0/d1 39 2024-04-16T14:35:30.171 INFO:tasks.workunit.client.1.smithi115.stdout:7/50: readlink d0/l3 0 2024-04-16T14:35:30.175 INFO:tasks.workunit.client.0.smithi005.stdout:8/279: rename d5/de/f2a to d5/d55/f5e 0 2024-04-16T14:35:30.176 INFO:tasks.workunit.client.0.smithi005.stdout:3/180: rmdir d2/d9/df/d30 0 2024-04-16T14:35:30.178 INFO:tasks.workunit.client.0.smithi005.stdout:0/287: getdents da/df 0 2024-04-16T14:35:30.179 INFO:tasks.workunit.client.0.smithi005.stdout:5/211: dwrite d0/d6/d12/f23 [0,4194304] 0 2024-04-16T14:35:30.179 INFO:tasks.workunit.client.0.smithi005.stdout:5/212: dread - d0/d6/d12/d1c/f2a zero size 2024-04-16T14:35:30.182 INFO:tasks.workunit.client.0.smithi005.stdout:0/288: creat da/df/d26/d39/d55/f5e x:0 0 0 2024-04-16T14:35:30.182 INFO:tasks.workunit.client.0.smithi005.stdout:0/289: write da/f20 [98497,63188] 0 2024-04-16T14:35:30.184 INFO:tasks.workunit.client.0.smithi005.stdout:5/213: creat d0/d6/d12/d1c/d1e/f3e x:0 0 0 2024-04-16T14:35:30.186 INFO:tasks.workunit.client.0.smithi005.stdout:0/290: symlink da/df/d26/d39/l5f 0 2024-04-16T14:35:30.186 INFO:tasks.workunit.client.0.smithi005.stdout:0/291: write da/df/d1b/d3a/d53/f4f [172492,7292] 0 2024-04-16T14:35:30.187 INFO:tasks.workunit.client.0.smithi005.stdout:5/214: symlink d0/d6/l3f 0 2024-04-16T14:35:30.187 INFO:tasks.workunit.client.0.smithi005.stdout:8/280: write f4 [3674526,112555] 0 2024-04-16T14:35:30.188 INFO:tasks.workunit.client.0.smithi005.stdout:9/161: dwrite d3/d12/f28 [0,4194304] 0 2024-04-16T14:35:30.189 INFO:tasks.workunit.client.0.smithi005.stdout:5/215: mknod d0/d6/d12/d1c/c40 0 2024-04-16T14:35:30.189 INFO:tasks.workunit.client.0.smithi005.stdout:3/181: dwrite d2/f21 [0,4194304] 0 2024-04-16T14:35:30.190 INFO:tasks.workunit.client.0.smithi005.stdout:0/292: dread f0 [0,4194304] 0 2024-04-16T14:35:30.190 INFO:tasks.workunit.client.0.smithi005.stdout:0/293: write da/f20 [579048,1365] 0 2024-04-16T14:35:30.198 INFO:tasks.workunit.client.0.smithi005.stdout:7/291: dwrite d1/d5/f11 [0,4194304] 0 2024-04-16T14:35:30.198 INFO:tasks.workunit.client.1.smithi115.stdout:3/24: dwrite f3 [0,4194304] 0 2024-04-16T14:35:30.200 INFO:tasks.workunit.client.1.smithi115.stdout:3/25: unlink l8 0 2024-04-16T14:35:30.201 INFO:tasks.workunit.client.1.smithi115.stdout:3/26: symlink l9 0 2024-04-16T14:35:30.204 INFO:tasks.workunit.client.0.smithi005.stdout:1/382: dwrite d2/d1c/d15/d2a/d19/d42/d64/f7e [0,4194304] 0 2024-04-16T14:35:30.219 INFO:tasks.workunit.client.0.smithi005.stdout:1/383: write d2/d1c/d15/d2a/d19/f84 [3240879,55645] 0 2024-04-16T14:35:30.252 INFO:tasks.workunit.client.1.smithi115.stdout:5/11: getdents . 0 2024-04-16T14:35:30.252 INFO:tasks.workunit.client.1.smithi115.stdout:5/12: truncate f0 4536861 0 2024-04-16T14:35:30.261 INFO:tasks.workunit.client.0.smithi005.stdout:2/132: dwrite d0/d1e/f11 [0,4194304] 0 2024-04-16T14:35:30.265 INFO:tasks.workunit.client.1.smithi115.stdout:3/27: dwrite f2 [0,4194304] 0 2024-04-16T14:35:30.266 INFO:tasks.workunit.client.0.smithi005.stdout:8/281: dwrite d5/de/f25 [0,4194304] 0 2024-04-16T14:35:30.268 INFO:tasks.workunit.client.1.smithi115.stdout:3/28: rename f2 to fa 0 2024-04-16T14:35:30.269 INFO:tasks.workunit.client.0.smithi005.stdout:5/216: dwrite d0/f28 [0,4194304] 0 2024-04-16T14:35:30.269 INFO:tasks.workunit.client.0.smithi005.stdout:5/217: write d0/d6/f36 [780320,53931] 0 2024-04-16T14:35:30.269 INFO:tasks.workunit.client.0.smithi005.stdout:5/218: creat d0/d6/d12/f41 x:0 0 0 2024-04-16T14:35:30.270 INFO:tasks.workunit.client.0.smithi005.stdout:1/384: dread d2/d1c/f58 [0,4194304] 0 2024-04-16T14:35:30.271 INFO:tasks.workunit.client.0.smithi005.stdout:9/162: symlink d3/d12/l2c 0 2024-04-16T14:35:30.274 INFO:tasks.workunit.client.0.smithi005.stdout:3/182: symlink d2/l40 0 2024-04-16T14:35:30.275 INFO:tasks.workunit.client.0.smithi005.stdout:0/294: rmdir da/df/d1b/d59 0 2024-04-16T14:35:30.275 INFO:tasks.workunit.client.0.smithi005.stdout:0/295: read - da/f1f zero size 2024-04-16T14:35:30.276 INFO:tasks.workunit.client.1.smithi115.stdout:3/29: dread f3 [0,4194304] 0 2024-04-16T14:35:30.276 INFO:tasks.workunit.client.1.smithi115.stdout:3/30: creat fb x:0 0 0 2024-04-16T14:35:30.279 INFO:tasks.workunit.client.1.smithi115.stdout:7/51: dwrite d0/d2/fb [0,4194304] 0 2024-04-16T14:35:30.281 INFO:tasks.workunit.client.0.smithi005.stdout:2/133: dread d0/d1e/f17 [0,4194304] 0 2024-04-16T14:35:30.288 INFO:tasks.workunit.client.0.smithi005.stdout:5/219: unlink d0/d6/f39 0 2024-04-16T14:35:30.288 INFO:tasks.workunit.client.0.smithi005.stdout:5/220: chown d0/d6/d12/d1c/f22 65227719 1 2024-04-16T14:35:30.290 INFO:tasks.workunit.client.0.smithi005.stdout:2/134: write d0/d1e/f11 [4050319,120831] 0 2024-04-16T14:35:30.291 INFO:tasks.workunit.client.0.smithi005.stdout:9/163: rmdir d3/d12/d16/d24 0 2024-04-16T14:35:30.294 INFO:tasks.workunit.client.1.smithi115.stdout:7/52: dwrite d0/d2/ff [0,4194304] 0 2024-04-16T14:35:30.294 INFO:tasks.workunit.client.1.smithi115.stdout:7/53: write d0/d2/f11 [544778,102269] 0 2024-04-16T14:35:30.295 INFO:tasks.workunit.client.0.smithi005.stdout:8/282: creat d5/d11/f5f x:0 0 0 2024-04-16T14:35:30.298 INFO:tasks.workunit.client.0.smithi005.stdout:0/296: symlink da/l60 0 2024-04-16T14:35:30.298 INFO:tasks.workunit.client.0.smithi005.stdout:9/164: dread d3/d12/d16/f1d [0,4194304] 0 2024-04-16T14:35:30.298 INFO:tasks.workunit.client.0.smithi005.stdout:9/165: fdatasync d3/f10 0 2024-04-16T14:35:30.299 INFO:tasks.workunit.client.0.smithi005.stdout:7/292: rename d1/d5/c9 to d1/d5/c54 0 2024-04-16T14:35:30.303 INFO:tasks.workunit.client.1.smithi115.stdout:9/21: truncate d1/f2 2693627 0 2024-04-16T14:35:30.303 INFO:tasks.workunit.client.1.smithi115.stdout:9/22: chown d1/l4 179 1 2024-04-16T14:35:30.303 INFO:tasks.workunit.client.1.smithi115.stdout:9/23: readlink d1/l4 0 2024-04-16T14:35:30.306 INFO:tasks.workunit.client.0.smithi005.stdout:1/385: rename d2/d1c/d15/d2a/l3c to d2/d1c/d15/d2a/d19/d6e/d7b/l8c 0 2024-04-16T14:35:30.307 INFO:tasks.workunit.client.0.smithi005.stdout:8/283: mknod d5/d55/c60 0 2024-04-16T14:35:30.309 INFO:tasks.workunit.client.0.smithi005.stdout:9/166: mknod d3/c2d 0 2024-04-16T14:35:30.309 INFO:tasks.workunit.client.0.smithi005.stdout:9/167: chown d3/d12/f2a 1387228722 1 2024-04-16T14:35:30.315 INFO:tasks.workunit.client.0.smithi005.stdout:1/386: rename d2/d1c/fd to d2/d1c/d15/d6f/f8d 0 2024-04-16T14:35:30.317 INFO:tasks.workunit.client.0.smithi005.stdout:9/168: mknod d3/d12/d2b/c2e 0 2024-04-16T14:35:30.318 INFO:tasks.workunit.client.0.smithi005.stdout:1/387: creat d2/d1c/d15/d2a/d1a/d2e/d83/f8e x:0 0 0 2024-04-16T14:35:30.319 INFO:tasks.workunit.client.0.smithi005.stdout:5/221: rmdir d0/d6/d12 39 2024-04-16T14:35:30.319 INFO:tasks.workunit.client.0.smithi005.stdout:0/297: dwrite da/f1f [0,4194304] 0 2024-04-16T14:35:30.320 INFO:tasks.workunit.client.0.smithi005.stdout:0/298: stat da/df/d26/d39/d55 0 2024-04-16T14:35:30.323 INFO:tasks.workunit.client.0.smithi005.stdout:7/293: dwrite d1/d5/d16/f3b [0,4194304] 0 2024-04-16T14:35:30.324 INFO:tasks.workunit.client.1.smithi115.stdout:9/24: dwrite f0 [0,4194304] 0 2024-04-16T14:35:30.325 INFO:tasks.workunit.client.0.smithi005.stdout:9/169: dread d3/d12/f23 [0,4194304] 0 2024-04-16T14:35:30.325 INFO:tasks.workunit.client.0.smithi005.stdout:9/170: read - d3/d12/f2a zero size 2024-04-16T14:35:30.334 INFO:tasks.workunit.client.0.smithi005.stdout:8/284: getdents d5/d55 0 2024-04-16T14:35:30.335 INFO:tasks.workunit.client.0.smithi005.stdout:9/171: dread d3/f8 [0,4194304] 0 2024-04-16T14:35:30.337 INFO:tasks.workunit.client.0.smithi005.stdout:8/285: creat d5/d40/f61 x:0 0 0 2024-04-16T14:35:30.337 INFO:tasks.workunit.client.0.smithi005.stdout:4/362: sync 2024-04-16T14:35:30.338 INFO:tasks.workunit.client.0.smithi005.stdout:2/135: truncate d0/d1e/f11 2025202 0 2024-04-16T14:35:30.340 INFO:tasks.workunit.client.0.smithi005.stdout:2/136: dread d0/fb [0,4194304] 0 2024-04-16T14:35:30.341 INFO:tasks.workunit.client.0.smithi005.stdout:9/172: creat d3/d12/d2b/f2f x:0 0 0 2024-04-16T14:35:30.341 INFO:tasks.workunit.client.0.smithi005.stdout:9/173: stat d3/d12/d16/l20 0 2024-04-16T14:35:30.342 INFO:tasks.workunit.client.0.smithi005.stdout:9/174: write d3/d12/d16/f1a [4439455,53523] 0 2024-04-16T14:35:30.342 INFO:tasks.workunit.client.0.smithi005.stdout:9/175: stat d3/c22 0 2024-04-16T14:35:30.343 INFO:tasks.workunit.client.0.smithi005.stdout:0/299: dwrite f1 [0,4194304] 0 2024-04-16T14:35:30.343 INFO:tasks.workunit.client.0.smithi005.stdout:7/294: dwrite d1/d5/d22/d27/f46 [0,4194304] 0 2024-04-16T14:35:30.344 INFO:tasks.workunit.client.0.smithi005.stdout:7/295: readlink d1/d5/d22/d27/d2e/l37 0 2024-04-16T14:35:30.349 INFO:tasks.workunit.client.0.smithi005.stdout:2/137: unlink d0/d1e/f13 0 2024-04-16T14:35:30.350 INFO:tasks.workunit.client.0.smithi005.stdout:3/183: dwrite d2/f21 [4194304,4194304] 0 2024-04-16T14:35:30.353 INFO:tasks.workunit.client.0.smithi005.stdout:2/138: dread d0/f21 [0,4194304] 0 2024-04-16T14:35:30.353 INFO:tasks.workunit.client.0.smithi005.stdout:7/296: rmdir d1/d5/d22/d27/d2e 39 2024-04-16T14:35:30.353 INFO:tasks.workunit.client.0.smithi005.stdout:7/297: creat d1/f55 x:0 0 0 2024-04-16T14:35:30.355 INFO:tasks.workunit.client.0.smithi005.stdout:7/298: write d1/f29 [581938,67185] 0 2024-04-16T14:35:30.355 INFO:tasks.workunit.client.0.smithi005.stdout:7/299: stat d1/c3f 0 2024-04-16T14:35:30.355 INFO:tasks.workunit.client.0.smithi005.stdout:3/184: mkdir d2/d17/d1e/d41 0 2024-04-16T14:35:30.356 INFO:tasks.workunit.client.0.smithi005.stdout:2/139: dread d0/fb [0,4194304] 0 2024-04-16T14:35:30.357 INFO:tasks.workunit.client.0.smithi005.stdout:3/185: stat d2/d9/df/l2e 0 2024-04-16T14:35:30.357 INFO:tasks.workunit.client.0.smithi005.stdout:3/186: read - d2/d17/d1e/f36 zero size 2024-04-16T14:35:30.357 INFO:tasks.workunit.client.0.smithi005.stdout:3/187: chown d2/c1b 614529 1 2024-04-16T14:35:30.358 INFO:tasks.workunit.client.0.smithi005.stdout:2/140: rename d0/f21 to d0/f27 0 2024-04-16T14:35:30.359 INFO:tasks.workunit.client.0.smithi005.stdout:3/188: truncate d2/fe 2366178 0 2024-04-16T14:35:30.360 INFO:tasks.workunit.client.0.smithi005.stdout:2/141: creat d0/d4/f28 x:0 0 0 2024-04-16T14:35:30.361 INFO:tasks.workunit.client.0.smithi005.stdout:2/142: write d0/d1e/f11 [2595384,46710] 0 2024-04-16T14:35:30.361 INFO:tasks.workunit.client.0.smithi005.stdout:2/143: fdatasync d0/d4/f28 0 2024-04-16T14:35:30.366 INFO:tasks.workunit.client.0.smithi005.stdout:9/176: dread d3/d12/d16/f1a [0,4194304] 0 2024-04-16T14:35:30.366 INFO:tasks.workunit.client.0.smithi005.stdout:9/177: chown d3/f25 119861 1 2024-04-16T14:35:30.367 INFO:tasks.workunit.client.0.smithi005.stdout:7/300: dread d1/d5/d16/f3b [0,4194304] 0 2024-04-16T14:35:30.368 INFO:tasks.workunit.client.0.smithi005.stdout:0/300: dwrite da/df/d1b/d3a/d53/f4f [0,4194304] 0 2024-04-16T14:35:30.369 INFO:tasks.workunit.client.0.smithi005.stdout:8/286: dwrite d5/d11/d1f/f4e [0,4194304] 0 2024-04-16T14:35:30.372 INFO:tasks.workunit.client.0.smithi005.stdout:8/287: read d5/d11/f47 [49952,101092] 0 2024-04-16T14:35:30.378 INFO:tasks.workunit.client.0.smithi005.stdout:7/301: dread d1/d5/d16/f4a [0,4194304] 0 2024-04-16T14:35:30.378 INFO:tasks.workunit.client.0.smithi005.stdout:7/302: stat d1/l41 0 2024-04-16T14:35:30.378 INFO:tasks.workunit.client.0.smithi005.stdout:4/363: dwrite d0/f7 [4194304,4194304] 0 2024-04-16T14:35:30.378 INFO:tasks.workunit.client.0.smithi005.stdout:7/303: fsync d1/f55 0 2024-04-16T14:35:30.378 INFO:tasks.workunit.client.0.smithi005.stdout:4/364: fsync d0/d1b/d1d/d1f/d3e/f55 0 2024-04-16T14:35:30.381 INFO:tasks.workunit.client.0.smithi005.stdout:7/304: symlink d1/d5/d22/d27/d2e/l56 0 2024-04-16T14:35:30.381 INFO:tasks.workunit.client.0.smithi005.stdout:7/305: write d1/d5/d22/f28 [4919263,67111] 0 2024-04-16T14:35:30.381 INFO:tasks.workunit.client.0.smithi005.stdout:7/306: write d1/dc/d2f/f4c [1716776,794] 0 2024-04-16T14:35:30.382 INFO:tasks.workunit.client.0.smithi005.stdout:4/365: symlink d0/d22/d29/d63/l66 0 2024-04-16T14:35:30.382 INFO:tasks.workunit.client.0.smithi005.stdout:4/366: creat d0/d1b/d1d/f67 x:0 0 0 2024-04-16T14:35:30.383 INFO:tasks.workunit.client.0.smithi005.stdout:4/367: truncate d0/f58 356282 0 2024-04-16T14:35:30.383 INFO:tasks.workunit.client.0.smithi005.stdout:4/368: truncate d0/d1b/d1d/f67 402243 0 2024-04-16T14:35:30.383 INFO:tasks.workunit.client.0.smithi005.stdout:4/369: fdatasync d0/f5 0 2024-04-16T14:35:30.384 INFO:tasks.workunit.client.0.smithi005.stdout:4/370: symlink d0/d4d/l68 0 2024-04-16T14:35:30.386 INFO:tasks.workunit.client.0.smithi005.stdout:4/371: symlink d0/d22/d61/l69 0 2024-04-16T14:35:30.386 INFO:tasks.workunit.client.0.smithi005.stdout:4/372: write d0/f12 [3718014,90495] 0 2024-04-16T14:35:30.386 INFO:tasks.workunit.client.0.smithi005.stdout:4/373: write d0/f5c [656171,117256] 0 2024-04-16T14:35:30.387 INFO:tasks.workunit.client.0.smithi005.stdout:4/374: stat d0/d4d/l68 0 2024-04-16T14:35:30.387 INFO:tasks.workunit.client.0.smithi005.stdout:4/375: write d0/d1b/d1d/f21 [4721260,122688] 0 2024-04-16T14:35:30.387 INFO:tasks.workunit.client.0.smithi005.stdout:4/376: symlink d0/d22/d61/l6a 0 2024-04-16T14:35:30.397 INFO:tasks.workunit.client.0.smithi005.stdout:9/178: dwrite d3/d12/d16/f19 [0,4194304] 0 2024-04-16T14:35:30.397 INFO:tasks.workunit.client.0.smithi005.stdout:0/301: dwrite da/f30 [0,4194304] 0 2024-04-16T14:35:30.397 INFO:tasks.workunit.client.0.smithi005.stdout:0/302: chown da/df/d1b/d3a/d53/d5a 203 1 2024-04-16T14:35:30.401 INFO:tasks.workunit.client.1.smithi115.stdout:1/15: fsync f4 0 2024-04-16T14:35:30.401 INFO:tasks.workunit.client.0.smithi005.stdout:9/179: dread d3/f8 [0,4194304] 0 2024-04-16T14:35:30.404 INFO:tasks.workunit.client.0.smithi005.stdout:8/288: dwrite d5/fb [0,4194304] 0 2024-04-16T14:35:30.404 INFO:tasks.workunit.client.0.smithi005.stdout:9/180: truncate d3/f10 1318384 0 2024-04-16T14:35:30.404 INFO:tasks.workunit.client.0.smithi005.stdout:9/181: chown d3/f14 642983 1 2024-04-16T14:35:30.404 INFO:tasks.workunit.client.0.smithi005.stdout:7/307: dwrite d1/d5/d22/d27/f46 [0,4194304] 0 2024-04-16T14:35:30.406 INFO:tasks.workunit.client.1.smithi115.stdout:3/31: truncate f6 1723090 0 2024-04-16T14:35:30.408 INFO:tasks.workunit.client.1.smithi115.stdout:3/32: mkdir dc 0 2024-04-16T14:35:30.408 INFO:tasks.workunit.client.1.smithi115.stdout:3/33: truncate fa 4514551 0 2024-04-16T14:35:30.408 INFO:tasks.workunit.client.0.smithi005.stdout:9/182: creat d3/d12/f30 x:0 0 0 2024-04-16T14:35:30.412 INFO:tasks.workunit.client.0.smithi005.stdout:8/289: dread d5/d11/d1f/d2f/f34 [0,4194304] 0 2024-04-16T14:35:30.413 INFO:tasks.workunit.client.0.smithi005.stdout:4/377: getdents d0/d22/d61 0 2024-04-16T14:35:30.414 INFO:tasks.workunit.client.1.smithi115.stdout:3/34: rename fa to dc/fd 0 2024-04-16T14:35:30.415 INFO:tasks.workunit.client.0.smithi005.stdout:9/183: truncate d3/d12/f23 2104862 0 2024-04-16T14:35:30.415 INFO:tasks.workunit.client.0.smithi005.stdout:9/184: write d3/f25 [759360,34312] 0 2024-04-16T14:35:30.417 INFO:tasks.workunit.client.1.smithi115.stdout:1/16: dwrite f4 [0,4194304] 0 2024-04-16T14:35:30.417 INFO:tasks.workunit.client.1.smithi115.stdout:1/17: creat f5 x:0 0 0 2024-04-16T14:35:30.417 INFO:tasks.workunit.client.1.smithi115.stdout:7/54: truncate d0/d2/ff 1441328 0 2024-04-16T14:35:30.422 INFO:tasks.workunit.client.0.smithi005.stdout:8/290: rmdir d5/de 39 2024-04-16T14:35:30.422 INFO:tasks.workunit.client.0.smithi005.stdout:8/291: creat d5/d11/f62 x:0 0 0 2024-04-16T14:35:30.422 INFO:tasks.workunit.client.0.smithi005.stdout:8/292: write d5/d11/d1f/f24 [1704751,70795] 0 2024-04-16T14:35:30.423 INFO:tasks.workunit.client.0.smithi005.stdout:7/308: rename d1/d5/d16 to d1/d5/d57 0 2024-04-16T14:35:30.424 INFO:tasks.workunit.client.1.smithi115.stdout:7/55: dread d0/d2/f11 [0,4194304] 0 2024-04-16T14:35:30.425 INFO:tasks.workunit.client.0.smithi005.stdout:8/293: symlink d5/d40/d4b/l63 0 2024-04-16T14:35:30.426 INFO:tasks.workunit.client.1.smithi115.stdout:3/35: getdents dc 0 2024-04-16T14:35:30.426 INFO:tasks.workunit.client.1.smithi115.stdout:3/36: chown f6 164887990 1 2024-04-16T14:35:30.426 INFO:tasks.workunit.client.1.smithi115.stdout:7/56: symlink d0/l12 0 2024-04-16T14:35:30.426 INFO:tasks.workunit.client.1.smithi115.stdout:7/57: dread - d0/fe zero size 2024-04-16T14:35:30.427 INFO:tasks.workunit.client.0.smithi005.stdout:7/309: link d1/cf d1/d5/d22/c58 0 2024-04-16T14:35:30.427 INFO:tasks.workunit.client.0.smithi005.stdout:7/310: fsync d1/d5/d22/d27/d3a/f40 0 2024-04-16T14:35:30.428 INFO:tasks.workunit.client.0.smithi005.stdout:8/294: symlink d5/l64 0 2024-04-16T14:35:30.428 INFO:tasks.workunit.client.0.smithi005.stdout:8/295: truncate d5/d11/f47 1132830 0 2024-04-16T14:35:30.428 INFO:tasks.workunit.client.1.smithi115.stdout:3/37: creat dc/fe x:0 0 0 2024-04-16T14:35:30.428 INFO:tasks.workunit.client.1.smithi115.stdout:3/38: readlink l9 0 2024-04-16T14:35:30.429 INFO:tasks.workunit.client.0.smithi005.stdout:8/296: mknod d5/d11/d1f/c65 0 2024-04-16T14:35:30.430 INFO:tasks.workunit.client.1.smithi115.stdout:7/58: link d0/l12 d0/d1/l13 0 2024-04-16T14:35:30.432 INFO:tasks.workunit.client.0.smithi005.stdout:8/297: link d5/d11/d1f/d2f/d3d/f52 d5/f66 0 2024-04-16T14:35:30.432 INFO:tasks.workunit.client.1.smithi115.stdout:3/39: link f6 dc/ff 0 2024-04-16T14:35:30.432 INFO:tasks.workunit.client.1.smithi115.stdout:3/40: dread - dc/fe zero size 2024-04-16T14:35:30.433 INFO:tasks.workunit.client.1.smithi115.stdout:3/41: dread - dc/fe zero size 2024-04-16T14:35:30.433 INFO:tasks.workunit.client.1.smithi115.stdout:3/42: chown dc/ff 631 1 2024-04-16T14:35:30.433 INFO:tasks.workunit.client.1.smithi115.stdout:3/43: dread - fb zero size 2024-04-16T14:35:30.434 INFO:tasks.workunit.client.1.smithi115.stdout:7/59: link d0/l12 d0/d2/l14 0 2024-04-16T14:35:30.435 INFO:tasks.workunit.client.0.smithi005.stdout:8/298: link d5/de/f59 d5/d11/f67 0 2024-04-16T14:35:30.436 INFO:tasks.workunit.client.0.smithi005.stdout:9/185: dread d3/ff [4194304,4194304] 0 2024-04-16T14:35:30.436 INFO:tasks.workunit.client.1.smithi115.stdout:3/44: symlink dc/l10 0 2024-04-16T14:35:30.437 INFO:tasks.workunit.client.1.smithi115.stdout:3/45: read - dc/fe zero size 2024-04-16T14:35:30.437 INFO:tasks.workunit.client.1.smithi115.stdout:3/46: write fb [747885,124794] 0 2024-04-16T14:35:30.437 INFO:tasks.workunit.client.1.smithi115.stdout:7/60: mknod d0/c15 0 2024-04-16T14:35:30.437 INFO:tasks.workunit.client.1.smithi115.stdout:7/61: readlink d0/l12 0 2024-04-16T14:35:30.437 INFO:tasks.workunit.client.1.smithi115.stdout:7/62: chown d0/d1/l10 7 1 2024-04-16T14:35:30.437 INFO:tasks.workunit.client.1.smithi115.stdout:7/63: dread - d0/fe zero size 2024-04-16T14:35:30.439 INFO:tasks.workunit.client.1.smithi115.stdout:7/64: link d0/fe d0/f16 0 2024-04-16T14:35:30.442 INFO:tasks.workunit.client.0.smithi005.stdout:4/378: dwrite d0/f10 [0,4194304] 0 2024-04-16T14:35:30.443 INFO:tasks.workunit.client.0.smithi005.stdout:4/379: write d0/d22/d29/d63/f3b [1111898,36529] 0 2024-04-16T14:35:30.443 INFO:tasks.workunit.client.1.smithi115.stdout:9/25: dwrite d1/f3 [0,4194304] 0 2024-04-16T14:35:30.445 INFO:tasks.workunit.client.0.smithi005.stdout:4/380: symlink d0/d1b/d1d/d1f/d3e/l6b 0 2024-04-16T14:35:30.449 INFO:tasks.workunit.client.0.smithi005.stdout:4/381: symlink d0/d4d/l6c 0 2024-04-16T14:35:30.450 INFO:tasks.workunit.client.0.smithi005.stdout:4/382: rmdir d0/d22/d29 39 2024-04-16T14:35:30.451 INFO:tasks.workunit.client.0.smithi005.stdout:4/383: truncate d0/f2c 3648363 0 2024-04-16T14:35:30.453 INFO:tasks.workunit.client.0.smithi005.stdout:7/311: dread d1/d5/d22/d27/f45 [0,4194304] 0 2024-04-16T14:35:30.456 INFO:tasks.workunit.client.0.smithi005.stdout:4/384: rename d0/d1b/d51 to d0/d1b/d1d/d1f/d3e/d6d 0 2024-04-16T14:35:30.458 INFO:tasks.workunit.client.0.smithi005.stdout:7/312: link d1/f55 d1/d5/d22/f59 0 2024-04-16T14:35:30.460 INFO:tasks.workunit.client.0.smithi005.stdout:4/385: creat d0/d1b/d1d/d1f/f6e x:0 0 0 2024-04-16T14:35:30.460 INFO:tasks.workunit.client.0.smithi005.stdout:4/386: dread - d0/d4d/f56 zero size 2024-04-16T14:35:30.460 INFO:tasks.workunit.client.0.smithi005.stdout:4/387: chown d0/d22/d29/d63 12 1 2024-04-16T14:35:30.461 INFO:tasks.workunit.client.0.smithi005.stdout:7/313: creat d1/dc/d2f/f5a x:0 0 0 2024-04-16T14:35:30.462 INFO:tasks.workunit.client.0.smithi005.stdout:7/314: chown d1/d5/d22/d27/l34 1 1 2024-04-16T14:35:30.463 INFO:tasks.workunit.client.0.smithi005.stdout:4/388: symlink d0/d22/l6f 0 2024-04-16T14:35:30.464 INFO:tasks.workunit.client.1.smithi115.stdout:3/47: rmdir dc 39 2024-04-16T14:35:30.465 INFO:tasks.workunit.client.0.smithi005.stdout:7/315: creat d1/d49/f5b x:0 0 0 2024-04-16T14:35:30.466 INFO:tasks.workunit.client.0.smithi005.stdout:4/389: link d0/lc d0/d1b/d1d/d1f/d48/l70 0 2024-04-16T14:35:30.467 INFO:tasks.workunit.client.0.smithi005.stdout:7/316: mkdir d1/d5/d22/d27/d3a/d5c 0 2024-04-16T14:35:30.467 INFO:tasks.workunit.client.0.smithi005.stdout:7/317: fsync d1/d5/d22/d27/d2e/f48 0 2024-04-16T14:35:30.467 INFO:tasks.workunit.client.0.smithi005.stdout:7/318: creat d1/dc/d2f/f5d x:0 0 0 2024-04-16T14:35:30.468 INFO:tasks.workunit.client.0.smithi005.stdout:4/390: symlink d0/d4d/l71 0 2024-04-16T14:35:30.468 INFO:tasks.workunit.client.0.smithi005.stdout:4/391: chown d0/d4d/l71 68518971 1 2024-04-16T14:35:30.468 INFO:tasks.workunit.client.0.smithi005.stdout:4/392: read d0/f58 [303988,39884] 0 2024-04-16T14:35:30.469 INFO:tasks.workunit.client.0.smithi005.stdout:4/393: chown d0/l18 482354202 1 2024-04-16T14:35:30.470 INFO:tasks.workunit.client.0.smithi005.stdout:8/299: dwrite d5/d11/d1f/d2f/d3d/f52 [0,4194304] 0 2024-04-16T14:35:30.470 INFO:tasks.workunit.client.0.smithi005.stdout:8/300: fdatasync d5/d11/d1f/d2f/f34 0 2024-04-16T14:35:30.470 INFO:tasks.workunit.client.1.smithi115.stdout:7/65: dwrite d0/d2/fb [0,4194304] 0 2024-04-16T14:35:30.471 INFO:tasks.workunit.client.1.smithi115.stdout:7/66: creat d0/d2/f17 x:0 0 0 2024-04-16T14:35:30.471 INFO:tasks.workunit.client.1.smithi115.stdout:7/67: chown d0/l3 0 1 2024-04-16T14:35:30.471 INFO:tasks.workunit.client.1.smithi115.stdout:9/26: dwrite d1/f3 [0,4194304] 0 2024-04-16T14:35:30.471 INFO:tasks.workunit.client.1.smithi115.stdout:9/27: truncate f0 5142243 0 2024-04-16T14:35:30.472 INFO:tasks.workunit.client.1.smithi115.stdout:7/68: symlink d0/d2/l18 0 2024-04-16T14:35:30.472 INFO:tasks.workunit.client.0.smithi005.stdout:7/319: truncate d1/d5/d22/f30 696794 0 2024-04-16T14:35:30.472 INFO:tasks.workunit.client.0.smithi005.stdout:7/320: chown d1/d5/d57 38146 1 2024-04-16T14:35:30.475 INFO:tasks.workunit.client.1.smithi115.stdout:7/69: dread d0/d2/f11 [0,4194304] 0 2024-04-16T14:35:30.476 INFO:tasks.workunit.client.1.smithi115.stdout:7/70: write d0/d2/f11 [1653067,4827] 0 2024-04-16T14:35:30.476 INFO:tasks.workunit.client.1.smithi115.stdout:7/71: creat d0/f19 x:0 0 0 2024-04-16T14:35:30.478 INFO:tasks.workunit.client.1.smithi115.stdout:7/72: rename d0/f19 to d0/f1a 0 2024-04-16T14:35:30.479 INFO:tasks.workunit.client.1.smithi115.stdout:7/73: link d0/d2/l18 d0/d1/l1b 0 2024-04-16T14:35:30.481 INFO:tasks.workunit.client.1.smithi115.stdout:7/74: rename d0/d1/l13 to d0/d1/l1c 0 2024-04-16T14:35:30.481 INFO:tasks.workunit.client.1.smithi115.stdout:7/75: write d0/d2/f11 [1150760,33630] 0 2024-04-16T14:35:30.482 INFO:tasks.workunit.client.1.smithi115.stdout:7/76: symlink d0/d2/l1d 0 2024-04-16T14:35:30.483 INFO:tasks.workunit.client.1.smithi115.stdout:7/77: unlink d0/d2/fb 0 2024-04-16T14:35:30.484 INFO:tasks.workunit.client.1.smithi115.stdout:7/78: write d0/fe [116746,118686] 0 2024-04-16T14:35:30.484 INFO:tasks.workunit.client.1.smithi115.stdout:7/79: write d0/f1a [877747,70531] 0 2024-04-16T14:35:30.484 INFO:tasks.workunit.client.1.smithi115.stdout:7/80: mknod d0/c1e 0 2024-04-16T14:35:30.484 INFO:tasks.workunit.client.1.smithi115.stdout:7/81: read - d0/d2/f17 zero size 2024-04-16T14:35:30.489 INFO:tasks.workunit.client.1.smithi115.stdout:9/28: dwrite d1/f3 [0,4194304] 0 2024-04-16T14:35:30.489 INFO:tasks.workunit.client.1.smithi115.stdout:3/48: dwrite fb [0,4194304] 0 2024-04-16T14:35:30.490 INFO:tasks.workunit.client.1.smithi115.stdout:3/49: write f6 [1955030,25397] 0 2024-04-16T14:35:30.490 INFO:tasks.workunit.client.1.smithi115.stdout:3/50: readlink dc/l10 0 2024-04-16T14:35:30.490 INFO:tasks.workunit.client.1.smithi115.stdout:3/51: chown f6 908142650 1 2024-04-16T14:35:30.492 INFO:tasks.workunit.client.1.smithi115.stdout:9/29: symlink d1/l5 0 2024-04-16T14:35:30.493 INFO:tasks.workunit.client.1.smithi115.stdout:3/52: dread f3 [0,4194304] 0 2024-04-16T14:35:30.493 INFO:tasks.workunit.client.1.smithi115.stdout:3/53: fsync dc/fe 0 2024-04-16T14:35:30.493 INFO:tasks.workunit.client.1.smithi115.stdout:9/30: mkdir d1/d6 0 2024-04-16T14:35:30.501 INFO:tasks.workunit.client.1.smithi115.stdout:3/54: dread fb [0,4194304] 0 2024-04-16T14:35:30.510 INFO:tasks.workunit.client.1.smithi115.stdout:9/31: dwrite f0 [0,4194304] 0 2024-04-16T14:35:30.510 INFO:tasks.workunit.client.1.smithi115.stdout:9/32: stat d1/d6 0 2024-04-16T14:35:30.511 INFO:tasks.workunit.client.1.smithi115.stdout:9/33: mknod d1/d6/c7 0 2024-04-16T14:35:30.517 INFO:tasks.workunit.client.1.smithi115.stdout:3/55: dwrite fb [0,4194304] 0 2024-04-16T14:35:30.518 INFO:tasks.workunit.client.1.smithi115.stdout:3/56: creat dc/f11 x:0 0 0 2024-04-16T14:35:30.521 INFO:tasks.workunit.client.1.smithi115.stdout:9/34: dread d1/f3 [0,4194304] 0 2024-04-16T14:35:30.522 INFO:tasks.workunit.client.1.smithi115.stdout:9/35: link d1/l5 d1/l8 0 2024-04-16T14:35:30.537 INFO:tasks.workunit.client.1.smithi115.stdout:3/57: dwrite fb [0,4194304] 0 2024-04-16T14:35:30.537 INFO:tasks.workunit.client.1.smithi115.stdout:9/36: dwrite d1/f2 [0,4194304] 0 2024-04-16T14:35:30.538 INFO:tasks.workunit.client.1.smithi115.stdout:3/58: mknod dc/c12 0 2024-04-16T14:35:30.540 INFO:tasks.workunit.client.1.smithi115.stdout:3/59: link c5 dc/c13 0 2024-04-16T14:35:30.542 INFO:tasks.workunit.client.1.smithi115.stdout:3/60: link f3 dc/f14 0 2024-04-16T14:35:30.542 INFO:tasks.workunit.client.1.smithi115.stdout:3/61: fdatasync f3 0 2024-04-16T14:35:30.546 INFO:tasks.workunit.client.1.smithi115.stdout:3/62: read dc/ff [477340,49822] 0 2024-04-16T14:35:30.546 INFO:tasks.workunit.client.1.smithi115.stdout:9/37: read d1/f2 [2291928,60841] 0 2024-04-16T14:35:30.546 INFO:tasks.workunit.client.1.smithi115.stdout:9/38: fsync d1/f2 0 2024-04-16T14:35:30.548 INFO:tasks.workunit.client.1.smithi115.stdout:3/63: rename dc/fd to dc/f15 0 2024-04-16T14:35:30.548 INFO:tasks.workunit.client.1.smithi115.stdout:3/64: creat dc/f16 x:0 0 0 2024-04-16T14:35:30.550 INFO:tasks.workunit.client.1.smithi115.stdout:9/39: link d1/l5 d1/d6/l9 0 2024-04-16T14:35:30.552 INFO:tasks.workunit.client.1.smithi115.stdout:9/40: symlink d1/d6/la 0 2024-04-16T14:35:30.552 INFO:tasks.workunit.client.1.smithi115.stdout:9/41: chown d1/d6/c7 56447642 1 2024-04-16T14:35:30.553 INFO:tasks.workunit.client.1.smithi115.stdout:9/42: mknod d1/d6/cb 0 2024-04-16T14:35:30.557 INFO:tasks.workunit.client.1.smithi115.stdout:9/43: dread d1/f3 [0,4194304] 0 2024-04-16T14:35:30.558 INFO:tasks.workunit.client.1.smithi115.stdout:9/44: symlink d1/lc 0 2024-04-16T14:35:30.559 INFO:tasks.workunit.client.1.smithi115.stdout:9/45: mkdir d1/d6/dd 0 2024-04-16T14:35:30.562 INFO:tasks.workunit.client.0.smithi005.stdout:4/394: rename d0/c17 to d0/c72 0 2024-04-16T14:35:30.562 INFO:tasks.workunit.client.0.smithi005.stdout:4/395: write d0/f5c [1758627,34202] 0 2024-04-16T14:35:30.565 INFO:tasks.workunit.client.1.smithi115.stdout:3/65: dwrite fb [0,4194304] 0 2024-04-16T14:35:30.565 INFO:tasks.workunit.client.1.smithi115.stdout:3/66: chown dc/f11 4628579 1 2024-04-16T14:35:30.565 INFO:tasks.workunit.client.1.smithi115.stdout:3/67: write dc/f16 [44411,120202] 0 2024-04-16T14:35:30.565 INFO:tasks.workunit.client.1.smithi115.stdout:3/68: chown fb 495 1 2024-04-16T14:35:30.565 INFO:tasks.workunit.client.0.smithi005.stdout:8/301: mkdir d5/d11/d1f/d2f/d68 0 2024-04-16T14:35:30.565 INFO:tasks.workunit.client.0.smithi005.stdout:8/302: fsync d5/de/f51 0 2024-04-16T14:35:30.566 INFO:tasks.workunit.client.0.smithi005.stdout:8/303: chown d5/f3a 149797906 1 2024-04-16T14:35:30.567 INFO:tasks.workunit.client.0.smithi005.stdout:7/321: rename d1/d5/d22/d27/l34 to d1/d5/d22/d27/d3a/d5c/l5e 0 2024-04-16T14:35:30.568 INFO:tasks.workunit.client.0.smithi005.stdout:7/322: creat d1/d49/f5f x:0 0 0 2024-04-16T14:35:30.568 INFO:tasks.workunit.client.0.smithi005.stdout:7/323: write d1/d49/f5f [609174,90365] 0 2024-04-16T14:35:30.568 INFO:tasks.workunit.client.0.smithi005.stdout:7/324: creat d1/dc/d2f/f60 x:0 0 0 2024-04-16T14:35:30.573 INFO:tasks.workunit.client.0.smithi005.stdout:4/396: symlink d0/d1b/d1d/d1f/d3e/d6d/l73 0 2024-04-16T14:35:30.573 INFO:tasks.workunit.client.0.smithi005.stdout:4/397: chown d0/d1b/d1d/d1f/d3e/c3f 0 1 2024-04-16T14:35:30.574 INFO:tasks.workunit.client.1.smithi115.stdout:3/69: write fb [3343056,30376] 0 2024-04-16T14:35:30.574 INFO:tasks.workunit.client.1.smithi115.stdout:3/70: creat dc/f17 x:0 0 0 2024-04-16T14:35:30.574 INFO:tasks.workunit.client.1.smithi115.stdout:3/71: creat dc/f18 x:0 0 0 2024-04-16T14:35:30.575 INFO:tasks.workunit.client.0.smithi005.stdout:8/304: mknod d5/d11/d1f/d2f/d68/c69 0 2024-04-16T14:35:30.575 INFO:tasks.workunit.client.0.smithi005.stdout:8/305: readlink d5/de/l42 0 2024-04-16T14:35:30.575 INFO:tasks.workunit.client.0.smithi005.stdout:8/306: readlink d5/d40/d4b/l58 0 2024-04-16T14:35:30.575 INFO:tasks.workunit.client.1.smithi115.stdout:9/46: dwrite d1/f3 [0,4194304] 0 2024-04-16T14:35:30.575 INFO:tasks.workunit.client.1.smithi115.stdout:9/47: fsync f0 0 2024-04-16T14:35:30.576 INFO:tasks.workunit.client.1.smithi115.stdout:9/48: dread f0 [4194304,4194304] 0 2024-04-16T14:35:30.576 INFO:tasks.workunit.client.1.smithi115.stdout:9/49: stat d1 0 2024-04-16T14:35:30.578 INFO:tasks.workunit.client.0.smithi005.stdout:7/325: mkdir d1/d5/d57/d47/d61 0 2024-04-16T14:35:30.578 INFO:tasks.workunit.client.0.smithi005.stdout:4/398: symlink d0/d1b/d1d/d1f/l74 0 2024-04-16T14:35:30.580 INFO:tasks.workunit.client.0.smithi005.stdout:4/399: mkdir d0/d1b/d1d/d4f/d75 0 2024-04-16T14:35:30.580 INFO:tasks.workunit.client.0.smithi005.stdout:7/326: dread d1/d5/d22/f30 [0,4194304] 0 2024-04-16T14:35:30.581 INFO:tasks.workunit.client.0.smithi005.stdout:4/400: mknod d0/d1b/c76 0 2024-04-16T14:35:30.582 INFO:tasks.workunit.client.0.smithi005.stdout:7/327: creat d1/d5/d22/d27/d3a/d5c/f62 x:0 0 0 2024-04-16T14:35:30.583 INFO:tasks.workunit.client.1.smithi115.stdout:3/72: dread f4 [0,4194304] 0 2024-04-16T14:35:30.584 INFO:tasks.workunit.client.1.smithi115.stdout:3/73: mknod dc/c19 0 2024-04-16T14:35:30.584 INFO:tasks.workunit.client.1.smithi115.stdout:3/74: write f6 [2524301,63769] 0 2024-04-16T14:35:30.585 INFO:tasks.workunit.client.0.smithi005.stdout:4/401: truncate d0/f2c 3639895 0 2024-04-16T14:35:30.585 INFO:tasks.workunit.client.0.smithi005.stdout:4/402: write d0/f5 [2772694,84649] 0 2024-04-16T14:35:30.585 INFO:tasks.workunit.client.0.smithi005.stdout:4/403: read d0/f7 [3335820,53310] 0 2024-04-16T14:35:30.586 INFO:tasks.workunit.client.1.smithi115.stdout:3/75: rename dc/f14 to dc/f1a 0 2024-04-16T14:35:30.586 INFO:tasks.workunit.client.1.smithi115.stdout:3/76: creat dc/f1b x:0 0 0 2024-04-16T14:35:30.587 INFO:tasks.workunit.client.0.smithi005.stdout:7/328: truncate d1/d5/d22/d27/f36 364564 0 2024-04-16T14:35:30.587 INFO:tasks.workunit.client.0.smithi005.stdout:8/307: write d5/f66 [64572,104291] 0 2024-04-16T14:35:30.587 INFO:tasks.workunit.client.0.smithi005.stdout:8/308: write f3 [5665163,3333] 0 2024-04-16T14:35:30.587 INFO:tasks.workunit.client.1.smithi115.stdout:9/50: dread d1/f3 [0,4194304] 0 2024-04-16T14:35:30.588 INFO:tasks.workunit.client.0.smithi005.stdout:4/404: mknod d0/d5a/c77 0 2024-04-16T14:35:30.589 INFO:tasks.workunit.client.0.smithi005.stdout:7/329: creat d1/d5/d57/d47/f63 x:0 0 0 2024-04-16T14:35:30.590 INFO:tasks.workunit.client.0.smithi005.stdout:7/330: creat d1/d5/d22/d27/f64 x:0 0 0 2024-04-16T14:35:30.593 INFO:tasks.workunit.client.0.smithi005.stdout:8/309: mknod d5/d40/c6a 0 2024-04-16T14:35:30.593 INFO:tasks.workunit.client.0.smithi005.stdout:8/310: fsync d5/f43 0 2024-04-16T14:35:30.593 INFO:tasks.workunit.client.1.smithi115.stdout:9/51: getdents d1/d6 0 2024-04-16T14:35:30.594 INFO:tasks.workunit.client.1.smithi115.stdout:3/77: dread dc/ff [0,4194304] 0 2024-04-16T14:35:30.594 INFO:tasks.workunit.client.1.smithi115.stdout:3/78: read - dc/f1b zero size 2024-04-16T14:35:30.595 INFO:tasks.workunit.client.1.smithi115.stdout:3/79: creat dc/f1c x:0 0 0 2024-04-16T14:35:30.595 INFO:tasks.workunit.client.1.smithi115.stdout:3/80: stat f3 0 2024-04-16T14:35:30.596 INFO:tasks.workunit.client.0.smithi005.stdout:7/331: creat d1/d5/f65 x:0 0 0 2024-04-16T14:35:30.598 INFO:tasks.workunit.client.0.smithi005.stdout:7/332: symlink d1/dc/d2f/d4f/l66 0 2024-04-16T14:35:30.598 INFO:tasks.workunit.client.0.smithi005.stdout:7/333: read - d1/d5/d22/d27/f64 zero size 2024-04-16T14:35:30.598 INFO:tasks.workunit.client.1.smithi115.stdout:9/52: write d1/f3 [2051430,5226] 0 2024-04-16T14:35:30.599 INFO:tasks.workunit.client.0.smithi005.stdout:8/311: dread d5/f43 [0,4194304] 0 2024-04-16T14:35:30.599 INFO:tasks.workunit.client.0.smithi005.stdout:8/312: chown d5/d55/c60 2 1 2024-04-16T14:35:30.599 INFO:tasks.workunit.client.0.smithi005.stdout:8/313: write d5/d11/d1f/d2f/f4c [1895921,84834] 0 2024-04-16T14:35:30.599 INFO:tasks.workunit.client.0.smithi005.stdout:7/334: mknod d1/dc/d2f/d4f/c67 0 2024-04-16T14:35:30.601 INFO:tasks.workunit.client.0.smithi005.stdout:8/314: creat d5/d55/f6b x:0 0 0 2024-04-16T14:35:30.604 INFO:tasks.workunit.client.0.smithi005.stdout:4/405: dwrite d0/d4d/f50 [0,4194304] 0 2024-04-16T14:35:30.605 INFO:tasks.workunit.client.1.smithi115.stdout:9/53: dread d1/f2 [0,4194304] 0 2024-04-16T14:35:30.605 INFO:tasks.workunit.client.1.smithi115.stdout:9/54: fdatasync f0 0 2024-04-16T14:35:30.606 INFO:tasks.workunit.client.0.smithi005.stdout:8/315: mkdir d5/d11/d6c 0 2024-04-16T14:35:30.606 INFO:tasks.workunit.client.0.smithi005.stdout:8/316: creat d5/d40/f6d x:0 0 0 2024-04-16T14:35:30.609 INFO:tasks.workunit.client.1.smithi115.stdout:9/55: dread d1/f3 [0,4194304] 0 2024-04-16T14:35:30.609 INFO:tasks.workunit.client.1.smithi115.stdout:9/56: fsync d1/f2 0 2024-04-16T14:35:30.609 INFO:tasks.workunit.client.1.smithi115.stdout:9/57: readlink d1/lc 0 2024-04-16T14:35:30.610 INFO:tasks.workunit.client.1.smithi115.stdout:9/58: creat d1/d6/dd/fe x:0 0 0 2024-04-16T14:35:30.613 INFO:tasks.workunit.client.0.smithi005.stdout:4/406: creat d0/d22/d29/f78 x:0 0 0 2024-04-16T14:35:30.620 INFO:tasks.workunit.client.0.smithi005.stdout:4/407: write d0/f7 [8034309,5923] 0 2024-04-16T14:35:30.621 INFO:tasks.workunit.client.0.smithi005.stdout:4/408: dread d0/d1b/d1d/d1f/d3e/f5e [0,4194304] 0 2024-04-16T14:35:30.621 INFO:tasks.workunit.client.0.smithi005.stdout:4/409: write d0/d1b/d1d/f67 [1196496,95535] 0 2024-04-16T14:35:30.626 INFO:tasks.workunit.client.1.smithi115.stdout:9/59: dwrite d1/f3 [0,4194304] 0 2024-04-16T14:35:30.626 INFO:tasks.workunit.client.1.smithi115.stdout:9/60: dread - d1/d6/dd/fe zero size 2024-04-16T14:35:30.626 INFO:tasks.workunit.client.1.smithi115.stdout:9/61: mknod d1/d6/cf 0 2024-04-16T14:35:30.626 INFO:tasks.workunit.client.1.smithi115.stdout:9/62: chown d1 3862 1 2024-04-16T14:35:30.626 INFO:tasks.workunit.client.1.smithi115.stdout:9/63: mkdir d1/d10 0 2024-04-16T14:35:30.627 INFO:tasks.workunit.client.0.smithi005.stdout:4/410: getdents d0/d22/d29 0 2024-04-16T14:35:30.635 INFO:tasks.workunit.client.1.smithi115.stdout:9/64: dread f0 [0,4194304] 0 2024-04-16T14:35:30.638 INFO:tasks.workunit.client.1.smithi115.stdout:9/65: write f0 [3217833,73451] 0 2024-04-16T14:35:30.639 INFO:tasks.workunit.client.1.smithi115.stdout:9/66: mknod d1/c11 0 2024-04-16T14:35:30.639 INFO:tasks.workunit.client.1.smithi115.stdout:9/67: write f0 [1461728,82901] 0 2024-04-16T14:35:30.639 INFO:tasks.workunit.client.1.smithi115.stdout:9/68: fdatasync d1/f2 0 2024-04-16T14:35:30.640 INFO:tasks.workunit.client.1.smithi115.stdout:9/69: symlink d1/d6/l12 0 2024-04-16T14:35:30.640 INFO:tasks.workunit.client.1.smithi115.stdout:9/70: truncate d1/d6/dd/fe 355427 0 2024-04-16T14:35:30.641 INFO:tasks.workunit.client.0.smithi005.stdout:4/411: dwrite d0/d1b/d1d/f21 [0,4194304] 0 2024-04-16T14:35:30.642 INFO:tasks.workunit.client.0.smithi005.stdout:4/412: read d0/d1b/d1d/f53 [151739,10191] 0 2024-04-16T14:35:30.643 INFO:tasks.workunit.client.0.smithi005.stdout:4/413: creat d0/d22/d29/f79 x:0 0 0 2024-04-16T14:35:30.644 INFO:tasks.workunit.client.0.smithi005.stdout:4/414: link d0/d1b/d1d/d1f/l32 d0/d1b/d1d/d1f/d3e/d6d/l7a 0 2024-04-16T14:35:30.644 INFO:tasks.workunit.client.0.smithi005.stdout:4/415: chown d0/d47 4293 1 2024-04-16T14:35:30.645 INFO:tasks.workunit.client.0.smithi005.stdout:4/416: symlink d0/d1b/d1d/d1f/d3e/l7b 0 2024-04-16T14:35:30.645 INFO:tasks.workunit.client.0.smithi005.stdout:4/417: read d0/f7 [1264948,45709] 0 2024-04-16T14:35:30.645 INFO:tasks.workunit.client.0.smithi005.stdout:4/418: fdatasync d0/d22/f4e 0 2024-04-16T14:35:30.646 INFO:tasks.workunit.client.0.smithi005.stdout:4/419: link d0/d1b/d1d/d1f/f57 d0/d1b/f7c 0 2024-04-16T14:35:30.657 INFO:tasks.workunit.client.1.smithi115.stdout:9/71: dwrite f0 [0,4194304] 0 2024-04-16T14:35:30.657 INFO:tasks.workunit.client.1.smithi115.stdout:9/72: readlink d1/l8 0 2024-04-16T14:35:30.657 INFO:tasks.workunit.client.1.smithi115.stdout:9/73: chown d1/d6/la 419 1 2024-04-16T14:35:30.662 INFO:tasks.workunit.client.1.smithi115.stdout:9/74: truncate d1/f3 3488640 0 2024-04-16T14:35:30.663 INFO:tasks.workunit.client.1.smithi115.stdout:9/75: symlink d1/d6/dd/l13 0 2024-04-16T14:35:30.663 INFO:tasks.workunit.client.1.smithi115.stdout:9/76: chown d1/d10 17875773 1 2024-04-16T14:35:30.672 INFO:tasks.workunit.client.1.smithi115.stdout:9/77: dread d1/f3 [0,4194304] 0 2024-04-16T14:35:30.673 INFO:tasks.workunit.client.1.smithi115.stdout:9/78: dread d1/d6/dd/fe [0,4194304] 0 2024-04-16T14:35:30.674 INFO:tasks.workunit.client.1.smithi115.stdout:9/79: getdents d1/d6/dd 0 2024-04-16T14:35:30.675 INFO:tasks.workunit.client.1.smithi115.stdout:9/80: rename d1/d6/c7 to d1/d10/c14 0 2024-04-16T14:35:30.676 INFO:tasks.workunit.client.1.smithi115.stdout:9/81: fsync d1/f3 0 2024-04-16T14:35:30.676 INFO:tasks.workunit.client.1.smithi115.stdout:9/82: dread d1/d6/dd/fe [0,4194304] 0 2024-04-16T14:35:30.676 INFO:tasks.workunit.client.1.smithi115.stdout:9/83: dread d1/d6/dd/fe [0,4194304] 0 2024-04-16T14:35:30.677 INFO:tasks.workunit.client.1.smithi115.stdout:9/84: mknod d1/d6/dd/c15 0 2024-04-16T14:35:30.678 INFO:tasks.workunit.client.1.smithi115.stdout:9/85: rename d1/d6/l12 to d1/d6/l16 0 2024-04-16T14:35:30.679 INFO:tasks.workunit.client.1.smithi115.stdout:9/86: creat d1/d6/f17 x:0 0 0 2024-04-16T14:35:30.682 INFO:tasks.workunit.client.1.smithi115.stdout:9/87: getdents d1/d6/dd 0 2024-04-16T14:35:30.682 INFO:tasks.workunit.client.1.smithi115.stdout:9/88: readlink d1/d6/la 0 2024-04-16T14:35:30.683 INFO:tasks.workunit.client.1.smithi115.stdout:9/89: link d1/d6/dd/c15 d1/d6/dd/c18 0 2024-04-16T14:35:30.683 INFO:tasks.workunit.client.1.smithi115.stdout:9/90: readlink d1/d6/l16 0 2024-04-16T14:35:30.683 INFO:tasks.workunit.client.1.smithi115.stdout:9/91: creat d1/f19 x:0 0 0 2024-04-16T14:35:30.685 INFO:tasks.workunit.client.1.smithi115.stdout:9/92: creat d1/d6/dd/f1a x:0 0 0 2024-04-16T14:35:30.686 INFO:tasks.workunit.client.1.smithi115.stdout:9/93: mknod d1/d6/dd/c1b 0 2024-04-16T14:35:30.686 INFO:tasks.workunit.client.1.smithi115.stdout:9/94: creat d1/d6/dd/f1c x:0 0 0 2024-04-16T14:35:30.687 INFO:tasks.workunit.client.1.smithi115.stdout:9/95: truncate d1/f3 1000472 0 2024-04-16T14:35:30.690 INFO:tasks.workunit.client.1.smithi115.stdout:9/96: getdents d1/d6/dd 0 2024-04-16T14:35:30.692 INFO:tasks.workunit.client.1.smithi115.stdout:9/97: rename d1/lc to d1/d6/l1d 0 2024-04-16T14:35:30.706 INFO:tasks.workunit.client.1.smithi115.stdout:9/98: dwrite d1/f19 [0,4194304] 0 2024-04-16T14:35:30.708 INFO:tasks.workunit.client.1.smithi115.stdout:9/99: rmdir d1/d6 39 2024-04-16T14:35:30.709 INFO:tasks.workunit.client.1.smithi115.stdout:9/100: rename d1/d6/dd/l13 to d1/d6/dd/l1e 0 2024-04-16T14:35:30.713 INFO:tasks.workunit.client.1.smithi115.stdout:9/101: unlink d1/d6/dd/l1e 0 2024-04-16T14:35:30.716 INFO:tasks.workunit.client.1.smithi115.stdout:9/102: truncate f0 3852393 0 2024-04-16T14:35:30.718 INFO:tasks.workunit.client.1.smithi115.stdout:9/103: write f0 [4726718,111819] 0 2024-04-16T14:35:30.720 INFO:tasks.workunit.client.1.smithi115.stdout:9/104: unlink d1/d6/dd/c15 0 2024-04-16T14:35:30.735 INFO:tasks.workunit.client.1.smithi115.stdout:9/105: dwrite f0 [0,4194304] 0 2024-04-16T14:35:30.743 INFO:tasks.workunit.client.1.smithi115.stdout:9/106: write d1/f19 [906396,23243] 0 2024-04-16T14:35:30.744 INFO:tasks.workunit.client.1.smithi115.stdout:9/107: fsync d1/d6/dd/fe 0 2024-04-16T14:35:30.745 INFO:tasks.workunit.client.1.smithi115.stdout:9/108: write d1/f3 [804765,28992] 0 2024-04-16T14:35:30.745 INFO:tasks.workunit.client.1.smithi115.stdout:9/109: chown d1 2537702 1 2024-04-16T14:35:30.757 INFO:tasks.workunit.client.1.smithi115.stdout:9/110: dwrite d1/d6/f17 [0,4194304] 0 2024-04-16T14:35:30.760 INFO:tasks.workunit.client.1.smithi115.stdout:9/111: unlink d1/d6/la 0 2024-04-16T14:35:30.760 INFO:tasks.workunit.client.1.smithi115.stdout:9/112: chown d1/d6/f17 343338 1 2024-04-16T14:35:30.760 INFO:tasks.workunit.client.1.smithi115.stdout:9/113: chown d1/d6/l9 1764 1 2024-04-16T14:35:30.761 INFO:tasks.workunit.client.1.smithi115.stdout:9/114: read d1/f2 [190783,64364] 0 2024-04-16T14:35:30.761 INFO:tasks.workunit.client.1.smithi115.stdout:9/115: truncate d1/f3 1684585 0 2024-04-16T14:35:30.766 INFO:tasks.workunit.client.1.smithi115.stdout:9/116: dread d1/f2 [0,4194304] 0 2024-04-16T14:35:30.769 INFO:tasks.workunit.client.1.smithi115.stdout:9/117: unlink d1/d6/dd/c1b 0 2024-04-16T14:35:30.769 INFO:tasks.workunit.client.0.smithi005.stdout:1/388: sync 2024-04-16T14:35:30.770 INFO:tasks.workunit.client.0.smithi005.stdout:6/372: sync 2024-04-16T14:35:30.770 INFO:tasks.workunit.client.0.smithi005.stdout:5/222: sync 2024-04-16T14:35:30.770 INFO:tasks.workunit.client.0.smithi005.stdout:1/389: creat d2/d1c/d15/d2a/d19/d42/d64/d66/f8f x:0 0 0 2024-04-16T14:35:30.771 INFO:tasks.workunit.client.0.smithi005.stdout:5/223: read d0/d6/f36 [41882,8531] 0 2024-04-16T14:35:30.771 INFO:tasks.workunit.client.1.smithi115.stdout:9/118: creat d1/d6/dd/f1f x:0 0 0 2024-04-16T14:35:30.771 INFO:tasks.workunit.client.1.smithi115.stdout:9/119: read d1/f3 [1313428,48383] 0 2024-04-16T14:35:30.772 INFO:tasks.workunit.client.0.smithi005.stdout:1/390: rename d2/d1c/d15/d2a/d25/f5f to d2/d1c/d15/d2a/d19/d42/d64/d66/f90 0 2024-04-16T14:35:30.772 INFO:tasks.workunit.client.0.smithi005.stdout:6/373: getdents d2 0 2024-04-16T14:35:30.773 INFO:tasks.workunit.client.1.smithi115.stdout:9/120: mkdir d1/d10/d20 0 2024-04-16T14:35:30.773 INFO:tasks.workunit.client.1.smithi115.stdout:9/121: chown d1 288728152 1 2024-04-16T14:35:30.773 INFO:tasks.workunit.client.1.smithi115.stdout:9/122: fdatasync d1/d6/dd/f1a 0 2024-04-16T14:35:30.774 INFO:tasks.workunit.client.0.smithi005.stdout:1/391: unlink d2/d1c/d15/d2a/d19/d42/f7d 0 2024-04-16T14:35:30.774 INFO:tasks.workunit.client.0.smithi005.stdout:1/392: creat d2/d1c/d15/d2a/d1a/d2e/f91 x:0 0 0 2024-04-16T14:35:30.776 INFO:tasks.workunit.client.0.smithi005.stdout:6/374: unlink d2/d5/c39 0 2024-04-16T14:35:30.776 INFO:tasks.workunit.client.0.smithi005.stdout:6/375: fdatasync d2/d5/d10/f1d 0 2024-04-16T14:35:30.776 INFO:tasks.workunit.client.0.smithi005.stdout:6/376: dread - d2/d3f/f71 zero size 2024-04-16T14:35:30.777 INFO:tasks.workunit.client.0.smithi005.stdout:6/377: readlink d2/d5/d10/l4a 0 2024-04-16T14:35:30.778 INFO:tasks.workunit.client.0.smithi005.stdout:5/224: rmdir d0 39 2024-04-16T14:35:30.780 INFO:tasks.workunit.client.1.smithi115.stdout:9/123: write f0 [1390438,121417] 0 2024-04-16T14:35:30.781 INFO:tasks.workunit.client.1.smithi115.stdout:9/124: stat d1/d6 0 2024-04-16T14:35:30.781 INFO:tasks.workunit.client.1.smithi115.stdout:9/125: dread - d1/d6/dd/f1a zero size 2024-04-16T14:35:30.781 INFO:tasks.workunit.client.1.smithi115.stdout:9/126: write d1/d6/dd/f1f [522104,106615] 0 2024-04-16T14:35:30.782 INFO:tasks.workunit.client.1.smithi115.stdout:9/127: link d1/d10/c14 d1/d10/c21 0 2024-04-16T14:35:30.782 INFO:tasks.workunit.client.0.smithi005.stdout:6/378: rename d2/d45/f48 to d2/d20/f7f 0 2024-04-16T14:35:30.783 INFO:tasks.workunit.client.1.smithi115.stdout:9/128: creat d1/d10/d20/f22 x:0 0 0 2024-04-16T14:35:30.783 INFO:tasks.workunit.client.1.smithi115.stdout:9/129: write d1/f3 [2675909,122100] 0 2024-04-16T14:35:30.784 INFO:tasks.workunit.client.0.smithi005.stdout:5/225: mkdir d0/d6/d12/d34/d42 0 2024-04-16T14:35:30.784 INFO:tasks.workunit.client.0.smithi005.stdout:5/226: readlink d0/d6/l7 0 2024-04-16T14:35:30.784 INFO:tasks.workunit.client.0.smithi005.stdout:6/379: creat d2/d5/d10/d4d/f80 x:0 0 0 2024-04-16T14:35:30.785 INFO:tasks.workunit.client.0.smithi005.stdout:5/227: symlink d0/d6/d12/d34/d30/l43 0 2024-04-16T14:35:30.786 INFO:tasks.workunit.client.0.smithi005.stdout:6/380: mkdir d2/d20/d3c/d7c/d81 0 2024-04-16T14:35:30.787 INFO:tasks.workunit.client.0.smithi005.stdout:5/228: symlink d0/d6/d12/d1c/l44 0 2024-04-16T14:35:30.787 INFO:tasks.workunit.client.0.smithi005.stdout:5/229: fdatasync d0/d6/d12/f3a 0 2024-04-16T14:35:30.788 INFO:tasks.workunit.client.0.smithi005.stdout:5/230: link d0/d6/f36 d0/d6/d12/f45 0 2024-04-16T14:35:30.789 INFO:tasks.workunit.client.0.smithi005.stdout:5/231: mknod d0/d6/d12/d34/d30/c46 0 2024-04-16T14:35:30.791 INFO:tasks.workunit.client.0.smithi005.stdout:1/393: dwrite d2/d1c/ff [0,4194304] 0 2024-04-16T14:35:30.793 INFO:tasks.workunit.client.0.smithi005.stdout:1/394: link d2/d1c/d15/d2a/d19/d20/l32 d2/d2c/d85/l92 0 2024-04-16T14:35:30.793 INFO:tasks.workunit.client.0.smithi005.stdout:1/395: write d2/d1c/f3d [993538,18863] 0 2024-04-16T14:35:30.794 INFO:tasks.workunit.client.0.smithi005.stdout:1/396: write d2/d1c/f1e [2444356,117594] 0 2024-04-16T14:35:30.794 INFO:tasks.workunit.client.0.smithi005.stdout:1/397: readlink d2/d74/d7a/l7f 0 2024-04-16T14:35:30.794 INFO:tasks.workunit.client.0.smithi005.stdout:1/398: creat d2/d1c/d15/d2a/d1a/d2e/f93 x:0 0 0 2024-04-16T14:35:30.794 INFO:tasks.workunit.client.0.smithi005.stdout:1/399: creat d2/d1c/d15/d2a/d1a/d2e/d51/f94 x:0 0 0 2024-04-16T14:35:30.794 INFO:tasks.workunit.client.0.smithi005.stdout:6/381: dread d2/f18 [0,4194304] 0 2024-04-16T14:35:30.795 INFO:tasks.workunit.client.0.smithi005.stdout:1/400: symlink d2/l95 0 2024-04-16T14:35:30.797 INFO:tasks.workunit.client.0.smithi005.stdout:1/401: rename d2/d2c/c45 to d2/d1c/d15/d2a/d19/d6e/d7b/c96 0 2024-04-16T14:35:30.799 INFO:tasks.workunit.client.0.smithi005.stdout:1/402: truncate d2/d1c/d15/d2a/d19/f84 742002 0 2024-04-16T14:35:30.800 INFO:tasks.workunit.client.0.smithi005.stdout:5/232: getdents d0/d6/d12/d34 0 2024-04-16T14:35:30.803 INFO:tasks.workunit.client.0.smithi005.stdout:5/233: symlink d0/d6/d12/l47 0 2024-04-16T14:35:30.813 INFO:tasks.workunit.client.0.smithi005.stdout:6/382: dwrite d2/df/f32 [0,4194304] 0 2024-04-16T14:35:30.814 INFO:tasks.workunit.client.0.smithi005.stdout:1/403: dwrite d2/d1c/f6b [0,4194304] 0 2024-04-16T14:35:30.815 INFO:tasks.workunit.client.0.smithi005.stdout:6/383: creat d2/d45/d7b/f82 x:0 0 0 2024-04-16T14:35:30.818 INFO:tasks.workunit.client.0.smithi005.stdout:1/404: creat d2/d1c/d15/d2a/d19/d42/d64/d76/f97 x:0 0 0 2024-04-16T14:35:30.818 INFO:tasks.workunit.client.0.smithi005.stdout:1/405: truncate d2/d1c/f17 1529373 0 2024-04-16T14:35:30.818 INFO:tasks.workunit.client.0.smithi005.stdout:1/406: truncate d2/d1c/d15/f1d 3474421 0 2024-04-16T14:35:30.819 INFO:tasks.workunit.client.0.smithi005.stdout:1/407: stat d2/d1c/d15/d2a/d19/d42/d64/d76/c78 0 2024-04-16T14:35:30.826 INFO:tasks.workunit.client.0.smithi005.stdout:5/234: dwrite d0/d6/d12/d1c/d1e/f3e [0,4194304] 0 2024-04-16T14:35:30.830 INFO:tasks.workunit.client.0.smithi005.stdout:5/235: rmdir d0/d6 39 2024-04-16T14:35:30.831 INFO:tasks.workunit.client.0.smithi005.stdout:6/384: dread d2/f23 [0,4194304] 0 2024-04-16T14:35:30.832 INFO:tasks.workunit.client.0.smithi005.stdout:6/385: unlink d2/d5/f77 0 2024-04-16T14:35:30.833 INFO:tasks.workunit.client.0.smithi005.stdout:6/386: fdatasync d2/d5/d10/f13 0 2024-04-16T14:35:30.833 INFO:tasks.workunit.client.0.smithi005.stdout:6/387: chown d2/d3f/d53/d54/l7e 363664591 1 2024-04-16T14:35:30.836 INFO:tasks.workunit.client.0.smithi005.stdout:1/408: dwrite d2/d1c/d15/d2a/d1a/d2e/d51/f94 [0,4194304] 0 2024-04-16T14:35:30.840 INFO:tasks.workunit.client.0.smithi005.stdout:1/409: symlink d2/d1c/d15/d2a/d19/d42/d64/l98 0 2024-04-16T14:35:30.840 INFO:tasks.workunit.client.0.smithi005.stdout:5/236: write d0/d6/d12/d1c/f20 [7219018,54407] 0 2024-04-16T14:35:30.841 INFO:tasks.workunit.client.0.smithi005.stdout:1/410: mkdir d2/d1c/d15/d2a/d19/d6e/d7b/d99 0 2024-04-16T14:35:30.842 INFO:tasks.workunit.client.0.smithi005.stdout:5/237: dread - d0/f26 zero size 2024-04-16T14:35:30.842 INFO:tasks.workunit.client.0.smithi005.stdout:5/238: dread - d0/d6/f31 zero size 2024-04-16T14:35:30.843 INFO:tasks.workunit.client.0.smithi005.stdout:1/411: mknod d2/d1c/d15/d2a/d19/d42/d71/c9a 0 2024-04-16T14:35:30.845 INFO:tasks.workunit.client.0.smithi005.stdout:5/239: mkdir d0/d6/d12/d1c/d1e/d48 0 2024-04-16T14:35:30.845 INFO:tasks.workunit.client.0.smithi005.stdout:6/388: dwrite d2/d5/d28/f6c [4194304,4194304] 0 2024-04-16T14:35:30.846 INFO:tasks.workunit.client.0.smithi005.stdout:5/240: creat d0/d6/d12/d34/f49 x:0 0 0 2024-04-16T14:35:30.846 INFO:tasks.workunit.client.0.smithi005.stdout:5/241: dread - d0/f26 zero size 2024-04-16T14:35:30.846 INFO:tasks.workunit.client.0.smithi005.stdout:5/242: truncate d0/d6/d12/d1c/f1f 1042596 0 2024-04-16T14:35:30.849 INFO:tasks.workunit.client.0.smithi005.stdout:5/243: dread d0/d6/f36 [0,4194304] 0 2024-04-16T14:35:30.849 INFO:tasks.workunit.client.0.smithi005.stdout:5/244: chown d0/d6/l3f 13 1 2024-04-16T14:35:30.851 INFO:tasks.workunit.client.0.smithi005.stdout:6/389: getdents d2/d45 0 2024-04-16T14:35:30.853 INFO:tasks.workunit.client.0.smithi005.stdout:5/245: rename d0/f32 to d0/d6/d12/d1c/f4a 0 2024-04-16T14:35:30.861 INFO:tasks.workunit.client.0.smithi005.stdout:6/390: dread d2/d3f/f4f [0,4194304] 0 2024-04-16T14:35:30.862 INFO:tasks.workunit.client.0.smithi005.stdout:6/391: creat d2/d3f/d47/f83 x:0 0 0 2024-04-16T14:35:30.871 INFO:tasks.workunit.client.0.smithi005.stdout:5/246: dwrite d0/f1b [0,4194304] 0 2024-04-16T14:35:30.871 INFO:tasks.workunit.client.0.smithi005.stdout:5/247: write d0/d6/d12/f45 [1400065,59898] 0 2024-04-16T14:35:30.871 INFO:tasks.workunit.client.0.smithi005.stdout:5/248: truncate d0/f2 1659282 0 2024-04-16T14:35:30.871 INFO:tasks.workunit.client.0.smithi005.stdout:5/249: stat d0/d6/d12/f29 0 2024-04-16T14:35:30.872 INFO:tasks.workunit.client.0.smithi005.stdout:5/250: mknod d0/d6/c4b 0 2024-04-16T14:35:30.872 INFO:tasks.workunit.client.0.smithi005.stdout:5/251: dread - d0/d6/d12/d1c/f2a zero size 2024-04-16T14:35:30.872 INFO:tasks.workunit.client.0.smithi005.stdout:5/252: mknod d0/d6/d12/d34/d42/c4c 0 2024-04-16T14:35:30.874 INFO:tasks.workunit.client.0.smithi005.stdout:5/253: unlink d0/d6/d12/f29 0 2024-04-16T14:35:30.874 INFO:tasks.workunit.client.0.smithi005.stdout:5/254: write d0/f26 [287247,90722] 0 2024-04-16T14:35:30.874 INFO:tasks.workunit.client.0.smithi005.stdout:5/255: truncate d0/d6/d12/f23 4459040 0 2024-04-16T14:35:30.874 INFO:tasks.workunit.client.0.smithi005.stdout:5/256: dread d0/d6/d12/d1c/f1f [0,4194304] 0 2024-04-16T14:35:30.879 INFO:tasks.workunit.client.0.smithi005.stdout:5/257: dread d0/d6/d12/d1c/f20 [0,4194304] 0 2024-04-16T14:35:30.879 INFO:tasks.workunit.client.0.smithi005.stdout:6/392: dwrite d2/f26 [0,4194304] 0 2024-04-16T14:35:30.880 INFO:tasks.workunit.client.0.smithi005.stdout:6/393: read d2/d5/d10/f2b [963306,64850] 0 2024-04-16T14:35:30.880 INFO:tasks.workunit.client.0.smithi005.stdout:6/394: write d2/d45/f74 [1254397,127187] 0 2024-04-16T14:35:30.881 INFO:tasks.workunit.client.0.smithi005.stdout:6/395: mkdir d2/d3f/d47/d84 0 2024-04-16T14:35:30.881 INFO:tasks.workunit.client.0.smithi005.stdout:6/396: dread - d2/d5/d28/f67 zero size 2024-04-16T14:35:30.909 INFO:tasks.workunit.client.0.smithi005.stdout:6/397: dwrite d2/f26 [0,4194304] 0 2024-04-16T14:35:30.909 INFO:tasks.workunit.client.0.smithi005.stdout:5/258: dwrite d0/d6/d12/f45 [0,4194304] 0 2024-04-16T14:35:30.910 INFO:tasks.workunit.client.0.smithi005.stdout:6/398: symlink d2/d3f/d47/d84/l85 0 2024-04-16T14:35:30.924 INFO:tasks.workunit.client.0.smithi005.stdout:6/399: dwrite d2/d5/d10/d4d/d51/f70 [0,4194304] 0 2024-04-16T14:35:30.924 INFO:tasks.workunit.client.0.smithi005.stdout:6/400: getdents d2/d20/d33/d64 0 2024-04-16T14:35:30.925 INFO:tasks.workunit.client.0.smithi005.stdout:5/259: dwrite d0/d6/d12/d1c/f4a [0,4194304] 0 2024-04-16T14:35:30.931 INFO:tasks.workunit.client.0.smithi005.stdout:5/260: rmdir d0/d6/d12/d34 39 2024-04-16T14:35:30.948 INFO:tasks.workunit.client.0.smithi005.stdout:5/261: write d0/d6/d12/f23 [1191455,4725] 0 2024-04-16T14:35:30.948 INFO:tasks.workunit.client.0.smithi005.stdout:5/262: chown d0/f1b 6811 1 2024-04-16T14:35:30.948 INFO:tasks.workunit.client.0.smithi005.stdout:6/401: dwrite d2/d5/d10/d4d/f57 [0,4194304] 0 2024-04-16T14:35:30.948 INFO:tasks.workunit.client.0.smithi005.stdout:6/402: creat d2/d45/d7b/f86 x:0 0 0 2024-04-16T14:35:30.948 INFO:tasks.workunit.client.0.smithi005.stdout:6/403: chown d2/d5/d10/d68/f73 18 1 2024-04-16T14:35:30.949 INFO:tasks.workunit.client.0.smithi005.stdout:6/404: rename d2/d5/d28/f6c to d2/d5/d10/d4d/d51/d6e/f87 0 2024-04-16T14:35:30.950 INFO:tasks.workunit.client.0.smithi005.stdout:6/405: rename d2/d5/d28/f2c to d2/d3f/d53/f88 0 2024-04-16T14:35:30.951 INFO:tasks.workunit.client.0.smithi005.stdout:6/406: mknod d2/d20/d33/c89 0 2024-04-16T14:35:30.951 INFO:tasks.workunit.client.0.smithi005.stdout:6/407: chown d2/d3f/d47 27 1 2024-04-16T14:35:30.951 INFO:tasks.workunit.client.0.smithi005.stdout:6/408: mknod d2/d5/d10/d68/c8a 0 2024-04-16T14:35:30.956 INFO:tasks.workunit.client.0.smithi005.stdout:6/409: dread d2/d3f/d47/f52 [0,4194304] 0 2024-04-16T14:35:30.957 INFO:tasks.workunit.client.0.smithi005.stdout:6/410: symlink d2/d20/d3c/d7c/d81/l8b 0 2024-04-16T14:35:30.957 INFO:tasks.workunit.client.0.smithi005.stdout:6/411: dread - d2/d3f/d47/f83 zero size 2024-04-16T14:35:30.957 INFO:tasks.workunit.client.0.smithi005.stdout:3/189: sync 2024-04-16T14:35:30.957 INFO:tasks.workunit.client.0.smithi005.stdout:2/144: sync 2024-04-16T14:35:30.957 INFO:tasks.workunit.client.0.smithi005.stdout:9/186: sync 2024-04-16T14:35:30.958 INFO:tasks.workunit.client.0.smithi005.stdout:7/335: sync 2024-04-16T14:35:30.959 INFO:tasks.workunit.client.0.smithi005.stdout:7/336: chown d1/d5/d22/d27/d2e/l56 1306893 1 2024-04-16T14:35:30.959 INFO:tasks.workunit.client.0.smithi005.stdout:0/303: sync 2024-04-16T14:35:30.959 INFO:tasks.workunit.client.0.smithi005.stdout:4/420: sync 2024-04-16T14:35:30.959 INFO:tasks.workunit.client.0.smithi005.stdout:3/190: write d2/d17/f38 [959143,33433] 0 2024-04-16T14:35:30.959 INFO:tasks.workunit.client.0.smithi005.stdout:8/317: sync 2024-04-16T14:35:30.959 INFO:tasks.workunit.client.0.smithi005.stdout:3/191: creat d2/d17/d1e/f42 x:0 0 0 2024-04-16T14:35:30.959 INFO:tasks.workunit.client.0.smithi005.stdout:3/192: chown d2/c10 1195 1 2024-04-16T14:35:30.959 INFO:tasks.workunit.client.0.smithi005.stdout:4/421: creat d0/d1b/d1d/d1f/f7d x:0 0 0 2024-04-16T14:35:30.959 INFO:tasks.workunit.client.0.smithi005.stdout:3/193: truncate d2/f2c 1921487 0 2024-04-16T14:35:30.960 INFO:tasks.workunit.client.0.smithi005.stdout:6/412: unlink d2/d5/fe 0 2024-04-16T14:35:30.960 INFO:tasks.workunit.client.0.smithi005.stdout:6/413: readlink d2/d45/l4e 0 2024-04-16T14:35:30.961 INFO:tasks.workunit.client.0.smithi005.stdout:9/187: mknod d3/d12/d16/c31 0 2024-04-16T14:35:30.961 INFO:tasks.workunit.client.0.smithi005.stdout:9/188: fsync d3/d12/f2a 0 2024-04-16T14:35:30.961 INFO:tasks.workunit.client.0.smithi005.stdout:5/263: dread d0/d6/d12/d1c/d1e/f3e [0,4194304] 0 2024-04-16T14:35:30.961 INFO:tasks.workunit.client.0.smithi005.stdout:7/337: mknod d1/d5/d22/d27/d2e/c68 0 2024-04-16T14:35:30.962 INFO:tasks.workunit.client.0.smithi005.stdout:0/304: creat da/df/d1b/d3a/d53/f61 x:0 0 0 2024-04-16T14:35:30.970 INFO:tasks.workunit.client.0.smithi005.stdout:8/318: link d5/de/l42 d5/d11/d1f/d2f/l6e 0 2024-04-16T14:35:30.972 INFO:tasks.workunit.client.0.smithi005.stdout:6/414: mkdir d2/d3f/d47/d84/d8c 0 2024-04-16T14:35:30.972 INFO:tasks.workunit.client.0.smithi005.stdout:7/338: dread d1/d5/f17 [0,4194304] 0 2024-04-16T14:35:30.972 INFO:tasks.workunit.client.0.smithi005.stdout:7/339: truncate d1/d49/f5b 647807 0 2024-04-16T14:35:30.973 INFO:tasks.workunit.client.0.smithi005.stdout:2/145: getdents d0/d1e 0 2024-04-16T14:35:30.974 INFO:tasks.workunit.client.0.smithi005.stdout:5/264: rmdir d0/d6/d12/d34 39 2024-04-16T14:35:30.975 INFO:tasks.workunit.client.0.smithi005.stdout:9/189: dread d3/f8 [0,4194304] 0 2024-04-16T14:35:30.977 INFO:tasks.workunit.client.0.smithi005.stdout:8/319: creat d5/d11/f6f x:0 0 0 2024-04-16T14:35:30.977 INFO:tasks.workunit.client.0.smithi005.stdout:8/320: creat d5/d40/f70 x:0 0 0 2024-04-16T14:35:30.978 INFO:tasks.workunit.client.0.smithi005.stdout:7/340: mknod d1/d5/d22/d27/d2e/c69 0 2024-04-16T14:35:30.978 INFO:tasks.workunit.client.0.smithi005.stdout:2/146: mkdir d0/d29 0 2024-04-16T14:35:30.980 INFO:tasks.workunit.client.0.smithi005.stdout:5/265: mkdir d0/d6/d12/d34/d42/d4d 0 2024-04-16T14:35:30.981 INFO:tasks.workunit.client.0.smithi005.stdout:3/194: dwrite d2/f2c [0,4194304] 0 2024-04-16T14:35:30.981 INFO:tasks.workunit.client.0.smithi005.stdout:3/195: write d2/f2b [849901,21267] 0 2024-04-16T14:35:30.981 INFO:tasks.workunit.client.0.smithi005.stdout:3/196: fdatasync d2/d17/d1e/f36 0 2024-04-16T14:35:30.982 INFO:tasks.workunit.client.0.smithi005.stdout:9/190: link d3/f14 d3/d12/d16/f32 0 2024-04-16T14:35:30.984 INFO:tasks.workunit.client.0.smithi005.stdout:0/305: getdents da/df/d1b/d24 0 2024-04-16T14:35:30.984 INFO:tasks.workunit.client.0.smithi005.stdout:0/306: fdatasync da/f1f 0 2024-04-16T14:35:30.984 INFO:tasks.workunit.client.0.smithi005.stdout:0/307: creat da/df/d1b/f62 x:0 0 0 2024-04-16T14:35:30.986 INFO:tasks.workunit.client.0.smithi005.stdout:7/341: dread d1/d5/d22/d27/f46 [0,4194304] 0 2024-04-16T14:35:30.987 INFO:tasks.workunit.client.0.smithi005.stdout:8/321: rmdir d5/d11/d1f 39 2024-04-16T14:35:30.995 INFO:tasks.workunit.client.0.smithi005.stdout:9/191: mknod d3/d12/d16/c33 0 2024-04-16T14:35:30.995 INFO:tasks.workunit.client.0.smithi005.stdout:9/192: write d3/d12/f23 [3081440,129133] 0 2024-04-16T14:35:30.995 INFO:tasks.workunit.client.0.smithi005.stdout:3/197: dread d2/fe [0,4194304] 0 2024-04-16T14:35:30.995 INFO:tasks.workunit.client.0.smithi005.stdout:9/193: chown d3/d12/f2a 3 1 2024-04-16T14:35:30.996 INFO:tasks.workunit.client.0.smithi005.stdout:2/147: write d0/d4/f9 [6104518,90429] 0 2024-04-16T14:35:30.997 INFO:tasks.workunit.client.0.smithi005.stdout:7/342: link d1/d5/d22/c31 d1/dc/c6a 0 2024-04-16T14:35:30.998 INFO:tasks.workunit.client.0.smithi005.stdout:7/343: creat d1/d49/f6b x:0 0 0 2024-04-16T14:35:30.998 INFO:tasks.workunit.client.0.smithi005.stdout:0/308: dread da/df/f21 [0,4194304] 0 2024-04-16T14:35:30.998 INFO:tasks.workunit.client.0.smithi005.stdout:0/309: chown da/df/d26/d39/l58 1 1 2024-04-16T14:35:30.998 INFO:tasks.workunit.client.0.smithi005.stdout:0/310: truncate da/df/d1b/f62 811581 0 2024-04-16T14:35:30.998 INFO:tasks.workunit.client.0.smithi005.stdout:0/311: write da/fc [3567482,7621] 0 2024-04-16T14:35:30.998 INFO:tasks.workunit.client.0.smithi005.stdout:0/312: write da/f1f [5219163,55905] 0 2024-04-16T14:35:30.999 INFO:tasks.workunit.client.0.smithi005.stdout:4/422: dwrite d0/f5 [0,4194304] 0 2024-04-16T14:35:31.000 INFO:tasks.workunit.client.0.smithi005.stdout:9/194: mknod d3/c34 0 2024-04-16T14:35:31.001 INFO:tasks.workunit.client.0.smithi005.stdout:5/266: dwrite d0/d6/d12/d1c/f1f [0,4194304] 0 2024-04-16T14:35:31.001 INFO:tasks.workunit.client.0.smithi005.stdout:6/415: dwrite d2/d45/d7b/f86 [0,4194304] 0 2024-04-16T14:35:31.001 INFO:tasks.workunit.client.0.smithi005.stdout:2/148: mkdir d0/d2a 0 2024-04-16T14:35:31.006 INFO:tasks.workunit.client.0.smithi005.stdout:0/313: creat da/df/d50/f63 x:0 0 0 2024-04-16T14:35:31.007 INFO:tasks.workunit.client.0.smithi005.stdout:0/314: stat da/df/d1b/d3a/f3b 0 2024-04-16T14:35:31.008 INFO:tasks.workunit.client.0.smithi005.stdout:3/198: getdents d2 0 2024-04-16T14:35:31.008 INFO:tasks.workunit.client.0.smithi005.stdout:3/199: fsync d2/f21 0 2024-04-16T14:35:31.009 INFO:tasks.workunit.client.0.smithi005.stdout:8/322: dwrite d5/de/f5b [0,4194304] 0 2024-04-16T14:35:31.012 INFO:tasks.workunit.client.0.smithi005.stdout:4/423: creat d0/d1b/d1d/d4f/f7e x:0 0 0 2024-04-16T14:35:31.016 INFO:tasks.workunit.client.0.smithi005.stdout:7/344: mkdir d1/d5/d6c 0 2024-04-16T14:35:31.017 INFO:tasks.workunit.client.0.smithi005.stdout:0/315: getdents da/df/d26/d39 0 2024-04-16T14:35:31.017 INFO:tasks.workunit.client.0.smithi005.stdout:5/267: write d0/f1b [2330882,7550] 0 2024-04-16T14:35:31.021 INFO:tasks.workunit.client.0.smithi005.stdout:8/323: mkdir d5/d11/d6c/d71 0 2024-04-16T14:35:31.021 INFO:tasks.workunit.client.0.smithi005.stdout:7/345: dread d1/d5/d22/f42 [0,4194304] 0 2024-04-16T14:35:31.023 INFO:tasks.workunit.client.0.smithi005.stdout:4/424: unlink d0/d1b/d1d/d4f/f7e 0 2024-04-16T14:35:31.023 INFO:tasks.workunit.client.0.smithi005.stdout:4/425: stat d0/d1b/d1d/d1f/d3e/f55 0 2024-04-16T14:35:31.025 INFO:tasks.workunit.client.0.smithi005.stdout:6/416: link d2/df/c3d d2/d5/d10/d4d/d51/d6e/c8d 0 2024-04-16T14:35:31.026 INFO:tasks.workunit.client.0.smithi005.stdout:6/417: write d2/d5/d28/f67 [750246,110908] 0 2024-04-16T14:35:31.026 INFO:tasks.workunit.client.0.smithi005.stdout:6/418: write d2/d5/d28/f38 [9277881,73834] 0 2024-04-16T14:35:31.026 INFO:tasks.workunit.client.0.smithi005.stdout:2/149: dwrite d0/d1e/f1a [0,4194304] 0 2024-04-16T14:35:31.026 INFO:tasks.workunit.client.0.smithi005.stdout:2/150: truncate d0/d4/f28 144983 0 2024-04-16T14:35:31.027 INFO:tasks.workunit.client.0.smithi005.stdout:2/151: chown d0 686061564 1 2024-04-16T14:35:31.027 INFO:tasks.workunit.client.0.smithi005.stdout:8/324: mknod d5/c72 0 2024-04-16T14:35:31.030 INFO:tasks.workunit.client.0.smithi005.stdout:3/200: write d2/d9/df/f1c [1539638,106529] 0 2024-04-16T14:35:31.031 INFO:tasks.workunit.client.0.smithi005.stdout:9/195: dwrite d3/f25 [0,4194304] 0 2024-04-16T14:35:31.032 INFO:tasks.workunit.client.0.smithi005.stdout:6/419: rename d2/d20/d3c/d7c/d81 to d2/d5/d10/d4d/d8e 0 2024-04-16T14:35:31.036 INFO:tasks.workunit.client.0.smithi005.stdout:8/325: creat d5/de/f73 x:0 0 0 2024-04-16T14:35:31.037 INFO:tasks.workunit.client.0.smithi005.stdout:0/316: dwrite da/df/d26/d39/d55/f5e [0,4194304] 0 2024-04-16T14:35:31.048 INFO:tasks.workunit.client.0.smithi005.stdout:9/196: creat d3/d12/d16/f35 x:0 0 0 2024-04-16T14:35:31.049 INFO:tasks.workunit.client.0.smithi005.stdout:9/197: write d3/f14 [19192,56159] 0 2024-04-16T14:35:31.049 INFO:tasks.workunit.client.0.smithi005.stdout:8/326: fsync d5/d11/f20 0 2024-04-16T14:35:31.050 INFO:tasks.workunit.client.0.smithi005.stdout:8/327: dread - d5/d40/f70 zero size 2024-04-16T14:35:31.051 INFO:tasks.workunit.client.0.smithi005.stdout:0/317: symlink da/l64 0 2024-04-16T14:35:31.053 INFO:tasks.workunit.client.0.smithi005.stdout:4/426: dwrite d0/f10 [0,4194304] 0 2024-04-16T14:35:31.054 INFO:tasks.workunit.client.0.smithi005.stdout:7/346: dwrite d1/d5/d22/d27/f45 [0,4194304] 0 2024-04-16T14:35:31.054 INFO:tasks.workunit.client.0.smithi005.stdout:7/347: readlink d1/d5/l32 0 2024-04-16T14:35:31.054 INFO:tasks.workunit.client.0.smithi005.stdout:3/201: rename d2/d9/lc to d2/d17/l43 0 2024-04-16T14:35:31.056 INFO:tasks.workunit.client.0.smithi005.stdout:9/198: mknod d3/d12/d2b/c36 0 2024-04-16T14:35:31.062 INFO:tasks.workunit.client.0.smithi005.stdout:7/348: rename d1/d5/d22/d27/d2e/c68 to d1/d5/d57/c6d 0 2024-04-16T14:35:31.064 INFO:tasks.workunit.client.0.smithi005.stdout:3/202: creat d2/f44 x:0 0 0 2024-04-16T14:35:31.064 INFO:tasks.workunit.client.0.smithi005.stdout:3/203: creat d2/f45 x:0 0 0 2024-04-16T14:35:31.065 INFO:tasks.workunit.client.0.smithi005.stdout:3/204: fsync d2/d9/df/f3c 0 2024-04-16T14:35:31.065 INFO:tasks.workunit.client.0.smithi005.stdout:6/420: truncate d2/d5/d28/f38 2336436 0 2024-04-16T14:35:31.065 INFO:tasks.workunit.client.0.smithi005.stdout:6/421: chown d2/d20/d3c 353478442 1 2024-04-16T14:35:31.066 INFO:tasks.workunit.client.0.smithi005.stdout:8/328: getdents d5/d11 0 2024-04-16T14:35:31.066 INFO:tasks.workunit.client.0.smithi005.stdout:8/329: chown d5/d11/d6c/d71 3633 1 2024-04-16T14:35:31.068 INFO:tasks.workunit.client.0.smithi005.stdout:7/349: link d1/d5/d22/d27/d2e/l56 d1/dc/d2f/d4f/l6e 0 2024-04-16T14:35:31.068 INFO:tasks.workunit.client.0.smithi005.stdout:7/350: creat d1/f6f x:0 0 0 2024-04-16T14:35:31.070 INFO:tasks.workunit.client.0.smithi005.stdout:6/422: rename d2/d20/d3c/l43 to d2/d20/d3c/l8f 0 2024-04-16T14:35:31.072 INFO:tasks.workunit.client.0.smithi005.stdout:9/199: getdents d3/d12 0 2024-04-16T14:35:31.074 INFO:tasks.workunit.client.0.smithi005.stdout:3/205: mkdir d2/d17/d46 0 2024-04-16T14:35:31.075 INFO:tasks.workunit.client.0.smithi005.stdout:3/206: chown d2/f2b 1677721 1 2024-04-16T14:35:31.075 INFO:tasks.workunit.client.0.smithi005.stdout:6/423: mkdir d2/d3f/d47/d90 0 2024-04-16T14:35:31.075 INFO:tasks.workunit.client.0.smithi005.stdout:6/424: dread - d2/d5/f6a zero size 2024-04-16T14:35:31.076 INFO:tasks.workunit.client.0.smithi005.stdout:9/200: symlink d3/l37 0 2024-04-16T14:35:31.077 INFO:tasks.workunit.client.0.smithi005.stdout:8/330: rmdir d5/de 39 2024-04-16T14:35:31.077 INFO:tasks.workunit.client.0.smithi005.stdout:8/331: write d5/d11/d1f/d2f/d3d/f52 [3836781,9262] 0 2024-04-16T14:35:31.077 INFO:tasks.workunit.client.0.smithi005.stdout:4/427: dwrite d0/f7 [4194304,4194304] 0 2024-04-16T14:35:31.079 INFO:tasks.workunit.client.0.smithi005.stdout:6/425: rename d2/d20/d3c/f59 to d2/d20/d72/f91 0 2024-04-16T14:35:31.079 INFO:tasks.workunit.client.0.smithi005.stdout:1/412: sync 2024-04-16T14:35:31.080 INFO:tasks.workunit.client.0.smithi005.stdout:4/428: rmdir d0/d22 39 2024-04-16T14:35:31.081 INFO:tasks.workunit.client.0.smithi005.stdout:4/429: chown d0/d1b/d1d/d1f/d5d 1682752 1 2024-04-16T14:35:31.083 INFO:tasks.workunit.client.0.smithi005.stdout:8/332: mkdir d5/de/d74 0 2024-04-16T14:35:31.088 INFO:tasks.workunit.client.0.smithi005.stdout:9/201: dread d3/d12/f28 [0,4194304] 0 2024-04-16T14:35:31.088 INFO:tasks.workunit.client.0.smithi005.stdout:9/202: truncate d3/d12/f23 3945381 0 2024-04-16T14:35:31.088 INFO:tasks.workunit.client.0.smithi005.stdout:9/203: stat d3/f10 0 2024-04-16T14:35:31.100 INFO:tasks.workunit.client.0.smithi005.stdout:9/204: dwrite d3/d12/f2a [0,4194304] 0 2024-04-16T14:35:31.110 INFO:tasks.workunit.client.0.smithi005.stdout:4/430: rename d0/fd to d0/d22/d29/f7f 0 2024-04-16T14:35:31.112 INFO:tasks.workunit.client.0.smithi005.stdout:8/333: creat d5/d11/d1f/d2f/d68/f75 x:0 0 0 2024-04-16T14:35:31.114 INFO:tasks.workunit.client.0.smithi005.stdout:9/205: mknod d3/d12/c38 0 2024-04-16T14:35:31.118 INFO:tasks.workunit.client.0.smithi005.stdout:4/431: symlink d0/d1b/d1d/d1f/d3e/l80 0 2024-04-16T14:35:31.118 INFO:tasks.workunit.client.0.smithi005.stdout:1/413: rename d2/d1c/d15/d2a/d1a/d2e/d83 to d2/d1c/d15/d2a/d1a/d2e/d9b 0 2024-04-16T14:35:31.119 INFO:tasks.workunit.client.0.smithi005.stdout:1/414: creat d2/d1c/d15/f9c x:0 0 0 2024-04-16T14:35:31.119 INFO:tasks.workunit.client.0.smithi005.stdout:8/334: mknod d5/d40/c76 0 2024-04-16T14:35:31.120 INFO:tasks.workunit.client.0.smithi005.stdout:4/432: symlink d0/d22/d29/d63/l81 0 2024-04-16T14:35:31.122 INFO:tasks.workunit.client.0.smithi005.stdout:1/415: rename d2/d1c/d15/d2a/d1a/d2e/d51/f94 to d2/d1c/f9d 0 2024-04-16T14:35:31.123 INFO:tasks.workunit.client.0.smithi005.stdout:4/433: unlink d0/d22/l6f 0 2024-04-16T14:35:31.124 INFO:tasks.workunit.client.0.smithi005.stdout:1/416: mknod d2/d1c/d15/d2a/d1a/d2e/c9e 0 2024-04-16T14:35:31.125 INFO:tasks.workunit.client.0.smithi005.stdout:4/434: creat d0/d1b/d1d/d4f/d75/f82 x:0 0 0 2024-04-16T14:35:31.127 INFO:tasks.workunit.client.0.smithi005.stdout:4/435: rename d0/d1b/d1d/d1f/d3e/l7b to d0/d1b/l83 0 2024-04-16T14:35:31.127 INFO:tasks.workunit.client.0.smithi005.stdout:4/436: dread - d0/d1b/d1d/d1f/d3e/f55 zero size 2024-04-16T14:35:31.134 INFO:tasks.workunit.client.0.smithi005.stdout:9/206: dwrite d3/d12/d16/f1a [4194304,4194304] 0 2024-04-16T14:35:31.136 INFO:tasks.workunit.client.0.smithi005.stdout:0/318: dwrite da/df/d1b/f47 [0,4194304] 0 2024-04-16T14:35:31.144 INFO:tasks.workunit.client.0.smithi005.stdout:0/319: read da/df/d1b/f25 [3450568,94663] 0 2024-04-16T14:35:31.145 INFO:tasks.workunit.client.0.smithi005.stdout:0/320: rename da/df/f15 to da/df/f65 0 2024-04-16T14:35:31.151 INFO:tasks.workunit.client.0.smithi005.stdout:4/437: dwrite d0/d1b/d1d/f53 [0,4194304] 0 2024-04-16T14:35:31.151 INFO:tasks.workunit.client.0.smithi005.stdout:4/438: creat d0/d1b/d1d/d1f/d3e/f84 x:0 0 0 2024-04-16T14:35:31.153 INFO:tasks.workunit.client.0.smithi005.stdout:4/439: stat d0/c72 0 2024-04-16T14:35:31.288 INFO:tasks.workunit.client.0.smithi005.stdout:7/351: dwrite d1/d5/d22/d27/f36 [0,4194304] 0 2024-04-16T14:35:31.291 INFO:tasks.workunit.client.0.smithi005.stdout:8/335: dwrite d5/d11/d1f/d2f/d68/f75 [0,4194304] 0 2024-04-16T14:35:31.292 INFO:tasks.workunit.client.0.smithi005.stdout:3/207: getdents d2/d17 0 2024-04-16T14:35:31.293 INFO:tasks.workunit.client.0.smithi005.stdout:3/208: stat d2/f21 0 2024-04-16T14:35:31.293 INFO:tasks.workunit.client.0.smithi005.stdout:3/209: fsync d2/f21 0 2024-04-16T14:35:31.304 INFO:tasks.workunit.client.0.smithi005.stdout:3/210: mkdir d2/d17/d46/d47 0 2024-04-16T14:35:31.304 INFO:tasks.workunit.client.0.smithi005.stdout:3/211: fdatasync d2/d9/d25/f32 0 2024-04-16T14:35:31.304 INFO:tasks.workunit.client.0.smithi005.stdout:3/212: chown d2/d17/d1e/f42 68 1 2024-04-16T14:35:31.305 INFO:tasks.workunit.client.0.smithi005.stdout:8/336: unlink d5/de/c1a 0 2024-04-16T14:35:31.307 INFO:tasks.workunit.client.0.smithi005.stdout:3/213: creat d2/d17/f48 x:0 0 0 2024-04-16T14:35:31.307 INFO:tasks.workunit.client.0.smithi005.stdout:3/214: write d2/f2b [1626015,32733] 0 2024-04-16T14:35:31.308 INFO:tasks.workunit.client.0.smithi005.stdout:3/215: symlink d2/d17/l49 0 2024-04-16T14:35:31.312 INFO:tasks.workunit.client.0.smithi005.stdout:6/426: dwrite d2/f18 [0,4194304] 0 2024-04-16T14:35:31.313 INFO:tasks.workunit.client.0.smithi005.stdout:6/427: symlink d2/d3f/d53/d54/l92 0 2024-04-16T14:35:31.313 INFO:tasks.workunit.client.0.smithi005.stdout:6/428: chown d2/d45/l4e 5263 1 2024-04-16T14:35:31.316 INFO:tasks.workunit.client.0.smithi005.stdout:7/352: dwrite d1/dc/d2f/f3e [0,4194304] 0 2024-04-16T14:35:31.316 INFO:tasks.workunit.client.0.smithi005.stdout:6/429: write d2/d5/d10/f60 [183890,105544] 0 2024-04-16T14:35:31.316 INFO:tasks.workunit.client.0.smithi005.stdout:6/430: read - d2/d5/d10/d4d/f80 zero size 2024-04-16T14:35:31.316 INFO:tasks.workunit.client.0.smithi005.stdout:6/431: write d2/d45/d7b/f82 [831188,126963] 0 2024-04-16T14:35:31.348 INFO:tasks.workunit.client.0.smithi005.stdout:8/337: dwrite d5/d11/d1f/f24 [0,4194304] 0 2024-04-16T14:35:31.348 INFO:tasks.workunit.client.0.smithi005.stdout:7/353: dwrite d1/d5/d22/d27/d3a/d5c/f62 [0,4194304] 0 2024-04-16T14:35:31.349 INFO:tasks.workunit.client.0.smithi005.stdout:3/216: dwrite d2/d9/df/f3c [0,4194304] 0 2024-04-16T14:35:31.349 INFO:tasks.workunit.client.0.smithi005.stdout:3/217: dread d2/f2b [0,4194304] 0 2024-04-16T14:35:31.349 INFO:tasks.workunit.client.0.smithi005.stdout:8/338: link d5/de/l42 d5/de/d74/l77 0 2024-04-16T14:35:31.351 INFO:tasks.workunit.client.0.smithi005.stdout:7/354: rename d1/cf to d1/dc/d2f/d4f/c70 0 2024-04-16T14:35:31.352 INFO:tasks.workunit.client.0.smithi005.stdout:3/218: rename d2/d17 to d2/d17/d46/d47/d4a 22 2024-04-16T14:35:31.352 INFO:tasks.workunit.client.0.smithi005.stdout:2/152: sync 2024-04-16T14:35:31.352 INFO:tasks.workunit.client.0.smithi005.stdout:5/268: sync 2024-04-16T14:35:31.352 INFO:tasks.workunit.client.0.smithi005.stdout:5/269: write d0/d6/f36 [4551698,96497] 0 2024-04-16T14:35:31.353 INFO:tasks.workunit.client.0.smithi005.stdout:2/153: dread d0/d4/f28 [0,4194304] 0 2024-04-16T14:35:31.358 INFO:tasks.workunit.client.0.smithi005.stdout:8/339: symlink d5/d40/d4b/l78 0 2024-04-16T14:35:31.359 INFO:tasks.workunit.client.0.smithi005.stdout:3/219: creat d2/d17/d46/f4b x:0 0 0 2024-04-16T14:35:31.362 INFO:tasks.workunit.client.0.smithi005.stdout:8/340: link d5/d11/c27 d5/d55/d5a/c79 0 2024-04-16T14:35:31.363 INFO:tasks.workunit.client.0.smithi005.stdout:7/355: symlink d1/d5/l71 0 2024-04-16T14:35:31.366 INFO:tasks.workunit.client.0.smithi005.stdout:2/154: rename d0/d1e to d0/d4/d2b 0 2024-04-16T14:35:31.366 INFO:tasks.workunit.client.0.smithi005.stdout:2/155: readlink d0/d4/d2b/l10 0 2024-04-16T14:35:31.367 INFO:tasks.workunit.client.0.smithi005.stdout:8/341: mkdir d5/d11/d6c/d7a 0 2024-04-16T14:35:31.374 INFO:tasks.workunit.client.0.smithi005.stdout:3/220: rename d2/f45 to d2/d9/d25/f4c 0 2024-04-16T14:35:31.376 INFO:tasks.workunit.client.0.smithi005.stdout:3/221: symlink d2/d17/d46/d47/l4d 0 2024-04-16T14:35:31.377 INFO:tasks.workunit.client.0.smithi005.stdout:3/222: mknod d2/d9/df/c4e 0 2024-04-16T14:35:31.379 INFO:tasks.workunit.client.0.smithi005.stdout:3/223: symlink d2/d9/d25/d39/l4f 0 2024-04-16T14:35:31.380 INFO:tasks.workunit.client.0.smithi005.stdout:3/224: mknod d2/d9/df/c50 0 2024-04-16T14:35:31.381 INFO:tasks.workunit.client.0.smithi005.stdout:3/225: mkdir d2/d9/d51 0 2024-04-16T14:35:31.382 INFO:tasks.workunit.client.0.smithi005.stdout:7/356: dwrite d1/dc/f1c [0,4194304] 0 2024-04-16T14:35:31.384 INFO:tasks.workunit.client.0.smithi005.stdout:7/357: dread d1/d5/d22/f30 [0,4194304] 0 2024-04-16T14:35:31.384 INFO:tasks.workunit.client.0.smithi005.stdout:8/342: rename d5/d11/d1f to d5/d7b 0 2024-04-16T14:35:31.384 INFO:tasks.workunit.client.0.smithi005.stdout:8/343: chown d5/d40/d4b 390 1 2024-04-16T14:35:31.385 INFO:tasks.workunit.client.0.smithi005.stdout:8/344: chown d5 117037621 1 2024-04-16T14:35:31.385 INFO:tasks.workunit.client.0.smithi005.stdout:7/358: symlink d1/d5/d57/l72 0 2024-04-16T14:35:31.385 INFO:tasks.workunit.client.0.smithi005.stdout:7/359: truncate d1/dc/d2f/f5d 708163 0 2024-04-16T14:35:31.387 INFO:tasks.workunit.client.0.smithi005.stdout:3/226: rename d2/d9/df/l37 to d2/d17/d46/l52 0 2024-04-16T14:35:31.387 INFO:tasks.workunit.client.0.smithi005.stdout:3/227: creat d2/d9/f53 x:0 0 0 2024-04-16T14:35:31.388 INFO:tasks.workunit.client.0.smithi005.stdout:8/345: unlink d5/d7b/c65 0 2024-04-16T14:35:31.392 INFO:tasks.workunit.client.0.smithi005.stdout:8/346: symlink d5/d11/d6c/d71/l7c 0 2024-04-16T14:35:31.392 INFO:tasks.workunit.client.0.smithi005.stdout:3/228: getdents d2/d17 0 2024-04-16T14:35:31.395 INFO:tasks.workunit.client.0.smithi005.stdout:3/229: dread d2/f2b [0,4194304] 0 2024-04-16T14:35:31.395 INFO:tasks.workunit.client.0.smithi005.stdout:3/230: chown d2/d9/df/c3a 0 1 2024-04-16T14:35:31.397 INFO:tasks.workunit.client.0.smithi005.stdout:7/360: dwrite d1/d49/f5f [0,4194304] 0 2024-04-16T14:35:31.407 INFO:tasks.workunit.client.0.smithi005.stdout:7/361: dread d1/d5/d22/d27/d3a/f40 [0,4194304] 0 2024-04-16T14:35:31.407 INFO:tasks.workunit.client.0.smithi005.stdout:7/362: write d1/f29 [1075157,51417] 0 2024-04-16T14:35:31.409 INFO:tasks.workunit.client.0.smithi005.stdout:3/231: dwrite d2/f21 [0,4194304] 0 2024-04-16T14:35:31.411 INFO:tasks.workunit.client.0.smithi005.stdout:7/363: write d1/d5/f17 [1643228,108295] 0 2024-04-16T14:35:31.412 INFO:tasks.workunit.client.0.smithi005.stdout:7/364: readlink d1/d5/ld 0 2024-04-16T14:35:31.413 INFO:tasks.workunit.client.0.smithi005.stdout:7/365: rmdir d1/d5/d57/d47/d61 0 2024-04-16T14:35:31.413 INFO:tasks.workunit.client.0.smithi005.stdout:7/366: fdatasync d1/d5/d22/f59 0 2024-04-16T14:35:31.413 INFO:tasks.workunit.client.0.smithi005.stdout:7/367: link d1/dc/c6a d1/d5/d22/d27/d3a/c73 0 2024-04-16T14:35:31.414 INFO:tasks.workunit.client.0.smithi005.stdout:7/368: mkdir d1/d49/d74 0 2024-04-16T14:35:31.414 INFO:tasks.workunit.client.0.smithi005.stdout:7/369: write d1/d5/d57/f4a [4346847,98583] 0 2024-04-16T14:35:31.415 INFO:tasks.workunit.client.0.smithi005.stdout:7/370: symlink d1/dc/d2f/l75 0 2024-04-16T14:35:31.415 INFO:tasks.workunit.client.0.smithi005.stdout:7/371: fdatasync d1/d5/f11 0 2024-04-16T14:35:31.422 INFO:tasks.workunit.client.0.smithi005.stdout:7/372: dread d1/dc/f1c [4194304,4194304] 0 2024-04-16T14:35:31.426 INFO:tasks.workunit.client.0.smithi005.stdout:3/232: dwrite d2/d9/d25/d39/f3b [0,4194304] 0 2024-04-16T14:35:31.427 INFO:tasks.workunit.client.0.smithi005.stdout:3/233: creat d2/d17/f54 x:0 0 0 2024-04-16T14:35:31.429 INFO:tasks.workunit.client.0.smithi005.stdout:3/234: rename d2/d9/df/f2f to d2/d9/f55 0 2024-04-16T14:35:31.429 INFO:tasks.workunit.client.0.smithi005.stdout:3/235: chown d2/d17/d46/d47 232446 1 2024-04-16T14:35:31.430 INFO:tasks.workunit.client.0.smithi005.stdout:3/236: mknod d2/d9/c56 0 2024-04-16T14:35:31.430 INFO:tasks.workunit.client.0.smithi005.stdout:3/237: creat d2/d17/d46/f57 x:0 0 0 2024-04-16T14:35:31.430 INFO:tasks.workunit.client.0.smithi005.stdout:3/238: write d2/f44 [1006378,114522] 0 2024-04-16T14:35:31.433 INFO:tasks.workunit.client.0.smithi005.stdout:7/373: dread d1/dc/f1c [0,4194304] 0 2024-04-16T14:35:31.433 INFO:tasks.workunit.client.0.smithi005.stdout:7/374: dread - d1/d5/d22/f59 zero size 2024-04-16T14:35:31.434 INFO:tasks.workunit.client.0.smithi005.stdout:7/375: creat d1/d5/d6c/f76 x:0 0 0 2024-04-16T14:35:31.436 INFO:tasks.workunit.client.0.smithi005.stdout:3/239: dread d2/d9/df/f1c [0,4194304] 0 2024-04-16T14:35:31.443 INFO:tasks.workunit.client.0.smithi005.stdout:3/240: creat d2/d9/d51/f58 x:0 0 0 2024-04-16T14:35:31.443 INFO:tasks.workunit.client.0.smithi005.stdout:3/241: fdatasync d2/f2b 0 2024-04-16T14:35:31.443 INFO:tasks.workunit.client.0.smithi005.stdout:3/242: getdents d2/d17/d1e 0 2024-04-16T14:35:31.443 INFO:tasks.workunit.client.0.smithi005.stdout:3/243: read - d2/d9/d51/f58 zero size 2024-04-16T14:35:31.443 INFO:tasks.workunit.client.0.smithi005.stdout:7/376: rename d1/d5 to d1/d49/d74/d77 0 2024-04-16T14:35:31.443 INFO:tasks.workunit.client.0.smithi005.stdout:7/377: write d1/d49/d74/d77/d57/f4a [4517056,116141] 0 2024-04-16T14:35:31.445 INFO:tasks.workunit.client.0.smithi005.stdout:3/244: rename d2/l40 to d2/d17/d1e/d41/l59 0 2024-04-16T14:35:31.445 INFO:tasks.workunit.client.0.smithi005.stdout:3/245: chown d2/d9/df/l2e 3805 1 2024-04-16T14:35:31.445 INFO:tasks.workunit.client.0.smithi005.stdout:3/246: fdatasync d2/f2b 0 2024-04-16T14:35:31.447 INFO:tasks.workunit.client.0.smithi005.stdout:7/378: rename d1/d49/d74/d77/ld to d1/d49/d74/d77/d22/d27/d3a/l78 0 2024-04-16T14:35:31.448 INFO:tasks.workunit.client.0.smithi005.stdout:7/379: creat d1/d49/d74/d77/d57/d47/f79 x:0 0 0 2024-04-16T14:35:31.448 INFO:tasks.workunit.client.0.smithi005.stdout:7/380: truncate d1/d49/d74/d77/d22/f59 584115 0 2024-04-16T14:35:31.451 INFO:tasks.workunit.client.0.smithi005.stdout:3/247: dread d2/f21 [4194304,4194304] 0 2024-04-16T14:35:31.453 INFO:tasks.workunit.client.0.smithi005.stdout:3/248: rename d2/d9/df/c3a to d2/d9/d25/d39/c5a 0 2024-04-16T14:35:31.455 INFO:tasks.workunit.client.0.smithi005.stdout:3/249: link d2/c10 d2/d9/d51/c5b 0 2024-04-16T14:35:31.455 INFO:tasks.workunit.client.0.smithi005.stdout:3/250: chown d2/d9/d25/l27 15 1 2024-04-16T14:35:31.456 INFO:tasks.workunit.client.0.smithi005.stdout:3/251: symlink d2/l5c 0 2024-04-16T14:35:31.456 INFO:tasks.workunit.client.0.smithi005.stdout:3/252: write d2/d9/f35 [964190,37874] 0 2024-04-16T14:35:31.468 INFO:tasks.workunit.client.0.smithi005.stdout:7/381: dwrite d1/d49/d74/d77/d22/d27/f64 [0,4194304] 0 2024-04-16T14:35:31.468 INFO:tasks.workunit.client.0.smithi005.stdout:7/382: write d1/d49/f6b [1022969,58675] 0 2024-04-16T14:35:31.468 INFO:tasks.workunit.client.0.smithi005.stdout:7/383: write d1/d49/d74/d77/f17 [1488914,116334] 0 2024-04-16T14:35:31.470 INFO:tasks.workunit.client.0.smithi005.stdout:7/384: rmdir d1/d49/d74/d77/d57/d47 39 2024-04-16T14:35:31.474 INFO:tasks.workunit.client.0.smithi005.stdout:3/253: dwrite d2/f44 [0,4194304] 0 2024-04-16T14:35:31.474 INFO:tasks.workunit.client.0.smithi005.stdout:3/254: dread - d2/d17/d46/f4b zero size 2024-04-16T14:35:31.474 INFO:tasks.workunit.client.0.smithi005.stdout:3/255: chown d2/d9/d51/f58 36136 1 2024-04-16T14:35:31.476 INFO:tasks.workunit.client.0.smithi005.stdout:7/385: dread d1/d49/d74/d77/d22/d27/d3a/f40 [0,4194304] 0 2024-04-16T14:35:31.480 INFO:tasks.workunit.client.0.smithi005.stdout:7/386: unlink d1/dc/f1c 0 2024-04-16T14:35:31.480 INFO:tasks.workunit.client.0.smithi005.stdout:7/387: chown d1/d49/d74/d77/d22/d27/d2e 14244034 1 2024-04-16T14:35:31.481 INFO:tasks.workunit.client.0.smithi005.stdout:7/388: creat d1/dc/d2f/d4f/f7a x:0 0 0 2024-04-16T14:35:31.482 INFO:tasks.workunit.client.0.smithi005.stdout:7/389: creat d1/d49/d74/d77/d57/f7b x:0 0 0 2024-04-16T14:35:31.483 INFO:tasks.workunit.client.0.smithi005.stdout:7/390: dread d1/d49/d74/d77/d22/f59 [0,4194304] 0 2024-04-16T14:35:31.485 INFO:tasks.workunit.client.0.smithi005.stdout:7/391: creat d1/d49/d74/d77/d57/d47/f7c x:0 0 0 2024-04-16T14:35:31.485 INFO:tasks.workunit.client.0.smithi005.stdout:7/392: chown d1/d49/d74/d77/d22 1 1 2024-04-16T14:35:31.485 INFO:tasks.workunit.client.0.smithi005.stdout:7/393: creat d1/dc/f7d x:0 0 0 2024-04-16T14:35:31.486 INFO:tasks.workunit.client.0.smithi005.stdout:7/394: write d1/dc/d2f/f60 [722777,50695] 0 2024-04-16T14:35:31.486 INFO:tasks.workunit.client.0.smithi005.stdout:7/395: creat d1/dc/f7e x:0 0 0 2024-04-16T14:35:31.486 INFO:tasks.workunit.client.0.smithi005.stdout:7/396: chown d1/d49/d74/d77/d22/d27/d3a/c73 12 1 2024-04-16T14:35:31.486 INFO:tasks.workunit.client.0.smithi005.stdout:7/397: rmdir d1/d49/d74/d77/d22/d27/d3a 39 2024-04-16T14:35:31.487 INFO:tasks.workunit.client.0.smithi005.stdout:7/398: read d1/f55 [360573,4882] 0 2024-04-16T14:35:31.487 INFO:tasks.workunit.client.0.smithi005.stdout:7/399: creat d1/d49/d74/f7f x:0 0 0 2024-04-16T14:35:31.490 INFO:tasks.workunit.client.0.smithi005.stdout:3/256: dwrite d2/d9/f53 [0,4194304] 0 2024-04-16T14:35:31.490 INFO:tasks.workunit.client.0.smithi005.stdout:3/257: fsync d2/d9/f53 0 2024-04-16T14:35:31.491 INFO:tasks.workunit.client.0.smithi005.stdout:3/258: dread - d2/d9/d25/f32 zero size 2024-04-16T14:35:31.491 INFO:tasks.workunit.client.0.smithi005.stdout:3/259: chown d2/d9/cd 1769126 1 2024-04-16T14:35:31.495 INFO:tasks.workunit.client.0.smithi005.stdout:3/260: mknod d2/c5d 0 2024-04-16T14:35:31.495 INFO:tasks.workunit.client.0.smithi005.stdout:3/261: fdatasync d2/d9/d25/f32 0 2024-04-16T14:35:31.495 INFO:tasks.workunit.client.0.smithi005.stdout:3/262: stat d2/d17/d1e/d41 0 2024-04-16T14:35:31.496 INFO:tasks.workunit.client.0.smithi005.stdout:3/263: truncate d2/d9/df/f3c 335160 0 2024-04-16T14:35:31.496 INFO:tasks.workunit.client.0.smithi005.stdout:3/264: chown d2/d17/d1e/f36 168255 1 2024-04-16T14:35:31.500 INFO:tasks.workunit.client.0.smithi005.stdout:3/265: mkdir d2/d9/d5e 0 2024-04-16T14:35:31.500 INFO:tasks.workunit.client.0.smithi005.stdout:3/266: mknod d2/d17/d46/c5f 0 2024-04-16T14:35:31.500 INFO:tasks.workunit.client.0.smithi005.stdout:3/267: creat d2/d17/d1e/f60 x:0 0 0 2024-04-16T14:35:31.501 INFO:tasks.workunit.client.0.smithi005.stdout:3/268: chown d2/d17/f54 53 1 2024-04-16T14:35:31.501 INFO:tasks.workunit.client.0.smithi005.stdout:3/269: write d2/d17/f38 [4705656,64915] 0 2024-04-16T14:35:31.504 INFO:tasks.workunit.client.0.smithi005.stdout:1/417: sync 2024-04-16T14:35:31.504 INFO:tasks.workunit.client.0.smithi005.stdout:1/418: getdents d2/d1c/d15/d2a/d1a/d2e/d9b 0 2024-04-16T14:35:31.507 INFO:tasks.workunit.client.0.smithi005.stdout:3/270: write d2/f21 [4006689,78447] 0 2024-04-16T14:35:31.509 INFO:tasks.workunit.client.0.smithi005.stdout:3/271: link d2/d9/df/l2a d2/d9/d5e/l61 0 2024-04-16T14:35:31.509 INFO:tasks.workunit.client.0.smithi005.stdout:3/272: chown d2/c15 3523 1 2024-04-16T14:35:31.509 INFO:tasks.workunit.client.0.smithi005.stdout:3/273: fdatasync d2/d9/df/f3c 0 2024-04-16T14:35:31.512 INFO:tasks.workunit.client.0.smithi005.stdout:3/274: rmdir d2/d17/d46 39 2024-04-16T14:35:31.513 INFO:tasks.workunit.client.0.smithi005.stdout:3/275: truncate d2/d9/df/f1c 766033 0 2024-04-16T14:35:31.516 INFO:tasks.workunit.client.0.smithi005.stdout:3/276: rename d2/d9/d25/f32 to d2/d17/d46/d47/f62 0 2024-04-16T14:35:31.516 INFO:tasks.workunit.client.0.smithi005.stdout:3/277: chown d2/d9/d25 936 1 2024-04-16T14:35:31.516 INFO:tasks.workunit.client.0.smithi005.stdout:3/278: read - d2/d17/d46/f57 zero size 2024-04-16T14:35:31.516 INFO:tasks.workunit.client.0.smithi005.stdout:3/279: symlink d2/d17/d1e/d41/l63 0 2024-04-16T14:35:31.516 INFO:tasks.workunit.client.0.smithi005.stdout:3/280: write d2/d17/d1e/f60 [897058,41697] 0 2024-04-16T14:35:31.529 INFO:tasks.workunit.client.0.smithi005.stdout:1/419: dwrite d2/d1c/fe [0,4194304] 0 2024-04-16T14:35:31.529 INFO:tasks.workunit.client.0.smithi005.stdout:3/281: write d2/d9/f53 [1000978,67825] 0 2024-04-16T14:35:31.529 INFO:tasks.workunit.client.0.smithi005.stdout:1/420: fsync d2/d1c/d15/d2a/d1a/d2e/f93 0 2024-04-16T14:35:31.543 INFO:tasks.workunit.client.0.smithi005.stdout:3/282: dread d2/d9/d25/d39/f3b [0,4194304] 0 2024-04-16T14:35:31.543 INFO:tasks.workunit.client.0.smithi005.stdout:3/283: write d2/d9/f53 [1093691,111099] 0 2024-04-16T14:35:31.545 INFO:tasks.workunit.client.0.smithi005.stdout:3/284: read d2/fe [1507003,96837] 0 2024-04-16T14:35:31.545 INFO:tasks.workunit.client.0.smithi005.stdout:3/285: readlink d2/d17/l3e 0 2024-04-16T14:35:31.546 INFO:tasks.workunit.client.0.smithi005.stdout:3/286: mkdir d2/d9/d25/d39/d64 0 2024-04-16T14:35:31.547 INFO:tasks.workunit.client.0.smithi005.stdout:3/287: getdents d2 0 2024-04-16T14:35:31.547 INFO:tasks.workunit.client.0.smithi005.stdout:3/288: stat d2/d9/d25/d39/f3b 0 2024-04-16T14:35:31.548 INFO:tasks.workunit.client.0.smithi005.stdout:3/289: unlink d2/d17/c2d 0 2024-04-16T14:35:31.549 INFO:tasks.workunit.client.0.smithi005.stdout:3/290: creat d2/d17/d1e/d41/f65 x:0 0 0 2024-04-16T14:35:31.549 INFO:tasks.workunit.client.0.smithi005.stdout:3/291: creat d2/f66 x:0 0 0 2024-04-16T14:35:31.550 INFO:tasks.workunit.client.0.smithi005.stdout:3/292: creat d2/d17/d46/d47/f67 x:0 0 0 2024-04-16T14:35:31.551 INFO:tasks.workunit.client.0.smithi005.stdout:3/293: mknod d2/d9/d25/c68 0 2024-04-16T14:35:31.551 INFO:tasks.workunit.client.0.smithi005.stdout:3/294: fdatasync d2/f21 0 2024-04-16T14:35:31.569 INFO:tasks.workunit.client.0.smithi005.stdout:3/295: dwrite d2/d9/df/f1c [0,4194304] 0 2024-04-16T14:35:31.570 INFO:tasks.workunit.client.0.smithi005.stdout:3/296: write d2/d9/df/f3c [632896,121423] 0 2024-04-16T14:35:31.572 INFO:tasks.workunit.client.0.smithi005.stdout:3/297: dread d2/f2b [0,4194304] 0 2024-04-16T14:35:31.574 INFO:tasks.workunit.client.0.smithi005.stdout:3/298: unlink d2/d9/d25/f4c 0 2024-04-16T14:35:31.574 INFO:tasks.workunit.client.0.smithi005.stdout:3/299: fdatasync d2/fe 0 2024-04-16T14:35:31.575 INFO:tasks.workunit.client.0.smithi005.stdout:3/300: symlink d2/d9/d25/d39/d64/l69 0 2024-04-16T14:35:31.575 INFO:tasks.workunit.client.0.smithi005.stdout:3/301: readlink d2/d9/d25/d39/d64/l69 0 2024-04-16T14:35:31.686 INFO:tasks.workunit.client.0.smithi005.stdout:0/321: sync 2024-04-16T14:35:31.686 INFO:tasks.workunit.client.0.smithi005.stdout:9/207: sync 2024-04-16T14:35:31.688 INFO:tasks.workunit.client.0.smithi005.stdout:0/322: rename da/df/d1b/l5b to da/df/d26/d39/l66 0 2024-04-16T14:35:31.688 INFO:tasks.workunit.client.0.smithi005.stdout:0/323: stat da/df/d26/f4a 0 2024-04-16T14:35:31.700 INFO:tasks.workunit.client.0.smithi005.stdout:0/324: dread da/df/d1b/f31 [0,4194304] 0 2024-04-16T14:35:31.701 INFO:tasks.workunit.client.0.smithi005.stdout:0/325: mkdir da/df/d1b/d3a/d53/d5a/d67 0 2024-04-16T14:35:31.703 INFO:tasks.workunit.client.0.smithi005.stdout:0/326: mknod da/df/d1b/d3a/d53/d5a/c68 0 2024-04-16T14:35:31.703 INFO:tasks.workunit.client.0.smithi005.stdout:0/327: chown da/df/d1b/d24/f3d 467902 1 2024-04-16T14:35:31.703 INFO:tasks.workunit.client.0.smithi005.stdout:0/328: write da/fc [492175,92903] 0 2024-04-16T14:35:31.703 INFO:tasks.workunit.client.0.smithi005.stdout:0/329: readlink da/df/d1b/d24/l40 0 2024-04-16T14:35:31.703 INFO:tasks.workunit.client.0.smithi005.stdout:0/330: symlink da/df/d1b/d3a/d53/d5a/d67/l69 0 2024-04-16T14:35:31.712 INFO:tasks.workunit.client.0.smithi005.stdout:0/331: write da/df/d1b/d3a/f4d [2563602,100680] 0 2024-04-16T14:35:31.713 INFO:tasks.workunit.client.0.smithi005.stdout:9/208: dwrite d3/d12/d2b/f2f [0,4194304] 0 2024-04-16T14:35:31.713 INFO:tasks.workunit.client.0.smithi005.stdout:9/209: creat d3/d12/d16/f39 x:0 0 0 2024-04-16T14:35:31.713 INFO:tasks.workunit.client.0.smithi005.stdout:9/210: chown d3/d12/d16/f19 130943743 1 2024-04-16T14:35:31.714 INFO:tasks.workunit.client.0.smithi005.stdout:0/332: mknod da/df/d26/d39/c6a 0 2024-04-16T14:35:31.722 INFO:tasks.workunit.client.0.smithi005.stdout:9/211: truncate d3/d12/d2b/f2f 3228721 0 2024-04-16T14:35:31.722 INFO:tasks.workunit.client.0.smithi005.stdout:9/212: mknod d3/c3a 0 2024-04-16T14:35:31.725 INFO:tasks.workunit.client.1.smithi115.stdout:9/130: sync 2024-04-16T14:35:31.725 INFO:tasks.workunit.client.1.smithi115.stdout:5/13: sync 2024-04-16T14:35:31.725 INFO:tasks.workunit.client.1.smithi115.stdout:4/24: sync 2024-04-16T14:35:31.726 INFO:tasks.workunit.client.1.smithi115.stdout:1/18: sync 2024-04-16T14:35:31.726 INFO:tasks.workunit.client.1.smithi115.stdout:2/17: sync 2024-04-16T14:35:31.726 INFO:tasks.workunit.client.1.smithi115.stdout:3/81: sync 2024-04-16T14:35:31.726 INFO:tasks.workunit.client.1.smithi115.stdout:9/131: creat d1/d10/d20/f23 x:0 0 0 2024-04-16T14:35:31.726 INFO:tasks.workunit.client.1.smithi115.stdout:7/82: sync 2024-04-16T14:35:31.726 INFO:tasks.workunit.client.1.smithi115.stdout:0/11: sync 2024-04-16T14:35:31.726 INFO:tasks.workunit.client.1.smithi115.stdout:6/16: sync 2024-04-16T14:35:31.726 INFO:tasks.workunit.client.1.smithi115.stdout:8/32: sync 2024-04-16T14:35:31.728 INFO:tasks.workunit.client.1.smithi115.stdout:4/25: creat d1/f6 x:0 0 0 2024-04-16T14:35:31.729 INFO:tasks.workunit.client.1.smithi115.stdout:5/14: symlink l3 0 2024-04-16T14:35:31.729 INFO:tasks.workunit.client.1.smithi115.stdout:7/83: dread d0/d2/f11 [0,4194304] 0 2024-04-16T14:35:31.731 INFO:tasks.workunit.client.1.smithi115.stdout:1/19: mknod c6 0 2024-04-16T14:35:31.732 INFO:tasks.workunit.client.1.smithi115.stdout:3/82: mknod dc/c1d 0 2024-04-16T14:35:31.732 INFO:tasks.workunit.client.1.smithi115.stdout:3/83: chown dc/f1a 115 1 2024-04-16T14:35:31.733 INFO:tasks.workunit.client.1.smithi115.stdout:9/132: symlink d1/d6/l24 0 2024-04-16T14:35:31.738 INFO:tasks.workunit.client.1.smithi115.stdout:3/84: dread f3 [0,4194304] 0 2024-04-16T14:35:31.738 INFO:tasks.workunit.client.1.smithi115.stdout:8/33: unlink d0/f8 0 2024-04-16T14:35:31.739 INFO:tasks.workunit.client.1.smithi115.stdout:6/17: rename f4 to f5 0 2024-04-16T14:35:31.739 INFO:tasks.workunit.client.1.smithi115.stdout:6/18: creat f6 x:0 0 0 2024-04-16T14:35:31.740 INFO:tasks.workunit.client.1.smithi115.stdout:4/26: link d1/f4 d1/d2/f7 0 2024-04-16T14:35:31.740 INFO:tasks.workunit.client.1.smithi115.stdout:4/27: stat d1/c5 0 2024-04-16T14:35:31.742 INFO:tasks.workunit.client.1.smithi115.stdout:9/133: symlink d1/d10/l25 0 2024-04-16T14:35:31.742 INFO:tasks.workunit.client.1.smithi115.stdout:2/18: write d0/d4/f7 [2853684,102369] 0 2024-04-16T14:35:31.742 INFO:tasks.workunit.client.1.smithi115.stdout:3/85: symlink dc/l1e 0 2024-04-16T14:35:31.743 INFO:tasks.workunit.client.1.smithi115.stdout:3/86: chown f6 200379743 1 2024-04-16T14:35:31.743 INFO:tasks.workunit.client.1.smithi115.stdout:5/15: write f0 [1108040,57659] 0 2024-04-16T14:35:31.743 INFO:tasks.workunit.client.1.smithi115.stdout:5/16: truncate f1 5370034 0 2024-04-16T14:35:31.745 INFO:tasks.workunit.client.1.smithi115.stdout:4/28: creat d1/d2/f8 x:0 0 0 2024-04-16T14:35:31.745 INFO:tasks.workunit.client.1.smithi115.stdout:4/29: write d1/d2/f8 [210400,85993] 0 2024-04-16T14:35:31.747 INFO:tasks.workunit.client.1.smithi115.stdout:2/19: symlink d0/l8 0 2024-04-16T14:35:31.747 INFO:tasks.workunit.client.1.smithi115.stdout:2/20: chown d0/l6 6020 1 2024-04-16T14:35:31.747 INFO:tasks.workunit.client.1.smithi115.stdout:2/21: dread - d0/f5 zero size 2024-04-16T14:35:31.748 INFO:tasks.workunit.client.1.smithi115.stdout:3/87: mknod dc/c1f 0 2024-04-16T14:35:31.750 INFO:tasks.workunit.client.1.smithi115.stdout:8/34: unlink d0/c5 0 2024-04-16T14:35:31.750 INFO:tasks.workunit.client.1.smithi115.stdout:8/35: fsync d0/f3 0 2024-04-16T14:35:31.750 INFO:tasks.workunit.client.1.smithi115.stdout:5/17: mknod c4 0 2024-04-16T14:35:31.751 INFO:tasks.workunit.client.1.smithi115.stdout:5/18: fdatasync f2 0 2024-04-16T14:35:31.752 INFO:tasks.workunit.client.1.smithi115.stdout:4/30: truncate d1/f4 922842 0 2024-04-16T14:35:31.752 INFO:tasks.workunit.client.1.smithi115.stdout:1/20: dread f3 [0,4194304] 0 2024-04-16T14:35:31.754 INFO:tasks.workunit.client.1.smithi115.stdout:6/19: read f0 [3029062,33190] 0 2024-04-16T14:35:31.754 INFO:tasks.workunit.client.1.smithi115.stdout:6/20: creat f7 x:0 0 0 2024-04-16T14:35:31.755 INFO:tasks.workunit.client.1.smithi115.stdout:2/22: unlink d0/f5 0 2024-04-16T14:35:31.756 INFO:tasks.workunit.client.1.smithi115.stdout:3/88: symlink dc/l20 0 2024-04-16T14:35:31.760 INFO:tasks.workunit.client.1.smithi115.stdout:1/21: mknod c7 0 2024-04-16T14:35:31.760 INFO:tasks.workunit.client.1.smithi115.stdout:2/23: mkdir d0/d4/d9 0 2024-04-16T14:35:31.762 INFO:tasks.workunit.client.1.smithi115.stdout:8/36: rename d0/l9 to d0/la 0 2024-04-16T14:35:31.763 INFO:tasks.workunit.client.1.smithi115.stdout:7/84: dwrite d0/fe [0,4194304] 0 2024-04-16T14:35:31.765 INFO:tasks.workunit.client.1.smithi115.stdout:1/22: write f3 [2079383,63507] 0 2024-04-16T14:35:31.766 INFO:tasks.workunit.client.1.smithi115.stdout:1/23: chown l2 235 1 2024-04-16T14:35:31.766 INFO:tasks.workunit.client.1.smithi115.stdout:1/24: write f5 [646720,53961] 0 2024-04-16T14:35:31.766 INFO:tasks.workunit.client.1.smithi115.stdout:1/25: read f3 [3818562,7985] 0 2024-04-16T14:35:31.767 INFO:tasks.workunit.client.1.smithi115.stdout:1/26: symlink l8 0 2024-04-16T14:35:31.770 INFO:tasks.workunit.client.0.smithi005.stdout:4/440: sync 2024-04-16T14:35:31.770 INFO:tasks.workunit.client.0.smithi005.stdout:6/432: sync 2024-04-16T14:35:31.771 INFO:tasks.workunit.client.0.smithi005.stdout:9/213: dwrite d3/d12/d16/f1a [4194304,4194304] 0 2024-04-16T14:35:31.771 INFO:tasks.workunit.client.0.smithi005.stdout:6/433: write f0 [5071645,111200] 0 2024-04-16T14:35:31.772 INFO:tasks.workunit.client.1.smithi115.stdout:9/134: dwrite d1/d6/dd/f1c [0,4194304] 0 2024-04-16T14:35:31.772 INFO:tasks.workunit.client.1.smithi115.stdout:4/31: fsync d1/f6 0 2024-04-16T14:35:31.773 INFO:tasks.workunit.client.0.smithi005.stdout:4/441: mkdir d0/d22/d85 0 2024-04-16T14:35:31.773 INFO:tasks.workunit.client.0.smithi005.stdout:4/442: write d0/d22/d29/f79 [805723,111062] 0 2024-04-16T14:35:31.773 INFO:tasks.workunit.client.0.smithi005.stdout:4/443: chown d0/d5a/c77 30623710 1 2024-04-16T14:35:31.773 INFO:tasks.workunit.client.0.smithi005.stdout:4/444: creat d0/d1b/d1d/d4f/f86 x:0 0 0 2024-04-16T14:35:31.773 INFO:tasks.workunit.client.0.smithi005.stdout:4/445: fsync d0/f7 0 2024-04-16T14:35:31.774 INFO:tasks.workunit.client.0.smithi005.stdout:9/214: truncate d3/d12/f26 699505 0 2024-04-16T14:35:31.774 INFO:tasks.workunit.client.0.smithi005.stdout:9/215: write d3/d12/d16/f1d [4992299,55989] 0 2024-04-16T14:35:31.775 INFO:tasks.workunit.client.0.smithi005.stdout:6/434: symlink d2/d20/d72/l93 0 2024-04-16T14:35:31.776 INFO:tasks.workunit.client.1.smithi115.stdout:6/21: dwrite f5 [0,4194304] 0 2024-04-16T14:35:31.776 INFO:tasks.workunit.client.1.smithi115.stdout:6/22: readlink l1 0 2024-04-16T14:35:31.777 INFO:tasks.workunit.client.1.smithi115.stdout:0/12: dwrite f3 [0,4194304] 0 2024-04-16T14:35:31.777 INFO:tasks.workunit.client.1.smithi115.stdout:7/85: dread d0/d2/ff [0,4194304] 0 2024-04-16T14:35:31.777 INFO:tasks.workunit.client.0.smithi005.stdout:4/446: mknod d0/d22/d61/c87 0 2024-04-16T14:35:31.779 INFO:tasks.workunit.client.1.smithi115.stdout:9/135: rename d1/d6/dd/fe to d1/d10/f26 0 2024-04-16T14:35:31.779 INFO:tasks.workunit.client.0.smithi005.stdout:4/447: symlink d0/d1b/d1d/d1f/d5d/l88 0 2024-04-16T14:35:31.779 INFO:tasks.workunit.client.0.smithi005.stdout:4/448: creat d0/f89 x:0 0 0 2024-04-16T14:35:31.782 INFO:tasks.workunit.client.1.smithi115.stdout:6/23: unlink f7 0 2024-04-16T14:35:31.782 INFO:tasks.workunit.client.1.smithi115.stdout:6/24: write f6 [396387,91381] 0 2024-04-16T14:35:31.782 INFO:tasks.workunit.client.1.smithi115.stdout:6/25: creat f8 x:0 0 0 2024-04-16T14:35:31.789 INFO:tasks.workunit.client.1.smithi115.stdout:3/89: dwrite dc/f1b [0,4194304] 0 2024-04-16T14:35:31.789 INFO:tasks.workunit.client.1.smithi115.stdout:8/37: dwrite d0/f3 [0,4194304] 0 2024-04-16T14:35:31.789 INFO:tasks.workunit.client.1.smithi115.stdout:8/38: stat d0/f4 0 2024-04-16T14:35:31.789 INFO:tasks.workunit.client.1.smithi115.stdout:3/90: fsync dc/f15 0 2024-04-16T14:35:31.789 INFO:tasks.workunit.client.1.smithi115.stdout:8/39: dread - d0/f4 zero size 2024-04-16T14:35:31.789 INFO:tasks.workunit.client.1.smithi115.stdout:8/40: fdatasync d0/f4 0 2024-04-16T14:35:31.792 INFO:tasks.workunit.client.0.smithi005.stdout:9/216: dread d3/d12/d2b/f2f [0,4194304] 0 2024-04-16T14:35:31.794 INFO:tasks.workunit.client.0.smithi005.stdout:9/217: creat d3/f3b x:0 0 0 2024-04-16T14:35:31.794 INFO:tasks.workunit.client.0.smithi005.stdout:9/218: write d3/d12/d16/f32 [922493,65851] 0 2024-04-16T14:35:31.796 INFO:tasks.workunit.client.0.smithi005.stdout:9/219: link d3/d12/d16/f1d d3/f3c 0 2024-04-16T14:35:31.796 INFO:tasks.workunit.client.0.smithi005.stdout:9/220: chown d3/l9 2636971 1 2024-04-16T14:35:31.800 INFO:tasks.workunit.client.1.smithi115.stdout:4/32: write d1/f4 [1498594,105902] 0 2024-04-16T14:35:31.800 INFO:tasks.workunit.client.1.smithi115.stdout:9/136: dread d1/d6/dd/f1c [0,4194304] 0 2024-04-16T14:35:31.804 INFO:tasks.workunit.client.1.smithi115.stdout:4/33: read d1/f3 [239598,112799] 0 2024-04-16T14:35:31.804 INFO:tasks.workunit.client.1.smithi115.stdout:4/34: fsync d1/f3 0 2024-04-16T14:35:31.804 INFO:tasks.workunit.client.1.smithi115.stdout:4/35: write d1/f6 [718720,117754] 0 2024-04-16T14:35:31.806 INFO:tasks.workunit.client.1.smithi115.stdout:9/137: unlink d1/d10/d20/f23 0 2024-04-16T14:35:31.810 INFO:tasks.workunit.client.1.smithi115.stdout:4/36: symlink d1/l9 0 2024-04-16T14:35:31.811 INFO:tasks.workunit.client.1.smithi115.stdout:2/24: getdents d0/d4 0 2024-04-16T14:35:31.811 INFO:tasks.workunit.client.1.smithi115.stdout:2/25: write d0/d4/f7 [611292,61257] 0 2024-04-16T14:35:31.817 INFO:tasks.workunit.client.1.smithi115.stdout:4/37: rmdir d1/d2 39 2024-04-16T14:35:31.819 INFO:tasks.workunit.client.1.smithi115.stdout:4/38: link d1/c5 d1/d2/ca 0 2024-04-16T14:35:31.840 INFO:tasks.workunit.client.1.smithi115.stdout:7/86: dwrite d0/fe [0,4194304] 0 2024-04-16T14:35:31.840 INFO:tasks.workunit.client.1.smithi115.stdout:7/87: stat d0/c1e 0 2024-04-16T14:35:31.840 INFO:tasks.workunit.client.1.smithi115.stdout:6/26: dwrite f0 [0,4194304] 0 2024-04-16T14:35:31.841 INFO:tasks.workunit.client.1.smithi115.stdout:6/27: fdatasync f0 0 2024-04-16T14:35:31.841 INFO:tasks.workunit.client.1.smithi115.stdout:6/28: truncate f8 256705 0 2024-04-16T14:35:31.841 INFO:tasks.workunit.client.1.smithi115.stdout:7/88: rename d0/d2/ff to d0/d1/f1f 0 2024-04-16T14:35:31.841 INFO:tasks.workunit.client.1.smithi115.stdout:7/89: write d0/d2/f17 [429674,123857] 0 2024-04-16T14:35:31.843 INFO:tasks.workunit.client.1.smithi115.stdout:7/90: rename d0/d2/f17 to d0/d1/f20 0 2024-04-16T14:35:31.846 INFO:tasks.workunit.client.0.smithi005.stdout:4/449: dwrite d0/f13 [0,4194304] 0 2024-04-16T14:35:31.846 INFO:tasks.workunit.client.0.smithi005.stdout:4/450: write d0/f89 [871167,124455] 0 2024-04-16T14:35:31.846 INFO:tasks.workunit.client.0.smithi005.stdout:4/451: write d0/d22/d29/f7f [4298640,44751] 0 2024-04-16T14:35:31.851 INFO:tasks.workunit.client.1.smithi115.stdout:0/13: dwrite f3 [0,4194304] 0 2024-04-16T14:35:31.851 INFO:tasks.workunit.client.1.smithi115.stdout:0/14: chown f0 308 1 2024-04-16T14:35:31.851 INFO:tasks.workunit.client.1.smithi115.stdout:0/15: chown f1 4094 1 2024-04-16T14:35:31.851 INFO:tasks.workunit.client.1.smithi115.stdout:1/27: dwrite f5 [0,4194304] 0 2024-04-16T14:35:31.851 INFO:tasks.workunit.client.1.smithi115.stdout:5/19: dwrite f0 [0,4194304] 0 2024-04-16T14:35:31.851 INFO:tasks.workunit.client.1.smithi115.stdout:5/20: readlink l3 0 2024-04-16T14:35:31.852 INFO:tasks.workunit.client.1.smithi115.stdout:1/28: readlink l2 0 2024-04-16T14:35:31.852 INFO:tasks.workunit.client.1.smithi115.stdout:1/29: write f3 [97187,57823] 0 2024-04-16T14:35:31.852 INFO:tasks.workunit.client.1.smithi115.stdout:1/30: write f3 [2184737,1185] 0 2024-04-16T14:35:31.852 INFO:tasks.workunit.client.1.smithi115.stdout:8/41: dwrite d0/f3 [4194304,4194304] 0 2024-04-16T14:35:31.852 INFO:tasks.workunit.client.1.smithi115.stdout:9/138: truncate d1/d6/dd/f1c 2812632 0 2024-04-16T14:35:31.853 INFO:tasks.workunit.client.0.smithi005.stdout:9/221: dwrite d3/d12/f30 [0,4194304] 0 2024-04-16T14:35:31.853 INFO:tasks.workunit.client.0.smithi005.stdout:9/222: write d3/d12/d16/f39 [650365,46806] 0 2024-04-16T14:35:31.853 INFO:tasks.workunit.client.0.smithi005.stdout:4/452: unlink d0/d1b/d1d/d1f/d5d/l88 0 2024-04-16T14:35:31.854 INFO:tasks.workunit.client.1.smithi115.stdout:6/29: dread f0 [0,4194304] 0 2024-04-16T14:35:31.854 INFO:tasks.workunit.client.1.smithi115.stdout:6/30: creat f9 x:0 0 0 2024-04-16T14:35:31.854 INFO:tasks.workunit.client.1.smithi115.stdout:6/31: stat f8 0 2024-04-16T14:35:31.854 INFO:tasks.workunit.client.1.smithi115.stdout:6/32: write f8 [417259,86530] 0 2024-04-16T14:35:31.855 INFO:tasks.workunit.client.1.smithi115.stdout:6/33: chown l1 745060 1 2024-04-16T14:35:31.855 INFO:tasks.workunit.client.1.smithi115.stdout:5/21: write f0 [88092,54733] 0 2024-04-16T14:35:31.856 INFO:tasks.workunit.client.0.smithi005.stdout:9/223: mknod d3/d12/d16/c3d 0 2024-04-16T14:35:31.857 INFO:tasks.workunit.client.0.smithi005.stdout:4/453: creat d0/d1b/d1d/d1f/d48/f8a x:0 0 0 2024-04-16T14:35:31.857 INFO:tasks.workunit.client.0.smithi005.stdout:4/454: dread - d0/d22/d29/f78 zero size 2024-04-16T14:35:31.858 INFO:tasks.workunit.client.0.smithi005.stdout:4/455: creat d0/d1b/d1d/d1f/d48/f8b x:0 0 0 2024-04-16T14:35:31.859 INFO:tasks.workunit.client.1.smithi115.stdout:6/34: dread f0 [0,4194304] 0 2024-04-16T14:35:31.859 INFO:tasks.workunit.client.1.smithi115.stdout:6/35: truncate f5 4537695 0 2024-04-16T14:35:31.860 INFO:tasks.workunit.client.0.smithi005.stdout:4/456: mknod d0/d1b/d1d/d4f/d75/c8c 0 2024-04-16T14:35:31.860 INFO:tasks.workunit.client.0.smithi005.stdout:4/457: mknod d0/c8d 0 2024-04-16T14:35:31.860 INFO:tasks.workunit.client.1.smithi115.stdout:3/91: truncate dc/f1b 2011228 0 2024-04-16T14:35:31.861 INFO:tasks.workunit.client.1.smithi115.stdout:8/42: write d0/f3 [8750064,101940] 0 2024-04-16T14:35:31.863 INFO:tasks.workunit.client.0.smithi005.stdout:9/224: write d3/d12/f2a [2285444,115079] 0 2024-04-16T14:35:31.863 INFO:tasks.workunit.client.0.smithi005.stdout:4/458: dread d0/f26 [0,4194304] 0 2024-04-16T14:35:31.863 INFO:tasks.workunit.client.1.smithi115.stdout:6/36: dread f6 [0,4194304] 0 2024-04-16T14:35:31.864 INFO:tasks.workunit.client.1.smithi115.stdout:9/139: link d1/d10/c14 d1/d10/c27 0 2024-04-16T14:35:31.866 INFO:tasks.workunit.client.1.smithi115.stdout:0/16: getdents . 0 2024-04-16T14:35:31.869 INFO:tasks.workunit.client.1.smithi115.stdout:6/37: dread f0 [0,4194304] 0 2024-04-16T14:35:31.870 INFO:tasks.workunit.client.1.smithi115.stdout:0/17: dread f1 [0,4194304] 0 2024-04-16T14:35:31.872 INFO:tasks.workunit.client.1.smithi115.stdout:4/39: dwrite d1/f4 [0,4194304] 0 2024-04-16T14:35:31.874 INFO:tasks.workunit.client.0.smithi005.stdout:5/270: sync 2024-04-16T14:35:31.875 INFO:tasks.workunit.client.0.smithi005.stdout:7/400: sync 2024-04-16T14:35:31.875 INFO:tasks.workunit.client.0.smithi005.stdout:2/156: sync 2024-04-16T14:35:31.875 INFO:tasks.workunit.client.0.smithi005.stdout:1/421: sync 2024-04-16T14:35:31.875 INFO:tasks.workunit.client.0.smithi005.stdout:3/302: sync 2024-04-16T14:35:31.875 INFO:tasks.workunit.client.0.smithi005.stdout:5/271: truncate d0/d6/f36 4902833 0 2024-04-16T14:35:31.875 INFO:tasks.workunit.client.0.smithi005.stdout:5/272: fdatasync d0/d6/d12/f14 0 2024-04-16T14:35:31.876 INFO:tasks.workunit.client.0.smithi005.stdout:1/422: fdatasync d2/d1c/d15/f63 0 2024-04-16T14:35:31.876 INFO:tasks.workunit.client.0.smithi005.stdout:3/303: stat d2/d17/d1e/d41/l63 0 2024-04-16T14:35:31.876 INFO:tasks.workunit.client.0.smithi005.stdout:1/423: fdatasync d2/d1c/f9d 0 2024-04-16T14:35:31.877 INFO:tasks.workunit.client.0.smithi005.stdout:8/347: sync 2024-04-16T14:35:31.877 INFO:tasks.workunit.client.0.smithi005.stdout:8/348: fsync d5/d55/f5e 0 2024-04-16T14:35:31.877 INFO:tasks.workunit.client.0.smithi005.stdout:5/273: write d0/d6/d12/d34/f49 [458275,54908] 0 2024-04-16T14:35:31.877 INFO:tasks.workunit.client.0.smithi005.stdout:5/274: chown d0/d6/d12/d34/f49 9874059 1 2024-04-16T14:35:31.877 INFO:tasks.workunit.client.0.smithi005.stdout:8/349: write d5/de/f73 [387822,129536] 0 2024-04-16T14:35:31.877 INFO:tasks.workunit.client.0.smithi005.stdout:5/275: chown d0/d6/d12/d1c/d1e/f2b 31947 1 2024-04-16T14:35:31.877 INFO:tasks.workunit.client.0.smithi005.stdout:5/276: readlink d0/d6/d12/l13 0 2024-04-16T14:35:31.878 INFO:tasks.workunit.client.1.smithi115.stdout:2/26: truncate d0/d4/f7 1303559 0 2024-04-16T14:35:31.878 INFO:tasks.workunit.client.0.smithi005.stdout:7/401: mknod d1/d49/d74/d77/d6c/c80 0 2024-04-16T14:35:31.878 INFO:tasks.workunit.client.0.smithi005.stdout:2/157: symlink d0/d1c/l2c 0 2024-04-16T14:35:31.879 INFO:tasks.workunit.client.0.smithi005.stdout:1/424: creat d2/d1c/d15/d2a/d19/d6e/d7b/f9f x:0 0 0 2024-04-16T14:35:31.881 INFO:tasks.workunit.client.0.smithi005.stdout:5/277: link d0/d6/d12/d1c/c40 d0/d6/d12/d34/c4e 0 2024-04-16T14:35:31.882 INFO:tasks.workunit.client.0.smithi005.stdout:7/402: creat d1/d49/d74/d77/d22/d27/d2e/f81 x:0 0 0 2024-04-16T14:35:31.883 INFO:tasks.workunit.client.0.smithi005.stdout:2/158: mknod d0/d4/d2b/c2d 0 2024-04-16T14:35:31.884 INFO:tasks.workunit.client.0.smithi005.stdout:8/350: read d5/de/f36 [2323502,91408] 0 2024-04-16T14:35:31.884 INFO:tasks.workunit.client.0.smithi005.stdout:8/351: write d5/f3a [828337,129523] 0 2024-04-16T14:35:31.884 INFO:tasks.workunit.client.0.smithi005.stdout:1/425: mkdir d2/d1c/d15/da0 0 2024-04-16T14:35:31.886 INFO:tasks.workunit.client.0.smithi005.stdout:5/278: creat d0/d6/f4f x:0 0 0 2024-04-16T14:35:31.887 INFO:tasks.workunit.client.1.smithi115.stdout:9/140: mknod d1/d10/d20/c28 0 2024-04-16T14:35:31.887 INFO:tasks.workunit.client.1.smithi115.stdout:9/141: write d1/d10/d20/f22 [505991,12661] 0 2024-04-16T14:35:31.887 INFO:tasks.workunit.client.1.smithi115.stdout:9/142: truncate d1/f19 5236945 0 2024-04-16T14:35:31.888 INFO:tasks.workunit.client.1.smithi115.stdout:6/38: mknod ca 0 2024-04-16T14:35:31.889 INFO:tasks.workunit.client.0.smithi005.stdout:2/159: mknod d0/d1c/c2e 0 2024-04-16T14:35:31.889 INFO:tasks.workunit.client.0.smithi005.stdout:2/160: fdatasync d0/d4/f6 0 2024-04-16T14:35:31.889 INFO:tasks.workunit.client.0.smithi005.stdout:8/352: stat d5/de/f15 0 2024-04-16T14:35:31.889 INFO:tasks.workunit.client.0.smithi005.stdout:8/353: fdatasync d5/d7b/d2f/f31 0 2024-04-16T14:35:31.889 INFO:tasks.workunit.client.0.smithi005.stdout:8/354: fdatasync d5/d7b/d2f/f4c 0 2024-04-16T14:35:31.890 INFO:tasks.workunit.client.1.smithi115.stdout:0/18: rename l2 to l5 0 2024-04-16T14:35:31.890 INFO:tasks.workunit.client.0.smithi005.stdout:1/426: rmdir d2/d1c/d15/d2a/d19/d20 39 2024-04-16T14:35:31.892 INFO:tasks.workunit.client.1.smithi115.stdout:3/92: dwrite f3 [0,4194304] 0 2024-04-16T14:35:31.892 INFO:tasks.workunit.client.1.smithi115.stdout:6/39: dread f0 [0,4194304] 0 2024-04-16T14:35:31.893 INFO:tasks.workunit.client.1.smithi115.stdout:2/27: mkdir d0/da 0 2024-04-16T14:35:31.894 INFO:tasks.workunit.client.0.smithi005.stdout:8/355: rename d5/de/l42 to d5/d11/l7d 0 2024-04-16T14:35:31.895 INFO:tasks.workunit.client.0.smithi005.stdout:1/427: truncate d2/d1c/d15/d2a/d19/d20/d27/f4c 3360353 0 2024-04-16T14:35:31.895 INFO:tasks.workunit.client.0.smithi005.stdout:1/428: creat d2/d1c/d15/d2a/d19/d6e/d7b/fa1 x:0 0 0 2024-04-16T14:35:31.895 INFO:tasks.workunit.client.1.smithi115.stdout:8/43: mkdir d0/db 0 2024-04-16T14:35:31.896 INFO:tasks.workunit.client.0.smithi005.stdout:8/356: creat d5/d11/d6c/f7e x:0 0 0 2024-04-16T14:35:31.896 INFO:tasks.workunit.client.0.smithi005.stdout:8/357: dread - d5/d11/f45 zero size 2024-04-16T14:35:31.897 INFO:tasks.workunit.client.1.smithi115.stdout:0/19: mkdir d6 0 2024-04-16T14:35:31.898 INFO:tasks.workunit.client.0.smithi005.stdout:4/459: dwrite d0/d1b/f62 [0,4194304] 0 2024-04-16T14:35:31.898 INFO:tasks.workunit.client.0.smithi005.stdout:4/460: write d0/f7 [3067413,33416] 0 2024-04-16T14:35:31.898 INFO:tasks.workunit.client.0.smithi005.stdout:4/461: write d0/d22/d29/f2d [439316,35566] 0 2024-04-16T14:35:31.898 INFO:tasks.workunit.client.0.smithi005.stdout:4/462: chown d0/f9 60721698 1 2024-04-16T14:35:31.899 INFO:tasks.workunit.client.0.smithi005.stdout:1/429: symlink d2/d1c/d15/d2a/d19/d20/la2 0 2024-04-16T14:35:31.899 INFO:tasks.workunit.client.0.smithi005.stdout:1/430: dread - d2/d1c/d15/d2a/d19/d42/d71/f75 zero size 2024-04-16T14:35:31.900 INFO:tasks.workunit.client.1.smithi115.stdout:6/40: unlink f5 0 2024-04-16T14:35:31.901 INFO:tasks.workunit.client.1.smithi115.stdout:0/20: symlink d6/l7 0 2024-04-16T14:35:31.901 INFO:tasks.workunit.client.1.smithi115.stdout:0/21: readlink l5 0 2024-04-16T14:35:31.901 INFO:tasks.workunit.client.1.smithi115.stdout:0/22: chown f0 1 1 2024-04-16T14:35:31.901 INFO:tasks.workunit.client.0.smithi005.stdout:8/358: mkdir d5/d7b/d2f/d3d/d7f 0 2024-04-16T14:35:31.902 INFO:tasks.workunit.client.0.smithi005.stdout:9/225: dwrite d3/d12/f26 [0,4194304] 0 2024-04-16T14:35:31.902 INFO:tasks.workunit.client.0.smithi005.stdout:9/226: readlink d3/d12/l13 0 2024-04-16T14:35:31.902 INFO:tasks.workunit.client.0.smithi005.stdout:8/359: write d5/d11/d6c/f7e [600573,83498] 0 2024-04-16T14:35:31.902 INFO:tasks.workunit.client.0.smithi005.stdout:3/304: dwrite d2/d17/d46/d47/f67 [0,4194304] 0 2024-04-16T14:35:31.902 INFO:tasks.workunit.client.0.smithi005.stdout:8/360: dread - d5/d11/f5f zero size 2024-04-16T14:35:31.903 INFO:tasks.workunit.client.1.smithi115.stdout:4/40: dwrite d1/f6 [0,4194304] 0 2024-04-16T14:35:31.903 INFO:tasks.workunit.client.1.smithi115.stdout:4/41: chown d1/d2 89125 1 2024-04-16T14:35:31.903 INFO:tasks.workunit.client.1.smithi115.stdout:4/42: rename d1 to d1/db 22 2024-04-16T14:35:31.903 INFO:tasks.workunit.client.1.smithi115.stdout:4/43: stat d1/f4 0 2024-04-16T14:35:31.903 INFO:tasks.workunit.client.1.smithi115.stdout:4/44: write d1/d2/f8 [389142,28476] 0 2024-04-16T14:35:31.904 INFO:tasks.workunit.client.1.smithi115.stdout:6/41: dread f8 [0,4194304] 0 2024-04-16T14:35:31.904 INFO:tasks.workunit.client.1.smithi115.stdout:6/42: readlink l1 0 2024-04-16T14:35:31.904 INFO:tasks.workunit.client.1.smithi115.stdout:6/43: creat fb x:0 0 0 2024-04-16T14:35:31.904 INFO:tasks.workunit.client.1.smithi115.stdout:6/44: chown l1 39 1 2024-04-16T14:35:31.904 INFO:tasks.workunit.client.1.smithi115.stdout:0/23: rename d6/l7 to d6/l8 0 2024-04-16T14:35:31.905 INFO:tasks.workunit.client.0.smithi005.stdout:4/463: symlink d0/d22/l8e 0 2024-04-16T14:35:31.905 INFO:tasks.workunit.client.0.smithi005.stdout:4/464: chown d0/c1e 157 1 2024-04-16T14:35:31.905 INFO:tasks.workunit.client.0.smithi005.stdout:1/431: chown d2/d1c/d15/d2a/d19/d42/d64/d76/d5a 29 1 2024-04-16T14:35:31.905 INFO:tasks.workunit.client.0.smithi005.stdout:1/432: readlink d2/d74/d7a/l7f 0 2024-04-16T14:35:31.911 INFO:tasks.workunit.client.0.smithi005.stdout:9/227: truncate d3/f7 1872479 0 2024-04-16T14:35:31.914 INFO:tasks.workunit.client.0.smithi005.stdout:3/305: creat d2/d9/d25/d39/f6a x:0 0 0 2024-04-16T14:35:31.915 INFO:tasks.workunit.client.0.smithi005.stdout:4/465: symlink d0/d1b/d1d/d1f/d3e/l8f 0 2024-04-16T14:35:31.915 INFO:tasks.workunit.client.0.smithi005.stdout:4/466: truncate d0/f12 4368748 0 2024-04-16T14:35:31.916 INFO:tasks.workunit.client.0.smithi005.stdout:1/433: write d2/d1c/d15/d2a/d1a/f3b [3026520,38181] 0 2024-04-16T14:35:31.916 INFO:tasks.workunit.client.0.smithi005.stdout:1/434: chown d2/d1c/f17 20617 1 2024-04-16T14:35:31.916 INFO:tasks.workunit.client.0.smithi005.stdout:1/435: write d2/f62 [730833,15930] 0 2024-04-16T14:35:31.917 INFO:tasks.workunit.client.0.smithi005.stdout:3/306: mkdir d2/d6b 0 2024-04-16T14:35:31.918 INFO:tasks.workunit.client.0.smithi005.stdout:4/467: mkdir d0/d22/d85/d90 0 2024-04-16T14:35:31.919 INFO:tasks.workunit.client.1.smithi115.stdout:0/24: dread f3 [0,4194304] 0 2024-04-16T14:35:31.919 INFO:tasks.workunit.client.1.smithi115.stdout:0/25: chown d6 49 1 2024-04-16T14:35:31.919 INFO:tasks.workunit.client.1.smithi115.stdout:0/26: fsync f3 0 2024-04-16T14:35:31.919 INFO:tasks.workunit.client.1.smithi115.stdout:4/45: write d1/d2/f7 [1654103,124231] 0 2024-04-16T14:35:31.919 INFO:tasks.workunit.client.1.smithi115.stdout:4/46: write d1/f4 [3633204,8385] 0 2024-04-16T14:35:31.919 INFO:tasks.workunit.client.0.smithi005.stdout:9/228: getdents d3/d12/d2b 0 2024-04-16T14:35:31.920 INFO:tasks.workunit.client.0.smithi005.stdout:9/229: readlink d3/l29 0 2024-04-16T14:35:31.920 INFO:tasks.workunit.client.1.smithi115.stdout:0/27: write f1 [882966,104630] 0 2024-04-16T14:35:31.920 INFO:tasks.workunit.client.1.smithi115.stdout:0/28: symlink d6/l9 0 2024-04-16T14:35:31.923 INFO:tasks.workunit.client.0.smithi005.stdout:3/307: mknod d2/d17/d1e/d41/c6c 0 2024-04-16T14:35:31.924 INFO:tasks.workunit.client.0.smithi005.stdout:3/308: mkdir d2/d17/d1e/d6d 0 2024-04-16T14:35:31.927 INFO:tasks.workunit.client.0.smithi005.stdout:3/309: rename d2/d9/d25/d39/l4f to d2/d9/l6e 0 2024-04-16T14:35:31.927 INFO:tasks.workunit.client.0.smithi005.stdout:3/310: dread - d2/d17/f54 zero size 2024-04-16T14:35:31.927 INFO:tasks.workunit.client.1.smithi115.stdout:1/31: truncate f5 2717747 0 2024-04-16T14:35:31.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:31 smithi115 ceph-mon[37295]: pgmap v20: 65 pgs: 65 active+clean; 487 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 32 MiB/s rd, 37 MiB/s wr, 84 op/s 2024-04-16T14:35:31.939 INFO:tasks.workunit.client.0.smithi005.stdout:9/230: dread d3/d12/f28 [0,4194304] 0 2024-04-16T14:35:31.939 INFO:tasks.workunit.client.0.smithi005.stdout:9/231: readlink d3/d12/d16/l27 0 2024-04-16T14:35:31.943 INFO:tasks.workunit.client.1.smithi115.stdout:3/93: dwrite dc/f1c [0,4194304] 0 2024-04-16T14:35:31.943 INFO:tasks.workunit.client.1.smithi115.stdout:3/94: fdatasync dc/f15 0 2024-04-16T14:35:31.943 INFO:tasks.workunit.client.1.smithi115.stdout:3/95: creat dc/f21 x:0 0 0 2024-04-16T14:35:31.943 INFO:tasks.workunit.client.1.smithi115.stdout:3/96: stat dc/f1b 0 2024-04-16T14:35:31.945 INFO:tasks.workunit.client.0.smithi005.stdout:9/232: dread d3/d12/d16/f1d [0,4194304] 0 2024-04-16T14:35:31.945 INFO:tasks.workunit.client.0.smithi005.stdout:5/279: dwrite d0/d6/d12/f3a [0,4194304] 0 2024-04-16T14:35:31.945 INFO:tasks.workunit.client.0.smithi005.stdout:9/233: creat d3/d12/f3e x:0 0 0 2024-04-16T14:35:31.946 INFO:tasks.workunit.client.0.smithi005.stdout:8/361: dwrite d5/d7b/d2f/d3d/f52 [0,4194304] 0 2024-04-16T14:35:31.946 INFO:tasks.workunit.client.0.smithi005.stdout:8/362: write d5/d11/d6c/f7e [1155856,106017] 0 2024-04-16T14:35:31.946 INFO:tasks.workunit.client.0.smithi005.stdout:2/161: dwrite d0/d4/fc [0,4194304] 0 2024-04-16T14:35:31.947 INFO:tasks.workunit.client.0.smithi005.stdout:4/468: dwrite d0/d1b/d1d/d4f/f86 [0,4194304] 0 2024-04-16T14:35:31.947 INFO:tasks.workunit.client.0.smithi005.stdout:5/280: mknod d0/d6/c50 0 2024-04-16T14:35:31.947 INFO:tasks.workunit.client.1.smithi115.stdout:8/44: dwrite d0/f3 [8388608,4194304] 0 2024-04-16T14:35:31.948 INFO:tasks.workunit.client.1.smithi115.stdout:3/97: link dc/f21 dc/f22 0 2024-04-16T14:35:31.948 INFO:tasks.workunit.client.0.smithi005.stdout:9/234: creat d3/d12/d2b/f3f x:0 0 0 2024-04-16T14:35:31.948 INFO:tasks.workunit.client.1.smithi115.stdout:4/47: dread d1/d2/f8 [0,4194304] 0 2024-04-16T14:35:31.949 INFO:tasks.workunit.client.1.smithi115.stdout:0/29: dread f1 [0,4194304] 0 2024-04-16T14:35:31.951 INFO:tasks.workunit.client.0.smithi005.stdout:8/363: write d5/d7b/d2f/f34 [3608778,73493] 0 2024-04-16T14:35:31.952 INFO:tasks.workunit.client.1.smithi115.stdout:2/28: getdents d0 0 2024-04-16T14:35:31.959 INFO:tasks.workunit.client.1.smithi115.stdout:6/45: getdents . 0 2024-04-16T14:35:31.961 INFO:tasks.workunit.client.1.smithi115.stdout:6/46: creat fc x:0 0 0 2024-04-16T14:35:31.962 INFO:tasks.workunit.client.0.smithi005.stdout:2/162: dread d0/d4/f6 [0,4194304] 0 2024-04-16T14:35:31.964 INFO:tasks.workunit.client.1.smithi115.stdout:6/47: mknod cd 0 2024-04-16T14:35:31.966 INFO:tasks.workunit.client.1.smithi115.stdout:1/32: rename f5 to f9 0 2024-04-16T14:35:31.967 INFO:tasks.workunit.client.0.smithi005.stdout:7/403: rmdir d1/d49/d74/d77/d22/d27/d2e 39 2024-04-16T14:35:31.967 INFO:tasks.workunit.client.1.smithi115.stdout:1/33: creat fa x:0 0 0 2024-04-16T14:35:31.967 INFO:tasks.workunit.client.1.smithi115.stdout:1/34: rmdir - no directory 2024-04-16T14:35:31.967 INFO:tasks.workunit.client.1.smithi115.stdout:1/35: chown f3 636193 1 2024-04-16T14:35:31.967 INFO:tasks.workunit.client.1.smithi115.stdout:4/48: dread d1/f4 [0,4194304] 0 2024-04-16T14:35:31.967 INFO:tasks.workunit.client.1.smithi115.stdout:4/49: fsync d1/f6 0 2024-04-16T14:35:31.967 INFO:tasks.workunit.client.1.smithi115.stdout:4/50: chown d1/d2/f7 1153 1 2024-04-16T14:35:31.968 INFO:tasks.workunit.client.1.smithi115.stdout:4/51: chown d1/f6 33 1 2024-04-16T14:35:31.969 INFO:tasks.workunit.client.1.smithi115.stdout:0/30: write f3 [2118420,65675] 0 2024-04-16T14:35:31.970 INFO:tasks.workunit.client.0.smithi005.stdout:4/469: unlink d0/d1b/d1d/d1f/d3e/c3f 0 2024-04-16T14:35:31.970 INFO:tasks.workunit.client.0.smithi005.stdout:4/470: readlink d0/d1b/d1d/d1f/d3e/d6d/l73 0 2024-04-16T14:35:31.970 INFO:tasks.workunit.client.1.smithi115.stdout:4/52: mknod d1/d2/cc 0 2024-04-16T14:35:31.971 INFO:tasks.workunit.client.1.smithi115.stdout:8/45: dwrite d0/f3 [0,4194304] 0 2024-04-16T14:35:31.971 INFO:tasks.workunit.client.1.smithi115.stdout:3/98: rmdir dc 39 2024-04-16T14:35:31.972 INFO:tasks.workunit.client.0.smithi005.stdout:5/281: link d0/d6/d12/d1c/c3c d0/d6/d12/c51 0 2024-04-16T14:35:31.973 INFO:tasks.workunit.client.1.smithi115.stdout:0/31: mknod d6/ca 0 2024-04-16T14:35:31.973 INFO:tasks.workunit.client.1.smithi115.stdout:0/32: write f1 [800301,102865] 0 2024-04-16T14:35:31.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:31 smithi005 ceph-mon[28964]: pgmap v20: 65 pgs: 65 active+clean; 487 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 32 MiB/s rd, 37 MiB/s wr, 84 op/s 2024-04-16T14:35:31.974 INFO:tasks.workunit.client.1.smithi115.stdout:8/46: creat d0/fc x:0 0 0 2024-04-16T14:35:31.976 INFO:tasks.workunit.client.1.smithi115.stdout:6/48: rename fb to fe 0 2024-04-16T14:35:31.976 INFO:tasks.workunit.client.0.smithi005.stdout:7/404: rename d1/d49/d74/d77/d6c to d1/d82 0 2024-04-16T14:35:31.978 INFO:tasks.workunit.client.0.smithi005.stdout:7/405: read d1/dc/d2f/f60 [554577,61757] 0 2024-04-16T14:35:31.979 INFO:tasks.workunit.client.1.smithi115.stdout:0/33: rename f3 to d6/fb 0 2024-04-16T14:35:31.979 INFO:tasks.workunit.client.1.smithi115.stdout:0/34: write f1 [572013,116718] 0 2024-04-16T14:35:31.979 INFO:tasks.workunit.client.0.smithi005.stdout:7/406: fsync d1/d49/d74/d77/d22/d27/d2e/f81 0 2024-04-16T14:35:31.980 INFO:tasks.workunit.client.0.smithi005.stdout:4/471: rename d0/d1b/c1c to d0/d22/d85/c91 0 2024-04-16T14:35:31.981 INFO:tasks.workunit.client.1.smithi115.stdout:8/47: creat d0/db/fd x:0 0 0 2024-04-16T14:35:31.981 INFO:tasks.workunit.client.1.smithi115.stdout:6/49: write f9 [279262,52337] 0 2024-04-16T14:35:31.982 INFO:tasks.workunit.client.0.smithi005.stdout:4/472: fdatasync d0/d22/d29/f7f 0 2024-04-16T14:35:31.983 INFO:tasks.workunit.client.1.smithi115.stdout:6/50: rename cd to cf 0 2024-04-16T14:35:31.985 INFO:tasks.workunit.client.0.smithi005.stdout:5/282: rename d0/fe to d0/f52 0 2024-04-16T14:35:31.985 INFO:tasks.workunit.client.1.smithi115.stdout:3/99: write f3 [2599792,121593] 0 2024-04-16T14:35:31.986 INFO:tasks.workunit.client.0.smithi005.stdout:4/473: mkdir d0/d1b/d1d/d1f/d3e/d6d/d92 0 2024-04-16T14:35:31.988 INFO:tasks.workunit.client.0.smithi005.stdout:8/364: dwrite d5/f3a [0,4194304] 0 2024-04-16T14:35:31.989 INFO:tasks.workunit.client.0.smithi005.stdout:4/474: creat d0/d1b/d1d/d1f/d5d/f93 x:0 0 0 2024-04-16T14:35:31.989 INFO:tasks.workunit.client.0.smithi005.stdout:4/475: creat d0/f94 x:0 0 0 2024-04-16T14:35:31.992 INFO:tasks.workunit.client.1.smithi115.stdout:6/51: write f0 [3861290,50156] 0 2024-04-16T14:35:31.993 INFO:tasks.workunit.client.1.smithi115.stdout:4/53: write d1/f6 [3817337,63451] 0 2024-04-16T14:35:31.993 INFO:tasks.workunit.client.1.smithi115.stdout:4/54: write d1/d2/f8 [1408945,84114] 0 2024-04-16T14:35:31.993 INFO:tasks.workunit.client.1.smithi115.stdout:1/36: dread f4 [0,4194304] 0 2024-04-16T14:35:31.993 INFO:tasks.workunit.client.1.smithi115.stdout:1/37: creat fb x:0 0 0 2024-04-16T14:35:31.994 INFO:tasks.workunit.client.0.smithi005.stdout:8/365: rmdir d5/d40/d4b 39 2024-04-16T14:35:31.994 INFO:tasks.workunit.client.0.smithi005.stdout:8/366: write d5/d40/f70 [862673,93943] 0 2024-04-16T14:35:31.996 INFO:tasks.workunit.client.0.smithi005.stdout:4/476: symlink d0/d1b/d1d/d1f/d48/l95 0 2024-04-16T14:35:31.998 INFO:tasks.workunit.client.0.smithi005.stdout:1/436: write d2/d1c/d15/d2a/d19/d42/d64/d76/f72 [1992700,66480] 0 2024-04-16T14:35:31.998 INFO:tasks.workunit.client.0.smithi005.stdout:1/437: readlink d2/d1c/l5e 0 2024-04-16T14:35:31.999 INFO:tasks.workunit.client.1.smithi115.stdout:4/55: creat d1/d2/fd x:0 0 0 2024-04-16T14:35:31.999 INFO:tasks.workunit.client.1.smithi115.stdout:4/56: write d1/f6 [2512248,89612] 0 2024-04-16T14:35:31.999 INFO:tasks.workunit.client.1.smithi115.stdout:4/57: truncate d1/d2/f8 2306529 0 2024-04-16T14:35:31.999 INFO:tasks.workunit.client.1.smithi115.stdout:4/58: fdatasync d1/d2/fd 0 2024-04-16T14:35:31.999 INFO:tasks.workunit.client.1.smithi115.stdout:4/59: chown d1/f3 34 1 2024-04-16T14:35:32.000 INFO:tasks.workunit.client.1.smithi115.stdout:0/35: write f0 [1717621,30868] 0 2024-04-16T14:35:32.000 INFO:tasks.workunit.client.1.smithi115.stdout:2/29: dwrite d0/d4/f7 [0,4194304] 0 2024-04-16T14:35:32.002 INFO:tasks.workunit.client.1.smithi115.stdout:1/38: symlink lc 0 2024-04-16T14:35:32.002 INFO:tasks.workunit.client.1.smithi115.stdout:1/39: chown f3 4 1 2024-04-16T14:35:32.003 INFO:tasks.workunit.client.1.smithi115.stdout:6/52: symlink l10 0 2024-04-16T14:35:32.004 INFO:tasks.workunit.client.1.smithi115.stdout:6/53: truncate fe 219441 0 2024-04-16T14:35:32.005 INFO:tasks.workunit.client.0.smithi005.stdout:3/311: rmdir d2/d9/d25 39 2024-04-16T14:35:32.005 INFO:tasks.workunit.client.0.smithi005.stdout:3/312: creat d2/d17/f6f x:0 0 0 2024-04-16T14:35:32.006 INFO:tasks.workunit.client.0.smithi005.stdout:3/313: truncate d2/d17/f54 666064 0 2024-04-16T14:35:32.006 INFO:tasks.workunit.client.1.smithi115.stdout:2/30: creat d0/fb x:0 0 0 2024-04-16T14:35:32.006 INFO:tasks.workunit.client.1.smithi115.stdout:2/31: rename d0 to d0/d4/d9/dc 22 2024-04-16T14:35:32.006 INFO:tasks.workunit.client.1.smithi115.stdout:6/54: creat f11 x:0 0 0 2024-04-16T14:35:32.006 INFO:tasks.workunit.client.1.smithi115.stdout:6/55: fdatasync fc 0 2024-04-16T14:35:32.009 INFO:tasks.workunit.client.1.smithi115.stdout:2/32: unlink d0/l8 0 2024-04-16T14:35:32.010 INFO:tasks.workunit.client.0.smithi005.stdout:1/438: write d2/d1c/d15/d2a/d19/d20/d27/f34 [906949,75522] 0 2024-04-16T14:35:32.012 INFO:tasks.workunit.client.1.smithi115.stdout:2/33: rename d0/f2 to d0/fd 0 2024-04-16T14:35:32.012 INFO:tasks.workunit.client.1.smithi115.stdout:2/34: chown d0/fb 356318610 1 2024-04-16T14:35:32.013 INFO:tasks.workunit.client.1.smithi115.stdout:1/40: write f4 [735505,129181] 0 2024-04-16T14:35:32.014 INFO:tasks.workunit.client.1.smithi115.stdout:2/35: mkdir d0/d4/de 0 2024-04-16T14:35:32.022 INFO:tasks.workunit.client.0.smithi005.stdout:4/477: dread d0/d1b/d1d/d4f/f86 [0,4194304] 0 2024-04-16T14:35:32.023 INFO:tasks.workunit.client.0.smithi005.stdout:4/478: symlink d0/d4d/l96 0 2024-04-16T14:35:32.023 INFO:tasks.workunit.client.1.smithi115.stdout:2/36: read d0/d4/f7 [1643000,129563] 0 2024-04-16T14:35:32.024 INFO:tasks.workunit.client.1.smithi115.stdout:2/37: truncate d0/fd 4111965 0 2024-04-16T14:35:32.024 INFO:tasks.workunit.client.1.smithi115.stdout:2/38: readlink d0/l6 0 2024-04-16T14:35:32.026 INFO:tasks.workunit.client.1.smithi115.stdout:2/39: link d0/fb d0/d4/ff 0 2024-04-16T14:35:32.026 INFO:tasks.workunit.client.1.smithi115.stdout:2/40: chown d0/l1 0 1 2024-04-16T14:35:32.031 INFO:tasks.workunit.client.0.smithi005.stdout:0/333: sync 2024-04-16T14:35:32.037 INFO:tasks.workunit.client.0.smithi005.stdout:0/334: write f1 [387548,46713] 0 2024-04-16T14:35:32.038 INFO:tasks.workunit.client.0.smithi005.stdout:2/163: dwrite d0/d1c/f20 [0,4194304] 0 2024-04-16T14:35:32.038 INFO:tasks.workunit.client.1.smithi115.stdout:8/48: dwrite d0/db/fd [0,4194304] 0 2024-04-16T14:35:32.039 INFO:tasks.workunit.client.1.smithi115.stdout:3/100: dwrite dc/f16 [0,4194304] 0 2024-04-16T14:35:32.039 INFO:tasks.workunit.client.0.smithi005.stdout:8/367: dwrite d5/fb [4194304,4194304] 0 2024-04-16T14:35:32.039 INFO:tasks.workunit.client.0.smithi005.stdout:8/368: fsync d5/f66 0 2024-04-16T14:35:32.040 INFO:tasks.workunit.client.0.smithi005.stdout:0/335: mknod da/df/d26/d39/c6b 0 2024-04-16T14:35:32.040 INFO:tasks.workunit.client.0.smithi005.stdout:3/314: dwrite d2/d17/f6f [0,4194304] 0 2024-04-16T14:35:32.041 INFO:tasks.workunit.client.1.smithi115.stdout:8/49: mknod d0/db/ce 0 2024-04-16T14:35:32.041 INFO:tasks.workunit.client.1.smithi115.stdout:8/50: chown d0/db/fd 1869604439 1 2024-04-16T14:35:32.042 INFO:tasks.workunit.client.0.smithi005.stdout:7/407: dwrite d1/d49/f5b [0,4194304] 0 2024-04-16T14:35:32.042 INFO:tasks.workunit.client.0.smithi005.stdout:5/283: dwrite d0/d6/f4f [0,4194304] 0 2024-04-16T14:35:32.042 INFO:tasks.workunit.client.0.smithi005.stdout:5/284: write d0/f52 [5037229,67283] 0 2024-04-16T14:35:32.047 INFO:tasks.workunit.client.1.smithi115.stdout:1/41: getdents . 0 2024-04-16T14:35:32.048 INFO:tasks.workunit.client.0.smithi005.stdout:8/369: rename d5/d7b/c5c to d5/d11/c80 0 2024-04-16T14:35:32.048 INFO:tasks.workunit.client.0.smithi005.stdout:8/370: fdatasync d5/d11/f5f 0 2024-04-16T14:35:32.048 INFO:tasks.workunit.client.0.smithi005.stdout:6/435: sync 2024-04-16T14:35:32.049 INFO:tasks.workunit.client.1.smithi115.stdout:1/42: symlink ld 0 2024-04-16T14:35:32.050 INFO:tasks.workunit.client.1.smithi115.stdout:1/43: write fa [455290,36510] 0 2024-04-16T14:35:32.051 INFO:tasks.workunit.client.0.smithi005.stdout:0/336: mknod da/df/d1b/d3a/d53/d5a/d67/c6c 0 2024-04-16T14:35:32.053 INFO:tasks.workunit.client.0.smithi005.stdout:0/337: creat da/df/d50/f6d x:0 0 0 2024-04-16T14:35:32.054 INFO:tasks.workunit.client.0.smithi005.stdout:2/164: dread d0/d4/f9 [0,4194304] 0 2024-04-16T14:35:32.054 INFO:tasks.workunit.client.0.smithi005.stdout:2/165: fdatasync d0/f2 0 2024-04-16T14:35:32.054 INFO:tasks.workunit.client.0.smithi005.stdout:2/166: fdatasync d0/d4/d2b/f1a 0 2024-04-16T14:35:32.056 INFO:tasks.workunit.client.0.smithi005.stdout:7/408: write d1/d49/f5b [3761787,9433] 0 2024-04-16T14:35:32.057 INFO:tasks.workunit.client.1.smithi115.stdout:8/51: truncate d0/f3 192193 0 2024-04-16T14:35:32.059 INFO:tasks.workunit.client.1.smithi115.stdout:3/101: dread fb [0,4194304] 0 2024-04-16T14:35:32.059 INFO:tasks.workunit.client.1.smithi115.stdout:3/102: chown dc/c13 419 1 2024-04-16T14:35:32.060 INFO:tasks.workunit.client.1.smithi115.stdout:6/56: dread f9 [0,4194304] 0 2024-04-16T14:35:32.060 INFO:tasks.workunit.client.0.smithi005.stdout:3/315: stat d2/d9/d51/c5b 0 2024-04-16T14:35:32.060 INFO:tasks.workunit.client.1.smithi115.stdout:3/103: rmdir dc 39 2024-04-16T14:35:32.062 INFO:tasks.workunit.client.1.smithi115.stdout:1/44: dread fa [0,4194304] 0 2024-04-16T14:35:32.063 INFO:tasks.workunit.client.0.smithi005.stdout:0/338: read da/df/d26/f4c [131361,55095] 0 2024-04-16T14:35:32.063 INFO:tasks.workunit.client.0.smithi005.stdout:0/339: fsync da/df/d1b/f22 0 2024-04-16T14:35:32.064 INFO:tasks.workunit.client.1.smithi115.stdout:0/36: dwrite f0 [0,4194304] 0 2024-04-16T14:35:32.064 INFO:tasks.workunit.client.1.smithi115.stdout:3/104: link dc/ff dc/f23 0 2024-04-16T14:35:32.064 INFO:tasks.workunit.client.1.smithi115.stdout:3/105: dread - dc/f17 zero size 2024-04-16T14:35:32.064 INFO:tasks.workunit.client.1.smithi115.stdout:3/106: dread - dc/f22 zero size 2024-04-16T14:35:32.067 INFO:tasks.workunit.client.1.smithi115.stdout:2/41: dread d0/fd [0,4194304] 0 2024-04-16T14:35:32.070 INFO:tasks.workunit.client.0.smithi005.stdout:5/285: truncate d0/d6/d12/d1c/f22 684584 0 2024-04-16T14:35:32.070 INFO:tasks.workunit.client.1.smithi115.stdout:0/37: link d6/fb d6/fc 0 2024-04-16T14:35:32.071 INFO:tasks.workunit.client.1.smithi115.stdout:3/107: mkdir dc/d24 0 2024-04-16T14:35:32.071 INFO:tasks.workunit.client.1.smithi115.stdout:3/108: stat dc/c12 0 2024-04-16T14:35:32.072 INFO:tasks.workunit.client.0.smithi005.stdout:6/436: link d2/d45/l6b d2/d20/d3c/l94 0 2024-04-16T14:35:32.074 INFO:tasks.workunit.client.1.smithi115.stdout:2/42: rmdir d0/d4/d9 0 2024-04-16T14:35:32.074 INFO:tasks.workunit.client.1.smithi115.stdout:2/43: dread - d0/d4/ff zero size 2024-04-16T14:35:32.075 INFO:tasks.workunit.client.1.smithi115.stdout:0/38: symlink d6/ld 0 2024-04-16T14:35:32.075 INFO:tasks.workunit.client.1.smithi115.stdout:0/39: chown d6 2039 1 2024-04-16T14:35:32.075 INFO:tasks.workunit.client.1.smithi115.stdout:4/60: dwrite d1/f6 [0,4194304] 0 2024-04-16T14:35:32.077 INFO:tasks.workunit.client.1.smithi115.stdout:3/109: symlink dc/l25 0 2024-04-16T14:35:32.077 INFO:tasks.workunit.client.1.smithi115.stdout:3/110: write dc/f23 [3125426,21727] 0 2024-04-16T14:35:32.077 INFO:tasks.workunit.client.1.smithi115.stdout:3/111: readlink dc/l1e 0 2024-04-16T14:35:32.077 INFO:tasks.workunit.client.1.smithi115.stdout:0/40: symlink d6/le 0 2024-04-16T14:35:32.077 INFO:tasks.workunit.client.1.smithi115.stdout:4/61: mknod d1/ce 0 2024-04-16T14:35:32.077 INFO:tasks.workunit.client.1.smithi115.stdout:4/62: write d1/f4 [3147486,90261] 0 2024-04-16T14:35:32.078 INFO:tasks.workunit.client.1.smithi115.stdout:4/63: stat d1/l9 0 2024-04-16T14:35:32.078 INFO:tasks.workunit.client.1.smithi115.stdout:4/64: readlink d1/l9 0 2024-04-16T14:35:32.078 INFO:tasks.workunit.client.1.smithi115.stdout:4/65: fsync d1/f3 0 2024-04-16T14:35:32.078 INFO:tasks.workunit.client.1.smithi115.stdout:4/66: creat d1/d2/ff x:0 0 0 2024-04-16T14:35:32.078 INFO:tasks.workunit.client.1.smithi115.stdout:0/41: creat d6/ff x:0 0 0 2024-04-16T14:35:32.079 INFO:tasks.workunit.client.0.smithi005.stdout:3/316: creat d2/d9/d25/d39/d64/f70 x:0 0 0 2024-04-16T14:35:32.079 INFO:tasks.workunit.client.0.smithi005.stdout:3/317: stat d2/d9 0 2024-04-16T14:35:32.079 INFO:tasks.workunit.client.0.smithi005.stdout:3/318: stat d2/d9/d25/d39/d64 0 2024-04-16T14:35:32.079 INFO:tasks.workunit.client.0.smithi005.stdout:3/319: write d2/d17/d1e/f60 [790228,44028] 0 2024-04-16T14:35:32.079 INFO:tasks.workunit.client.0.smithi005.stdout:3/320: chown d2/d9/df/l13 100 1 2024-04-16T14:35:32.079 INFO:tasks.workunit.client.0.smithi005.stdout:0/340: rename da/c16 to da/df/d1b/d24/c6e 0 2024-04-16T14:35:32.079 INFO:tasks.workunit.client.0.smithi005.stdout:0/341: chown da/df/d1b/d3a/d53/d5a/c68 1 1 2024-04-16T14:35:32.080 INFO:tasks.workunit.client.0.smithi005.stdout:0/342: write da/df/d1b/f22 [403796,71353] 0 2024-04-16T14:35:32.080 INFO:tasks.workunit.client.0.smithi005.stdout:5/286: mknod d0/d6/d12/d1c/d1e/c53 0 2024-04-16T14:35:32.080 INFO:tasks.workunit.client.0.smithi005.stdout:5/287: creat d0/d6/f54 x:0 0 0 2024-04-16T14:35:32.081 INFO:tasks.workunit.client.0.smithi005.stdout:6/437: mkdir d2/d3f/d95 0 2024-04-16T14:35:32.082 INFO:tasks.workunit.client.0.smithi005.stdout:8/371: dwrite d5/d11/f4a [4194304,4194304] 0 2024-04-16T14:35:32.082 INFO:tasks.workunit.client.1.smithi115.stdout:8/52: dwrite d0/db/fd [0,4194304] 0 2024-04-16T14:35:32.083 INFO:tasks.workunit.client.1.smithi115.stdout:0/42: unlink c4 0 2024-04-16T14:35:32.084 INFO:tasks.workunit.client.0.smithi005.stdout:7/409: rmdir d1/d49/d74 39 2024-04-16T14:35:32.084 INFO:tasks.workunit.client.0.smithi005.stdout:7/410: creat d1/dc/d2f/f83 x:0 0 0 2024-04-16T14:35:32.085 INFO:tasks.workunit.client.1.smithi115.stdout:8/53: read - d0/f4 zero size 2024-04-16T14:35:32.085 INFO:tasks.workunit.client.1.smithi115.stdout:8/54: read - d0/fc zero size 2024-04-16T14:35:32.086 INFO:tasks.workunit.client.0.smithi005.stdout:0/343: symlink da/l6f 0 2024-04-16T14:35:32.086 INFO:tasks.workunit.client.0.smithi005.stdout:0/344: write da/df/d26/f45 [2131800,35465] 0 2024-04-16T14:35:32.086 INFO:tasks.workunit.client.0.smithi005.stdout:0/345: write da/f4e [880732,77894] 0 2024-04-16T14:35:32.086 INFO:tasks.workunit.client.0.smithi005.stdout:0/346: stat da/df/d1b/d3a/d53/d5a/d67/c6c 0 2024-04-16T14:35:32.087 INFO:tasks.workunit.client.0.smithi005.stdout:3/321: write d2/f2c [48913,87214] 0 2024-04-16T14:35:32.087 INFO:tasks.workunit.client.1.smithi115.stdout:0/43: mkdir d6/d10 0 2024-04-16T14:35:32.087 INFO:tasks.workunit.client.1.smithi115.stdout:2/44: dread d0/d4/f7 [0,4194304] 0 2024-04-16T14:35:32.088 INFO:tasks.workunit.client.0.smithi005.stdout:5/288: symlink d0/d6/d12/d1c/d1e/l55 0 2024-04-16T14:35:32.088 INFO:tasks.workunit.client.0.smithi005.stdout:5/289: truncate d0/d6/d12/d1c/f2a 596174 0 2024-04-16T14:35:32.089 INFO:tasks.workunit.client.1.smithi115.stdout:0/44: rename d6/ca to d6/c11 0 2024-04-16T14:35:32.091 INFO:tasks.workunit.client.0.smithi005.stdout:6/438: rename d2/d3f/d47/d90 to d2/d20/d33/d64/d96 0 2024-04-16T14:35:32.091 INFO:tasks.workunit.client.1.smithi115.stdout:2/45: mkdir d0/da/d10 0 2024-04-16T14:35:32.095 INFO:tasks.workunit.client.0.smithi005.stdout:0/347: unlink da/df/d1b/d3a/d53/f4f 0 2024-04-16T14:35:32.095 INFO:tasks.workunit.client.1.smithi115.stdout:1/45: truncate fa 405359 0 2024-04-16T14:35:32.096 INFO:tasks.workunit.client.0.smithi005.stdout:8/372: dread d5/de/f19 [0,4194304] 0 2024-04-16T14:35:32.097 INFO:tasks.workunit.client.0.smithi005.stdout:5/290: symlink d0/d6/d12/l56 0 2024-04-16T14:35:32.101 INFO:tasks.workunit.client.0.smithi005.stdout:6/439: readlink d2/d5/d10/l16 0 2024-04-16T14:35:32.103 INFO:tasks.workunit.client.0.smithi005.stdout:0/348: symlink da/df/d1b/d3a/d53/d5a/d67/l70 0 2024-04-16T14:35:32.103 INFO:tasks.workunit.client.0.smithi005.stdout:0/349: readlink da/df/d26/d39/l58 0 2024-04-16T14:35:32.103 INFO:tasks.workunit.client.0.smithi005.stdout:0/350: read - da/df/d1b/d3a/f57 zero size 2024-04-16T14:35:32.103 INFO:tasks.workunit.client.0.smithi005.stdout:0/351: chown da/df/c1c 251 1 2024-04-16T14:35:32.104 INFO:tasks.workunit.client.0.smithi005.stdout:8/373: truncate d5/de/f19 3507964 0 2024-04-16T14:35:32.104 INFO:tasks.workunit.client.0.smithi005.stdout:8/374: write d5/d11/f67 [641950,44398] 0 2024-04-16T14:35:32.104 INFO:tasks.workunit.client.0.smithi005.stdout:8/375: stat d5/d7b/f33 0 2024-04-16T14:35:32.105 INFO:tasks.workunit.client.0.smithi005.stdout:5/291: creat d0/d6/d12/d34/d42/f57 x:0 0 0 2024-04-16T14:35:32.106 INFO:tasks.workunit.client.0.smithi005.stdout:7/411: dread d1/d49/d74/d77/d22/d27/f36 [0,4194304] 0 2024-04-16T14:35:32.106 INFO:tasks.workunit.client.0.smithi005.stdout:7/412: dread - d1/d49/d74/d77/d57/d47/f7c zero size 2024-04-16T14:35:32.107 INFO:tasks.workunit.client.0.smithi005.stdout:0/352: mkdir da/df/d1b/d71 0 2024-04-16T14:35:32.107 INFO:tasks.workunit.client.0.smithi005.stdout:8/376: creat d5/d7b/d2f/d3d/d7f/f81 x:0 0 0 2024-04-16T14:35:32.108 INFO:tasks.workunit.client.0.smithi005.stdout:8/377: mknod d5/de/d74/c82 0 2024-04-16T14:35:32.109 INFO:tasks.workunit.client.0.smithi005.stdout:8/378: fdatasync d5/d7b/f24 0 2024-04-16T14:35:32.109 INFO:tasks.workunit.client.0.smithi005.stdout:8/379: creat d5/d7b/f83 x:0 0 0 2024-04-16T14:35:32.110 INFO:tasks.workunit.client.1.smithi115.stdout:4/67: rmdir d1 39 2024-04-16T14:35:32.110 INFO:tasks.workunit.client.1.smithi115.stdout:4/68: read d1/f3 [554274,4015] 0 2024-04-16T14:35:32.111 INFO:tasks.workunit.client.0.smithi005.stdout:3/322: dread d2/d9/df/f1c [0,4194304] 0 2024-04-16T14:35:32.111 INFO:tasks.workunit.client.0.smithi005.stdout:3/323: creat d2/f71 x:0 0 0 2024-04-16T14:35:32.112 INFO:tasks.workunit.client.1.smithi115.stdout:4/69: mknod d1/d2/c10 0 2024-04-16T14:35:32.115 INFO:tasks.workunit.client.0.smithi005.stdout:3/324: rename d2/d17/d1e/f36 to d2/d17/d1e/d6d/f72 0 2024-04-16T14:35:32.126 INFO:tasks.workunit.client.1.smithi115.stdout:4/70: read d1/f6 [1914681,48183] 0 2024-04-16T14:35:32.126 INFO:tasks.workunit.client.1.smithi115.stdout:4/71: write d1/d2/fd [269286,47594] 0 2024-04-16T14:35:32.126 INFO:tasks.workunit.client.1.smithi115.stdout:4/72: stat d1 0 2024-04-16T14:35:32.126 INFO:tasks.workunit.client.1.smithi115.stdout:4/73: write d1/f4 [1970232,87720] 0 2024-04-16T14:35:32.127 INFO:tasks.workunit.client.1.smithi115.stdout:0/45: fdatasync f1 0 2024-04-16T14:35:32.127 INFO:tasks.workunit.client.1.smithi115.stdout:3/112: truncate dc/f23 2684729 0 2024-04-16T14:35:32.128 INFO:tasks.workunit.client.1.smithi115.stdout:6/57: dwrite f0 [0,4194304] 0 2024-04-16T14:35:32.129 INFO:tasks.workunit.client.1.smithi115.stdout:6/58: write f0 [4336387,125423] 0 2024-04-16T14:35:32.129 INFO:tasks.workunit.client.1.smithi115.stdout:4/74: creat d1/d2/f11 x:0 0 0 2024-04-16T14:35:32.129 INFO:tasks.workunit.client.1.smithi115.stdout:4/75: truncate d1/d2/f7 4359791 0 2024-04-16T14:35:32.129 INFO:tasks.workunit.client.1.smithi115.stdout:4/76: chown d1/d2/ca 46 1 2024-04-16T14:35:32.129 INFO:tasks.workunit.client.1.smithi115.stdout:4/77: creat d1/d2/f12 x:0 0 0 2024-04-16T14:35:32.131 INFO:tasks.workunit.client.1.smithi115.stdout:3/113: rmdir dc 39 2024-04-16T14:35:32.131 INFO:tasks.workunit.client.1.smithi115.stdout:3/114: chown dc/l25 232796 1 2024-04-16T14:35:32.132 INFO:tasks.workunit.client.1.smithi115.stdout:4/78: mknod d1/d2/c13 0 2024-04-16T14:35:32.132 INFO:tasks.workunit.client.1.smithi115.stdout:4/79: stat d1/d2/fd 0 2024-04-16T14:35:32.132 INFO:tasks.workunit.client.1.smithi115.stdout:4/80: truncate d1/d2/f11 543431 0 2024-04-16T14:35:32.132 INFO:tasks.workunit.client.1.smithi115.stdout:4/81: write d1/f6 [4056100,83634] 0 2024-04-16T14:35:32.133 INFO:tasks.workunit.client.1.smithi115.stdout:3/115: symlink dc/l26 0 2024-04-16T14:35:32.135 INFO:tasks.workunit.client.1.smithi115.stdout:3/116: rename fb to dc/f27 0 2024-04-16T14:35:32.136 INFO:tasks.workunit.client.1.smithi115.stdout:3/117: symlink dc/l28 0 2024-04-16T14:35:32.137 INFO:tasks.workunit.client.1.smithi115.stdout:3/118: mkdir dc/d29 0 2024-04-16T14:35:32.139 INFO:tasks.workunit.client.1.smithi115.stdout:3/119: creat dc/d24/f2a x:0 0 0 2024-04-16T14:35:32.140 INFO:tasks.workunit.client.1.smithi115.stdout:8/55: dwrite d0/db/fd [0,4194304] 0 2024-04-16T14:35:32.147 INFO:tasks.workunit.client.1.smithi115.stdout:2/46: dwrite d0/d4/ff [0,4194304] 0 2024-04-16T14:35:32.156 INFO:tasks.workunit.client.1.smithi115.stdout:1/46: dwrite f3 [0,4194304] 0 2024-04-16T14:35:32.157 INFO:tasks.workunit.client.1.smithi115.stdout:1/47: rmdir - no directory 2024-04-16T14:35:32.157 INFO:tasks.workunit.client.1.smithi115.stdout:1/48: chown f3 14267 1 2024-04-16T14:35:32.157 INFO:tasks.workunit.client.1.smithi115.stdout:0/46: dwrite d6/ff [0,4194304] 0 2024-04-16T14:35:32.158 INFO:tasks.workunit.client.0.smithi005.stdout:0/353: fsync da/df/d26/f45 0 2024-04-16T14:35:32.158 INFO:tasks.workunit.client.0.smithi005.stdout:6/440: dwrite d2/d45/d7b/f86 [4194304,4194304] 0 2024-04-16T14:35:32.158 INFO:tasks.workunit.client.0.smithi005.stdout:8/380: dwrite d5/d11/f5f [0,4194304] 0 2024-04-16T14:35:32.158 INFO:tasks.workunit.client.0.smithi005.stdout:8/381: write d5/d40/f61 [587032,79288] 0 2024-04-16T14:35:32.158 INFO:tasks.workunit.client.0.smithi005.stdout:5/292: dwrite d0/d6/d12/d1c/f4a [0,4194304] 0 2024-04-16T14:35:32.158 INFO:tasks.workunit.client.0.smithi005.stdout:3/325: dread d2/d17/d1e/f60 [0,4194304] 0 2024-04-16T14:35:32.158 INFO:tasks.workunit.client.0.smithi005.stdout:7/413: dwrite d1/dc/d2f/f5d [0,4194304] 0 2024-04-16T14:35:32.160 INFO:tasks.workunit.client.1.smithi115.stdout:1/49: creat fe x:0 0 0 2024-04-16T14:35:32.160 INFO:tasks.workunit.client.1.smithi115.stdout:8/56: dwrite d0/db/fd [4194304,4194304] 0 2024-04-16T14:35:32.162 INFO:tasks.workunit.client.0.smithi005.stdout:6/441: rename d2/df/c11 to d2/d5/d10/d4d/d51/c97 0 2024-04-16T14:35:32.166 INFO:tasks.workunit.client.0.smithi005.stdout:5/293: symlink d0/d6/d12/l58 0 2024-04-16T14:35:32.166 INFO:tasks.workunit.client.0.smithi005.stdout:5/294: creat d0/d6/d12/d34/d42/f59 x:0 0 0 2024-04-16T14:35:32.166 INFO:tasks.workunit.client.0.smithi005.stdout:5/295: truncate d0/d6/d12/d34/d42/f59 537297 0 2024-04-16T14:35:32.166 INFO:tasks.workunit.client.1.smithi115.stdout:0/47: dread d6/ff [0,4194304] 0 2024-04-16T14:35:32.167 INFO:tasks.workunit.client.1.smithi115.stdout:4/82: dread d1/d2/f7 [0,4194304] 0 2024-04-16T14:35:32.167 INFO:tasks.workunit.client.1.smithi115.stdout:4/83: read d1/f4 [2161005,64516] 0 2024-04-16T14:35:32.170 INFO:tasks.workunit.client.1.smithi115.stdout:1/50: dread f3 [0,4194304] 0 2024-04-16T14:35:32.170 INFO:tasks.workunit.client.1.smithi115.stdout:6/59: dread f0 [0,4194304] 0 2024-04-16T14:35:32.170 INFO:tasks.workunit.client.0.smithi005.stdout:7/414: creat d1/d49/d74/d77/d57/d47/f84 x:0 0 0 2024-04-16T14:35:32.174 INFO:tasks.workunit.client.0.smithi005.stdout:8/382: rename d5/c32 to d5/d11/d6c/d71/c84 0 2024-04-16T14:35:32.176 INFO:tasks.workunit.client.0.smithi005.stdout:0/354: getdents da/df/d1b/d3a/d53/d5a/d67 0 2024-04-16T14:35:32.177 INFO:tasks.workunit.client.1.smithi115.stdout:0/48: write d6/ff [963079,19645] 0 2024-04-16T14:35:32.178 INFO:tasks.workunit.client.1.smithi115.stdout:0/49: stat d6 0 2024-04-16T14:35:32.180 INFO:tasks.workunit.client.1.smithi115.stdout:4/84: symlink d1/l14 0 2024-04-16T14:35:32.180 INFO:tasks.workunit.client.0.smithi005.stdout:0/355: write da/df/d1b/d24/f28 [333287,27648] 0 2024-04-16T14:35:32.181 INFO:tasks.workunit.client.1.smithi115.stdout:1/51: truncate fb 673731 0 2024-04-16T14:35:32.183 INFO:tasks.workunit.client.1.smithi115.stdout:6/60: creat f12 x:0 0 0 2024-04-16T14:35:32.184 INFO:tasks.workunit.client.1.smithi115.stdout:8/57: symlink d0/lf 0 2024-04-16T14:35:32.185 INFO:tasks.workunit.client.1.smithi115.stdout:8/58: chown d0/db/ce 2 1 2024-04-16T14:35:32.185 INFO:tasks.workunit.client.1.smithi115.stdout:8/59: stat d0/f3 0 2024-04-16T14:35:32.185 INFO:tasks.workunit.client.1.smithi115.stdout:8/60: dread - d0/f4 zero size 2024-04-16T14:35:32.185 INFO:tasks.workunit.client.1.smithi115.stdout:8/61: dread - d0/f4 zero size 2024-04-16T14:35:32.185 INFO:tasks.workunit.client.1.smithi115.stdout:8/62: write d0/fc [923031,56229] 0 2024-04-16T14:35:32.185 INFO:tasks.workunit.client.1.smithi115.stdout:8/63: fsync d0/f3 0 2024-04-16T14:35:32.186 INFO:tasks.workunit.client.0.smithi005.stdout:7/415: truncate d1/d49/d74/d77/d22/d27/f64 2020992 0 2024-04-16T14:35:32.186 INFO:tasks.workunit.client.1.smithi115.stdout:0/50: mkdir d6/d10/d12 0 2024-04-16T14:35:32.186 INFO:tasks.workunit.client.1.smithi115.stdout:0/51: readlink d6/l8 0 2024-04-16T14:35:32.186 INFO:tasks.workunit.client.1.smithi115.stdout:0/52: fsync d6/fb 0 2024-04-16T14:35:32.188 INFO:tasks.workunit.client.1.smithi115.stdout:4/85: unlink d1/d2/f12 0 2024-04-16T14:35:32.189 INFO:tasks.workunit.client.1.smithi115.stdout:3/120: rmdir dc/d24 39 2024-04-16T14:35:32.193 INFO:tasks.workunit.client.0.smithi005.stdout:8/383: rename d5/de/l39 to d5/d55/d5a/l85 0 2024-04-16T14:35:32.194 INFO:tasks.workunit.client.1.smithi115.stdout:4/86: unlink d1/d2/fd 0 2024-04-16T14:35:32.195 INFO:tasks.workunit.client.1.smithi115.stdout:3/121: mknod dc/d24/c2b 0 2024-04-16T14:35:32.195 INFO:tasks.workunit.client.1.smithi115.stdout:3/122: write dc/f18 [533058,83082] 0 2024-04-16T14:35:32.195 INFO:tasks.workunit.client.1.smithi115.stdout:2/47: write d0/d4/ff [4491422,1642] 0 2024-04-16T14:35:32.196 INFO:tasks.workunit.client.0.smithi005.stdout:0/356: rmdir da/df/d26 39 2024-04-16T14:35:32.196 INFO:tasks.workunit.client.0.smithi005.stdout:0/357: creat da/df/d1b/f72 x:0 0 0 2024-04-16T14:35:32.197 INFO:tasks.workunit.client.1.smithi115.stdout:1/52: mkdir df 0 2024-04-16T14:35:32.198 INFO:tasks.workunit.client.1.smithi115.stdout:1/53: dread fb [0,4194304] 0 2024-04-16T14:35:32.198 INFO:tasks.workunit.client.1.smithi115.stdout:6/61: mkdir d13 0 2024-04-16T14:35:32.198 INFO:tasks.workunit.client.1.smithi115.stdout:6/62: dread - f12 zero size 2024-04-16T14:35:32.198 INFO:tasks.workunit.client.1.smithi115.stdout:6/63: readlink l10 0 2024-04-16T14:35:32.199 INFO:tasks.workunit.client.0.smithi005.stdout:5/296: dwrite d0/f52 [0,4194304] 0 2024-04-16T14:35:32.199 INFO:tasks.workunit.client.0.smithi005.stdout:6/442: dwrite d2/d20/d3c/f5d [0,4194304] 0 2024-04-16T14:35:32.200 INFO:tasks.workunit.client.1.smithi115.stdout:4/87: mkdir d1/d15 0 2024-04-16T14:35:32.202 INFO:tasks.workunit.client.1.smithi115.stdout:3/123: symlink dc/d29/l2c 0 2024-04-16T14:35:32.202 INFO:tasks.workunit.client.0.smithi005.stdout:0/358: link da/f1a da/df/d1b/d3a/d53/d5a/f73 0 2024-04-16T14:35:32.202 INFO:tasks.workunit.client.0.smithi005.stdout:0/359: chown da/df/d1b/d24/l52 1847 1 2024-04-16T14:35:32.204 INFO:tasks.workunit.client.1.smithi115.stdout:1/54: creat df/f10 x:0 0 0 2024-04-16T14:35:32.204 INFO:tasks.workunit.client.1.smithi115.stdout:1/55: creat df/f11 x:0 0 0 2024-04-16T14:35:32.205 INFO:tasks.workunit.client.0.smithi005.stdout:5/297: creat d0/d6/d12/d34/f5a x:0 0 0 2024-04-16T14:35:32.206 INFO:tasks.workunit.client.1.smithi115.stdout:6/64: symlink d13/l14 0 2024-04-16T14:35:32.209 INFO:tasks.workunit.client.1.smithi115.stdout:3/124: link dc/f27 dc/d29/f2d 0 2024-04-16T14:35:32.210 INFO:tasks.workunit.client.0.smithi005.stdout:6/443: creat d2/d20/f98 x:0 0 0 2024-04-16T14:35:32.212 INFO:tasks.workunit.client.0.smithi005.stdout:0/360: mknod da/c74 0 2024-04-16T14:35:32.213 INFO:tasks.workunit.client.1.smithi115.stdout:6/65: symlink d13/l15 0 2024-04-16T14:35:32.213 INFO:tasks.workunit.client.0.smithi005.stdout:7/416: dwrite d1/d49/d74/d77/f11 [0,4194304] 0 2024-04-16T14:35:32.213 INFO:tasks.workunit.client.0.smithi005.stdout:7/417: fsync d1/d49/d74/d77/d22/f28 0 2024-04-16T14:35:32.213 INFO:tasks.workunit.client.0.smithi005.stdout:3/326: truncate d2/f2c 247188 0 2024-04-16T14:35:32.213 INFO:tasks.workunit.client.0.smithi005.stdout:5/298: creat d0/d6/d12/f5b x:0 0 0 2024-04-16T14:35:32.214 INFO:tasks.workunit.client.1.smithi115.stdout:3/125: link dc/f1c dc/d29/f2e 0 2024-04-16T14:35:32.214 INFO:tasks.workunit.client.1.smithi115.stdout:3/126: dread - dc/d24/f2a zero size 2024-04-16T14:35:32.216 INFO:tasks.workunit.client.0.smithi005.stdout:6/444: unlink d2/d20/f62 0 2024-04-16T14:35:32.216 INFO:tasks.workunit.client.1.smithi115.stdout:8/64: dwrite d0/f3 [0,4194304] 0 2024-04-16T14:35:32.216 INFO:tasks.workunit.client.1.smithi115.stdout:6/66: link f6 d13/f16 0 2024-04-16T14:35:32.218 INFO:tasks.workunit.client.1.smithi115.stdout:8/65: mkdir d0/db/d10 0 2024-04-16T14:35:32.219 INFO:tasks.workunit.client.0.smithi005.stdout:0/361: mkdir da/df/d1b/d24/d75 0 2024-04-16T14:35:32.219 INFO:tasks.workunit.client.0.smithi005.stdout:0/362: write da/df/d1b/f72 [885576,125563] 0 2024-04-16T14:35:32.220 INFO:tasks.workunit.client.1.smithi115.stdout:6/67: rename d13/f16 to d13/f17 0 2024-04-16T14:35:32.221 INFO:tasks.workunit.client.0.smithi005.stdout:6/445: mknod d2/d3f/c99 0 2024-04-16T14:35:32.222 INFO:tasks.workunit.client.1.smithi115.stdout:8/66: creat d0/db/d10/f11 x:0 0 0 2024-04-16T14:35:32.225 INFO:tasks.workunit.client.1.smithi115.stdout:4/88: dwrite d1/d2/f8 [0,4194304] 0 2024-04-16T14:35:32.226 INFO:tasks.workunit.client.0.smithi005.stdout:8/384: dwrite f3 [0,4194304] 0 2024-04-16T14:35:32.226 INFO:tasks.workunit.client.0.smithi005.stdout:3/327: rmdir d2/d17 39 2024-04-16T14:35:32.227 INFO:tasks.workunit.client.1.smithi115.stdout:8/67: rename d0/f4 to d0/db/f12 0 2024-04-16T14:35:32.227 INFO:tasks.workunit.client.1.smithi115.stdout:6/68: dread f8 [0,4194304] 0 2024-04-16T14:35:32.227 INFO:tasks.workunit.client.1.smithi115.stdout:6/69: chown fe 10 1 2024-04-16T14:35:32.227 INFO:tasks.workunit.client.1.smithi115.stdout:6/70: write d13/f17 [1021437,59231] 0 2024-04-16T14:35:32.228 INFO:tasks.workunit.client.1.smithi115.stdout:6/71: dread fe [0,4194304] 0 2024-04-16T14:35:32.228 INFO:tasks.workunit.client.1.smithi115.stdout:0/53: dwrite d6/fb [0,4194304] 0 2024-04-16T14:35:32.231 INFO:tasks.workunit.client.1.smithi115.stdout:6/72: read f6 [180398,65355] 0 2024-04-16T14:35:32.235 INFO:tasks.workunit.client.0.smithi005.stdout:3/328: unlink d2/d17/d46/d47/f67 0 2024-04-16T14:35:32.235 INFO:tasks.workunit.client.0.smithi005.stdout:3/329: dread - d2/d17/d46/f57 zero size 2024-04-16T14:35:32.236 INFO:tasks.workunit.client.1.smithi115.stdout:0/54: symlink d6/l13 0 2024-04-16T14:35:32.237 INFO:tasks.workunit.client.0.smithi005.stdout:3/330: creat d2/d17/d1e/d6d/f73 x:0 0 0 2024-04-16T14:35:32.237 INFO:tasks.workunit.client.0.smithi005.stdout:3/331: dread - d2/f66 zero size 2024-04-16T14:35:32.239 INFO:tasks.workunit.client.1.smithi115.stdout:4/89: getdents d1/d2 0 2024-04-16T14:35:32.239 INFO:tasks.workunit.client.0.smithi005.stdout:6/446: rmdir d2/d20/d3c/d7c 0 2024-04-16T14:35:32.239 INFO:tasks.workunit.client.0.smithi005.stdout:6/447: chown d2/df/f32 2453544 1 2024-04-16T14:35:32.240 INFO:tasks.workunit.client.0.smithi005.stdout:9/235: sync 2024-04-16T14:35:32.240 INFO:tasks.workunit.client.0.smithi005.stdout:9/236: readlink d3/d12/d16/l17 0 2024-04-16T14:35:32.242 INFO:tasks.workunit.client.1.smithi115.stdout:0/55: creat d6/d10/d12/f14 x:0 0 0 2024-04-16T14:35:32.242 INFO:tasks.workunit.client.0.smithi005.stdout:6/448: link d2/d5/d28/c58 d2/d5/d10/d4d/d7a/c9a 0 2024-04-16T14:35:32.243 INFO:tasks.workunit.client.0.smithi005.stdout:3/332: rmdir d2/d9/df 39 2024-04-16T14:35:32.243 INFO:tasks.workunit.client.0.smithi005.stdout:3/333: chown d2/l5c 867 1 2024-04-16T14:35:32.244 INFO:tasks.workunit.client.1.smithi115.stdout:0/56: mknod d6/d10/c15 0 2024-04-16T14:35:32.244 INFO:tasks.workunit.client.0.smithi005.stdout:9/237: symlink d3/d12/d16/l40 0 2024-04-16T14:35:32.245 INFO:tasks.workunit.client.1.smithi115.stdout:0/57: mknod d6/d10/d12/c16 0 2024-04-16T14:35:32.247 INFO:tasks.workunit.client.0.smithi005.stdout:6/449: symlink d2/d3f/d47/l9b 0 2024-04-16T14:35:32.247 INFO:tasks.workunit.client.0.smithi005.stdout:6/450: chown d2/d5/d28/f21 88775 1 2024-04-16T14:35:32.247 INFO:tasks.workunit.client.1.smithi115.stdout:1/56: rmdir df 39 2024-04-16T14:35:32.249 INFO:tasks.workunit.client.1.smithi115.stdout:1/57: chown f4 192897 1 2024-04-16T14:35:32.249 INFO:tasks.workunit.client.1.smithi115.stdout:1/58: truncate fa 1440159 0 2024-04-16T14:35:32.249 INFO:tasks.workunit.client.0.smithi005.stdout:6/451: truncate d2/f26 1800016 0 2024-04-16T14:35:32.250 INFO:tasks.workunit.client.0.smithi005.stdout:6/452: rmdir d2/d20/d72 39 2024-04-16T14:35:32.250 INFO:tasks.workunit.client.0.smithi005.stdout:6/453: write d2/d5/d28/f21 [3282556,41239] 0 2024-04-16T14:35:32.251 INFO:tasks.workunit.client.1.smithi115.stdout:1/59: creat df/f12 x:0 0 0 2024-04-16T14:35:32.251 INFO:tasks.workunit.client.0.smithi005.stdout:6/454: truncate d2/d20/d3c/f5d 2764598 0 2024-04-16T14:35:32.252 INFO:tasks.workunit.client.0.smithi005.stdout:6/455: creat d2/d20/d72/f9c x:0 0 0 2024-04-16T14:35:32.253 INFO:tasks.workunit.client.0.smithi005.stdout:6/456: truncate d2/d5/d10/d4d/f6d 2515623 0 2024-04-16T14:35:32.253 INFO:tasks.workunit.client.0.smithi005.stdout:6/457: truncate d2/d5/d28/f38 3710572 0 2024-04-16T14:35:32.253 INFO:tasks.workunit.client.0.smithi005.stdout:6/458: chown d2/d5/d10/d4d/f80 562 1 2024-04-16T14:35:32.253 INFO:tasks.workunit.client.0.smithi005.stdout:6/459: mkdir d2/d5/d10/d4d/d7a/d9d 0 2024-04-16T14:35:32.258 INFO:tasks.workunit.client.1.smithi115.stdout:6/73: rename d13/f17 to d13/f18 0 2024-04-16T14:35:32.258 INFO:tasks.workunit.client.1.smithi115.stdout:8/68: rmdir d0/db 39 2024-04-16T14:35:32.258 INFO:tasks.workunit.client.1.smithi115.stdout:6/74: read f8 [160220,74605] 0 2024-04-16T14:35:32.258 INFO:tasks.workunit.client.1.smithi115.stdout:6/75: write fc [568188,46011] 0 2024-04-16T14:35:32.260 INFO:tasks.workunit.client.1.smithi115.stdout:8/69: link d0/db/f12 d0/db/f13 0 2024-04-16T14:35:32.260 INFO:tasks.workunit.client.1.smithi115.stdout:8/70: readlink d0/lf 0 2024-04-16T14:35:32.260 INFO:tasks.workunit.client.1.smithi115.stdout:8/71: fsync d0/db/fd 0 2024-04-16T14:35:32.261 INFO:tasks.workunit.client.1.smithi115.stdout:6/76: mknod d13/c19 0 2024-04-16T14:35:32.263 INFO:tasks.workunit.client.1.smithi115.stdout:8/72: mknod d0/db/d10/c14 0 2024-04-16T14:35:32.263 INFO:tasks.workunit.client.1.smithi115.stdout:8/73: chown d0/db/d10/f11 241558067 1 2024-04-16T14:35:32.264 INFO:tasks.workunit.client.1.smithi115.stdout:6/77: mkdir d13/d1a 0 2024-04-16T14:35:32.264 INFO:tasks.workunit.client.1.smithi115.stdout:6/78: write d13/f18 [1977471,73715] 0 2024-04-16T14:35:32.264 INFO:tasks.workunit.client.1.smithi115.stdout:4/90: write d1/d2/f8 [3356743,426] 0 2024-04-16T14:35:32.266 INFO:tasks.workunit.client.1.smithi115.stdout:6/79: rename fe to d13/d1a/f1b 0 2024-04-16T14:35:32.267 INFO:tasks.workunit.client.1.smithi115.stdout:4/91: symlink d1/l16 0 2024-04-16T14:35:32.269 INFO:tasks.workunit.client.1.smithi115.stdout:4/92: mkdir d1/d15/d17 0 2024-04-16T14:35:32.269 INFO:tasks.workunit.client.1.smithi115.stdout:4/93: fsync d1/f3 0 2024-04-16T14:35:32.271 INFO:tasks.workunit.client.1.smithi115.stdout:1/60: dread f0 [0,4194304] 0 2024-04-16T14:35:32.285 INFO:tasks.workunit.client.1.smithi115.stdout:8/74: write d0/db/fd [5461098,90231] 0 2024-04-16T14:35:32.285 INFO:tasks.workunit.client.1.smithi115.stdout:8/75: dread - d0/db/d10/f11 zero size 2024-04-16T14:35:32.287 INFO:tasks.workunit.client.1.smithi115.stdout:8/76: unlink d0/lf 0 2024-04-16T14:35:32.287 INFO:tasks.workunit.client.1.smithi115.stdout:8/77: rename d0/fc to d0/db/f15 0 2024-04-16T14:35:32.287 INFO:tasks.workunit.client.1.smithi115.stdout:8/78: dread - d0/db/f13 zero size 2024-04-16T14:35:32.288 INFO:tasks.workunit.client.1.smithi115.stdout:8/79: creat d0/db/d10/f16 x:0 0 0 2024-04-16T14:35:32.289 INFO:tasks.workunit.client.1.smithi115.stdout:8/80: mkdir d0/db/d10/d17 0 2024-04-16T14:35:32.289 INFO:tasks.workunit.client.0.smithi005.stdout:5/299: dwrite d0/d6/d12/d1c/f22 [0,4194304] 0 2024-04-16T14:35:32.289 INFO:tasks.workunit.client.0.smithi005.stdout:0/363: dwrite da/f20 [0,4194304] 0 2024-04-16T14:35:32.290 INFO:tasks.workunit.client.1.smithi115.stdout:8/81: creat d0/db/d10/d17/f18 x:0 0 0 2024-04-16T14:35:32.296 INFO:tasks.workunit.client.0.smithi005.stdout:8/385: dwrite d5/d55/f6b [0,4194304] 0 2024-04-16T14:35:32.296 INFO:tasks.workunit.client.0.smithi005.stdout:5/300: rename d0/d6/d12/l58 to d0/d6/d12/d34/l5c 0 2024-04-16T14:35:32.296 INFO:tasks.workunit.client.0.smithi005.stdout:5/301: write d0/f1b [6175912,19193] 0 2024-04-16T14:35:32.297 INFO:tasks.workunit.client.0.smithi005.stdout:6/460: dwrite d2/d3f/d47/f31 [4194304,4194304] 0 2024-04-16T14:35:32.297 INFO:tasks.workunit.client.0.smithi005.stdout:9/238: dwrite d3/f25 [0,4194304] 0 2024-04-16T14:35:32.297 INFO:tasks.workunit.client.0.smithi005.stdout:9/239: chown d3/f7 209 1 2024-04-16T14:35:32.297 INFO:tasks.workunit.client.1.smithi115.stdout:2/48: dwrite d0/fb [0,4194304] 0 2024-04-16T14:35:32.297 INFO:tasks.workunit.client.1.smithi115.stdout:0/58: fsync d6/ff 0 2024-04-16T14:35:32.297 INFO:tasks.workunit.client.1.smithi115.stdout:4/94: dwrite d1/f6 [0,4194304] 0 2024-04-16T14:35:32.298 INFO:tasks.workunit.client.1.smithi115.stdout:3/127: dwrite dc/f1b [0,4194304] 0 2024-04-16T14:35:32.298 INFO:tasks.workunit.client.1.smithi115.stdout:3/128: truncate dc/f23 3633307 0 2024-04-16T14:35:32.298 INFO:tasks.workunit.client.1.smithi115.stdout:3/129: truncate dc/f23 4287794 0 2024-04-16T14:35:32.299 INFO:tasks.workunit.client.1.smithi115.stdout:0/59: mknod d6/d10/c17 0 2024-04-16T14:35:32.299 INFO:tasks.workunit.client.1.smithi115.stdout:0/60: readlink d6/l9 0 2024-04-16T14:35:32.299 INFO:tasks.workunit.client.1.smithi115.stdout:0/61: write d6/ff [2448190,105263] 0 2024-04-16T14:35:32.299 INFO:tasks.workunit.client.0.smithi005.stdout:1/439: sync 2024-04-16T14:35:32.299 INFO:tasks.workunit.client.0.smithi005.stdout:4/479: sync 2024-04-16T14:35:32.299 INFO:tasks.workunit.client.0.smithi005.stdout:2/167: sync 2024-04-16T14:35:32.299 INFO:tasks.workunit.client.0.smithi005.stdout:3/334: dwrite d2/f44 [4194304,4194304] 0 2024-04-16T14:35:32.309 INFO:tasks.workunit.client.1.smithi115.stdout:1/61: getdents df 0 2024-04-16T14:35:32.312 INFO:tasks.workunit.client.1.smithi115.stdout:1/62: dread fa [0,4194304] 0 2024-04-16T14:35:32.313 INFO:tasks.workunit.client.0.smithi005.stdout:0/364: dwrite da/df/f1d [0,4194304] 0 2024-04-16T14:35:32.313 INFO:tasks.workunit.client.0.smithi005.stdout:0/365: fsync da/df/f1d 0 2024-04-16T14:35:32.315 INFO:tasks.workunit.client.0.smithi005.stdout:5/302: dread d0/f28 [0,4194304] 0 2024-04-16T14:35:32.318 INFO:tasks.workunit.client.1.smithi115.stdout:4/95: unlink d1/f6 0 2024-04-16T14:35:32.318 INFO:tasks.workunit.client.1.smithi115.stdout:4/96: fdatasync d1/f3 0 2024-04-16T14:35:32.318 INFO:tasks.workunit.client.1.smithi115.stdout:6/80: getdents d13/d1a 0 2024-04-16T14:35:32.323 INFO:tasks.workunit.client.1.smithi115.stdout:0/62: truncate f1 398397 0 2024-04-16T14:35:32.323 INFO:tasks.workunit.client.1.smithi115.stdout:0/63: chown d6/d10/d12/c16 168120015 1 2024-04-16T14:35:32.324 INFO:tasks.workunit.client.1.smithi115.stdout:1/63: mkdir df/d13 0 2024-04-16T14:35:32.324 INFO:tasks.workunit.client.1.smithi115.stdout:1/64: fdatasync f4 0 2024-04-16T14:35:32.325 INFO:tasks.workunit.client.1.smithi115.stdout:4/97: creat d1/f18 x:0 0 0 2024-04-16T14:35:32.325 INFO:tasks.workunit.client.1.smithi115.stdout:4/98: dread - d1/d2/ff zero size 2024-04-16T14:35:32.326 INFO:tasks.workunit.client.1.smithi115.stdout:0/64: rename d6/ld to d6/d10/d12/l18 0 2024-04-16T14:35:32.326 INFO:tasks.workunit.client.0.smithi005.stdout:1/440: write d2/d2c/f4f [2840737,125670] 0 2024-04-16T14:35:32.327 INFO:tasks.workunit.client.1.smithi115.stdout:1/65: unlink f4 0 2024-04-16T14:35:32.328 INFO:tasks.workunit.client.1.smithi115.stdout:3/130: dwrite dc/f18 [0,4194304] 0 2024-04-16T14:35:32.328 INFO:tasks.workunit.client.1.smithi115.stdout:4/99: unlink d1/d2/c13 0 2024-04-16T14:35:32.329 INFO:tasks.workunit.client.1.smithi115.stdout:4/100: fdatasync d1/f18 0 2024-04-16T14:35:32.332 INFO:tasks.workunit.client.1.smithi115.stdout:3/131: symlink dc/d29/l2f 0 2024-04-16T14:35:32.332 INFO:tasks.workunit.client.1.smithi115.stdout:3/132: read dc/f1a [551763,74641] 0 2024-04-16T14:35:32.332 INFO:tasks.workunit.client.1.smithi115.stdout:3/133: write dc/f17 [1002946,14044] 0 2024-04-16T14:35:32.332 INFO:tasks.workunit.client.0.smithi005.stdout:4/480: unlink d0/d1b/d1d/d1f/d3e/f84 0 2024-04-16T14:35:32.334 INFO:tasks.workunit.client.1.smithi115.stdout:4/101: creat d1/d15/d17/f19 x:0 0 0 2024-04-16T14:35:32.335 INFO:tasks.workunit.client.1.smithi115.stdout:3/134: rename dc/f1b to dc/d24/f30 0 2024-04-16T14:35:32.335 INFO:tasks.workunit.client.0.smithi005.stdout:3/335: mknod d2/d9/df/c74 0 2024-04-16T14:35:32.336 INFO:tasks.workunit.client.1.smithi115.stdout:4/102: mknod d1/d15/c1a 0 2024-04-16T14:35:32.336 INFO:tasks.workunit.client.1.smithi115.stdout:4/103: chown d1/f18 515 1 2024-04-16T14:35:32.337 INFO:tasks.workunit.client.1.smithi115.stdout:3/135: creat dc/f31 x:0 0 0 2024-04-16T14:35:32.337 INFO:tasks.workunit.client.0.smithi005.stdout:9/240: dwrite d3/d12/d2b/f2f [0,4194304] 0 2024-04-16T14:35:32.338 INFO:tasks.workunit.client.0.smithi005.stdout:2/168: dwrite d0/d1c/f20 [4194304,4194304] 0 2024-04-16T14:35:32.338 INFO:tasks.workunit.client.0.smithi005.stdout:2/169: write d0/d4/f9 [7258517,68461] 0 2024-04-16T14:35:32.339 INFO:tasks.workunit.client.1.smithi115.stdout:4/104: truncate d1/f4 1800162 0 2024-04-16T14:35:32.340 INFO:tasks.workunit.client.1.smithi115.stdout:3/136: mknod dc/c32 0 2024-04-16T14:35:32.340 INFO:tasks.workunit.client.1.smithi115.stdout:3/137: chown dc/f27 1637245 1 2024-04-16T14:35:32.341 INFO:tasks.workunit.client.0.smithi005.stdout:5/303: rename d0/d6/d12/d1c/d1e/f3e to d0/d6/d12/d34/d42/d4d/f5d 0 2024-04-16T14:35:32.341 INFO:tasks.workunit.client.0.smithi005.stdout:5/304: readlink d0/d6/d12/d34/d30/l43 0 2024-04-16T14:35:32.342 INFO:tasks.workunit.client.1.smithi115.stdout:4/105: link d1/l9 d1/d2/l1b 0 2024-04-16T14:35:32.342 INFO:tasks.workunit.client.0.smithi005.stdout:9/241: dread d3/f7 [0,4194304] 0 2024-04-16T14:35:32.343 INFO:tasks.workunit.client.1.smithi115.stdout:8/82: dwrite d0/db/f15 [0,4194304] 0 2024-04-16T14:35:32.343 INFO:tasks.workunit.client.0.smithi005.stdout:4/481: mknod d0/d5a/c97 0 2024-04-16T14:35:32.344 INFO:tasks.workunit.client.1.smithi115.stdout:3/138: mkdir dc/d24/d33 0 2024-04-16T14:35:32.344 INFO:tasks.workunit.client.1.smithi115.stdout:3/139: write dc/f22 [581848,81354] 0 2024-04-16T14:35:32.345 INFO:tasks.workunit.client.0.smithi005.stdout:0/366: symlink da/df/d26/l76 0 2024-04-16T14:35:32.345 INFO:tasks.workunit.client.0.smithi005.stdout:0/367: dread - da/df/d50/f6d zero size 2024-04-16T14:35:32.346 INFO:tasks.workunit.client.1.smithi115.stdout:4/106: symlink d1/l1c 0 2024-04-16T14:35:32.346 INFO:tasks.workunit.client.1.smithi115.stdout:4/107: dread - d1/d15/d17/f19 zero size 2024-04-16T14:35:32.348 INFO:tasks.workunit.client.1.smithi115.stdout:3/140: creat dc/d29/f34 x:0 0 0 2024-04-16T14:35:32.348 INFO:tasks.workunit.client.0.smithi005.stdout:2/170: write d0/d4/f12 [1299664,23060] 0 2024-04-16T14:35:32.349 INFO:tasks.workunit.client.1.smithi115.stdout:6/81: dwrite f9 [0,4194304] 0 2024-04-16T14:35:32.351 INFO:tasks.workunit.client.1.smithi115.stdout:1/66: dwrite df/f10 [0,4194304] 0 2024-04-16T14:35:32.353 INFO:tasks.workunit.client.0.smithi005.stdout:1/441: dwrite d2/d1c/d15/f63 [0,4194304] 0 2024-04-16T14:35:32.353 INFO:tasks.workunit.client.0.smithi005.stdout:1/442: chown d2/d1c/d15/d2a/d1a 189248499 1 2024-04-16T14:35:32.354 INFO:tasks.workunit.client.0.smithi005.stdout:6/461: write d2/d20/d3c/f5d [91347,69079] 0 2024-04-16T14:35:32.355 INFO:tasks.workunit.client.0.smithi005.stdout:3/336: rename d2/d17/d1e to d2/d17/d46/d75 0 2024-04-16T14:35:32.355 INFO:tasks.workunit.client.0.smithi005.stdout:3/337: write d2/d17/d46/d75/f60 [900239,25475] 0 2024-04-16T14:35:32.356 INFO:tasks.workunit.client.1.smithi115.stdout:6/82: creat d13/f1c x:0 0 0 2024-04-16T14:35:32.357 INFO:tasks.workunit.client.0.smithi005.stdout:2/171: symlink d0/d4/l2f 0 2024-04-16T14:35:32.358 INFO:tasks.workunit.client.1.smithi115.stdout:1/67: creat df/f14 x:0 0 0 2024-04-16T14:35:32.360 INFO:tasks.workunit.client.0.smithi005.stdout:6/462: creat d2/d5/d10/d4d/d8e/f9e x:0 0 0 2024-04-16T14:35:32.362 INFO:tasks.workunit.client.0.smithi005.stdout:3/338: creat d2/d17/f76 x:0 0 0 2024-04-16T14:35:32.362 INFO:tasks.workunit.client.0.smithi005.stdout:3/339: read - d2/d17/d46/d47/f62 zero size 2024-04-16T14:35:32.362 INFO:tasks.workunit.client.0.smithi005.stdout:3/340: fsync d2/d17/d46/f57 0 2024-04-16T14:35:32.362 INFO:tasks.workunit.client.0.smithi005.stdout:3/341: readlink d2/d9/d25/l27 0 2024-04-16T14:35:32.362 INFO:tasks.workunit.client.0.smithi005.stdout:2/172: mknod d0/d1c/c30 0 2024-04-16T14:35:32.364 INFO:tasks.workunit.client.0.smithi005.stdout:3/342: mknod d2/d9/d25/c77 0 2024-04-16T14:35:32.364 INFO:tasks.workunit.client.0.smithi005.stdout:3/343: chown d2/d9/d25/d39/d64 28276 1 2024-04-16T14:35:32.364 INFO:tasks.workunit.client.0.smithi005.stdout:3/344: chown d2/d17/d46/d75/d6d 716035 1 2024-04-16T14:35:32.365 INFO:tasks.workunit.client.1.smithi115.stdout:1/68: mkdir df/d15 0 2024-04-16T14:35:32.368 INFO:tasks.workunit.client.1.smithi115.stdout:6/83: truncate f6 1295339 0 2024-04-16T14:35:32.368 INFO:tasks.workunit.client.0.smithi005.stdout:3/345: creat d2/d17/d46/d47/f78 x:0 0 0 2024-04-16T14:35:32.368 INFO:tasks.workunit.client.0.smithi005.stdout:3/346: mkdir d2/d17/d46/d75/d41/d79 0 2024-04-16T14:35:32.368 INFO:tasks.workunit.client.0.smithi005.stdout:6/463: write d2/d5/f37 [823165,7939] 0 2024-04-16T14:35:32.369 INFO:tasks.workunit.client.0.smithi005.stdout:3/347: mkdir d2/d6b/d7a 0 2024-04-16T14:35:32.370 INFO:tasks.workunit.client.0.smithi005.stdout:6/464: getdents d2/d45/d7b 0 2024-04-16T14:35:32.371 INFO:tasks.workunit.client.1.smithi115.stdout:0/65: link f1 d6/d10/d12/f19 0 2024-04-16T14:35:32.371 INFO:tasks.workunit.client.0.smithi005.stdout:6/465: mkdir d2/d3f/d9f 0 2024-04-16T14:35:32.373 INFO:tasks.workunit.client.1.smithi115.stdout:6/84: unlink ca 0 2024-04-16T14:35:32.373 INFO:tasks.workunit.client.1.smithi115.stdout:7/91: sync 2024-04-16T14:35:32.373 INFO:tasks.workunit.client.1.smithi115.stdout:5/22: sync 2024-04-16T14:35:32.373 INFO:tasks.workunit.client.1.smithi115.stdout:9/143: sync 2024-04-16T14:35:32.375 INFO:tasks.workunit.client.1.smithi115.stdout:6/85: truncate fc 166598 0 2024-04-16T14:35:32.375 INFO:tasks.workunit.client.1.smithi115.stdout:6/86: chown d13/d1a/f1b 120971034 1 2024-04-16T14:35:32.375 INFO:tasks.workunit.client.1.smithi115.stdout:6/87: fsync f12 0 2024-04-16T14:35:32.377 INFO:tasks.workunit.client.1.smithi115.stdout:7/92: symlink d0/d1/l21 0 2024-04-16T14:35:32.378 INFO:tasks.workunit.client.0.smithi005.stdout:2/173: dwrite d0/d4/d2b/f1a [4194304,4194304] 0 2024-04-16T14:35:32.378 INFO:tasks.workunit.client.0.smithi005.stdout:2/174: read d0/d4/d2b/f17 [21696,91746] 0 2024-04-16T14:35:32.380 INFO:tasks.workunit.client.1.smithi115.stdout:9/144: mkdir d1/d6/d29 0 2024-04-16T14:35:32.380 INFO:tasks.workunit.client.1.smithi115.stdout:9/145: mkdir d1/d10/d20/d2a 0 2024-04-16T14:35:32.381 INFO:tasks.workunit.client.1.smithi115.stdout:9/146: getdents d1/d10/d20/d2a 0 2024-04-16T14:35:32.382 INFO:tasks.workunit.client.0.smithi005.stdout:5/305: rename d0/d6/d12/d34/d42/d4d to d0/d6/d12/d1c/d1e/d48/d5e 0 2024-04-16T14:35:32.382 INFO:tasks.workunit.client.1.smithi115.stdout:8/83: dwrite d0/db/f12 [0,4194304] 0 2024-04-16T14:35:32.382 INFO:tasks.workunit.client.1.smithi115.stdout:8/84: chown d0/db/d10/f11 4903118 1 2024-04-16T14:35:32.382 INFO:tasks.workunit.client.1.smithi115.stdout:9/147: truncate d1/f19 26102 0 2024-04-16T14:35:32.383 INFO:tasks.workunit.client.0.smithi005.stdout:2/175: getdents d0/d4/d2b 0 2024-04-16T14:35:32.386 INFO:tasks.workunit.client.0.smithi005.stdout:4/482: rename d0/d4d/f56 to d0/d22/d85/d90/f98 0 2024-04-16T14:35:32.386 INFO:tasks.workunit.client.0.smithi005.stdout:4/483: chown d0/d1b/f62 4652 1 2024-04-16T14:35:32.386 INFO:tasks.workunit.client.0.smithi005.stdout:4/484: write d0/d22/d29/f7f [1018169,3783] 0 2024-04-16T14:35:32.386 INFO:tasks.workunit.client.0.smithi005.stdout:4/485: write d0/d1b/d1d/d1f/d48/f8a [30049,17260] 0 2024-04-16T14:35:32.386 INFO:tasks.workunit.client.0.smithi005.stdout:4/486: write d0/d1b/d1d/d1f/d5d/f93 [64307,67186] 0 2024-04-16T14:35:32.386 INFO:tasks.workunit.client.0.smithi005.stdout:4/487: read d0/d22/d29/f7f [1598547,29564] 0 2024-04-16T14:35:32.386 INFO:tasks.workunit.client.0.smithi005.stdout:5/306: rmdir d0/d6/d12/d1c 39 2024-04-16T14:35:32.387 INFO:tasks.workunit.client.0.smithi005.stdout:5/307: chown d0/d6/d12/d1c/f20 760555 1 2024-04-16T14:35:32.387 INFO:tasks.workunit.client.1.smithi115.stdout:9/148: truncate f0 2048967 0 2024-04-16T14:35:32.387 INFO:tasks.workunit.client.1.smithi115.stdout:9/149: chown d1/d6/dd 60696 1 2024-04-16T14:35:32.388 INFO:tasks.workunit.client.0.smithi005.stdout:2/176: link d0/d4/f6 d0/d2a/f31 0 2024-04-16T14:35:32.388 INFO:tasks.workunit.client.0.smithi005.stdout:2/177: write d0/f27 [772126,72315] 0 2024-04-16T14:35:32.389 INFO:tasks.workunit.client.1.smithi115.stdout:4/108: truncate d1/f4 2061551 0 2024-04-16T14:35:32.390 INFO:tasks.workunit.client.0.smithi005.stdout:0/368: rename da/l11 to da/df/d1b/d24/d75/l77 0 2024-04-16T14:35:32.390 INFO:tasks.workunit.client.1.smithi115.stdout:4/109: dread d1/d2/f11 [0,4194304] 0 2024-04-16T14:35:32.393 INFO:tasks.workunit.client.0.smithi005.stdout:5/308: unlink d0/f1b 0 2024-04-16T14:35:32.393 INFO:tasks.workunit.client.0.smithi005.stdout:5/309: chown d0/d6/d12/f23 23912 1 2024-04-16T14:35:32.395 INFO:tasks.workunit.client.0.smithi005.stdout:1/443: rename d2/d1c/ff to d2/d1c/d15/d2a/d1a/d21/fa3 0 2024-04-16T14:35:32.396 INFO:tasks.workunit.client.1.smithi115.stdout:4/110: mknod d1/c1d 0 2024-04-16T14:35:32.396 INFO:tasks.workunit.client.1.smithi115.stdout:4/111: fdatasync d1/d2/f8 0 2024-04-16T14:35:32.396 INFO:tasks.workunit.client.1.smithi115.stdout:4/112: chown d1/l1c 134004522 1 2024-04-16T14:35:32.396 INFO:tasks.workunit.client.1.smithi115.stdout:7/93: dread d0/f16 [0,4194304] 0 2024-04-16T14:35:32.396 INFO:tasks.workunit.client.0.smithi005.stdout:0/369: symlink da/df/d26/d39/d55/l78 0 2024-04-16T14:35:32.398 INFO:tasks.workunit.client.1.smithi115.stdout:7/94: symlink d0/d2/l22 0 2024-04-16T14:35:32.398 INFO:tasks.workunit.client.1.smithi115.stdout:5/23: read f2 [4188119,15548] 0 2024-04-16T14:35:32.398 INFO:tasks.workunit.client.1.smithi115.stdout:5/24: chown l3 160 1 2024-04-16T14:35:32.398 INFO:tasks.workunit.client.1.smithi115.stdout:5/25: chown f2 48 1 2024-04-16T14:35:32.398 INFO:tasks.workunit.client.1.smithi115.stdout:5/26: write f0 [520795,32526] 0 2024-04-16T14:35:32.400 INFO:tasks.workunit.client.1.smithi115.stdout:3/141: dwrite dc/f16 [0,4194304] 0 2024-04-16T14:35:32.400 INFO:tasks.workunit.client.1.smithi115.stdout:3/142: readlink dc/d29/l2f 0 2024-04-16T14:35:32.400 INFO:tasks.workunit.client.1.smithi115.stdout:3/143: write f6 [4657308,42932] 0 2024-04-16T14:35:32.400 INFO:tasks.workunit.client.1.smithi115.stdout:1/69: dwrite f3 [0,4194304] 0 2024-04-16T14:35:32.402 INFO:tasks.workunit.client.1.smithi115.stdout:8/85: write d0/db/f15 [3914041,47947] 0 2024-04-16T14:35:32.403 INFO:tasks.workunit.client.1.smithi115.stdout:0/66: dwrite d6/fb [0,4194304] 0 2024-04-16T14:35:32.403 INFO:tasks.workunit.client.1.smithi115.stdout:8/86: creat d0/db/d10/d17/f19 x:0 0 0 2024-04-16T14:35:32.405 INFO:tasks.workunit.client.1.smithi115.stdout:1/70: creat df/d13/f16 x:0 0 0 2024-04-16T14:35:32.408 INFO:tasks.workunit.client.1.smithi115.stdout:4/113: dread d1/d2/f8 [0,4194304] 0 2024-04-16T14:35:32.408 INFO:tasks.workunit.client.1.smithi115.stdout:4/114: stat d1/d15/c1a 0 2024-04-16T14:35:32.415 INFO:tasks.workunit.client.0.smithi005.stdout:3/348: dwrite d2/d9/d25/d39/d64/f70 [0,4194304] 0 2024-04-16T14:35:32.415 INFO:tasks.workunit.client.0.smithi005.stdout:3/349: write d2/d17/d46/d47/f62 [871837,8955] 0 2024-04-16T14:35:32.415 INFO:tasks.workunit.client.0.smithi005.stdout:3/350: fdatasync d2/d17/d46/f4b 0 2024-04-16T14:35:32.416 INFO:tasks.workunit.client.0.smithi005.stdout:5/310: mknod d0/d6/d12/d34/c5f 0 2024-04-16T14:35:32.417 INFO:tasks.workunit.client.1.smithi115.stdout:1/71: rename l2 to df/l17 0 2024-04-16T14:35:32.417 INFO:tasks.workunit.client.1.smithi115.stdout:1/72: creat df/d13/f18 x:0 0 0 2024-04-16T14:35:32.418 INFO:tasks.workunit.client.0.smithi005.stdout:0/370: mkdir da/df/d1b/d3a/d53/d5a/d67/d79 0 2024-04-16T14:35:32.428 INFO:tasks.workunit.client.0.smithi005.stdout:0/371: write da/df/f1d [948128,62863] 0 2024-04-16T14:35:32.429 INFO:tasks.workunit.client.0.smithi005.stdout:0/372: creat da/df/d1b/f7a x:0 0 0 2024-04-16T14:35:32.429 INFO:tasks.workunit.client.0.smithi005.stdout:0/373: creat da/df/d1b/f7b x:0 0 0 2024-04-16T14:35:32.429 INFO:tasks.workunit.client.0.smithi005.stdout:0/374: fdatasync da/fe 0 2024-04-16T14:35:32.431 INFO:tasks.workunit.client.0.smithi005.stdout:3/351: link d2/d9/cd d2/d17/d46/d75/d41/c7b 0 2024-04-16T14:35:32.431 INFO:tasks.workunit.client.0.smithi005.stdout:3/352: chown d2/d9/df/c4e 30 1 2024-04-16T14:35:32.437 INFO:tasks.workunit.client.0.smithi005.stdout:0/375: mkdir da/d7c 0 2024-04-16T14:35:32.437 INFO:tasks.workunit.client.0.smithi005.stdout:0/376: write da/df/d1b/f22 [4375482,76774] 0 2024-04-16T14:35:32.438 INFO:tasks.workunit.client.0.smithi005.stdout:3/353: symlink d2/d17/l7c 0 2024-04-16T14:35:32.447 INFO:tasks.workunit.client.0.smithi005.stdout:3/354: dread d2/d9/df/f3c [0,4194304] 0 2024-04-16T14:35:32.447 INFO:tasks.workunit.client.0.smithi005.stdout:3/355: write d2/d17/d46/f4b [469763,19604] 0 2024-04-16T14:35:32.447 INFO:tasks.workunit.client.0.smithi005.stdout:3/356: dread - d2/d17/d46/d75/f42 zero size 2024-04-16T14:35:32.448 INFO:tasks.workunit.client.0.smithi005.stdout:3/357: getdents d2/d17/d46/d47 0 2024-04-16T14:35:32.452 INFO:tasks.workunit.client.0.smithi005.stdout:6/466: dwrite d2/d3f/f4f [0,4194304] 0 2024-04-16T14:35:32.453 INFO:tasks.workunit.client.1.smithi115.stdout:9/150: dwrite d1/f2 [0,4194304] 0 2024-04-16T14:35:32.453 INFO:tasks.workunit.client.0.smithi005.stdout:6/467: fsync d2/d5/d10/f5a 0 2024-04-16T14:35:32.455 INFO:tasks.workunit.client.1.smithi115.stdout:5/27: dread f1 [4194304,4194304] 0 2024-04-16T14:35:32.455 INFO:tasks.workunit.client.1.smithi115.stdout:4/115: truncate d1/d2/f7 26466 0 2024-04-16T14:35:32.455 INFO:tasks.workunit.client.1.smithi115.stdout:6/88: write f6 [831951,47122] 0 2024-04-16T14:35:32.456 INFO:tasks.workunit.client.0.smithi005.stdout:1/444: dwrite d2/d1c/d15/d2a/d1a/f3b [0,4194304] 0 2024-04-16T14:35:32.457 INFO:tasks.workunit.client.1.smithi115.stdout:8/87: dwrite d0/db/d10/f11 [0,4194304] 0 2024-04-16T14:35:32.457 INFO:tasks.workunit.client.0.smithi005.stdout:0/377: dread da/f1a [0,4194304] 0 2024-04-16T14:35:32.458 INFO:tasks.workunit.client.1.smithi115.stdout:3/144: dwrite f6 [0,4194304] 0 2024-04-16T14:35:32.458 INFO:tasks.workunit.client.1.smithi115.stdout:0/67: dwrite f0 [4194304,4194304] 0 2024-04-16T14:35:32.458 INFO:tasks.workunit.client.1.smithi115.stdout:0/68: dread - d6/d10/d12/f14 zero size 2024-04-16T14:35:32.458 INFO:tasks.workunit.client.1.smithi115.stdout:0/69: write d6/ff [431993,30264] 0 2024-04-16T14:35:32.458 INFO:tasks.workunit.client.1.smithi115.stdout:0/70: stat d6/d10/d12/f19 0 2024-04-16T14:35:32.459 INFO:tasks.workunit.client.1.smithi115.stdout:1/73: dwrite fb [0,4194304] 0 2024-04-16T14:35:32.459 INFO:tasks.workunit.client.1.smithi115.stdout:1/74: chown df/f11 1 1 2024-04-16T14:35:32.459 INFO:tasks.workunit.client.1.smithi115.stdout:9/151: creat d1/d6/f2b x:0 0 0 2024-04-16T14:35:32.459 INFO:tasks.workunit.client.1.smithi115.stdout:9/152: chown d1/f2 66 1 2024-04-16T14:35:32.461 INFO:tasks.workunit.client.0.smithi005.stdout:2/178: dwrite d0/d4/f28 [0,4194304] 0 2024-04-16T14:35:32.461 INFO:tasks.workunit.client.0.smithi005.stdout:1/445: rename d2/d1c/l67 to d2/d1c/d15/la4 0 2024-04-16T14:35:32.461 INFO:tasks.workunit.client.0.smithi005.stdout:1/446: chown d2/d1c/d15/d2a/d19/d20/d27/f4c 132893 1 2024-04-16T14:35:32.461 INFO:tasks.workunit.client.0.smithi005.stdout:1/447: chown d2/d1c/d15/d2a/d19 58844 1 2024-04-16T14:35:32.462 INFO:tasks.workunit.client.1.smithi115.stdout:5/28: dread f2 [0,4194304] 0 2024-04-16T14:35:32.462 INFO:tasks.workunit.client.0.smithi005.stdout:4/488: rmdir d0 39 2024-04-16T14:35:32.464 INFO:tasks.workunit.client.0.smithi005.stdout:0/378: rename da/df/d1b/f22 to da/df/d26/d39/d55/d5c/f7d 0 2024-04-16T14:35:32.464 INFO:tasks.workunit.client.1.smithi115.stdout:8/88: chown d0/la 221601 1 2024-04-16T14:35:32.464 INFO:tasks.workunit.client.1.smithi115.stdout:8/89: chown d0/db/d10 376265776 1 2024-04-16T14:35:32.465 INFO:tasks.workunit.client.1.smithi115.stdout:8/90: write d0/db/d10/f16 [1001713,114453] 0 2024-04-16T14:35:32.465 INFO:tasks.workunit.client.0.smithi005.stdout:5/311: dwrite d0/d6/d12/d34/d42/f57 [0,4194304] 0 2024-04-16T14:35:32.466 INFO:tasks.workunit.client.0.smithi005.stdout:1/448: mkdir d2/d1c/d15/d2a/d1a/d2e/da5 0 2024-04-16T14:35:32.466 INFO:tasks.workunit.client.0.smithi005.stdout:1/449: stat d2/d1c/d15/d2a/d25/l4b 0 2024-04-16T14:35:32.467 INFO:tasks.workunit.client.1.smithi115.stdout:3/145: mknod dc/d24/d33/c35 0 2024-04-16T14:35:32.468 INFO:tasks.workunit.client.1.smithi115.stdout:0/71: symlink d6/l1a 0 2024-04-16T14:35:32.468 INFO:tasks.workunit.client.0.smithi005.stdout:4/489: mkdir d0/d99 0 2024-04-16T14:35:32.474 INFO:tasks.workunit.client.1.smithi115.stdout:9/153: link d1/f19 d1/d10/d20/f2c 0 2024-04-16T14:35:32.474 INFO:tasks.workunit.client.0.smithi005.stdout:3/358: dwrite d2/d17/d46/d47/f78 [0,4194304] 0 2024-04-16T14:35:32.475 INFO:tasks.workunit.client.0.smithi005.stdout:0/379: creat da/df/d1b/d24/f7e x:0 0 0 2024-04-16T14:35:32.476 INFO:tasks.workunit.client.1.smithi115.stdout:5/29: creat f5 x:0 0 0 2024-04-16T14:35:32.477 INFO:tasks.workunit.client.1.smithi115.stdout:4/116: fsync d1/d2/f7 0 2024-04-16T14:35:32.477 INFO:tasks.workunit.client.1.smithi115.stdout:4/117: dread - d1/f18 zero size 2024-04-16T14:35:32.477 INFO:tasks.workunit.client.1.smithi115.stdout:4/118: readlink d1/l9 0 2024-04-16T14:35:32.477 INFO:tasks.workunit.client.1.smithi115.stdout:4/119: write d1/f4 [903791,102245] 0 2024-04-16T14:35:32.477 INFO:tasks.workunit.client.1.smithi115.stdout:4/120: write d1/d2/ff [951441,49479] 0 2024-04-16T14:35:32.478 INFO:tasks.workunit.client.1.smithi115.stdout:6/89: getdents d13 0 2024-04-16T14:35:32.478 INFO:tasks.workunit.client.0.smithi005.stdout:2/179: dwrite d0/f27 [0,4194304] 0 2024-04-16T14:35:32.479 INFO:tasks.workunit.client.0.smithi005.stdout:5/312: mknod d0/d6/d12/d1c/c60 0 2024-04-16T14:35:32.480 INFO:tasks.workunit.client.1.smithi115.stdout:8/91: creat d0/f1a x:0 0 0 2024-04-16T14:35:32.480 INFO:tasks.workunit.client.1.smithi115.stdout:8/92: write d0/f1a [270978,92317] 0 2024-04-16T14:35:32.481 INFO:tasks.workunit.client.0.smithi005.stdout:4/490: creat d0/d1b/d1d/f9a x:0 0 0 2024-04-16T14:35:32.482 INFO:tasks.workunit.client.1.smithi115.stdout:5/30: symlink l6 0 2024-04-16T14:35:32.483 INFO:tasks.workunit.client.1.smithi115.stdout:0/72: read d6/fc [1795920,22397] 0 2024-04-16T14:35:32.484 INFO:tasks.workunit.client.1.smithi115.stdout:4/121: mkdir d1/d15/d1e 0 2024-04-16T14:35:32.484 INFO:tasks.workunit.client.0.smithi005.stdout:3/359: mkdir d2/d9/d7d 0 2024-04-16T14:35:32.485 INFO:tasks.workunit.client.0.smithi005.stdout:0/380: mknod da/df/d26/d39/c7f 0 2024-04-16T14:35:32.485 INFO:tasks.workunit.client.0.smithi005.stdout:0/381: chown da/c41 16977758 1 2024-04-16T14:35:32.485 INFO:tasks.workunit.client.0.smithi005.stdout:0/382: write da/df/d1b/f72 [1108997,27668] 0 2024-04-16T14:35:32.486 INFO:tasks.workunit.client.1.smithi115.stdout:6/90: truncate f9 4164294 0 2024-04-16T14:35:32.486 INFO:tasks.workunit.client.1.smithi115.stdout:6/91: fdatasync f11 0 2024-04-16T14:35:32.487 INFO:tasks.workunit.client.1.smithi115.stdout:6/92: write f11 [388569,20026] 0 2024-04-16T14:35:32.487 INFO:tasks.workunit.client.0.smithi005.stdout:4/491: truncate d0/f4c 351319 0 2024-04-16T14:35:32.487 INFO:tasks.workunit.client.0.smithi005.stdout:4/492: chown d0/d4d/l6c 7871 1 2024-04-16T14:35:32.488 INFO:tasks.workunit.client.0.smithi005.stdout:3/360: rename d2/d9/c22 to d2/d17/c7e 0 2024-04-16T14:35:32.491 INFO:tasks.workunit.client.0.smithi005.stdout:0/383: mknod da/df/d26/d39/d55/c80 0 2024-04-16T14:35:32.493 INFO:tasks.workunit.client.0.smithi005.stdout:4/493: creat d0/d99/f9b x:0 0 0 2024-04-16T14:35:32.493 INFO:tasks.workunit.client.0.smithi005.stdout:4/494: chown d0/d22/d29/d63/l66 159314038 1 2024-04-16T14:35:32.494 INFO:tasks.workunit.client.0.smithi005.stdout:2/180: read d0/d4/f28 [1455200,128279] 0 2024-04-16T14:35:32.494 INFO:tasks.workunit.client.0.smithi005.stdout:3/361: getdents d2/d17/d46/d75/d41 0 2024-04-16T14:35:32.496 INFO:tasks.workunit.client.0.smithi005.stdout:0/384: mkdir da/df/d1b/d24/d75/d81 0 2024-04-16T14:35:32.497 INFO:tasks.workunit.client.1.smithi115.stdout:5/31: link l3 l7 0 2024-04-16T14:35:32.498 INFO:tasks.workunit.client.0.smithi005.stdout:5/313: write d0/f52 [31069,82483] 0 2024-04-16T14:35:32.498 INFO:tasks.workunit.client.0.smithi005.stdout:2/181: rename d0/c1f to d0/d2a/c32 0 2024-04-16T14:35:32.498 INFO:tasks.workunit.client.0.smithi005.stdout:2/182: creat d0/d1c/f33 x:0 0 0 2024-04-16T14:35:32.499 INFO:tasks.workunit.client.0.smithi005.stdout:2/183: write d0/d1c/f33 [536679,100676] 0 2024-04-16T14:35:32.499 INFO:tasks.workunit.client.1.smithi115.stdout:6/93: mkdir d13/d1d 0 2024-04-16T14:35:32.499 INFO:tasks.workunit.client.0.smithi005.stdout:3/362: creat d2/d9/d25/d39/f7f x:0 0 0 2024-04-16T14:35:32.500 INFO:tasks.workunit.client.1.smithi115.stdout:8/93: rmdir d0/db/d10/d17 39 2024-04-16T14:35:32.500 INFO:tasks.workunit.client.1.smithi115.stdout:8/94: stat d0 0 2024-04-16T14:35:32.501 INFO:tasks.workunit.client.0.smithi005.stdout:0/385: unlink da/df/d26/d39/d55/c80 0 2024-04-16T14:35:32.501 INFO:tasks.workunit.client.0.smithi005.stdout:0/386: chown da/c13 3382 1 2024-04-16T14:35:32.501 INFO:tasks.workunit.client.0.smithi005.stdout:0/387: dread - da/df/d1b/d3a/f57 zero size 2024-04-16T14:35:32.502 INFO:tasks.workunit.client.1.smithi115.stdout:9/154: rename d1/d6/dd to d1/d6/d2d 0 2024-04-16T14:35:32.502 INFO:tasks.workunit.client.1.smithi115.stdout:0/73: dwrite d6/d10/d12/f19 [0,4194304] 0 2024-04-16T14:35:32.502 INFO:tasks.workunit.client.1.smithi115.stdout:1/75: dwrite df/f10 [4194304,4194304] 0 2024-04-16T14:35:32.504 INFO:tasks.workunit.client.1.smithi115.stdout:5/32: link l7 l8 0 2024-04-16T14:35:32.504 INFO:tasks.workunit.client.0.smithi005.stdout:1/450: dwrite d2/d1c/d15/d2a/d19/d42/d64/d66/f68 [0,4194304] 0 2024-04-16T14:35:32.504 INFO:tasks.workunit.client.0.smithi005.stdout:1/451: dread - d2/d1c/d15/d2a/d19/d42/d64/d76/f97 zero size 2024-04-16T14:35:32.505 INFO:tasks.workunit.client.0.smithi005.stdout:5/314: link d0/d6/cf d0/d6/d12/d34/d30/c61 0 2024-04-16T14:35:32.506 INFO:tasks.workunit.client.1.smithi115.stdout:4/122: getdents d1/d2 0 2024-04-16T14:35:32.507 INFO:tasks.workunit.client.1.smithi115.stdout:6/94: symlink d13/d1a/l1e 0 2024-04-16T14:35:32.508 INFO:tasks.workunit.client.0.smithi005.stdout:3/363: mknod d2/d9/d5e/c80 0 2024-04-16T14:35:32.508 INFO:tasks.workunit.client.0.smithi005.stdout:3/364: dread - d2/d17/d46/d75/d6d/f72 zero size 2024-04-16T14:35:32.509 INFO:tasks.workunit.client.0.smithi005.stdout:1/452: symlink d2/d74/d7a/la6 0 2024-04-16T14:35:32.511 INFO:tasks.workunit.client.0.smithi005.stdout:2/184: symlink d0/d4/l34 0 2024-04-16T14:35:32.512 INFO:tasks.workunit.client.1.smithi115.stdout:0/74: mkdir d6/d1b 0 2024-04-16T14:35:32.513 INFO:tasks.workunit.client.1.smithi115.stdout:0/75: creat d6/d10/d12/f1c x:0 0 0 2024-04-16T14:35:32.513 INFO:tasks.workunit.client.0.smithi005.stdout:3/365: unlink d2/d17/d46/d75/c33 0 2024-04-16T14:35:32.513 INFO:tasks.workunit.client.0.smithi005.stdout:5/315: dread d0/f2 [0,4194304] 0 2024-04-16T14:35:32.517 INFO:tasks.workunit.client.1.smithi115.stdout:1/76: rename df/d15 to df/d19 0 2024-04-16T14:35:32.517 INFO:tasks.workunit.client.1.smithi115.stdout:1/77: creat df/f1a x:0 0 0 2024-04-16T14:35:32.517 INFO:tasks.workunit.client.1.smithi115.stdout:1/78: chown f0 3 1 2024-04-16T14:35:32.517 INFO:tasks.workunit.client.0.smithi005.stdout:3/366: symlink d2/d17/l81 0 2024-04-16T14:35:32.518 INFO:tasks.workunit.client.0.smithi005.stdout:1/453: getdents d2/d1c/d15/d2a/d19 0 2024-04-16T14:35:32.519 INFO:tasks.workunit.client.1.smithi115.stdout:5/33: mknod c9 0 2024-04-16T14:35:32.519 INFO:tasks.workunit.client.1.smithi115.stdout:5/34: readlink l7 0 2024-04-16T14:35:32.520 INFO:tasks.workunit.client.0.smithi005.stdout:5/316: getdents d0/d6/d12 0 2024-04-16T14:35:32.521 INFO:tasks.workunit.client.1.smithi115.stdout:4/123: symlink d1/l1f 0 2024-04-16T14:35:32.522 INFO:tasks.workunit.client.0.smithi005.stdout:3/367: rename d2/d17/l49 to d2/d17/d46/d47/l82 0 2024-04-16T14:35:32.522 INFO:tasks.workunit.client.1.smithi115.stdout:6/95: truncate f0 3106636 0 2024-04-16T14:35:32.523 INFO:tasks.workunit.client.0.smithi005.stdout:3/368: read d2/d9/f35 [48608,108454] 0 2024-04-16T14:35:32.523 INFO:tasks.workunit.client.0.smithi005.stdout:5/317: creat d0/d6/d12/d1c/d1e/d48/f62 x:0 0 0 2024-04-16T14:35:32.523 INFO:tasks.workunit.client.1.smithi115.stdout:8/95: getdents d0 0 2024-04-16T14:35:32.524 INFO:tasks.workunit.client.0.smithi005.stdout:3/369: link d2/d9/f53 d2/d17/d46/d75/d41/d79/f83 0 2024-04-16T14:35:32.525 INFO:tasks.workunit.client.0.smithi005.stdout:5/318: mknod d0/d6/d12/d1c/d1e/d48/d5e/c63 0 2024-04-16T14:35:32.526 INFO:tasks.workunit.client.1.smithi115.stdout:0/76: link l5 d6/d10/d12/l1d 0 2024-04-16T14:35:32.526 INFO:tasks.workunit.client.1.smithi115.stdout:0/77: chown l5 35026 1 2024-04-16T14:35:32.527 INFO:tasks.workunit.client.0.smithi005.stdout:5/319: rename d0/d6/cf to d0/d6/c64 0 2024-04-16T14:35:32.530 INFO:tasks.workunit.client.1.smithi115.stdout:5/35: symlink la 0 2024-04-16T14:35:32.530 INFO:tasks.workunit.client.1.smithi115.stdout:5/36: fsync f5 0 2024-04-16T14:35:32.530 INFO:tasks.workunit.client.1.smithi115.stdout:6/96: dread fc [0,4194304] 0 2024-04-16T14:35:32.532 INFO:tasks.workunit.client.1.smithi115.stdout:6/97: dread d13/d1a/f1b [0,4194304] 0 2024-04-16T14:35:32.532 INFO:tasks.workunit.client.1.smithi115.stdout:4/124: rmdir d1/d15 39 2024-04-16T14:35:32.536 INFO:tasks.workunit.client.0.smithi005.stdout:1/454: write d2/d1c/d15/d2a/d19/d42/d64/d66/f68 [2670848,26803] 0 2024-04-16T14:35:32.536 INFO:tasks.workunit.client.0.smithi005.stdout:0/388: dwrite da/df/d1b/d24/f28 [0,4194304] 0 2024-04-16T14:35:32.537 INFO:tasks.workunit.client.1.smithi115.stdout:1/79: dread f9 [0,4194304] 0 2024-04-16T14:35:32.537 INFO:tasks.workunit.client.1.smithi115.stdout:0/78: dread d6/fc [0,4194304] 0 2024-04-16T14:35:32.538 INFO:tasks.workunit.client.0.smithi005.stdout:4/495: dwrite d0/f12 [0,4194304] 0 2024-04-16T14:35:32.538 INFO:tasks.workunit.client.0.smithi005.stdout:5/320: write d0/d6/d12/d1c/f1f [2613756,49417] 0 2024-04-16T14:35:32.539 INFO:tasks.workunit.client.0.smithi005.stdout:5/321: readlink d0/d6/d12/d34/l33 0 2024-04-16T14:35:32.540 INFO:tasks.workunit.client.0.smithi005.stdout:0/389: creat da/df/d1b/d3a/d53/d5a/d67/d79/f82 x:0 0 0 2024-04-16T14:35:32.540 INFO:tasks.workunit.client.0.smithi005.stdout:0/390: chown da/df/l42 19616 1 2024-04-16T14:35:32.542 INFO:tasks.workunit.client.0.smithi005.stdout:1/455: truncate d2/d1c/d15/d2a/d1a/d21/f30 2965944 0 2024-04-16T14:35:32.542 INFO:tasks.workunit.client.0.smithi005.stdout:1/456: fsync d2/d1c/d15/d2a/d1a/d2e/f93 0 2024-04-16T14:35:32.546 INFO:tasks.workunit.client.0.smithi005.stdout:4/496: mknod d0/d22/d85/c9c 0 2024-04-16T14:35:32.546 INFO:tasks.workunit.client.0.smithi005.stdout:4/497: readlink d0/d1b/d1d/d1f/l38 0 2024-04-16T14:35:32.546 INFO:tasks.workunit.client.1.smithi115.stdout:6/98: dread f9 [0,4194304] 0 2024-04-16T14:35:32.547 INFO:tasks.workunit.client.0.smithi005.stdout:2/185: dwrite d0/f2 [0,4194304] 0 2024-04-16T14:35:32.547 INFO:tasks.workunit.client.0.smithi005.stdout:0/391: truncate da/fe 272952 0 2024-04-16T14:35:32.548 INFO:tasks.workunit.client.0.smithi005.stdout:5/322: write d0/d6/f4f [2351627,82418] 0 2024-04-16T14:35:32.548 INFO:tasks.workunit.client.0.smithi005.stdout:1/457: symlink d2/d1c/d15/d2a/d1a/d2e/d9b/la7 0 2024-04-16T14:35:32.550 INFO:tasks.workunit.client.0.smithi005.stdout:4/498: rename d0/d1b/d1d/d1f/f20 to d0/d22/d61/f9d 0 2024-04-16T14:35:32.550 INFO:tasks.workunit.client.0.smithi005.stdout:3/370: dwrite d2/d9/df/f3c [0,4194304] 0 2024-04-16T14:35:32.550 INFO:tasks.workunit.client.0.smithi005.stdout:4/499: fsync d0/d22/d29/d63/f2f 0 2024-04-16T14:35:32.550 INFO:tasks.workunit.client.0.smithi005.stdout:4/500: write d0/d4d/f50 [4791223,36747] 0 2024-04-16T14:35:32.551 INFO:tasks.workunit.client.0.smithi005.stdout:2/186: creat d0/d2a/f35 x:0 0 0 2024-04-16T14:35:32.552 INFO:tasks.workunit.client.0.smithi005.stdout:0/392: mknod da/df/c83 0 2024-04-16T14:35:32.552 INFO:tasks.workunit.client.0.smithi005.stdout:0/393: write da/df/d1b/d3a/f3b [5263561,66757] 0 2024-04-16T14:35:32.555 INFO:tasks.workunit.client.0.smithi005.stdout:5/323: mknod d0/d6/d12/d34/d30/c65 0 2024-04-16T14:35:32.555 INFO:tasks.workunit.client.0.smithi005.stdout:5/324: fdatasync d0/d6/d12/d1c/f2a 0 2024-04-16T14:35:32.555 INFO:tasks.workunit.client.0.smithi005.stdout:5/325: dread - d0/d6/d12/f5b zero size 2024-04-16T14:35:32.561 INFO:tasks.workunit.client.0.smithi005.stdout:2/187: truncate d0/d4/d2b/f1a 3297628 0 2024-04-16T14:35:32.563 INFO:tasks.workunit.client.0.smithi005.stdout:4/501: dread d0/d1b/d1d/f21 [0,4194304] 0 2024-04-16T14:35:32.563 INFO:tasks.workunit.client.0.smithi005.stdout:7/418: sync 2024-04-16T14:35:32.564 INFO:tasks.workunit.client.0.smithi005.stdout:5/326: symlink d0/d6/d12/d34/d30/l66 0 2024-04-16T14:35:32.566 INFO:tasks.workunit.client.0.smithi005.stdout:7/419: mkdir d1/d85 0 2024-04-16T14:35:32.566 INFO:tasks.workunit.client.0.smithi005.stdout:7/420: fdatasync d1/d49/d74/d77/d22/d27/f36 0 2024-04-16T14:35:32.571 INFO:tasks.workunit.client.1.smithi115.stdout:5/37: dwrite f1 [0,4194304] 0 2024-04-16T14:35:32.571 INFO:tasks.workunit.client.1.smithi115.stdout:5/38: fsync f1 0 2024-04-16T14:35:32.571 INFO:tasks.workunit.client.1.smithi115.stdout:5/39: write f5 [645431,18837] 0 2024-04-16T14:35:32.571 INFO:tasks.workunit.client.0.smithi005.stdout:3/371: dwrite d2/fe [0,4194304] 0 2024-04-16T14:35:32.580 INFO:tasks.workunit.client.1.smithi115.stdout:8/96: truncate d0/db/d10/f16 26417 0 2024-04-16T14:35:32.586 INFO:tasks.workunit.client.0.smithi005.stdout:8/386: sync 2024-04-16T14:35:32.586 INFO:tasks.workunit.client.0.smithi005.stdout:8/387: creat d5/d55/f86 x:0 0 0 2024-04-16T14:35:32.587 INFO:tasks.workunit.client.0.smithi005.stdout:5/327: mknod d0/d6/d12/d34/d30/c67 0 2024-04-16T14:35:32.588 INFO:tasks.workunit.client.0.smithi005.stdout:5/328: readlink d0/d6/d12/d34/d30/l66 0 2024-04-16T14:35:32.592 INFO:tasks.workunit.client.0.smithi005.stdout:7/421: rename d1/d49/d74/d77/l71 to d1/d49/d74/d77/d57/d47/l86 0 2024-04-16T14:35:32.592 INFO:tasks.workunit.client.0.smithi005.stdout:7/422: fsync d1/d49/d74/d77/d22/d27/f46 0 2024-04-16T14:35:32.592 INFO:tasks.workunit.client.0.smithi005.stdout:7/423: truncate d1/d49/d74/d77/d57/d47/f79 850864 0 2024-04-16T14:35:32.593 INFO:tasks.workunit.client.0.smithi005.stdout:4/502: dwrite d0/d1b/d1d/f9a [0,4194304] 0 2024-04-16T14:35:32.593 INFO:tasks.workunit.client.0.smithi005.stdout:3/372: mkdir d2/d17/d46/d84 0 2024-04-16T14:35:32.598 INFO:tasks.workunit.client.0.smithi005.stdout:8/388: creat d5/d7b/d2f/d3d/f87 x:0 0 0 2024-04-16T14:35:32.598 INFO:tasks.workunit.client.0.smithi005.stdout:8/389: chown d5/d11/f4a 0 1 2024-04-16T14:35:32.598 INFO:tasks.workunit.client.0.smithi005.stdout:8/390: write d5/d7b/d2f/d3d/f3f [295887,58298] 0 2024-04-16T14:35:32.599 INFO:tasks.workunit.client.0.smithi005.stdout:5/329: dread d0/d6/d12/d1c/f22 [0,4194304] 0 2024-04-16T14:35:32.599 INFO:tasks.workunit.client.0.smithi005.stdout:7/424: stat d1/d49/d74/d77/c54 0 2024-04-16T14:35:32.599 INFO:tasks.workunit.client.0.smithi005.stdout:7/425: truncate d1/f6f 316380 0 2024-04-16T14:35:32.602 INFO:tasks.workunit.client.0.smithi005.stdout:4/503: symlink d0/d1b/d1d/d1f/d3e/l9e 0 2024-04-16T14:35:32.602 INFO:tasks.workunit.client.0.smithi005.stdout:2/188: fsync d0/d2a/f35 0 2024-04-16T14:35:32.603 INFO:tasks.workunit.client.0.smithi005.stdout:1/458: unlink d2/d1c/f1e 0 2024-04-16T14:35:32.604 INFO:tasks.workunit.client.0.smithi005.stdout:5/330: creat d0/d6/d12/d34/d30/f68 x:0 0 0 2024-04-16T14:35:32.605 INFO:tasks.workunit.client.0.smithi005.stdout:7/426: stat d1/d49/d74/d77/d22/c31 0 2024-04-16T14:35:32.606 INFO:tasks.workunit.client.0.smithi005.stdout:4/504: mknod d0/d22/d61/c9f 0 2024-04-16T14:35:32.607 INFO:tasks.workunit.client.0.smithi005.stdout:2/189: truncate d0/d4/f6 4024402 0 2024-04-16T14:35:32.608 INFO:tasks.workunit.client.0.smithi005.stdout:1/459: mknod d2/d1c/d15/d2a/d25/ca8 0 2024-04-16T14:35:32.608 INFO:tasks.workunit.client.1.smithi115.stdout:5/40: mknod cb 0 2024-04-16T14:35:32.608 INFO:tasks.workunit.client.1.smithi115.stdout:5/41: chown cb 248617444 1 2024-04-16T14:35:32.610 INFO:tasks.workunit.client.0.smithi005.stdout:5/331: symlink d0/d6/d12/d34/d42/l69 0 2024-04-16T14:35:32.611 INFO:tasks.workunit.client.0.smithi005.stdout:4/505: dread d0/f1a [0,4194304] 0 2024-04-16T14:35:32.611 INFO:tasks.workunit.client.0.smithi005.stdout:4/506: write d0/d1b/d1d/d4f/d75/f82 [482319,38957] 0 2024-04-16T14:35:32.612 INFO:tasks.workunit.client.1.smithi115.stdout:0/79: truncate d6/d10/d12/f19 509254 0 2024-04-16T14:35:32.613 INFO:tasks.workunit.client.1.smithi115.stdout:0/80: creat d6/f1e x:0 0 0 2024-04-16T14:35:32.613 INFO:tasks.workunit.client.1.smithi115.stdout:0/81: chown d6/f1e 1 1 2024-04-16T14:35:32.613 INFO:tasks.workunit.client.1.smithi115.stdout:0/82: stat d6/le 0 2024-04-16T14:35:32.613 INFO:tasks.workunit.client.1.smithi115.stdout:0/83: write d6/d10/d12/f1c [1046747,70408] 0 2024-04-16T14:35:32.613 INFO:tasks.workunit.client.0.smithi005.stdout:7/427: read d1/d49/d74/d77/d57/f4a [3921409,37703] 0 2024-04-16T14:35:32.614 INFO:tasks.workunit.client.0.smithi005.stdout:5/332: creat d0/f6a x:0 0 0 2024-04-16T14:35:32.615 INFO:tasks.workunit.client.0.smithi005.stdout:4/507: mkdir d0/d1b/d1d/d1f/da0 0 2024-04-16T14:35:32.618 INFO:tasks.workunit.client.0.smithi005.stdout:7/428: unlink d1/d49/d74/d77/d22/f30 0 2024-04-16T14:35:32.619 INFO:tasks.workunit.client.1.smithi115.stdout:1/80: rmdir df 39 2024-04-16T14:35:32.619 INFO:tasks.workunit.client.1.smithi115.stdout:1/81: chown fb 4 1 2024-04-16T14:35:32.622 INFO:tasks.workunit.client.0.smithi005.stdout:4/508: unlink d0/d22/d29/d63/l66 0 2024-04-16T14:35:32.622 INFO:tasks.workunit.client.0.smithi005.stdout:4/509: write d0/f58 [605112,80984] 0 2024-04-16T14:35:32.638 INFO:tasks.workunit.client.0.smithi005.stdout:4/510: dread d0/f13 [0,4194304] 0 2024-04-16T14:35:32.638 INFO:tasks.workunit.client.0.smithi005.stdout:4/511: mkdir d0/d1b/d1d/d1f/d3e/d6d/da1 0 2024-04-16T14:35:32.640 INFO:tasks.workunit.client.0.smithi005.stdout:4/512: rename d0/d1b/d1d/d1f/c41 to d0/d1b/d1d/d1f/da0/ca2 0 2024-04-16T14:35:32.641 INFO:tasks.workunit.client.0.smithi005.stdout:4/513: write d0/d1b/d1d/d4f/d75/f82 [214635,122838] 0 2024-04-16T14:35:32.643 INFO:tasks.workunit.client.0.smithi005.stdout:7/429: dwrite d1/d49/d74/d77/d22/f59 [0,4194304] 0 2024-04-16T14:35:32.643 INFO:tasks.workunit.client.0.smithi005.stdout:5/333: dwrite d0/f8 [0,4194304] 0 2024-04-16T14:35:32.648 INFO:tasks.workunit.client.0.smithi005.stdout:7/430: link d1/d82/c80 d1/d85/c87 0 2024-04-16T14:35:32.648 INFO:tasks.workunit.client.0.smithi005.stdout:7/431: write d1/d49/d74/d77/d57/f7b [60844,59372] 0 2024-04-16T14:35:32.651 INFO:tasks.workunit.client.0.smithi005.stdout:5/334: getdents d0/d6/d12/d34/d30 0 2024-04-16T14:35:32.651 INFO:tasks.workunit.client.0.smithi005.stdout:5/335: read - d0/f6a zero size 2024-04-16T14:35:32.654 INFO:tasks.workunit.client.0.smithi005.stdout:5/336: truncate d0/d6/f36 3147623 0 2024-04-16T14:35:32.661 INFO:tasks.workunit.client.0.smithi005.stdout:0/394: dwrite da/df/d1b/f72 [0,4194304] 0 2024-04-16T14:35:32.662 INFO:tasks.workunit.client.0.smithi005.stdout:0/395: creat da/df/d1b/d3a/d53/d5a/d67/d79/f84 x:0 0 0 2024-04-16T14:35:32.666 INFO:tasks.workunit.client.1.smithi115.stdout:2/49: sync 2024-04-16T14:35:32.670 INFO:tasks.workunit.client.0.smithi005.stdout:0/396: rename da/l60 to da/df/d50/l85 0 2024-04-16T14:35:32.670 INFO:tasks.workunit.client.0.smithi005.stdout:0/397: symlink da/df/l86 0 2024-04-16T14:35:32.672 INFO:tasks.workunit.client.0.smithi005.stdout:2/190: dread d0/d4/fc [0,4194304] 0 2024-04-16T14:35:32.672 INFO:tasks.workunit.client.0.smithi005.stdout:2/191: truncate d0/d4/f6 5021355 0 2024-04-16T14:35:32.672 INFO:tasks.workunit.client.0.smithi005.stdout:2/192: stat d0/d4/d2b 0 2024-04-16T14:35:32.673 INFO:tasks.workunit.client.0.smithi005.stdout:2/193: write d0/f2 [4344838,61244] 0 2024-04-16T14:35:32.674 INFO:tasks.workunit.client.1.smithi115.stdout:6/99: dread f0 [0,4194304] 0 2024-04-16T14:35:32.675 INFO:tasks.workunit.client.1.smithi115.stdout:6/100: truncate d13/f18 2014169 0 2024-04-16T14:35:32.675 INFO:tasks.workunit.client.1.smithi115.stdout:6/101: stat f6 0 2024-04-16T14:35:32.675 INFO:tasks.workunit.client.1.smithi115.stdout:6/102: fdatasync d13/f1c 0 2024-04-16T14:35:32.675 INFO:tasks.workunit.client.1.smithi115.stdout:8/97: dwrite d0/db/fd [4194304,4194304] 0 2024-04-16T14:35:32.676 INFO:tasks.workunit.client.0.smithi005.stdout:5/337: write d0/d6/d12/f3a [3622694,36240] 0 2024-04-16T14:35:32.676 INFO:tasks.workunit.client.0.smithi005.stdout:4/514: dread d0/d1b/d1d/d4f/d75/f82 [0,4194304] 0 2024-04-16T14:35:32.676 INFO:tasks.workunit.client.0.smithi005.stdout:8/391: write d5/d11/f47 [504104,86882] 0 2024-04-16T14:35:32.679 INFO:tasks.workunit.client.0.smithi005.stdout:3/373: dwrite d2/d9/d25/d39/f3b [0,4194304] 0 2024-04-16T14:35:32.680 INFO:tasks.workunit.client.0.smithi005.stdout:3/374: write d2/d17/d46/d75/f42 [646218,100382] 0 2024-04-16T14:35:32.681 INFO:tasks.workunit.client.1.smithi115.stdout:8/98: dread d0/f1a [0,4194304] 0 2024-04-16T14:35:32.682 INFO:tasks.workunit.client.0.smithi005.stdout:7/432: dwrite d1/dc/d2f/f5d [0,4194304] 0 2024-04-16T14:35:32.682 INFO:tasks.workunit.client.0.smithi005.stdout:4/515: mknod d0/d22/ca3 0 2024-04-16T14:35:32.689 INFO:tasks.workunit.client.0.smithi005.stdout:1/460: dwrite d2/d1c/d15/d2a/d19/d20/d27/f54 [0,4194304] 0 2024-04-16T14:35:32.690 INFO:tasks.workunit.client.0.smithi005.stdout:0/398: write da/f20 [2883938,121026] 0 2024-04-16T14:35:32.694 INFO:tasks.workunit.client.0.smithi005.stdout:1/461: creat d2/d1c/d15/d2a/d19/fa9 x:0 0 0 2024-04-16T14:35:32.697 INFO:tasks.workunit.client.0.smithi005.stdout:5/338: dwrite d0/d6/d12/d34/d42/f59 [0,4194304] 0 2024-04-16T14:35:32.697 INFO:tasks.workunit.client.0.smithi005.stdout:5/339: readlink d0/d6/d12/d34/l5c 0 2024-04-16T14:35:32.697 INFO:tasks.workunit.client.0.smithi005.stdout:5/340: fsync d0/d6/d12/d1c/f2a 0 2024-04-16T14:35:32.698 INFO:tasks.workunit.client.0.smithi005.stdout:1/462: rmdir d2/d1c/d15/d6f 39 2024-04-16T14:35:32.700 INFO:tasks.workunit.client.0.smithi005.stdout:5/341: mknod d0/d6/d12/d34/c6b 0 2024-04-16T14:35:32.701 INFO:tasks.workunit.client.0.smithi005.stdout:1/463: mknod d2/d1c/d15/d2a/d19/d6e/d7b/d99/caa 0 2024-04-16T14:35:32.701 INFO:tasks.workunit.client.1.smithi115.stdout:5/42: mkdir dc 0 2024-04-16T14:35:32.701 INFO:tasks.workunit.client.1.smithi115.stdout:5/43: truncate f2 4844368 0 2024-04-16T14:35:32.703 INFO:tasks.workunit.client.1.smithi115.stdout:0/84: mkdir d6/d10/d12/d1f 0 2024-04-16T14:35:32.703 INFO:tasks.workunit.client.1.smithi115.stdout:1/82: stat df/l17 0 2024-04-16T14:35:32.707 INFO:tasks.workunit.client.0.smithi005.stdout:8/392: dwrite d5/de/f36 [4194304,4194304] 0 2024-04-16T14:35:32.710 INFO:tasks.workunit.client.1.smithi115.stdout:2/50: mkdir d0/d4/de/d11 0 2024-04-16T14:35:32.711 INFO:tasks.workunit.client.1.smithi115.stdout:1/83: dread f9 [0,4194304] 0 2024-04-16T14:35:32.713 INFO:tasks.workunit.client.1.smithi115.stdout:2/51: dread d0/fb [4194304,4194304] 0 2024-04-16T14:35:32.714 INFO:tasks.workunit.client.0.smithi005.stdout:8/393: mkdir d5/d11/d6c/d7a/d88 0 2024-04-16T14:35:32.714 INFO:tasks.workunit.client.0.smithi005.stdout:8/394: write d5/d7b/f83 [990790,53889] 0 2024-04-16T14:35:32.715 INFO:tasks.workunit.client.0.smithi005.stdout:8/395: mkdir d5/d7b/d2f/d89 0 2024-04-16T14:35:32.715 INFO:tasks.workunit.client.0.smithi005.stdout:3/375: dwrite d2/d17/d46/d75/d6d/f72 [0,4194304] 0 2024-04-16T14:35:32.715 INFO:tasks.workunit.client.0.smithi005.stdout:3/376: chown d2/f21 52 1 2024-04-16T14:35:32.715 INFO:tasks.workunit.client.0.smithi005.stdout:3/377: chown d2/l5c 1 1 2024-04-16T14:35:32.718 INFO:tasks.workunit.client.0.smithi005.stdout:3/378: creat d2/d17/d46/d84/f85 x:0 0 0 2024-04-16T14:35:32.718 INFO:tasks.workunit.client.1.smithi115.stdout:6/103: symlink d13/d1d/l1f 0 2024-04-16T14:35:32.718 INFO:tasks.workunit.client.1.smithi115.stdout:6/104: stat d13/f18 0 2024-04-16T14:35:32.720 INFO:tasks.workunit.client.1.smithi115.stdout:6/105: read d13/d1a/f1b [105312,84031] 0 2024-04-16T14:35:32.722 INFO:tasks.workunit.client.1.smithi115.stdout:5/44: mkdir dc/dd 0 2024-04-16T14:35:32.725 INFO:tasks.workunit.client.1.smithi115.stdout:0/85: creat d6/d10/f20 x:0 0 0 2024-04-16T14:35:32.727 INFO:tasks.workunit.client.1.smithi115.stdout:1/84: mkdir df/d1b 0 2024-04-16T14:35:32.727 INFO:tasks.workunit.client.1.smithi115.stdout:1/85: dread - df/f12 zero size 2024-04-16T14:35:32.727 INFO:tasks.workunit.client.1.smithi115.stdout:1/86: dread - df/d13/f16 zero size 2024-04-16T14:35:32.731 INFO:tasks.workunit.client.1.smithi115.stdout:1/87: creat df/f1c x:0 0 0 2024-04-16T14:35:32.731 INFO:tasks.workunit.client.1.smithi115.stdout:1/88: chown df/d1b 998509 1 2024-04-16T14:35:32.733 INFO:tasks.workunit.client.1.smithi115.stdout:2/52: dread d0/d4/ff [0,4194304] 0 2024-04-16T14:35:32.736 INFO:tasks.workunit.client.1.smithi115.stdout:6/106: dread d13/f18 [0,4194304] 0 2024-04-16T14:35:32.736 INFO:tasks.workunit.client.1.smithi115.stdout:6/107: write f11 [1243671,14632] 0 2024-04-16T14:35:32.736 INFO:tasks.workunit.client.1.smithi115.stdout:6/108: write d13/d1a/f1b [1261699,42960] 0 2024-04-16T14:35:32.736 INFO:tasks.workunit.client.1.smithi115.stdout:6/109: chown d13/f1c 111795073 1 2024-04-16T14:35:32.738 INFO:tasks.workunit.client.0.smithi005.stdout:8/396: dread d5/de/f19 [0,4194304] 0 2024-04-16T14:35:32.741 INFO:tasks.workunit.client.0.smithi005.stdout:8/397: mkdir d5/de/d8a 0 2024-04-16T14:35:32.752 INFO:tasks.workunit.client.0.smithi005.stdout:3/379: dread d2/d9/df/f1c [0,4194304] 0 2024-04-16T14:35:32.752 INFO:tasks.workunit.client.0.smithi005.stdout:3/380: chown d2/d9/df/l26 9333009 1 2024-04-16T14:35:32.756 INFO:tasks.workunit.client.0.smithi005.stdout:7/433: dwrite d1/d49/d74/d77/d22/d27/f36 [0,4194304] 0 2024-04-16T14:35:32.756 INFO:tasks.workunit.client.1.smithi115.stdout:2/53: dread d0/fd [0,4194304] 0 2024-04-16T14:35:32.757 INFO:tasks.workunit.client.1.smithi115.stdout:5/45: dwrite f0 [4194304,4194304] 0 2024-04-16T14:35:32.757 INFO:tasks.workunit.client.0.smithi005.stdout:7/434: symlink d1/d49/d74/d77/d57/l88 0 2024-04-16T14:35:32.758 INFO:tasks.workunit.client.0.smithi005.stdout:7/435: fdatasync d1/d49/d74/d77/d57/d47/f84 0 2024-04-16T14:35:32.758 INFO:tasks.workunit.client.1.smithi115.stdout:5/46: write f5 [489348,121560] 0 2024-04-16T14:35:32.758 INFO:tasks.workunit.client.0.smithi005.stdout:7/436: mknod d1/d49/d74/c89 0 2024-04-16T14:35:32.760 INFO:tasks.workunit.client.1.smithi115.stdout:5/47: rmdir dc/dd 0 2024-04-16T14:35:32.760 INFO:tasks.workunit.client.1.smithi115.stdout:5/48: readlink l7 0 2024-04-16T14:35:32.761 INFO:tasks.workunit.client.1.smithi115.stdout:2/54: dread d0/fd [0,4194304] 0 2024-04-16T14:35:32.761 INFO:tasks.workunit.client.1.smithi115.stdout:2/55: rmdir d0/da 39 2024-04-16T14:35:32.762 INFO:tasks.workunit.client.1.smithi115.stdout:2/56: creat d0/d4/de/d11/f12 x:0 0 0 2024-04-16T14:35:32.774 INFO:tasks.workunit.client.1.smithi115.stdout:5/49: dread f0 [4194304,4194304] 0 2024-04-16T14:35:32.775 INFO:tasks.workunit.client.0.smithi005.stdout:1/464: dwrite d2/d1c/d15/d2a/d1a/d2e/d51/f6a [4194304,4194304] 0 2024-04-16T14:35:32.776 INFO:tasks.workunit.client.1.smithi115.stdout:5/50: unlink la 0 2024-04-16T14:35:32.778 INFO:tasks.workunit.client.0.smithi005.stdout:4/516: dwrite d0/f10 [4194304,4194304] 0 2024-04-16T14:35:32.778 INFO:tasks.workunit.client.0.smithi005.stdout:5/342: dwrite d0/d6/d12/d1c/d1e/f2b [0,4194304] 0 2024-04-16T14:35:32.778 INFO:tasks.workunit.client.0.smithi005.stdout:0/399: dwrite da/f20 [0,4194304] 0 2024-04-16T14:35:32.778 INFO:tasks.workunit.client.0.smithi005.stdout:1/465: unlink d2/d74/d7a/la6 0 2024-04-16T14:35:32.778 INFO:tasks.workunit.client.0.smithi005.stdout:1/466: write d2/d1c/d15/d2a/d25/f48 [959166,108086] 0 2024-04-16T14:35:32.778 INFO:tasks.workunit.client.1.smithi115.stdout:2/57: dread d0/d4/f7 [0,4194304] 0 2024-04-16T14:35:32.780 INFO:tasks.workunit.client.0.smithi005.stdout:3/381: dwrite d2/d9/d25/d39/d64/f70 [0,4194304] 0 2024-04-16T14:35:32.780 INFO:tasks.workunit.client.1.smithi115.stdout:2/58: creat d0/da/f13 x:0 0 0 2024-04-16T14:35:32.781 INFO:tasks.workunit.client.0.smithi005.stdout:4/517: unlink d0/d1b/d1d/d1f/d3e/d6d/l73 0 2024-04-16T14:35:32.782 INFO:tasks.workunit.client.1.smithi115.stdout:6/110: dwrite f6 [0,4194304] 0 2024-04-16T14:35:32.782 INFO:tasks.workunit.client.1.smithi115.stdout:6/111: chown d13/d1a/f1b 3960 1 2024-04-16T14:35:32.782 INFO:tasks.workunit.client.1.smithi115.stdout:6/112: fsync f8 0 2024-04-16T14:35:32.783 INFO:tasks.workunit.client.0.smithi005.stdout:7/437: dwrite d1/d49/d74/d77/d22/f59 [0,4194304] 0 2024-04-16T14:35:32.783 INFO:tasks.workunit.client.0.smithi005.stdout:7/438: dread - d1/dc/f7e zero size 2024-04-16T14:35:32.783 INFO:tasks.workunit.client.0.smithi005.stdout:8/398: dread d5/d11/f47 [0,4194304] 0 2024-04-16T14:35:32.783 INFO:tasks.workunit.client.1.smithi115.stdout:5/51: dread f1 [4194304,4194304] 0 2024-04-16T14:35:32.783 INFO:tasks.workunit.client.1.smithi115.stdout:5/52: chown f1 2982929 1 2024-04-16T14:35:32.784 INFO:tasks.workunit.client.1.smithi115.stdout:1/89: dwrite fb [0,4194304] 0 2024-04-16T14:35:32.784 INFO:tasks.workunit.client.1.smithi115.stdout:1/90: truncate df/f12 60062 0 2024-04-16T14:35:32.785 INFO:tasks.workunit.client.1.smithi115.stdout:0/86: dwrite d6/ff [0,4194304] 0 2024-04-16T14:35:32.785 INFO:tasks.workunit.client.0.smithi005.stdout:5/343: symlink d0/d6/d12/d34/l6c 0 2024-04-16T14:35:32.786 INFO:tasks.workunit.client.0.smithi005.stdout:0/400: creat da/df/d26/f87 x:0 0 0 2024-04-16T14:35:32.786 INFO:tasks.workunit.client.0.smithi005.stdout:0/401: truncate da/df/d26/f45 2783817 0 2024-04-16T14:35:32.788 INFO:tasks.workunit.client.0.smithi005.stdout:3/382: mknod d2/d17/d46/d75/d6d/c86 0 2024-04-16T14:35:32.788 INFO:tasks.workunit.client.1.smithi115.stdout:7/95: sync 2024-04-16T14:35:32.788 INFO:tasks.workunit.client.1.smithi115.stdout:7/96: write d0/d1/f20 [735894,30003] 0 2024-04-16T14:35:32.788 INFO:tasks.workunit.client.1.smithi115.stdout:7/97: truncate d0/fe 4556181 0 2024-04-16T14:35:32.788 INFO:tasks.workunit.client.1.smithi115.stdout:2/59: dread d0/d4/f7 [0,4194304] 0 2024-04-16T14:35:32.789 INFO:tasks.workunit.client.1.smithi115.stdout:3/146: sync 2024-04-16T14:35:32.789 INFO:tasks.workunit.client.1.smithi115.stdout:3/147: fdatasync dc/f18 0 2024-04-16T14:35:32.789 INFO:tasks.workunit.client.0.smithi005.stdout:4/518: getdents d0/d22/d85 0 2024-04-16T14:35:32.791 INFO:tasks.workunit.client.0.smithi005.stdout:1/467: write d2/d1c/d15/f63 [1822063,28667] 0 2024-04-16T14:35:32.791 INFO:tasks.workunit.client.1.smithi115.stdout:5/53: creat dc/fe x:0 0 0 2024-04-16T14:35:32.796 INFO:tasks.workunit.client.0.smithi005.stdout:4/519: dread d0/d1b/d1d/d1f/f57 [0,4194304] 0 2024-04-16T14:35:32.797 INFO:tasks.workunit.client.0.smithi005.stdout:7/439: mkdir d1/d8a 0 2024-04-16T14:35:32.798 INFO:tasks.workunit.client.1.smithi115.stdout:1/91: link fe df/f1d 0 2024-04-16T14:35:32.798 INFO:tasks.workunit.client.1.smithi115.stdout:1/92: dread - df/f1d zero size 2024-04-16T14:35:32.798 INFO:tasks.workunit.client.1.smithi115.stdout:1/93: chown df/f14 657258699 1 2024-04-16T14:35:32.798 INFO:tasks.workunit.client.1.smithi115.stdout:6/113: dread f9 [0,4194304] 0 2024-04-16T14:35:32.798 INFO:tasks.workunit.client.1.smithi115.stdout:6/114: dread - f12 zero size 2024-04-16T14:35:32.799 INFO:tasks.workunit.client.0.smithi005.stdout:8/399: truncate d5/de/f19 1175495 0 2024-04-16T14:35:32.801 INFO:tasks.workunit.client.0.smithi005.stdout:9/242: sync 2024-04-16T14:35:32.802 INFO:tasks.workunit.client.0.smithi005.stdout:9/243: dread - d3/d12/f3e zero size 2024-04-16T14:35:32.802 INFO:tasks.workunit.client.0.smithi005.stdout:9/244: read d3/f8 [945164,78193] 0 2024-04-16T14:35:32.802 INFO:tasks.workunit.client.0.smithi005.stdout:9/245: read - d3/d12/d16/f35 zero size 2024-04-16T14:35:32.803 INFO:tasks.workunit.client.0.smithi005.stdout:5/344: unlink d0/d6/d12/c24 0 2024-04-16T14:35:32.805 INFO:tasks.workunit.client.0.smithi005.stdout:0/402: unlink da/df/d1b/f7b 0 2024-04-16T14:35:32.807 INFO:tasks.workunit.client.0.smithi005.stdout:1/468: truncate d2/d1c/d15/d2a/d19/d42/d64/d66/f81 617910 0 2024-04-16T14:35:32.807 INFO:tasks.workunit.client.0.smithi005.stdout:1/469: readlink d2/d1c/d15/d2a/d19/d20/la2 0 2024-04-16T14:35:32.808 INFO:tasks.workunit.client.0.smithi005.stdout:8/400: read d5/d11/f5f [2699651,12335] 0 2024-04-16T14:35:32.809 INFO:tasks.workunit.client.0.smithi005.stdout:4/520: truncate d0/d1b/f7c 2475794 0 2024-04-16T14:35:32.809 INFO:tasks.workunit.client.0.smithi005.stdout:7/440: mknod d1/d82/c8b 0 2024-04-16T14:35:32.813 INFO:tasks.workunit.client.0.smithi005.stdout:5/345: mkdir d0/d6/d12/d34/d6d 0 2024-04-16T14:35:32.813 INFO:tasks.workunit.client.0.smithi005.stdout:5/346: stat d0/d6/d12/d1c/d1e/l55 0 2024-04-16T14:35:32.813 INFO:tasks.workunit.client.0.smithi005.stdout:5/347: stat d0/d6/d12/d1c/d1e 0 2024-04-16T14:35:32.813 INFO:tasks.workunit.client.0.smithi005.stdout:5/348: readlink d0/d6/d12/d1c/d1e/l55 0 2024-04-16T14:35:32.814 INFO:tasks.workunit.client.0.smithi005.stdout:0/403: rename da/df/d26/d39/d55/l78 to da/df/d1b/d24/d75/l88 0 2024-04-16T14:35:32.814 INFO:tasks.workunit.client.0.smithi005.stdout:0/404: fsync da/df/d1b/f72 0 2024-04-16T14:35:32.815 INFO:tasks.workunit.client.0.smithi005.stdout:0/405: fsync da/df/f1e 0 2024-04-16T14:35:32.815 INFO:tasks.workunit.client.0.smithi005.stdout:0/406: write da/df/f1d [3121735,54993] 0 2024-04-16T14:35:32.815 INFO:tasks.workunit.client.0.smithi005.stdout:4/521: mknod d0/d4d/ca4 0 2024-04-16T14:35:32.816 INFO:tasks.workunit.client.0.smithi005.stdout:4/522: write d0/d1b/d1d/d1f/d3e/f5e [202170,125584] 0 2024-04-16T14:35:32.816 INFO:tasks.workunit.client.0.smithi005.stdout:4/523: chown d0/lf 4 1 2024-04-16T14:35:32.817 INFO:tasks.workunit.client.0.smithi005.stdout:7/441: creat d1/d49/d74/d77/d22/f8c x:0 0 0 2024-04-16T14:35:32.817 INFO:tasks.workunit.client.0.smithi005.stdout:7/442: dread - d1/dc/d2f/f83 zero size 2024-04-16T14:35:32.818 INFO:tasks.workunit.client.1.smithi115.stdout:5/54: dwrite f5 [0,4194304] 0 2024-04-16T14:35:32.818 INFO:tasks.workunit.client.0.smithi005.stdout:9/246: rmdir d3/d12 39 2024-04-16T14:35:32.818 INFO:tasks.workunit.client.0.smithi005.stdout:9/247: creat d3/f41 x:0 0 0 2024-04-16T14:35:32.819 INFO:tasks.workunit.client.0.smithi005.stdout:3/383: dwrite d2/d17/f76 [0,4194304] 0 2024-04-16T14:35:32.819 INFO:tasks.workunit.client.0.smithi005.stdout:3/384: stat d2/d17/d46/c5f 0 2024-04-16T14:35:32.819 INFO:tasks.workunit.client.0.smithi005.stdout:5/349: mkdir d0/d6/d6e 0 2024-04-16T14:35:32.819 INFO:tasks.workunit.client.0.smithi005.stdout:5/350: readlink d0/d6/d12/l13 0 2024-04-16T14:35:32.820 INFO:tasks.workunit.client.1.smithi115.stdout:3/148: dwrite dc/ff [0,4194304] 0 2024-04-16T14:35:32.820 INFO:tasks.workunit.client.1.smithi115.stdout:3/149: write dc/f11 [329345,4211] 0 2024-04-16T14:35:32.820 INFO:tasks.workunit.client.1.smithi115.stdout:3/150: chown dc/d24 1 1 2024-04-16T14:35:32.821 INFO:tasks.workunit.client.1.smithi115.stdout:7/98: mknod d0/c23 0 2024-04-16T14:35:32.822 INFO:tasks.workunit.client.1.smithi115.stdout:2/60: mknod d0/d4/de/c14 0 2024-04-16T14:35:32.823 INFO:tasks.workunit.client.0.smithi005.stdout:0/407: unlink da/df/d1b/d3a/f57 0 2024-04-16T14:35:32.823 INFO:tasks.workunit.client.0.smithi005.stdout:0/408: creat da/df/d1b/f89 x:0 0 0 2024-04-16T14:35:32.824 INFO:tasks.workunit.client.0.smithi005.stdout:7/443: mkdir d1/d49/d74/d77/d57/d47/d8d 0 2024-04-16T14:35:32.824 INFO:tasks.workunit.client.1.smithi115.stdout:1/94: creat df/d1b/f1e x:0 0 0 2024-04-16T14:35:32.824 INFO:tasks.workunit.client.1.smithi115.stdout:1/95: dread - df/d13/f16 zero size 2024-04-16T14:35:32.826 INFO:tasks.workunit.client.1.smithi115.stdout:6/115: mkdir d13/d1d/d20 0 2024-04-16T14:35:32.827 INFO:tasks.workunit.client.0.smithi005.stdout:9/248: mknod d3/d12/d16/c42 0 2024-04-16T14:35:32.829 INFO:tasks.workunit.client.1.smithi115.stdout:5/55: mknod dc/cf 0 2024-04-16T14:35:32.829 INFO:tasks.workunit.client.1.smithi115.stdout:5/56: chown f1 32824918 1 2024-04-16T14:35:32.830 INFO:tasks.workunit.client.1.smithi115.stdout:3/151: mkdir dc/d24/d36 0 2024-04-16T14:35:32.833 INFO:tasks.workunit.client.0.smithi005.stdout:3/385: mknod d2/d9/d51/c87 0 2024-04-16T14:35:32.833 INFO:tasks.workunit.client.1.smithi115.stdout:2/61: symlink d0/d4/de/l15 0 2024-04-16T14:35:32.833 INFO:tasks.workunit.client.1.smithi115.stdout:2/62: chown d0/d4/de/d11/f12 236694 1 2024-04-16T14:35:32.836 INFO:tasks.workunit.client.1.smithi115.stdout:6/116: mkdir d13/d1d/d20/d21 0 2024-04-16T14:35:32.839 INFO:tasks.workunit.client.1.smithi115.stdout:5/57: mknod dc/c10 0 2024-04-16T14:35:32.840 INFO:tasks.workunit.client.0.smithi005.stdout:7/444: dwrite d1/dc/f7e [0,4194304] 0 2024-04-16T14:35:32.841 INFO:tasks.workunit.client.0.smithi005.stdout:5/351: dwrite d0/d6/f36 [0,4194304] 0 2024-04-16T14:35:32.843 INFO:tasks.workunit.client.1.smithi115.stdout:3/152: mknod dc/d29/c37 0 2024-04-16T14:35:32.844 INFO:tasks.workunit.client.0.smithi005.stdout:0/409: link da/df/d1b/d24/l52 da/df/d1b/d3a/d53/l8a 0 2024-04-16T14:35:32.844 INFO:tasks.workunit.client.0.smithi005.stdout:0/410: stat da/df/d26/d39/d55/d5c/f7d 0 2024-04-16T14:35:32.845 INFO:tasks.workunit.client.1.smithi115.stdout:2/63: creat d0/da/d10/f16 x:0 0 0 2024-04-16T14:35:32.846 INFO:tasks.workunit.client.1.smithi115.stdout:6/117: mknod d13/d1d/d20/d21/c22 0 2024-04-16T14:35:32.846 INFO:tasks.workunit.client.0.smithi005.stdout:1/470: rename d2/d1c/d15/d2a/d1a/d2e to d2/d2c/d85/dab 0 2024-04-16T14:35:32.847 INFO:tasks.workunit.client.0.smithi005.stdout:1/471: readlink d2/d1c/d15/d2a/d19/d6e/d7b/l8c 0 2024-04-16T14:35:32.847 INFO:tasks.workunit.client.0.smithi005.stdout:1/472: dread - d2/d1c/d15/d2a/d19/d42/d64/f69 zero size 2024-04-16T14:35:32.847 INFO:tasks.workunit.client.1.smithi115.stdout:3/153: symlink dc/d29/l38 0 2024-04-16T14:35:32.848 INFO:tasks.workunit.client.1.smithi115.stdout:3/154: readlink dc/l10 0 2024-04-16T14:35:32.849 INFO:tasks.workunit.client.1.smithi115.stdout:2/64: mknod d0/d4/de/d11/c17 0 2024-04-16T14:35:32.849 INFO:tasks.workunit.client.1.smithi115.stdout:2/65: readlink d0/d4/de/l15 0 2024-04-16T14:35:32.849 INFO:tasks.workunit.client.1.smithi115.stdout:2/66: fdatasync d0/fd 0 2024-04-16T14:35:32.849 INFO:tasks.workunit.client.0.smithi005.stdout:7/445: getdents d1/d49/d74/d77/d22/d27/d3a/d5c 0 2024-04-16T14:35:32.851 INFO:tasks.workunit.client.1.smithi115.stdout:3/155: unlink dc/d24/d33/c35 0 2024-04-16T14:35:32.851 INFO:tasks.workunit.client.1.smithi115.stdout:3/156: chown f4 4 1 2024-04-16T14:35:32.852 INFO:tasks.workunit.client.0.smithi005.stdout:5/352: mknod d0/d6/d12/d34/d6d/c6f 0 2024-04-16T14:35:32.853 INFO:tasks.workunit.client.0.smithi005.stdout:0/411: dread da/df/f65 [0,4194304] 0 2024-04-16T14:35:32.853 INFO:tasks.workunit.client.0.smithi005.stdout:0/412: chown da/df/d1b/d3a/d53/f61 0 1 2024-04-16T14:35:32.854 INFO:tasks.workunit.client.1.smithi115.stdout:2/67: link d0/d4/de/d11/c17 d0/d4/c18 0 2024-04-16T14:35:32.854 INFO:tasks.workunit.client.1.smithi115.stdout:2/68: creat d0/da/f19 x:0 0 0 2024-04-16T14:35:32.854 INFO:tasks.workunit.client.1.smithi115.stdout:2/69: chown d0/l1 40454 1 2024-04-16T14:35:32.854 INFO:tasks.workunit.client.1.smithi115.stdout:5/58: write f5 [2896297,99658] 0 2024-04-16T14:35:32.854 INFO:tasks.workunit.client.1.smithi115.stdout:2/70: creat d0/f1a x:0 0 0 2024-04-16T14:35:32.854 INFO:tasks.workunit.client.1.smithi115.stdout:2/71: stat d0/d4 0 2024-04-16T14:35:32.855 INFO:tasks.workunit.client.1.smithi115.stdout:2/72: fdatasync d0/da/f19 0 2024-04-16T14:35:32.855 INFO:tasks.workunit.client.1.smithi115.stdout:2/73: fdatasync d0/fb 0 2024-04-16T14:35:32.855 INFO:tasks.workunit.client.1.smithi115.stdout:5/59: write f2 [437782,101632] 0 2024-04-16T14:35:32.855 INFO:tasks.workunit.client.1.smithi115.stdout:5/60: dread - dc/fe zero size 2024-04-16T14:35:32.855 INFO:tasks.workunit.client.1.smithi115.stdout:5/61: stat f1 0 2024-04-16T14:35:32.855 INFO:tasks.workunit.client.0.smithi005.stdout:3/386: dwrite d2/d9/df/f1c [0,4194304] 0 2024-04-16T14:35:32.855 INFO:tasks.workunit.client.1.smithi115.stdout:3/157: mkdir dc/d29/d39 0 2024-04-16T14:35:32.855 INFO:tasks.workunit.client.1.smithi115.stdout:3/158: fsync dc/f18 0 2024-04-16T14:35:32.857 INFO:tasks.workunit.client.0.smithi005.stdout:0/413: symlink da/d7c/l8b 0 2024-04-16T14:35:32.861 INFO:tasks.workunit.client.1.smithi115.stdout:2/74: mkdir d0/d1b 0 2024-04-16T14:35:32.863 INFO:tasks.workunit.client.0.smithi005.stdout:5/353: read d0/d6/d12/d34/d42/f59 [3666374,69218] 0 2024-04-16T14:35:32.864 INFO:tasks.workunit.client.1.smithi115.stdout:3/159: link dc/f15 dc/f3a 0 2024-04-16T14:35:32.864 INFO:tasks.workunit.client.1.smithi115.stdout:3/160: fdatasync dc/f17 0 2024-04-16T14:35:32.865 INFO:tasks.workunit.client.0.smithi005.stdout:3/387: link d2/d17/l43 d2/d9/d25/l88 0 2024-04-16T14:35:32.865 INFO:tasks.workunit.client.1.smithi115.stdout:6/118: dwrite f6 [0,4194304] 0 2024-04-16T14:35:32.865 INFO:tasks.workunit.client.1.smithi115.stdout:6/119: write f12 [559258,39709] 0 2024-04-16T14:35:32.866 INFO:tasks.workunit.client.1.smithi115.stdout:2/75: unlink d0/l1 0 2024-04-16T14:35:32.867 INFO:tasks.workunit.client.0.smithi005.stdout:0/414: symlink da/df/d1b/d3a/d53/d5a/l8c 0 2024-04-16T14:35:32.867 INFO:tasks.workunit.client.0.smithi005.stdout:0/415: write f0 [4695438,29862] 0 2024-04-16T14:35:32.874 INFO:tasks.workunit.client.0.smithi005.stdout:7/446: dread d1/d49/d74/d77/d22/d27/f36 [0,4194304] 0 2024-04-16T14:35:32.874 INFO:tasks.workunit.client.0.smithi005.stdout:4/524: rename d0/d99 to d0/d1b/da5 0 2024-04-16T14:35:32.874 INFO:tasks.workunit.client.0.smithi005.stdout:4/525: readlink d0/d4d/l96 0 2024-04-16T14:35:32.874 INFO:tasks.workunit.client.0.smithi005.stdout:4/526: chown d0/d1b/d1d/d1f/f36 1176982 1 2024-04-16T14:35:32.874 INFO:tasks.workunit.client.1.smithi115.stdout:7/99: truncate d0/d1/f20 182583 0 2024-04-16T14:35:32.874 INFO:tasks.workunit.client.0.smithi005.stdout:7/447: dread d1/d49/d74/d77/d57/f7b [0,4194304] 0 2024-04-16T14:35:32.876 INFO:tasks.workunit.client.0.smithi005.stdout:3/388: symlink d2/d9/l89 0 2024-04-16T14:35:32.877 INFO:tasks.workunit.client.1.smithi115.stdout:6/120: rename f9 to d13/d1a/f23 0 2024-04-16T14:35:32.877 INFO:tasks.workunit.client.1.smithi115.stdout:6/121: write f11 [1622461,19620] 0 2024-04-16T14:35:32.877 INFO:tasks.workunit.client.1.smithi115.stdout:6/122: chown d13/l14 114 1 2024-04-16T14:35:32.878 INFO:tasks.workunit.client.0.smithi005.stdout:0/416: dread da/df/d26/f4c [0,4194304] 0 2024-04-16T14:35:32.880 INFO:tasks.workunit.client.1.smithi115.stdout:7/100: dread d0/d1/f1f [0,4194304] 0 2024-04-16T14:35:32.880 INFO:tasks.workunit.client.0.smithi005.stdout:7/448: mkdir d1/d49/d74/d77/d57/d47/d8e 0 2024-04-16T14:35:32.881 INFO:tasks.workunit.client.0.smithi005.stdout:3/389: mknod d2/d9/d51/c8a 0 2024-04-16T14:35:32.884 INFO:tasks.workunit.client.0.smithi005.stdout:0/417: truncate da/f30 2137723 0 2024-04-16T14:35:32.884 INFO:tasks.workunit.client.0.smithi005.stdout:0/418: readlink da/df/l42 0 2024-04-16T14:35:32.887 INFO:tasks.workunit.client.0.smithi005.stdout:1/473: rename d2/d1c/d15/d2a/d19/d6e/d7b to d2/d1c/d15/d2a/d19/d42/d71/dac 0 2024-04-16T14:35:32.889 INFO:tasks.workunit.client.0.smithi005.stdout:0/419: truncate da/df/d1b/d3a/d53/d5a/f73 2373282 0 2024-04-16T14:35:32.891 INFO:tasks.workunit.client.0.smithi005.stdout:7/449: dread d1/d49/d74/d77/d57/f3b [0,4194304] 0 2024-04-16T14:35:32.891 INFO:tasks.workunit.client.0.smithi005.stdout:7/450: fdatasync d1/f55 0 2024-04-16T14:35:32.893 INFO:tasks.workunit.client.0.smithi005.stdout:4/527: rename d0/d22/f4e to d0/d1b/d1d/d1f/d3e/d6d/d92/fa6 0 2024-04-16T14:35:32.893 INFO:tasks.workunit.client.0.smithi005.stdout:4/528: fdatasync d0/d22/d29/f2d 0 2024-04-16T14:35:32.894 INFO:tasks.workunit.client.1.smithi115.stdout:2/76: dwrite d0/f1a [0,4194304] 0 2024-04-16T14:35:32.896 INFO:tasks.workunit.client.0.smithi005.stdout:1/474: symlink d2/d1c/d15/d2a/d19/d42/d71/dac/d99/lad 0 2024-04-16T14:35:32.899 INFO:tasks.workunit.client.0.smithi005.stdout:7/451: symlink d1/d49/d74/d77/d57/d47/d8e/l8f 0 2024-04-16T14:35:32.910 INFO:tasks.workunit.client.1.smithi115.stdout:5/62: dwrite f0 [0,4194304] 0 2024-04-16T14:35:32.916 INFO:tasks.workunit.client.0.smithi005.stdout:7/452: write d1/dc/d2f/f3e [3812657,114151] 0 2024-04-16T14:35:32.916 INFO:tasks.workunit.client.0.smithi005.stdout:7/453: fsync d1/d49/d74/d77/d57/d47/f84 0 2024-04-16T14:35:32.919 INFO:tasks.workunit.client.0.smithi005.stdout:7/454: getdents d1 0 2024-04-16T14:35:32.930 INFO:tasks.workunit.client.1.smithi115.stdout:5/63: dwrite f1 [4194304,4194304] 0 2024-04-16T14:35:32.930 INFO:tasks.workunit.client.1.smithi115.stdout:6/123: dread f11 [0,4194304] 0 2024-04-16T14:35:32.930 INFO:tasks.workunit.client.1.smithi115.stdout:6/124: chown d13/d1d/d20/d21/c22 7315518 1 2024-04-16T14:35:32.930 INFO:tasks.workunit.client.1.smithi115.stdout:6/125: fsync f0 0 2024-04-16T14:35:32.930 INFO:tasks.workunit.client.1.smithi115.stdout:2/77: rmdir d0/da 39 2024-04-16T14:35:32.931 INFO:tasks.workunit.client.1.smithi115.stdout:6/126: rmdir d13 39 2024-04-16T14:35:32.932 INFO:tasks.workunit.client.1.smithi115.stdout:2/78: symlink d0/d4/de/d11/l1c 0 2024-04-16T14:35:32.933 INFO:tasks.workunit.client.0.smithi005.stdout:7/455: dread d1/d49/d74/d77/d22/d27/f44 [0,4194304] 0 2024-04-16T14:35:32.933 INFO:tasks.workunit.client.0.smithi005.stdout:7/456: write d1/d49/f5b [181724,36560] 0 2024-04-16T14:35:32.934 INFO:tasks.workunit.client.1.smithi115.stdout:6/127: creat d13/d1a/f24 x:0 0 0 2024-04-16T14:35:32.934 INFO:tasks.workunit.client.0.smithi005.stdout:5/354: dwrite d0/d6/d12/f3a [0,4194304] 0 2024-04-16T14:35:32.934 INFO:tasks.workunit.client.0.smithi005.stdout:0/420: dwrite da/df/d50/f63 [0,4194304] 0 2024-04-16T14:35:32.935 INFO:tasks.workunit.client.1.smithi115.stdout:7/101: dwrite d0/f16 [0,4194304] 0 2024-04-16T14:35:32.937 INFO:tasks.workunit.client.1.smithi115.stdout:5/64: dread f5 [0,4194304] 0 2024-04-16T14:35:32.937 INFO:tasks.workunit.client.0.smithi005.stdout:1/475: dwrite d2/d1c/d15/d2a/d1a/d21/fa3 [0,4194304] 0 2024-04-16T14:35:32.939 INFO:tasks.workunit.client.1.smithi115.stdout:2/79: dread d0/d4/ff [0,4194304] 0 2024-04-16T14:35:32.939 INFO:tasks.workunit.client.1.smithi115.stdout:2/80: readlink d0/l6 0 2024-04-16T14:35:32.940 INFO:tasks.workunit.client.0.smithi005.stdout:3/390: dwrite d2/d17/f38 [0,4194304] 0 2024-04-16T14:35:32.940 INFO:tasks.workunit.client.0.smithi005.stdout:0/421: creat da/df/d1b/d3a/d53/d5a/d67/f8d x:0 0 0 2024-04-16T14:35:32.940 INFO:tasks.workunit.client.1.smithi115.stdout:7/102: truncate d0/d1/f20 429515 0 2024-04-16T14:35:32.941 INFO:tasks.workunit.client.1.smithi115.stdout:9/155: sync 2024-04-16T14:35:32.941 INFO:tasks.workunit.client.1.smithi115.stdout:4/125: sync 2024-04-16T14:35:32.942 INFO:tasks.workunit.client.1.smithi115.stdout:4/126: write d1/d15/d17/f19 [400325,10074] 0 2024-04-16T14:35:32.942 INFO:tasks.workunit.client.1.smithi115.stdout:4/127: chown d1/d15/d1e 1 1 2024-04-16T14:35:32.942 INFO:tasks.workunit.client.1.smithi115.stdout:4/128: write d1/d15/d17/f19 [526089,3533] 0 2024-04-16T14:35:32.942 INFO:tasks.workunit.client.1.smithi115.stdout:4/129: readlink d1/l16 0 2024-04-16T14:35:32.942 INFO:tasks.workunit.client.1.smithi115.stdout:4/130: truncate d1/d2/f8 4373604 0 2024-04-16T14:35:32.942 INFO:tasks.workunit.client.1.smithi115.stdout:4/131: read d1/d15/d17/f19 [480898,624] 0 2024-04-16T14:35:32.942 INFO:tasks.workunit.client.1.smithi115.stdout:4/132: read d1/d2/f8 [2108700,4881] 0 2024-04-16T14:35:32.943 INFO:tasks.workunit.client.1.smithi115.stdout:7/103: mkdir d0/d24 0 2024-04-16T14:35:32.943 INFO:tasks.workunit.client.0.smithi005.stdout:4/529: dwrite d0/d22/d85/d90/f98 [0,4194304] 0 2024-04-16T14:35:32.943 INFO:tasks.workunit.client.0.smithi005.stdout:4/530: write d0/d1b/d1d/f67 [2219679,86980] 0 2024-04-16T14:35:32.944 INFO:tasks.workunit.client.0.smithi005.stdout:5/355: mkdir d0/d70 0 2024-04-16T14:35:32.945 INFO:tasks.workunit.client.1.smithi115.stdout:9/156: symlink d1/d10/l2e 0 2024-04-16T14:35:32.946 INFO:tasks.workunit.client.1.smithi115.stdout:4/133: creat d1/d15/f20 x:0 0 0 2024-04-16T14:35:32.946 INFO:tasks.workunit.client.1.smithi115.stdout:4/134: creat d1/d15/d17/f21 x:0 0 0 2024-04-16T14:35:32.951 INFO:tasks.workunit.client.0.smithi005.stdout:7/457: dwrite d1/d49/d74/d77/f17 [0,4194304] 0 2024-04-16T14:35:32.951 INFO:tasks.workunit.client.0.smithi005.stdout:7/458: creat d1/d49/d74/d77/d57/d47/f90 x:0 0 0 2024-04-16T14:35:32.951 INFO:tasks.workunit.client.1.smithi115.stdout:9/157: link d1/d6/l9 d1/d6/d2d/l2f 0 2024-04-16T14:35:32.951 INFO:tasks.workunit.client.1.smithi115.stdout:9/158: chown d1/d6/d2d/f1a 4611 1 2024-04-16T14:35:32.951 INFO:tasks.workunit.client.1.smithi115.stdout:9/159: truncate d1/d6/d2d/f1f 1177327 0 2024-04-16T14:35:32.954 INFO:tasks.workunit.client.0.smithi005.stdout:4/531: write d0/f13 [360552,88044] 0 2024-04-16T14:35:32.956 INFO:tasks.workunit.client.1.smithi115.stdout:2/81: write d0/f1a [2876483,36480] 0 2024-04-16T14:35:32.959 INFO:tasks.workunit.client.0.smithi005.stdout:5/356: rename d0/d6/d12/c51 to d0/d6/d6e/c71 0 2024-04-16T14:35:32.959 INFO:tasks.workunit.client.1.smithi115.stdout:2/82: symlink d0/d1b/l1d 0 2024-04-16T14:35:32.959 INFO:tasks.workunit.client.1.smithi115.stdout:2/83: creat d0/d4/de/d11/f1e x:0 0 0 2024-04-16T14:35:32.960 INFO:tasks.workunit.client.0.smithi005.stdout:1/476: dwrite d2/d1c/d15/f1d [0,4194304] 0 2024-04-16T14:35:32.960 INFO:tasks.workunit.client.0.smithi005.stdout:1/477: write d2/d1c/d15/d2a/d19/f4a [2290694,87822] 0 2024-04-16T14:35:32.960 INFO:tasks.workunit.client.1.smithi115.stdout:4/135: dread d1/d2/f11 [0,4194304] 0 2024-04-16T14:35:32.961 INFO:tasks.workunit.client.0.smithi005.stdout:0/422: write da/df/d1b/d24/f28 [2330595,65464] 0 2024-04-16T14:35:32.962 INFO:tasks.workunit.client.1.smithi115.stdout:2/84: rename d0/da to d0/d4/de/d11/d1f 0 2024-04-16T14:35:32.963 INFO:tasks.workunit.client.1.smithi115.stdout:4/136: unlink d1/d2/ca 0 2024-04-16T14:35:32.970 INFO:tasks.workunit.client.0.smithi005.stdout:3/391: rmdir d2 39 2024-04-16T14:35:32.970 INFO:tasks.workunit.client.0.smithi005.stdout:3/392: truncate d2/d9/d51/f58 155735 0 2024-04-16T14:35:32.971 INFO:tasks.workunit.client.1.smithi115.stdout:5/65: dwrite f0 [0,4194304] 0 2024-04-16T14:35:32.971 INFO:tasks.workunit.client.1.smithi115.stdout:5/66: dread - dc/fe zero size 2024-04-16T14:35:32.973 INFO:tasks.workunit.client.1.smithi115.stdout:2/85: dread d0/d4/f7 [0,4194304] 0 2024-04-16T14:35:32.973 INFO:tasks.workunit.client.1.smithi115.stdout:2/86: read - d0/d4/de/d11/d1f/f13 zero size 2024-04-16T14:35:32.973 INFO:tasks.workunit.client.1.smithi115.stdout:2/87: creat d0/d4/de/d11/f20 x:0 0 0 2024-04-16T14:35:32.974 INFO:tasks.workunit.client.0.smithi005.stdout:7/459: symlink d1/d49/l91 0 2024-04-16T14:35:32.974 INFO:tasks.workunit.client.0.smithi005.stdout:7/460: creat d1/dc/d2f/d4f/f92 x:0 0 0 2024-04-16T14:35:32.975 INFO:tasks.workunit.client.0.smithi005.stdout:1/478: dread d2/d1c/d15/d2a/d19/f4a [0,4194304] 0 2024-04-16T14:35:32.976 INFO:tasks.workunit.client.1.smithi115.stdout:5/67: dread f2 [0,4194304] 0 2024-04-16T14:35:32.976 INFO:tasks.workunit.client.1.smithi115.stdout:5/68: fsync f0 0 2024-04-16T14:35:32.977 INFO:tasks.workunit.client.1.smithi115.stdout:5/69: creat dc/f11 x:0 0 0 2024-04-16T14:35:32.977 INFO:tasks.workunit.client.1.smithi115.stdout:5/70: creat dc/f12 x:0 0 0 2024-04-16T14:35:32.977 INFO:tasks.workunit.client.1.smithi115.stdout:5/71: creat dc/f13 x:0 0 0 2024-04-16T14:35:32.977 INFO:tasks.workunit.client.1.smithi115.stdout:5/72: truncate dc/fe 299066 0 2024-04-16T14:35:32.977 INFO:tasks.workunit.client.1.smithi115.stdout:5/73: creat dc/f14 x:0 0 0 2024-04-16T14:35:32.977 INFO:tasks.workunit.client.1.smithi115.stdout:5/74: chown dc/c10 0 1 2024-04-16T14:35:32.980 INFO:tasks.workunit.client.1.smithi115.stdout:2/88: mkdir d0/d4/de/d11/d1f/d21 0 2024-04-16T14:35:32.982 INFO:tasks.workunit.client.0.smithi005.stdout:7/461: dread d1/dc/d2f/f3e [0,4194304] 0 2024-04-16T14:35:32.982 INFO:tasks.workunit.client.0.smithi005.stdout:7/462: truncate d1/d49/d74/d77/d57/d47/f84 56559 0 2024-04-16T14:35:32.984 INFO:tasks.workunit.client.0.smithi005.stdout:4/532: rename d0/d22/d85 to d0/d1b/d1d/d1f/d5d/da7 0 2024-04-16T14:35:32.985 INFO:tasks.workunit.client.1.smithi115.stdout:5/75: mkdir dc/d15 0 2024-04-16T14:35:32.987 INFO:tasks.workunit.client.1.smithi115.stdout:7/104: dwrite d0/f1a [0,4194304] 0 2024-04-16T14:35:32.988 INFO:tasks.workunit.client.0.smithi005.stdout:3/393: dread d2/d17/d46/d75/d41/d79/f83 [0,4194304] 0 2024-04-16T14:35:32.989 INFO:tasks.workunit.client.0.smithi005.stdout:7/463: symlink d1/dc/l93 0 2024-04-16T14:35:32.990 INFO:tasks.workunit.client.0.smithi005.stdout:7/464: chown d1/f6f 19468875 1 2024-04-16T14:35:32.990 INFO:tasks.workunit.client.0.smithi005.stdout:0/423: mkdir da/df/d26/d8e 0 2024-04-16T14:35:32.990 INFO:tasks.workunit.client.0.smithi005.stdout:0/424: fdatasync da/df/d1b/d3a/d53/d5a/d67/d79/f84 0 2024-04-16T14:35:32.992 INFO:tasks.workunit.client.1.smithi115.stdout:7/105: rename d0/d1/l10 to d0/l25 0 2024-04-16T14:35:32.993 INFO:tasks.workunit.client.0.smithi005.stdout:3/394: creat d2/d17/f8b x:0 0 0 2024-04-16T14:35:32.994 INFO:tasks.workunit.client.1.smithi115.stdout:7/106: link d0/d2/f11 d0/f26 0 2024-04-16T14:35:32.994 INFO:tasks.workunit.client.1.smithi115.stdout:7/107: chown d0/d1/f20 11 1 2024-04-16T14:35:32.994 INFO:tasks.workunit.client.1.smithi115.stdout:7/108: chown d0/d2/l14 9 1 2024-04-16T14:35:32.995 INFO:tasks.workunit.client.1.smithi115.stdout:7/109: write d0/d2/f11 [1577211,90225] 0 2024-04-16T14:35:32.995 INFO:tasks.workunit.client.1.smithi115.stdout:7/110: readlink d0/d1/l1b 0 2024-04-16T14:35:32.995 INFO:tasks.workunit.client.1.smithi115.stdout:7/111: stat d0/f26 0 2024-04-16T14:35:32.996 INFO:tasks.workunit.client.1.smithi115.stdout:7/112: symlink d0/d24/l27 0 2024-04-16T14:35:32.996 INFO:tasks.workunit.client.1.smithi115.stdout:7/113: chown d0/ca 20183581 1 2024-04-16T14:35:32.999 INFO:tasks.workunit.client.0.smithi005.stdout:1/479: dread d2/d1c/d15/d2a/f16 [0,4194304] 0 2024-04-16T14:35:32.999 INFO:tasks.workunit.client.0.smithi005.stdout:5/357: dwrite d0/d6/d12/d1c/d1e/d48/d5e/f5d [0,4194304] 0 2024-04-16T14:35:33.006 INFO:tasks.workunit.client.0.smithi005.stdout:5/358: unlink d0/d6/d12/d1c/f20 0 2024-04-16T14:35:33.009 INFO:tasks.workunit.client.1.smithi115.stdout:4/137: dwrite d1/d2/f11 [0,4194304] 0 2024-04-16T14:35:33.010 INFO:tasks.workunit.client.1.smithi115.stdout:8/99: sync 2024-04-16T14:35:33.010 INFO:tasks.workunit.client.1.smithi115.stdout:8/100: dread - d0/db/d10/d17/f18 zero size 2024-04-16T14:35:33.013 INFO:tasks.workunit.client.1.smithi115.stdout:4/138: link d1/d2/f8 d1/f22 0 2024-04-16T14:35:33.014 INFO:tasks.workunit.client.1.smithi115.stdout:4/139: chown d1/d2/f7 3088 1 2024-04-16T14:35:33.014 INFO:tasks.workunit.client.1.smithi115.stdout:4/140: write d1/d15/f20 [284196,115071] 0 2024-04-16T14:35:33.014 INFO:tasks.workunit.client.0.smithi005.stdout:1/480: truncate d2/d1c/d15/d2a/d19/d20/d27/f54 3298135 0 2024-04-16T14:35:33.016 INFO:tasks.workunit.client.1.smithi115.stdout:9/160: dwrite d1/d10/d20/f2c [0,4194304] 0 2024-04-16T14:35:33.016 INFO:tasks.workunit.client.1.smithi115.stdout:9/161: fsync d1/d10/d20/f22 0 2024-04-16T14:35:33.016 INFO:tasks.workunit.client.1.smithi115.stdout:9/162: truncate d1/d6/f2b 623892 0 2024-04-16T14:35:33.016 INFO:tasks.workunit.client.1.smithi115.stdout:7/114: getdents d0 0 2024-04-16T14:35:33.016 INFO:tasks.workunit.client.1.smithi115.stdout:7/115: stat d0/d24/l27 0 2024-04-16T14:35:33.016 INFO:tasks.workunit.client.1.smithi115.stdout:7/116: write d0/d1/f20 [818572,63272] 0 2024-04-16T14:35:33.018 INFO:tasks.workunit.client.0.smithi005.stdout:1/481: symlink d2/d1c/d15/d2a/d19/lae 0 2024-04-16T14:35:33.018 INFO:tasks.workunit.client.0.smithi005.stdout:1/482: write d2/d1c/d15/d6f/f8d [1475595,14127] 0 2024-04-16T14:35:33.018 INFO:tasks.workunit.client.1.smithi115.stdout:9/163: read d1/d6/d2d/f1f [498326,101552] 0 2024-04-16T14:35:33.019 INFO:tasks.workunit.client.1.smithi115.stdout:9/164: fdatasync d1/d6/d2d/f1f 0 2024-04-16T14:35:33.022 INFO:tasks.workunit.client.0.smithi005.stdout:1/483: rename d2/d1c/d15/f4d to d2/d1c/d15/d2a/d19/d42/d64/d76/faf 0 2024-04-16T14:35:33.026 INFO:tasks.workunit.client.1.smithi115.stdout:2/89: dwrite d0/d4/de/d11/f12 [0,4194304] 0 2024-04-16T14:35:33.027 INFO:tasks.workunit.client.1.smithi115.stdout:7/117: dread d0/fe [0,4194304] 0 2024-04-16T14:35:33.027 INFO:tasks.workunit.client.1.smithi115.stdout:7/118: fdatasync d0/fe 0 2024-04-16T14:35:33.029 INFO:tasks.workunit.client.1.smithi115.stdout:2/90: mkdir d0/d4/d22 0 2024-04-16T14:35:33.029 INFO:tasks.workunit.client.1.smithi115.stdout:2/91: read - d0/d4/de/d11/d1f/f13 zero size 2024-04-16T14:35:33.029 INFO:tasks.workunit.client.1.smithi115.stdout:2/92: chown d0/d4/de/d11/d1f 247271 1 2024-04-16T14:35:33.031 INFO:tasks.workunit.client.1.smithi115.stdout:7/119: unlink d0/f16 0 2024-04-16T14:35:33.032 INFO:tasks.workunit.client.0.smithi005.stdout:7/465: dwrite d1/f6f [0,4194304] 0 2024-04-16T14:35:33.033 INFO:tasks.workunit.client.1.smithi115.stdout:9/165: read d1/f2 [568485,8109] 0 2024-04-16T14:35:33.033 INFO:tasks.workunit.client.1.smithi115.stdout:2/93: mkdir d0/d4/de/d11/d1f/d23 0 2024-04-16T14:35:33.033 INFO:tasks.workunit.client.1.smithi115.stdout:2/94: stat d0/d4/de/d11/f20 0 2024-04-16T14:35:33.033 INFO:tasks.workunit.client.0.smithi005.stdout:4/533: dwrite d0/d1b/d1d/d1f/d3e/f55 [0,4194304] 0 2024-04-16T14:35:33.034 INFO:tasks.workunit.client.1.smithi115.stdout:7/120: mknod d0/d1/c28 0 2024-04-16T14:35:33.034 INFO:tasks.workunit.client.1.smithi115.stdout:7/121: chown d0/d1/f1f 41 1 2024-04-16T14:35:33.034 INFO:tasks.workunit.client.0.smithi005.stdout:3/395: dwrite d2/d17/f54 [0,4194304] 0 2024-04-16T14:35:33.034 INFO:tasks.workunit.client.0.smithi005.stdout:0/425: dwrite da/df/d50/f63 [4194304,4194304] 0 2024-04-16T14:35:33.036 INFO:tasks.workunit.client.0.smithi005.stdout:5/359: dwrite d0/d6/d12/f45 [4194304,4194304] 0 2024-04-16T14:35:33.037 INFO:tasks.workunit.client.1.smithi115.stdout:5/76: dwrite f0 [4194304,4194304] 0 2024-04-16T14:35:33.037 INFO:tasks.workunit.client.1.smithi115.stdout:5/77: write dc/f12 [364179,121922] 0 2024-04-16T14:35:33.037 INFO:tasks.workunit.client.1.smithi115.stdout:5/78: truncate dc/f11 848567 0 2024-04-16T14:35:33.037 INFO:tasks.workunit.client.1.smithi115.stdout:5/79: truncate f2 5840328 0 2024-04-16T14:35:33.039 INFO:tasks.workunit.client.1.smithi115.stdout:7/122: creat d0/f29 x:0 0 0 2024-04-16T14:35:33.041 INFO:tasks.workunit.client.1.smithi115.stdout:5/80: symlink dc/l16 0 2024-04-16T14:35:33.043 INFO:tasks.workunit.client.1.smithi115.stdout:7/123: symlink d0/l2a 0 2024-04-16T14:35:33.044 INFO:tasks.workunit.client.0.smithi005.stdout:3/396: truncate d2/d17/d46/d75/d41/d79/f83 2202117 0 2024-04-16T14:35:33.045 INFO:tasks.workunit.client.0.smithi005.stdout:3/397: fsync d2/d9/f35 0 2024-04-16T14:35:33.047 INFO:tasks.workunit.client.1.smithi115.stdout:5/81: link f1 dc/d15/f17 0 2024-04-16T14:35:33.050 INFO:tasks.workunit.client.1.smithi115.stdout:9/166: dread d1/d6/f17 [0,4194304] 0 2024-04-16T14:35:33.050 INFO:tasks.workunit.client.1.smithi115.stdout:9/167: fdatasync d1/d6/d2d/f1a 0 2024-04-16T14:35:33.051 INFO:tasks.workunit.client.1.smithi115.stdout:9/168: mknod d1/d10/c30 0 2024-04-16T14:35:33.053 INFO:tasks.workunit.client.0.smithi005.stdout:1/484: dwrite d2/d1c/d15/d2a/d19/d42/d64/f7e [4194304,4194304] 0 2024-04-16T14:35:33.054 INFO:tasks.workunit.client.0.smithi005.stdout:4/534: read d0/d1b/d1d/f21 [843264,121433] 0 2024-04-16T14:35:33.054 INFO:tasks.workunit.client.0.smithi005.stdout:4/535: chown d0/d1b/d1d/d1f/da0/ca2 971 1 2024-04-16T14:35:33.054 INFO:tasks.workunit.client.0.smithi005.stdout:4/536: fsync d0/d1b/d1d/f21 0 2024-04-16T14:35:33.054 INFO:tasks.workunit.client.0.smithi005.stdout:4/537: chown d0/d1b/da5 4035759 1 2024-04-16T14:35:33.054 INFO:tasks.workunit.client.0.smithi005.stdout:4/538: chown d0/d4d/l96 0 1 2024-04-16T14:35:33.056 INFO:tasks.workunit.client.1.smithi115.stdout:0/87: sync 2024-04-16T14:35:33.056 INFO:tasks.workunit.client.1.smithi115.stdout:0/88: dread - d6/d10/f20 zero size 2024-04-16T14:35:33.057 INFO:tasks.workunit.client.1.smithi115.stdout:0/89: creat d6/d1b/f21 x:0 0 0 2024-04-16T14:35:33.104 INFO:tasks.workunit.client.1.smithi115.stdout:7/124: read d0/d1/f1f [895677,28599] 0 2024-04-16T14:35:33.104 INFO:tasks.workunit.client.1.smithi115.stdout:7/125: fsync d0/fe 0 2024-04-16T14:35:33.104 INFO:tasks.workunit.client.1.smithi115.stdout:7/126: chown d0/d2/f11 9293 1 2024-04-16T14:35:33.105 INFO:tasks.workunit.client.1.smithi115.stdout:7/127: mkdir d0/d24/d2b 0 2024-04-16T14:35:33.105 INFO:tasks.workunit.client.1.smithi115.stdout:2/95: dwrite d0/d4/de/d11/f20 [0,4194304] 0 2024-04-16T14:35:33.105 INFO:tasks.workunit.client.1.smithi115.stdout:2/96: read - d0/d4/de/d11/d1f/f19 zero size 2024-04-16T14:35:33.107 INFO:tasks.workunit.client.0.smithi005.stdout:0/426: rename da/df/d26/f4a to da/df/d1b/d3a/d53/f8f 0 2024-04-16T14:35:33.107 INFO:tasks.workunit.client.1.smithi115.stdout:2/97: rename d0/d4/de/d11/d1f to d0/d4/d24 0 2024-04-16T14:35:33.110 INFO:tasks.workunit.client.1.smithi115.stdout:2/98: mkdir d0/d4/de/d11/d25 0 2024-04-16T14:35:33.110 INFO:tasks.workunit.client.1.smithi115.stdout:2/99: fdatasync d0/fb 0 2024-04-16T14:35:33.110 INFO:tasks.workunit.client.1.smithi115.stdout:2/100: chown d0/d4/d22 1096 1 2024-04-16T14:35:33.113 INFO:tasks.workunit.client.1.smithi115.stdout:0/90: dread d6/fb [0,4194304] 0 2024-04-16T14:35:33.113 INFO:tasks.workunit.client.1.smithi115.stdout:0/91: readlink d6/l8 0 2024-04-16T14:35:33.113 INFO:tasks.workunit.client.1.smithi115.stdout:0/92: chown d6/d10/d12 386652026 1 2024-04-16T14:35:33.113 INFO:tasks.workunit.client.1.smithi115.stdout:0/93: readlink d6/d10/d12/l1d 0 2024-04-16T14:35:33.113 INFO:tasks.workunit.client.1.smithi115.stdout:0/94: creat d6/d10/f22 x:0 0 0 2024-04-16T14:35:33.114 INFO:tasks.workunit.client.0.smithi005.stdout:0/427: dread f1 [0,4194304] 0 2024-04-16T14:35:33.115 INFO:tasks.workunit.client.1.smithi115.stdout:0/95: mknod d6/c23 0 2024-04-16T14:35:33.115 INFO:tasks.workunit.client.1.smithi115.stdout:0/96: truncate d6/d1b/f21 321470 0 2024-04-16T14:35:33.115 INFO:tasks.workunit.client.1.smithi115.stdout:0/97: mkdir d6/d10/d12/d1f/d24 0 2024-04-16T14:35:33.117 INFO:tasks.workunit.client.0.smithi005.stdout:5/360: dwrite d0/f26 [0,4194304] 0 2024-04-16T14:35:33.117 INFO:tasks.workunit.client.1.smithi115.stdout:9/169: dwrite d1/d6/d2d/f1c [0,4194304] 0 2024-04-16T14:35:33.117 INFO:tasks.workunit.client.1.smithi115.stdout:0/98: write d6/d10/d12/f1c [290474,107445] 0 2024-04-16T14:35:33.118 INFO:tasks.workunit.client.1.smithi115.stdout:5/82: dread f0 [4194304,4194304] 0 2024-04-16T14:35:33.120 INFO:tasks.workunit.client.1.smithi115.stdout:9/170: creat d1/d6/d2d/f31 x:0 0 0 2024-04-16T14:35:33.122 INFO:tasks.workunit.client.1.smithi115.stdout:5/83: creat dc/d15/f18 x:0 0 0 2024-04-16T14:35:33.122 INFO:tasks.workunit.client.0.smithi005.stdout:1/485: symlink d2/d2c/d85/dab/lb0 0 2024-04-16T14:35:33.124 INFO:tasks.workunit.client.0.smithi005.stdout:4/539: creat d0/d1b/d1d/d1f/d5d/fa8 x:0 0 0 2024-04-16T14:35:33.126 INFO:tasks.workunit.client.1.smithi115.stdout:2/101: write d0/d4/de/d11/f12 [1201907,71608] 0 2024-04-16T14:35:33.127 INFO:tasks.workunit.client.1.smithi115.stdout:2/102: mknod d0/d1b/c26 0 2024-04-16T14:35:33.128 INFO:tasks.workunit.client.1.smithi115.stdout:2/103: mknod d0/d4/de/d11/d25/c27 0 2024-04-16T14:35:33.129 INFO:tasks.workunit.client.0.smithi005.stdout:3/398: rename d2/f66 to d2/d6b/d7a/f8c 0 2024-04-16T14:35:33.129 INFO:tasks.workunit.client.0.smithi005.stdout:3/399: write d2/d9/d51/f58 [590258,123887] 0 2024-04-16T14:35:33.130 INFO:tasks.workunit.client.1.smithi115.stdout:7/128: dwrite d0/d1/f1f [0,4194304] 0 2024-04-16T14:35:33.132 INFO:tasks.workunit.client.1.smithi115.stdout:7/129: mkdir d0/d24/d2b/d2c 0 2024-04-16T14:35:33.132 INFO:tasks.workunit.client.1.smithi115.stdout:7/130: stat d0/l2a 0 2024-04-16T14:35:33.133 INFO:tasks.workunit.client.1.smithi115.stdout:7/131: unlink d0/ca 0 2024-04-16T14:35:33.135 INFO:tasks.workunit.client.0.smithi005.stdout:5/361: rmdir d0/d6/d6e 39 2024-04-16T14:35:33.135 INFO:tasks.workunit.client.1.smithi115.stdout:7/132: link d0/c23 d0/d24/d2b/c2d 0 2024-04-16T14:35:33.137 INFO:tasks.workunit.client.1.smithi115.stdout:7/133: symlink d0/d24/l2e 0 2024-04-16T14:35:33.138 INFO:tasks.workunit.client.0.smithi005.stdout:1/486: mknod d2/d1c/d15/da0/cb1 0 2024-04-16T14:35:33.138 INFO:tasks.workunit.client.1.smithi115.stdout:7/134: unlink d0/f29 0 2024-04-16T14:35:33.138 INFO:tasks.workunit.client.1.smithi115.stdout:7/135: chown d0/d2/cd 3 1 2024-04-16T14:35:33.140 INFO:tasks.workunit.client.0.smithi005.stdout:5/362: creat d0/d6/d12/d34/d6d/f72 x:0 0 0 2024-04-16T14:35:33.141 INFO:tasks.workunit.client.0.smithi005.stdout:0/428: dwrite da/df/d1b/f72 [0,4194304] 0 2024-04-16T14:35:33.142 INFO:tasks.workunit.client.0.smithi005.stdout:3/400: write d2/d9/d25/d39/f3b [3501164,46238] 0 2024-04-16T14:35:33.142 INFO:tasks.workunit.client.0.smithi005.stdout:3/401: chown d2/d9/df/l2a 2160 1 2024-04-16T14:35:33.142 INFO:tasks.workunit.client.1.smithi115.stdout:9/171: write d1/f19 [3294198,108120] 0 2024-04-16T14:35:33.142 INFO:tasks.workunit.client.1.smithi115.stdout:0/99: dwrite d6/fb [0,4194304] 0 2024-04-16T14:35:33.143 INFO:tasks.workunit.client.1.smithi115.stdout:9/172: readlink d1/d6/l1d 0 2024-04-16T14:35:33.143 INFO:tasks.workunit.client.1.smithi115.stdout:0/100: creat d6/f25 x:0 0 0 2024-04-16T14:35:33.143 INFO:tasks.workunit.client.0.smithi005.stdout:6/468: sync 2024-04-16T14:35:33.143 INFO:tasks.workunit.client.0.smithi005.stdout:2/194: sync 2024-04-16T14:35:33.144 INFO:tasks.workunit.client.0.smithi005.stdout:9/249: sync 2024-04-16T14:35:33.144 INFO:tasks.workunit.client.0.smithi005.stdout:8/401: sync 2024-04-16T14:35:33.144 INFO:tasks.workunit.client.0.smithi005.stdout:8/402: write d5/d7b/d2f/d3d/d7f/f81 [470067,105754] 0 2024-04-16T14:35:33.145 INFO:tasks.workunit.client.0.smithi005.stdout:3/402: truncate d2/d9/f55 2175165 0 2024-04-16T14:35:33.145 INFO:tasks.workunit.client.0.smithi005.stdout:3/403: chown d2/d17/l43 7 1 2024-04-16T14:35:33.145 INFO:tasks.workunit.client.1.smithi115.stdout:7/136: dread d0/f26 [0,4194304] 0 2024-04-16T14:35:33.145 INFO:tasks.workunit.client.1.smithi115.stdout:0/101: mknod d6/d10/d12/d1f/c26 0 2024-04-16T14:35:33.145 INFO:tasks.workunit.client.0.smithi005.stdout:1/487: getdents d2/d1c/d15/d2a/d1a 0 2024-04-16T14:35:33.147 INFO:tasks.workunit.client.1.smithi115.stdout:2/104: dread d0/d4/de/d11/f20 [0,4194304] 0 2024-04-16T14:35:33.148 INFO:tasks.workunit.client.0.smithi005.stdout:4/540: rename d0/d22/d29/d63 to d0/d1b/d1d/d1f/d5d/da9 0 2024-04-16T14:35:33.149 INFO:tasks.workunit.client.0.smithi005.stdout:2/195: mknod d0/d2a/c36 0 2024-04-16T14:35:33.151 INFO:tasks.workunit.client.1.smithi115.stdout:7/137: creat d0/d1/f2f x:0 0 0 2024-04-16T14:35:33.151 INFO:tasks.workunit.client.1.smithi115.stdout:2/105: getdents d0/d4/d24 0 2024-04-16T14:35:33.151 INFO:tasks.workunit.client.0.smithi005.stdout:9/250: symlink d3/l43 0 2024-04-16T14:35:33.151 INFO:tasks.workunit.client.0.smithi005.stdout:9/251: chown d3/d12/f28 547853 1 2024-04-16T14:35:33.154 INFO:tasks.workunit.client.0.smithi005.stdout:6/469: symlink d2/df/la0 0 2024-04-16T14:35:33.154 INFO:tasks.workunit.client.0.smithi005.stdout:6/470: write d2/d5/d10/f60 [1552829,107153] 0 2024-04-16T14:35:33.154 INFO:tasks.workunit.client.0.smithi005.stdout:5/363: write d0/d6/f36 [2110178,127377] 0 2024-04-16T14:35:33.155 INFO:tasks.workunit.client.1.smithi115.stdout:7/138: mkdir d0/d24/d2b/d2c/d30 0 2024-04-16T14:35:33.155 INFO:tasks.workunit.client.1.smithi115.stdout:7/139: fsync d0/f26 0 2024-04-16T14:35:33.156 INFO:tasks.workunit.client.0.smithi005.stdout:8/403: mknod d5/de/d8a/c8b 0 2024-04-16T14:35:33.156 INFO:tasks.workunit.client.0.smithi005.stdout:8/404: truncate d5/d7b/f83 1430836 0 2024-04-16T14:35:33.156 INFO:tasks.workunit.client.1.smithi115.stdout:0/102: dread f0 [4194304,4194304] 0 2024-04-16T14:35:33.156 INFO:tasks.workunit.client.1.smithi115.stdout:2/106: rmdir d0/d4/de 39 2024-04-16T14:35:33.156 INFO:tasks.workunit.client.1.smithi115.stdout:2/107: truncate d0/d4/de/d11/f12 4720255 0 2024-04-16T14:35:33.157 INFO:tasks.workunit.client.0.smithi005.stdout:3/404: symlink d2/d17/d46/d47/l8d 0 2024-04-16T14:35:33.158 INFO:tasks.workunit.client.1.smithi115.stdout:7/140: rename d0/d24/l27 to d0/d24/d2b/d2c/l31 0 2024-04-16T14:35:33.158 INFO:tasks.workunit.client.1.smithi115.stdout:0/103: symlink d6/d10/d12/d1f/d24/l27 0 2024-04-16T14:35:33.159 INFO:tasks.workunit.client.0.smithi005.stdout:1/488: truncate d2/d1c/d15/d2a/d19/d20/d27/f4c 4014450 0 2024-04-16T14:35:33.159 INFO:tasks.workunit.client.1.smithi115.stdout:2/108: truncate d0/d4/f7 2235106 0 2024-04-16T14:35:33.160 INFO:tasks.workunit.client.0.smithi005.stdout:4/541: truncate d0/d22/d29/f7f 3763892 0 2024-04-16T14:35:33.160 INFO:tasks.workunit.client.0.smithi005.stdout:4/542: dread - d0/d1b/d1d/d1f/d48/f8b zero size 2024-04-16T14:35:33.160 INFO:tasks.workunit.client.1.smithi115.stdout:0/104: mkdir d6/d10/d12/d1f/d24/d28 0 2024-04-16T14:35:33.160 INFO:tasks.workunit.client.1.smithi115.stdout:7/141: dread d0/d1/f20 [0,4194304] 0 2024-04-16T14:35:33.161 INFO:tasks.workunit.client.0.smithi005.stdout:2/196: rename d0/d4/l34 to d0/d1c/l37 0 2024-04-16T14:35:33.161 INFO:tasks.workunit.client.1.smithi115.stdout:2/109: mknod d0/c28 0 2024-04-16T14:35:33.161 INFO:tasks.workunit.client.1.smithi115.stdout:2/110: readlink d0/d4/de/d11/l1c 0 2024-04-16T14:35:33.162 INFO:tasks.workunit.client.0.smithi005.stdout:6/471: creat d2/d5/d10/d4d/d51/fa1 x:0 0 0 2024-04-16T14:35:33.163 INFO:tasks.workunit.client.0.smithi005.stdout:5/364: mkdir d0/d6/d12/d1c/d1e/d73 0 2024-04-16T14:35:33.163 INFO:tasks.workunit.client.1.smithi115.stdout:7/142: rename d0/d1/f2f to d0/d24/d2b/d2c/d30/f32 0 2024-04-16T14:35:33.165 INFO:tasks.workunit.client.0.smithi005.stdout:8/405: symlink d5/de/d8a/l8c 0 2024-04-16T14:35:33.165 INFO:tasks.workunit.client.1.smithi115.stdout:2/111: rename d0/d1b/l1d to d0/l29 0 2024-04-16T14:35:33.165 INFO:tasks.workunit.client.1.smithi115.stdout:2/112: fsync d0/d4/de/d11/f1e 0 2024-04-16T14:35:33.165 INFO:tasks.workunit.client.1.smithi115.stdout:2/113: stat d0/d4/d24/d10 0 2024-04-16T14:35:33.166 INFO:tasks.workunit.client.0.smithi005.stdout:3/405: truncate d2/d17/d46/d75/d41/d79/f83 2142696 0 2024-04-16T14:35:33.166 INFO:tasks.workunit.client.0.smithi005.stdout:3/406: truncate d2/d17/f8b 422861 0 2024-04-16T14:35:33.166 INFO:tasks.workunit.client.1.smithi115.stdout:7/143: creat d0/d24/d2b/d2c/f33 x:0 0 0 2024-04-16T14:35:33.167 INFO:tasks.workunit.client.0.smithi005.stdout:3/407: write d2/d17/d46/d47/f62 [777326,123300] 0 2024-04-16T14:35:33.167 INFO:tasks.workunit.client.0.smithi005.stdout:3/408: readlink d2/d17/d46/l52 0 2024-04-16T14:35:33.167 INFO:tasks.workunit.client.0.smithi005.stdout:1/489: link d2/d1c/f6b d2/d1c/d15/d2a/d19/d42/d64/d66/fb2 0 2024-04-16T14:35:33.168 INFO:tasks.workunit.client.0.smithi005.stdout:2/197: dread d0/d4/d2b/f1a [0,4194304] 0 2024-04-16T14:35:33.168 INFO:tasks.workunit.client.0.smithi005.stdout:2/198: fdatasync d0/d4/d2b/f1a 0 2024-04-16T14:35:33.168 INFO:tasks.workunit.client.0.smithi005.stdout:4/543: mkdir d0/d1b/d1d/d1f/d3e/daa 0 2024-04-16T14:35:33.170 INFO:tasks.workunit.client.1.smithi115.stdout:7/144: dread d0/fe [0,4194304] 0 2024-04-16T14:35:33.171 INFO:tasks.workunit.client.0.smithi005.stdout:8/406: rename d5/d11/d6c/d7a to d5/d7b/d2f/d3d/d7f/d8d 0 2024-04-16T14:35:33.173 INFO:tasks.workunit.client.1.smithi115.stdout:9/173: dwrite d1/f3 [0,4194304] 0 2024-04-16T14:35:33.175 INFO:tasks.workunit.client.1.smithi115.stdout:9/174: creat d1/d6/d29/f32 x:0 0 0 2024-04-16T14:35:33.175 INFO:tasks.workunit.client.0.smithi005.stdout:3/409: mknod d2/d9/df/c8e 0 2024-04-16T14:35:33.176 INFO:tasks.workunit.client.0.smithi005.stdout:3/410: fdatasync d2/d17/f76 0 2024-04-16T14:35:33.176 INFO:tasks.workunit.client.0.smithi005.stdout:3/411: chown d2/d17/d46/d75/f60 37 1 2024-04-16T14:35:33.176 INFO:tasks.workunit.client.1.smithi115.stdout:5/84: dwrite f2 [4194304,4194304] 0 2024-04-16T14:35:33.176 INFO:tasks.workunit.client.1.smithi115.stdout:5/85: chown l6 17 1 2024-04-16T14:35:33.177 INFO:tasks.workunit.client.1.smithi115.stdout:5/86: creat dc/d15/f19 x:0 0 0 2024-04-16T14:35:33.177 INFO:tasks.workunit.client.1.smithi115.stdout:9/175: mkdir d1/d6/d33 0 2024-04-16T14:35:33.177 INFO:tasks.workunit.client.1.smithi115.stdout:9/176: write d1/d10/f26 [410158,14182] 0 2024-04-16T14:35:33.177 INFO:tasks.workunit.client.1.smithi115.stdout:9/177: write d1/d6/d2d/f1a [116041,70883] 0 2024-04-16T14:35:33.177 INFO:tasks.workunit.client.1.smithi115.stdout:9/178: write f0 [20192,29659] 0 2024-04-16T14:35:33.178 INFO:tasks.workunit.client.1.smithi115.stdout:9/179: write d1/d10/f26 [1264305,81041] 0 2024-04-16T14:35:33.178 INFO:tasks.workunit.client.0.smithi005.stdout:5/365: dread d0/d6/d12/d1c/d1e/d48/d5e/f5d [0,4194304] 0 2024-04-16T14:35:33.178 INFO:tasks.workunit.client.0.smithi005.stdout:0/429: dwrite da/f1f [0,4194304] 0 2024-04-16T14:35:33.179 INFO:tasks.workunit.client.0.smithi005.stdout:1/490: mkdir d2/d2c/d85/dab/da5/db3 0 2024-04-16T14:35:33.179 INFO:tasks.workunit.client.0.smithi005.stdout:2/199: symlink d0/d1c/l38 0 2024-04-16T14:35:33.180 INFO:tasks.workunit.client.1.smithi115.stdout:5/87: rename dc/l16 to dc/l1a 0 2024-04-16T14:35:33.181 INFO:tasks.workunit.client.1.smithi115.stdout:9/180: getdents d1/d10 0 2024-04-16T14:35:33.181 INFO:tasks.workunit.client.1.smithi115.stdout:9/181: stat d1/d6/cb 0 2024-04-16T14:35:33.182 INFO:tasks.workunit.client.0.smithi005.stdout:8/407: mkdir d5/d40/d8e 0 2024-04-16T14:35:33.182 INFO:tasks.workunit.client.0.smithi005.stdout:8/408: write d5/d7b/d2f/d3d/d7f/f81 [1291412,37717] 0 2024-04-16T14:35:33.182 INFO:tasks.workunit.client.0.smithi005.stdout:8/409: fsync d5/d7b/d2f/d3d/f87 0 2024-04-16T14:35:33.182 INFO:tasks.workunit.client.0.smithi005.stdout:8/410: creat d5/d11/d6c/f8f x:0 0 0 2024-04-16T14:35:33.182 INFO:tasks.workunit.client.0.smithi005.stdout:8/411: chown d5/d7b/d2f/d68/f75 2060004186 1 2024-04-16T14:35:33.182 INFO:tasks.workunit.client.1.smithi115.stdout:9/182: symlink d1/d6/d29/l34 0 2024-04-16T14:35:33.183 INFO:tasks.workunit.client.0.smithi005.stdout:4/544: dread d0/f13 [0,4194304] 0 2024-04-16T14:35:33.185 INFO:tasks.workunit.client.1.smithi115.stdout:0/105: dwrite f0 [0,4194304] 0 2024-04-16T14:35:33.185 INFO:tasks.workunit.client.1.smithi115.stdout:0/106: fsync d6/d10/f22 0 2024-04-16T14:35:33.189 INFO:tasks.workunit.client.0.smithi005.stdout:5/366: mkdir d0/d6/d12/d1c/d1e/d48/d5e/d74 0 2024-04-16T14:35:33.192 INFO:tasks.workunit.client.1.smithi115.stdout:2/114: dwrite d0/d4/de/d11/f20 [0,4194304] 0 2024-04-16T14:35:33.192 INFO:tasks.workunit.client.1.smithi115.stdout:2/115: chown d0/d4/d24/d21 12 1 2024-04-16T14:35:33.193 INFO:tasks.workunit.client.1.smithi115.stdout:5/88: dread f5 [0,4194304] 0 2024-04-16T14:35:33.193 INFO:tasks.workunit.client.1.smithi115.stdout:5/89: read f5 [1836469,41495] 0 2024-04-16T14:35:33.195 INFO:tasks.workunit.client.1.smithi115.stdout:5/90: symlink dc/d15/l1b 0 2024-04-16T14:35:33.195 INFO:tasks.workunit.client.1.smithi115.stdout:5/91: creat dc/f1c x:0 0 0 2024-04-16T14:35:33.195 INFO:tasks.workunit.client.1.smithi115.stdout:8/101: sync 2024-04-16T14:35:33.196 INFO:tasks.workunit.client.0.smithi005.stdout:2/200: mkdir d0/d1c/d39 0 2024-04-16T14:35:33.199 INFO:tasks.workunit.client.1.smithi115.stdout:5/92: mknod dc/d15/c1d 0 2024-04-16T14:35:33.200 INFO:tasks.workunit.client.0.smithi005.stdout:8/412: creat d5/f90 x:0 0 0 2024-04-16T14:35:33.201 INFO:tasks.workunit.client.0.smithi005.stdout:8/413: dread - d5/f38 zero size 2024-04-16T14:35:33.201 INFO:tasks.workunit.client.1.smithi115.stdout:1/96: sync 2024-04-16T14:35:33.201 INFO:tasks.workunit.client.1.smithi115.stdout:4/141: sync 2024-04-16T14:35:33.201 INFO:tasks.workunit.client.1.smithi115.stdout:1/97: chown df/d1b 0 1 2024-04-16T14:35:33.201 INFO:tasks.workunit.client.1.smithi115.stdout:3/161: sync 2024-04-16T14:35:33.202 INFO:tasks.workunit.client.1.smithi115.stdout:6/128: sync 2024-04-16T14:35:33.202 INFO:tasks.workunit.client.1.smithi115.stdout:9/183: read d1/d6/d2d/f1c [833937,56458] 0 2024-04-16T14:35:33.203 INFO:tasks.workunit.client.0.smithi005.stdout:4/545: rename d0/d1b/d1d/d1f/d3e/d6d/d92 to d0/d1b/d1d/d1f/d48/dab 0 2024-04-16T14:35:33.204 INFO:tasks.workunit.client.1.smithi115.stdout:8/102: rename d0/db/d10/d17/f19 to d0/db/f1b 0 2024-04-16T14:35:33.204 INFO:tasks.workunit.client.1.smithi115.stdout:8/103: dread - d0/db/d10/d17/f18 zero size 2024-04-16T14:35:33.204 INFO:tasks.workunit.client.1.smithi115.stdout:8/104: write d0/db/d10/f16 [571351,75262] 0 2024-04-16T14:35:33.204 INFO:tasks.workunit.client.1.smithi115.stdout:8/105: stat d0/db/f13 0 2024-04-16T14:35:33.205 INFO:tasks.workunit.client.1.smithi115.stdout:1/98: symlink df/d1b/l1f 0 2024-04-16T14:35:33.205 INFO:tasks.workunit.client.1.smithi115.stdout:1/99: chown df/f1d 5412 1 2024-04-16T14:35:33.206 INFO:tasks.workunit.client.1.smithi115.stdout:3/162: creat dc/d24/d36/f3b x:0 0 0 2024-04-16T14:35:33.207 INFO:tasks.workunit.client.0.smithi005.stdout:3/412: dwrite d2/d9/d51/f58 [0,4194304] 0 2024-04-16T14:35:33.207 INFO:tasks.workunit.client.1.smithi115.stdout:2/116: write d0/fd [190246,69644] 0 2024-04-16T14:35:33.208 INFO:tasks.workunit.client.1.smithi115.stdout:2/117: fdatasync d0/d4/d24/f19 0 2024-04-16T14:35:33.208 INFO:tasks.workunit.client.1.smithi115.stdout:6/129: mkdir d13/d1a/d25 0 2024-04-16T14:35:33.208 INFO:tasks.workunit.client.0.smithi005.stdout:0/430: getdents da/df/d1b/d24 0 2024-04-16T14:35:33.209 INFO:tasks.workunit.client.0.smithi005.stdout:8/414: link d5/d7b/d2f/f4c d5/de/d8a/f91 0 2024-04-16T14:35:33.211 INFO:tasks.workunit.client.1.smithi115.stdout:9/184: symlink d1/d10/d20/d2a/l35 0 2024-04-16T14:35:33.211 INFO:tasks.workunit.client.1.smithi115.stdout:8/106: rmdir d0/db 39 2024-04-16T14:35:33.211 INFO:tasks.workunit.client.1.smithi115.stdout:0/107: write d6/fb [3995429,100502] 0 2024-04-16T14:35:33.212 INFO:tasks.workunit.client.1.smithi115.stdout:0/108: write d6/d1b/f21 [1173323,97335] 0 2024-04-16T14:35:33.212 INFO:tasks.workunit.client.1.smithi115.stdout:0/109: dread - d6/d10/f20 zero size 2024-04-16T14:35:33.212 INFO:tasks.workunit.client.1.smithi115.stdout:1/100: mknod df/c20 0 2024-04-16T14:35:33.212 INFO:tasks.workunit.client.1.smithi115.stdout:4/142: dread d1/d15/f20 [0,4194304] 0 2024-04-16T14:35:33.213 INFO:tasks.workunit.client.0.smithi005.stdout:4/546: creat d0/d1b/da5/fac x:0 0 0 2024-04-16T14:35:33.213 INFO:tasks.workunit.client.1.smithi115.stdout:3/163: symlink dc/d29/d39/l3c 0 2024-04-16T14:35:33.215 INFO:tasks.workunit.client.1.smithi115.stdout:2/118: mkdir d0/d2a 0 2024-04-16T14:35:33.216 INFO:tasks.workunit.client.0.smithi005.stdout:0/431: dread da/df/d1b/d3a/d53/f8f [0,4194304] 0 2024-04-16T14:35:33.216 INFO:tasks.workunit.client.0.smithi005.stdout:0/432: getdents da/df/d26/d8e 0 2024-04-16T14:35:33.216 INFO:tasks.workunit.client.0.smithi005.stdout:0/433: chown f1 15 1 2024-04-16T14:35:33.217 INFO:tasks.workunit.client.0.smithi005.stdout:3/413: truncate d2/fe 36469 0 2024-04-16T14:35:33.221 INFO:tasks.workunit.client.1.smithi115.stdout:8/107: creat d0/db/d10/d17/f1c x:0 0 0 2024-04-16T14:35:33.221 INFO:tasks.workunit.client.1.smithi115.stdout:8/108: readlink d0/la 0 2024-04-16T14:35:33.221 INFO:tasks.workunit.client.1.smithi115.stdout:0/110: mkdir d6/d1b/d29 0 2024-04-16T14:35:33.221 INFO:tasks.workunit.client.1.smithi115.stdout:0/111: truncate d6/d10/d12/f19 592351 0 2024-04-16T14:35:33.221 INFO:tasks.workunit.client.1.smithi115.stdout:0/112: read - d6/d10/f20 zero size 2024-04-16T14:35:33.221 INFO:tasks.workunit.client.1.smithi115.stdout:0/113: rename d6/d10/d12/d1f/d24 to d6/d10/d12/d1f/d24/d28/d2a 22 2024-04-16T14:35:33.221 INFO:tasks.workunit.client.1.smithi115.stdout:0/114: write d6/d10/f20 [166867,58446] 0 2024-04-16T14:35:33.221 INFO:tasks.workunit.client.1.smithi115.stdout:0/115: chown d6/d10/d12/d1f/d24/l27 3 1 2024-04-16T14:35:33.222 INFO:tasks.workunit.client.1.smithi115.stdout:1/101: link df/f14 df/d19/f21 0 2024-04-16T14:35:33.222 INFO:tasks.workunit.client.1.smithi115.stdout:1/102: write df/f12 [802111,45260] 0 2024-04-16T14:35:33.222 INFO:tasks.workunit.client.1.smithi115.stdout:1/103: creat df/f22 x:0 0 0 2024-04-16T14:35:33.222 INFO:tasks.workunit.client.1.smithi115.stdout:1/104: creat df/f23 x:0 0 0 2024-04-16T14:35:33.223 INFO:tasks.workunit.client.1.smithi115.stdout:7/145: dwrite d0/d1/f20 [0,4194304] 0 2024-04-16T14:35:33.223 INFO:tasks.workunit.client.1.smithi115.stdout:7/146: creat d0/d1/f34 x:0 0 0 2024-04-16T14:35:33.227 INFO:tasks.workunit.client.0.smithi005.stdout:4/547: symlink d0/d1b/d1d/d1f/d5d/da9/lad 0 2024-04-16T14:35:33.229 INFO:tasks.workunit.client.1.smithi115.stdout:3/164: write dc/f18 [305630,74325] 0 2024-04-16T14:35:33.229 INFO:tasks.workunit.client.1.smithi115.stdout:3/165: chown dc/ff 7774 1 2024-04-16T14:35:33.229 INFO:tasks.workunit.client.1.smithi115.stdout:3/166: readlink dc/l26 0 2024-04-16T14:35:33.230 INFO:tasks.workunit.client.0.smithi005.stdout:0/434: rename da/df/d1b/d3a/d53/d5a/f73 to da/df/d1b/d24/f90 0 2024-04-16T14:35:33.230 INFO:tasks.workunit.client.0.smithi005.stdout:0/435: write da/df/f65 [4720386,83011] 0 2024-04-16T14:35:33.231 INFO:tasks.workunit.client.0.smithi005.stdout:3/414: creat d2/d17/d46/d75/f8f x:0 0 0 2024-04-16T14:35:33.232 INFO:tasks.workunit.client.0.smithi005.stdout:4/548: unlink d0/d4d/f50 0 2024-04-16T14:35:33.233 INFO:tasks.workunit.client.1.smithi115.stdout:2/119: symlink d0/d4/d24/l2b 0 2024-04-16T14:35:33.233 INFO:tasks.workunit.client.1.smithi115.stdout:2/120: chown d0/d4/de/d11/f12 256024 1 2024-04-16T14:35:33.233 INFO:tasks.workunit.client.1.smithi115.stdout:6/130: dread d13/f18 [0,4194304] 0 2024-04-16T14:35:33.233 INFO:tasks.workunit.client.0.smithi005.stdout:5/367: dwrite d0/f2 [4194304,4194304] 0 2024-04-16T14:35:33.234 INFO:tasks.workunit.client.1.smithi115.stdout:8/109: dread d0/db/f13 [0,4194304] 0 2024-04-16T14:35:33.234 INFO:tasks.workunit.client.1.smithi115.stdout:8/110: dread - d0/db/f1b zero size 2024-04-16T14:35:33.236 INFO:tasks.workunit.client.0.smithi005.stdout:4/549: creat d0/d47/fae x:0 0 0 2024-04-16T14:35:33.238 INFO:tasks.workunit.client.0.smithi005.stdout:0/436: dread da/df/d1b/f47 [0,4194304] 0 2024-04-16T14:35:33.238 INFO:tasks.workunit.client.1.smithi115.stdout:0/116: symlink d6/d1b/d29/l2b 0 2024-04-16T14:35:33.238 INFO:tasks.workunit.client.1.smithi115.stdout:7/147: dread d0/d1/f1f [0,4194304] 0 2024-04-16T14:35:33.238 INFO:tasks.workunit.client.1.smithi115.stdout:7/148: creat d0/d2/f35 x:0 0 0 2024-04-16T14:35:33.239 INFO:tasks.workunit.client.0.smithi005.stdout:0/437: mknod da/df/d26/c91 0 2024-04-16T14:35:33.244 INFO:tasks.workunit.client.0.smithi005.stdout:0/438: symlink da/df/d26/d8e/l92 0 2024-04-16T14:35:33.246 INFO:tasks.workunit.client.0.smithi005.stdout:5/368: truncate d0/d6/f36 2957822 0 2024-04-16T14:35:33.246 INFO:tasks.workunit.client.0.smithi005.stdout:5/369: creat d0/d6/f75 x:0 0 0 2024-04-16T14:35:33.246 INFO:tasks.workunit.client.1.smithi115.stdout:1/105: creat df/d19/f24 x:0 0 0 2024-04-16T14:35:33.246 INFO:tasks.workunit.client.1.smithi115.stdout:1/106: fdatasync fb 0 2024-04-16T14:35:33.246 INFO:tasks.workunit.client.1.smithi115.stdout:1/107: chown df/d19/f21 19 1 2024-04-16T14:35:33.246 INFO:tasks.workunit.client.1.smithi115.stdout:1/108: creat df/f25 x:0 0 0 2024-04-16T14:35:33.254 INFO:tasks.workunit.client.0.smithi005.stdout:0/439: dread f1 [0,4194304] 0 2024-04-16T14:35:33.254 INFO:tasks.workunit.client.0.smithi005.stdout:5/370: rename d0/d6/d12/d1c/f4a to d0/f76 0 2024-04-16T14:35:33.254 INFO:tasks.workunit.client.0.smithi005.stdout:5/371: chown d0/d6/d12/d1c/c27 2 1 2024-04-16T14:35:33.254 INFO:tasks.workunit.client.0.smithi005.stdout:4/550: dread d0/d1b/f62 [0,4194304] 0 2024-04-16T14:35:33.255 INFO:tasks.workunit.client.0.smithi005.stdout:1/491: dwrite d2/d1c/d15/d6f/f8d [0,4194304] 0 2024-04-16T14:35:33.256 INFO:tasks.workunit.client.0.smithi005.stdout:0/440: creat da/f93 x:0 0 0 2024-04-16T14:35:33.258 INFO:tasks.workunit.client.0.smithi005.stdout:4/551: unlink d0/f89 0 2024-04-16T14:35:33.259 INFO:tasks.workunit.client.0.smithi005.stdout:1/492: rename d2/d1c/d15/d2a/d19/c41 to d2/d1c/d15/d2a/d19/d20/cb4 0 2024-04-16T14:35:33.259 INFO:tasks.workunit.client.0.smithi005.stdout:1/493: fsync d2/d1c/d15/d2a/f16 0 2024-04-16T14:35:33.260 INFO:tasks.workunit.client.0.smithi005.stdout:0/441: creat da/df/f94 x:0 0 0 2024-04-16T14:35:33.261 INFO:tasks.workunit.client.0.smithi005.stdout:0/442: dread da/df/d1b/f62 [0,4194304] 0 2024-04-16T14:35:33.261 INFO:tasks.workunit.client.0.smithi005.stdout:4/552: symlink d0/d1b/d1d/d1f/d5d/da9/laf 0 2024-04-16T14:35:33.261 INFO:tasks.workunit.client.0.smithi005.stdout:1/494: stat d2/d1c/d15/d2a/c60 0 2024-04-16T14:35:33.264 INFO:tasks.workunit.client.0.smithi005.stdout:0/443: unlink da/df/d26/f87 0 2024-04-16T14:35:33.265 INFO:tasks.workunit.client.0.smithi005.stdout:4/553: rmdir d0/d1b/d1d/d1f/d48 39 2024-04-16T14:35:33.267 INFO:tasks.workunit.client.0.smithi005.stdout:1/495: rename d2/d1c/d15/d2a/d1a/c59 to d2/d1c/d15/d2a/d19/d42/d71/dac/cb5 0 2024-04-16T14:35:33.268 INFO:tasks.workunit.client.0.smithi005.stdout:1/496: fdatasync d2/d1c/d15/d2a/d19/d42/d64/d66/f90 0 2024-04-16T14:35:33.270 INFO:tasks.workunit.client.0.smithi005.stdout:1/497: mkdir d2/d1c/d15/d2a/db6 0 2024-04-16T14:35:33.272 INFO:tasks.workunit.client.0.smithi005.stdout:1/498: symlink d2/d2c/d85/dab/da5/db3/lb7 0 2024-04-16T14:35:33.280 INFO:tasks.workunit.client.1.smithi115.stdout:2/121: creat d0/d4/d24/d23/f2c x:0 0 0 2024-04-16T14:35:33.280 INFO:tasks.workunit.client.1.smithi115.stdout:2/122: creat d0/f2d x:0 0 0 2024-04-16T14:35:33.280 INFO:tasks.workunit.client.1.smithi115.stdout:2/123: fsync d0/d4/d24/f13 0 2024-04-16T14:35:33.281 INFO:tasks.workunit.client.1.smithi115.stdout:6/131: getdents d13/d1d/d20 0 2024-04-16T14:35:33.284 INFO:tasks.workunit.client.1.smithi115.stdout:4/143: dwrite d1/d15/d17/f21 [0,4194304] 0 2024-04-16T14:35:33.291 INFO:tasks.workunit.client.1.smithi115.stdout:4/144: creat d1/d15/d1e/f23 x:0 0 0 2024-04-16T14:35:33.293 INFO:tasks.workunit.client.1.smithi115.stdout:4/145: mkdir d1/d15/d24 0 2024-04-16T14:35:33.293 INFO:tasks.workunit.client.1.smithi115.stdout:4/146: fsync d1/d2/f7 0 2024-04-16T14:35:33.294 INFO:tasks.workunit.client.1.smithi115.stdout:4/147: mknod d1/d15/d1e/c25 0 2024-04-16T14:35:33.296 INFO:tasks.workunit.client.1.smithi115.stdout:4/148: getdents d1/d15/d17 0 2024-04-16T14:35:33.296 INFO:tasks.workunit.client.1.smithi115.stdout:4/149: write d1/d15/f20 [592198,116113] 0 2024-04-16T14:35:33.296 INFO:tasks.workunit.client.0.smithi005.stdout:4/554: dread d0/d1b/d1d/d1f/d3e/f55 [0,4194304] 0 2024-04-16T14:35:33.296 INFO:tasks.workunit.client.0.smithi005.stdout:4/555: chown d0/d5a 114403169 1 2024-04-16T14:35:33.297 INFO:tasks.workunit.client.1.smithi115.stdout:4/150: dread d1/f3 [0,4194304] 0 2024-04-16T14:35:33.298 INFO:tasks.workunit.client.1.smithi115.stdout:4/151: creat d1/d15/d17/f26 x:0 0 0 2024-04-16T14:35:33.299 INFO:tasks.workunit.client.0.smithi005.stdout:2/201: dwrite d0/d4/f28 [0,4194304] 0 2024-04-16T14:35:33.300 INFO:tasks.workunit.client.1.smithi115.stdout:4/152: symlink d1/d15/d1e/l27 0 2024-04-16T14:35:33.300 INFO:tasks.workunit.client.0.smithi005.stdout:8/415: dwrite d5/d7b/f33 [4194304,4194304] 0 2024-04-16T14:35:33.300 INFO:tasks.workunit.client.1.smithi115.stdout:5/93: dwrite f0 [0,4194304] 0 2024-04-16T14:35:33.300 INFO:tasks.workunit.client.1.smithi115.stdout:3/167: dwrite f4 [0,4194304] 0 2024-04-16T14:35:33.301 INFO:tasks.workunit.client.1.smithi115.stdout:3/168: chown f4 32835 1 2024-04-16T14:35:33.301 INFO:tasks.workunit.client.0.smithi005.stdout:2/202: mkdir d0/d2a/d3a 0 2024-04-16T14:35:33.303 INFO:tasks.workunit.client.0.smithi005.stdout:8/416: mknod d5/de/d8a/c92 0 2024-04-16T14:35:33.303 INFO:tasks.workunit.client.1.smithi115.stdout:7/149: dwrite d0/f1a [4194304,4194304] 0 2024-04-16T14:35:33.303 INFO:tasks.workunit.client.1.smithi115.stdout:9/185: dwrite f0 [0,4194304] 0 2024-04-16T14:35:33.303 INFO:tasks.workunit.client.0.smithi005.stdout:2/203: creat d0/d4/f3b x:0 0 0 2024-04-16T14:35:33.304 INFO:tasks.workunit.client.0.smithi005.stdout:2/204: chown d0/f2 0 1 2024-04-16T14:35:33.305 INFO:tasks.workunit.client.0.smithi005.stdout:5/372: dwrite d0/d6/d12/d1c/d1e/f2b [0,4194304] 0 2024-04-16T14:35:33.305 INFO:tasks.workunit.client.0.smithi005.stdout:5/373: fsync d0/f6a 0 2024-04-16T14:35:33.305 INFO:tasks.workunit.client.0.smithi005.stdout:0/444: dwrite da/df/d26/f4c [0,4194304] 0 2024-04-16T14:35:33.305 INFO:tasks.workunit.client.0.smithi005.stdout:1/499: dwrite d2/d2c/d85/dab/f93 [0,4194304] 0 2024-04-16T14:35:33.306 INFO:tasks.workunit.client.0.smithi005.stdout:1/500: readlink d2/d1c/d15/d2a/d19/d20/la2 0 2024-04-16T14:35:33.309 INFO:tasks.workunit.client.1.smithi115.stdout:9/186: stat d1/l5 0 2024-04-16T14:35:33.313 INFO:tasks.workunit.client.0.smithi005.stdout:4/556: dread d0/f13 [0,4194304] 0 2024-04-16T14:35:33.314 INFO:tasks.workunit.client.1.smithi115.stdout:0/117: rmdir d6/d1b 39 2024-04-16T14:35:33.316 INFO:tasks.workunit.client.1.smithi115.stdout:4/153: dread d1/d2/f11 [0,4194304] 0 2024-04-16T14:35:33.321 INFO:tasks.workunit.client.1.smithi115.stdout:1/109: getdents df/d19 0 2024-04-16T14:35:33.329 INFO:tasks.workunit.client.1.smithi115.stdout:3/169: write dc/f15 [2560889,36203] 0 2024-04-16T14:35:33.329 INFO:tasks.workunit.client.1.smithi115.stdout:3/170: readlink dc/l26 0 2024-04-16T14:35:33.329 INFO:tasks.workunit.client.1.smithi115.stdout:3/171: creat dc/f3d x:0 0 0 2024-04-16T14:35:33.329 INFO:tasks.workunit.client.1.smithi115.stdout:3/172: chown c5 1 1 2024-04-16T14:35:33.330 INFO:tasks.workunit.client.0.smithi005.stdout:4/557: dread d0/f12 [0,4194304] 0 2024-04-16T14:35:33.330 INFO:tasks.workunit.client.0.smithi005.stdout:4/558: dread - d0/f94 zero size 2024-04-16T14:35:33.330 INFO:tasks.workunit.client.0.smithi005.stdout:4/559: read d0/d1b/d1d/f67 [1776974,48777] 0 2024-04-16T14:35:33.330 INFO:tasks.workunit.client.0.smithi005.stdout:4/560: fsync d0/d1b/f34 0 2024-04-16T14:35:33.333 INFO:tasks.workunit.client.0.smithi005.stdout:4/561: symlink d0/d1b/d1d/d1f/d3e/d6d/lb0 0 2024-04-16T14:35:33.333 INFO:tasks.workunit.client.0.smithi005.stdout:4/562: chown d0/d5a/c77 17 1 2024-04-16T14:35:33.334 INFO:tasks.workunit.client.1.smithi115.stdout:9/187: mkdir d1/d10/d20/d36 0 2024-04-16T14:35:33.335 INFO:tasks.workunit.client.0.smithi005.stdout:3/415: truncate d2/d9/f53 522164 0 2024-04-16T14:35:33.336 INFO:tasks.workunit.client.1.smithi115.stdout:0/118: mknod d6/d10/d12/d1f/d24/d28/c2c 0 2024-04-16T14:35:33.339 INFO:tasks.workunit.client.0.smithi005.stdout:4/563: rename d0/d1b/f34 to d0/d1b/d1d/d1f/da0/fb1 0 2024-04-16T14:35:33.339 INFO:tasks.workunit.client.0.smithi005.stdout:4/564: readlink d0/d1b/d1d/d1f/l25 0 2024-04-16T14:35:33.339 INFO:tasks.workunit.client.1.smithi115.stdout:0/119: rename d6/d10/d12/d1f/d24/d28/c2c to d6/d10/d12/d1f/d24/c2d 0 2024-04-16T14:35:33.340 INFO:tasks.workunit.client.1.smithi115.stdout:0/120: mknod d6/d10/d12/d1f/d24/d28/c2e 0 2024-04-16T14:35:33.341 INFO:tasks.workunit.client.0.smithi005.stdout:4/565: mkdir d0/d1b/d1d/d1f/d48/dab/db2 0 2024-04-16T14:35:33.342 INFO:tasks.workunit.client.1.smithi115.stdout:2/124: truncate d0/fd 1931998 0 2024-04-16T14:35:33.344 INFO:tasks.workunit.client.1.smithi115.stdout:2/125: mkdir d0/d4/d22/d2e 0 2024-04-16T14:35:33.345 INFO:tasks.workunit.client.1.smithi115.stdout:2/126: symlink d0/d4/de/d11/l2f 0 2024-04-16T14:35:33.345 INFO:tasks.workunit.client.1.smithi115.stdout:2/127: fsync d0/d4/d24/f13 0 2024-04-16T14:35:33.346 INFO:tasks.workunit.client.1.smithi115.stdout:2/128: rmdir d0/d4/de/d11/d25 39 2024-04-16T14:35:33.348 INFO:tasks.workunit.client.0.smithi005.stdout:0/445: dwrite da/df/f94 [0,4194304] 0 2024-04-16T14:35:33.348 INFO:tasks.workunit.client.0.smithi005.stdout:0/446: fsync da/df/d1b/f62 0 2024-04-16T14:35:33.351 INFO:tasks.workunit.client.0.smithi005.stdout:0/447: rmdir da/df/d26/d39/d55/d5c 39 2024-04-16T14:35:33.351 INFO:tasks.workunit.client.0.smithi005.stdout:0/448: fsync da/df/d1b/f31 0 2024-04-16T14:35:33.351 INFO:tasks.workunit.client.0.smithi005.stdout:0/449: chown da/df/d26/d39/d55/f5e 1457 1 2024-04-16T14:35:33.352 INFO:tasks.workunit.client.1.smithi115.stdout:7/150: truncate d0/f1a 5272139 0 2024-04-16T14:35:33.352 INFO:tasks.workunit.client.1.smithi115.stdout:0/121: dread d6/ff [0,4194304] 0 2024-04-16T14:35:33.352 INFO:tasks.workunit.client.1.smithi115.stdout:0/122: dread - d6/f25 zero size 2024-04-16T14:35:33.352 INFO:tasks.workunit.client.1.smithi115.stdout:7/151: creat d0/f36 x:0 0 0 2024-04-16T14:35:33.352 INFO:tasks.workunit.client.1.smithi115.stdout:7/152: write d0/f36 [751186,119864] 0 2024-04-16T14:35:33.353 INFO:tasks.workunit.client.1.smithi115.stdout:0/123: getdents d6/d1b/d29 0 2024-04-16T14:35:33.354 INFO:tasks.workunit.client.1.smithi115.stdout:7/153: getdents d0/d24/d2b/d2c/d30 0 2024-04-16T14:35:33.354 INFO:tasks.workunit.client.0.smithi005.stdout:3/416: write d2/d17/f6f [1184951,115431] 0 2024-04-16T14:35:33.355 INFO:tasks.workunit.client.1.smithi115.stdout:7/154: creat d0/d24/f37 x:0 0 0 2024-04-16T14:35:33.356 INFO:tasks.workunit.client.1.smithi115.stdout:7/155: unlink d0/d24/d2b/d2c/l31 0 2024-04-16T14:35:33.358 INFO:tasks.workunit.client.0.smithi005.stdout:4/566: dwrite d0/d1b/d1d/d1f/da0/fb1 [0,4194304] 0 2024-04-16T14:35:33.358 INFO:tasks.workunit.client.0.smithi005.stdout:4/567: readlink d0/d4d/l6c 0 2024-04-16T14:35:33.358 INFO:tasks.workunit.client.0.smithi005.stdout:4/568: write d0/f13 [475249,30935] 0 2024-04-16T14:35:33.358 INFO:tasks.workunit.client.0.smithi005.stdout:4/569: chown d0/d1b/d1d/d1f/d5d/f93 14174 1 2024-04-16T14:35:33.358 INFO:tasks.workunit.client.0.smithi005.stdout:4/570: write d0/d1b/d1d/d4f/d75/f82 [1424357,14276] 0 2024-04-16T14:35:33.358 INFO:tasks.workunit.client.0.smithi005.stdout:4/571: creat d0/d1b/da5/fb3 x:0 0 0 2024-04-16T14:35:33.358 INFO:tasks.workunit.client.0.smithi005.stdout:0/450: rmdir da/df/d1b/d3a/d53 39 2024-04-16T14:35:33.360 INFO:tasks.workunit.client.0.smithi005.stdout:3/417: symlink d2/d9/d5e/l90 0 2024-04-16T14:35:33.361 INFO:tasks.workunit.client.1.smithi115.stdout:4/154: dwrite d1/f22 [0,4194304] 0 2024-04-16T14:35:33.361 INFO:tasks.workunit.client.1.smithi115.stdout:4/155: chown d1/f22 873438571 1 2024-04-16T14:35:33.361 INFO:tasks.workunit.client.1.smithi115.stdout:4/156: fsync d1/f4 0 2024-04-16T14:35:33.361 INFO:tasks.workunit.client.1.smithi115.stdout:1/110: dwrite fb [0,4194304] 0 2024-04-16T14:35:33.361 INFO:tasks.workunit.client.1.smithi115.stdout:1/111: stat df/f1d 0 2024-04-16T14:35:33.362 INFO:tasks.workunit.client.0.smithi005.stdout:1/501: dwrite d2/d1c/f6b [0,4194304] 0 2024-04-16T14:35:33.363 INFO:tasks.workunit.client.1.smithi115.stdout:3/173: dwrite f6 [0,4194304] 0 2024-04-16T14:35:33.363 INFO:tasks.workunit.client.1.smithi115.stdout:3/174: write dc/f27 [2471875,42558] 0 2024-04-16T14:35:33.363 INFO:tasks.workunit.client.1.smithi115.stdout:3/175: write dc/f27 [4814514,5614] 0 2024-04-16T14:35:33.364 INFO:tasks.workunit.client.0.smithi005.stdout:2/205: dwrite d0/d4/f12 [0,4194304] 0 2024-04-16T14:35:33.364 INFO:tasks.workunit.client.0.smithi005.stdout:2/206: fdatasync d0/d2a/f31 0 2024-04-16T14:35:33.367 INFO:tasks.workunit.client.1.smithi115.stdout:1/112: symlink df/l26 0 2024-04-16T14:35:33.367 INFO:tasks.workunit.client.1.smithi115.stdout:1/113: fdatasync df/f22 0 2024-04-16T14:35:33.367 INFO:tasks.workunit.client.1.smithi115.stdout:1/114: creat df/f27 x:0 0 0 2024-04-16T14:35:33.367 INFO:tasks.workunit.client.1.smithi115.stdout:1/115: readlink df/l17 0 2024-04-16T14:35:33.369 INFO:tasks.workunit.client.0.smithi005.stdout:4/572: rename d0/d5a to d0/d1b/d1d/d1f/d5d/da7/db4 0 2024-04-16T14:35:33.375 INFO:tasks.workunit.client.0.smithi005.stdout:2/207: creat d0/d4/f3c x:0 0 0 2024-04-16T14:35:33.376 INFO:tasks.workunit.client.1.smithi115.stdout:5/94: dwrite dc/d15/f18 [0,4194304] 0 2024-04-16T14:35:33.376 INFO:tasks.workunit.client.1.smithi115.stdout:5/95: truncate dc/f12 857335 0 2024-04-16T14:35:33.376 INFO:tasks.workunit.client.1.smithi115.stdout:5/96: chown l3 1727 1 2024-04-16T14:35:33.376 INFO:tasks.workunit.client.1.smithi115.stdout:5/97: dread - dc/f1c zero size 2024-04-16T14:35:33.378 INFO:tasks.workunit.client.0.smithi005.stdout:1/502: rename d2/d1c/d15/d2a/d19/d20/f88 to d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/fb8 0 2024-04-16T14:35:33.378 INFO:tasks.workunit.client.0.smithi005.stdout:1/503: readlink d2/d1c/d15/la4 0 2024-04-16T14:35:33.379 INFO:tasks.workunit.client.1.smithi115.stdout:5/98: symlink dc/d15/l1e 0 2024-04-16T14:35:33.380 INFO:tasks.workunit.client.0.smithi005.stdout:0/451: link da/df/d1b/d3a/f3b da/df/d26/f95 0 2024-04-16T14:35:33.381 INFO:tasks.workunit.client.1.smithi115.stdout:1/116: dread f0 [0,4194304] 0 2024-04-16T14:35:33.381 INFO:tasks.workunit.client.1.smithi115.stdout:1/117: stat fa 0 2024-04-16T14:35:33.381 INFO:tasks.workunit.client.1.smithi115.stdout:1/118: stat fe 0 2024-04-16T14:35:33.381 INFO:tasks.workunit.client.1.smithi115.stdout:2/129: link d0/fd d0/d4/de/d11/d25/f30 0 2024-04-16T14:35:33.381 INFO:tasks.workunit.client.1.smithi115.stdout:2/130: write d0/d4/de/d11/f12 [2473278,70872] 0 2024-04-16T14:35:33.382 INFO:tasks.workunit.client.1.smithi115.stdout:1/119: getdents df/d13 0 2024-04-16T14:35:33.383 INFO:tasks.workunit.client.0.smithi005.stdout:4/573: write d0/d1b/d1d/d1f/da0/fb1 [2620116,29233] 0 2024-04-16T14:35:33.383 INFO:tasks.workunit.client.0.smithi005.stdout:4/574: write d0/d1b/d1d/d1f/d5d/f93 [1077868,77786] 0 2024-04-16T14:35:33.383 INFO:tasks.workunit.client.0.smithi005.stdout:3/418: dwrite d2/d9/f35 [0,4194304] 0 2024-04-16T14:35:33.383 INFO:tasks.workunit.client.0.smithi005.stdout:3/419: chown d2/d17/f6f 94689529 1 2024-04-16T14:35:33.383 INFO:tasks.workunit.client.0.smithi005.stdout:3/420: dread - d2/d17/d46/d75/d6d/f73 zero size 2024-04-16T14:35:33.383 INFO:tasks.workunit.client.0.smithi005.stdout:4/575: write d0/d1b/da5/f9b [359001,96964] 0 2024-04-16T14:35:33.383 INFO:tasks.workunit.client.0.smithi005.stdout:2/208: link d0/d2a/c32 d0/d2a/c3d 0 2024-04-16T14:35:33.383 INFO:tasks.workunit.client.0.smithi005.stdout:2/209: stat d0/d2a/f31 0 2024-04-16T14:35:33.384 INFO:tasks.workunit.client.1.smithi115.stdout:2/131: getdents d0/d4/d24 0 2024-04-16T14:35:33.385 INFO:tasks.workunit.client.1.smithi115.stdout:7/156: dwrite d0/f26 [0,4194304] 0 2024-04-16T14:35:33.386 INFO:tasks.workunit.client.0.smithi005.stdout:1/504: unlink d2/d1c/d15/d2a/d1a/d21/fa3 0 2024-04-16T14:35:33.386 INFO:tasks.workunit.client.0.smithi005.stdout:1/505: chown d2/d2c/d85/dab/l57 221395 1 2024-04-16T14:35:33.386 INFO:tasks.workunit.client.0.smithi005.stdout:0/452: mkdir da/df/d1b/d3a/d96 0 2024-04-16T14:35:33.387 INFO:tasks.workunit.client.1.smithi115.stdout:7/157: mknod d0/d2/c38 0 2024-04-16T14:35:33.390 INFO:tasks.workunit.client.0.smithi005.stdout:3/421: unlink d2/d9/df/l2e 0 2024-04-16T14:35:33.391 INFO:tasks.workunit.client.0.smithi005.stdout:2/210: mkdir d0/d29/d3e 0 2024-04-16T14:35:33.392 INFO:tasks.workunit.client.0.smithi005.stdout:1/506: getdents d2/d1c/d15/d2a 0 2024-04-16T14:35:33.392 INFO:tasks.workunit.client.0.smithi005.stdout:1/507: dread - d2/d1c/d15/d2a/d19/d42/d71/dac/f9f zero size 2024-04-16T14:35:33.393 INFO:tasks.workunit.client.0.smithi005.stdout:0/453: mknod da/df/c97 0 2024-04-16T14:35:33.393 INFO:tasks.workunit.client.0.smithi005.stdout:0/454: chown da/df/d26/d39/d55/f5e 13248293 1 2024-04-16T14:35:33.394 INFO:tasks.workunit.client.0.smithi005.stdout:3/422: creat d2/d9/d25/f91 x:0 0 0 2024-04-16T14:35:33.395 INFO:tasks.workunit.client.1.smithi115.stdout:2/132: write d0/fb [2453373,107790] 0 2024-04-16T14:35:33.397 INFO:tasks.workunit.client.0.smithi005.stdout:0/455: link f8 da/df/d26/d8e/f98 0 2024-04-16T14:35:33.398 INFO:tasks.workunit.client.0.smithi005.stdout:3/423: mkdir d2/d92 0 2024-04-16T14:35:33.401 INFO:tasks.workunit.client.0.smithi005.stdout:0/456: mkdir da/df/d1b/d3a/d53/d5a/d99 0 2024-04-16T14:35:33.401 INFO:tasks.workunit.client.0.smithi005.stdout:0/457: write da/df/d1b/d3a/d53/f61 [679801,47763] 0 2024-04-16T14:35:33.401 INFO:tasks.workunit.client.0.smithi005.stdout:0/458: stat da/df/d26/d8e/l92 0 2024-04-16T14:35:33.401 INFO:tasks.workunit.client.0.smithi005.stdout:4/576: fdatasync d0/f13 0 2024-04-16T14:35:33.402 INFO:tasks.workunit.client.1.smithi115.stdout:4/157: dwrite d1/f22 [0,4194304] 0 2024-04-16T14:35:33.402 INFO:tasks.workunit.client.1.smithi115.stdout:3/176: dwrite dc/f1a [0,4194304] 0 2024-04-16T14:35:33.404 INFO:tasks.workunit.client.1.smithi115.stdout:0/124: dwrite d6/d10/d12/f14 [0,4194304] 0 2024-04-16T14:35:33.405 INFO:tasks.workunit.client.1.smithi115.stdout:0/125: chown d6/fb 324 1 2024-04-16T14:35:33.405 INFO:tasks.workunit.client.1.smithi115.stdout:0/126: write d6/d10/f22 [777739,11790] 0 2024-04-16T14:35:33.405 INFO:tasks.workunit.client.1.smithi115.stdout:0/127: chown l5 20 1 2024-04-16T14:35:33.406 INFO:tasks.workunit.client.0.smithi005.stdout:1/508: dread d2/d1c/d15/d2a/d19/d42/f56 [0,4194304] 0 2024-04-16T14:35:33.406 INFO:tasks.workunit.client.0.smithi005.stdout:1/509: dread - d2/d1c/d15/f8b zero size 2024-04-16T14:35:33.406 INFO:tasks.workunit.client.0.smithi005.stdout:1/510: readlink d2/l95 0 2024-04-16T14:35:33.406 INFO:tasks.workunit.client.0.smithi005.stdout:1/511: stat d2/d2c/d85/dab/c39 0 2024-04-16T14:35:33.406 INFO:tasks.workunit.client.0.smithi005.stdout:4/577: rename d0/d1b/c76 to d0/d1b/d1d/d1f/d3e/cb5 0 2024-04-16T14:35:33.412 INFO:tasks.workunit.client.0.smithi005.stdout:2/211: dwrite d0/fb [0,4194304] 0 2024-04-16T14:35:33.412 INFO:tasks.workunit.client.1.smithi115.stdout:2/133: mknod d0/d4/d24/d10/c31 0 2024-04-16T14:35:33.413 INFO:tasks.workunit.client.0.smithi005.stdout:4/578: creat d0/d1b/fb6 x:0 0 0 2024-04-16T14:35:33.417 INFO:tasks.workunit.client.1.smithi115.stdout:4/158: getdents d1/d2 0 2024-04-16T14:35:33.418 INFO:tasks.workunit.client.1.smithi115.stdout:3/177: rmdir dc/d29/d39 39 2024-04-16T14:35:33.419 INFO:tasks.workunit.client.0.smithi005.stdout:4/579: dread d0/f12 [0,4194304] 0 2024-04-16T14:35:33.424 INFO:tasks.workunit.client.0.smithi005.stdout:4/580: mkdir d0/d1b/db7 0 2024-04-16T14:35:33.424 INFO:tasks.workunit.client.0.smithi005.stdout:4/581: readlink d0/d1b/d1d/d1f/d3e/l9e 0 2024-04-16T14:35:33.427 INFO:tasks.workunit.client.1.smithi115.stdout:2/134: link d0/d4/c18 d0/d4/d22/c32 0 2024-04-16T14:35:33.427 INFO:tasks.workunit.client.0.smithi005.stdout:3/424: dwrite d2/d17/d46/d75/f60 [0,4194304] 0 2024-04-16T14:35:33.427 INFO:tasks.workunit.client.0.smithi005.stdout:4/582: dread d0/d1b/d1d/d1f/d48/dab/fa6 [0,4194304] 0 2024-04-16T14:35:33.427 INFO:tasks.workunit.client.0.smithi005.stdout:1/512: dwrite d2/d1c/f3d [0,4194304] 0 2024-04-16T14:35:33.427 INFO:tasks.workunit.client.0.smithi005.stdout:4/583: readlink d0/d22/d29/l31 0 2024-04-16T14:35:33.429 INFO:tasks.workunit.client.1.smithi115.stdout:4/159: truncate d1/f4 603626 0 2024-04-16T14:35:33.430 INFO:tasks.workunit.client.1.smithi115.stdout:2/135: symlink d0/d4/de/d11/l33 0 2024-04-16T14:35:33.431 INFO:tasks.workunit.client.0.smithi005.stdout:3/425: creat d2/d9/d5e/f93 x:0 0 0 2024-04-16T14:35:33.431 INFO:tasks.workunit.client.0.smithi005.stdout:3/426: stat d2/d9/d25/d39/d64/l69 0 2024-04-16T14:35:33.432 INFO:tasks.workunit.client.1.smithi115.stdout:2/136: truncate d0/d4/de/d11/d25/f30 121850 0 2024-04-16T14:35:33.434 INFO:tasks.workunit.client.0.smithi005.stdout:0/459: rmdir da/df/d26 39 2024-04-16T14:35:33.435 INFO:tasks.workunit.client.1.smithi115.stdout:2/137: getdents d0/d4/de 0 2024-04-16T14:35:33.436 INFO:tasks.workunit.client.0.smithi005.stdout:2/212: dwrite d0/f27 [0,4194304] 0 2024-04-16T14:35:33.436 INFO:tasks.workunit.client.0.smithi005.stdout:1/513: creat d2/d2c/d85/dab/d51/fb9 x:0 0 0 2024-04-16T14:35:33.439 INFO:tasks.workunit.client.1.smithi115.stdout:2/138: truncate d0/fb 2903178 0 2024-04-16T14:35:33.439 INFO:tasks.workunit.client.1.smithi115.stdout:2/139: chown d0/d4/d24/d10 97990152 1 2024-04-16T14:35:33.439 INFO:tasks.workunit.client.0.smithi005.stdout:3/427: unlink d2/d17/l3d 0 2024-04-16T14:35:33.439 INFO:tasks.workunit.client.0.smithi005.stdout:3/428: truncate d2/f2b 2133417 0 2024-04-16T14:35:33.440 INFO:tasks.workunit.client.0.smithi005.stdout:3/429: write d2/d17/d46/f4b [193520,31870] 0 2024-04-16T14:35:33.440 INFO:tasks.workunit.client.0.smithi005.stdout:3/430: fsync d2/f71 0 2024-04-16T14:35:33.440 INFO:tasks.workunit.client.0.smithi005.stdout:3/431: creat d2/d9/d5e/f94 x:0 0 0 2024-04-16T14:35:33.440 INFO:tasks.workunit.client.0.smithi005.stdout:3/432: chown d2/d17/l81 1 1 2024-04-16T14:35:33.440 INFO:tasks.workunit.client.0.smithi005.stdout:3/433: dread - d2/d6b/d7a/f8c zero size 2024-04-16T14:35:33.441 INFO:tasks.workunit.client.1.smithi115.stdout:4/160: write d1/d2/f7 [1207807,67953] 0 2024-04-16T14:35:33.442 INFO:tasks.workunit.client.0.smithi005.stdout:0/460: dread da/f1f [0,4194304] 0 2024-04-16T14:35:33.442 INFO:tasks.workunit.client.0.smithi005.stdout:0/461: chown da/df/l4b 2 1 2024-04-16T14:35:33.442 INFO:tasks.workunit.client.0.smithi005.stdout:2/213: link d0/d1c/c22 d0/d29/d3e/c3f 0 2024-04-16T14:35:33.442 INFO:tasks.workunit.client.0.smithi005.stdout:2/214: readlink d0/d4/l2f 0 2024-04-16T14:35:33.442 INFO:tasks.workunit.client.0.smithi005.stdout:2/215: readlink d0/d1c/l2c 0 2024-04-16T14:35:33.444 INFO:tasks.workunit.client.0.smithi005.stdout:1/514: stat d2/d1c/d15/la4 0 2024-04-16T14:35:33.444 INFO:tasks.workunit.client.0.smithi005.stdout:1/515: dread - d2/d1c/d15/d2a/d19/d42/d71/f75 zero size 2024-04-16T14:35:33.448 INFO:tasks.workunit.client.0.smithi005.stdout:3/434: getdents d2/d17/d46 0 2024-04-16T14:35:33.448 INFO:tasks.workunit.client.1.smithi115.stdout:6/132: sync 2024-04-16T14:35:33.448 INFO:tasks.workunit.client.1.smithi115.stdout:8/111: sync 2024-04-16T14:35:33.449 INFO:tasks.workunit.client.0.smithi005.stdout:4/584: dwrite d0/f10 [8388608,4194304] 0 2024-04-16T14:35:33.450 INFO:tasks.workunit.client.0.smithi005.stdout:3/435: symlink d2/d9/d7d/l95 0 2024-04-16T14:35:33.450 INFO:tasks.workunit.client.0.smithi005.stdout:3/436: write d2/d17/f38 [3696796,64738] 0 2024-04-16T14:35:33.451 INFO:tasks.workunit.client.1.smithi115.stdout:8/112: rename d0/db/d10/f16 to d0/db/d10/d17/f1d 0 2024-04-16T14:35:33.451 INFO:tasks.workunit.client.1.smithi115.stdout:8/113: chown d0/db/f13 28 1 2024-04-16T14:35:33.454 INFO:tasks.workunit.client.0.smithi005.stdout:7/466: sync 2024-04-16T14:35:33.456 INFO:tasks.workunit.client.0.smithi005.stdout:4/585: unlink d0/d1b/d1d/d1f/f6e 0 2024-04-16T14:35:33.458 INFO:tasks.workunit.client.0.smithi005.stdout:7/467: rename d1/d49/d74/d77/d22/c26 to d1/d49/d74/d77/d22/d27/c94 0 2024-04-16T14:35:33.458 INFO:tasks.workunit.client.0.smithi005.stdout:7/468: getdents d1/d49/d74/d77/d22/d27/d3a/d5c 0 2024-04-16T14:35:33.459 INFO:tasks.workunit.client.0.smithi005.stdout:4/586: mknod d0/d4d/cb8 0 2024-04-16T14:35:33.460 INFO:tasks.workunit.client.0.smithi005.stdout:4/587: truncate d0/d1b/d1d/f53 4463044 0 2024-04-16T14:35:33.460 INFO:tasks.workunit.client.0.smithi005.stdout:4/588: chown d0/d1b/d1d/d1f/d5d/da7/d90/f98 0 1 2024-04-16T14:35:33.460 INFO:tasks.workunit.client.0.smithi005.stdout:1/516: dread d2/d1c/d15/f63 [0,4194304] 0 2024-04-16T14:35:33.460 INFO:tasks.workunit.client.0.smithi005.stdout:7/469: mknod d1/dc/d2f/c95 0 2024-04-16T14:35:33.463 INFO:tasks.workunit.client.0.smithi005.stdout:4/589: rename d0/d1b/d1d/d1f/d5d/da9/laf to d0/d1b/d1d/d1f/d5d/lb9 0 2024-04-16T14:35:33.465 INFO:tasks.workunit.client.0.smithi005.stdout:1/517: creat d2/d2c/d85/dab/d9b/fba x:0 0 0 2024-04-16T14:35:33.475 INFO:tasks.workunit.client.0.smithi005.stdout:4/590: dread d0/d1b/d1d/d1f/d48/f8a [0,4194304] 0 2024-04-16T14:35:33.476 INFO:tasks.workunit.client.0.smithi005.stdout:4/591: mknod d0/d1b/d1d/d1f/d48/dab/cba 0 2024-04-16T14:35:33.478 INFO:tasks.workunit.client.0.smithi005.stdout:4/592: creat d0/d1b/d1d/d1f/d5d/da7/db4/fbb x:0 0 0 2024-04-16T14:35:33.483 INFO:tasks.workunit.client.0.smithi005.stdout:4/593: read d0/d1b/f62 [1500045,22339] 0 2024-04-16T14:35:33.490 INFO:tasks.workunit.client.0.smithi005.stdout:4/594: read d0/f2c [2199686,86711] 0 2024-04-16T14:35:33.490 INFO:tasks.workunit.client.0.smithi005.stdout:4/595: chown d0/c11 36274719 1 2024-04-16T14:35:33.501 INFO:tasks.workunit.client.1.smithi115.stdout:2/140: dwrite d0/d4/de/d11/f1e [0,4194304] 0 2024-04-16T14:35:33.501 INFO:tasks.workunit.client.1.smithi115.stdout:2/141: stat d0/fb 0 2024-04-16T14:35:33.505 INFO:tasks.workunit.client.1.smithi115.stdout:2/142: link d0/d4/de/d11/f20 d0/d4/d24/f34 0 2024-04-16T14:35:33.505 INFO:tasks.workunit.client.1.smithi115.stdout:2/143: write d0/d4/d24/f13 [734435,13829] 0 2024-04-16T14:35:33.505 INFO:tasks.workunit.client.1.smithi115.stdout:2/144: truncate d0/fd 650186 0 2024-04-16T14:35:33.505 INFO:tasks.workunit.client.1.smithi115.stdout:2/145: write d0/d4/ff [374758,44613] 0 2024-04-16T14:35:33.505 INFO:tasks.workunit.client.1.smithi115.stdout:2/146: fsync d0/d4/d24/f19 0 2024-04-16T14:35:33.505 INFO:tasks.workunit.client.1.smithi115.stdout:2/147: mknod d0/d1b/c35 0 2024-04-16T14:35:33.505 INFO:tasks.workunit.client.1.smithi115.stdout:2/148: truncate d0/fb 3398809 0 2024-04-16T14:35:33.505 INFO:tasks.workunit.client.1.smithi115.stdout:4/161: dwrite d1/d15/d17/f19 [0,4194304] 0 2024-04-16T14:35:33.506 INFO:tasks.workunit.client.1.smithi115.stdout:2/149: mkdir d0/d4/de/d11/d36 0 2024-04-16T14:35:33.506 INFO:tasks.workunit.client.1.smithi115.stdout:6/133: dwrite d13/f18 [0,4194304] 0 2024-04-16T14:35:33.507 INFO:tasks.workunit.client.0.smithi005.stdout:0/462: dwrite da/df/d26/f45 [0,4194304] 0 2024-04-16T14:35:33.507 INFO:tasks.workunit.client.0.smithi005.stdout:4/596: dread d0/d1b/d1d/f53 [0,4194304] 0 2024-04-16T14:35:33.507 INFO:tasks.workunit.client.0.smithi005.stdout:4/597: chown d0/d1b/d1d 91053335 1 2024-04-16T14:35:33.507 INFO:tasks.workunit.client.0.smithi005.stdout:4/598: creat d0/d47/fbc x:0 0 0 2024-04-16T14:35:33.507 INFO:tasks.workunit.client.0.smithi005.stdout:3/437: dwrite d2/d17/d46/d75/d6d/f73 [0,4194304] 0 2024-04-16T14:35:33.507 INFO:tasks.workunit.client.0.smithi005.stdout:3/438: creat d2/d9/d25/f96 x:0 0 0 2024-04-16T14:35:33.507 INFO:tasks.workunit.client.0.smithi005.stdout:7/470: dwrite d1/dc/f7d [0,4194304] 0 2024-04-16T14:35:33.508 INFO:tasks.workunit.client.0.smithi005.stdout:1/518: dwrite d2/d1c/fe [0,4194304] 0 2024-04-16T14:35:33.508 INFO:tasks.workunit.client.0.smithi005.stdout:1/519: write d2/d1c/d15/d2a/d19/d42/d64/d66/f8f [325036,51713] 0 2024-04-16T14:35:33.508 INFO:tasks.workunit.client.1.smithi115.stdout:2/150: creat d0/d4/de/f37 x:0 0 0 2024-04-16T14:35:33.509 INFO:tasks.workunit.client.1.smithi115.stdout:2/151: write d0/fb [2418737,48881] 0 2024-04-16T14:35:33.510 INFO:tasks.workunit.client.0.smithi005.stdout:4/599: dread d0/d1b/d1d/d1f/f57 [0,4194304] 0 2024-04-16T14:35:33.510 INFO:tasks.workunit.client.0.smithi005.stdout:4/600: fsync d0/d1b/d1d/d1f/d5d/da7/d90/f98 0 2024-04-16T14:35:33.515 INFO:tasks.workunit.client.0.smithi005.stdout:0/463: write da/df/f21 [2438150,129500] 0 2024-04-16T14:35:33.515 INFO:tasks.workunit.client.0.smithi005.stdout:0/464: chown da/df/d1b/d3a/d53/d5a/d99 18 1 2024-04-16T14:35:33.516 INFO:tasks.workunit.client.1.smithi115.stdout:9/188: sync 2024-04-16T14:35:33.516 INFO:tasks.workunit.client.1.smithi115.stdout:9/189: fsync d1/d6/d2d/f1a 0 2024-04-16T14:35:33.516 INFO:tasks.workunit.client.1.smithi115.stdout:9/190: fdatasync d1/d10/d20/f2c 0 2024-04-16T14:35:33.517 INFO:tasks.workunit.client.1.smithi115.stdout:4/162: write d1/d2/f8 [2611691,110304] 0 2024-04-16T14:35:33.517 INFO:tasks.workunit.client.1.smithi115.stdout:4/163: truncate d1/d2/f7 1646306 0 2024-04-16T14:35:33.518 INFO:tasks.workunit.client.0.smithi005.stdout:3/439: getdents d2/d17/d46/d75/d6d 0 2024-04-16T14:35:33.518 INFO:tasks.workunit.client.0.smithi005.stdout:3/440: stat d2/f71 0 2024-04-16T14:35:33.518 INFO:tasks.workunit.client.1.smithi115.stdout:9/191: creat d1/d10/d20/d2a/f37 x:0 0 0 2024-04-16T14:35:33.520 INFO:tasks.workunit.client.1.smithi115.stdout:9/192: link d1/d6/f2b d1/d6/d33/f38 0 2024-04-16T14:35:33.520 INFO:tasks.workunit.client.1.smithi115.stdout:9/193: write d1/d10/f26 [2337820,56109] 0 2024-04-16T14:35:33.520 INFO:tasks.workunit.client.1.smithi115.stdout:4/164: getdents d1/d15/d1e 0 2024-04-16T14:35:33.523 INFO:tasks.workunit.client.0.smithi005.stdout:4/601: creat d0/d1b/d1d/d1f/d5d/da7/d90/fbd x:0 0 0 2024-04-16T14:35:33.524 INFO:tasks.workunit.client.0.smithi005.stdout:4/602: write d0/d47/fbc [907566,34544] 0 2024-04-16T14:35:33.525 INFO:tasks.workunit.client.0.smithi005.stdout:0/465: dread f1 [0,4194304] 0 2024-04-16T14:35:33.525 INFO:tasks.workunit.client.1.smithi115.stdout:9/194: creat d1/d10/d20/d36/f39 x:0 0 0 2024-04-16T14:35:33.525 INFO:tasks.workunit.client.1.smithi115.stdout:9/195: dread - d1/d10/d20/d36/f39 zero size 2024-04-16T14:35:33.525 INFO:tasks.workunit.client.1.smithi115.stdout:4/165: mknod d1/d15/d24/c28 0 2024-04-16T14:35:33.525 INFO:tasks.workunit.client.1.smithi115.stdout:4/166: read d1/f3 [152688,29449] 0 2024-04-16T14:35:33.525 INFO:tasks.workunit.client.1.smithi115.stdout:9/196: symlink d1/d6/l3a 0 2024-04-16T14:35:33.525 INFO:tasks.workunit.client.1.smithi115.stdout:9/197: chown d1/d10/d20/d2a/l35 332907 1 2024-04-16T14:35:33.526 INFO:tasks.workunit.client.1.smithi115.stdout:4/167: creat d1/d15/d1e/f29 x:0 0 0 2024-04-16T14:35:33.526 INFO:tasks.workunit.client.0.smithi005.stdout:3/441: mknod d2/d17/d46/d75/d6d/c97 0 2024-04-16T14:35:33.528 INFO:tasks.workunit.client.0.smithi005.stdout:4/603: mkdir d0/d22/d61/dbe 0 2024-04-16T14:35:33.528 INFO:tasks.workunit.client.0.smithi005.stdout:1/520: dwrite d2/d1c/d15/d2a/d19/d42/d71/dac/fa1 [0,4194304] 0 2024-04-16T14:35:33.528 INFO:tasks.workunit.client.0.smithi005.stdout:1/521: chown d2/d1c/d15/d2a/c60 425209353 1 2024-04-16T14:35:33.529 INFO:tasks.workunit.client.1.smithi115.stdout:9/198: mknod d1/d6/d29/c3b 0 2024-04-16T14:35:33.529 INFO:tasks.workunit.client.1.smithi115.stdout:9/199: creat d1/d10/d20/f3c x:0 0 0 2024-04-16T14:35:33.529 INFO:tasks.workunit.client.1.smithi115.stdout:9/200: write d1/d6/d29/f32 [738804,56675] 0 2024-04-16T14:35:33.529 INFO:tasks.workunit.client.1.smithi115.stdout:9/201: truncate d1/d10/d20/f2c 5082281 0 2024-04-16T14:35:33.529 INFO:tasks.workunit.client.1.smithi115.stdout:9/202: write d1/d6/d2d/f1a [1139827,118868] 0 2024-04-16T14:35:33.530 INFO:tasks.workunit.client.1.smithi115.stdout:4/168: truncate d1/f4 406799 0 2024-04-16T14:35:33.530 INFO:tasks.workunit.client.0.smithi005.stdout:0/466: rename da/df/f1e to da/df/d26/d39/f9a 0 2024-04-16T14:35:33.531 INFO:tasks.workunit.client.1.smithi115.stdout:9/203: mkdir d1/d6/d2d/d3d 0 2024-04-16T14:35:33.531 INFO:tasks.workunit.client.1.smithi115.stdout:9/204: fsync d1/d6/f2b 0 2024-04-16T14:35:33.531 INFO:tasks.workunit.client.0.smithi005.stdout:3/442: creat d2/d9/d7d/f98 x:0 0 0 2024-04-16T14:35:33.532 INFO:tasks.workunit.client.1.smithi115.stdout:6/134: dwrite d13/f1c [0,4194304] 0 2024-04-16T14:35:33.532 INFO:tasks.workunit.client.1.smithi115.stdout:6/135: chown fc 19 1 2024-04-16T14:35:33.535 INFO:tasks.workunit.client.1.smithi115.stdout:6/136: creat d13/d1d/d20/f26 x:0 0 0 2024-04-16T14:35:33.535 INFO:tasks.workunit.client.0.smithi005.stdout:0/467: read da/df/d1b/f47 [1459419,18699] 0 2024-04-16T14:35:33.538 INFO:tasks.workunit.client.1.smithi115.stdout:6/137: rename d13/d1a/f24 to d13/d1a/d25/f27 0 2024-04-16T14:35:33.538 INFO:tasks.workunit.client.0.smithi005.stdout:4/604: write d0/d1b/d1d/f9a [2121168,116523] 0 2024-04-16T14:35:33.542 INFO:tasks.workunit.client.0.smithi005.stdout:1/522: unlink d2/d2c/d85/l92 0 2024-04-16T14:35:33.542 INFO:tasks.workunit.client.0.smithi005.stdout:3/443: truncate d2/f44 5049638 0 2024-04-16T14:35:33.543 INFO:tasks.workunit.client.0.smithi005.stdout:1/523: write d2/d1c/d15/d2a/d1a/d21/f89 [4635637,23298] 0 2024-04-16T14:35:33.543 INFO:tasks.workunit.client.0.smithi005.stdout:1/524: fdatasync d2/d1c/d15/d2a/d19/d42/d71/dac/f9f 0 2024-04-16T14:35:33.544 INFO:tasks.workunit.client.0.smithi005.stdout:3/444: creat d2/d6b/f99 x:0 0 0 2024-04-16T14:35:33.545 INFO:tasks.workunit.client.0.smithi005.stdout:3/445: dread - d2/d17/d46/d75/d41/f65 zero size 2024-04-16T14:35:33.545 INFO:tasks.workunit.client.1.smithi115.stdout:9/205: write f0 [4098510,127086] 0 2024-04-16T14:35:33.545 INFO:tasks.workunit.client.1.smithi115.stdout:9/206: creat d1/d6/f3e x:0 0 0 2024-04-16T14:35:33.546 INFO:tasks.workunit.client.0.smithi005.stdout:3/446: mknod d2/d6b/d7a/c9a 0 2024-04-16T14:35:33.546 INFO:tasks.workunit.client.1.smithi115.stdout:6/138: dread d13/d1a/f1b [0,4194304] 0 2024-04-16T14:35:33.548 INFO:tasks.workunit.client.0.smithi005.stdout:3/447: mkdir d2/d17/d46/d75/d9b 0 2024-04-16T14:35:33.548 INFO:tasks.workunit.client.0.smithi005.stdout:3/448: readlink d2/l1a 0 2024-04-16T14:35:33.548 INFO:tasks.workunit.client.0.smithi005.stdout:3/449: write d2/d9/d5e/f93 [133440,61661] 0 2024-04-16T14:35:33.548 INFO:tasks.workunit.client.0.smithi005.stdout:3/450: truncate d2/d9/d25/d39/f7f 666324 0 2024-04-16T14:35:33.548 INFO:tasks.workunit.client.0.smithi005.stdout:3/451: fsync d2/d17/d46/d75/d41/d79/f83 0 2024-04-16T14:35:33.549 INFO:tasks.workunit.client.1.smithi115.stdout:9/207: symlink d1/d6/l3f 0 2024-04-16T14:35:33.549 INFO:tasks.workunit.client.1.smithi115.stdout:9/208: write d1/d10/d20/d36/f39 [846249,77082] 0 2024-04-16T14:35:33.549 INFO:tasks.workunit.client.1.smithi115.stdout:9/209: chown d1/d6/cb 2683 1 2024-04-16T14:35:33.549 INFO:tasks.workunit.client.1.smithi115.stdout:9/210: chown d1/d10/d20 221151031 1 2024-04-16T14:35:33.550 INFO:tasks.workunit.client.1.smithi115.stdout:6/139: creat d13/f28 x:0 0 0 2024-04-16T14:35:33.550 INFO:tasks.workunit.client.1.smithi115.stdout:6/140: readlink d13/l14 0 2024-04-16T14:35:33.550 INFO:tasks.workunit.client.1.smithi115.stdout:6/141: chown d13/d1d/l1f 119839440 1 2024-04-16T14:35:33.552 INFO:tasks.workunit.client.1.smithi115.stdout:6/142: rmdir d13/d1a 39 2024-04-16T14:35:33.555 INFO:tasks.workunit.client.1.smithi115.stdout:4/169: dwrite d1/d2/f8 [4194304,4194304] 0 2024-04-16T14:35:33.555 INFO:tasks.workunit.client.1.smithi115.stdout:4/170: dread - d1/d15/d17/f26 zero size 2024-04-16T14:35:33.556 INFO:tasks.workunit.client.1.smithi115.stdout:4/171: write d1/d15/d17/f19 [4569688,7251] 0 2024-04-16T14:35:33.556 INFO:tasks.workunit.client.1.smithi115.stdout:4/172: readlink d1/l1f 0 2024-04-16T14:35:33.557 INFO:tasks.workunit.client.1.smithi115.stdout:4/173: rmdir d1/d2 39 2024-04-16T14:35:33.559 INFO:tasks.workunit.client.1.smithi115.stdout:4/174: symlink d1/d15/d1e/l2a 0 2024-04-16T14:35:33.559 INFO:tasks.workunit.client.1.smithi115.stdout:4/175: creat d1/d15/d1e/f2b x:0 0 0 2024-04-16T14:35:33.559 INFO:tasks.workunit.client.1.smithi115.stdout:4/176: write d1/f3 [902371,106374] 0 2024-04-16T14:35:33.559 INFO:tasks.workunit.client.1.smithi115.stdout:4/177: write d1/d2/f7 [838120,30508] 0 2024-04-16T14:35:33.560 INFO:tasks.workunit.client.1.smithi115.stdout:4/178: write d1/d15/d1e/f23 [741445,68184] 0 2024-04-16T14:35:33.568 INFO:tasks.workunit.client.1.smithi115.stdout:9/211: dread d1/d10/f26 [0,4194304] 0 2024-04-16T14:35:33.568 INFO:tasks.workunit.client.1.smithi115.stdout:9/212: mknod d1/d6/d2d/d3d/c40 0 2024-04-16T14:35:33.569 INFO:tasks.workunit.client.1.smithi115.stdout:9/213: link d1/d6/f2b d1/d6/f41 0 2024-04-16T14:35:33.578 INFO:tasks.workunit.client.0.smithi005.stdout:4/605: dwrite d0/d47/fae [0,4194304] 0 2024-04-16T14:35:33.580 INFO:tasks.workunit.client.0.smithi005.stdout:1/525: dwrite d2/d1c/d15/d6f/f8d [0,4194304] 0 2024-04-16T14:35:33.580 INFO:tasks.workunit.client.0.smithi005.stdout:1/526: truncate d2/d1c/d15/d2a/d19/d42/d64/d66/f8f 942821 0 2024-04-16T14:35:33.580 INFO:tasks.workunit.client.0.smithi005.stdout:4/606: symlink d0/d1b/da5/lbf 0 2024-04-16T14:35:33.581 INFO:tasks.workunit.client.0.smithi005.stdout:4/607: write d0/d1b/d1d/d1f/f7d [1045228,21394] 0 2024-04-16T14:35:33.581 INFO:tasks.workunit.client.0.smithi005.stdout:4/608: read - d0/d1b/da5/fb3 zero size 2024-04-16T14:35:33.581 INFO:tasks.workunit.client.0.smithi005.stdout:4/609: readlink d0/d22/d61/l64 0 2024-04-16T14:35:33.581 INFO:tasks.workunit.client.0.smithi005.stdout:4/610: chown d0/d22/d29 928516 1 2024-04-16T14:35:33.587 INFO:tasks.workunit.client.0.smithi005.stdout:1/527: read d2/d1c/d15/d6f/f8d [1392954,101668] 0 2024-04-16T14:35:33.588 INFO:tasks.workunit.client.0.smithi005.stdout:1/528: creat d2/d2c/d85/dab/da5/db3/fbb x:0 0 0 2024-04-16T14:35:33.588 INFO:tasks.workunit.client.0.smithi005.stdout:3/452: dwrite d2/d9/f53 [0,4194304] 0 2024-04-16T14:35:33.588 INFO:tasks.workunit.client.0.smithi005.stdout:3/453: write d2/d9/d5e/f93 [911435,86633] 0 2024-04-16T14:35:33.588 INFO:tasks.workunit.client.0.smithi005.stdout:3/454: read - d2/d17/d46/d75/f8f zero size 2024-04-16T14:35:33.588 INFO:tasks.workunit.client.0.smithi005.stdout:3/455: write d2/d17/f48 [989059,21646] 0 2024-04-16T14:35:33.589 INFO:tasks.workunit.client.1.smithi115.stdout:6/143: dwrite d13/d1d/d20/f26 [0,4194304] 0 2024-04-16T14:35:33.589 INFO:tasks.workunit.client.1.smithi115.stdout:4/179: dwrite d1/d2/ff [0,4194304] 0 2024-04-16T14:35:33.589 INFO:tasks.workunit.client.1.smithi115.stdout:4/180: fdatasync d1/d2/f11 0 2024-04-16T14:35:33.594 INFO:tasks.workunit.client.0.smithi005.stdout:1/529: rename d2/d2c/d85/dab/d9b to d2/d2c/d85/dab/da5/dbc 0 2024-04-16T14:35:33.598 INFO:tasks.workunit.client.0.smithi005.stdout:3/456: dread d2/d9/d51/f58 [0,4194304] 0 2024-04-16T14:35:33.600 INFO:tasks.workunit.client.0.smithi005.stdout:4/611: dread d0/f10 [4194304,4194304] 0 2024-04-16T14:35:33.600 INFO:tasks.workunit.client.0.smithi005.stdout:4/612: fsync d0/d1b/d1d/d4f/d75/f82 0 2024-04-16T14:35:33.601 INFO:tasks.workunit.client.1.smithi115.stdout:6/144: dread d13/d1a/f23 [0,4194304] 0 2024-04-16T14:35:33.601 INFO:tasks.workunit.client.1.smithi115.stdout:6/145: fdatasync d13/f18 0 2024-04-16T14:35:33.603 INFO:tasks.workunit.client.0.smithi005.stdout:8/417: sync 2024-04-16T14:35:33.603 INFO:tasks.workunit.client.0.smithi005.stdout:6/472: sync 2024-04-16T14:35:33.604 INFO:tasks.workunit.client.0.smithi005.stdout:9/252: sync 2024-04-16T14:35:33.604 INFO:tasks.workunit.client.0.smithi005.stdout:5/374: sync 2024-04-16T14:35:33.604 INFO:tasks.workunit.client.0.smithi005.stdout:8/418: write d5/d40/f6d [697989,120122] 0 2024-04-16T14:35:33.604 INFO:tasks.workunit.client.0.smithi005.stdout:5/375: creat d0/d6/f77 x:0 0 0 2024-04-16T14:35:33.607 INFO:tasks.workunit.client.0.smithi005.stdout:3/457: rename d2/d17/d46/d84 to d2/d9/d25/d39/d9c 0 2024-04-16T14:35:33.610 INFO:tasks.workunit.client.0.smithi005.stdout:6/473: rmdir d2/d3f/d95 0 2024-04-16T14:35:33.611 INFO:tasks.workunit.client.0.smithi005.stdout:8/419: dread d5/de/f19 [0,4194304] 0 2024-04-16T14:35:33.612 INFO:tasks.workunit.client.1.smithi115.stdout:7/158: sync 2024-04-16T14:35:33.612 INFO:tasks.workunit.client.1.smithi115.stdout:8/114: sync 2024-04-16T14:35:33.612 INFO:tasks.workunit.client.1.smithi115.stdout:0/128: sync 2024-04-16T14:35:33.612 INFO:tasks.workunit.client.1.smithi115.stdout:7/159: chown d0/f26 1 1 2024-04-16T14:35:33.612 INFO:tasks.workunit.client.1.smithi115.stdout:5/99: sync 2024-04-16T14:35:33.612 INFO:tasks.workunit.client.1.smithi115.stdout:2/152: sync 2024-04-16T14:35:33.612 INFO:tasks.workunit.client.1.smithi115.stdout:5/100: creat dc/f1f x:0 0 0 2024-04-16T14:35:33.612 INFO:tasks.workunit.client.1.smithi115.stdout:0/129: write d6/d10/d12/f19 [595754,52798] 0 2024-04-16T14:35:33.612 INFO:tasks.workunit.client.1.smithi115.stdout:1/120: sync 2024-04-16T14:35:33.613 INFO:tasks.workunit.client.1.smithi115.stdout:3/178: sync 2024-04-16T14:35:33.613 INFO:tasks.workunit.client.0.smithi005.stdout:4/613: dread d0/f5 [0,4194304] 0 2024-04-16T14:35:33.613 INFO:tasks.workunit.client.0.smithi005.stdout:9/253: link d3/d12/d16/f1d d3/d12/d2b/f44 0 2024-04-16T14:35:33.614 INFO:tasks.workunit.client.1.smithi115.stdout:7/160: rename d0/d2/f11 to d0/d24/d2b/f39 0 2024-04-16T14:35:33.616 INFO:tasks.workunit.client.1.smithi115.stdout:9/214: dwrite f0 [4194304,4194304] 0 2024-04-16T14:35:33.616 INFO:tasks.workunit.client.1.smithi115.stdout:2/153: creat d0/d1b/f38 x:0 0 0 2024-04-16T14:35:33.616 INFO:tasks.workunit.client.0.smithi005.stdout:5/376: symlink d0/d6/d12/d1c/d1e/d73/l78 0 2024-04-16T14:35:33.616 INFO:tasks.workunit.client.0.smithi005.stdout:9/254: dread d3/d12/d16/f32 [0,4194304] 0 2024-04-16T14:35:33.617 INFO:tasks.workunit.client.1.smithi115.stdout:1/121: mknod df/d1b/c28 0 2024-04-16T14:35:33.619 INFO:tasks.workunit.client.1.smithi115.stdout:5/101: getdents dc/d15 0 2024-04-16T14:35:33.620 INFO:tasks.workunit.client.1.smithi115.stdout:4/181: dwrite d1/f18 [0,4194304] 0 2024-04-16T14:35:33.621 INFO:tasks.workunit.client.0.smithi005.stdout:6/474: truncate d2/d5/f2a 2767652 0 2024-04-16T14:35:33.621 INFO:tasks.workunit.client.0.smithi005.stdout:8/420: truncate d5/d7b/f24 2369319 0 2024-04-16T14:35:33.624 INFO:tasks.workunit.client.1.smithi115.stdout:5/102: link dc/d15/f18 dc/d15/f20 0 2024-04-16T14:35:33.624 INFO:tasks.workunit.client.1.smithi115.stdout:5/103: creat dc/f21 x:0 0 0 2024-04-16T14:35:33.626 INFO:tasks.workunit.client.0.smithi005.stdout:4/614: rename d0/d1b/da5/lbf to d0/d1b/d1d/d1f/d3e/d6d/da1/lc0 0 2024-04-16T14:35:33.629 INFO:tasks.workunit.client.1.smithi115.stdout:7/161: rename d0/d24/d2b/d2c to d0/d2/d3a 0 2024-04-16T14:35:33.630 INFO:tasks.workunit.client.1.smithi115.stdout:5/104: mknod dc/c22 0 2024-04-16T14:35:33.630 INFO:tasks.workunit.client.1.smithi115.stdout:5/105: chown dc/d15/f20 1179000 1 2024-04-16T14:35:33.631 INFO:tasks.workunit.client.0.smithi005.stdout:3/458: dread d2/d9/f53 [0,4194304] 0 2024-04-16T14:35:33.631 INFO:tasks.workunit.client.0.smithi005.stdout:1/530: dwrite d2/d1c/d15/f8b [0,4194304] 0 2024-04-16T14:35:33.631 INFO:tasks.workunit.client.0.smithi005.stdout:1/531: truncate d2/d1c/d15/d2a/d19/d42/d71/dac/f9f 959742 0 2024-04-16T14:35:33.631 INFO:tasks.workunit.client.0.smithi005.stdout:3/459: write d2/f71 [51409,109100] 0 2024-04-16T14:35:33.631 INFO:tasks.workunit.client.0.smithi005.stdout:3/460: readlink d2/d17/d46/d75/d41/l63 0 2024-04-16T14:35:33.631 INFO:tasks.workunit.client.0.smithi005.stdout:3/461: readlink d2/d17/d46/l52 0 2024-04-16T14:35:33.631 INFO:tasks.workunit.client.0.smithi005.stdout:3/462: write d2/d17/f6f [2909053,94294] 0 2024-04-16T14:35:33.636 INFO:tasks.workunit.client.1.smithi115.stdout:4/182: getdents d1/d15 0 2024-04-16T14:35:33.637 INFO:tasks.workunit.client.0.smithi005.stdout:5/377: mknod d0/d6/d12/d1c/d1e/d48/d5e/d74/c79 0 2024-04-16T14:35:33.637 INFO:tasks.workunit.client.0.smithi005.stdout:5/378: write d0/d6/f54 [992980,23229] 0 2024-04-16T14:35:33.638 INFO:tasks.workunit.client.0.smithi005.stdout:5/379: chown d0/d6/d12/l56 5 1 2024-04-16T14:35:33.638 INFO:tasks.workunit.client.0.smithi005.stdout:5/380: write d0/f76 [4463380,50137] 0 2024-04-16T14:35:33.638 INFO:tasks.workunit.client.0.smithi005.stdout:1/532: dread d2/f62 [0,4194304] 0 2024-04-16T14:35:33.639 INFO:tasks.workunit.client.1.smithi115.stdout:7/162: mkdir d0/d1/d3b 0 2024-04-16T14:35:33.639 INFO:tasks.workunit.client.1.smithi115.stdout:5/106: rmdir dc/d15 39 2024-04-16T14:35:33.640 INFO:tasks.workunit.client.0.smithi005.stdout:9/255: unlink d3/d12/d16/f32 0 2024-04-16T14:35:33.640 INFO:tasks.workunit.client.1.smithi115.stdout:7/163: stat d0/d1/l1b 0 2024-04-16T14:35:33.642 INFO:tasks.workunit.client.1.smithi115.stdout:7/164: unlink d0/f1a 0 2024-04-16T14:35:33.644 INFO:tasks.workunit.client.0.smithi005.stdout:6/475: creat d2/d5/d10/d68/fa2 x:0 0 0 2024-04-16T14:35:33.645 INFO:tasks.workunit.client.0.smithi005.stdout:1/533: dread d2/d1c/d15/d2a/d19/f84 [0,4194304] 0 2024-04-16T14:35:33.646 INFO:tasks.workunit.client.1.smithi115.stdout:6/146: dwrite d13/f1c [0,4194304] 0 2024-04-16T14:35:33.646 INFO:tasks.workunit.client.1.smithi115.stdout:6/147: chown d13/f28 41115 1 2024-04-16T14:35:33.646 INFO:tasks.workunit.client.1.smithi115.stdout:6/148: read - d13/d1a/d25/f27 zero size 2024-04-16T14:35:33.646 INFO:tasks.workunit.client.1.smithi115.stdout:6/149: creat d13/d1a/f29 x:0 0 0 2024-04-16T14:35:33.649 INFO:tasks.workunit.client.0.smithi005.stdout:8/421: rename d5/f1e to d5/d40/d4b/f93 0 2024-04-16T14:35:33.649 INFO:tasks.workunit.client.0.smithi005.stdout:9/256: rename d3 to d3/d12/d2b/d45 22 2024-04-16T14:35:33.649 INFO:tasks.workunit.client.0.smithi005.stdout:9/257: truncate d3/d12/f3e 124063 0 2024-04-16T14:35:33.649 INFO:tasks.workunit.client.0.smithi005.stdout:9/258: chown d3/d12/d16/f1a 29 1 2024-04-16T14:35:33.657 INFO:tasks.workunit.client.1.smithi115.stdout:9/215: dwrite d1/f3 [0,4194304] 0 2024-04-16T14:35:33.658 INFO:tasks.workunit.client.0.smithi005.stdout:5/381: creat d0/d6/d6e/f7a x:0 0 0 2024-04-16T14:35:33.658 INFO:tasks.workunit.client.1.smithi115.stdout:7/165: dread d0/f26 [0,4194304] 0 2024-04-16T14:35:33.658 INFO:tasks.workunit.client.1.smithi115.stdout:8/115: dwrite d0/db/d10/f11 [0,4194304] 0 2024-04-16T14:35:33.658 INFO:tasks.workunit.client.1.smithi115.stdout:8/116: readlink d0/la 0 2024-04-16T14:35:33.659 INFO:tasks.workunit.client.0.smithi005.stdout:5/382: read d0/d6/d12/d1c/f2a [401837,89106] 0 2024-04-16T14:35:33.659 INFO:tasks.workunit.client.0.smithi005.stdout:5/383: chown d0/d6/l2f 9804299 1 2024-04-16T14:35:33.659 INFO:tasks.workunit.client.1.smithi115.stdout:9/216: mknod d1/d10/c42 0 2024-04-16T14:35:33.659 INFO:tasks.workunit.client.1.smithi115.stdout:9/217: truncate d1/d6/f41 1561792 0 2024-04-16T14:35:33.661 INFO:tasks.workunit.client.0.smithi005.stdout:6/476: creat d2/d5/d10/fa3 x:0 0 0 2024-04-16T14:35:33.661 INFO:tasks.workunit.client.0.smithi005.stdout:6/477: stat d2/d5/d10/d4d/d7a/d9d 0 2024-04-16T14:35:33.661 INFO:tasks.workunit.client.0.smithi005.stdout:6/478: write d2/d5/d10/fa3 [329107,11962] 0 2024-04-16T14:35:33.662 INFO:tasks.workunit.client.1.smithi115.stdout:7/166: rename d0/d2/l18 to d0/d24/d2b/l3c 0 2024-04-16T14:35:33.662 INFO:tasks.workunit.client.0.smithi005.stdout:8/422: mknod d5/d7b/d2f/d3d/d7f/d8d/d88/c94 0 2024-04-16T14:35:33.664 INFO:tasks.workunit.client.1.smithi115.stdout:3/179: dwrite dc/f17 [0,4194304] 0 2024-04-16T14:35:33.665 INFO:tasks.workunit.client.0.smithi005.stdout:4/615: getdents d0/d1b 0 2024-04-16T14:35:33.667 INFO:tasks.workunit.client.1.smithi115.stdout:9/218: dread d1/d10/d20/f2c [0,4194304] 0 2024-04-16T14:35:33.668 INFO:tasks.workunit.client.0.smithi005.stdout:5/384: creat d0/d6/d12/d1c/d1e/f7b x:0 0 0 2024-04-16T14:35:33.669 INFO:tasks.workunit.client.0.smithi005.stdout:6/479: mkdir d2/d3f/da4 0 2024-04-16T14:35:33.669 INFO:tasks.workunit.client.0.smithi005.stdout:6/480: fsync d2/d5/f22 0 2024-04-16T14:35:33.670 INFO:tasks.workunit.client.1.smithi115.stdout:0/130: dwrite d6/fc [0,4194304] 0 2024-04-16T14:35:33.670 INFO:tasks.workunit.client.1.smithi115.stdout:9/219: dread d1/d6/d2d/f1f [0,4194304] 0 2024-04-16T14:35:33.670 INFO:tasks.workunit.client.1.smithi115.stdout:9/220: fdatasync d1/d10/d20/f22 0 2024-04-16T14:35:33.670 INFO:tasks.workunit.client.1.smithi115.stdout:3/180: creat dc/d24/f3e x:0 0 0 2024-04-16T14:35:33.671 INFO:tasks.workunit.client.0.smithi005.stdout:4/616: creat d0/d22/d61/fc1 x:0 0 0 2024-04-16T14:35:33.672 INFO:tasks.workunit.client.1.smithi115.stdout:3/181: link dc/c1d dc/d29/d39/c3f 0 2024-04-16T14:35:33.672 INFO:tasks.workunit.client.0.smithi005.stdout:5/385: mknod d0/d6/d12/c7c 0 2024-04-16T14:35:33.672 INFO:tasks.workunit.client.0.smithi005.stdout:5/386: read - d0/d6/f31 zero size 2024-04-16T14:35:33.672 INFO:tasks.workunit.client.1.smithi115.stdout:0/131: getdents d6/d10 0 2024-04-16T14:35:33.674 INFO:tasks.workunit.client.1.smithi115.stdout:9/221: rmdir d1/d6 39 2024-04-16T14:35:33.674 INFO:tasks.workunit.client.0.smithi005.stdout:6/481: mkdir d2/d3f/d47/d84/da5 0 2024-04-16T14:35:33.675 INFO:tasks.workunit.client.1.smithi115.stdout:3/182: mknod dc/d24/c40 0 2024-04-16T14:35:33.675 INFO:tasks.workunit.client.1.smithi115.stdout:3/183: write dc/f31 [393005,53357] 0 2024-04-16T14:35:33.675 INFO:tasks.workunit.client.0.smithi005.stdout:8/423: symlink d5/de/l95 0 2024-04-16T14:35:33.675 INFO:tasks.workunit.client.0.smithi005.stdout:8/424: chown d5/d55/c60 119466 1 2024-04-16T14:35:33.676 INFO:tasks.workunit.client.1.smithi115.stdout:3/184: symlink dc/d24/d36/l41 0 2024-04-16T14:35:33.676 INFO:tasks.workunit.client.0.smithi005.stdout:4/617: truncate d0/f10 11874751 0 2024-04-16T14:35:33.676 INFO:tasks.workunit.client.1.smithi115.stdout:3/185: rename dc/l1e to dc/d24/d33/l42 0 2024-04-16T14:35:33.678 INFO:tasks.workunit.client.1.smithi115.stdout:3/186: mknod dc/d24/d33/c43 0 2024-04-16T14:35:33.678 INFO:tasks.workunit.client.1.smithi115.stdout:3/187: fdatasync dc/d24/f2a 0 2024-04-16T14:35:33.678 INFO:tasks.workunit.client.1.smithi115.stdout:3/188: stat dc 0 2024-04-16T14:35:33.678 INFO:tasks.workunit.client.0.smithi005.stdout:5/387: creat d0/d6/d12/d1c/d1e/d73/f7d x:0 0 0 2024-04-16T14:35:33.679 INFO:tasks.workunit.client.1.smithi115.stdout:4/183: dwrite d1/f22 [4194304,4194304] 0 2024-04-16T14:35:33.679 INFO:tasks.workunit.client.1.smithi115.stdout:4/184: stat d1/f22 0 2024-04-16T14:35:33.680 INFO:tasks.workunit.client.1.smithi115.stdout:6/150: dwrite f12 [0,4194304] 0 2024-04-16T14:35:33.680 INFO:tasks.workunit.client.1.smithi115.stdout:6/151: write d13/d1a/f29 [135781,22275] 0 2024-04-16T14:35:33.680 INFO:tasks.workunit.client.1.smithi115.stdout:6/152: creat d13/f2a x:0 0 0 2024-04-16T14:35:33.681 INFO:tasks.workunit.client.0.smithi005.stdout:9/259: dwrite d3/d12/d16/f1b [0,4194304] 0 2024-04-16T14:35:33.681 INFO:tasks.workunit.client.1.smithi115.stdout:8/117: dwrite d0/db/d10/f11 [0,4194304] 0 2024-04-16T14:35:33.681 INFO:tasks.workunit.client.0.smithi005.stdout:8/425: creat d5/d7b/d2f/f96 x:0 0 0 2024-04-16T14:35:33.681 INFO:tasks.workunit.client.0.smithi005.stdout:8/426: dread - d5/de/f51 zero size 2024-04-16T14:35:33.681 INFO:tasks.workunit.client.0.smithi005.stdout:4/618: truncate d0/d1b/d1d/d4f/f86 628685 0 2024-04-16T14:35:33.682 INFO:tasks.workunit.client.1.smithi115.stdout:4/185: link d1/l1f d1/d15/l2c 0 2024-04-16T14:35:33.688 INFO:tasks.workunit.client.1.smithi115.stdout:6/153: mkdir d13/d1d/d2b 0 2024-04-16T14:35:33.694 INFO:tasks.workunit.client.1.smithi115.stdout:6/154: mkdir d13/d1d/d20/d2c 0 2024-04-16T14:35:33.694 INFO:tasks.workunit.client.1.smithi115.stdout:6/155: creat d13/d1d/d20/f2d x:0 0 0 2024-04-16T14:35:33.697 INFO:tasks.workunit.client.0.smithi005.stdout:9/260: unlink d3/d12/d2b/f2f 0 2024-04-16T14:35:33.697 INFO:tasks.workunit.client.0.smithi005.stdout:9/261: dread - d3/d12/d16/f35 zero size 2024-04-16T14:35:33.697 INFO:tasks.workunit.client.0.smithi005.stdout:9/262: chown d3/f3c 129 1 2024-04-16T14:35:33.697 INFO:tasks.workunit.client.0.smithi005.stdout:9/263: write d3/f41 [360460,40986] 0 2024-04-16T14:35:33.699 INFO:tasks.workunit.client.0.smithi005.stdout:5/388: getdents d0/d6 0 2024-04-16T14:35:33.702 INFO:tasks.workunit.client.1.smithi115.stdout:6/156: mkdir d13/d1a/d25/d2e 0 2024-04-16T14:35:33.702 INFO:tasks.workunit.client.0.smithi005.stdout:6/482: dwrite d2/d5/f2a [0,4194304] 0 2024-04-16T14:35:33.703 INFO:tasks.workunit.client.0.smithi005.stdout:6/483: creat d2/d5/d10/d4d/fa6 x:0 0 0 2024-04-16T14:35:33.704 INFO:tasks.workunit.client.0.smithi005.stdout:9/264: mkdir d3/d12/d16/d46 0 2024-04-16T14:35:33.704 INFO:tasks.workunit.client.0.smithi005.stdout:9/265: truncate d3/f8 5035946 0 2024-04-16T14:35:33.704 INFO:tasks.workunit.client.0.smithi005.stdout:9/266: write d3/d12/f1f [393000,31082] 0 2024-04-16T14:35:33.706 INFO:tasks.workunit.client.0.smithi005.stdout:5/389: unlink d0/d6/d12/d34/d30/c46 0 2024-04-16T14:35:33.707 INFO:tasks.workunit.client.1.smithi115.stdout:8/118: dread d0/f3 [0,4194304] 0 2024-04-16T14:35:33.707 INFO:tasks.workunit.client.1.smithi115.stdout:8/119: creat d0/db/d10/f1e x:0 0 0 2024-04-16T14:35:33.707 INFO:tasks.workunit.client.1.smithi115.stdout:8/120: fsync d0/f1a 0 2024-04-16T14:35:33.710 INFO:tasks.workunit.client.0.smithi005.stdout:6/484: truncate d2/d5/d28/f38 1543810 0 2024-04-16T14:35:33.713 INFO:tasks.workunit.client.0.smithi005.stdout:9/267: unlink d3/d12/f23 0 2024-04-16T14:35:33.717 INFO:tasks.workunit.client.0.smithi005.stdout:5/390: unlink d0/d6/d12/d34/c17 0 2024-04-16T14:35:33.717 INFO:tasks.workunit.client.0.smithi005.stdout:5/391: fdatasync d0/d6/d12/f5b 0 2024-04-16T14:35:33.717 INFO:tasks.workunit.client.0.smithi005.stdout:5/392: fdatasync d0/d6/d12/d34/d42/f59 0 2024-04-16T14:35:33.717 INFO:tasks.workunit.client.0.smithi005.stdout:5/393: fdatasync d0/d6/d12/d1c/f22 0 2024-04-16T14:35:33.717 INFO:tasks.workunit.client.0.smithi005.stdout:5/394: fsync d0/f52 0 2024-04-16T14:35:33.717 INFO:tasks.workunit.client.0.smithi005.stdout:5/395: creat d0/d6/d6e/f7e x:0 0 0 2024-04-16T14:35:33.719 INFO:tasks.workunit.client.0.smithi005.stdout:6/485: mknod d2/d5/d10/d4d/ca7 0 2024-04-16T14:35:33.719 INFO:tasks.workunit.client.0.smithi005.stdout:6/486: write d2/d5/d10/d4d/f80 [983719,121158] 0 2024-04-16T14:35:33.720 INFO:tasks.workunit.client.0.smithi005.stdout:6/487: chown d2/f26 62192691 1 2024-04-16T14:35:33.721 INFO:tasks.workunit.client.0.smithi005.stdout:9/268: mkdir d3/d12/d16/d46/d47 0 2024-04-16T14:35:33.723 INFO:tasks.workunit.client.0.smithi005.stdout:6/488: unlink d2/df/la0 0 2024-04-16T14:35:33.723 INFO:tasks.workunit.client.0.smithi005.stdout:6/489: stat d2/d5/d28/f46 0 2024-04-16T14:35:33.724 INFO:tasks.workunit.client.0.smithi005.stdout:6/490: truncate d2/d20/d72/f78 44348 0 2024-04-16T14:35:33.724 INFO:tasks.workunit.client.0.smithi005.stdout:6/491: mkdir d2/d5/d10/d4d/d8e/da8 0 2024-04-16T14:35:33.725 INFO:tasks.workunit.client.0.smithi005.stdout:6/492: chown d2/f23 0 1 2024-04-16T14:35:33.732 INFO:tasks.workunit.client.0.smithi005.stdout:8/427: dwrite d5/d40/d4b/f93 [0,4194304] 0 2024-04-16T14:35:33.734 INFO:tasks.workunit.client.0.smithi005.stdout:8/428: creat d5/d7b/d2f/d3d/d7f/d8d/f97 x:0 0 0 2024-04-16T14:35:33.734 INFO:tasks.workunit.client.0.smithi005.stdout:8/429: creat d5/d7b/d2f/d3d/d7f/d8d/f98 x:0 0 0 2024-04-16T14:35:33.734 INFO:tasks.workunit.client.0.smithi005.stdout:8/430: read - d5/d7b/d2f/d3d/f87 zero size 2024-04-16T14:35:33.735 INFO:tasks.workunit.client.0.smithi005.stdout:8/431: mknod d5/d7b/d2f/d3d/d7f/d8d/d88/c99 0 2024-04-16T14:35:33.735 INFO:tasks.workunit.client.0.smithi005.stdout:8/432: readlink d5/de/d8a/l8c 0 2024-04-16T14:35:33.737 INFO:tasks.workunit.client.0.smithi005.stdout:8/433: rename d5/d7b/d2f/c57 to d5/d7b/d2f/d3d/c9a 0 2024-04-16T14:35:33.737 INFO:tasks.workunit.client.0.smithi005.stdout:8/434: write d5/f38 [309549,65325] 0 2024-04-16T14:35:33.737 INFO:tasks.workunit.client.0.smithi005.stdout:8/435: truncate d5/f43 5094998 0 2024-04-16T14:35:33.743 INFO:tasks.workunit.client.0.smithi005.stdout:5/396: dread d0/f76 [0,4194304] 0 2024-04-16T14:35:33.743 INFO:tasks.workunit.client.0.smithi005.stdout:5/397: readlink d0/d6/d12/d1c/d1e/l21 0 2024-04-16T14:35:33.744 INFO:tasks.workunit.client.0.smithi005.stdout:5/398: mknod d0/d6/d12/d34/d30/c7f 0 2024-04-16T14:35:33.747 INFO:tasks.workunit.client.0.smithi005.stdout:9/269: dread d3/d12/d16/f1a [4194304,4194304] 0 2024-04-16T14:35:33.748 INFO:tasks.workunit.client.0.smithi005.stdout:9/270: write d3/d12/d16/f1d [1553220,37747] 0 2024-04-16T14:35:33.748 INFO:tasks.workunit.client.0.smithi005.stdout:9/271: write d3/d12/f3e [924512,68982] 0 2024-04-16T14:35:33.755 INFO:tasks.workunit.client.1.smithi115.stdout:0/132: dwrite d6/fc [4194304,4194304] 0 2024-04-16T14:35:33.757 INFO:tasks.workunit.client.1.smithi115.stdout:0/133: mknod d6/d10/d12/d1f/c2f 0 2024-04-16T14:35:33.757 INFO:tasks.workunit.client.1.smithi115.stdout:0/134: chown f1 258 1 2024-04-16T14:35:33.758 INFO:tasks.workunit.client.0.smithi005.stdout:4/619: dwrite d0/f7 [0,4194304] 0 2024-04-16T14:35:33.759 INFO:tasks.workunit.client.1.smithi115.stdout:3/189: dwrite dc/d24/f2a [0,4194304] 0 2024-04-16T14:35:33.759 INFO:tasks.workunit.client.1.smithi115.stdout:3/190: creat dc/d24/d36/f44 x:0 0 0 2024-04-16T14:35:33.759 INFO:tasks.workunit.client.1.smithi115.stdout:0/135: mkdir d6/d30 0 2024-04-16T14:35:33.759 INFO:tasks.workunit.client.1.smithi115.stdout:4/186: dwrite d1/d15/d1e/f29 [0,4194304] 0 2024-04-16T14:35:33.762 INFO:tasks.workunit.client.0.smithi005.stdout:4/620: dread d0/d47/fbc [0,4194304] 0 2024-04-16T14:35:33.762 INFO:tasks.workunit.client.1.smithi115.stdout:3/191: symlink dc/d24/l45 0 2024-04-16T14:35:33.763 INFO:tasks.workunit.client.1.smithi115.stdout:0/136: mkdir d6/d10/d12/d31 0 2024-04-16T14:35:33.763 INFO:tasks.workunit.client.1.smithi115.stdout:0/137: write d6/d10/d12/f1c [1304886,37348] 0 2024-04-16T14:35:33.763 INFO:tasks.workunit.client.0.smithi005.stdout:4/621: mknod d0/d1b/d1d/d1f/d3e/d6d/da1/cc2 0 2024-04-16T14:35:33.763 INFO:tasks.workunit.client.0.smithi005.stdout:4/622: readlink d0/d1b/d1d/d1f/d3e/d6d/lb0 0 2024-04-16T14:35:33.766 INFO:tasks.workunit.client.1.smithi115.stdout:4/187: rename d1/f18 to d1/f2d 0 2024-04-16T14:35:33.766 INFO:tasks.workunit.client.1.smithi115.stdout:4/188: read - d1/d15/d17/f26 zero size 2024-04-16T14:35:33.766 INFO:tasks.workunit.client.1.smithi115.stdout:9/222: dwrite d1/d10/d20/f2c [4194304,4194304] 0 2024-04-16T14:35:33.766 INFO:tasks.workunit.client.1.smithi115.stdout:8/121: dwrite d0/db/fd [0,4194304] 0 2024-04-16T14:35:33.766 INFO:tasks.workunit.client.1.smithi115.stdout:8/122: chown d0/db 57 1 2024-04-16T14:35:33.767 INFO:tasks.workunit.client.0.smithi005.stdout:6/493: dwrite d2/d20/d33/f63 [0,4194304] 0 2024-04-16T14:35:33.767 INFO:tasks.workunit.client.0.smithi005.stdout:8/436: dwrite d5/d7b/f83 [0,4194304] 0 2024-04-16T14:35:33.767 INFO:tasks.workunit.client.1.smithi115.stdout:0/138: creat d6/d10/d12/d1f/f32 x:0 0 0 2024-04-16T14:35:33.768 INFO:tasks.workunit.client.1.smithi115.stdout:0/139: creat d6/f33 x:0 0 0 2024-04-16T14:35:33.768 INFO:tasks.workunit.client.1.smithi115.stdout:9/223: creat d1/d6/d29/f43 x:0 0 0 2024-04-16T14:35:33.768 INFO:tasks.workunit.client.1.smithi115.stdout:9/224: truncate d1/d10/d20/d2a/f37 626127 0 2024-04-16T14:35:33.769 INFO:tasks.workunit.client.0.smithi005.stdout:5/399: dwrite d0/d6/d12/f14 [0,4194304] 0 2024-04-16T14:35:33.770 INFO:tasks.workunit.client.0.smithi005.stdout:8/437: mkdir d5/d9b 0 2024-04-16T14:35:33.771 INFO:tasks.workunit.client.0.smithi005.stdout:6/494: creat d2/d5/d10/d4d/d7a/fa9 x:0 0 0 2024-04-16T14:35:33.772 INFO:tasks.workunit.client.1.smithi115.stdout:6/157: dwrite f12 [0,4194304] 0 2024-04-16T14:35:33.772 INFO:tasks.workunit.client.1.smithi115.stdout:6/158: chown d13/d1a/f1b 468201 1 2024-04-16T14:35:33.772 INFO:tasks.workunit.client.1.smithi115.stdout:6/159: chown d13/d1d/d20 0 1 2024-04-16T14:35:33.772 INFO:tasks.workunit.client.0.smithi005.stdout:8/438: dread d5/de/f59 [0,4194304] 0 2024-04-16T14:35:33.773 INFO:tasks.workunit.client.1.smithi115.stdout:3/192: write dc/d24/f30 [3890351,42461] 0 2024-04-16T14:35:33.773 INFO:tasks.workunit.client.1.smithi115.stdout:3/193: chown dc/d29/d39/c3f 2 1 2024-04-16T14:35:33.774 INFO:tasks.workunit.client.0.smithi005.stdout:9/272: dwrite d3/f8 [0,4194304] 0 2024-04-16T14:35:33.774 INFO:tasks.workunit.client.0.smithi005.stdout:9/273: chown d3/f7 731320 1 2024-04-16T14:35:33.775 INFO:tasks.workunit.client.0.smithi005.stdout:6/495: mkdir d2/d5/d10/d4d/d8e/daa 0 2024-04-16T14:35:33.777 INFO:tasks.workunit.client.0.smithi005.stdout:8/439: symlink d5/d9b/l9c 0 2024-04-16T14:35:33.778 INFO:tasks.workunit.client.0.smithi005.stdout:8/440: chown f3 651 1 2024-04-16T14:35:33.778 INFO:tasks.workunit.client.0.smithi005.stdout:8/441: readlink d5/de/d8a/l8c 0 2024-04-16T14:35:33.778 INFO:tasks.workunit.client.0.smithi005.stdout:8/442: write d5/de/f51 [996666,65929] 0 2024-04-16T14:35:33.778 INFO:tasks.workunit.client.0.smithi005.stdout:8/443: creat d5/d7b/d2f/d3d/d7f/f9d x:0 0 0 2024-04-16T14:35:33.779 INFO:tasks.workunit.client.0.smithi005.stdout:9/274: dread d3/d12/f1f [0,4194304] 0 2024-04-16T14:35:33.780 INFO:tasks.workunit.client.0.smithi005.stdout:9/275: chown d3/l9 461 1 2024-04-16T14:35:33.781 INFO:tasks.workunit.client.0.smithi005.stdout:5/400: getdents d0/d6/d12/d1c/d1e 0 2024-04-16T14:35:33.781 INFO:tasks.workunit.client.1.smithi115.stdout:0/140: dread d6/d10/d12/f1c [0,4194304] 0 2024-04-16T14:35:33.784 INFO:tasks.workunit.client.1.smithi115.stdout:6/160: mknod d13/d1d/d20/d21/c2f 0 2024-04-16T14:35:33.784 INFO:tasks.workunit.client.1.smithi115.stdout:6/161: chown d13/d1d/d2b 656257 1 2024-04-16T14:35:33.784 INFO:tasks.workunit.client.1.smithi115.stdout:6/162: write f8 [1151301,34207] 0 2024-04-16T14:35:33.788 INFO:tasks.workunit.client.0.smithi005.stdout:5/401: dread d0/f11 [0,4194304] 0 2024-04-16T14:35:33.790 INFO:tasks.workunit.client.1.smithi115.stdout:3/194: rename dc/d29/c37 to dc/d24/c46 0 2024-04-16T14:35:33.790 INFO:tasks.workunit.client.1.smithi115.stdout:3/195: chown dc/c1f 143 1 2024-04-16T14:35:33.793 INFO:tasks.workunit.client.1.smithi115.stdout:4/189: dwrite d1/f22 [0,4194304] 0 2024-04-16T14:35:33.794 INFO:tasks.workunit.client.1.smithi115.stdout:6/163: mkdir d13/d1a/d25/d30 0 2024-04-16T14:35:33.794 INFO:tasks.workunit.client.1.smithi115.stdout:6/164: truncate d13/f28 660788 0 2024-04-16T14:35:33.794 INFO:tasks.workunit.client.0.smithi005.stdout:8/444: rename d5/d7b/c53 to d5/d40/d8e/c9e 0 2024-04-16T14:35:33.794 INFO:tasks.workunit.client.0.smithi005.stdout:8/445: stat d5/d40/f61 0 2024-04-16T14:35:33.795 INFO:tasks.workunit.client.1.smithi115.stdout:0/141: rename d6/d10/d12/d1f/d24/l27 to d6/d30/l34 0 2024-04-16T14:35:33.796 INFO:tasks.workunit.client.1.smithi115.stdout:9/225: dwrite d1/d6/f2b [0,4194304] 0 2024-04-16T14:35:33.797 INFO:tasks.workunit.client.1.smithi115.stdout:9/226: chown d1/d10/d20/d36/f39 784454 1 2024-04-16T14:35:33.797 INFO:tasks.workunit.client.1.smithi115.stdout:9/227: write d1/d10/d20/f2c [2409882,78559] 0 2024-04-16T14:35:33.797 INFO:tasks.workunit.client.1.smithi115.stdout:3/196: mknod dc/d24/c47 0 2024-04-16T14:35:33.797 INFO:tasks.workunit.client.1.smithi115.stdout:3/197: creat dc/d29/f48 x:0 0 0 2024-04-16T14:35:33.797 INFO:tasks.workunit.client.1.smithi115.stdout:3/198: write dc/d24/d36/f3b [743245,97054] 0 2024-04-16T14:35:33.797 INFO:tasks.workunit.client.0.smithi005.stdout:5/402: symlink d0/d70/l80 0 2024-04-16T14:35:33.798 INFO:tasks.workunit.client.0.smithi005.stdout:6/496: truncate d2/d5/d10/f13 117254 0 2024-04-16T14:35:33.800 INFO:tasks.workunit.client.1.smithi115.stdout:4/190: rename d1/c5 to d1/d15/d24/c2e 0 2024-04-16T14:35:33.803 INFO:tasks.workunit.client.1.smithi115.stdout:8/123: dwrite d0/db/f15 [0,4194304] 0 2024-04-16T14:35:33.804 INFO:tasks.workunit.client.1.smithi115.stdout:8/124: fdatasync d0/f1a 0 2024-04-16T14:35:33.805 INFO:tasks.workunit.client.1.smithi115.stdout:6/165: getdents d13/d1d/d20 0 2024-04-16T14:35:33.808 INFO:tasks.workunit.client.1.smithi115.stdout:3/199: rename dc/d24/f2a to dc/d24/f49 0 2024-04-16T14:35:33.808 INFO:tasks.workunit.client.1.smithi115.stdout:3/200: creat dc/d24/d36/f4a x:0 0 0 2024-04-16T14:35:33.809 INFO:tasks.workunit.client.1.smithi115.stdout:4/191: mkdir d1/d2f 0 2024-04-16T14:35:33.810 INFO:tasks.workunit.client.0.smithi005.stdout:8/446: symlink d5/d40/d4b/l9f 0 2024-04-16T14:35:33.810 INFO:tasks.workunit.client.0.smithi005.stdout:8/447: chown d5 39 1 2024-04-16T14:35:33.810 INFO:tasks.workunit.client.0.smithi005.stdout:8/448: fsync d5/d55/f86 0 2024-04-16T14:35:33.811 INFO:tasks.workunit.client.1.smithi115.stdout:8/125: rename d0/db/d10/d17/f1c to d0/f1f 0 2024-04-16T14:35:33.813 INFO:tasks.workunit.client.0.smithi005.stdout:6/497: unlink d2/d5/d28/f21 0 2024-04-16T14:35:33.813 INFO:tasks.workunit.client.1.smithi115.stdout:3/201: mkdir dc/d24/d33/d4b 0 2024-04-16T14:35:33.813 INFO:tasks.workunit.client.1.smithi115.stdout:3/202: write dc/d24/d36/f44 [395959,74803] 0 2024-04-16T14:35:33.814 INFO:tasks.workunit.client.1.smithi115.stdout:8/126: rename d0/db/d10/c14 to d0/db/c20 0 2024-04-16T14:35:33.814 INFO:tasks.workunit.client.1.smithi115.stdout:8/127: readlink d0/la 0 2024-04-16T14:35:33.815 INFO:tasks.workunit.client.0.smithi005.stdout:6/498: unlink d2/d5/d28/f79 0 2024-04-16T14:35:33.817 INFO:tasks.workunit.client.1.smithi115.stdout:3/203: rename dc/d24/d36/f44 to dc/d24/d33/d4b/f4c 0 2024-04-16T14:35:33.817 INFO:tasks.workunit.client.1.smithi115.stdout:3/204: chown dc/d29/l38 32 1 2024-04-16T14:35:33.819 INFO:tasks.workunit.client.1.smithi115.stdout:4/192: read d1/d2/f11 [2394102,89984] 0 2024-04-16T14:35:33.819 INFO:tasks.workunit.client.0.smithi005.stdout:6/499: creat d2/d5/d10/d4d/d51/d6e/fab x:0 0 0 2024-04-16T14:35:33.819 INFO:tasks.workunit.client.0.smithi005.stdout:6/500: fdatasync d2/d5/d10/f1d 0 2024-04-16T14:35:33.820 INFO:tasks.workunit.client.1.smithi115.stdout:7/167: sync 2024-04-16T14:35:33.820 INFO:tasks.workunit.client.1.smithi115.stdout:7/168: dread - d0/d2/d3a/d30/f32 zero size 2024-04-16T14:35:33.821 INFO:tasks.workunit.client.1.smithi115.stdout:7/169: write d0/d2/f35 [984743,127081] 0 2024-04-16T14:35:33.821 INFO:tasks.workunit.client.1.smithi115.stdout:1/122: sync 2024-04-16T14:35:33.821 INFO:tasks.workunit.client.1.smithi115.stdout:4/193: rmdir d1/d15/d24 39 2024-04-16T14:35:33.821 INFO:tasks.workunit.client.1.smithi115.stdout:2/154: sync 2024-04-16T14:35:33.821 INFO:tasks.workunit.client.1.smithi115.stdout:5/107: sync 2024-04-16T14:35:33.822 INFO:tasks.workunit.client.0.smithi005.stdout:9/276: dwrite d3/d12/d16/f1b [4194304,4194304] 0 2024-04-16T14:35:33.823 INFO:tasks.workunit.client.1.smithi115.stdout:6/166: dread f6 [0,4194304] 0 2024-04-16T14:35:33.823 INFO:tasks.workunit.client.1.smithi115.stdout:6/167: readlink l10 0 2024-04-16T14:35:33.823 INFO:tasks.workunit.client.1.smithi115.stdout:9/228: dwrite d1/d6/d29/f43 [0,4194304] 0 2024-04-16T14:35:33.824 INFO:tasks.workunit.client.0.smithi005.stdout:5/403: dwrite d0/d6/d12/d34/f49 [0,4194304] 0 2024-04-16T14:35:33.827 INFO:tasks.workunit.client.1.smithi115.stdout:1/123: mknod df/c29 0 2024-04-16T14:35:33.827 INFO:tasks.workunit.client.1.smithi115.stdout:4/194: mknod d1/d15/c30 0 2024-04-16T14:35:33.827 INFO:tasks.workunit.client.1.smithi115.stdout:4/195: stat d1/d15/d1e/l27 0 2024-04-16T14:35:33.828 INFO:tasks.workunit.client.1.smithi115.stdout:4/196: dread - d1/d15/d17/f26 zero size 2024-04-16T14:35:33.828 INFO:tasks.workunit.client.1.smithi115.stdout:4/197: readlink d1/l1c 0 2024-04-16T14:35:33.828 INFO:tasks.workunit.client.1.smithi115.stdout:4/198: write d1/f3 [1555674,35376] 0 2024-04-16T14:35:33.828 INFO:tasks.workunit.client.1.smithi115.stdout:9/229: dread d1/d10/d20/d36/f39 [0,4194304] 0 2024-04-16T14:35:33.828 INFO:tasks.workunit.client.1.smithi115.stdout:6/168: rename d13/d1d/d20/d21/c22 to d13/d1a/d25/d2e/c31 0 2024-04-16T14:35:33.829 INFO:tasks.workunit.client.1.smithi115.stdout:6/169: fsync d13/f28 0 2024-04-16T14:35:33.829 INFO:tasks.workunit.client.0.smithi005.stdout:9/277: rename d3/d12/d2b/c36 to d3/c48 0 2024-04-16T14:35:33.832 INFO:tasks.workunit.client.0.smithi005.stdout:5/404: mkdir d0/d6/d12/d1c/d81 0 2024-04-16T14:35:33.833 INFO:tasks.workunit.client.1.smithi115.stdout:8/128: read d0/db/d10/f11 [1711199,65892] 0 2024-04-16T14:35:33.833 INFO:tasks.workunit.client.1.smithi115.stdout:8/129: readlink d0/la 0 2024-04-16T14:35:33.833 INFO:tasks.workunit.client.1.smithi115.stdout:1/124: chown lc 58 1 2024-04-16T14:35:33.834 INFO:tasks.workunit.client.0.smithi005.stdout:5/405: mkdir d0/d6/d12/d1c/d81/d82 0 2024-04-16T14:35:33.835 INFO:tasks.workunit.client.0.smithi005.stdout:5/406: creat d0/d6/d12/d1c/d1e/d48/f83 x:0 0 0 2024-04-16T14:35:33.836 INFO:tasks.workunit.client.1.smithi115.stdout:5/108: symlink dc/d15/l23 0 2024-04-16T14:35:33.838 INFO:tasks.workunit.client.0.smithi005.stdout:5/407: creat d0/d6/d12/d1c/d1e/d48/d5e/f84 x:0 0 0 2024-04-16T14:35:33.839 INFO:tasks.workunit.client.1.smithi115.stdout:4/199: mkdir d1/d15/d31 0 2024-04-16T14:35:33.839 INFO:tasks.workunit.client.0.smithi005.stdout:5/408: mknod d0/d6/d12/d1c/d1e/d48/d5e/d74/c85 0 2024-04-16T14:35:33.840 INFO:tasks.workunit.client.1.smithi115.stdout:9/230: creat d1/d10/f44 x:0 0 0 2024-04-16T14:35:33.840 INFO:tasks.workunit.client.1.smithi115.stdout:9/231: fdatasync f0 0 2024-04-16T14:35:33.842 INFO:tasks.workunit.client.1.smithi115.stdout:6/170: link f6 d13/d1a/d25/f32 0 2024-04-16T14:35:33.842 INFO:tasks.workunit.client.1.smithi115.stdout:6/171: fsync d13/d1d/d20/f26 0 2024-04-16T14:35:33.846 INFO:tasks.workunit.client.1.smithi115.stdout:6/172: dread d13/d1a/d25/f32 [0,4194304] 0 2024-04-16T14:35:33.848 INFO:tasks.workunit.client.1.smithi115.stdout:8/130: mkdir d0/db/d21 0 2024-04-16T14:35:33.848 INFO:tasks.workunit.client.1.smithi115.stdout:8/131: fsync d0/db/d10/d17/f18 0 2024-04-16T14:35:33.849 INFO:tasks.workunit.client.1.smithi115.stdout:1/125: mkdir df/d1b/d2a 0 2024-04-16T14:35:33.850 INFO:tasks.workunit.client.1.smithi115.stdout:1/126: write df/d19/f21 [741404,115674] 0 2024-04-16T14:35:33.850 INFO:tasks.workunit.client.1.smithi115.stdout:5/109: creat dc/d15/f24 x:0 0 0 2024-04-16T14:35:33.851 INFO:tasks.workunit.client.1.smithi115.stdout:4/200: unlink d1/d15/d1e/l2a 0 2024-04-16T14:35:33.852 INFO:tasks.workunit.client.1.smithi115.stdout:6/173: mknod d13/d1d/c33 0 2024-04-16T14:35:33.852 INFO:tasks.workunit.client.1.smithi115.stdout:6/174: fsync f11 0 2024-04-16T14:35:33.854 INFO:tasks.workunit.client.1.smithi115.stdout:8/132: rename d0/db/d21 to d0/db/d10/d17/d22 0 2024-04-16T14:35:33.855 INFO:tasks.workunit.client.1.smithi115.stdout:1/127: mkdir df/d1b/d2a/d2b 0 2024-04-16T14:35:33.857 INFO:tasks.workunit.client.1.smithi115.stdout:1/128: write df/f12 [487966,78286] 0 2024-04-16T14:35:33.857 INFO:tasks.workunit.client.1.smithi115.stdout:1/129: stat ld 0 2024-04-16T14:35:33.857 INFO:tasks.workunit.client.1.smithi115.stdout:1/130: dread - df/d1b/f1e zero size 2024-04-16T14:35:33.857 INFO:tasks.workunit.client.1.smithi115.stdout:1/131: dread - df/d13/f16 zero size 2024-04-16T14:35:33.858 INFO:tasks.workunit.client.1.smithi115.stdout:6/175: mknod d13/c34 0 2024-04-16T14:35:33.859 INFO:tasks.workunit.client.1.smithi115.stdout:8/133: mknod d0/db/d10/c23 0 2024-04-16T14:35:33.859 INFO:tasks.workunit.client.1.smithi115.stdout:8/134: write d0/f1f [443557,40412] 0 2024-04-16T14:35:33.859 INFO:tasks.workunit.client.1.smithi115.stdout:6/176: symlink d13/d1a/d25/l35 0 2024-04-16T14:35:33.861 INFO:tasks.workunit.client.1.smithi115.stdout:8/135: creat d0/db/f24 x:0 0 0 2024-04-16T14:35:33.863 INFO:tasks.workunit.client.1.smithi115.stdout:8/136: mkdir d0/db/d10/d25 0 2024-04-16T14:35:33.863 INFO:tasks.workunit.client.1.smithi115.stdout:8/137: creat d0/db/f26 x:0 0 0 2024-04-16T14:35:33.863 INFO:tasks.workunit.client.1.smithi115.stdout:8/138: chown d0/db/d10/d17/d22 39 1 2024-04-16T14:35:33.863 INFO:tasks.workunit.client.1.smithi115.stdout:6/177: write d13/f18 [485923,106521] 0 2024-04-16T14:35:33.865 INFO:tasks.workunit.client.1.smithi115.stdout:8/139: creat d0/db/d10/d17/d22/f27 x:0 0 0 2024-04-16T14:35:33.867 INFO:tasks.workunit.client.1.smithi115.stdout:8/140: symlink d0/db/l28 0 2024-04-16T14:35:33.868 INFO:tasks.workunit.client.0.smithi005.stdout:6/501: dwrite d2/d5/d28/f67 [0,4194304] 0 2024-04-16T14:35:33.868 INFO:tasks.workunit.client.0.smithi005.stdout:6/502: stat d2/d20/d3c 0 2024-04-16T14:35:33.869 INFO:tasks.workunit.client.1.smithi115.stdout:8/141: creat d0/db/d10/d17/d22/f29 x:0 0 0 2024-04-16T14:35:33.869 INFO:tasks.workunit.client.1.smithi115.stdout:5/110: dread dc/d15/f17 [4194304,4194304] 0 2024-04-16T14:35:33.869 INFO:tasks.workunit.client.1.smithi115.stdout:3/205: dwrite dc/f1a [0,4194304] 0 2024-04-16T14:35:33.869 INFO:tasks.workunit.client.1.smithi115.stdout:7/170: dwrite d0/f36 [0,4194304] 0 2024-04-16T14:35:33.869 INFO:tasks.workunit.client.1.smithi115.stdout:7/171: chown d0/d24/d2b/f39 14 1 2024-04-16T14:35:33.870 INFO:tasks.workunit.client.0.smithi005.stdout:8/449: getdents d5/d40/d4b 0 2024-04-16T14:35:33.870 INFO:tasks.workunit.client.1.smithi115.stdout:8/142: symlink d0/db/d10/l2a 0 2024-04-16T14:35:33.870 INFO:tasks.workunit.client.1.smithi115.stdout:8/143: chown d0/db/d10/d17/d22/f27 32316927 1 2024-04-16T14:35:33.870 INFO:tasks.workunit.client.1.smithi115.stdout:8/144: creat d0/db/d10/d17/f2b x:0 0 0 2024-04-16T14:35:33.870 INFO:tasks.workunit.client.1.smithi115.stdout:8/145: dread - d0/db/f26 zero size 2024-04-16T14:35:33.871 INFO:tasks.workunit.client.1.smithi115.stdout:5/111: unlink dc/d15/f20 0 2024-04-16T14:35:33.872 INFO:tasks.workunit.client.1.smithi115.stdout:3/206: mkdir dc/d29/d4d 0 2024-04-16T14:35:33.872 INFO:tasks.workunit.client.1.smithi115.stdout:3/207: readlink dc/d24/l45 0 2024-04-16T14:35:33.874 INFO:tasks.workunit.client.1.smithi115.stdout:7/172: mknod d0/c3d 0 2024-04-16T14:35:33.875 INFO:tasks.workunit.client.0.smithi005.stdout:9/278: dwrite d3/f7 [0,4194304] 0 2024-04-16T14:35:33.875 INFO:tasks.workunit.client.0.smithi005.stdout:8/450: dread d5/de/d8a/f91 [0,4194304] 0 2024-04-16T14:35:33.875 INFO:tasks.workunit.client.0.smithi005.stdout:9/279: chown d3/l18 118242551 1 2024-04-16T14:35:33.877 INFO:tasks.workunit.client.1.smithi115.stdout:9/232: dwrite d1/f19 [4194304,4194304] 0 2024-04-16T14:35:33.877 INFO:tasks.workunit.client.1.smithi115.stdout:1/132: dwrite df/d19/f24 [0,4194304] 0 2024-04-16T14:35:33.877 INFO:tasks.workunit.client.1.smithi115.stdout:1/133: stat df/f12 0 2024-04-16T14:35:33.877 INFO:tasks.workunit.client.0.smithi005.stdout:6/503: read d2/f18 [779009,77234] 0 2024-04-16T14:35:33.878 INFO:tasks.workunit.client.1.smithi115.stdout:4/201: dwrite d1/d15/f20 [0,4194304] 0 2024-04-16T14:35:33.878 INFO:tasks.workunit.client.1.smithi115.stdout:2/155: dwrite d0/d1b/f38 [0,4194304] 0 2024-04-16T14:35:33.879 INFO:tasks.workunit.client.1.smithi115.stdout:2/156: truncate d0/d4/d24/d10/f16 463194 0 2024-04-16T14:35:33.879 INFO:tasks.workunit.client.1.smithi115.stdout:2/157: chown d0/d1b 0 1 2024-04-16T14:35:33.879 INFO:tasks.workunit.client.1.smithi115.stdout:8/146: mkdir d0/db/d10/d17/d2c 0 2024-04-16T14:35:33.879 INFO:tasks.workunit.client.0.smithi005.stdout:8/451: rename d5/d7b/d2f/d89 to d5/da0 0 2024-04-16T14:35:33.880 INFO:tasks.workunit.client.0.smithi005.stdout:9/280: mkdir d3/d49 0 2024-04-16T14:35:33.882 INFO:tasks.workunit.client.1.smithi115.stdout:3/208: rename dc/d29/f2d to dc/d24/d36/f4e 0 2024-04-16T14:35:33.882 INFO:tasks.workunit.client.1.smithi115.stdout:3/209: chown dc/d24/c47 107320 1 2024-04-16T14:35:33.885 INFO:tasks.workunit.client.0.smithi005.stdout:6/504: symlink d2/d3f/d47/d84/da5/lac 0 2024-04-16T14:35:33.886 INFO:tasks.workunit.client.1.smithi115.stdout:9/233: creat d1/d6/f45 x:0 0 0 2024-04-16T14:35:33.888 INFO:tasks.workunit.client.1.smithi115.stdout:1/134: chown c6 3417723 1 2024-04-16T14:35:33.888 INFO:tasks.workunit.client.1.smithi115.stdout:1/135: write fe [58835,39907] 0 2024-04-16T14:35:33.888 INFO:tasks.workunit.client.1.smithi115.stdout:1/136: truncate df/f25 399064 0 2024-04-16T14:35:33.888 INFO:tasks.workunit.client.1.smithi115.stdout:9/234: dread d1/d10/d20/f22 [0,4194304] 0 2024-04-16T14:35:33.888 INFO:tasks.workunit.client.1.smithi115.stdout:9/235: creat d1/d10/f46 x:0 0 0 2024-04-16T14:35:33.889 INFO:tasks.workunit.client.0.smithi005.stdout:6/505: readlink d2/d20/d3c/l94 0 2024-04-16T14:35:33.890 INFO:tasks.workunit.client.1.smithi115.stdout:9/236: dread d1/d10/f26 [0,4194304] 0 2024-04-16T14:35:33.892 INFO:tasks.workunit.client.1.smithi115.stdout:6/178: getdents d13/d1d/d20/d21 0 2024-04-16T14:35:33.895 INFO:tasks.workunit.client.1.smithi115.stdout:2/158: creat d0/d4/d24/d10/f39 x:0 0 0 2024-04-16T14:35:33.896 INFO:tasks.workunit.client.1.smithi115.stdout:8/147: mkdir d0/db/d10/d25/d2d 0 2024-04-16T14:35:33.896 INFO:tasks.workunit.client.0.smithi005.stdout:6/506: dread d2/f26 [0,4194304] 0 2024-04-16T14:35:33.896 INFO:tasks.workunit.client.0.smithi005.stdout:8/452: rename d5/d7b/d2f to d5/de/d8a/da1 0 2024-04-16T14:35:33.896 INFO:tasks.workunit.client.0.smithi005.stdout:8/453: creat d5/d40/fa2 x:0 0 0 2024-04-16T14:35:33.898 INFO:tasks.workunit.client.1.smithi115.stdout:5/112: link l7 dc/d15/l25 0 2024-04-16T14:35:33.898 INFO:tasks.workunit.client.0.smithi005.stdout:8/454: mknod d5/de/d8a/da1/ca3 0 2024-04-16T14:35:33.898 INFO:tasks.workunit.client.0.smithi005.stdout:6/507: unlink d2/d5/d28/l3b 0 2024-04-16T14:35:33.899 INFO:tasks.workunit.client.1.smithi115.stdout:3/210: mknod dc/d29/d39/c4f 0 2024-04-16T14:35:33.902 INFO:tasks.workunit.client.0.smithi005.stdout:8/455: unlink d5/d40/d4b/l63 0 2024-04-16T14:35:33.902 INFO:tasks.workunit.client.0.smithi005.stdout:6/508: symlink d2/d5/d10/d4d/lad 0 2024-04-16T14:35:33.903 INFO:tasks.workunit.client.0.smithi005.stdout:8/456: mknod d5/d11/d6c/d71/ca4 0 2024-04-16T14:35:33.903 INFO:tasks.workunit.client.1.smithi115.stdout:1/137: rename df/d19 to df/d1b/d2a/d2c 0 2024-04-16T14:35:33.903 INFO:tasks.workunit.client.1.smithi115.stdout:1/138: chown df/f14 748 1 2024-04-16T14:35:33.903 INFO:tasks.workunit.client.1.smithi115.stdout:1/139: chown df/c29 1838171 1 2024-04-16T14:35:33.903 INFO:tasks.workunit.client.1.smithi115.stdout:1/140: write df/f11 [960971,33761] 0 2024-04-16T14:35:33.903 INFO:tasks.workunit.client.0.smithi005.stdout:6/509: mknod d2/d5/d10/d4d/d8e/da8/cae 0 2024-04-16T14:35:33.904 INFO:tasks.workunit.client.0.smithi005.stdout:6/510: creat d2/d5/d10/d4d/d7a/faf x:0 0 0 2024-04-16T14:35:33.904 INFO:tasks.workunit.client.0.smithi005.stdout:8/457: truncate d5/d11/f20 2870723 0 2024-04-16T14:35:33.904 INFO:tasks.workunit.client.0.smithi005.stdout:8/458: chown d5/de/d8a/da1/f31 52061030 1 2024-04-16T14:35:33.905 INFO:tasks.workunit.client.1.smithi115.stdout:9/237: symlink d1/d10/d20/d36/l47 0 2024-04-16T14:35:33.905 INFO:tasks.workunit.client.1.smithi115.stdout:9/238: stat d1/d6/cb 0 2024-04-16T14:35:33.906 INFO:tasks.workunit.client.1.smithi115.stdout:9/239: dread - d1/d10/d20/f3c zero size 2024-04-16T14:35:33.906 INFO:tasks.workunit.client.1.smithi115.stdout:7/173: dwrite d0/d24/d2b/f39 [0,4194304] 0 2024-04-16T14:35:33.906 INFO:tasks.workunit.client.0.smithi005.stdout:8/459: mkdir d5/de/d8a/da1/d3d/d7f/d8d/d88/da5 0 2024-04-16T14:35:33.907 INFO:tasks.workunit.client.1.smithi115.stdout:2/159: rmdir d0/d4/d22/d2e 0 2024-04-16T14:35:33.908 INFO:tasks.workunit.client.1.smithi115.stdout:2/160: getdents d0/d4/d24/d21 0 2024-04-16T14:35:33.908 INFO:tasks.workunit.client.1.smithi115.stdout:2/161: chown d0/d4/de/d11/d25/c27 1593 1 2024-04-16T14:35:33.908 INFO:tasks.workunit.client.0.smithi005.stdout:6/511: mkdir d2/d45/db0 0 2024-04-16T14:35:33.909 INFO:tasks.workunit.client.1.smithi115.stdout:6/179: rename d13/d1a/f1b to d13/d1d/f36 0 2024-04-16T14:35:33.910 INFO:tasks.workunit.client.0.smithi005.stdout:6/512: getdents d2/d3f/d53/d54 0 2024-04-16T14:35:33.911 INFO:tasks.workunit.client.1.smithi115.stdout:4/202: dwrite d1/d15/d1e/f29 [4194304,4194304] 0 2024-04-16T14:35:33.911 INFO:tasks.workunit.client.0.smithi005.stdout:6/513: mknod d2/d5/d10/d4d/d7a/cb1 0 2024-04-16T14:35:33.912 INFO:tasks.workunit.client.0.smithi005.stdout:6/514: rmdir d2/d20/d33 39 2024-04-16T14:35:33.913 INFO:tasks.workunit.client.1.smithi115.stdout:3/211: dread dc/ff [0,4194304] 0 2024-04-16T14:35:33.914 INFO:tasks.workunit.client.1.smithi115.stdout:7/174: mkdir d0/d1/d3b/d3e 0 2024-04-16T14:35:33.914 INFO:tasks.workunit.client.1.smithi115.stdout:7/175: chown d0/d24/d2b/l3c 895465 1 2024-04-16T14:35:33.914 INFO:tasks.workunit.client.1.smithi115.stdout:7/176: stat d0/d2/d3a/d30/f32 0 2024-04-16T14:35:33.915 INFO:tasks.workunit.client.0.smithi005.stdout:2/216: sync 2024-04-16T14:35:33.915 INFO:tasks.workunit.client.0.smithi005.stdout:2/217: readlink d0/d4/d2b/l15 0 2024-04-16T14:35:33.915 INFO:tasks.workunit.client.0.smithi005.stdout:2/218: dread - d0/d4/f3b zero size 2024-04-16T14:35:33.916 INFO:tasks.workunit.client.1.smithi115.stdout:8/148: dwrite d0/db/d10/f1e [0,4194304] 0 2024-04-16T14:35:33.916 INFO:tasks.workunit.client.1.smithi115.stdout:8/149: write d0/db/fd [8866361,67168] 0 2024-04-16T14:35:33.916 INFO:tasks.workunit.client.1.smithi115.stdout:9/240: rename d1/d6/l24 to d1/d10/d20/d2a/l48 0 2024-04-16T14:35:33.916 INFO:tasks.workunit.client.1.smithi115.stdout:8/150: read d0/db/d10/d17/f1d [183976,19165] 0 2024-04-16T14:35:33.917 INFO:tasks.workunit.client.1.smithi115.stdout:6/180: symlink d13/d1a/l37 0 2024-04-16T14:35:33.917 INFO:tasks.workunit.client.1.smithi115.stdout:6/181: fdatasync d13/d1d/d20/f26 0 2024-04-16T14:35:33.918 INFO:tasks.workunit.client.0.smithi005.stdout:2/219: rename d0/d2a/f35 to d0/d4/d2b/f40 0 2024-04-16T14:35:33.918 INFO:tasks.workunit.client.0.smithi005.stdout:6/515: rmdir d2/d3f/d47 39 2024-04-16T14:35:33.920 INFO:tasks.workunit.client.0.smithi005.stdout:2/220: symlink d0/l41 0 2024-04-16T14:35:33.922 INFO:tasks.workunit.client.1.smithi115.stdout:5/113: dwrite dc/d15/f24 [0,4194304] 0 2024-04-16T14:35:33.922 INFO:tasks.workunit.client.1.smithi115.stdout:5/114: read - dc/f13 zero size 2024-04-16T14:35:33.922 INFO:tasks.workunit.client.0.smithi005.stdout:6/516: mkdir d2/d45/d7b/db2 0 2024-04-16T14:35:33.923 INFO:tasks.workunit.client.1.smithi115.stdout:7/177: mkdir d0/d1/d3b/d3f 0 2024-04-16T14:35:33.924 INFO:tasks.workunit.client.0.smithi005.stdout:6/517: dread d2/d5/d10/fa3 [0,4194304] 0 2024-04-16T14:35:33.925 INFO:tasks.workunit.client.0.smithi005.stdout:8/460: dwrite d5/d11/f4a [4194304,4194304] 0 2024-04-16T14:35:33.925 INFO:tasks.workunit.client.0.smithi005.stdout:8/461: fdatasync d5/d40/f61 0 2024-04-16T14:35:33.925 INFO:tasks.workunit.client.0.smithi005.stdout:8/462: chown d5/f38 0 1 2024-04-16T14:35:33.926 INFO:tasks.workunit.client.0.smithi005.stdout:6/518: creat d2/d20/d33/fb3 x:0 0 0 2024-04-16T14:35:33.928 INFO:tasks.workunit.client.0.smithi005.stdout:2/221: write d0/d1c/f20 [3673872,57787] 0 2024-04-16T14:35:33.929 INFO:tasks.workunit.client.1.smithi115.stdout:2/162: rename d0/d4/d24/d10/f16 to d0/d4/f3a 0 2024-04-16T14:35:33.929 INFO:tasks.workunit.client.0.smithi005.stdout:8/463: creat d5/de/d8a/da1/d3d/d7f/d8d/d88/da5/fa6 x:0 0 0 2024-04-16T14:35:33.929 INFO:tasks.workunit.client.0.smithi005.stdout:8/464: dread - d5/de/f5d zero size 2024-04-16T14:35:33.930 INFO:tasks.workunit.client.1.smithi115.stdout:8/151: symlink d0/db/d10/l2e 0 2024-04-16T14:35:33.930 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:33 smithi115 ceph-mon[37295]: pgmap v21: 65 pgs: 65 active+clean; 487 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 32 MiB/s rd, 37 MiB/s wr, 84 op/s 2024-04-16T14:35:33.931 INFO:tasks.workunit.client.0.smithi005.stdout:6/519: mkdir d2/d20/d33/d64/d96/db4 0 2024-04-16T14:35:33.931 INFO:tasks.workunit.client.0.smithi005.stdout:6/520: dread - d2/d5/d10/d4d/fa6 zero size 2024-04-16T14:35:33.932 INFO:tasks.workunit.client.1.smithi115.stdout:6/182: unlink d13/d1d/d20/f26 0 2024-04-16T14:35:33.934 INFO:tasks.workunit.client.0.smithi005.stdout:8/465: creat d5/de/d8a/da1/d3d/d7f/d8d/d88/fa7 x:0 0 0 2024-04-16T14:35:33.935 INFO:tasks.workunit.client.0.smithi005.stdout:6/521: mkdir d2/d3f/d53/d54/db5 0 2024-04-16T14:35:33.937 INFO:tasks.workunit.client.0.smithi005.stdout:6/522: mknod d2/d20/d72/cb6 0 2024-04-16T14:35:33.937 INFO:tasks.workunit.client.0.smithi005.stdout:8/466: dread d5/de/d8a/da1/d3d/d7f/f81 [0,4194304] 0 2024-04-16T14:35:33.942 INFO:tasks.workunit.client.0.smithi005.stdout:2/222: dwrite d0/d4/f3c [0,4194304] 0 2024-04-16T14:35:33.943 INFO:tasks.workunit.client.1.smithi115.stdout:7/178: mkdir d0/d24/d40 0 2024-04-16T14:35:33.946 INFO:tasks.workunit.client.0.smithi005.stdout:2/223: creat d0/d29/d3e/f42 x:0 0 0 2024-04-16T14:35:33.947 INFO:tasks.workunit.client.1.smithi115.stdout:6/183: write d13/d1a/f23 [2478436,53905] 0 2024-04-16T14:35:33.948 INFO:tasks.workunit.client.1.smithi115.stdout:4/203: rename d1/l9 to d1/d2f/l32 0 2024-04-16T14:35:33.950 INFO:tasks.workunit.client.0.smithi005.stdout:8/467: rename d5/de/d8a/da1/d3d/d7f/d8d/d88 to d5/d7b/da8 0 2024-04-16T14:35:33.950 INFO:tasks.workunit.client.0.smithi005.stdout:8/468: fdatasync d5/d11/d6c/f8f 0 2024-04-16T14:35:33.951 INFO:tasks.workunit.client.1.smithi115.stdout:5/115: write dc/d15/f18 [1966033,123312] 0 2024-04-16T14:35:33.953 INFO:tasks.workunit.client.1.smithi115.stdout:8/152: symlink d0/db/d10/l2f 0 2024-04-16T14:35:33.955 INFO:tasks.workunit.client.1.smithi115.stdout:6/184: symlink d13/l38 0 2024-04-16T14:35:33.957 INFO:tasks.workunit.client.1.smithi115.stdout:3/212: rename dc/d24/c46 to dc/d29/d39/c50 0 2024-04-16T14:35:33.957 INFO:tasks.workunit.client.1.smithi115.stdout:3/213: fdatasync f6 0 2024-04-16T14:35:33.957 INFO:tasks.workunit.client.1.smithi115.stdout:3/214: stat dc/f15 0 2024-04-16T14:35:33.958 INFO:tasks.workunit.client.1.smithi115.stdout:3/215: dread - dc/fe zero size 2024-04-16T14:35:33.958 INFO:tasks.workunit.client.1.smithi115.stdout:6/185: dread d13/d1a/f29 [0,4194304] 0 2024-04-16T14:35:33.958 INFO:tasks.workunit.client.1.smithi115.stdout:6/186: fdatasync d13/f2a 0 2024-04-16T14:35:33.964 INFO:tasks.workunit.client.0.smithi005.stdout:8/469: dread d5/de/d8a/da1/d68/f75 [0,4194304] 0 2024-04-16T14:35:33.964 INFO:tasks.workunit.client.0.smithi005.stdout:8/470: creat d5/d11/d6c/fa9 x:0 0 0 2024-04-16T14:35:33.964 INFO:tasks.workunit.client.0.smithi005.stdout:8/471: creat d5/d11/d6c/faa x:0 0 0 2024-04-16T14:35:33.965 INFO:tasks.workunit.client.1.smithi115.stdout:6/187: rename d13/f18 to d13/d1d/d20/d2c/f39 0 2024-04-16T14:35:33.965 INFO:tasks.workunit.client.0.smithi005.stdout:8/472: stat d5/de/d8a/da1/d68/f75 0 2024-04-16T14:35:33.966 INFO:tasks.workunit.client.0.smithi005.stdout:6/523: dwrite d2/f18 [4194304,4194304] 0 2024-04-16T14:35:33.966 INFO:tasks.workunit.client.0.smithi005.stdout:8/473: dread d5/de/f59 [0,4194304] 0 2024-04-16T14:35:33.966 INFO:tasks.workunit.client.1.smithi115.stdout:2/163: truncate d0/d1b/f38 3281771 0 2024-04-16T14:35:33.968 INFO:tasks.workunit.client.0.smithi005.stdout:8/474: creat d5/de/d8a/fab x:0 0 0 2024-04-16T14:35:33.969 INFO:tasks.workunit.client.0.smithi005.stdout:6/524: getdents d2/d5/d10/d4d/d51 0 2024-04-16T14:35:33.970 INFO:tasks.workunit.client.1.smithi115.stdout:8/153: write d0/f3 [3176735,39380] 0 2024-04-16T14:35:33.970 INFO:tasks.workunit.client.1.smithi115.stdout:5/116: rmdir dc 39 2024-04-16T14:35:33.971 INFO:tasks.workunit.client.0.smithi005.stdout:8/475: creat d5/d40/d8e/fac x:0 0 0 2024-04-16T14:35:33.972 INFO:tasks.workunit.client.1.smithi115.stdout:2/164: mkdir d0/d4/d24/d21/d3b 0 2024-04-16T14:35:33.973 INFO:tasks.workunit.client.0.smithi005.stdout:8/476: truncate d5/f66 3286426 0 2024-04-16T14:35:33.973 INFO:tasks.workunit.client.0.smithi005.stdout:8/477: fdatasync d5/d11/f6f 0 2024-04-16T14:35:33.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:33 smithi005 ceph-mon[28964]: pgmap v21: 65 pgs: 65 active+clean; 487 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 32 MiB/s rd, 37 MiB/s wr, 84 op/s 2024-04-16T14:35:33.974 INFO:tasks.workunit.client.1.smithi115.stdout:5/117: creat dc/f26 x:0 0 0 2024-04-16T14:35:33.975 INFO:tasks.workunit.client.1.smithi115.stdout:5/118: stat dc/d15/f17 0 2024-04-16T14:35:33.975 INFO:tasks.workunit.client.1.smithi115.stdout:3/216: dread dc/f1a [0,4194304] 0 2024-04-16T14:35:33.978 INFO:tasks.workunit.client.1.smithi115.stdout:7/179: dwrite d0/d1/f20 [0,4194304] 0 2024-04-16T14:35:33.978 INFO:tasks.workunit.client.1.smithi115.stdout:7/180: write d0/d24/f37 [458358,13832] 0 2024-04-16T14:35:33.980 INFO:tasks.workunit.client.1.smithi115.stdout:1/141: rename df/d1b to df/d2d 0 2024-04-16T14:35:33.982 INFO:tasks.workunit.client.1.smithi115.stdout:3/217: dread dc/f31 [0,4194304] 0 2024-04-16T14:35:33.985 INFO:tasks.workunit.client.1.smithi115.stdout:5/119: dread f1 [4194304,4194304] 0 2024-04-16T14:35:33.985 INFO:tasks.workunit.client.1.smithi115.stdout:5/120: chown dc/f11 113628 1 2024-04-16T14:35:33.987 INFO:tasks.workunit.client.1.smithi115.stdout:7/181: mknod d0/d2/c41 0 2024-04-16T14:35:33.987 INFO:tasks.workunit.client.1.smithi115.stdout:7/182: read - d0/d2/d3a/d30/f32 zero size 2024-04-16T14:35:33.989 INFO:tasks.workunit.client.1.smithi115.stdout:1/142: creat df/d2d/d2a/f2e x:0 0 0 2024-04-16T14:35:33.989 INFO:tasks.workunit.client.1.smithi115.stdout:1/143: write f3 [4239905,111588] 0 2024-04-16T14:35:33.989 INFO:tasks.workunit.client.1.smithi115.stdout:1/144: rename df to df/d2d/d2f 22 2024-04-16T14:35:33.991 INFO:tasks.workunit.client.1.smithi115.stdout:3/218: rename dc/c1d to dc/c51 0 2024-04-16T14:35:33.991 INFO:tasks.workunit.client.1.smithi115.stdout:3/219: stat dc/l20 0 2024-04-16T14:35:33.992 INFO:tasks.workunit.client.1.smithi115.stdout:5/121: creat dc/d15/f27 x:0 0 0 2024-04-16T14:35:33.994 INFO:tasks.workunit.client.1.smithi115.stdout:1/145: rename df/d13/f18 to df/d13/f30 0 2024-04-16T14:35:33.995 INFO:tasks.workunit.client.1.smithi115.stdout:3/220: truncate dc/f1a 1293807 0 2024-04-16T14:35:33.996 INFO:tasks.workunit.client.1.smithi115.stdout:7/183: write d0/d1/f20 [1830598,83320] 0 2024-04-16T14:35:33.998 INFO:tasks.workunit.client.1.smithi115.stdout:7/184: rename d0/c1e to d0/d1/d3b/d3e/c42 0 2024-04-16T14:35:34.000 INFO:tasks.workunit.client.1.smithi115.stdout:1/146: dread f9 [0,4194304] 0 2024-04-16T14:35:34.001 INFO:tasks.workunit.client.1.smithi115.stdout:1/147: mknod df/d13/c31 0 2024-04-16T14:35:34.001 INFO:tasks.workunit.client.1.smithi115.stdout:1/148: read - df/f22 zero size 2024-04-16T14:35:34.001 INFO:tasks.workunit.client.1.smithi115.stdout:1/149: readlink df/l26 0 2024-04-16T14:35:34.007 INFO:tasks.workunit.client.1.smithi115.stdout:3/221: dread dc/f17 [0,4194304] 0 2024-04-16T14:35:34.007 INFO:tasks.workunit.client.1.smithi115.stdout:3/222: stat dc/fe 0 2024-04-16T14:35:34.009 INFO:tasks.workunit.client.1.smithi115.stdout:7/185: read d0/d1/f1f [2071852,50207] 0 2024-04-16T14:35:34.011 INFO:tasks.workunit.client.1.smithi115.stdout:2/165: dwrite d0/d4/d24/f34 [0,4194304] 0 2024-04-16T14:35:34.011 INFO:tasks.workunit.client.1.smithi115.stdout:6/188: dwrite d13/d1d/d20/d2c/f39 [0,4194304] 0 2024-04-16T14:35:34.011 INFO:tasks.workunit.client.1.smithi115.stdout:4/204: dwrite d1/d15/d17/f26 [0,4194304] 0 2024-04-16T14:35:34.011 INFO:tasks.workunit.client.1.smithi115.stdout:4/205: chown d1/d15/d17/f19 380320 1 2024-04-16T14:35:34.011 INFO:tasks.workunit.client.1.smithi115.stdout:8/154: dwrite d0/db/d10/d17/f2b [0,4194304] 0 2024-04-16T14:35:34.011 INFO:tasks.workunit.client.0.smithi005.stdout:6/525: dwrite d2/d5/f2f [4194304,4194304] 0 2024-04-16T14:35:34.012 INFO:tasks.workunit.client.1.smithi115.stdout:7/186: symlink d0/d24/l43 0 2024-04-16T14:35:34.012 INFO:tasks.workunit.client.1.smithi115.stdout:7/187: dread - d0/d2/d3a/d30/f32 zero size 2024-04-16T14:35:34.012 INFO:tasks.workunit.client.0.smithi005.stdout:6/526: mknod d2/d3f/d53/d54/db5/cb7 0 2024-04-16T14:35:34.012 INFO:tasks.workunit.client.0.smithi005.stdout:6/527: fdatasync d2/d20/d33/f4c 0 2024-04-16T14:35:34.014 INFO:tasks.workunit.client.1.smithi115.stdout:1/150: write df/d2d/d2a/d2c/f24 [561166,2718] 0 2024-04-16T14:35:34.014 INFO:tasks.workunit.client.0.smithi005.stdout:6/528: rename d2/d45/db0 to d2/d5/d28/db8 0 2024-04-16T14:35:34.016 INFO:tasks.workunit.client.0.smithi005.stdout:6/529: link d2/d20/d33/f4c d2/d5/d28/db8/fb9 0 2024-04-16T14:35:34.017 INFO:tasks.workunit.client.1.smithi115.stdout:5/122: getdents dc 0 2024-04-16T14:35:34.022 INFO:tasks.workunit.client.1.smithi115.stdout:8/155: write d0/db/f15 [3149491,7144] 0 2024-04-16T14:35:34.022 INFO:tasks.workunit.client.1.smithi115.stdout:8/156: write d0/db/d10/d17/f18 [175528,56382] 0 2024-04-16T14:35:34.022 INFO:tasks.workunit.client.1.smithi115.stdout:8/157: creat d0/db/f30 x:0 0 0 2024-04-16T14:35:34.022 INFO:tasks.workunit.client.1.smithi115.stdout:2/166: dread d0/f1a [0,4194304] 0 2024-04-16T14:35:34.025 INFO:tasks.workunit.client.1.smithi115.stdout:6/189: link d13/l15 d13/d1a/d25/d2e/l3a 0 2024-04-16T14:35:34.027 INFO:tasks.workunit.client.1.smithi115.stdout:6/190: dread f11 [0,4194304] 0 2024-04-16T14:35:34.027 INFO:tasks.workunit.client.1.smithi115.stdout:6/191: stat d13/d1a/d25/f32 0 2024-04-16T14:35:34.028 INFO:tasks.workunit.client.1.smithi115.stdout:6/192: fdatasync d13/f28 0 2024-04-16T14:35:34.029 INFO:tasks.workunit.client.1.smithi115.stdout:7/188: creat d0/d24/d40/f44 x:0 0 0 2024-04-16T14:35:34.030 INFO:tasks.workunit.client.1.smithi115.stdout:1/151: creat df/d2d/d2a/f32 x:0 0 0 2024-04-16T14:35:34.032 INFO:tasks.workunit.client.1.smithi115.stdout:8/158: creat d0/f31 x:0 0 0 2024-04-16T14:35:34.033 INFO:tasks.workunit.client.1.smithi115.stdout:1/152: creat df/d2d/d2a/d2c/f33 x:0 0 0 2024-04-16T14:35:34.035 INFO:tasks.workunit.client.1.smithi115.stdout:5/123: symlink dc/d15/l28 0 2024-04-16T14:35:34.036 INFO:tasks.workunit.client.0.smithi005.stdout:7/471: sync 2024-04-16T14:35:34.037 INFO:tasks.workunit.client.1.smithi115.stdout:1/153: link df/f12 df/d2d/d2a/f34 0 2024-04-16T14:35:34.037 INFO:tasks.workunit.client.1.smithi115.stdout:1/154: chown f9 368586347 1 2024-04-16T14:35:34.037 INFO:tasks.workunit.client.1.smithi115.stdout:1/155: truncate df/f23 592610 0 2024-04-16T14:35:34.037 INFO:tasks.workunit.client.0.smithi005.stdout:7/472: mkdir d1/d85/d96 0 2024-04-16T14:35:34.038 INFO:tasks.workunit.client.0.smithi005.stdout:7/473: creat d1/d49/d74/f97 x:0 0 0 2024-04-16T14:35:34.039 INFO:tasks.workunit.client.1.smithi115.stdout:5/124: rename dc/f14 to dc/f29 0 2024-04-16T14:35:34.039 INFO:tasks.workunit.client.0.smithi005.stdout:7/474: symlink d1/d49/d74/d77/d22/d27/d3a/l98 0 2024-04-16T14:35:34.039 INFO:tasks.workunit.client.1.smithi115.stdout:1/156: rmdir df/d2d 39 2024-04-16T14:35:34.040 INFO:tasks.workunit.client.1.smithi115.stdout:1/157: write fa [2367994,7173] 0 2024-04-16T14:35:34.040 INFO:tasks.workunit.client.0.smithi005.stdout:7/475: creat d1/d85/d96/f99 x:0 0 0 2024-04-16T14:35:34.043 INFO:tasks.workunit.client.1.smithi115.stdout:5/125: creat dc/d15/f2a x:0 0 0 2024-04-16T14:35:34.043 INFO:tasks.workunit.client.1.smithi115.stdout:5/126: write dc/f1f [21342,126557] 0 2024-04-16T14:35:34.043 INFO:tasks.workunit.client.1.smithi115.stdout:5/127: stat dc/f26 0 2024-04-16T14:35:34.045 INFO:tasks.workunit.client.1.smithi115.stdout:1/158: readlink l1 0 2024-04-16T14:35:34.046 INFO:tasks.workunit.client.1.smithi115.stdout:1/159: read - df/f27 zero size 2024-04-16T14:35:34.046 INFO:tasks.workunit.client.1.smithi115.stdout:1/160: dread - df/f27 zero size 2024-04-16T14:35:34.046 INFO:tasks.workunit.client.0.smithi005.stdout:7/476: dread d1/dc/f18 [0,4194304] 0 2024-04-16T14:35:34.046 INFO:tasks.workunit.client.0.smithi005.stdout:7/477: dread - d1/dc/d2f/f5a zero size 2024-04-16T14:35:34.047 INFO:tasks.workunit.client.1.smithi115.stdout:5/128: truncate dc/d15/f24 2219596 0 2024-04-16T14:35:34.049 INFO:tasks.workunit.client.1.smithi115.stdout:1/161: rename df/d2d/d2a/d2b to df/d35 0 2024-04-16T14:35:34.052 INFO:tasks.workunit.client.1.smithi115.stdout:1/162: mkdir df/d36 0 2024-04-16T14:35:34.053 INFO:tasks.workunit.client.1.smithi115.stdout:1/163: write df/f14 [107268,98940] 0 2024-04-16T14:35:34.053 INFO:tasks.workunit.client.1.smithi115.stdout:1/164: dread - df/f22 zero size 2024-04-16T14:35:34.054 INFO:tasks.workunit.client.0.smithi005.stdout:6/530: write d2/d3f/f4f [3357303,68430] 0 2024-04-16T14:35:34.054 INFO:tasks.workunit.client.1.smithi115.stdout:1/165: mknod df/d13/c37 0 2024-04-16T14:35:34.055 INFO:tasks.workunit.client.1.smithi115.stdout:6/193: getdents d13/d1a/d25/d2e 0 2024-04-16T14:35:34.057 INFO:tasks.workunit.client.1.smithi115.stdout:1/166: rename df/d13/c31 to df/d13/c38 0 2024-04-16T14:35:34.058 INFO:tasks.workunit.client.1.smithi115.stdout:7/189: dread d0/d24/d2b/f39 [0,4194304] 0 2024-04-16T14:35:34.058 INFO:tasks.workunit.client.1.smithi115.stdout:6/194: truncate d13/d1d/f36 1245932 0 2024-04-16T14:35:34.058 INFO:tasks.workunit.client.1.smithi115.stdout:4/206: dwrite d1/f22 [4194304,4194304] 0 2024-04-16T14:35:34.059 INFO:tasks.workunit.client.1.smithi115.stdout:0/142: sync 2024-04-16T14:35:34.060 INFO:tasks.workunit.client.1.smithi115.stdout:1/167: unlink l1 0 2024-04-16T14:35:34.060 INFO:tasks.workunit.client.1.smithi115.stdout:1/168: dread - df/f22 zero size 2024-04-16T14:35:34.060 INFO:tasks.workunit.client.1.smithi115.stdout:1/169: write df/d13/f16 [477512,20236] 0 2024-04-16T14:35:34.061 INFO:tasks.workunit.client.1.smithi115.stdout:7/190: symlink d0/d1/d3b/d3f/l45 0 2024-04-16T14:35:34.061 INFO:tasks.workunit.client.1.smithi115.stdout:1/170: dread df/f25 [0,4194304] 0 2024-04-16T14:35:34.061 INFO:tasks.workunit.client.1.smithi115.stdout:1/171: truncate df/d2d/d2a/f32 632867 0 2024-04-16T14:35:34.061 INFO:tasks.workunit.client.1.smithi115.stdout:1/172: readlink df/d2d/l1f 0 2024-04-16T14:35:34.061 INFO:tasks.workunit.client.1.smithi115.stdout:1/173: dread - df/f27 zero size 2024-04-16T14:35:34.062 INFO:tasks.workunit.client.1.smithi115.stdout:7/191: read d0/d2/f35 [126278,93379] 0 2024-04-16T14:35:34.062 INFO:tasks.workunit.client.1.smithi115.stdout:6/195: unlink d13/c19 0 2024-04-16T14:35:34.063 INFO:tasks.workunit.client.1.smithi115.stdout:1/174: dread df/f1d [0,4194304] 0 2024-04-16T14:35:34.065 INFO:tasks.workunit.client.1.smithi115.stdout:8/159: dwrite d0/db/f26 [0,4194304] 0 2024-04-16T14:35:34.065 INFO:tasks.workunit.client.1.smithi115.stdout:8/160: fsync d0/db/d10/f11 0 2024-04-16T14:35:34.066 INFO:tasks.workunit.client.0.smithi005.stdout:7/478: dwrite d1/d49/d74/d77/d57/f3b [0,4194304] 0 2024-04-16T14:35:34.068 INFO:tasks.workunit.client.0.smithi005.stdout:7/479: dread d1/d49/f6b [0,4194304] 0 2024-04-16T14:35:34.068 INFO:tasks.workunit.client.0.smithi005.stdout:7/480: dread - d1/d85/d96/f99 zero size 2024-04-16T14:35:34.068 INFO:tasks.workunit.client.0.smithi005.stdout:7/481: chown d1/d49/d74/d77/d22/d27/d2e/l56 597 1 2024-04-16T14:35:34.068 INFO:tasks.workunit.client.0.smithi005.stdout:7/482: readlink d1/d49/d74/d77/d22/d27/d3a/l98 0 2024-04-16T14:35:34.072 INFO:tasks.workunit.client.1.smithi115.stdout:4/207: symlink d1/d15/l33 0 2024-04-16T14:35:34.073 INFO:tasks.workunit.client.1.smithi115.stdout:6/196: dread d13/d1a/f23 [0,4194304] 0 2024-04-16T14:35:34.074 INFO:tasks.workunit.client.1.smithi115.stdout:2/167: dwrite d0/d4/de/d11/f12 [4194304,4194304] 0 2024-04-16T14:35:34.076 INFO:tasks.workunit.client.1.smithi115.stdout:0/143: rename d6/d10/d12/d1f/d24 to d6/d10/d12/d31/d35 0 2024-04-16T14:35:34.077 INFO:tasks.workunit.client.1.smithi115.stdout:5/129: rename dc/f29 to dc/f2b 0 2024-04-16T14:35:34.079 INFO:tasks.workunit.client.1.smithi115.stdout:1/175: unlink lc 0 2024-04-16T14:35:34.080 INFO:tasks.workunit.client.0.smithi005.stdout:6/531: rename d2/d3f/da4 to d2/d3f/d53/dba 0 2024-04-16T14:35:34.081 INFO:tasks.workunit.client.0.smithi005.stdout:6/532: read d2/d5/f2f [2918093,22799] 0 2024-04-16T14:35:34.081 INFO:tasks.workunit.client.0.smithi005.stdout:6/533: write d2/d3f/d47/f41 [4222282,89221] 0 2024-04-16T14:35:34.081 INFO:tasks.workunit.client.0.smithi005.stdout:7/483: dread d1/dc/d2f/f4c [0,4194304] 0 2024-04-16T14:35:34.085 INFO:tasks.workunit.client.0.smithi005.stdout:7/484: symlink d1/dc/l9a 0 2024-04-16T14:35:34.086 INFO:tasks.workunit.client.1.smithi115.stdout:4/208: dread d1/d2/f8 [0,4194304] 0 2024-04-16T14:35:34.086 INFO:tasks.workunit.client.1.smithi115.stdout:4/209: write d1/d15/d1e/f2b [880385,53304] 0 2024-04-16T14:35:34.087 INFO:tasks.workunit.client.1.smithi115.stdout:4/210: truncate d1/f3 2462212 0 2024-04-16T14:35:34.087 INFO:tasks.workunit.client.1.smithi115.stdout:4/211: fsync d1/f4 0 2024-04-16T14:35:34.087 INFO:tasks.workunit.client.0.smithi005.stdout:6/534: creat d2/d45/d7b/db2/fbb x:0 0 0 2024-04-16T14:35:34.087 INFO:tasks.workunit.client.0.smithi005.stdout:6/535: chown d2/d20/d72 419 1 2024-04-16T14:35:34.088 INFO:tasks.workunit.client.1.smithi115.stdout:5/130: readlink dc/d15/l1e 0 2024-04-16T14:35:34.088 INFO:tasks.workunit.client.1.smithi115.stdout:2/168: write d0/d4/de/d11/f20 [3082759,38293] 0 2024-04-16T14:35:34.088 INFO:tasks.workunit.client.1.smithi115.stdout:2/169: fsync d0/d4/f3a 0 2024-04-16T14:35:34.088 INFO:tasks.workunit.client.1.smithi115.stdout:2/170: chown d0/d4/d24/d21 396 1 2024-04-16T14:35:34.089 INFO:tasks.workunit.client.1.smithi115.stdout:6/197: write f6 [2730672,78504] 0 2024-04-16T14:35:34.090 INFO:tasks.workunit.client.0.smithi005.stdout:7/485: symlink d1/d49/d74/d77/d22/d27/d2e/l9b 0 2024-04-16T14:35:34.090 INFO:tasks.workunit.client.0.smithi005.stdout:7/486: chown d1/d49/d74/d77/d57/f7b 6637613 1 2024-04-16T14:35:34.090 INFO:tasks.workunit.client.0.smithi005.stdout:7/487: write d1/d49/d74/f7f [469221,44664] 0 2024-04-16T14:35:34.091 INFO:tasks.workunit.client.1.smithi115.stdout:5/131: creat dc/f2c x:0 0 0 2024-04-16T14:35:34.091 INFO:tasks.workunit.client.1.smithi115.stdout:5/132: write dc/f11 [1691137,85828] 0 2024-04-16T14:35:34.091 INFO:tasks.workunit.client.1.smithi115.stdout:5/133: read dc/f12 [659913,15709] 0 2024-04-16T14:35:34.091 INFO:tasks.workunit.client.0.smithi005.stdout:7/488: creat d1/d49/d74/d77/d22/d27/d3a/f9c x:0 0 0 2024-04-16T14:35:34.092 INFO:tasks.workunit.client.1.smithi115.stdout:2/171: getdents d0/d4/d24/d21 0 2024-04-16T14:35:34.093 INFO:tasks.workunit.client.1.smithi115.stdout:7/192: dwrite d0/d24/d2b/f39 [0,4194304] 0 2024-04-16T14:35:34.093 INFO:tasks.workunit.client.1.smithi115.stdout:7/193: getdents d0/d2/d3a/d30 0 2024-04-16T14:35:34.093 INFO:tasks.workunit.client.0.smithi005.stdout:7/489: symlink d1/d85/l9d 0 2024-04-16T14:35:34.095 INFO:tasks.workunit.client.0.smithi005.stdout:7/490: mkdir d1/d49/d74/d77/d22/d27/d3a/d5c/d9e 0 2024-04-16T14:35:34.096 INFO:tasks.workunit.client.0.smithi005.stdout:6/536: dread d2/d5/d10/d4d/d51/d6e/f87 [0,4194304] 0 2024-04-16T14:35:34.096 INFO:tasks.workunit.client.0.smithi005.stdout:6/537: readlink d2/d45/l4e 0 2024-04-16T14:35:34.096 INFO:tasks.workunit.client.0.smithi005.stdout:6/538: chown d2/d3f/d53/d54/l7e 0 1 2024-04-16T14:35:34.096 INFO:tasks.workunit.client.1.smithi115.stdout:6/198: creat d13/d1d/d20/d21/f3b x:0 0 0 2024-04-16T14:35:34.096 INFO:tasks.workunit.client.1.smithi115.stdout:6/199: creat d13/d1d/d20/d21/f3c x:0 0 0 2024-04-16T14:35:34.097 INFO:tasks.workunit.client.0.smithi005.stdout:7/491: mkdir d1/d49/d74/d77/d22/d9f 0 2024-04-16T14:35:34.098 INFO:tasks.workunit.client.1.smithi115.stdout:7/194: rmdir d0/d1/d3b/d3e 39 2024-04-16T14:35:34.100 INFO:tasks.workunit.client.0.smithi005.stdout:7/492: mkdir d1/d49/d74/d77/d22/da0 0 2024-04-16T14:35:34.101 INFO:tasks.workunit.client.1.smithi115.stdout:4/212: read d1/d15/d17/f21 [2353698,102808] 0 2024-04-16T14:35:34.102 INFO:tasks.workunit.client.1.smithi115.stdout:4/213: chown d1/d15/d31 138156 1 2024-04-16T14:35:34.102 INFO:tasks.workunit.client.1.smithi115.stdout:8/161: dwrite d0/db/d10/f1e [0,4194304] 0 2024-04-16T14:35:34.107 INFO:tasks.workunit.client.0.smithi005.stdout:7/493: symlink d1/dc/d2f/la1 0 2024-04-16T14:35:34.107 INFO:tasks.workunit.client.0.smithi005.stdout:7/494: fdatasync d1/dc/f7e 0 2024-04-16T14:35:34.107 INFO:tasks.workunit.client.0.smithi005.stdout:7/495: rename d1/d49/d74/d77/d57/f3b to d1/d49/d74/d77/d57/d47/fa2 0 2024-04-16T14:35:34.108 INFO:tasks.workunit.client.0.smithi005.stdout:7/496: creat d1/d49/d74/d77/d22/d27/d2e/fa3 x:0 0 0 2024-04-16T14:35:34.108 INFO:tasks.workunit.client.0.smithi005.stdout:7/497: creat d1/dc/d2f/d4f/fa4 x:0 0 0 2024-04-16T14:35:34.108 INFO:tasks.workunit.client.0.smithi005.stdout:7/498: fsync d1/d49/f5f 0 2024-04-16T14:35:34.108 INFO:tasks.workunit.client.0.smithi005.stdout:7/499: read - d1/d49/d74/d77/f65 zero size 2024-04-16T14:35:34.108 INFO:tasks.workunit.client.0.smithi005.stdout:7/500: creat d1/dc/d2f/fa5 x:0 0 0 2024-04-16T14:35:34.108 INFO:tasks.workunit.client.0.smithi005.stdout:7/501: creat d1/dc/d2f/fa6 x:0 0 0 2024-04-16T14:35:34.108 INFO:tasks.workunit.client.0.smithi005.stdout:7/502: write d1/d49/d74/d77/d22/d27/d3a/f40 [3881657,90492] 0 2024-04-16T14:35:34.108 INFO:tasks.workunit.client.0.smithi005.stdout:7/503: truncate d1/dc/d2f/fa5 877588 0 2024-04-16T14:35:34.108 INFO:tasks.workunit.client.1.smithi115.stdout:6/200: dread d13/d1a/f23 [0,4194304] 0 2024-04-16T14:35:34.110 INFO:tasks.workunit.client.1.smithi115.stdout:0/144: dwrite f1 [0,4194304] 0 2024-04-16T14:35:34.110 INFO:tasks.workunit.client.1.smithi115.stdout:8/162: link d0/f1f d0/db/d10/d17/d22/f32 0 2024-04-16T14:35:34.110 INFO:tasks.workunit.client.1.smithi115.stdout:8/163: chown d0/db/d10/l2e 461539 1 2024-04-16T14:35:34.111 INFO:tasks.workunit.client.0.smithi005.stdout:7/504: creat d1/d49/d74/d77/d22/da0/fa7 x:0 0 0 2024-04-16T14:35:34.111 INFO:tasks.workunit.client.0.smithi005.stdout:7/505: truncate d1/d49/d74/f97 851105 0 2024-04-16T14:35:34.112 INFO:tasks.workunit.client.1.smithi115.stdout:6/201: link d13/d1d/l1f d13/d1d/d20/d2c/l3d 0 2024-04-16T14:35:34.113 INFO:tasks.workunit.client.1.smithi115.stdout:6/202: readlink d13/d1a/l37 0 2024-04-16T14:35:34.113 INFO:tasks.workunit.client.1.smithi115.stdout:6/203: truncate d13/d1a/f29 362472 0 2024-04-16T14:35:34.115 INFO:tasks.workunit.client.1.smithi115.stdout:0/145: mkdir d6/d10/d12/d1f/d36 0 2024-04-16T14:35:34.115 INFO:tasks.workunit.client.1.smithi115.stdout:5/134: dwrite f0 [4194304,4194304] 0 2024-04-16T14:35:34.116 INFO:tasks.workunit.client.1.smithi115.stdout:1/176: dwrite df/f14 [0,4194304] 0 2024-04-16T14:35:34.117 INFO:tasks.workunit.client.1.smithi115.stdout:4/214: dread d1/d15/d17/f19 [0,4194304] 0 2024-04-16T14:35:34.119 INFO:tasks.workunit.client.1.smithi115.stdout:0/146: symlink d6/d1b/d29/l37 0 2024-04-16T14:35:34.122 INFO:tasks.workunit.client.0.smithi005.stdout:6/539: dwrite d2/f23 [0,4194304] 0 2024-04-16T14:35:34.123 INFO:tasks.workunit.client.0.smithi005.stdout:6/540: mkdir d2/d5/d10/d4d/d7a/dbc 0 2024-04-16T14:35:34.124 INFO:tasks.workunit.client.0.smithi005.stdout:6/541: creat d2/d20/fbd x:0 0 0 2024-04-16T14:35:34.124 INFO:tasks.workunit.client.0.smithi005.stdout:6/542: read - d2/d20/d72/f9c zero size 2024-04-16T14:35:34.127 INFO:tasks.workunit.client.0.smithi005.stdout:6/543: write d2/d5/d10/d4d/f80 [318360,69133] 0 2024-04-16T14:35:34.127 INFO:tasks.workunit.client.1.smithi115.stdout:2/172: dread d0/d4/d24/f34 [0,4194304] 0 2024-04-16T14:35:34.128 INFO:tasks.workunit.client.0.smithi005.stdout:6/544: chown d2/d5/d10/f2b 15 1 2024-04-16T14:35:34.131 INFO:tasks.workunit.client.1.smithi115.stdout:4/215: creat d1/d15/f34 x:0 0 0 2024-04-16T14:35:34.131 INFO:tasks.workunit.client.1.smithi115.stdout:4/216: creat d1/d15/d1e/f35 x:0 0 0 2024-04-16T14:35:34.131 INFO:tasks.workunit.client.1.smithi115.stdout:4/217: fdatasync d1/d2/f7 0 2024-04-16T14:35:34.132 INFO:tasks.workunit.client.0.smithi005.stdout:6/545: symlink d2/d5/d10/d4d/d51/d6e/lbe 0 2024-04-16T14:35:34.132 INFO:tasks.workunit.client.0.smithi005.stdout:6/546: mkdir d2/d3f/d47/d84/dbf 0 2024-04-16T14:35:34.132 INFO:tasks.workunit.client.0.smithi005.stdout:6/547: chown d2/d5/d10/d4d/d7a/dbc 1398801 1 2024-04-16T14:35:34.132 INFO:tasks.workunit.client.0.smithi005.stdout:6/548: rmdir d2/d3f/d53/d54 39 2024-04-16T14:35:34.132 INFO:tasks.workunit.client.0.smithi005.stdout:6/549: chown d2/d20/f98 653467526 1 2024-04-16T14:35:34.132 INFO:tasks.workunit.client.0.smithi005.stdout:6/550: fsync d2/d3f/d47/f83 0 2024-04-16T14:35:34.132 INFO:tasks.workunit.client.0.smithi005.stdout:6/551: mknod d2/d5/d28/db8/cc0 0 2024-04-16T14:35:34.133 INFO:tasks.workunit.client.0.smithi005.stdout:6/552: chown d2/d5/d10/d4d/d7a/cb1 912338 1 2024-04-16T14:35:34.136 INFO:tasks.workunit.client.1.smithi115.stdout:5/135: mkdir dc/d15/d2d 0 2024-04-16T14:35:34.137 INFO:tasks.workunit.client.1.smithi115.stdout:1/177: creat df/d35/f39 x:0 0 0 2024-04-16T14:35:34.138 INFO:tasks.workunit.client.0.smithi005.stdout:7/506: dwrite d1/d49/d74/d77/d22/f42 [0,4194304] 0 2024-04-16T14:35:34.139 INFO:tasks.workunit.client.1.smithi115.stdout:8/164: dwrite d0/f31 [0,4194304] 0 2024-04-16T14:35:34.139 INFO:tasks.workunit.client.1.smithi115.stdout:7/195: dwrite d0/d2/d3a/d30/f32 [0,4194304] 0 2024-04-16T14:35:34.139 INFO:tasks.workunit.client.1.smithi115.stdout:7/196: fsync d0/d2/d3a/f33 0 2024-04-16T14:35:34.139 INFO:tasks.workunit.client.1.smithi115.stdout:8/165: truncate d0/db/f30 129136 0 2024-04-16T14:35:34.140 INFO:tasks.workunit.client.0.smithi005.stdout:7/507: dread d1/dc/d2f/fa5 [0,4194304] 0 2024-04-16T14:35:34.140 INFO:tasks.workunit.client.1.smithi115.stdout:6/204: rmdir d13 39 2024-04-16T14:35:34.141 INFO:tasks.workunit.client.1.smithi115.stdout:2/173: mknod d0/c3c 0 2024-04-16T14:35:34.141 INFO:tasks.workunit.client.1.smithi115.stdout:2/174: creat d0/d1b/f3d x:0 0 0 2024-04-16T14:35:34.141 INFO:tasks.workunit.client.1.smithi115.stdout:2/175: write d0/d4/d24/f13 [1461959,4306] 0 2024-04-16T14:35:34.144 INFO:tasks.workunit.client.1.smithi115.stdout:0/147: rename d6/d1b/d29 to d6/d38 0 2024-04-16T14:35:34.144 INFO:tasks.workunit.client.0.smithi005.stdout:7/508: symlink d1/d49/d74/d77/d57/la8 0 2024-04-16T14:35:34.145 INFO:tasks.workunit.client.0.smithi005.stdout:7/509: read - d1/d49/d74/d77/d22/da0/fa7 zero size 2024-04-16T14:35:34.146 INFO:tasks.workunit.client.0.smithi005.stdout:6/553: dwrite d2/f18 [0,4194304] 0 2024-04-16T14:35:34.150 INFO:tasks.workunit.client.1.smithi115.stdout:7/197: unlink d0/d24/l43 0 2024-04-16T14:35:34.156 INFO:tasks.workunit.client.1.smithi115.stdout:6/205: read d13/f1c [4027763,18544] 0 2024-04-16T14:35:34.157 INFO:tasks.workunit.client.0.smithi005.stdout:7/510: truncate d1/d49/d74/d77/d22/d27/d3a/f40 3442770 0 2024-04-16T14:35:34.158 INFO:tasks.workunit.client.1.smithi115.stdout:2/176: write d0/d4/de/d11/f1e [2429980,7116] 0 2024-04-16T14:35:34.158 INFO:tasks.workunit.client.1.smithi115.stdout:2/177: chown d0/d4/d24/d10 664610258 1 2024-04-16T14:35:34.162 INFO:tasks.workunit.client.1.smithi115.stdout:5/136: link dc/d15/f19 dc/f2e 0 2024-04-16T14:35:34.162 INFO:tasks.workunit.client.1.smithi115.stdout:5/137: chown dc/d15 68370 1 2024-04-16T14:35:34.162 INFO:tasks.workunit.client.1.smithi115.stdout:5/138: truncate dc/f21 79420 0 2024-04-16T14:35:34.163 INFO:tasks.workunit.client.1.smithi115.stdout:8/166: rename d0/db/d10/l2a to d0/db/l33 0 2024-04-16T14:35:34.164 INFO:tasks.workunit.client.0.smithi005.stdout:7/511: read d1/d49/d74/d77/d22/d27/f64 [1978961,5644] 0 2024-04-16T14:35:34.165 INFO:tasks.workunit.client.1.smithi115.stdout:0/148: link d6/fb d6/d10/d12/d31/f39 0 2024-04-16T14:35:34.166 INFO:tasks.workunit.client.0.smithi005.stdout:7/512: truncate d1/f55 1939400 0 2024-04-16T14:35:34.166 INFO:tasks.workunit.client.0.smithi005.stdout:7/513: dread - d1/d49/d74/d77/d57/d47/f7c zero size 2024-04-16T14:35:34.166 INFO:tasks.workunit.client.0.smithi005.stdout:7/514: readlink d1/d49/d74/d77/d22/d27/d2e/l56 0 2024-04-16T14:35:34.166 INFO:tasks.workunit.client.0.smithi005.stdout:7/515: stat d1/dc/d2f/d4f/f92 0 2024-04-16T14:35:34.166 INFO:tasks.workunit.client.0.smithi005.stdout:7/516: dread - d1/d49/d74/d77/d57/d47/f90 zero size 2024-04-16T14:35:34.167 INFO:tasks.workunit.client.0.smithi005.stdout:7/517: mkdir d1/d49/d74/d77/d22/da9 0 2024-04-16T14:35:34.167 INFO:tasks.workunit.client.1.smithi115.stdout:7/198: mknod d0/d2/d3a/d30/c46 0 2024-04-16T14:35:34.167 INFO:tasks.workunit.client.0.smithi005.stdout:7/518: mkdir d1/d49/d74/d77/d57/d47/daa 0 2024-04-16T14:35:34.168 INFO:tasks.workunit.client.1.smithi115.stdout:6/206: truncate f8 473387 0 2024-04-16T14:35:34.172 INFO:tasks.workunit.client.1.smithi115.stdout:2/178: creat d0/d4/d24/f3e x:0 0 0 2024-04-16T14:35:34.174 INFO:tasks.workunit.client.0.smithi005.stdout:6/554: dwrite d2/d45/d7b/f82 [0,4194304] 0 2024-04-16T14:35:34.174 INFO:tasks.workunit.client.0.smithi005.stdout:6/555: chown d2/d5/d28/l40 4087 1 2024-04-16T14:35:34.175 INFO:tasks.workunit.client.1.smithi115.stdout:7/199: symlink d0/d1/d3b/d3f/l47 0 2024-04-16T14:35:34.176 INFO:tasks.workunit.client.1.smithi115.stdout:7/200: dread - d0/d1/f34 zero size 2024-04-16T14:35:34.177 INFO:tasks.workunit.client.0.smithi005.stdout:6/556: truncate d2/d5/d10/d4d/f80 338968 0 2024-04-16T14:35:34.178 INFO:tasks.workunit.client.0.smithi005.stdout:6/557: chown d2/d5/d10/f3e 0 1 2024-04-16T14:35:34.178 INFO:tasks.workunit.client.1.smithi115.stdout:8/167: write d0/db/fd [5328740,46162] 0 2024-04-16T14:35:34.179 INFO:tasks.workunit.client.0.smithi005.stdout:6/558: mknod d2/d5/d10/d4d/d7a/d9d/cc1 0 2024-04-16T14:35:34.179 INFO:tasks.workunit.client.1.smithi115.stdout:5/139: rename dc/d15/f2a to dc/d15/f2f 0 2024-04-16T14:35:34.180 INFO:tasks.workunit.client.0.smithi005.stdout:6/559: getdents d2/d20/d33/d64 0 2024-04-16T14:35:34.180 INFO:tasks.workunit.client.0.smithi005.stdout:6/560: write d2/d5/d10/f5a [515328,39476] 0 2024-04-16T14:35:34.181 INFO:tasks.workunit.client.1.smithi115.stdout:7/201: unlink d0/d1/c28 0 2024-04-16T14:35:34.181 INFO:tasks.workunit.client.0.smithi005.stdout:6/561: chown d2/df 15942295 1 2024-04-16T14:35:34.183 INFO:tasks.workunit.client.0.smithi005.stdout:6/562: creat d2/d3f/d47/d84/fc2 x:0 0 0 2024-04-16T14:35:34.183 INFO:tasks.workunit.client.1.smithi115.stdout:8/168: getdents d0/db/d10/d25 0 2024-04-16T14:35:34.184 INFO:tasks.workunit.client.0.smithi005.stdout:0/468: sync 2024-04-16T14:35:34.184 INFO:tasks.workunit.client.0.smithi005.stdout:3/463: sync 2024-04-16T14:35:34.184 INFO:tasks.workunit.client.0.smithi005.stdout:1/534: sync 2024-04-16T14:35:34.184 INFO:tasks.workunit.client.0.smithi005.stdout:3/464: dread - d2/d17/d46/f57 zero size 2024-04-16T14:35:34.185 INFO:tasks.workunit.client.1.smithi115.stdout:7/202: mkdir d0/d1/d3b/d3f/d48 0 2024-04-16T14:35:34.185 INFO:tasks.workunit.client.1.smithi115.stdout:7/203: chown d0/d24/d2b/f39 4980674 1 2024-04-16T14:35:34.185 INFO:tasks.workunit.client.1.smithi115.stdout:7/204: write d0/d1/f20 [1434612,73085] 0 2024-04-16T14:35:34.185 INFO:tasks.workunit.client.1.smithi115.stdout:7/205: write d0/d1/f34 [905496,47991] 0 2024-04-16T14:35:34.185 INFO:tasks.workunit.client.0.smithi005.stdout:0/469: truncate da/f1a 596622 0 2024-04-16T14:35:34.186 INFO:tasks.workunit.client.1.smithi115.stdout:9/241: sync 2024-04-16T14:35:34.186 INFO:tasks.workunit.client.1.smithi115.stdout:3/223: sync 2024-04-16T14:35:34.187 INFO:tasks.workunit.client.1.smithi115.stdout:9/242: write d1/d6/d33/f38 [4615579,50865] 0 2024-04-16T14:35:34.187 INFO:tasks.workunit.client.1.smithi115.stdout:8/169: creat d0/db/d10/d25/f34 x:0 0 0 2024-04-16T14:35:34.187 INFO:tasks.workunit.client.1.smithi115.stdout:8/170: stat d0/db/d10/l2e 0 2024-04-16T14:35:34.187 INFO:tasks.workunit.client.0.smithi005.stdout:0/470: symlink da/df/d1b/d24/l9b 0 2024-04-16T14:35:34.188 INFO:tasks.workunit.client.0.smithi005.stdout:0/471: fdatasync da/df/f94 0 2024-04-16T14:35:34.188 INFO:tasks.workunit.client.0.smithi005.stdout:3/465: dread d2/d9/d5e/f93 [0,4194304] 0 2024-04-16T14:35:34.188 INFO:tasks.workunit.client.1.smithi115.stdout:9/243: read d1/d10/d20/d2a/f37 [23166,112183] 0 2024-04-16T14:35:34.188 INFO:tasks.workunit.client.1.smithi115.stdout:9/244: fdatasync d1/d10/d20/d2a/f37 0 2024-04-16T14:35:34.188 INFO:tasks.workunit.client.1.smithi115.stdout:9/245: chown d1/d6/d2d 6 1 2024-04-16T14:35:34.188 INFO:tasks.workunit.client.1.smithi115.stdout:9/246: readlink d1/d6/l1d 0 2024-04-16T14:35:34.188 INFO:tasks.workunit.client.1.smithi115.stdout:7/206: rmdir d0/d1/d3b/d3f 39 2024-04-16T14:35:34.188 INFO:tasks.workunit.client.1.smithi115.stdout:0/149: dwrite d6/f1e [0,4194304] 0 2024-04-16T14:35:34.189 INFO:tasks.workunit.client.0.smithi005.stdout:3/466: rmdir d2/d9/d51 39 2024-04-16T14:35:34.189 INFO:tasks.workunit.client.0.smithi005.stdout:0/472: creat da/df/d1b/d24/f9c x:0 0 0 2024-04-16T14:35:34.190 INFO:tasks.workunit.client.0.smithi005.stdout:0/473: creat da/df/d1b/d24/f9d x:0 0 0 2024-04-16T14:35:34.190 INFO:tasks.workunit.client.0.smithi005.stdout:7/519: dwrite d1/d49/d74/d77/d22/f8c [0,4194304] 0 2024-04-16T14:35:34.191 INFO:tasks.workunit.client.1.smithi115.stdout:3/224: mknod dc/d24/d33/d4b/c52 0 2024-04-16T14:35:34.191 INFO:tasks.workunit.client.1.smithi115.stdout:3/225: write dc/d24/f30 [625870,114666] 0 2024-04-16T14:35:34.192 INFO:tasks.workunit.client.0.smithi005.stdout:3/467: mknod d2/d9/df/c9d 0 2024-04-16T14:35:34.192 INFO:tasks.workunit.client.0.smithi005.stdout:3/468: chown d2/d9/d25/l88 78282027 1 2024-04-16T14:35:34.193 INFO:tasks.workunit.client.0.smithi005.stdout:3/469: truncate d2/d17/d46/d47/f78 4722116 0 2024-04-16T14:35:34.196 INFO:tasks.workunit.client.0.smithi005.stdout:6/563: dread d2/d5/f22 [0,4194304] 0 2024-04-16T14:35:34.196 INFO:tasks.workunit.client.0.smithi005.stdout:6/564: dread - d2/d3f/f71 zero size 2024-04-16T14:35:34.196 INFO:tasks.workunit.client.1.smithi115.stdout:2/179: dread d0/d4/de/d11/f1e [0,4194304] 0 2024-04-16T14:35:34.196 INFO:tasks.workunit.client.1.smithi115.stdout:2/180: read d0/d4/de/d11/f1e [361869,54883] 0 2024-04-16T14:35:34.198 INFO:tasks.workunit.client.1.smithi115.stdout:0/150: rename d6/le to d6/d10/d12/d31/d35/l3a 0 2024-04-16T14:35:34.199 INFO:tasks.workunit.client.1.smithi115.stdout:9/247: dread d1/d6/d29/f32 [0,4194304] 0 2024-04-16T14:35:34.200 INFO:tasks.workunit.client.0.smithi005.stdout:0/474: creat da/df/d1b/d3a/d53/d5a/d99/f9e x:0 0 0 2024-04-16T14:35:34.200 INFO:tasks.workunit.client.1.smithi115.stdout:3/226: truncate dc/ff 2648557 0 2024-04-16T14:35:34.200 INFO:tasks.workunit.client.1.smithi115.stdout:3/227: chown l9 1 1 2024-04-16T14:35:34.202 INFO:tasks.workunit.client.1.smithi115.stdout:8/171: creat d0/db/d10/d25/d2d/f35 x:0 0 0 2024-04-16T14:35:34.202 INFO:tasks.workunit.client.1.smithi115.stdout:8/172: readlink d0/la 0 2024-04-16T14:35:34.202 INFO:tasks.workunit.client.1.smithi115.stdout:8/173: write d0/db/d10/d17/f1d [104130,94845] 0 2024-04-16T14:35:34.202 INFO:tasks.workunit.client.1.smithi115.stdout:3/228: write dc/f1a [752525,9394] 0 2024-04-16T14:35:34.203 INFO:tasks.workunit.client.1.smithi115.stdout:3/229: getdents dc/d29/d4d 0 2024-04-16T14:35:34.203 INFO:tasks.workunit.client.1.smithi115.stdout:3/230: chown dc/d24/d36/f3b 26754 1 2024-04-16T14:35:34.203 INFO:tasks.workunit.client.1.smithi115.stdout:2/181: rmdir d0/d4/de/d11/d25 39 2024-04-16T14:35:34.203 INFO:tasks.workunit.client.1.smithi115.stdout:0/151: mknod d6/d10/d12/d31/d35/c3b 0 2024-04-16T14:35:34.203 INFO:tasks.workunit.client.1.smithi115.stdout:0/152: fdatasync f0 0 2024-04-16T14:35:34.205 INFO:tasks.workunit.client.1.smithi115.stdout:9/248: mkdir d1/d6/d2d/d3d/d49 0 2024-04-16T14:35:34.205 INFO:tasks.workunit.client.0.smithi005.stdout:7/520: creat d1/d49/d74/d77/d22/da9/fab x:0 0 0 2024-04-16T14:35:34.207 INFO:tasks.workunit.client.0.smithi005.stdout:3/470: creat d2/d92/f9e x:0 0 0 2024-04-16T14:35:34.208 INFO:tasks.workunit.client.0.smithi005.stdout:3/471: fdatasync d2/d6b/f99 0 2024-04-16T14:35:34.208 INFO:tasks.workunit.client.1.smithi115.stdout:8/174: unlink d0/db/d10/d17/d22/f27 0 2024-04-16T14:35:34.208 INFO:tasks.workunit.client.1.smithi115.stdout:5/140: dwrite dc/d15/f19 [0,4194304] 0 2024-04-16T14:35:34.209 INFO:tasks.workunit.client.1.smithi115.stdout:2/182: creat d0/d4/d24/d21/d3b/f3f x:0 0 0 2024-04-16T14:35:34.210 INFO:tasks.workunit.client.1.smithi115.stdout:0/153: creat d6/d10/d12/d31/d35/f3c x:0 0 0 2024-04-16T14:35:34.211 INFO:tasks.workunit.client.1.smithi115.stdout:0/154: readlink d6/l1a 0 2024-04-16T14:35:34.211 INFO:tasks.workunit.client.0.smithi005.stdout:1/535: dwrite d2/d1c/d15/d6f/f8d [0,4194304] 0 2024-04-16T14:35:34.211 INFO:tasks.workunit.client.1.smithi115.stdout:9/249: symlink d1/d10/d20/d36/l4a 0 2024-04-16T14:35:34.212 INFO:tasks.workunit.client.0.smithi005.stdout:7/521: creat d1/d49/d74/d77/d57/d47/d8d/fac x:0 0 0 2024-04-16T14:35:34.213 INFO:tasks.workunit.client.0.smithi005.stdout:0/475: mknod da/df/d26/c9f 0 2024-04-16T14:35:34.216 INFO:tasks.workunit.client.0.smithi005.stdout:1/536: symlink d2/d1c/d15/d2a/d19/d42/d71/dac/lbd 0 2024-04-16T14:35:34.218 INFO:tasks.workunit.client.0.smithi005.stdout:7/522: rename d1/dc/d2f/d4f/fa4 to d1/d49/d74/d77/d57/d47/d8e/fad 0 2024-04-16T14:35:34.219 INFO:tasks.workunit.client.1.smithi115.stdout:0/155: truncate d6/fc 8357704 0 2024-04-16T14:35:34.219 INFO:tasks.workunit.client.0.smithi005.stdout:6/565: dwrite d2/d5/d10/d4d/fa6 [0,4194304] 0 2024-04-16T14:35:34.219 INFO:tasks.workunit.client.0.smithi005.stdout:6/566: fdatasync d2/d3f/f71 0 2024-04-16T14:35:34.219 INFO:tasks.workunit.client.0.smithi005.stdout:6/567: read - d2/d5/d28/db8/fb9 zero size 2024-04-16T14:35:34.220 INFO:tasks.workunit.client.0.smithi005.stdout:0/476: creat da/df/d1b/d71/fa0 x:0 0 0 2024-04-16T14:35:34.221 INFO:tasks.workunit.client.1.smithi115.stdout:2/183: dread d0/d4/ff [0,4194304] 0 2024-04-16T14:35:34.221 INFO:tasks.workunit.client.1.smithi115.stdout:2/184: dread - d0/d4/de/f37 zero size 2024-04-16T14:35:34.221 INFO:tasks.workunit.client.1.smithi115.stdout:2/185: stat d0/d4/de/d11/d25/c27 0 2024-04-16T14:35:34.221 INFO:tasks.workunit.client.1.smithi115.stdout:7/207: dwrite d0/f26 [0,4194304] 0 2024-04-16T14:35:34.222 INFO:tasks.workunit.client.0.smithi005.stdout:1/537: link d2/d1c/d15/d2a/d1a/f3b d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/fbe 0 2024-04-16T14:35:34.223 INFO:tasks.workunit.client.0.smithi005.stdout:1/538: truncate d2/d2c/d85/dab/d51/fb9 30850 0 2024-04-16T14:35:34.224 INFO:tasks.workunit.client.1.smithi115.stdout:5/141: dread f2 [0,4194304] 0 2024-04-16T14:35:34.224 INFO:tasks.workunit.client.1.smithi115.stdout:5/142: fdatasync dc/f1c 0 2024-04-16T14:35:34.225 INFO:tasks.workunit.client.0.smithi005.stdout:7/523: creat d1/d49/d74/d77/d57/fae x:0 0 0 2024-04-16T14:35:34.226 INFO:tasks.workunit.client.1.smithi115.stdout:2/186: mknod d0/d4/d24/d21/d3b/c40 0 2024-04-16T14:35:34.226 INFO:tasks.workunit.client.1.smithi115.stdout:2/187: dread - d0/d4/d24/f3e zero size 2024-04-16T14:35:34.228 INFO:tasks.workunit.client.1.smithi115.stdout:5/143: mknod dc/d15/d2d/c30 0 2024-04-16T14:35:34.230 INFO:tasks.workunit.client.1.smithi115.stdout:5/144: creat dc/d15/f31 x:0 0 0 2024-04-16T14:35:34.230 INFO:tasks.workunit.client.1.smithi115.stdout:5/145: chown dc/d15/l1e 1 1 2024-04-16T14:35:34.230 INFO:tasks.workunit.client.1.smithi115.stdout:5/146: fdatasync dc/d15/f24 0 2024-04-16T14:35:34.230 INFO:tasks.workunit.client.1.smithi115.stdout:5/147: truncate dc/f26 636678 0 2024-04-16T14:35:34.232 INFO:tasks.workunit.client.1.smithi115.stdout:9/250: dwrite d1/d10/f26 [0,4194304] 0 2024-04-16T14:35:34.232 INFO:tasks.workunit.client.1.smithi115.stdout:9/251: readlink d1/d6/l3a 0 2024-04-16T14:35:34.233 INFO:tasks.workunit.client.0.smithi005.stdout:1/539: dread d2/d1c/d15/d2a/d19/f84 [0,4194304] 0 2024-04-16T14:35:34.234 INFO:tasks.workunit.client.1.smithi115.stdout:5/148: creat dc/d15/d2d/f32 x:0 0 0 2024-04-16T14:35:34.235 INFO:tasks.workunit.client.1.smithi115.stdout:0/156: dread d6/d10/d12/f19 [0,4194304] 0 2024-04-16T14:35:34.237 INFO:tasks.workunit.client.0.smithi005.stdout:7/524: rmdir d1/d49/d74/d77/d22/d9f 0 2024-04-16T14:35:34.238 INFO:tasks.workunit.client.1.smithi115.stdout:0/157: creat d6/d38/f3d x:0 0 0 2024-04-16T14:35:34.240 INFO:tasks.workunit.client.0.smithi005.stdout:1/540: mknod d2/d2c/d85/dab/da5/cbf 0 2024-04-16T14:35:34.240 INFO:tasks.workunit.client.0.smithi005.stdout:1/541: readlink d2/d1c/d15/d2a/d19/d42/d64/l98 0 2024-04-16T14:35:34.240 INFO:tasks.workunit.client.0.smithi005.stdout:1/542: creat d2/d1c/fc0 x:0 0 0 2024-04-16T14:35:34.241 INFO:tasks.workunit.client.0.smithi005.stdout:6/568: symlink d2/d5/d10/lc3 0 2024-04-16T14:35:34.241 INFO:tasks.workunit.client.0.smithi005.stdout:6/569: read d2/d3f/d47/f31 [3838174,4376] 0 2024-04-16T14:35:34.241 INFO:tasks.workunit.client.0.smithi005.stdout:6/570: chown d2/d5/d10/d4d/d51/f70 1907 1 2024-04-16T14:35:34.241 INFO:tasks.workunit.client.1.smithi115.stdout:9/252: mkdir d1/d6/d2d/d4b 0 2024-04-16T14:35:34.241 INFO:tasks.workunit.client.1.smithi115.stdout:5/149: mkdir dc/d15/d33 0 2024-04-16T14:35:34.244 INFO:tasks.workunit.client.0.smithi005.stdout:3/472: dwrite d2/f71 [0,4194304] 0 2024-04-16T14:35:34.244 INFO:tasks.workunit.client.0.smithi005.stdout:1/543: rmdir d2/d2c/d85 39 2024-04-16T14:35:34.245 INFO:tasks.workunit.client.0.smithi005.stdout:6/571: mknod d2/d3f/cc4 0 2024-04-16T14:35:34.245 INFO:tasks.workunit.client.0.smithi005.stdout:6/572: read - d2/d20/d33/f4c zero size 2024-04-16T14:35:34.245 INFO:tasks.workunit.client.1.smithi115.stdout:3/231: dread f6 [0,4194304] 0 2024-04-16T14:35:34.249 INFO:tasks.workunit.client.1.smithi115.stdout:8/175: dwrite d0/db/d10/d17/d22/f29 [0,4194304] 0 2024-04-16T14:35:34.249 INFO:tasks.workunit.client.1.smithi115.stdout:3/232: unlink dc/f17 0 2024-04-16T14:35:34.250 INFO:tasks.workunit.client.0.smithi005.stdout:1/544: creat d2/d74/d7a/fc1 x:0 0 0 2024-04-16T14:35:34.250 INFO:tasks.workunit.client.0.smithi005.stdout:1/545: chown d2/d2c/d85/dab/da5/db3 35785821 1 2024-04-16T14:35:34.250 INFO:tasks.workunit.client.0.smithi005.stdout:1/546: chown d2/d1c/d15/d2a/d1a/d21 2470135 1 2024-04-16T14:35:34.253 INFO:tasks.workunit.client.0.smithi005.stdout:6/573: link d2/d3f/d47/f31 d2/d20/fc5 0 2024-04-16T14:35:34.254 INFO:tasks.workunit.client.1.smithi115.stdout:8/176: mknod d0/db/c36 0 2024-04-16T14:35:34.254 INFO:tasks.workunit.client.1.smithi115.stdout:2/188: dwrite d0/d4/d24/f34 [0,4194304] 0 2024-04-16T14:35:34.254 INFO:tasks.workunit.client.1.smithi115.stdout:2/189: fdatasync d0/d4/d24/f13 0 2024-04-16T14:35:34.254 INFO:tasks.workunit.client.1.smithi115.stdout:2/190: creat d0/d1b/f41 x:0 0 0 2024-04-16T14:35:34.254 INFO:tasks.workunit.client.1.smithi115.stdout:7/208: dwrite d0/d2/d3a/f33 [0,4194304] 0 2024-04-16T14:35:34.255 INFO:tasks.workunit.client.0.smithi005.stdout:3/473: dread d2/d9/f55 [0,4194304] 0 2024-04-16T14:35:34.255 INFO:tasks.workunit.client.0.smithi005.stdout:0/477: dwrite da/df/d26/d39/f9a [0,4194304] 0 2024-04-16T14:35:34.255 INFO:tasks.workunit.client.0.smithi005.stdout:7/525: getdents d1/dc/d2f/d4f 0 2024-04-16T14:35:34.256 INFO:tasks.workunit.client.1.smithi115.stdout:3/233: mknod dc/c53 0 2024-04-16T14:35:34.256 INFO:tasks.workunit.client.1.smithi115.stdout:3/234: chown f3 2 1 2024-04-16T14:35:34.256 INFO:tasks.workunit.client.1.smithi115.stdout:3/235: chown dc/d24/d36/l41 520658881 1 2024-04-16T14:35:34.256 INFO:tasks.workunit.client.1.smithi115.stdout:3/236: read dc/f18 [3772747,32971] 0 2024-04-16T14:35:34.257 INFO:tasks.workunit.client.0.smithi005.stdout:1/547: rmdir d2/d1c/d8a 0 2024-04-16T14:35:34.257 INFO:tasks.workunit.client.0.smithi005.stdout:1/548: truncate d2/d1c/d15/d2a/d19/d42/d64/d76/f97 567213 0 2024-04-16T14:35:34.257 INFO:tasks.workunit.client.1.smithi115.stdout:8/177: mknod d0/db/d10/d17/d2c/c37 0 2024-04-16T14:35:34.258 INFO:tasks.workunit.client.1.smithi115.stdout:3/237: dread dc/f1a [0,4194304] 0 2024-04-16T14:35:34.259 INFO:tasks.workunit.client.0.smithi005.stdout:3/474: mkdir d2/d9/d5e/d9f 0 2024-04-16T14:35:34.259 INFO:tasks.workunit.client.0.smithi005.stdout:3/475: chown d2/d17/l3e 2 1 2024-04-16T14:35:34.260 INFO:tasks.workunit.client.1.smithi115.stdout:2/191: creat d0/d4/de/d11/d36/f42 x:0 0 0 2024-04-16T14:35:34.261 INFO:tasks.workunit.client.1.smithi115.stdout:0/158: dwrite f0 [0,4194304] 0 2024-04-16T14:35:34.263 INFO:tasks.workunit.client.1.smithi115.stdout:7/209: mkdir d0/d1/d3b/d49 0 2024-04-16T14:35:34.263 INFO:tasks.workunit.client.1.smithi115.stdout:7/210: creat d0/d24/f4a x:0 0 0 2024-04-16T14:35:34.264 INFO:tasks.workunit.client.1.smithi115.stdout:8/178: truncate d0/db/fd 5482882 0 2024-04-16T14:35:34.264 INFO:tasks.workunit.client.1.smithi115.stdout:8/179: chown d0/f31 2004570 1 2024-04-16T14:35:34.264 INFO:tasks.workunit.client.1.smithi115.stdout:8/180: fdatasync d0/db/f15 0 2024-04-16T14:35:34.264 INFO:tasks.workunit.client.1.smithi115.stdout:8/181: stat d0/db/f24 0 2024-04-16T14:35:34.265 INFO:tasks.workunit.client.1.smithi115.stdout:9/253: dwrite d1/d10/f26 [4194304,4194304] 0 2024-04-16T14:35:34.265 INFO:tasks.workunit.client.1.smithi115.stdout:3/238: symlink dc/d24/d36/l54 0 2024-04-16T14:35:34.266 INFO:tasks.workunit.client.0.smithi005.stdout:7/526: rename d1/d49/d74/f7f to d1/d49/d74/d77/d57/d47/faf 0 2024-04-16T14:35:34.266 INFO:tasks.workunit.client.0.smithi005.stdout:7/527: write d1/d49/d74/d77/d22/d27/d2e/f81 [972528,74723] 0 2024-04-16T14:35:34.266 INFO:tasks.workunit.client.0.smithi005.stdout:6/574: getdents d2/d5/d28 0 2024-04-16T14:35:34.266 INFO:tasks.workunit.client.1.smithi115.stdout:2/192: symlink d0/d4/d22/l43 0 2024-04-16T14:35:34.267 INFO:tasks.workunit.client.0.smithi005.stdout:3/476: mknod d2/d17/d46/d47/ca0 0 2024-04-16T14:35:34.267 INFO:tasks.workunit.client.0.smithi005.stdout:3/477: readlink d2/d17/d46/d75/d41/l59 0 2024-04-16T14:35:34.271 INFO:tasks.workunit.client.0.smithi005.stdout:4/623: sync 2024-04-16T14:35:34.271 INFO:tasks.workunit.client.0.smithi005.stdout:9/281: sync 2024-04-16T14:35:34.271 INFO:tasks.workunit.client.0.smithi005.stdout:5/409: sync 2024-04-16T14:35:34.271 INFO:tasks.workunit.client.0.smithi005.stdout:5/410: chown d0/d6/d12/d1c/d81 19454 1 2024-04-16T14:35:34.271 INFO:tasks.workunit.client.0.smithi005.stdout:1/549: rename d2/l95 to d2/d2c/d85/lc2 0 2024-04-16T14:35:34.271 INFO:tasks.workunit.client.0.smithi005.stdout:1/550: write d2/d1c/d15/d2a/d25/f5c [5006215,63210] 0 2024-04-16T14:35:34.272 INFO:tasks.workunit.client.0.smithi005.stdout:1/551: creat d2/d2c/d85/dab/d51/fc3 x:0 0 0 2024-04-16T14:35:34.273 INFO:tasks.workunit.client.0.smithi005.stdout:6/575: symlink d2/df/lc6 0 2024-04-16T14:35:34.274 INFO:tasks.workunit.client.0.smithi005.stdout:6/576: creat d2/d5/d10/d4d/d7a/fc7 x:0 0 0 2024-04-16T14:35:34.275 INFO:tasks.workunit.client.0.smithi005.stdout:5/411: creat d0/d6/d12/d1c/d1e/d48/d5e/d74/f86 x:0 0 0 2024-04-16T14:35:34.275 INFO:tasks.workunit.client.0.smithi005.stdout:5/412: read d0/d6/d12/d1c/f1f [588434,63885] 0 2024-04-16T14:35:34.278 INFO:tasks.workunit.client.0.smithi005.stdout:1/552: mkdir d2/d2c/d85/dab/d51/dc4 0 2024-04-16T14:35:34.279 INFO:tasks.workunit.client.0.smithi005.stdout:7/528: rmdir d1/d49/d74/d77/d57/d47/d8d 39 2024-04-16T14:35:34.282 INFO:tasks.workunit.client.0.smithi005.stdout:6/577: creat d2/d3f/d53/d54/fc8 x:0 0 0 2024-04-16T14:35:34.282 INFO:tasks.workunit.client.0.smithi005.stdout:8/478: sync 2024-04-16T14:35:34.283 INFO:tasks.workunit.client.0.smithi005.stdout:8/479: chown d5/de/d8a/c8b 31793162 1 2024-04-16T14:35:34.283 INFO:tasks.workunit.client.0.smithi005.stdout:2/224: sync 2024-04-16T14:35:34.283 INFO:tasks.workunit.client.0.smithi005.stdout:2/225: read - d0/d29/d3e/f42 zero size 2024-04-16T14:35:34.283 INFO:tasks.workunit.client.0.smithi005.stdout:2/226: fsync d0/d4/d2b/f1a 0 2024-04-16T14:35:34.283 INFO:tasks.workunit.client.0.smithi005.stdout:4/624: read d0/d1b/d1d/d4f/f86 [596374,95616] 0 2024-04-16T14:35:34.285 INFO:tasks.workunit.client.0.smithi005.stdout:5/413: truncate d0/d6/d12/f45 1028383 0 2024-04-16T14:35:34.285 INFO:tasks.workunit.client.0.smithi005.stdout:5/414: chown d0/d6/d12/d1c/d1e/d73/l78 6620119 1 2024-04-16T14:35:34.287 INFO:tasks.workunit.client.0.smithi005.stdout:4/625: mkdir d0/d1b/d1d/dc3 0 2024-04-16T14:35:34.287 INFO:tasks.workunit.client.0.smithi005.stdout:4/626: getdents d0/d1b/db7 0 2024-04-16T14:35:34.287 INFO:tasks.workunit.client.0.smithi005.stdout:4/627: creat d0/d1b/d1d/d1f/d5d/da7/db4/fc4 x:0 0 0 2024-04-16T14:35:34.288 INFO:tasks.workunit.client.0.smithi005.stdout:5/415: symlink d0/d6/d12/d34/d42/l87 0 2024-04-16T14:35:34.289 INFO:tasks.workunit.client.0.smithi005.stdout:5/416: fsync d0/d6/d12/d1c/d1e/d48/f83 0 2024-04-16T14:35:34.289 INFO:tasks.workunit.client.0.smithi005.stdout:5/417: write d0/d6/d12/f3a [4274009,118408] 0 2024-04-16T14:35:34.290 INFO:tasks.workunit.client.0.smithi005.stdout:1/553: rename d2/d2c/d85/dab/da5 to d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/dc5 0 2024-04-16T14:35:34.290 INFO:tasks.workunit.client.0.smithi005.stdout:1/554: stat d2/d1c/f58 0 2024-04-16T14:35:34.290 INFO:tasks.workunit.client.0.smithi005.stdout:1/555: stat d2/d1c/d15/d2a/d19/d42/d64/d76/f72 0 2024-04-16T14:35:34.291 INFO:tasks.workunit.client.0.smithi005.stdout:8/480: dread d5/de/d8a/da1/d3d/f52 [0,4194304] 0 2024-04-16T14:35:34.293 INFO:tasks.workunit.client.0.smithi005.stdout:3/478: dwrite d2/d9/f53 [0,4194304] 0 2024-04-16T14:35:34.293 INFO:tasks.workunit.client.0.smithi005.stdout:4/628: mknod d0/d22/cc5 0 2024-04-16T14:35:34.293 INFO:tasks.workunit.client.1.smithi115.stdout:7/211: dwrite d0/d2/d3a/d30/f32 [0,4194304] 0 2024-04-16T14:35:34.295 INFO:tasks.workunit.client.0.smithi005.stdout:5/418: creat d0/d6/d12/d1c/d81/d82/f88 x:0 0 0 2024-04-16T14:35:34.297 INFO:tasks.workunit.client.0.smithi005.stdout:6/578: rename d2/f23 to d2/d3f/d47/d84/da5/fc9 0 2024-04-16T14:35:34.297 INFO:tasks.workunit.client.0.smithi005.stdout:6/579: fdatasync d2/d5/d10/f1d 0 2024-04-16T14:35:34.298 INFO:tasks.workunit.client.0.smithi005.stdout:2/227: write d0/d4/f28 [752030,33733] 0 2024-04-16T14:35:34.299 INFO:tasks.workunit.client.0.smithi005.stdout:1/556: link d2/d1c/d15/d2a/d19/d42/d71/dac/f9f d2/d1c/d15/d2a/d19/d42/d71/fc6 0 2024-04-16T14:35:34.303 INFO:tasks.workunit.client.0.smithi005.stdout:8/481: dread d5/d11/f44 [0,4194304] 0 2024-04-16T14:35:34.304 INFO:tasks.workunit.client.0.smithi005.stdout:6/580: creat d2/d5/d10/d4d/d7a/d9d/fca x:0 0 0 2024-04-16T14:35:34.304 INFO:tasks.workunit.client.0.smithi005.stdout:6/581: write d2/d5/d28/db8/fb9 [542326,1901] 0 2024-04-16T14:35:34.306 INFO:tasks.workunit.client.0.smithi005.stdout:2/228: getdents d0/d29 0 2024-04-16T14:35:34.306 INFO:tasks.workunit.client.0.smithi005.stdout:3/479: read d2/fe [6118,6453] 0 2024-04-16T14:35:34.306 INFO:tasks.workunit.client.0.smithi005.stdout:4/629: dread d0/f13 [0,4194304] 0 2024-04-16T14:35:34.310 INFO:tasks.workunit.client.0.smithi005.stdout:1/557: creat d2/d1c/d15/d2a/d1a/fc7 x:0 0 0 2024-04-16T14:35:34.311 INFO:tasks.workunit.client.0.smithi005.stdout:8/482: truncate d5/de/d8a/da1/f34 2083806 0 2024-04-16T14:35:34.312 INFO:tasks.workunit.client.1.smithi115.stdout:5/150: rmdir dc 39 2024-04-16T14:35:34.312 INFO:tasks.workunit.client.1.smithi115.stdout:5/151: write dc/f11 [2726590,106948] 0 2024-04-16T14:35:34.313 INFO:tasks.workunit.client.0.smithi005.stdout:2/229: link d0/d4/d2b/l10 d0/l43 0 2024-04-16T14:35:34.314 INFO:tasks.workunit.client.1.smithi115.stdout:8/182: symlink d0/db/d10/l38 0 2024-04-16T14:35:34.315 INFO:tasks.workunit.client.0.smithi005.stdout:3/480: mknod d2/d9/d5e/ca1 0 2024-04-16T14:35:34.315 INFO:tasks.workunit.client.1.smithi115.stdout:9/254: truncate d1/f2 1008914 0 2024-04-16T14:35:34.317 INFO:tasks.workunit.client.0.smithi005.stdout:4/630: unlink d0/d1b/d1d/f67 0 2024-04-16T14:35:34.317 INFO:tasks.workunit.client.0.smithi005.stdout:5/419: dwrite d0/d6/d12/d34/d42/f59 [0,4194304] 0 2024-04-16T14:35:34.318 INFO:tasks.workunit.client.1.smithi115.stdout:3/239: creat dc/d24/d33/d4b/f55 x:0 0 0 2024-04-16T14:35:34.318 INFO:tasks.workunit.client.1.smithi115.stdout:3/240: chown dc/f1c 20012 1 2024-04-16T14:35:34.318 INFO:tasks.workunit.client.1.smithi115.stdout:3/241: chown dc/l28 10269 1 2024-04-16T14:35:34.318 INFO:tasks.workunit.client.1.smithi115.stdout:3/242: write dc/d29/f2e [4778586,7021] 0 2024-04-16T14:35:34.318 INFO:tasks.workunit.client.1.smithi115.stdout:3/243: chown c5 11754 1 2024-04-16T14:35:34.318 INFO:tasks.workunit.client.1.smithi115.stdout:5/152: fsync dc/f11 0 2024-04-16T14:35:34.319 INFO:tasks.workunit.client.0.smithi005.stdout:1/558: mknod d2/d1c/d15/d2a/d19/d6e/cc8 0 2024-04-16T14:35:34.319 INFO:tasks.workunit.client.1.smithi115.stdout:7/212: symlink d0/d1/d3b/d49/l4b 0 2024-04-16T14:35:34.320 INFO:tasks.workunit.client.0.smithi005.stdout:3/481: mknod d2/d17/d46/d75/d9b/ca2 0 2024-04-16T14:35:34.321 INFO:tasks.workunit.client.0.smithi005.stdout:4/631: dread d0/d47/fbc [0,4194304] 0 2024-04-16T14:35:34.321 INFO:tasks.workunit.client.1.smithi115.stdout:8/183: rmdir d0/db/d10/d17/d22 39 2024-04-16T14:35:34.322 INFO:tasks.workunit.client.0.smithi005.stdout:8/483: write d5/de/f25 [401818,51382] 0 2024-04-16T14:35:34.322 INFO:tasks.workunit.client.0.smithi005.stdout:8/484: creat d5/d7b/fad x:0 0 0 2024-04-16T14:35:34.322 INFO:tasks.workunit.client.0.smithi005.stdout:5/420: symlink d0/d6/d12/l89 0 2024-04-16T14:35:34.322 INFO:tasks.workunit.client.0.smithi005.stdout:5/421: truncate d0/d6/d12/d34/f5a 652948 0 2024-04-16T14:35:34.323 INFO:tasks.workunit.client.1.smithi115.stdout:3/244: truncate dc/f21 198214 0 2024-04-16T14:35:34.324 INFO:tasks.workunit.client.0.smithi005.stdout:2/230: dread d0/d4/f12 [0,4194304] 0 2024-04-16T14:35:34.324 INFO:tasks.workunit.client.0.smithi005.stdout:2/231: dread - d0/d4/d2b/f40 zero size 2024-04-16T14:35:34.324 INFO:tasks.workunit.client.0.smithi005.stdout:6/582: dwrite d2/d5/d10/d4d/d51/f70 [0,4194304] 0 2024-04-16T14:35:34.324 INFO:tasks.workunit.client.0.smithi005.stdout:6/583: chown d2/d5/f6a 868 1 2024-04-16T14:35:34.324 INFO:tasks.workunit.client.0.smithi005.stdout:1/559: mkdir d2/d1c/d15/d2a/d19/dc9 0 2024-04-16T14:35:34.326 INFO:tasks.workunit.client.0.smithi005.stdout:3/482: truncate d2/d9/df/f3c 4056864 0 2024-04-16T14:35:34.327 INFO:tasks.workunit.client.1.smithi115.stdout:9/255: dread d1/d6/d29/f43 [0,4194304] 0 2024-04-16T14:35:34.327 INFO:tasks.workunit.client.1.smithi115.stdout:5/153: rmdir dc/d15/d33 0 2024-04-16T14:35:34.328 INFO:tasks.workunit.client.1.smithi115.stdout:2/193: getdents d0/d4/de 0 2024-04-16T14:35:34.328 INFO:tasks.workunit.client.1.smithi115.stdout:2/194: creat d0/d4/d24/f44 x:0 0 0 2024-04-16T14:35:34.329 INFO:tasks.workunit.client.1.smithi115.stdout:2/195: fsync d0/d4/d24/d23/f2c 0 2024-04-16T14:35:34.329 INFO:tasks.workunit.client.1.smithi115.stdout:2/196: creat d0/d4/de/d11/f45 x:0 0 0 2024-04-16T14:35:34.329 INFO:tasks.workunit.client.1.smithi115.stdout:2/197: chown d0/d4/d24/f34 25 1 2024-04-16T14:35:34.329 INFO:tasks.workunit.client.1.smithi115.stdout:2/198: write d0/d4/d24/d21/d3b/f3f [923514,90102] 0 2024-04-16T14:35:34.329 INFO:tasks.workunit.client.0.smithi005.stdout:4/632: symlink d0/d1b/da5/lc6 0 2024-04-16T14:35:34.331 INFO:tasks.workunit.client.1.smithi115.stdout:7/213: creat d0/d1/d3b/f4c x:0 0 0 2024-04-16T14:35:34.332 INFO:tasks.workunit.client.1.smithi115.stdout:3/245: mkdir dc/d29/d4d/d56 0 2024-04-16T14:35:34.332 INFO:tasks.workunit.client.1.smithi115.stdout:3/246: readlink dc/d29/l2f 0 2024-04-16T14:35:34.333 INFO:tasks.workunit.client.1.smithi115.stdout:9/256: mkdir d1/d6/d29/d4c 0 2024-04-16T14:35:34.333 INFO:tasks.workunit.client.0.smithi005.stdout:8/485: symlink d5/d7b/lae 0 2024-04-16T14:35:34.334 INFO:tasks.workunit.client.1.smithi115.stdout:8/184: dread d0/db/f13 [0,4194304] 0 2024-04-16T14:35:34.335 INFO:tasks.workunit.client.0.smithi005.stdout:2/232: symlink d0/d4/d2b/l44 0 2024-04-16T14:35:34.335 INFO:tasks.workunit.client.0.smithi005.stdout:2/233: write d0/d4/f28 [2795079,7101] 0 2024-04-16T14:35:34.336 INFO:tasks.workunit.client.0.smithi005.stdout:5/422: dread d0/f8 [0,4194304] 0 2024-04-16T14:35:34.336 INFO:tasks.workunit.client.0.smithi005.stdout:5/423: chown d0/d70/l80 146921 1 2024-04-16T14:35:34.337 INFO:tasks.workunit.client.1.smithi115.stdout:5/154: write dc/f11 [866130,3236] 0 2024-04-16T14:35:34.337 INFO:tasks.workunit.client.1.smithi115.stdout:5/155: read - dc/d15/f27 zero size 2024-04-16T14:35:34.338 INFO:tasks.workunit.client.1.smithi115.stdout:8/185: dread d0/db/d10/d17/f1d [0,4194304] 0 2024-04-16T14:35:34.338 INFO:tasks.workunit.client.0.smithi005.stdout:6/584: truncate d2/d45/d7b/f86 4549753 0 2024-04-16T14:35:34.339 INFO:tasks.workunit.client.1.smithi115.stdout:8/186: dread d0/db/f30 [0,4194304] 0 2024-04-16T14:35:34.339 INFO:tasks.workunit.client.1.smithi115.stdout:8/187: stat d0/db/c36 0 2024-04-16T14:35:34.340 INFO:tasks.workunit.client.1.smithi115.stdout:2/199: mknod d0/d4/d24/d21/d3b/c46 0 2024-04-16T14:35:34.341 INFO:tasks.workunit.client.0.smithi005.stdout:4/633: rename d0/f94 to d0/d1b/d1d/d1f/d48/fc7 0 2024-04-16T14:35:34.342 INFO:tasks.workunit.client.1.smithi115.stdout:7/214: unlink d0/d24/d2b/f39 0 2024-04-16T14:35:34.342 INFO:tasks.workunit.client.0.smithi005.stdout:4/634: write d0/d1b/d1d/d1f/f57 [2531199,130030] 0 2024-04-16T14:35:34.343 INFO:tasks.workunit.client.0.smithi005.stdout:8/486: mkdir d5/d40/d8e/daf 0 2024-04-16T14:35:34.344 INFO:tasks.workunit.client.0.smithi005.stdout:8/487: dread - d5/de/d8a/da1/d3d/d7f/d8d/f98 zero size 2024-04-16T14:35:34.344 INFO:tasks.workunit.client.1.smithi115.stdout:3/247: truncate dc/ff 2001015 0 2024-04-16T14:35:34.346 INFO:tasks.workunit.client.0.smithi005.stdout:2/234: creat d0/d4/f45 x:0 0 0 2024-04-16T14:35:34.346 INFO:tasks.workunit.client.0.smithi005.stdout:5/424: symlink d0/d6/d12/d1c/d1e/d48/l8a 0 2024-04-16T14:35:34.348 INFO:tasks.workunit.client.1.smithi115.stdout:8/188: getdents d0/db/d10/d17/d2c 0 2024-04-16T14:35:34.348 INFO:tasks.workunit.client.1.smithi115.stdout:8/189: dread - d0/db/d10/d25/d2d/f35 zero size 2024-04-16T14:35:34.348 INFO:tasks.workunit.client.1.smithi115.stdout:8/190: readlink d0/db/d10/l2e 0 2024-04-16T14:35:34.348 INFO:tasks.workunit.client.1.smithi115.stdout:8/191: write d0/f1a [334589,101532] 0 2024-04-16T14:35:34.348 INFO:tasks.workunit.client.1.smithi115.stdout:5/156: dread f0 [4194304,4194304] 0 2024-04-16T14:35:34.348 INFO:tasks.workunit.client.0.smithi005.stdout:4/635: dread d0/f13 [0,4194304] 0 2024-04-16T14:35:34.349 INFO:tasks.workunit.client.0.smithi005.stdout:6/585: symlink d2/d20/d33/d64/lcb 0 2024-04-16T14:35:34.349 INFO:tasks.workunit.client.0.smithi005.stdout:6/586: write d2/d20/d72/f78 [327072,52877] 0 2024-04-16T14:35:34.349 INFO:tasks.workunit.client.0.smithi005.stdout:6/587: chown d2/d20/d72 49467349 1 2024-04-16T14:35:34.351 INFO:tasks.workunit.client.1.smithi115.stdout:7/215: creat d0/d1/d3b/d49/f4d x:0 0 0 2024-04-16T14:35:34.351 INFO:tasks.workunit.client.0.smithi005.stdout:3/483: dwrite d2/f2b [0,4194304] 0 2024-04-16T14:35:34.353 INFO:tasks.workunit.client.1.smithi115.stdout:5/157: creat dc/f34 x:0 0 0 2024-04-16T14:35:34.354 INFO:tasks.workunit.client.0.smithi005.stdout:8/488: write d5/f3a [3649835,55965] 0 2024-04-16T14:35:34.355 INFO:tasks.workunit.client.0.smithi005.stdout:6/588: creat d2/d3f/d47/d84/d8c/fcc x:0 0 0 2024-04-16T14:35:34.355 INFO:tasks.workunit.client.0.smithi005.stdout:6/589: truncate d2/d5/d10/f13 361837 0 2024-04-16T14:35:34.356 INFO:tasks.workunit.client.0.smithi005.stdout:1/560: dwrite d2/d1c/d15/f8b [0,4194304] 0 2024-04-16T14:35:34.356 INFO:tasks.workunit.client.0.smithi005.stdout:6/590: fsync d2/d5/f37 0 2024-04-16T14:35:34.356 INFO:tasks.workunit.client.0.smithi005.stdout:1/561: fdatasync d2/d1c/f17 0 2024-04-16T14:35:34.356 INFO:tasks.workunit.client.1.smithi115.stdout:7/216: symlink d0/d2/d3a/l4e 0 2024-04-16T14:35:34.356 INFO:tasks.workunit.client.1.smithi115.stdout:7/217: truncate d0/d2/d3a/f33 4198953 0 2024-04-16T14:35:34.356 INFO:tasks.workunit.client.1.smithi115.stdout:3/248: dread dc/f31 [0,4194304] 0 2024-04-16T14:35:34.357 INFO:tasks.workunit.client.0.smithi005.stdout:5/425: link d0/d6/d12/f14 d0/f8b 0 2024-04-16T14:35:34.357 INFO:tasks.workunit.client.0.smithi005.stdout:5/426: chown d0/d6/d12/d1c/d1e/d48/d5e/d74/c85 950386 1 2024-04-16T14:35:34.357 INFO:tasks.workunit.client.1.smithi115.stdout:7/218: mknod d0/d24/d2b/c4f 0 2024-04-16T14:35:34.357 INFO:tasks.workunit.client.1.smithi115.stdout:7/219: readlink d0/d1/d3b/d49/l4b 0 2024-04-16T14:35:34.358 INFO:tasks.workunit.client.1.smithi115.stdout:5/158: mkdir dc/d15/d35 0 2024-04-16T14:35:34.359 INFO:tasks.workunit.client.0.smithi005.stdout:4/636: getdents d0/d47 0 2024-04-16T14:35:34.361 INFO:tasks.workunit.client.0.smithi005.stdout:3/484: symlink d2/d9/d25/la3 0 2024-04-16T14:35:34.361 INFO:tasks.workunit.client.0.smithi005.stdout:3/485: dread - d2/d17/d46/d75/d41/f65 zero size 2024-04-16T14:35:34.362 INFO:tasks.workunit.client.1.smithi115.stdout:5/159: rename l8 to dc/d15/l36 0 2024-04-16T14:35:34.364 INFO:tasks.workunit.client.0.smithi005.stdout:8/489: getdents d5/d7b/da8/da5 0 2024-04-16T14:35:34.367 INFO:tasks.workunit.client.0.smithi005.stdout:1/562: readlink d2/d1c/d15/d2a/d19/d42/d64/d76/l52 0 2024-04-16T14:35:34.369 INFO:tasks.workunit.client.0.smithi005.stdout:5/427: symlink d0/d6/d12/d1c/d1e/l8c 0 2024-04-16T14:35:34.371 INFO:tasks.workunit.client.0.smithi005.stdout:8/490: unlink d5/d11/l3c 0 2024-04-16T14:35:34.374 INFO:tasks.workunit.client.0.smithi005.stdout:6/591: dread d2/d3f/f4f [0,4194304] 0 2024-04-16T14:35:34.374 INFO:tasks.workunit.client.1.smithi115.stdout:3/249: dread dc/d24/f49 [0,4194304] 0 2024-04-16T14:35:34.375 INFO:tasks.workunit.client.0.smithi005.stdout:8/491: creat d5/de/d8a/da1/d3d/d7f/fb0 x:0 0 0 2024-04-16T14:35:34.375 INFO:tasks.workunit.client.0.smithi005.stdout:8/492: chown d5/d7b 5 1 2024-04-16T14:35:34.375 INFO:tasks.workunit.client.0.smithi005.stdout:8/493: stat d5/d55 0 2024-04-16T14:35:34.376 INFO:tasks.workunit.client.1.smithi115.stdout:8/192: write d0/db/d10/d17/d22/f29 [2751682,34284] 0 2024-04-16T14:35:34.376 INFO:tasks.workunit.client.1.smithi115.stdout:8/193: fsync d0/db/d10/f1e 0 2024-04-16T14:35:34.376 INFO:tasks.workunit.client.1.smithi115.stdout:8/194: write d0/db/f1b [793312,33221] 0 2024-04-16T14:35:34.376 INFO:tasks.workunit.client.1.smithi115.stdout:3/250: write dc/f11 [171470,95617] 0 2024-04-16T14:35:34.377 INFO:tasks.workunit.client.0.smithi005.stdout:4/637: read d0/f7 [1021592,118360] 0 2024-04-16T14:35:34.377 INFO:tasks.workunit.client.0.smithi005.stdout:4/638: fsync d0/f26 0 2024-04-16T14:35:34.378 INFO:tasks.workunit.client.1.smithi115.stdout:8/195: link d0/c7 d0/db/d10/c39 0 2024-04-16T14:35:34.378 INFO:tasks.workunit.client.0.smithi005.stdout:2/235: dwrite d0/d4/d2b/f40 [0,4194304] 0 2024-04-16T14:35:34.379 INFO:tasks.workunit.client.1.smithi115.stdout:5/160: fdatasync dc/f11 0 2024-04-16T14:35:34.379 INFO:tasks.workunit.client.1.smithi115.stdout:8/196: write d0/db/f1b [332687,39311] 0 2024-04-16T14:35:34.379 INFO:tasks.workunit.client.1.smithi115.stdout:8/197: readlink d0/db/l28 0 2024-04-16T14:35:34.379 INFO:tasks.workunit.client.1.smithi115.stdout:2/200: dwrite d0/d4/d24/d21/d3b/f3f [0,4194304] 0 2024-04-16T14:35:34.385 INFO:tasks.workunit.client.0.smithi005.stdout:2/236: mkdir d0/d2a/d3a/d46 0 2024-04-16T14:35:34.390 INFO:tasks.workunit.client.0.smithi005.stdout:5/428: rename d0/d6/d12/d1c/d1e/d48 to d0/d6/d12/d34/d8d 0 2024-04-16T14:35:34.391 INFO:tasks.workunit.client.1.smithi115.stdout:5/161: write f0 [3731697,124579] 0 2024-04-16T14:35:34.391 INFO:tasks.workunit.client.1.smithi115.stdout:5/162: fdatasync dc/f13 0 2024-04-16T14:35:34.391 INFO:tasks.workunit.client.1.smithi115.stdout:5/163: write dc/f13 [581034,76260] 0 2024-04-16T14:35:34.391 INFO:tasks.workunit.client.1.smithi115.stdout:5/164: dread dc/fe [0,4194304] 0 2024-04-16T14:35:34.393 INFO:tasks.workunit.client.0.smithi005.stdout:2/237: link d0/d1c/f33 d0/d1c/d39/f47 0 2024-04-16T14:35:34.395 INFO:tasks.workunit.client.1.smithi115.stdout:2/201: read d0/d4/de/d11/f12 [6783352,2106] 0 2024-04-16T14:35:34.395 INFO:tasks.workunit.client.0.smithi005.stdout:5/429: unlink d0/d6/d12/l56 0 2024-04-16T14:35:34.396 INFO:tasks.workunit.client.1.smithi115.stdout:8/198: link d0/f31 d0/db/d10/d17/f3a 0 2024-04-16T14:35:34.396 INFO:tasks.workunit.client.1.smithi115.stdout:8/199: truncate d0/db/d10/d17/f1d 857917 0 2024-04-16T14:35:34.397 INFO:tasks.workunit.client.0.smithi005.stdout:5/430: rename d0/d6/d12/d1c/d1e/d73/f7d to d0/d6/d12/d34/d6d/f8e 0 2024-04-16T14:35:34.398 INFO:tasks.workunit.client.0.smithi005.stdout:5/431: stat d0/d6/d12/d34/c2c 0 2024-04-16T14:35:34.399 INFO:tasks.workunit.client.0.smithi005.stdout:5/432: write d0/d6/d12/d34/d42/f59 [5109498,15671] 0 2024-04-16T14:35:34.400 INFO:tasks.workunit.client.1.smithi115.stdout:3/251: rmdir dc 39 2024-04-16T14:35:34.400 INFO:tasks.workunit.client.0.smithi005.stdout:2/238: dread d0/d4/fc [0,4194304] 0 2024-04-16T14:35:34.401 INFO:tasks.workunit.client.0.smithi005.stdout:5/433: symlink d0/d6/d12/d1c/d1e/d73/l8f 0 2024-04-16T14:35:34.401 INFO:tasks.workunit.client.0.smithi005.stdout:5/434: dread - d0/d6/d12/d34/d6d/f72 zero size 2024-04-16T14:35:34.401 INFO:tasks.workunit.client.1.smithi115.stdout:5/165: getdents dc/d15/d2d 0 2024-04-16T14:35:34.401 INFO:tasks.workunit.client.1.smithi115.stdout:5/166: dread - dc/f2c zero size 2024-04-16T14:35:34.402 INFO:tasks.workunit.client.1.smithi115.stdout:2/202: mkdir d0/d47 0 2024-04-16T14:35:34.403 INFO:tasks.workunit.client.0.smithi005.stdout:5/435: link d0/d6/f54 d0/d70/f90 0 2024-04-16T14:35:34.403 INFO:tasks.workunit.client.1.smithi115.stdout:8/200: mkdir d0/db/d10/d25/d2d/d3b 0 2024-04-16T14:35:34.404 INFO:tasks.workunit.client.1.smithi115.stdout:3/252: rename dc/l20 to dc/d29/d4d/l57 0 2024-04-16T14:35:34.404 INFO:tasks.workunit.client.1.smithi115.stdout:3/253: write dc/d24/f3e [416037,16989] 0 2024-04-16T14:35:34.405 INFO:tasks.workunit.client.1.smithi115.stdout:8/201: unlink d0/db/d10/d17/d22/f29 0 2024-04-16T14:35:34.408 INFO:tasks.workunit.client.1.smithi115.stdout:3/254: creat dc/d29/d4d/d56/f58 x:0 0 0 2024-04-16T14:35:34.408 INFO:tasks.workunit.client.1.smithi115.stdout:3/255: write dc/d29/f34 [727130,98873] 0 2024-04-16T14:35:34.409 INFO:tasks.workunit.client.0.smithi005.stdout:4/639: dwrite d0/f4c [0,4194304] 0 2024-04-16T14:35:34.409 INFO:tasks.workunit.client.1.smithi115.stdout:3/256: truncate dc/d24/f49 3415452 0 2024-04-16T14:35:34.410 INFO:tasks.workunit.client.0.smithi005.stdout:4/640: mknod d0/d1b/d1d/d4f/d75/cc8 0 2024-04-16T14:35:34.412 INFO:tasks.workunit.client.1.smithi115.stdout:3/257: creat dc/d29/d4d/f59 x:0 0 0 2024-04-16T14:35:34.414 INFO:tasks.workunit.client.0.smithi005.stdout:6/592: dwrite d2/d45/d7b/db2/fbb [0,4194304] 0 2024-04-16T14:35:34.414 INFO:tasks.workunit.client.0.smithi005.stdout:4/641: rename d0/d1b/da5/f9b to d0/d1b/d1d/d1f/d3e/daa/fc9 0 2024-04-16T14:35:34.414 INFO:tasks.workunit.client.0.smithi005.stdout:4/642: stat d0/d1b/d1d/d1f/d5d/da7/db4/c77 0 2024-04-16T14:35:34.414 INFO:tasks.workunit.client.0.smithi005.stdout:4/643: write d0/d1b/f7c [532707,108889] 0 2024-04-16T14:35:34.414 INFO:tasks.workunit.client.0.smithi005.stdout:4/644: creat d0/d1b/da5/fca x:0 0 0 2024-04-16T14:35:34.416 INFO:tasks.workunit.client.0.smithi005.stdout:4/645: dread d0/d22/d29/f79 [0,4194304] 0 2024-04-16T14:35:34.418 INFO:tasks.workunit.client.1.smithi115.stdout:3/258: rename dc/f3a to dc/d29/d4d/d56/f5a 0 2024-04-16T14:35:34.422 INFO:tasks.workunit.client.0.smithi005.stdout:2/239: truncate d0/d4/f28 1681618 0 2024-04-16T14:35:34.422 INFO:tasks.workunit.client.0.smithi005.stdout:4/646: rmdir d0/d1b/d1d/d1f/d5d/da7/db4 39 2024-04-16T14:35:34.422 INFO:tasks.workunit.client.0.smithi005.stdout:4/647: read - d0/d22/d29/f78 zero size 2024-04-16T14:35:34.423 INFO:tasks.workunit.client.1.smithi115.stdout:1/178: sync 2024-04-16T14:35:34.423 INFO:tasks.workunit.client.1.smithi115.stdout:6/207: sync 2024-04-16T14:35:34.423 INFO:tasks.workunit.client.1.smithi115.stdout:4/218: sync 2024-04-16T14:35:34.427 INFO:tasks.workunit.client.1.smithi115.stdout:2/203: dread d0/d1b/f38 [0,4194304] 0 2024-04-16T14:35:34.430 INFO:tasks.workunit.client.1.smithi115.stdout:4/219: unlink d1/ce 0 2024-04-16T14:35:34.430 INFO:tasks.workunit.client.1.smithi115.stdout:4/220: fdatasync d1/d15/d17/f19 0 2024-04-16T14:35:34.433 INFO:tasks.workunit.client.1.smithi115.stdout:2/204: unlink d0/d4/de/d11/d36/f42 0 2024-04-16T14:35:34.433 INFO:tasks.workunit.client.1.smithi115.stdout:8/202: dwrite d0/f1a [0,4194304] 0 2024-04-16T14:35:34.434 INFO:tasks.workunit.client.1.smithi115.stdout:8/203: fsync d0/f1a 0 2024-04-16T14:35:34.434 INFO:tasks.workunit.client.1.smithi115.stdout:8/204: stat d0/db/d10/d17/d2c 0 2024-04-16T14:35:34.434 INFO:tasks.workunit.client.1.smithi115.stdout:8/205: stat d0/db/f12 0 2024-04-16T14:35:34.435 INFO:tasks.workunit.client.1.smithi115.stdout:1/179: mkdir df/d13/d3a 0 2024-04-16T14:35:34.435 INFO:tasks.workunit.client.0.smithi005.stdout:2/240: mkdir d0/d1c/d39/d48 0 2024-04-16T14:35:34.436 INFO:tasks.workunit.client.0.smithi005.stdout:4/648: mkdir d0/d1b/d1d/d1f/d48/dab/dcb 0 2024-04-16T14:35:34.436 INFO:tasks.workunit.client.0.smithi005.stdout:4/649: chown d0/d4d/l96 3916 1 2024-04-16T14:35:34.437 INFO:tasks.workunit.client.1.smithi115.stdout:2/205: rename d0/d4/d24/f3e to d0/d4/de/f48 0 2024-04-16T14:35:34.437 INFO:tasks.workunit.client.1.smithi115.stdout:2/206: chown d0/d2a 2759 1 2024-04-16T14:35:34.439 INFO:tasks.workunit.client.1.smithi115.stdout:8/206: creat d0/db/d10/d25/d2d/d3b/f3c x:0 0 0 2024-04-16T14:35:34.439 INFO:tasks.workunit.client.1.smithi115.stdout:1/180: write df/f1c [787187,11745] 0 2024-04-16T14:35:34.440 INFO:tasks.workunit.client.1.smithi115.stdout:2/207: mknod d0/d1b/c49 0 2024-04-16T14:35:34.440 INFO:tasks.workunit.client.1.smithi115.stdout:2/208: chown d0/l6 2456327 1 2024-04-16T14:35:34.440 INFO:tasks.workunit.client.1.smithi115.stdout:2/209: fsync d0/d4/d24/d21/d3b/f3f 0 2024-04-16T14:35:34.442 INFO:tasks.workunit.client.1.smithi115.stdout:8/207: unlink d0/db/d10/f11 0 2024-04-16T14:35:34.443 INFO:tasks.workunit.client.1.smithi115.stdout:1/181: creat df/d2d/d2a/d2c/f3b x:0 0 0 2024-04-16T14:35:34.447 INFO:tasks.workunit.client.1.smithi115.stdout:8/208: creat d0/db/d10/d25/f3d x:0 0 0 2024-04-16T14:35:34.447 INFO:tasks.workunit.client.1.smithi115.stdout:1/182: truncate df/f1d 328904 0 2024-04-16T14:35:34.451 INFO:tasks.workunit.client.0.smithi005.stdout:5/436: dwrite d0/d6/d12/d1c/f22 [0,4194304] 0 2024-04-16T14:35:34.458 INFO:tasks.workunit.client.1.smithi115.stdout:1/183: mkdir df/d36/d3c 0 2024-04-16T14:35:34.463 INFO:tasks.workunit.client.1.smithi115.stdout:1/184: dread df/f12 [0,4194304] 0 2024-04-16T14:35:34.463 INFO:tasks.workunit.client.1.smithi115.stdout:1/185: stat f3 0 2024-04-16T14:35:34.464 INFO:tasks.workunit.client.1.smithi115.stdout:1/186: write df/f23 [331009,88711] 0 2024-04-16T14:35:34.465 INFO:tasks.workunit.client.1.smithi115.stdout:1/187: creat df/d36/f3d x:0 0 0 2024-04-16T14:35:34.509 INFO:tasks.workunit.client.0.smithi005.stdout:6/593: dwrite d2/d3f/d47/f83 [0,4194304] 0 2024-04-16T14:35:34.509 INFO:tasks.workunit.client.1.smithi115.stdout:5/167: dwrite dc/f11 [0,4194304] 0 2024-04-16T14:35:34.509 INFO:tasks.workunit.client.1.smithi115.stdout:5/168: write dc/d15/f2f [184871,49322] 0 2024-04-16T14:35:34.509 INFO:tasks.workunit.client.1.smithi115.stdout:6/208: dwrite d13/d1d/d20/f2d [0,4194304] 0 2024-04-16T14:35:34.514 INFO:tasks.workunit.client.0.smithi005.stdout:2/241: dwrite d0/fb [0,4194304] 0 2024-04-16T14:35:34.515 INFO:tasks.workunit.client.0.smithi005.stdout:5/437: dwrite d0/d6/d12/d34/d8d/d5e/d74/f86 [0,4194304] 0 2024-04-16T14:35:34.515 INFO:tasks.workunit.client.0.smithi005.stdout:4/650: dwrite d0/d1b/d1d/d1f/d3e/f55 [4194304,4194304] 0 2024-04-16T14:35:34.515 INFO:tasks.workunit.client.0.smithi005.stdout:4/651: write d0/d1b/d1d/d1f/d5d/da7/db4/fc4 [702406,100667] 0 2024-04-16T14:35:34.515 INFO:tasks.workunit.client.0.smithi005.stdout:4/652: chown d0/d1b/d1d/d1f/d5d/da7/db4/c77 508461328 1 2024-04-16T14:35:34.515 INFO:tasks.workunit.client.0.smithi005.stdout:6/594: mknod d2/d20/d3c/ccd 0 2024-04-16T14:35:34.515 INFO:tasks.workunit.client.1.smithi115.stdout:1/188: dwrite df/f27 [0,4194304] 0 2024-04-16T14:35:34.516 INFO:tasks.workunit.client.1.smithi115.stdout:1/189: readlink ld 0 2024-04-16T14:35:34.516 INFO:tasks.workunit.client.1.smithi115.stdout:3/259: dwrite dc/d24/d36/f3b [0,4194304] 0 2024-04-16T14:35:34.516 INFO:tasks.workunit.client.1.smithi115.stdout:8/209: dwrite d0/db/d10/d17/f2b [0,4194304] 0 2024-04-16T14:35:34.516 INFO:tasks.workunit.client.1.smithi115.stdout:3/260: write dc/d29/f48 [12799,88553] 0 2024-04-16T14:35:34.516 INFO:tasks.workunit.client.1.smithi115.stdout:4/221: dwrite d1/d15/d1e/f35 [0,4194304] 0 2024-04-16T14:35:34.516 INFO:tasks.workunit.client.1.smithi115.stdout:5/169: link l6 dc/d15/d2d/l37 0 2024-04-16T14:35:34.516 INFO:tasks.workunit.client.1.smithi115.stdout:6/209: rmdir d13/d1d/d20/d2c 39 2024-04-16T14:35:34.520 INFO:tasks.workunit.client.1.smithi115.stdout:1/190: mkdir df/d2d/d2a/d3e 0 2024-04-16T14:35:34.521 INFO:tasks.workunit.client.1.smithi115.stdout:5/170: dread f2 [0,4194304] 0 2024-04-16T14:35:34.522 INFO:tasks.workunit.client.1.smithi115.stdout:6/210: write f0 [59695,126863] 0 2024-04-16T14:35:34.523 INFO:tasks.workunit.client.1.smithi115.stdout:2/210: rmdir d0 39 2024-04-16T14:35:34.523 INFO:tasks.workunit.client.1.smithi115.stdout:2/211: write d0/d4/de/f37 [953929,59433] 0 2024-04-16T14:35:34.525 INFO:tasks.workunit.client.1.smithi115.stdout:3/261: stat dc/d29/d39/c50 0 2024-04-16T14:35:34.527 INFO:tasks.workunit.client.0.smithi005.stdout:6/595: dwrite d2/d5/d10/d4d/d7a/fa9 [0,4194304] 0 2024-04-16T14:35:34.527 INFO:tasks.workunit.client.0.smithi005.stdout:6/596: write d2/d20/fc5 [2725910,70451] 0 2024-04-16T14:35:34.535 INFO:tasks.workunit.client.0.smithi005.stdout:2/242: rename d0/d1c/d39/f47 to d0/d29/f49 0 2024-04-16T14:35:34.539 INFO:tasks.workunit.client.0.smithi005.stdout:5/438: link d0/d6/d12/d1c/d1e/l3b d0/d6/d12/d1c/d81/l91 0 2024-04-16T14:35:34.539 INFO:tasks.workunit.client.0.smithi005.stdout:5/439: truncate d0/d6/d12/d1c/d1e/f2b 4212383 0 2024-04-16T14:35:34.541 INFO:tasks.workunit.client.0.smithi005.stdout:4/653: creat d0/d1b/d1d/d1f/d3e/fcc x:0 0 0 2024-04-16T14:35:34.542 INFO:tasks.workunit.client.0.smithi005.stdout:4/654: write d0/d22/d61/f9d [1419850,29539] 0 2024-04-16T14:35:34.543 INFO:tasks.workunit.client.1.smithi115.stdout:4/222: mknod d1/d2/c36 0 2024-04-16T14:35:34.546 INFO:tasks.workunit.client.0.smithi005.stdout:2/243: symlink d0/d2a/d3a/d46/l4a 0 2024-04-16T14:35:34.546 INFO:tasks.workunit.client.0.smithi005.stdout:2/244: chown d0/d2a/c3d 8732 1 2024-04-16T14:35:34.546 INFO:tasks.workunit.client.0.smithi005.stdout:5/440: unlink d0/d6/d12/d1c/d1e/c53 0 2024-04-16T14:35:34.547 INFO:tasks.workunit.client.0.smithi005.stdout:4/655: creat d0/d1b/d1d/d1f/d3e/daa/fcd x:0 0 0 2024-04-16T14:35:34.548 INFO:tasks.workunit.client.1.smithi115.stdout:2/212: mkdir d0/d4/d4a 0 2024-04-16T14:35:34.548 INFO:tasks.workunit.client.1.smithi115.stdout:8/210: rmdir d0/db/d10/d25/d2d/d3b 39 2024-04-16T14:35:34.548 INFO:tasks.workunit.client.1.smithi115.stdout:3/262: creat dc/f5b x:0 0 0 2024-04-16T14:35:34.548 INFO:tasks.workunit.client.1.smithi115.stdout:3/263: write dc/f15 [2440872,74275] 0 2024-04-16T14:35:34.548 INFO:tasks.workunit.client.1.smithi115.stdout:1/191: rename df/f22 to df/d2d/f3f 0 2024-04-16T14:35:34.548 INFO:tasks.workunit.client.1.smithi115.stdout:6/211: dwrite f0 [0,4194304] 0 2024-04-16T14:35:34.548 INFO:tasks.workunit.client.1.smithi115.stdout:1/192: write df/d2d/f3f [329880,53323] 0 2024-04-16T14:35:34.548 INFO:tasks.workunit.client.1.smithi115.stdout:1/193: dread - df/d36/f3d zero size 2024-04-16T14:35:34.548 INFO:tasks.workunit.client.1.smithi115.stdout:1/194: dread - df/d2d/d2a/d2c/f3b zero size 2024-04-16T14:35:34.549 INFO:tasks.workunit.client.0.smithi005.stdout:5/441: rmdir d0/d6/d12/d34/d8d 39 2024-04-16T14:35:34.549 INFO:tasks.workunit.client.1.smithi115.stdout:5/171: mknod dc/d15/c38 0 2024-04-16T14:35:34.550 INFO:tasks.workunit.client.1.smithi115.stdout:5/172: write dc/f2b [125346,9465] 0 2024-04-16T14:35:34.550 INFO:tasks.workunit.client.1.smithi115.stdout:8/211: mknod d0/c3e 0 2024-04-16T14:35:34.550 INFO:tasks.workunit.client.0.smithi005.stdout:4/656: creat d0/d4d/fce x:0 0 0 2024-04-16T14:35:34.550 INFO:tasks.workunit.client.0.smithi005.stdout:4/657: readlink d0/d22/l37 0 2024-04-16T14:35:34.550 INFO:tasks.workunit.client.0.smithi005.stdout:4/658: stat d0/d1b/d1d/dc3 0 2024-04-16T14:35:34.551 INFO:tasks.workunit.client.0.smithi005.stdout:6/597: dwrite d2/d3f/d53/d54/fc8 [0,4194304] 0 2024-04-16T14:35:34.551 INFO:tasks.workunit.client.0.smithi005.stdout:6/598: creat d2/d3f/d47/d84/d8c/fce x:0 0 0 2024-04-16T14:35:34.551 INFO:tasks.workunit.client.1.smithi115.stdout:3/264: unlink dc/l10 0 2024-04-16T14:35:34.552 INFO:tasks.workunit.client.1.smithi115.stdout:3/265: creat dc/d29/d4d/d56/f5c x:0 0 0 2024-04-16T14:35:34.552 INFO:tasks.workunit.client.1.smithi115.stdout:3/266: truncate dc/f3d 938626 0 2024-04-16T14:35:34.552 INFO:tasks.workunit.client.1.smithi115.stdout:3/267: write dc/f22 [216459,47041] 0 2024-04-16T14:35:34.552 INFO:tasks.workunit.client.1.smithi115.stdout:4/223: rename d1/d2/f7 to d1/f37 0 2024-04-16T14:35:34.554 INFO:tasks.workunit.client.1.smithi115.stdout:6/212: unlink d13/f28 0 2024-04-16T14:35:34.560 INFO:tasks.workunit.client.1.smithi115.stdout:2/213: rename d0/d4/de/d11/f45 to d0/d1b/f4b 0 2024-04-16T14:35:34.561 INFO:tasks.workunit.client.1.smithi115.stdout:5/173: write dc/f2e [481325,30615] 0 2024-04-16T14:35:34.561 INFO:tasks.workunit.client.1.smithi115.stdout:1/195: write df/d2d/d2a/d2c/f21 [2792484,105060] 0 2024-04-16T14:35:34.562 INFO:tasks.workunit.client.1.smithi115.stdout:6/213: symlink d13/d1a/d25/l3e 0 2024-04-16T14:35:34.563 INFO:tasks.workunit.client.0.smithi005.stdout:5/442: dwrite d0/d6/d12/d34/d30/f68 [0,4194304] 0 2024-04-16T14:35:34.564 INFO:tasks.workunit.client.0.smithi005.stdout:4/659: rename d0/d1b/d1d/d1f/d5d/da7/db4/fbb to d0/d1b/d1d/d1f/d3e/fcf 0 2024-04-16T14:35:34.564 INFO:tasks.workunit.client.1.smithi115.stdout:4/224: rmdir d1/d15/d1e 39 2024-04-16T14:35:34.566 INFO:tasks.workunit.client.1.smithi115.stdout:3/268: rename dc/d29/d4d/l57 to dc/d29/l5d 0 2024-04-16T14:35:34.568 INFO:tasks.workunit.client.1.smithi115.stdout:2/214: mknod d0/d4/de/d11/d25/c4c 0 2024-04-16T14:35:34.570 INFO:tasks.workunit.client.1.smithi115.stdout:5/174: link dc/d15/f31 dc/d15/d35/f39 0 2024-04-16T14:35:34.573 INFO:tasks.workunit.client.1.smithi115.stdout:2/215: dread d0/fb [0,4194304] 0 2024-04-16T14:35:34.573 INFO:tasks.workunit.client.1.smithi115.stdout:2/216: dread - d0/d4/d24/f19 zero size 2024-04-16T14:35:34.573 INFO:tasks.workunit.client.1.smithi115.stdout:0/159: sync 2024-04-16T14:35:34.573 INFO:tasks.workunit.client.1.smithi115.stdout:0/160: write d6/d10/d12/d1f/f32 [24543,38070] 0 2024-04-16T14:35:34.573 INFO:tasks.workunit.client.1.smithi115.stdout:0/161: dread - d6/f25 zero size 2024-04-16T14:35:34.573 INFO:tasks.workunit.client.1.smithi115.stdout:0/162: chown d6/d10/d12/d31/d35/c2d 666288483 1 2024-04-16T14:35:34.573 INFO:tasks.workunit.client.1.smithi115.stdout:0/163: creat d6/d10/d12/d31/d35/f3e x:0 0 0 2024-04-16T14:35:34.573 INFO:tasks.workunit.client.1.smithi115.stdout:0/164: write d6/f33 [580676,110449] 0 2024-04-16T14:35:34.573 INFO:tasks.workunit.client.1.smithi115.stdout:0/165: getdents d6/d10/d12/d1f/d36 0 2024-04-16T14:35:34.574 INFO:tasks.workunit.client.1.smithi115.stdout:7/220: sync 2024-04-16T14:35:34.574 INFO:tasks.workunit.client.1.smithi115.stdout:9/257: sync 2024-04-16T14:35:34.574 INFO:tasks.workunit.client.1.smithi115.stdout:4/225: truncate d1/d15/d17/f21 3658542 0 2024-04-16T14:35:34.574 INFO:tasks.workunit.client.1.smithi115.stdout:1/196: dread f9 [0,4194304] 0 2024-04-16T14:35:34.574 INFO:tasks.workunit.client.0.smithi005.stdout:2/245: rmdir d0 39 2024-04-16T14:35:34.576 INFO:tasks.workunit.client.1.smithi115.stdout:8/212: dwrite d0/db/f13 [0,4194304] 0 2024-04-16T14:35:34.577 INFO:tasks.workunit.client.1.smithi115.stdout:5/175: symlink dc/d15/d35/l3a 0 2024-04-16T14:35:34.580 INFO:tasks.workunit.client.0.smithi005.stdout:2/246: creat d0/d2a/d3a/d46/f4b x:0 0 0 2024-04-16T14:35:34.582 INFO:tasks.workunit.client.0.smithi005.stdout:6/599: rename d2/d5/d10/d4d/d51 to d2/d20/d3c/dcf 0 2024-04-16T14:35:34.582 INFO:tasks.workunit.client.0.smithi005.stdout:6/600: truncate d2/df/f32 2444201 0 2024-04-16T14:35:34.583 INFO:tasks.workunit.client.1.smithi115.stdout:3/269: fdatasync dc/d29/f34 0 2024-04-16T14:35:34.583 INFO:tasks.workunit.client.1.smithi115.stdout:2/217: link d0/d4/de/l15 d0/d4/l4d 0 2024-04-16T14:35:34.584 INFO:tasks.workunit.client.0.smithi005.stdout:6/601: creat d2/fd0 x:0 0 0 2024-04-16T14:35:34.588 INFO:tasks.workunit.client.1.smithi115.stdout:0/166: mknod d6/d1b/c3f 0 2024-04-16T14:35:34.588 INFO:tasks.workunit.client.1.smithi115.stdout:0/167: chown d6/d10 28299 1 2024-04-16T14:35:34.588 INFO:tasks.workunit.client.1.smithi115.stdout:0/168: dread - d6/d10/d12/d31/d35/f3e zero size 2024-04-16T14:35:34.589 INFO:tasks.workunit.client.1.smithi115.stdout:7/221: dread - d0/d1/d3b/d49/f4d zero size 2024-04-16T14:35:34.591 INFO:tasks.workunit.client.1.smithi115.stdout:9/258: mknod d1/d6/d2d/d4b/c4d 0 2024-04-16T14:35:34.592 INFO:tasks.workunit.client.1.smithi115.stdout:9/259: write d1/d10/f46 [613680,53516] 0 2024-04-16T14:35:34.594 INFO:tasks.workunit.client.1.smithi115.stdout:1/197: mkdir df/d13/d40 0 2024-04-16T14:35:34.595 INFO:tasks.workunit.client.0.smithi005.stdout:2/247: dread d0/d1c/f20 [4194304,4194304] 0 2024-04-16T14:35:34.595 INFO:tasks.workunit.client.0.smithi005.stdout:2/248: chown d0/d1c/l37 3130 1 2024-04-16T14:35:34.598 INFO:tasks.workunit.client.1.smithi115.stdout:5/176: rmdir dc/d15/d35 39 2024-04-16T14:35:34.598 INFO:tasks.workunit.client.1.smithi115.stdout:5/177: creat dc/f3b x:0 0 0 2024-04-16T14:35:34.598 INFO:tasks.workunit.client.1.smithi115.stdout:2/218: stat d0/d4/de/d11/c17 0 2024-04-16T14:35:34.599 INFO:tasks.workunit.client.1.smithi115.stdout:0/169: creat d6/d10/f40 x:0 0 0 2024-04-16T14:35:34.602 INFO:tasks.workunit.client.1.smithi115.stdout:1/198: link fb df/d2d/f41 0 2024-04-16T14:35:34.611 INFO:tasks.workunit.client.1.smithi115.stdout:2/219: rename d0/d4/de/d11/d25/c27 to d0/d4/d22/c4e 0 2024-04-16T14:35:34.612 INFO:tasks.workunit.client.1.smithi115.stdout:2/220: chown d0/d4/d4a 111698 1 2024-04-16T14:35:34.612 INFO:tasks.workunit.client.0.smithi005.stdout:6/602: write d2/f18 [6046312,11918] 0 2024-04-16T14:35:34.613 INFO:tasks.workunit.client.1.smithi115.stdout:5/178: link dc/d15/c1d dc/d15/d35/c3c 0 2024-04-16T14:35:34.613 INFO:tasks.workunit.client.1.smithi115.stdout:5/179: truncate dc/f13 769530 0 2024-04-16T14:35:34.613 INFO:tasks.workunit.client.1.smithi115.stdout:5/180: write f1 [1295418,55632] 0 2024-04-16T14:35:34.613 INFO:tasks.workunit.client.1.smithi115.stdout:9/260: write d1/d6/f2b [1064944,122390] 0 2024-04-16T14:35:34.614 INFO:tasks.workunit.client.1.smithi115.stdout:2/221: symlink d0/d4/l4f 0 2024-04-16T14:35:34.615 INFO:tasks.workunit.client.0.smithi005.stdout:6/603: link d2/d5/d10/f2b d2/d5/d10/fd1 0 2024-04-16T14:35:34.615 INFO:tasks.workunit.client.0.smithi005.stdout:4/660: dwrite d0/d4d/fce [0,4194304] 0 2024-04-16T14:35:34.615 INFO:tasks.workunit.client.1.smithi115.stdout:5/181: unlink dc/f2e 0 2024-04-16T14:35:34.617 INFO:tasks.workunit.client.0.smithi005.stdout:4/661: symlink d0/d47/ld0 0 2024-04-16T14:35:34.618 INFO:tasks.workunit.client.1.smithi115.stdout:2/222: mknod d0/d4/de/d11/d25/c50 0 2024-04-16T14:35:34.618 INFO:tasks.workunit.client.1.smithi115.stdout:2/223: chown d0/d4/de/d11/l33 136208 1 2024-04-16T14:35:34.618 INFO:tasks.workunit.client.1.smithi115.stdout:9/261: mknod d1/d6/d2d/c4e 0 2024-04-16T14:35:34.619 INFO:tasks.workunit.client.1.smithi115.stdout:2/224: mkdir d0/d4/d22/d51 0 2024-04-16T14:35:34.620 INFO:tasks.workunit.client.1.smithi115.stdout:9/262: link d1/l5 d1/d10/d20/l4f 0 2024-04-16T14:35:34.621 INFO:tasks.workunit.client.1.smithi115.stdout:2/225: mkdir d0/d4/d24/d23/d52 0 2024-04-16T14:35:34.622 INFO:tasks.workunit.client.1.smithi115.stdout:2/226: dread - d0/d4/de/f48 zero size 2024-04-16T14:35:34.632 INFO:tasks.workunit.client.1.smithi115.stdout:9/263: dread d1/f2 [0,4194304] 0 2024-04-16T14:35:34.641 INFO:tasks.workunit.client.0.smithi005.stdout:5/443: dwrite d0/d6/d12/d34/d8d/d5e/f84 [0,4194304] 0 2024-04-16T14:35:34.641 INFO:tasks.workunit.client.0.smithi005.stdout:5/444: chown d0/d6/d12/d34/d8d 43835 1 2024-04-16T14:35:34.641 INFO:tasks.workunit.client.0.smithi005.stdout:6/604: dread d2/d5/f2f [0,4194304] 0 2024-04-16T14:35:34.643 INFO:tasks.workunit.client.0.smithi005.stdout:5/445: mknod d0/d6/d12/d34/c92 0 2024-04-16T14:35:34.643 INFO:tasks.workunit.client.1.smithi115.stdout:9/264: write d1/d6/f17 [2037853,121607] 0 2024-04-16T14:35:34.644 INFO:tasks.workunit.client.0.smithi005.stdout:6/605: truncate d2/d5/d28/db8/fb9 145063 0 2024-04-16T14:35:34.644 INFO:tasks.workunit.client.0.smithi005.stdout:6/606: readlink d2/d5/l65 0 2024-04-16T14:35:34.646 INFO:tasks.workunit.client.1.smithi115.stdout:9/265: mkdir d1/d6/d2d/d3d/d50 0 2024-04-16T14:35:34.646 INFO:tasks.workunit.client.0.smithi005.stdout:5/446: symlink d0/d6/d12/d34/d8d/d5e/l93 0 2024-04-16T14:35:34.646 INFO:tasks.workunit.client.0.smithi005.stdout:5/447: mknod d0/d70/c94 0 2024-04-16T14:35:34.646 INFO:tasks.workunit.client.1.smithi115.stdout:9/266: rename d1/d6/l3a to d1/d6/d2d/d3d/d50/l51 0 2024-04-16T14:35:34.648 INFO:tasks.workunit.client.1.smithi115.stdout:9/267: rename d1/d6/d2d/f1a to d1/d10/d20/d36/f52 0 2024-04-16T14:35:34.654 INFO:tasks.workunit.client.0.smithi005.stdout:5/448: dread d0/d6/d12/d1c/f22 [0,4194304] 0 2024-04-16T14:35:34.656 INFO:tasks.workunit.client.0.smithi005.stdout:5/449: mknod d0/d6/d12/d1c/d1e/c95 0 2024-04-16T14:35:34.656 INFO:tasks.workunit.client.0.smithi005.stdout:5/450: fsync d0/f8 0 2024-04-16T14:35:34.657 INFO:tasks.workunit.client.0.smithi005.stdout:5/451: chown d0/d6/d12/f41 94785 1 2024-04-16T14:35:34.657 INFO:tasks.workunit.client.0.smithi005.stdout:5/452: fdatasync d0/f26 0 2024-04-16T14:35:34.658 INFO:tasks.workunit.client.1.smithi115.stdout:4/226: dwrite d1/d15/d1e/f35 [0,4194304] 0 2024-04-16T14:35:34.658 INFO:tasks.workunit.client.1.smithi115.stdout:9/268: write d1/f19 [4819845,57520] 0 2024-04-16T14:35:34.658 INFO:tasks.workunit.client.0.smithi005.stdout:5/453: creat d0/d70/f96 x:0 0 0 2024-04-16T14:35:34.659 INFO:tasks.workunit.client.1.smithi115.stdout:4/227: symlink d1/d15/d17/l38 0 2024-04-16T14:35:34.659 INFO:tasks.workunit.client.1.smithi115.stdout:6/214: dwrite d13/f2a [0,4194304] 0 2024-04-16T14:35:34.659 INFO:tasks.workunit.client.1.smithi115.stdout:6/215: truncate d13/d1d/d20/d21/f3b 762012 0 2024-04-16T14:35:34.659 INFO:tasks.workunit.client.1.smithi115.stdout:6/216: fsync fc 0 2024-04-16T14:35:34.659 INFO:tasks.workunit.client.0.smithi005.stdout:5/454: mkdir d0/d6/d12/d34/d30/d97 0 2024-04-16T14:35:34.660 INFO:tasks.workunit.client.1.smithi115.stdout:8/213: dwrite d0/f1f [0,4194304] 0 2024-04-16T14:35:34.660 INFO:tasks.workunit.client.1.smithi115.stdout:8/214: chown d0/db/d10/l2f 820 1 2024-04-16T14:35:34.660 INFO:tasks.workunit.client.1.smithi115.stdout:8/215: chown d0/db/ce 25786860 1 2024-04-16T14:35:34.660 INFO:tasks.workunit.client.1.smithi115.stdout:8/216: readlink d0/db/d10/l38 0 2024-04-16T14:35:34.660 INFO:tasks.workunit.client.1.smithi115.stdout:9/269: stat d1/d6/d2d/c18 0 2024-04-16T14:35:34.660 INFO:tasks.workunit.client.1.smithi115.stdout:9/270: chown d1/d10/d20/d2a 7225 1 2024-04-16T14:35:34.660 INFO:tasks.workunit.client.0.smithi005.stdout:0/478: sync 2024-04-16T14:35:34.661 INFO:tasks.workunit.client.1.smithi115.stdout:0/170: dwrite d6/d10/d12/d31/d35/f3c [0,4194304] 0 2024-04-16T14:35:34.661 INFO:tasks.workunit.client.1.smithi115.stdout:0/171: creat d6/f41 x:0 0 0 2024-04-16T14:35:34.661 INFO:tasks.workunit.client.1.smithi115.stdout:0/172: readlink d6/d38/l2b 0 2024-04-16T14:35:34.663 INFO:tasks.workunit.client.0.smithi005.stdout:2/249: dwrite d0/d2a/d3a/d46/f4b [0,4194304] 0 2024-04-16T14:35:34.665 INFO:tasks.workunit.client.1.smithi115.stdout:4/228: symlink d1/d15/d1e/l39 0 2024-04-16T14:35:34.666 INFO:tasks.workunit.client.0.smithi005.stdout:0/479: link da/df/d26/c2c da/df/d50/ca1 0 2024-04-16T14:35:34.670 INFO:tasks.workunit.client.0.smithi005.stdout:6/607: dwrite d2/d20/fbd [0,4194304] 0 2024-04-16T14:35:34.671 INFO:tasks.workunit.client.0.smithi005.stdout:2/250: creat d0/d29/f4c x:0 0 0 2024-04-16T14:35:34.676 INFO:tasks.workunit.client.1.smithi115.stdout:5/182: dread dc/d15/f17 [4194304,4194304] 0 2024-04-16T14:35:34.678 INFO:tasks.workunit.client.1.smithi115.stdout:2/227: dwrite d0/d4/d24/d23/f2c [0,4194304] 0 2024-04-16T14:35:34.678 INFO:tasks.workunit.client.1.smithi115.stdout:2/228: fdatasync d0/d1b/f4b 0 2024-04-16T14:35:34.678 INFO:tasks.workunit.client.1.smithi115.stdout:2/229: write d0/d4/d24/f19 [318555,36144] 0 2024-04-16T14:35:34.680 INFO:tasks.workunit.client.0.smithi005.stdout:6/608: dread d2/d20/f7f [0,4194304] 0 2024-04-16T14:35:34.681 INFO:tasks.workunit.client.1.smithi115.stdout:8/217: dread d0/f1f [0,4194304] 0 2024-04-16T14:35:34.681 INFO:tasks.workunit.client.0.smithi005.stdout:2/251: dread d0/d4/f3c [0,4194304] 0 2024-04-16T14:35:34.682 INFO:tasks.workunit.client.0.smithi005.stdout:4/662: dwrite d0/d1b/d1d/f39 [4194304,4194304] 0 2024-04-16T14:35:34.682 INFO:tasks.workunit.client.0.smithi005.stdout:4/663: write d0/f2c [514584,48325] 0 2024-04-16T14:35:34.682 INFO:tasks.workunit.client.0.smithi005.stdout:4/664: getdents d0/d1b/d1d/dc3 0 2024-04-16T14:35:34.683 INFO:tasks.workunit.client.0.smithi005.stdout:6/609: rename d2/d20/d33/d64/d96/db4 to d2/d45/d7b/dd2 0 2024-04-16T14:35:34.683 INFO:tasks.workunit.client.0.smithi005.stdout:6/610: chown d2/d5/d10/d4d/d7a/d9d/cc1 674034 1 2024-04-16T14:35:34.683 INFO:tasks.workunit.client.0.smithi005.stdout:6/611: fdatasync d2/d3f/d47/d84/d8c/fcc 0 2024-04-16T14:35:34.684 INFO:tasks.workunit.client.1.smithi115.stdout:5/183: dread dc/f2b [0,4194304] 0 2024-04-16T14:35:34.684 INFO:tasks.workunit.client.1.smithi115.stdout:2/230: mkdir d0/d4/de/d53 0 2024-04-16T14:35:34.684 INFO:tasks.workunit.client.1.smithi115.stdout:6/217: write d13/d1d/d20/f2d [672340,87489] 0 2024-04-16T14:35:34.684 INFO:tasks.workunit.client.1.smithi115.stdout:0/173: write d6/d10/f22 [345460,55224] 0 2024-04-16T14:35:34.685 INFO:tasks.workunit.client.0.smithi005.stdout:6/612: symlink d2/d5/d10/d4d/d7a/ld3 0 2024-04-16T14:35:34.686 INFO:tasks.workunit.client.1.smithi115.stdout:2/231: rename d0/d4/c18 to d0/d1b/c54 0 2024-04-16T14:35:34.688 INFO:tasks.workunit.client.1.smithi115.stdout:6/218: mkdir d13/d1d/d20/d21/d3f 0 2024-04-16T14:35:34.689 INFO:tasks.workunit.client.0.smithi005.stdout:2/252: dread d0/d29/f49 [0,4194304] 0 2024-04-16T14:35:34.690 INFO:tasks.workunit.client.1.smithi115.stdout:0/174: mknod d6/d38/c42 0 2024-04-16T14:35:34.690 INFO:tasks.workunit.client.1.smithi115.stdout:2/232: mknod d0/d4/de/c55 0 2024-04-16T14:35:34.691 INFO:tasks.workunit.client.1.smithi115.stdout:6/219: creat d13/d1d/d20/f40 x:0 0 0 2024-04-16T14:35:34.693 INFO:tasks.workunit.client.1.smithi115.stdout:5/184: dread dc/d15/f19 [0,4194304] 0 2024-04-16T14:35:34.693 INFO:tasks.workunit.client.1.smithi115.stdout:5/185: chown f2 38 1 2024-04-16T14:35:34.694 INFO:tasks.workunit.client.1.smithi115.stdout:2/233: creat d0/d4/d24/d21/d3b/f56 x:0 0 0 2024-04-16T14:35:34.694 INFO:tasks.workunit.client.1.smithi115.stdout:2/234: truncate d0/d4/d24/d21/d3b/f56 825408 0 2024-04-16T14:35:34.694 INFO:tasks.workunit.client.1.smithi115.stdout:6/220: symlink d13/d1a/d25/d30/l41 0 2024-04-16T14:35:34.695 INFO:tasks.workunit.client.1.smithi115.stdout:2/235: mkdir d0/d4/d57 0 2024-04-16T14:35:34.697 INFO:tasks.workunit.client.1.smithi115.stdout:6/221: symlink d13/d1a/l42 0 2024-04-16T14:35:34.697 INFO:tasks.workunit.client.0.smithi005.stdout:2/253: read d0/d4/d2b/f1a [536449,54482] 0 2024-04-16T14:35:34.699 INFO:tasks.workunit.client.0.smithi005.stdout:2/254: symlink d0/d29/d3e/l4d 0 2024-04-16T14:35:34.699 INFO:tasks.workunit.client.0.smithi005.stdout:2/255: chown d0/d4/f28 83648331 1 2024-04-16T14:35:34.699 INFO:tasks.workunit.client.0.smithi005.stdout:2/256: chown d0 1450 1 2024-04-16T14:35:34.702 INFO:tasks.workunit.client.0.smithi005.stdout:4/665: dread d0/f7 [0,4194304] 0 2024-04-16T14:35:34.702 INFO:tasks.workunit.client.1.smithi115.stdout:0/175: write d6/d10/d12/d31/f39 [7307829,60103] 0 2024-04-16T14:35:34.702 INFO:tasks.workunit.client.1.smithi115.stdout:0/176: fdatasync d6/d10/f40 0 2024-04-16T14:35:34.703 INFO:tasks.workunit.client.0.smithi005.stdout:4/666: link d0/d4d/fce d0/d1b/d1d/d1f/d48/dab/db2/fd1 0 2024-04-16T14:35:34.704 INFO:tasks.workunit.client.0.smithi005.stdout:4/667: creat d0/d1b/d1d/d4f/d75/fd2 x:0 0 0 2024-04-16T14:35:34.706 INFO:tasks.workunit.client.1.smithi115.stdout:5/186: write dc/f11 [4046606,56341] 0 2024-04-16T14:35:34.706 INFO:tasks.workunit.client.1.smithi115.stdout:3/270: dwrite dc/f21 [0,4194304] 0 2024-04-16T14:35:34.706 INFO:tasks.workunit.client.1.smithi115.stdout:5/187: write dc/fe [774282,61664] 0 2024-04-16T14:35:34.707 INFO:tasks.workunit.client.0.smithi005.stdout:2/257: dread d0/d4/fc [0,4194304] 0 2024-04-16T14:35:34.712 INFO:tasks.workunit.client.1.smithi115.stdout:5/188: rmdir dc/d15/d35 39 2024-04-16T14:35:34.714 INFO:tasks.workunit.client.1.smithi115.stdout:0/177: dread d6/ff [0,4194304] 0 2024-04-16T14:35:34.716 INFO:tasks.workunit.client.1.smithi115.stdout:0/178: creat d6/d30/f43 x:0 0 0 2024-04-16T14:35:34.717 INFO:tasks.workunit.client.0.smithi005.stdout:2/258: dread d0/f27 [0,4194304] 0 2024-04-16T14:35:34.718 INFO:tasks.workunit.client.0.smithi005.stdout:2/259: mknod d0/d1c/c4e 0 2024-04-16T14:35:34.720 INFO:tasks.workunit.client.0.smithi005.stdout:2/260: creat d0/d29/d3e/f4f x:0 0 0 2024-04-16T14:35:34.722 INFO:tasks.workunit.client.0.smithi005.stdout:5/455: dwrite d0/f6a [0,4194304] 0 2024-04-16T14:35:34.722 INFO:tasks.workunit.client.1.smithi115.stdout:9/271: dwrite d1/d10/d20/d2a/f37 [0,4194304] 0 2024-04-16T14:35:34.723 INFO:tasks.workunit.client.0.smithi005.stdout:0/480: dwrite da/f1a [0,4194304] 0 2024-04-16T14:35:34.723 INFO:tasks.workunit.client.0.smithi005.stdout:0/481: chown da/fc 443283 1 2024-04-16T14:35:34.723 INFO:tasks.workunit.client.0.smithi005.stdout:0/482: creat da/df/d50/fa2 x:0 0 0 2024-04-16T14:35:34.723 INFO:tasks.workunit.client.0.smithi005.stdout:4/668: read d0/f4c [67358,20777] 0 2024-04-16T14:35:34.723 INFO:tasks.workunit.client.0.smithi005.stdout:0/483: chown da/df/d26/d39/d55/f5e 27461403 1 2024-04-16T14:35:34.723 INFO:tasks.workunit.client.0.smithi005.stdout:0/484: fsync f1 0 2024-04-16T14:35:34.724 INFO:tasks.workunit.client.0.smithi005.stdout:4/669: creat d0/d1b/d1d/d1f/d5d/da7/d90/fd3 x:0 0 0 2024-04-16T14:35:34.725 INFO:tasks.workunit.client.1.smithi115.stdout:9/272: dread d1/d10/f46 [0,4194304] 0 2024-04-16T14:35:34.725 INFO:tasks.workunit.client.1.smithi115.stdout:9/273: write d1/f2 [1410729,29502] 0 2024-04-16T14:35:34.731 INFO:tasks.workunit.client.1.smithi115.stdout:4/229: dwrite d1/d2/f8 [0,4194304] 0 2024-04-16T14:35:34.735 INFO:tasks.workunit.client.1.smithi115.stdout:8/218: dwrite d0/f1a [0,4194304] 0 2024-04-16T14:35:34.736 INFO:tasks.workunit.client.0.smithi005.stdout:0/485: creat da/d7c/fa3 x:0 0 0 2024-04-16T14:35:34.736 INFO:tasks.workunit.client.0.smithi005.stdout:0/486: readlink da/df/l4b 0 2024-04-16T14:35:34.738 INFO:tasks.workunit.client.0.smithi005.stdout:5/456: rmdir d0/d70 39 2024-04-16T14:35:34.738 INFO:tasks.workunit.client.0.smithi005.stdout:5/457: fdatasync d0/d6/d12/d1c/f1f 0 2024-04-16T14:35:34.739 INFO:tasks.workunit.client.0.smithi005.stdout:2/261: dwrite d0/d29/f4c [0,4194304] 0 2024-04-16T14:35:34.739 INFO:tasks.workunit.client.1.smithi115.stdout:5/189: dwrite dc/f2b [0,4194304] 0 2024-04-16T14:35:34.739 INFO:tasks.workunit.client.1.smithi115.stdout:3/271: dwrite dc/d29/f2e [4194304,4194304] 0 2024-04-16T14:35:34.739 INFO:tasks.workunit.client.1.smithi115.stdout:3/272: creat dc/d29/d4d/f5e x:0 0 0 2024-04-16T14:35:34.739 INFO:tasks.workunit.client.1.smithi115.stdout:4/230: creat d1/d15/d31/f3a x:0 0 0 2024-04-16T14:35:34.740 INFO:tasks.workunit.client.0.smithi005.stdout:0/487: link da/df/d1b/d3a/d53/f61 da/df/d1b/d3a/fa4 0 2024-04-16T14:35:34.740 INFO:tasks.workunit.client.0.smithi005.stdout:0/488: creat da/df/d1b/fa5 x:0 0 0 2024-04-16T14:35:34.741 INFO:tasks.workunit.client.0.smithi005.stdout:5/458: mkdir d0/d6/d98 0 2024-04-16T14:35:34.742 INFO:tasks.workunit.client.1.smithi115.stdout:8/219: mknod d0/db/c3f 0 2024-04-16T14:35:34.742 INFO:tasks.workunit.client.1.smithi115.stdout:8/220: creat d0/db/d10/d17/f40 x:0 0 0 2024-04-16T14:35:34.744 INFO:tasks.workunit.client.0.smithi005.stdout:2/262: dread d0/d4/fc [0,4194304] 0 2024-04-16T14:35:34.747 INFO:tasks.workunit.client.0.smithi005.stdout:0/489: rename da/df/d1b/d3a/d53/c56 to da/df/d1b/d3a/d53/d5a/ca6 0 2024-04-16T14:35:34.748 INFO:tasks.workunit.client.1.smithi115.stdout:5/190: mkdir dc/d3d 0 2024-04-16T14:35:34.749 INFO:tasks.workunit.client.0.smithi005.stdout:5/459: creat d0/d6/d12/d34/d8d/d5e/f99 x:0 0 0 2024-04-16T14:35:34.751 INFO:tasks.workunit.client.1.smithi115.stdout:4/231: dread d1/f22 [0,4194304] 0 2024-04-16T14:35:34.751 INFO:tasks.workunit.client.1.smithi115.stdout:4/232: write d1/d15/d17/f21 [318472,22319] 0 2024-04-16T14:35:34.751 INFO:tasks.workunit.client.0.smithi005.stdout:2/263: rename d0/l41 to d0/d2a/d3a/l50 0 2024-04-16T14:35:34.752 INFO:tasks.workunit.client.1.smithi115.stdout:3/273: mknod dc/d29/d39/c5f 0 2024-04-16T14:35:34.753 INFO:tasks.workunit.client.1.smithi115.stdout:8/221: write d0/db/f12 [2422494,128361] 0 2024-04-16T14:35:34.753 INFO:tasks.workunit.client.1.smithi115.stdout:9/274: dwrite d1/d6/d2d/f1f [0,4194304] 0 2024-04-16T14:35:34.753 INFO:tasks.workunit.client.1.smithi115.stdout:9/275: write d1/d6/f3e [874185,78083] 0 2024-04-16T14:35:34.753 INFO:tasks.workunit.client.1.smithi115.stdout:9/276: chown d1/d10/f44 1527771079 1 2024-04-16T14:35:34.754 INFO:tasks.workunit.client.0.smithi005.stdout:5/460: creat d0/d6/d98/f9a x:0 0 0 2024-04-16T14:35:34.756 INFO:tasks.workunit.client.0.smithi005.stdout:5/461: link d0/d6/d12/d34/d8d/l8a d0/d70/l9b 0 2024-04-16T14:35:34.756 INFO:tasks.workunit.client.0.smithi005.stdout:5/462: creat d0/d6/d12/d34/d42/f9c x:0 0 0 2024-04-16T14:35:34.757 INFO:tasks.workunit.client.0.smithi005.stdout:5/463: read - d0/d6/d98/f9a zero size 2024-04-16T14:35:34.758 INFO:tasks.workunit.client.1.smithi115.stdout:3/274: mkdir dc/d24/d36/d60 0 2024-04-16T14:35:34.759 INFO:tasks.workunit.client.0.smithi005.stdout:2/264: rename d0/fb to d0/d4/f51 0 2024-04-16T14:35:34.760 INFO:tasks.workunit.client.0.smithi005.stdout:9/282: sync 2024-04-16T14:35:34.760 INFO:tasks.workunit.client.0.smithi005.stdout:3/486: sync 2024-04-16T14:35:34.761 INFO:tasks.workunit.client.0.smithi005.stdout:7/529: sync 2024-04-16T14:35:34.761 INFO:tasks.workunit.client.0.smithi005.stdout:3/487: read - d2/d17/d46/d75/f8f zero size 2024-04-16T14:35:34.761 INFO:tasks.workunit.client.0.smithi005.stdout:9/283: dread - d3/d12/d16/f35 zero size 2024-04-16T14:35:34.761 INFO:tasks.workunit.client.0.smithi005.stdout:3/488: readlink d2/d17/d46/d75/l3f 0 2024-04-16T14:35:34.761 INFO:tasks.workunit.client.0.smithi005.stdout:7/530: write d1/d49/d74/d77/d22/da0/fa7 [618073,122214] 0 2024-04-16T14:35:34.761 INFO:tasks.workunit.client.0.smithi005.stdout:1/563: sync 2024-04-16T14:35:34.761 INFO:tasks.workunit.client.1.smithi115.stdout:3/275: dread dc/f11 [0,4194304] 0 2024-04-16T14:35:34.762 INFO:tasks.workunit.client.1.smithi115.stdout:6/222: rename d13/d1d/d20 to d13/d1a/d25/d30/d43 0 2024-04-16T14:35:34.762 INFO:tasks.workunit.client.0.smithi005.stdout:5/464: getdents d0/d6/d12/d1c/d81 0 2024-04-16T14:35:34.762 INFO:tasks.workunit.client.0.smithi005.stdout:9/284: write d3/d12/f1f [297839,77824] 0 2024-04-16T14:35:34.763 INFO:tasks.workunit.client.0.smithi005.stdout:7/531: mkdir d1/d49/d74/d77/d22/db0 0 2024-04-16T14:35:34.764 INFO:tasks.workunit.client.1.smithi115.stdout:5/191: read dc/f2b [2585560,4448] 0 2024-04-16T14:35:34.764 INFO:tasks.workunit.client.1.smithi115.stdout:8/222: unlink d0/la 0 2024-04-16T14:35:34.766 INFO:tasks.workunit.client.0.smithi005.stdout:2/265: write d0/d2a/f31 [1223261,7530] 0 2024-04-16T14:35:34.766 INFO:tasks.workunit.client.0.smithi005.stdout:2/266: dread - d0/d4/f3b zero size 2024-04-16T14:35:34.767 INFO:tasks.workunit.client.1.smithi115.stdout:3/276: rmdir dc/d29/d39 39 2024-04-16T14:35:34.768 INFO:tasks.workunit.client.0.smithi005.stdout:2/267: creat d0/d2a/f52 x:0 0 0 2024-04-16T14:35:34.769 INFO:tasks.workunit.client.0.smithi005.stdout:2/268: creat d0/d2a/d3a/f53 x:0 0 0 2024-04-16T14:35:34.769 INFO:tasks.workunit.client.1.smithi115.stdout:4/233: dread d1/f22 [4194304,4194304] 0 2024-04-16T14:35:34.769 INFO:tasks.workunit.client.1.smithi115.stdout:4/234: fsync d1/d15/d1e/f29 0 2024-04-16T14:35:34.770 INFO:tasks.workunit.client.0.smithi005.stdout:7/532: dread d1/dc/f7d [0,4194304] 0 2024-04-16T14:35:34.771 INFO:tasks.workunit.client.1.smithi115.stdout:9/277: symlink d1/d6/d2d/l53 0 2024-04-16T14:35:34.773 INFO:tasks.workunit.client.1.smithi115.stdout:3/277: mknod dc/d29/d4d/c61 0 2024-04-16T14:35:34.774 INFO:tasks.workunit.client.0.smithi005.stdout:1/564: dread d2/d1c/fe [0,4194304] 0 2024-04-16T14:35:34.774 INFO:tasks.workunit.client.0.smithi005.stdout:0/490: dwrite da/df/d1b/d24/f9c [0,4194304] 0 2024-04-16T14:35:34.775 INFO:tasks.workunit.client.0.smithi005.stdout:7/533: getdents d1/d49/d74/d77/d22/da0 0 2024-04-16T14:35:34.776 INFO:tasks.workunit.client.1.smithi115.stdout:6/223: unlink l1 0 2024-04-16T14:35:34.777 INFO:tasks.workunit.client.0.smithi005.stdout:5/465: write d0/f26 [3967308,18948] 0 2024-04-16T14:35:34.779 INFO:tasks.workunit.client.1.smithi115.stdout:5/192: rename f0 to dc/d15/f3e 0 2024-04-16T14:35:34.780 INFO:tasks.workunit.client.1.smithi115.stdout:8/223: rmdir d0/db/d10/d25/d2d 39 2024-04-16T14:35:34.780 INFO:tasks.workunit.client.0.smithi005.stdout:0/491: unlink da/df/d1b/f25 0 2024-04-16T14:35:34.782 INFO:tasks.workunit.client.1.smithi115.stdout:6/224: rmdir d13/d1a/d25/d30/d43/d21 39 2024-04-16T14:35:34.782 INFO:tasks.workunit.client.1.smithi115.stdout:6/225: fsync d13/d1a/f23 0 2024-04-16T14:35:34.783 INFO:tasks.workunit.client.1.smithi115.stdout:5/193: getdents dc/d15/d2d 0 2024-04-16T14:35:34.783 INFO:tasks.workunit.client.0.smithi005.stdout:1/565: getdents d2/d74 0 2024-04-16T14:35:34.784 INFO:tasks.workunit.client.0.smithi005.stdout:1/566: getdents d2/d1c/d15/d2a/d19/dc9 0 2024-04-16T14:35:34.784 INFO:tasks.workunit.client.1.smithi115.stdout:9/278: getdents d1/d6 0 2024-04-16T14:35:34.785 INFO:tasks.workunit.client.1.smithi115.stdout:6/226: creat d13/d1a/f44 x:0 0 0 2024-04-16T14:35:34.785 INFO:tasks.workunit.client.1.smithi115.stdout:6/227: readlink d13/d1a/l1e 0 2024-04-16T14:35:34.785 INFO:tasks.workunit.client.1.smithi115.stdout:6/228: dread - d13/d1a/d25/d30/d43/d21/f3c zero size 2024-04-16T14:35:34.787 INFO:tasks.workunit.client.1.smithi115.stdout:5/194: creat dc/d15/d35/f3f x:0 0 0 2024-04-16T14:35:34.789 INFO:tasks.workunit.client.1.smithi115.stdout:5/195: mknod dc/c40 0 2024-04-16T14:35:34.791 INFO:tasks.workunit.client.1.smithi115.stdout:5/196: mkdir dc/d3d/d41 0 2024-04-16T14:35:34.792 INFO:tasks.workunit.client.0.smithi005.stdout:2/269: unlink d0/d4/f51 0 2024-04-16T14:35:34.792 INFO:tasks.workunit.client.1.smithi115.stdout:8/224: dread d0/db/d10/d17/d22/f32 [0,4194304] 0 2024-04-16T14:35:34.792 INFO:tasks.workunit.client.1.smithi115.stdout:8/225: chown d0/db/ce 1 1 2024-04-16T14:35:34.793 INFO:tasks.workunit.client.0.smithi005.stdout:0/492: symlink da/df/la7 0 2024-04-16T14:35:34.793 INFO:tasks.workunit.client.0.smithi005.stdout:0/493: write da/df/d1b/d24/f9d [603973,108016] 0 2024-04-16T14:35:34.794 INFO:tasks.workunit.client.1.smithi115.stdout:4/235: dwrite d1/f37 [0,4194304] 0 2024-04-16T14:35:34.794 INFO:tasks.workunit.client.1.smithi115.stdout:4/236: write d1/d15/f34 [66464,24559] 0 2024-04-16T14:35:34.794 INFO:tasks.workunit.client.1.smithi115.stdout:5/197: unlink dc/l1a 0 2024-04-16T14:35:34.795 INFO:tasks.workunit.client.1.smithi115.stdout:5/198: creat dc/d3d/f42 x:0 0 0 2024-04-16T14:35:34.795 INFO:tasks.workunit.client.1.smithi115.stdout:5/199: truncate dc/d15/f2f 1136208 0 2024-04-16T14:35:34.795 INFO:tasks.workunit.client.1.smithi115.stdout:5/200: read - dc/f1c zero size 2024-04-16T14:35:34.796 INFO:tasks.workunit.client.1.smithi115.stdout:6/229: dread f12 [0,4194304] 0 2024-04-16T14:35:34.796 INFO:tasks.workunit.client.1.smithi115.stdout:5/201: link dc/d15/d2d/l37 dc/l43 0 2024-04-16T14:35:34.797 INFO:tasks.workunit.client.0.smithi005.stdout:1/567: creat d2/d2c/d85/dab/d51/dc4/fca x:0 0 0 2024-04-16T14:35:34.797 INFO:tasks.workunit.client.0.smithi005.stdout:5/466: getdents d0/d6/d12/d34/d6d 0 2024-04-16T14:35:34.798 INFO:tasks.workunit.client.1.smithi115.stdout:3/278: dwrite dc/d24/d36/f4e [0,4194304] 0 2024-04-16T14:35:34.798 INFO:tasks.workunit.client.1.smithi115.stdout:6/230: symlink d13/d1d/l45 0 2024-04-16T14:35:34.798 INFO:tasks.workunit.client.1.smithi115.stdout:6/231: truncate d13/d1a/d25/f32 4823382 0 2024-04-16T14:35:34.799 INFO:tasks.workunit.client.0.smithi005.stdout:0/494: mkdir da/df/d26/d39/d55/d5c/da8 0 2024-04-16T14:35:34.799 INFO:tasks.workunit.client.0.smithi005.stdout:0/495: chown da/df/l42 401133 1 2024-04-16T14:35:34.801 INFO:tasks.workunit.client.1.smithi115.stdout:5/202: rename dc/l43 to dc/l44 0 2024-04-16T14:35:34.801 INFO:tasks.workunit.client.1.smithi115.stdout:5/203: dread - dc/d15/d35/f39 zero size 2024-04-16T14:35:34.801 INFO:tasks.workunit.client.1.smithi115.stdout:5/204: fdatasync dc/d15/f3e 0 2024-04-16T14:35:34.801 INFO:tasks.workunit.client.1.smithi115.stdout:5/205: chown dc/cf 2621847 1 2024-04-16T14:35:34.802 INFO:tasks.workunit.client.0.smithi005.stdout:1/568: symlink d2/d1c/d15/d2a/d19/d42/d71/dac/d99/lcb 0 2024-04-16T14:35:34.803 INFO:tasks.workunit.client.1.smithi115.stdout:3/279: truncate dc/d29/d4d/d56/f5a 2982181 0 2024-04-16T14:35:34.804 INFO:tasks.workunit.client.0.smithi005.stdout:5/467: getdents d0/d6/d12/d1c 0 2024-04-16T14:35:34.806 INFO:tasks.workunit.client.1.smithi115.stdout:8/226: write d0/db/f26 [3251233,28768] 0 2024-04-16T14:35:34.806 INFO:tasks.workunit.client.1.smithi115.stdout:8/227: write d0/db/f26 [419259,60138] 0 2024-04-16T14:35:34.806 INFO:tasks.workunit.client.1.smithi115.stdout:9/279: dwrite d1/d6/f2b [4194304,4194304] 0 2024-04-16T14:35:34.806 INFO:tasks.workunit.client.1.smithi115.stdout:9/280: creat d1/d6/d29/f54 x:0 0 0 2024-04-16T14:35:34.806 INFO:tasks.workunit.client.0.smithi005.stdout:5/468: mknod d0/d6/d12/d34/c9d 0 2024-04-16T14:35:34.807 INFO:tasks.workunit.client.1.smithi115.stdout:4/237: dread d1/d15/d1e/f2b [0,4194304] 0 2024-04-16T14:35:34.807 INFO:tasks.workunit.client.1.smithi115.stdout:6/232: rename d13/d1a/d25/d2e to d13/d1d/d2b/d46 0 2024-04-16T14:35:34.810 INFO:tasks.workunit.client.0.smithi005.stdout:1/569: write d2/d1c/d15/d2a/d1a/d21/f89 [3311979,6397] 0 2024-04-16T14:35:34.810 INFO:tasks.workunit.client.0.smithi005.stdout:2/270: dwrite d0/d29/d3e/f4f [0,4194304] 0 2024-04-16T14:35:34.812 INFO:tasks.workunit.client.1.smithi115.stdout:5/206: unlink dc/d15/d2d/l37 0 2024-04-16T14:35:34.812 INFO:tasks.workunit.client.0.smithi005.stdout:1/570: link d2/d1c/d15/d2a/d19/d20/d27/c50 d2/d2c/d85/dab/d51/dc4/ccc 0 2024-04-16T14:35:34.815 INFO:tasks.workunit.client.1.smithi115.stdout:8/228: mknod d0/db/d10/c41 0 2024-04-16T14:35:34.817 INFO:tasks.workunit.client.0.smithi005.stdout:2/271: symlink d0/d1c/d39/d48/l54 0 2024-04-16T14:35:34.817 INFO:tasks.workunit.client.0.smithi005.stdout:2/272: creat d0/d2a/d3a/f55 x:0 0 0 2024-04-16T14:35:34.821 INFO:tasks.workunit.client.0.smithi005.stdout:1/571: mkdir d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/dc5/dcd 0 2024-04-16T14:35:34.821 INFO:tasks.workunit.client.0.smithi005.stdout:1/572: dread - d2/d74/d7a/fc1 zero size 2024-04-16T14:35:34.822 INFO:tasks.workunit.client.1.smithi115.stdout:3/280: rename dc/d24/f3e to dc/d24/d33/f62 0 2024-04-16T14:35:34.823 INFO:tasks.workunit.client.1.smithi115.stdout:5/207: symlink dc/l45 0 2024-04-16T14:35:34.825 INFO:tasks.workunit.client.1.smithi115.stdout:9/281: rename d1/d6/d2d/c4e to d1/d6/d2d/d4b/c55 0 2024-04-16T14:35:34.828 INFO:tasks.workunit.client.0.smithi005.stdout:2/273: read d0/d4/f3c [4155181,109477] 0 2024-04-16T14:35:34.828 INFO:tasks.workunit.client.0.smithi005.stdout:2/274: creat d0/d2a/d3a/d46/f56 x:0 0 0 2024-04-16T14:35:34.828 INFO:tasks.workunit.client.0.smithi005.stdout:2/275: readlink d0/d4/l2f 0 2024-04-16T14:35:34.831 INFO:tasks.workunit.client.0.smithi005.stdout:0/496: dwrite da/df/d1b/d3a/d53/d5a/d67/d79/f84 [0,4194304] 0 2024-04-16T14:35:34.832 INFO:tasks.workunit.client.0.smithi005.stdout:1/573: dread d2/d1c/d15/d2a/d19/f4a [0,4194304] 0 2024-04-16T14:35:34.833 INFO:tasks.workunit.client.1.smithi115.stdout:9/282: dread d1/d10/d20/d36/f39 [0,4194304] 0 2024-04-16T14:35:34.834 INFO:tasks.workunit.client.0.smithi005.stdout:2/276: unlink d0/d1c/f20 0 2024-04-16T14:35:34.835 INFO:tasks.workunit.client.1.smithi115.stdout:3/281: dread dc/d24/d33/f62 [0,4194304] 0 2024-04-16T14:35:34.835 INFO:tasks.workunit.client.1.smithi115.stdout:3/282: stat dc/d29/d39/c4f 0 2024-04-16T14:35:34.835 INFO:tasks.workunit.client.1.smithi115.stdout:4/238: dwrite d1/f22 [4194304,4194304] 0 2024-04-16T14:35:34.836 INFO:tasks.workunit.client.1.smithi115.stdout:9/283: read d1/f3 [228999,23814] 0 2024-04-16T14:35:34.836 INFO:tasks.workunit.client.1.smithi115.stdout:9/284: write d1/d6/d2d/f31 [267652,34568] 0 2024-04-16T14:35:34.837 INFO:tasks.workunit.client.1.smithi115.stdout:5/208: dread dc/d15/f17 [4194304,4194304] 0 2024-04-16T14:35:34.837 INFO:tasks.workunit.client.1.smithi115.stdout:3/283: symlink dc/d29/d39/l63 0 2024-04-16T14:35:34.837 INFO:tasks.workunit.client.1.smithi115.stdout:5/209: write dc/f34 [143355,123550] 0 2024-04-16T14:35:34.838 INFO:tasks.workunit.client.1.smithi115.stdout:3/284: write dc/d24/d33/d4b/f55 [980481,64591] 0 2024-04-16T14:35:34.838 INFO:tasks.workunit.client.1.smithi115.stdout:5/210: fdatasync dc/f3b 0 2024-04-16T14:35:34.838 INFO:tasks.workunit.client.1.smithi115.stdout:5/211: fdatasync dc/f2c 0 2024-04-16T14:35:34.838 INFO:tasks.workunit.client.1.smithi115.stdout:3/285: creat dc/f64 x:0 0 0 2024-04-16T14:35:34.839 INFO:tasks.workunit.client.0.smithi005.stdout:5/469: dwrite d0/d6/d6e/f7e [0,4194304] 0 2024-04-16T14:35:34.839 INFO:tasks.workunit.client.0.smithi005.stdout:1/574: link d2/d1c/d15/d2a/d25/c33 d2/d74/d7a/cce 0 2024-04-16T14:35:34.839 INFO:tasks.workunit.client.0.smithi005.stdout:2/277: truncate d0/d4/d2b/f40 2451734 0 2024-04-16T14:35:34.840 INFO:tasks.workunit.client.0.smithi005.stdout:2/278: truncate d0/d2a/f52 851880 0 2024-04-16T14:35:34.840 INFO:tasks.workunit.client.0.smithi005.stdout:2/279: fdatasync d0/d2a/d3a/d46/f56 0 2024-04-16T14:35:34.842 INFO:tasks.workunit.client.0.smithi005.stdout:0/497: mkdir da/df/d26/da9 0 2024-04-16T14:35:34.842 INFO:tasks.workunit.client.0.smithi005.stdout:0/498: write da/df/f65 [1799983,54743] 0 2024-04-16T14:35:34.844 INFO:tasks.workunit.client.1.smithi115.stdout:6/233: dwrite f8 [0,4194304] 0 2024-04-16T14:35:34.844 INFO:tasks.workunit.client.1.smithi115.stdout:3/286: dread dc/f23 [0,4194304] 0 2024-04-16T14:35:34.846 INFO:tasks.workunit.client.0.smithi005.stdout:5/470: truncate d0/d6/d12/d34/d42/f59 1638196 0 2024-04-16T14:35:34.850 INFO:tasks.workunit.client.0.smithi005.stdout:1/575: getdents d2/d1c/d15/d2a/d19/d42 0 2024-04-16T14:35:34.850 INFO:tasks.workunit.client.0.smithi005.stdout:1/576: write d2/d1c/d15/d2a/d19/d42/d64/f69 [1038699,56931] 0 2024-04-16T14:35:34.850 INFO:tasks.workunit.client.1.smithi115.stdout:4/239: unlink d1/d15/f20 0 2024-04-16T14:35:34.850 INFO:tasks.workunit.client.1.smithi115.stdout:4/240: stat d1/d15/d1e/l39 0 2024-04-16T14:35:34.850 INFO:tasks.workunit.client.1.smithi115.stdout:4/241: fdatasync d1/d15/d1e/f23 0 2024-04-16T14:35:34.853 INFO:tasks.workunit.client.1.smithi115.stdout:9/285: rename d1/d10/f26 to d1/d6/d2d/d3d/d50/f56 0 2024-04-16T14:35:34.853 INFO:tasks.workunit.client.1.smithi115.stdout:9/286: fdatasync d1/d10/d20/f3c 0 2024-04-16T14:35:34.853 INFO:tasks.workunit.client.1.smithi115.stdout:9/287: creat d1/d6/d29/f57 x:0 0 0 2024-04-16T14:35:34.854 INFO:tasks.workunit.client.0.smithi005.stdout:2/280: link d0/d4/d2b/f40 d0/d29/d3e/f57 0 2024-04-16T14:35:34.854 INFO:tasks.workunit.client.0.smithi005.stdout:2/281: write d0/d29/f4c [4642654,19804] 0 2024-04-16T14:35:34.861 INFO:tasks.workunit.client.1.smithi115.stdout:5/212: creat dc/d3d/d41/f46 x:0 0 0 2024-04-16T14:35:34.861 INFO:tasks.workunit.client.1.smithi115.stdout:5/213: truncate f1 8829535 0 2024-04-16T14:35:34.861 INFO:tasks.workunit.client.1.smithi115.stdout:5/214: stat dc/d3d/d41 0 2024-04-16T14:35:34.861 INFO:tasks.workunit.client.1.smithi115.stdout:5/215: dread - dc/d15/d35/f3f zero size 2024-04-16T14:35:34.861 INFO:tasks.workunit.client.1.smithi115.stdout:5/216: creat dc/d3d/f47 x:0 0 0 2024-04-16T14:35:34.862 INFO:tasks.workunit.client.1.smithi115.stdout:5/217: write f2 [702662,107160] 0 2024-04-16T14:35:34.862 INFO:tasks.workunit.client.1.smithi115.stdout:5/218: creat dc/d15/d35/f48 x:0 0 0 2024-04-16T14:35:34.862 INFO:tasks.workunit.client.0.smithi005.stdout:5/471: dread d0/f28 [0,4194304] 0 2024-04-16T14:35:34.862 INFO:tasks.workunit.client.0.smithi005.stdout:2/282: dread d0/d4/d2b/f1a [0,4194304] 0 2024-04-16T14:35:34.864 INFO:tasks.workunit.client.0.smithi005.stdout:2/283: rmdir d0/d2a 39 2024-04-16T14:35:34.866 INFO:tasks.workunit.client.0.smithi005.stdout:2/284: symlink d0/d1c/l58 0 2024-04-16T14:35:34.867 INFO:tasks.workunit.client.0.smithi005.stdout:1/577: write d2/d1c/d15/d2a/d19/d42/d64/f7e [6143638,107140] 0 2024-04-16T14:35:34.867 INFO:tasks.workunit.client.0.smithi005.stdout:1/578: chown d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/fb8 5938 1 2024-04-16T14:35:34.869 INFO:tasks.workunit.client.1.smithi115.stdout:6/234: mkdir d13/d1d/d47 0 2024-04-16T14:35:34.869 INFO:tasks.workunit.client.1.smithi115.stdout:6/235: fsync d13/d1d/f36 0 2024-04-16T14:35:34.869 INFO:tasks.workunit.client.0.smithi005.stdout:2/285: unlink d0/d4/d2b/f40 0 2024-04-16T14:35:34.870 INFO:tasks.workunit.client.1.smithi115.stdout:3/287: mkdir dc/d24/d33/d4b/d65 0 2024-04-16T14:35:34.870 INFO:tasks.workunit.client.1.smithi115.stdout:3/288: chown dc/d29/l2f 154342752 1 2024-04-16T14:35:34.870 INFO:tasks.workunit.client.1.smithi115.stdout:3/289: chown dc/d29/l2c 0 1 2024-04-16T14:35:34.871 INFO:tasks.workunit.client.0.smithi005.stdout:2/286: mkdir d0/d1c/d59 0 2024-04-16T14:35:34.872 INFO:tasks.workunit.client.0.smithi005.stdout:2/287: creat d0/d1c/d59/f5a x:0 0 0 2024-04-16T14:35:34.872 INFO:tasks.workunit.client.0.smithi005.stdout:2/288: write d0/d2a/d3a/f55 [125995,26613] 0 2024-04-16T14:35:34.873 INFO:tasks.workunit.client.1.smithi115.stdout:9/288: rmdir d1/d6/d29/d4c 0 2024-04-16T14:35:34.873 INFO:tasks.workunit.client.1.smithi115.stdout:9/289: dread - d1/d10/d20/f3c zero size 2024-04-16T14:35:34.873 INFO:tasks.workunit.client.1.smithi115.stdout:9/290: creat d1/d10/d20/d2a/f58 x:0 0 0 2024-04-16T14:35:34.873 INFO:tasks.workunit.client.1.smithi115.stdout:9/291: truncate d1/d10/f44 384885 0 2024-04-16T14:35:34.875 INFO:tasks.workunit.client.0.smithi005.stdout:2/289: rename d0/d4/d2b/c18 to d0/d2a/c5b 0 2024-04-16T14:35:34.875 INFO:tasks.workunit.client.0.smithi005.stdout:2/290: chown d0/d2a/f52 165 1 2024-04-16T14:35:34.875 INFO:tasks.workunit.client.0.smithi005.stdout:2/291: mknod d0/d1c/d59/c5c 0 2024-04-16T14:35:34.875 INFO:tasks.workunit.client.0.smithi005.stdout:1/579: dread d2/d1c/d15/d2a/d19/f84 [0,4194304] 0 2024-04-16T14:35:34.875 INFO:tasks.workunit.client.0.smithi005.stdout:1/580: stat d2/d1c/d15/d2a/d25/ca8 0 2024-04-16T14:35:34.876 INFO:tasks.workunit.client.1.smithi115.stdout:5/219: mknod dc/c49 0 2024-04-16T14:35:34.876 INFO:tasks.workunit.client.0.smithi005.stdout:1/581: mkdir d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/dc5/dbc/dcf 0 2024-04-16T14:35:34.877 INFO:tasks.workunit.client.0.smithi005.stdout:0/499: dwrite f8 [0,4194304] 0 2024-04-16T14:35:34.877 INFO:tasks.workunit.client.0.smithi005.stdout:0/500: mknod da/df/d26/d39/d55/d5c/caa 0 2024-04-16T14:35:34.878 INFO:tasks.workunit.client.0.smithi005.stdout:0/501: mkdir da/df/d1b/d3a/d96/dab 0 2024-04-16T14:35:34.878 INFO:tasks.workunit.client.0.smithi005.stdout:8/494: sync 2024-04-16T14:35:34.878 INFO:tasks.workunit.client.0.smithi005.stdout:8/495: chown d5/d55/d5a/l85 68 1 2024-04-16T14:35:34.879 INFO:tasks.workunit.client.1.smithi115.stdout:6/236: rename f6 to d13/d1a/d25/d30/d43/d21/f48 0 2024-04-16T14:35:34.879 INFO:tasks.workunit.client.1.smithi115.stdout:6/237: chown d13/d1a/d25/d30/d43/d21/f3c 11033297 1 2024-04-16T14:35:34.879 INFO:tasks.workunit.client.1.smithi115.stdout:6/238: stat d13/f2a 0 2024-04-16T14:35:34.880 INFO:tasks.workunit.client.0.smithi005.stdout:0/502: unlink da/f4e 0 2024-04-16T14:35:34.880 INFO:tasks.workunit.client.1.smithi115.stdout:3/290: mkdir dc/d29/d4d/d56/d66 0 2024-04-16T14:35:34.880 INFO:tasks.workunit.client.1.smithi115.stdout:3/291: stat dc/d29/d4d 0 2024-04-16T14:35:34.880 INFO:tasks.workunit.client.1.smithi115.stdout:3/292: write dc/f11 [534203,22460] 0 2024-04-16T14:35:34.881 INFO:tasks.workunit.client.1.smithi115.stdout:7/222: sync 2024-04-16T14:35:34.882 INFO:tasks.workunit.client.0.smithi005.stdout:2/292: write d0/d29/d3e/f4f [1489121,46638] 0 2024-04-16T14:35:34.882 INFO:tasks.workunit.client.0.smithi005.stdout:2/293: chown d0/d4/f6 100955126 1 2024-04-16T14:35:34.882 INFO:tasks.workunit.client.0.smithi005.stdout:2/294: stat d0/d29 0 2024-04-16T14:35:34.882 INFO:tasks.workunit.client.0.smithi005.stdout:2/295: fdatasync d0/d4/f3b 0 2024-04-16T14:35:34.882 INFO:tasks.workunit.client.1.smithi115.stdout:3/293: dread dc/f1a [0,4194304] 0 2024-04-16T14:35:34.883 INFO:tasks.workunit.client.0.smithi005.stdout:8/496: dread d5/f38 [0,4194304] 0 2024-04-16T14:35:34.883 INFO:tasks.workunit.client.0.smithi005.stdout:1/582: read d2/d2c/d85/dab/d51/f6a [3463143,112194] 0 2024-04-16T14:35:34.884 INFO:tasks.workunit.client.1.smithi115.stdout:4/242: dwrite d1/f2d [4194304,4194304] 0 2024-04-16T14:35:34.884 INFO:tasks.workunit.client.1.smithi115.stdout:3/294: dread dc/f31 [0,4194304] 0 2024-04-16T14:35:34.885 INFO:tasks.workunit.client.0.smithi005.stdout:2/296: rename d0/d4/f9 to d0/d2a/d3a/d46/f5d 0 2024-04-16T14:35:34.885 INFO:tasks.workunit.client.0.smithi005.stdout:2/297: fdatasync d0/d4/f12 0 2024-04-16T14:35:34.886 INFO:tasks.workunit.client.1.smithi115.stdout:8/229: dwrite d0/db/f13 [0,4194304] 0 2024-04-16T14:35:34.886 INFO:tasks.workunit.client.1.smithi115.stdout:5/220: creat dc/d15/d2d/f4a x:0 0 0 2024-04-16T14:35:34.886 INFO:tasks.workunit.client.1.smithi115.stdout:6/239: mkdir d13/d1d/d49 0 2024-04-16T14:35:34.886 INFO:tasks.workunit.client.1.smithi115.stdout:6/240: read - d13/d1a/d25/f27 zero size 2024-04-16T14:35:34.887 INFO:tasks.workunit.client.0.smithi005.stdout:5/472: dwrite d0/f8b [0,4194304] 0 2024-04-16T14:35:34.887 INFO:tasks.workunit.client.0.smithi005.stdout:8/497: creat d5/de/d74/fb1 x:0 0 0 2024-04-16T14:35:34.888 INFO:tasks.workunit.client.0.smithi005.stdout:1/583: rename d2/d1c/d15/d2a/d19/d42/d71/dac/d99/lcb to d2/d1c/d15/d2a/d19/d42/d71/dac/d99/ld0 0 2024-04-16T14:35:34.888 INFO:tasks.workunit.client.0.smithi005.stdout:1/584: rename d2/d1c/d15/d2a/d19 to d2/d1c/d15/d2a/d19/d42/dd1 22 2024-04-16T14:35:34.889 INFO:tasks.workunit.client.0.smithi005.stdout:2/298: mkdir d0/d4/d2b/d5e 0 2024-04-16T14:35:34.893 INFO:tasks.workunit.client.1.smithi115.stdout:4/243: unlink d1/d2/cc 0 2024-04-16T14:35:34.893 INFO:tasks.workunit.client.1.smithi115.stdout:3/295: unlink dc/d24/d36/f4a 0 2024-04-16T14:35:34.893 INFO:tasks.workunit.client.1.smithi115.stdout:3/296: creat dc/f67 x:0 0 0 2024-04-16T14:35:34.893 INFO:tasks.workunit.client.0.smithi005.stdout:8/498: creat d5/de/fb2 x:0 0 0 2024-04-16T14:35:34.893 INFO:tasks.workunit.client.0.smithi005.stdout:8/499: creat d5/d55/fb3 x:0 0 0 2024-04-16T14:35:34.894 INFO:tasks.workunit.client.1.smithi115.stdout:5/221: mknod dc/d3d/d41/c4b 0 2024-04-16T14:35:34.895 INFO:tasks.workunit.client.1.smithi115.stdout:5/222: rename dc to dc/d4c 22 2024-04-16T14:35:34.895 INFO:tasks.workunit.client.0.smithi005.stdout:0/503: write da/df/d26/d39/d55/f5e [4175630,81080] 0 2024-04-16T14:35:34.895 INFO:tasks.workunit.client.0.smithi005.stdout:0/504: chown da/df/d26/da9 143 1 2024-04-16T14:35:34.896 INFO:tasks.workunit.client.1.smithi115.stdout:8/230: dread d0/f1f [0,4194304] 0 2024-04-16T14:35:34.896 INFO:tasks.workunit.client.1.smithi115.stdout:8/231: creat d0/db/d10/f42 x:0 0 0 2024-04-16T14:35:34.896 INFO:tasks.workunit.client.1.smithi115.stdout:8/232: stat d0/db/d10/d17/f18 0 2024-04-16T14:35:34.896 INFO:tasks.workunit.client.1.smithi115.stdout:8/233: dread - d0/db/d10/d17/f40 zero size 2024-04-16T14:35:34.896 INFO:tasks.workunit.client.0.smithi005.stdout:1/585: readlink d2/d1c/d15/d2a/d19/d42/d64/d76/l6d 0 2024-04-16T14:35:34.897 INFO:tasks.workunit.client.0.smithi005.stdout:1/586: creat d2/d1c/d15/d2a/d19/d42/d64/fd2 x:0 0 0 2024-04-16T14:35:34.898 INFO:tasks.workunit.client.0.smithi005.stdout:5/473: dread d0/d6/d12/d34/d8d/d5e/d74/f86 [0,4194304] 0 2024-04-16T14:35:34.898 INFO:tasks.workunit.client.1.smithi115.stdout:0/179: sync 2024-04-16T14:35:34.898 INFO:tasks.workunit.client.1.smithi115.stdout:1/199: sync 2024-04-16T14:35:34.899 INFO:tasks.workunit.client.1.smithi115.stdout:1/200: write f0 [2158151,51920] 0 2024-04-16T14:35:34.899 INFO:tasks.workunit.client.1.smithi115.stdout:2/236: sync 2024-04-16T14:35:34.899 INFO:tasks.workunit.client.0.smithi005.stdout:2/299: mknod d0/d2a/d3a/d46/c5f 0 2024-04-16T14:35:34.899 INFO:tasks.workunit.client.0.smithi005.stdout:2/300: chown d0/d2a/d3a/d46/f56 264860376 1 2024-04-16T14:35:34.900 INFO:tasks.workunit.client.1.smithi115.stdout:7/223: rmdir d0/d1 39 2024-04-16T14:35:34.902 INFO:tasks.workunit.client.1.smithi115.stdout:6/241: creat d13/d1a/d25/f4a x:0 0 0 2024-04-16T14:35:34.904 INFO:tasks.workunit.client.1.smithi115.stdout:4/244: symlink d1/d15/d17/l3b 0 2024-04-16T14:35:34.906 INFO:tasks.workunit.client.0.smithi005.stdout:1/587: dread d2/d2c/d85/dab/f93 [0,4194304] 0 2024-04-16T14:35:34.910 INFO:tasks.workunit.client.1.smithi115.stdout:9/292: getdents d1/d6/d29 0 2024-04-16T14:35:34.912 INFO:tasks.workunit.client.1.smithi115.stdout:1/201: dread df/f27 [0,4194304] 0 2024-04-16T14:35:34.913 INFO:tasks.workunit.client.0.smithi005.stdout:0/505: creat da/df/d1b/d3a/d96/dab/fac x:0 0 0 2024-04-16T14:35:34.913 INFO:tasks.workunit.client.1.smithi115.stdout:8/234: unlink d0/db/f13 0 2024-04-16T14:35:34.913 INFO:tasks.workunit.client.1.smithi115.stdout:8/235: readlink d0/db/d10/l38 0 2024-04-16T14:35:34.914 INFO:tasks.workunit.client.1.smithi115.stdout:0/180: mkdir d6/d10/d12/d31/d35/d44 0 2024-04-16T14:35:34.917 INFO:tasks.workunit.client.1.smithi115.stdout:2/237: dread d0/d4/d24/f34 [0,4194304] 0 2024-04-16T14:35:34.919 INFO:tasks.workunit.client.1.smithi115.stdout:4/245: getdents d1/d15/d1e 0 2024-04-16T14:35:34.923 INFO:tasks.workunit.client.0.smithi005.stdout:1/588: symlink d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/ld3 0 2024-04-16T14:35:34.923 INFO:tasks.workunit.client.0.smithi005.stdout:8/500: dwrite d5/de/f1d [0,4194304] 0 2024-04-16T14:35:34.923 INFO:tasks.workunit.client.0.smithi005.stdout:8/501: write f3 [6176089,52863] 0 2024-04-16T14:35:34.923 INFO:tasks.workunit.client.0.smithi005.stdout:8/502: fsync d5/f23 0 2024-04-16T14:35:34.923 INFO:tasks.workunit.client.0.smithi005.stdout:8/503: fdatasync d5/f3a 0 2024-04-16T14:35:34.923 INFO:tasks.workunit.client.0.smithi005.stdout:8/504: fdatasync d5/d11/f62 0 2024-04-16T14:35:34.923 INFO:tasks.workunit.client.0.smithi005.stdout:0/506: creat da/df/d1b/d3a/d53/fad x:0 0 0 2024-04-16T14:35:34.923 INFO:tasks.workunit.client.0.smithi005.stdout:5/474: dwrite d0/d6/d12/f41 [0,4194304] 0 2024-04-16T14:35:34.923 INFO:tasks.workunit.client.0.smithi005.stdout:2/301: getdents d0/d29 0 2024-04-16T14:35:34.924 INFO:tasks.workunit.client.1.smithi115.stdout:3/297: dwrite dc/f16 [0,4194304] 0 2024-04-16T14:35:34.924 INFO:tasks.workunit.client.1.smithi115.stdout:5/223: mkdir dc/d15/d4d 0 2024-04-16T14:35:34.924 INFO:tasks.workunit.client.1.smithi115.stdout:5/224: chown dc/f13 219782 1 2024-04-16T14:35:34.924 INFO:tasks.workunit.client.1.smithi115.stdout:5/225: write dc/f3b [706759,15372] 0 2024-04-16T14:35:34.925 INFO:tasks.workunit.client.0.smithi005.stdout:1/589: mknod d2/d1c/d15/d2a/d25/cd4 0 2024-04-16T14:35:34.925 INFO:tasks.workunit.client.1.smithi115.stdout:9/293: mknod d1/d6/d2d/d3d/d49/c59 0 2024-04-16T14:35:34.926 INFO:tasks.workunit.client.0.smithi005.stdout:8/505: mknod d5/d7b/da8/cb4 0 2024-04-16T14:35:34.929 INFO:tasks.workunit.client.1.smithi115.stdout:8/236: link d0/f1a d0/db/d10/d17/d2c/f43 0 2024-04-16T14:35:34.929 INFO:tasks.workunit.client.1.smithi115.stdout:8/237: write d0/db/f15 [3830389,8026] 0 2024-04-16T14:35:34.930 INFO:tasks.workunit.client.1.smithi115.stdout:7/224: truncate d0/d2/f35 1094177 0 2024-04-16T14:35:34.933 INFO:tasks.workunit.client.0.smithi005.stdout:5/475: truncate d0/d6/d12/d34/f49 2635648 0 2024-04-16T14:35:34.934 INFO:tasks.workunit.client.0.smithi005.stdout:2/302: creat d0/d4/d2b/d5e/f60 x:0 0 0 2024-04-16T14:35:34.935 INFO:tasks.workunit.client.1.smithi115.stdout:0/181: dwrite d6/d10/f20 [0,4194304] 0 2024-04-16T14:35:34.936 INFO:tasks.workunit.client.1.smithi115.stdout:0/182: write d6/d38/f3d [355193,19417] 0 2024-04-16T14:35:34.937 INFO:tasks.workunit.client.1.smithi115.stdout:5/226: symlink dc/d15/d35/l4e 0 2024-04-16T14:35:34.937 INFO:tasks.workunit.client.0.smithi005.stdout:1/590: creat d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/dc5/fd5 x:0 0 0 2024-04-16T14:35:34.939 INFO:tasks.workunit.client.0.smithi005.stdout:8/506: rename d5/de/d8a/da1/f4c to d5/d55/fb5 0 2024-04-16T14:35:34.940 INFO:tasks.workunit.client.0.smithi005.stdout:0/507: dread f8 [0,4194304] 0 2024-04-16T14:35:34.942 INFO:tasks.workunit.client.1.smithi115.stdout:5/227: truncate dc/d15/f18 3496485 0 2024-04-16T14:35:34.944 INFO:tasks.workunit.client.0.smithi005.stdout:5/476: mkdir d0/d6/d6e/d9e 0 2024-04-16T14:35:34.944 INFO:tasks.workunit.client.1.smithi115.stdout:9/294: getdents d1/d10/d20 0 2024-04-16T14:35:34.946 INFO:tasks.workunit.client.0.smithi005.stdout:1/591: write d2/d1c/d15/d2a/d19/d20/d27/f54 [626311,71058] 0 2024-04-16T14:35:34.946 INFO:tasks.workunit.client.1.smithi115.stdout:3/298: write f6 [842315,28786] 0 2024-04-16T14:35:34.946 INFO:tasks.workunit.client.1.smithi115.stdout:3/299: stat dc/d24/d36/l54 0 2024-04-16T14:35:34.946 INFO:tasks.workunit.client.1.smithi115.stdout:3/300: chown dc/f23 726613469 1 2024-04-16T14:35:34.947 INFO:tasks.workunit.client.0.smithi005.stdout:0/508: rmdir da/df/d26/d39/d55/d5c 39 2024-04-16T14:35:34.947 INFO:tasks.workunit.client.1.smithi115.stdout:7/225: truncate d0/fe 2489789 0 2024-04-16T14:35:34.949 INFO:tasks.workunit.client.1.smithi115.stdout:9/295: creat d1/d6/d2d/d4b/f5a x:0 0 0 2024-04-16T14:35:34.953 INFO:tasks.workunit.client.1.smithi115.stdout:3/301: creat dc/d24/d33/f68 x:0 0 0 2024-04-16T14:35:34.954 INFO:tasks.workunit.client.0.smithi005.stdout:5/477: creat d0/d6/d12/d34/d8d/d5e/d74/f9f x:0 0 0 2024-04-16T14:35:34.956 INFO:tasks.workunit.client.1.smithi115.stdout:7/226: truncate d0/d1/f1f 3037423 0 2024-04-16T14:35:34.956 INFO:tasks.workunit.client.1.smithi115.stdout:3/302: dread dc/f31 [0,4194304] 0 2024-04-16T14:35:34.957 INFO:tasks.workunit.client.0.smithi005.stdout:2/303: getdents d0/d4 0 2024-04-16T14:35:34.957 INFO:tasks.workunit.client.0.smithi005.stdout:2/304: fsync d0/d4/f3c 0 2024-04-16T14:35:34.957 INFO:tasks.workunit.client.0.smithi005.stdout:2/305: readlink d0/d1c/l37 0 2024-04-16T14:35:34.958 INFO:tasks.workunit.client.1.smithi115.stdout:8/238: dwrite d0/db/f1b [0,4194304] 0 2024-04-16T14:35:34.958 INFO:tasks.workunit.client.1.smithi115.stdout:8/239: chown d0/db 42228601 1 2024-04-16T14:35:34.958 INFO:tasks.workunit.client.1.smithi115.stdout:8/240: readlink d0/db/l28 0 2024-04-16T14:35:34.959 INFO:tasks.workunit.client.1.smithi115.stdout:9/296: rename d1/d6/d2d/f31 to d1/d6/d2d/f5b 0 2024-04-16T14:35:34.959 INFO:tasks.workunit.client.1.smithi115.stdout:0/183: dread d6/d10/f20 [0,4194304] 0 2024-04-16T14:35:34.959 INFO:tasks.workunit.client.1.smithi115.stdout:0/184: readlink d6/l8 0 2024-04-16T14:35:34.963 INFO:tasks.workunit.client.0.smithi005.stdout:0/509: truncate da/df/f65 1037130 0 2024-04-16T14:35:34.963 INFO:tasks.workunit.client.0.smithi005.stdout:0/510: write da/df/d1b/d3a/d53/d5a/d67/f8d [188767,48415] 0 2024-04-16T14:35:34.963 INFO:tasks.workunit.client.1.smithi115.stdout:8/241: mkdir d0/db/d44 0 2024-04-16T14:35:34.967 INFO:tasks.workunit.client.0.smithi005.stdout:1/592: rmdir d2/d2c/d85/dab/d51/dc4 39 2024-04-16T14:35:34.969 INFO:tasks.workunit.client.1.smithi115.stdout:9/297: unlink d1/f2 0 2024-04-16T14:35:34.969 INFO:tasks.workunit.client.1.smithi115.stdout:9/298: truncate d1/d6/d2d/d4b/f5a 750220 0 2024-04-16T14:35:34.969 INFO:tasks.workunit.client.1.smithi115.stdout:9/299: readlink d1/d6/l3f 0 2024-04-16T14:35:34.969 INFO:tasks.workunit.client.1.smithi115.stdout:3/303: dread dc/d29/d4d/d56/f5a [0,4194304] 0 2024-04-16T14:35:34.969 INFO:tasks.workunit.client.1.smithi115.stdout:3/304: write dc/f22 [4432011,1689] 0 2024-04-16T14:35:34.971 INFO:tasks.workunit.client.1.smithi115.stdout:0/185: mknod d6/d38/c45 0 2024-04-16T14:35:34.971 INFO:tasks.workunit.client.0.smithi005.stdout:0/511: link da/f93 da/df/d26/d39/fae 0 2024-04-16T14:35:34.971 INFO:tasks.workunit.client.0.smithi005.stdout:0/512: write da/df/d26/f4c [4486859,74482] 0 2024-04-16T14:35:34.972 INFO:tasks.workunit.client.0.smithi005.stdout:5/478: rmdir d0/d6/d12/d34/d30 39 2024-04-16T14:35:34.972 INFO:tasks.workunit.client.0.smithi005.stdout:5/479: chown d0/d6/f31 8325 1 2024-04-16T14:35:34.973 INFO:tasks.workunit.client.1.smithi115.stdout:9/300: symlink d1/d6/d2d/d3d/d50/l5c 0 2024-04-16T14:35:34.973 INFO:tasks.workunit.client.1.smithi115.stdout:7/227: dread d0/d1/f20 [0,4194304] 0 2024-04-16T14:35:34.974 INFO:tasks.workunit.client.0.smithi005.stdout:1/593: mknod d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/cd6 0 2024-04-16T14:35:34.978 INFO:tasks.workunit.client.1.smithi115.stdout:0/186: rename d6/l1a to d6/l46 0 2024-04-16T14:35:34.978 INFO:tasks.workunit.client.1.smithi115.stdout:2/238: dwrite d0/d1b/f38 [0,4194304] 0 2024-04-16T14:35:34.979 INFO:tasks.workunit.client.1.smithi115.stdout:2/239: write d0/d4/f3a [64134,86053] 0 2024-04-16T14:35:34.979 INFO:tasks.workunit.client.1.smithi115.stdout:2/240: truncate d0/d4/de/f37 1312748 0 2024-04-16T14:35:34.983 INFO:tasks.workunit.client.1.smithi115.stdout:0/187: getdents d6/d10/d12/d31/d35/d28 0 2024-04-16T14:35:34.983 INFO:tasks.workunit.client.1.smithi115.stdout:0/188: write d6/d10/d12/d31/d35/f3e [257670,13090] 0 2024-04-16T14:35:34.984 INFO:tasks.workunit.client.1.smithi115.stdout:2/241: mknod d0/d1b/c58 0 2024-04-16T14:35:34.987 INFO:tasks.workunit.client.1.smithi115.stdout:7/228: rename d0/f26 to d0/d1/d3b/f50 0 2024-04-16T14:35:34.987 INFO:tasks.workunit.client.0.smithi005.stdout:8/507: dwrite d5/de/d8a/da1/f31 [0,4194304] 0 2024-04-16T14:35:34.988 INFO:tasks.workunit.client.0.smithi005.stdout:8/508: write d5/d11/f6f [213004,128792] 0 2024-04-16T14:35:34.988 INFO:tasks.workunit.client.0.smithi005.stdout:0/513: rmdir da/df/d1b 39 2024-04-16T14:35:34.988 INFO:tasks.workunit.client.0.smithi005.stdout:0/514: creat da/d7c/faf x:0 0 0 2024-04-16T14:35:34.989 INFO:tasks.workunit.client.1.smithi115.stdout:2/242: mkdir d0/d4/d24/d21/d59 0 2024-04-16T14:35:34.989 INFO:tasks.workunit.client.1.smithi115.stdout:2/243: truncate d0/d4/d24/d10/f39 381612 0 2024-04-16T14:35:34.990 INFO:tasks.workunit.client.1.smithi115.stdout:2/244: stat d0/l6 0 2024-04-16T14:35:34.990 INFO:tasks.workunit.client.1.smithi115.stdout:2/245: readlink d0/d4/de/d11/l1c 0 2024-04-16T14:35:34.990 INFO:tasks.workunit.client.1.smithi115.stdout:2/246: write d0/d4/d24/f34 [4725901,119607] 0 2024-04-16T14:35:34.993 INFO:tasks.workunit.client.1.smithi115.stdout:2/247: mkdir d0/d4/d24/d23/d52/d5a 0 2024-04-16T14:35:34.993 INFO:tasks.workunit.client.1.smithi115.stdout:2/248: fsync d0/d4/d24/f44 0 2024-04-16T14:35:34.993 INFO:tasks.workunit.client.1.smithi115.stdout:2/249: dread - d0/d1b/f41 zero size 2024-04-16T14:35:34.993 INFO:tasks.workunit.client.1.smithi115.stdout:2/250: stat d0/d4/de 0 2024-04-16T14:35:34.994 INFO:tasks.workunit.client.1.smithi115.stdout:2/251: rmdir d0/d4/d24 39 2024-04-16T14:35:34.994 INFO:tasks.workunit.client.0.smithi005.stdout:1/594: dread d2/d1c/d15/d2a/d1a/d21/f30 [0,4194304] 0 2024-04-16T14:35:34.995 INFO:tasks.workunit.client.1.smithi115.stdout:5/228: dwrite dc/d15/f24 [0,4194304] 0 2024-04-16T14:35:34.996 INFO:tasks.workunit.client.1.smithi115.stdout:4/246: dwrite d1/d15/d17/f26 [0,4194304] 0 2024-04-16T14:35:34.996 INFO:tasks.workunit.client.1.smithi115.stdout:4/247: fdatasync d1/f2d 0 2024-04-16T14:35:34.997 INFO:tasks.workunit.client.0.smithi005.stdout:8/509: link d5/d11/c2c d5/de/d8a/da1/d3d/d7f/d8d/cb6 0 2024-04-16T14:35:34.997 INFO:tasks.workunit.client.0.smithi005.stdout:8/510: readlink d5/de/d8a/da1/l6e 0 2024-04-16T14:35:34.997 INFO:tasks.workunit.client.1.smithi115.stdout:2/252: mknod d0/d4/d22/c5b 0 2024-04-16T14:35:34.998 INFO:tasks.workunit.client.1.smithi115.stdout:2/253: getdents d0/d2a 0 2024-04-16T14:35:34.998 INFO:tasks.workunit.client.1.smithi115.stdout:9/301: rmdir d1/d6/d2d/d4b 39 2024-04-16T14:35:34.998 INFO:tasks.workunit.client.0.smithi005.stdout:0/515: dread da/df/f21 [0,4194304] 0 2024-04-16T14:35:34.999 INFO:tasks.workunit.client.0.smithi005.stdout:0/516: mknod da/df/d1b/d3a/d53/d5a/d67/cb0 0 2024-04-16T14:35:34.999 INFO:tasks.workunit.client.0.smithi005.stdout:0/517: fsync da/df/d50/f6d 0 2024-04-16T14:35:35.007 INFO:tasks.workunit.client.1.smithi115.stdout:1/202: dwrite df/f1a [0,4194304] 0 2024-04-16T14:35:35.007 INFO:tasks.workunit.client.1.smithi115.stdout:8/242: dwrite d0/db/d10/d17/d2c/f43 [0,4194304] 0 2024-04-16T14:35:35.008 INFO:tasks.workunit.client.0.smithi005.stdout:2/306: dwrite d0/d4/f3c [0,4194304] 0 2024-04-16T14:35:35.008 INFO:tasks.workunit.client.1.smithi115.stdout:8/243: write d0/db/d10/d25/d2d/f35 [130758,118278] 0 2024-04-16T14:35:35.008 INFO:tasks.workunit.client.0.smithi005.stdout:1/595: dread d2/d1c/d15/d2a/d19/d20/f53 [0,4194304] 0 2024-04-16T14:35:35.008 INFO:tasks.workunit.client.0.smithi005.stdout:5/480: dwrite d0/d6/f4f [0,4194304] 0 2024-04-16T14:35:35.009 INFO:tasks.workunit.client.1.smithi115.stdout:0/189: dwrite d6/d10/d12/d1f/f32 [0,4194304] 0 2024-04-16T14:35:35.009 INFO:tasks.workunit.client.1.smithi115.stdout:3/305: dwrite dc/d29/d4d/f5e [0,4194304] 0 2024-04-16T14:35:35.016 INFO:tasks.workunit.client.0.smithi005.stdout:2/307: mkdir d0/d61 0 2024-04-16T14:35:35.020 INFO:tasks.workunit.client.0.smithi005.stdout:2/308: creat d0/d4/f62 x:0 0 0 2024-04-16T14:35:35.021 INFO:tasks.workunit.client.1.smithi115.stdout:9/302: unlink d1/d10/l25 0 2024-04-16T14:35:35.021 INFO:tasks.workunit.client.1.smithi115.stdout:2/254: dread d0/d4/de/d11/f20 [0,4194304] 0 2024-04-16T14:35:35.021 INFO:tasks.workunit.client.1.smithi115.stdout:2/255: fdatasync d0/d4/de/d11/f1e 0 2024-04-16T14:35:35.021 INFO:tasks.workunit.client.1.smithi115.stdout:2/256: chown d0/d4/d24/d21/d3b 985478119 1 2024-04-16T14:35:35.024 INFO:tasks.workunit.client.1.smithi115.stdout:1/203: mknod df/d13/d40/c42 0 2024-04-16T14:35:35.026 INFO:tasks.workunit.client.1.smithi115.stdout:8/244: creat d0/db/d10/d25/d2d/f45 x:0 0 0 2024-04-16T14:35:35.028 INFO:tasks.workunit.client.0.smithi005.stdout:6/613: sync 2024-04-16T14:35:35.028 INFO:tasks.workunit.client.0.smithi005.stdout:4/670: sync 2024-04-16T14:35:35.029 INFO:tasks.workunit.client.1.smithi115.stdout:8/245: write d0/db/f30 [40453,27625] 0 2024-04-16T14:35:35.029 INFO:tasks.workunit.client.0.smithi005.stdout:8/511: rename d5/de to d5/d7b/da8/db7 0 2024-04-16T14:35:35.031 INFO:tasks.workunit.client.0.smithi005.stdout:6/614: mkdir d2/d20/d33/dd4 0 2024-04-16T14:35:35.032 INFO:tasks.workunit.client.0.smithi005.stdout:6/615: readlink d2/d3f/d47/l3a 0 2024-04-16T14:35:35.032 INFO:tasks.workunit.client.0.smithi005.stdout:4/671: mknod d0/d1b/d1d/d1f/d5d/da7/d90/cd4 0 2024-04-16T14:35:35.032 INFO:tasks.workunit.client.0.smithi005.stdout:4/672: creat d0/d1b/d1d/d1f/d5d/fd5 x:0 0 0 2024-04-16T14:35:35.034 INFO:tasks.workunit.client.0.smithi005.stdout:0/518: rename da/df/l42 to da/df/d26/d39/d55/d5c/da8/lb1 0 2024-04-16T14:35:35.035 INFO:tasks.workunit.client.1.smithi115.stdout:0/190: dwrite d6/f41 [0,4194304] 0 2024-04-16T14:35:35.035 INFO:tasks.workunit.client.0.smithi005.stdout:2/309: dread d0/d4/f6 [0,4194304] 0 2024-04-16T14:35:35.038 INFO:tasks.workunit.client.1.smithi115.stdout:3/306: mkdir dc/d24/d33/d4b/d65/d69 0 2024-04-16T14:35:35.038 INFO:tasks.workunit.client.1.smithi115.stdout:3/307: stat dc/fe 0 2024-04-16T14:35:35.038 INFO:tasks.workunit.client.1.smithi115.stdout:3/308: creat dc/d24/d33/f6a x:0 0 0 2024-04-16T14:35:35.039 INFO:tasks.workunit.client.1.smithi115.stdout:2/257: dread d0/d4/de/d11/f12 [0,4194304] 0 2024-04-16T14:35:35.040 INFO:tasks.workunit.client.0.smithi005.stdout:6/616: dread d2/d5/f2a [0,4194304] 0 2024-04-16T14:35:35.040 INFO:tasks.workunit.client.0.smithi005.stdout:5/481: dwrite d0/d6/d12/d1c/d81/d82/f88 [0,4194304] 0 2024-04-16T14:35:35.040 INFO:tasks.workunit.client.0.smithi005.stdout:5/482: dread - d0/d6/d12/f5b zero size 2024-04-16T14:35:35.041 INFO:tasks.workunit.client.0.smithi005.stdout:0/519: link da/c41 da/df/d1b/d24/cb2 0 2024-04-16T14:35:35.042 INFO:tasks.workunit.client.1.smithi115.stdout:9/303: dwrite d1/d10/d20/f22 [0,4194304] 0 2024-04-16T14:35:35.045 INFO:tasks.workunit.client.0.smithi005.stdout:5/483: dread d0/d70/f90 [0,4194304] 0 2024-04-16T14:35:35.045 INFO:tasks.workunit.client.0.smithi005.stdout:6/617: creat d2/d5/d28/fd5 x:0 0 0 2024-04-16T14:35:35.046 INFO:tasks.workunit.client.0.smithi005.stdout:4/673: dread d0/d1b/d1d/d1f/f46 [0,4194304] 0 2024-04-16T14:35:35.046 INFO:tasks.workunit.client.0.smithi005.stdout:4/674: dread - d0/d1b/d1d/d1f/d5d/fa8 zero size 2024-04-16T14:35:35.046 INFO:tasks.workunit.client.0.smithi005.stdout:4/675: write d0/d22/d29/f78 [477542,53508] 0 2024-04-16T14:35:35.047 INFO:tasks.workunit.client.0.smithi005.stdout:4/676: write d0/f5c [1896645,113873] 0 2024-04-16T14:35:35.047 INFO:tasks.workunit.client.0.smithi005.stdout:4/677: write d0/d1b/d1d/d1f/f7d [78047,28428] 0 2024-04-16T14:35:35.048 INFO:tasks.workunit.client.1.smithi115.stdout:4/248: rmdir d1 39 2024-04-16T14:35:35.048 INFO:tasks.workunit.client.0.smithi005.stdout:0/520: truncate da/df/d1b/d24/f38 23171 0 2024-04-16T14:35:35.048 INFO:tasks.workunit.client.0.smithi005.stdout:0/521: read da/df/f1d [2924915,43768] 0 2024-04-16T14:35:35.048 INFO:tasks.workunit.client.0.smithi005.stdout:0/522: fsync da/d7c/faf 0 2024-04-16T14:35:35.049 INFO:tasks.workunit.client.1.smithi115.stdout:1/204: readlink df/l26 0 2024-04-16T14:35:35.051 INFO:tasks.workunit.client.0.smithi005.stdout:8/512: dwrite d5/d7b/da8/db7/fb2 [0,4194304] 0 2024-04-16T14:35:35.053 INFO:tasks.workunit.client.0.smithi005.stdout:1/596: rename d2/d1c/d15/d2a/d19/d42/d64/d66 to d2/d74/dd7 0 2024-04-16T14:35:35.055 INFO:tasks.workunit.client.0.smithi005.stdout:6/618: write d2/d5/f2f [7634600,61281] 0 2024-04-16T14:35:35.055 INFO:tasks.workunit.client.0.smithi005.stdout:6/619: write d2/d20/d3c/dcf/d6e/fab [459817,12877] 0 2024-04-16T14:35:35.055 INFO:tasks.workunit.client.0.smithi005.stdout:5/484: symlink d0/d6/d12/d34/la0 0 2024-04-16T14:35:35.056 INFO:tasks.workunit.client.1.smithi115.stdout:8/246: creat d0/db/d10/d25/f46 x:0 0 0 2024-04-16T14:35:35.057 INFO:tasks.workunit.client.0.smithi005.stdout:4/678: mknod d0/d1b/d1d/d1f/d5d/cd6 0 2024-04-16T14:35:35.057 INFO:tasks.workunit.client.0.smithi005.stdout:4/679: chown d0/f1a 11356 1 2024-04-16T14:35:35.060 INFO:tasks.workunit.client.1.smithi115.stdout:0/191: link d6/d10/c15 d6/d1b/c47 0 2024-04-16T14:35:35.060 INFO:tasks.workunit.client.1.smithi115.stdout:0/192: readlink d6/l46 0 2024-04-16T14:35:35.060 INFO:tasks.workunit.client.1.smithi115.stdout:0/193: write d6/d10/d12/d31/f39 [8153028,27097] 0 2024-04-16T14:35:35.060 INFO:tasks.workunit.client.1.smithi115.stdout:0/194: write d6/d10/f22 [1474063,106393] 0 2024-04-16T14:35:35.061 INFO:tasks.workunit.client.0.smithi005.stdout:1/597: rename d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/dc5/db3 to d2/d1c/dd8 0 2024-04-16T14:35:35.063 INFO:tasks.workunit.client.1.smithi115.stdout:3/309: rename dc/d24/f30 to dc/d29/f6b 0 2024-04-16T14:35:35.065 INFO:tasks.workunit.client.0.smithi005.stdout:4/680: mknod d0/d1b/d1d/d4f/d75/cd7 0 2024-04-16T14:35:35.067 INFO:tasks.workunit.client.0.smithi005.stdout:2/310: rename d0/d4/f12 to d0/d2a/f63 0 2024-04-16T14:35:35.068 INFO:tasks.workunit.client.0.smithi005.stdout:4/681: mknod d0/d1b/cd8 0 2024-04-16T14:35:35.069 INFO:tasks.workunit.client.0.smithi005.stdout:2/311: rmdir d0 39 2024-04-16T14:35:35.069 INFO:tasks.workunit.client.1.smithi115.stdout:4/249: creat d1/d2/f3c x:0 0 0 2024-04-16T14:35:35.069 INFO:tasks.workunit.client.1.smithi115.stdout:4/250: readlink d1/d15/d1e/l27 0 2024-04-16T14:35:35.070 INFO:tasks.workunit.client.1.smithi115.stdout:8/247: symlink d0/db/d10/d17/d2c/l47 0 2024-04-16T14:35:35.071 INFO:tasks.workunit.client.1.smithi115.stdout:8/248: write d0/db/d10/d25/d2d/d3b/f3c [222133,12676] 0 2024-04-16T14:35:35.071 INFO:tasks.workunit.client.1.smithi115.stdout:8/249: fdatasync d0/db/f15 0 2024-04-16T14:35:35.073 INFO:tasks.workunit.client.1.smithi115.stdout:0/195: mknod d6/d10/c48 0 2024-04-16T14:35:35.075 INFO:tasks.workunit.client.1.smithi115.stdout:2/258: rename d0/d1b/c35 to d0/d4/d4a/c5c 0 2024-04-16T14:35:35.075 INFO:tasks.workunit.client.1.smithi115.stdout:2/259: chown d0/d2a 119775 1 2024-04-16T14:35:35.076 INFO:tasks.workunit.client.0.smithi005.stdout:6/620: rename d2/d5/d10/d4d to d2/d5/d10/dd6 0 2024-04-16T14:35:35.076 INFO:tasks.workunit.client.0.smithi005.stdout:6/621: chown d2/d3f 235 1 2024-04-16T14:35:35.080 INFO:tasks.workunit.client.0.smithi005.stdout:7/534: sync 2024-04-16T14:35:35.080 INFO:tasks.workunit.client.0.smithi005.stdout:3/489: sync 2024-04-16T14:35:35.080 INFO:tasks.workunit.client.0.smithi005.stdout:9/285: sync 2024-04-16T14:35:35.080 INFO:tasks.workunit.client.0.smithi005.stdout:3/490: read - d2/d17/d46/f57 zero size 2024-04-16T14:35:35.080 INFO:tasks.workunit.client.0.smithi005.stdout:3/491: chown d2/d9/d25/d39/c5a 1010 1 2024-04-16T14:35:35.080 INFO:tasks.workunit.client.1.smithi115.stdout:3/310: truncate f6 1187852 0 2024-04-16T14:35:35.081 INFO:tasks.workunit.client.1.smithi115.stdout:8/250: symlink d0/l48 0 2024-04-16T14:35:35.081 INFO:tasks.workunit.client.1.smithi115.stdout:9/304: dread d1/d6/d29/f43 [0,4194304] 0 2024-04-16T14:35:35.082 INFO:tasks.workunit.client.0.smithi005.stdout:9/286: symlink d3/d12/d16/d46/l4a 0 2024-04-16T14:35:35.082 INFO:tasks.workunit.client.0.smithi005.stdout:5/485: dwrite d0/d6/f36 [0,4194304] 0 2024-04-16T14:35:35.083 INFO:tasks.workunit.client.0.smithi005.stdout:7/535: symlink d1/lb1 0 2024-04-16T14:35:35.084 INFO:tasks.workunit.client.0.smithi005.stdout:6/622: write d2/d5/f8 [7089923,107935] 0 2024-04-16T14:35:35.086 INFO:tasks.workunit.client.0.smithi005.stdout:3/492: creat d2/d17/d46/d75/d41/d79/fa4 x:0 0 0 2024-04-16T14:35:35.086 INFO:tasks.workunit.client.0.smithi005.stdout:3/493: chown d2/d17/d46/d75/l3f 184073353 1 2024-04-16T14:35:35.086 INFO:tasks.workunit.client.0.smithi005.stdout:3/494: stat d2/d17/d46/d47/f62 0 2024-04-16T14:35:35.086 INFO:tasks.workunit.client.0.smithi005.stdout:3/495: chown d2/d6b/d7a 3 1 2024-04-16T14:35:35.087 INFO:tasks.workunit.client.0.smithi005.stdout:9/287: mkdir d3/d49/d4b 0 2024-04-16T14:35:35.087 INFO:tasks.workunit.client.0.smithi005.stdout:9/288: stat d3/c3a 0 2024-04-16T14:35:35.087 INFO:tasks.workunit.client.0.smithi005.stdout:3/496: write d2/d17/d46/d75/f42 [149521,113210] 0 2024-04-16T14:35:35.087 INFO:tasks.workunit.client.0.smithi005.stdout:3/497: creat d2/d9/d7d/fa5 x:0 0 0 2024-04-16T14:35:35.088 INFO:tasks.workunit.client.0.smithi005.stdout:5/486: creat d0/d6/fa1 x:0 0 0 2024-04-16T14:35:35.089 INFO:tasks.workunit.client.0.smithi005.stdout:7/536: creat d1/d49/d74/d77/d22/da0/fb2 x:0 0 0 2024-04-16T14:35:35.089 INFO:tasks.workunit.client.0.smithi005.stdout:7/537: fsync d1/d49/d74/d77/d22/d27/f44 0 2024-04-16T14:35:35.089 INFO:tasks.workunit.client.0.smithi005.stdout:6/623: mknod d2/d20/d72/cd7 0 2024-04-16T14:35:35.090 INFO:tasks.workunit.client.1.smithi115.stdout:1/205: rename l8 to df/d36/l43 0 2024-04-16T14:35:35.091 INFO:tasks.workunit.client.1.smithi115.stdout:8/251: symlink d0/db/d10/d25/l49 0 2024-04-16T14:35:35.091 INFO:tasks.workunit.client.1.smithi115.stdout:8/252: readlink d0/db/d10/l38 0 2024-04-16T14:35:35.091 INFO:tasks.workunit.client.0.smithi005.stdout:9/289: rename d3/d12/d16/l17 to d3/d12/d16/d46/l4c 0 2024-04-16T14:35:35.091 INFO:tasks.workunit.client.1.smithi115.stdout:1/206: symlink df/d13/d40/l44 0 2024-04-16T14:35:35.092 INFO:tasks.workunit.client.1.smithi115.stdout:1/207: mknod df/d35/c45 0 2024-04-16T14:35:35.095 INFO:tasks.workunit.client.0.smithi005.stdout:3/498: rmdir d2/d17/d46/d75/d41 39 2024-04-16T14:35:35.095 INFO:tasks.workunit.client.0.smithi005.stdout:3/499: chown d2/d9/d5e/d9f 1996 1 2024-04-16T14:35:35.096 INFO:tasks.workunit.client.1.smithi115.stdout:8/253: write d0/f1f [3747170,10544] 0 2024-04-16T14:35:35.096 INFO:tasks.workunit.client.1.smithi115.stdout:3/311: write dc/d29/d4d/f5e [1030573,18526] 0 2024-04-16T14:35:35.097 INFO:tasks.workunit.client.0.smithi005.stdout:4/682: dwrite d0/d22/d29/f79 [0,4194304] 0 2024-04-16T14:35:35.097 INFO:tasks.workunit.client.0.smithi005.stdout:7/538: rename d1/d49/d74/d77/d22/d27/d3a/f9c to d1/d49/d74/d77/d22/d27/d3a/fb3 0 2024-04-16T14:35:35.097 INFO:tasks.workunit.client.0.smithi005.stdout:7/539: dread - d1/d49/d74/d77/f65 zero size 2024-04-16T14:35:35.098 INFO:tasks.workunit.client.0.smithi005.stdout:5/487: rename d0/d6/f77 to d0/d6/d98/fa2 0 2024-04-16T14:35:35.101 INFO:tasks.workunit.client.1.smithi115.stdout:8/254: mknod d0/db/d10/c4a 0 2024-04-16T14:35:35.101 INFO:tasks.workunit.client.1.smithi115.stdout:8/255: creat d0/db/d10/f4b x:0 0 0 2024-04-16T14:35:35.101 INFO:tasks.workunit.client.1.smithi115.stdout:8/256: creat d0/db/d10/d17/f4c x:0 0 0 2024-04-16T14:35:35.101 INFO:tasks.workunit.client.1.smithi115.stdout:8/257: read d0/db/d10/d17/f1d [468628,76627] 0 2024-04-16T14:35:35.101 INFO:tasks.workunit.client.1.smithi115.stdout:8/258: creat d0/db/d10/d25/d2d/f4d x:0 0 0 2024-04-16T14:35:35.101 INFO:tasks.workunit.client.1.smithi115.stdout:8/259: write d0/db/d10/d25/d2d/f35 [1011491,101722] 0 2024-04-16T14:35:35.103 INFO:tasks.workunit.client.1.smithi115.stdout:9/305: dread d1/d10/d20/d2a/f37 [0,4194304] 0 2024-04-16T14:35:35.103 INFO:tasks.workunit.client.0.smithi005.stdout:4/683: link d0/d1b/d1d/d4f/d75/f82 d0/d1b/d1d/d1f/d3e/d6d/fd9 0 2024-04-16T14:35:35.105 INFO:tasks.workunit.client.0.smithi005.stdout:7/540: creat d1/d85/fb4 x:0 0 0 2024-04-16T14:35:35.109 INFO:tasks.workunit.client.0.smithi005.stdout:5/488: mknod d0/d6/d12/ca3 0 2024-04-16T14:35:35.110 INFO:tasks.workunit.client.1.smithi115.stdout:9/306: creat d1/d6/d29/f5d x:0 0 0 2024-04-16T14:35:35.113 INFO:tasks.workunit.client.0.smithi005.stdout:4/684: link d0/d1b/d1d/d1f/f57 d0/d22/fda 0 2024-04-16T14:35:35.113 INFO:tasks.workunit.client.0.smithi005.stdout:4/685: fdatasync d0/d22/d29/f2d 0 2024-04-16T14:35:35.115 INFO:tasks.workunit.client.1.smithi115.stdout:9/307: creat d1/d6/d2d/d3d/d50/f5e x:0 0 0 2024-04-16T14:35:35.117 INFO:tasks.workunit.client.0.smithi005.stdout:6/624: write d2/d45/d7b/f82 [4079798,121006] 0 2024-04-16T14:35:35.119 INFO:tasks.workunit.client.1.smithi115.stdout:2/260: dread d0/d4/d24/f19 [0,4194304] 0 2024-04-16T14:35:35.120 INFO:tasks.workunit.client.1.smithi115.stdout:9/308: rmdir d1/d10 39 2024-04-16T14:35:35.121 INFO:tasks.workunit.client.0.smithi005.stdout:5/489: creat d0/d6/d12/d1c/d81/fa4 x:0 0 0 2024-04-16T14:35:35.121 INFO:tasks.workunit.client.0.smithi005.stdout:5/490: read - d0/d6/d12/f5b zero size 2024-04-16T14:35:35.121 INFO:tasks.workunit.client.0.smithi005.stdout:5/491: chown d0/f28 10172 1 2024-04-16T14:35:35.121 INFO:tasks.workunit.client.0.smithi005.stdout:5/492: write d0/d6/d12/d34/d8d/f83 [77409,113650] 0 2024-04-16T14:35:35.122 INFO:tasks.workunit.client.0.smithi005.stdout:7/541: rmdir d1/d85/d96 39 2024-04-16T14:35:35.122 INFO:tasks.workunit.client.0.smithi005.stdout:7/542: dread - d1/dc/d2f/d4f/f7a zero size 2024-04-16T14:35:35.122 INFO:tasks.workunit.client.0.smithi005.stdout:7/543: creat d1/d49/fb5 x:0 0 0 2024-04-16T14:35:35.123 INFO:tasks.workunit.client.0.smithi005.stdout:7/544: truncate d1/d49/d74/d77/d57/d47/f63 832949 0 2024-04-16T14:35:35.124 INFO:tasks.workunit.client.0.smithi005.stdout:9/290: dwrite d3/d12/d16/f19 [0,4194304] 0 2024-04-16T14:35:35.124 INFO:tasks.workunit.client.0.smithi005.stdout:9/291: fsync d3/d12/f30 0 2024-04-16T14:35:35.125 INFO:tasks.workunit.client.0.smithi005.stdout:9/292: write d3/d12/d16/f39 [738227,356] 0 2024-04-16T14:35:35.126 INFO:tasks.workunit.client.0.smithi005.stdout:4/686: dread d0/d22/d29/f79 [0,4194304] 0 2024-04-16T14:35:35.126 INFO:tasks.workunit.client.0.smithi005.stdout:5/493: rename d0/d70/l9b to d0/d6/d12/d34/d30/d97/la5 0 2024-04-16T14:35:35.127 INFO:tasks.workunit.client.1.smithi115.stdout:9/309: dread d1/d6/d2d/f5b [0,4194304] 0 2024-04-16T14:35:35.127 INFO:tasks.workunit.client.1.smithi115.stdout:9/310: rename d1/d6 to d1/d6/d5f 22 2024-04-16T14:35:35.130 INFO:tasks.workunit.client.1.smithi115.stdout:9/311: mkdir d1/d6/d2d/d4b/d60 0 2024-04-16T14:35:35.130 INFO:tasks.workunit.client.1.smithi115.stdout:9/312: fsync d1/d6/d2d/d4b/f5a 0 2024-04-16T14:35:35.130 INFO:tasks.workunit.client.0.smithi005.stdout:2/312: dwrite d0/f27 [0,4194304] 0 2024-04-16T14:35:35.130 INFO:tasks.workunit.client.0.smithi005.stdout:2/313: read - d0/d4/f62 zero size 2024-04-16T14:35:35.133 INFO:tasks.workunit.client.1.smithi115.stdout:9/313: symlink d1/d6/d2d/l61 0 2024-04-16T14:35:35.135 INFO:tasks.workunit.client.0.smithi005.stdout:9/293: unlink d3/d12/d2b/f3f 0 2024-04-16T14:35:35.137 INFO:tasks.workunit.client.0.smithi005.stdout:6/625: dread d2/d5/d10/dd6/f57 [0,4194304] 0 2024-04-16T14:35:35.137 INFO:tasks.workunit.client.0.smithi005.stdout:3/500: dwrite d2/d17/d46/d75/d41/f65 [0,4194304] 0 2024-04-16T14:35:35.137 INFO:tasks.workunit.client.0.smithi005.stdout:3/501: readlink d2/d17/d46/l52 0 2024-04-16T14:35:35.137 INFO:tasks.workunit.client.0.smithi005.stdout:3/502: chown d2/d9/d5e/d9f 24 1 2024-04-16T14:35:35.137 INFO:tasks.workunit.client.0.smithi005.stdout:3/503: read - d2/d9/d25/d39/d9c/f85 zero size 2024-04-16T14:35:35.137 INFO:tasks.workunit.client.1.smithi115.stdout:1/208: dwrite fb [0,4194304] 0 2024-04-16T14:35:35.137 INFO:tasks.workunit.client.1.smithi115.stdout:1/209: chown df/d2d/d2a/f2e 1 1 2024-04-16T14:35:35.138 INFO:tasks.workunit.client.1.smithi115.stdout:3/312: dread dc/f18 [0,4194304] 0 2024-04-16T14:35:35.138 INFO:tasks.workunit.client.0.smithi005.stdout:1/598: dwrite d2/d1c/d15/d2a/d1a/d21/f89 [4194304,4194304] 0 2024-04-16T14:35:35.138 INFO:tasks.workunit.client.1.smithi115.stdout:9/314: rename d1/d10/d20/d36/l4a to d1/d6/d2d/l62 0 2024-04-16T14:35:35.142 INFO:tasks.workunit.client.1.smithi115.stdout:3/313: link dc/d29/f2e dc/d24/f6c 0 2024-04-16T14:35:35.142 INFO:tasks.workunit.client.1.smithi115.stdout:3/314: truncate dc/ff 1288566 0 2024-04-16T14:35:35.142 INFO:tasks.workunit.client.1.smithi115.stdout:3/315: creat dc/d29/d4d/f6d x:0 0 0 2024-04-16T14:35:35.142 INFO:tasks.workunit.client.1.smithi115.stdout:3/316: dread - dc/f67 zero size 2024-04-16T14:35:35.145 INFO:tasks.workunit.client.1.smithi115.stdout:9/315: mknod d1/d10/d20/c63 0 2024-04-16T14:35:35.147 INFO:tasks.workunit.client.1.smithi115.stdout:2/261: dread d0/d1b/f38 [0,4194304] 0 2024-04-16T14:35:35.147 INFO:tasks.workunit.client.1.smithi115.stdout:2/262: chown d0/d4/de/d11/d25/f30 443524168 1 2024-04-16T14:35:35.147 INFO:tasks.workunit.client.1.smithi115.stdout:2/263: chown d0/fb 42056360 1 2024-04-16T14:35:35.148 INFO:tasks.workunit.client.0.smithi005.stdout:3/504: mknod d2/d9/d5e/ca6 0 2024-04-16T14:35:35.149 INFO:tasks.workunit.client.0.smithi005.stdout:5/494: getdents d0/d6/d12/d34/d8d/d5e 0 2024-04-16T14:35:35.149 INFO:tasks.workunit.client.0.smithi005.stdout:5/495: chown d0/d6/c37 3238832 1 2024-04-16T14:35:35.149 INFO:tasks.workunit.client.1.smithi115.stdout:4/251: dwrite d1/d2/f3c [0,4194304] 0 2024-04-16T14:35:35.149 INFO:tasks.workunit.client.1.smithi115.stdout:4/252: write d1/d15/d31/f3a [134401,59256] 0 2024-04-16T14:35:35.152 INFO:tasks.workunit.client.1.smithi115.stdout:9/316: unlink d1/d6/d2d/d3d/d49/c59 0 2024-04-16T14:35:35.153 INFO:tasks.workunit.client.0.smithi005.stdout:5/496: rename d0/d6/c64 to d0/d6/d12/d34/d42/ca6 0 2024-04-16T14:35:35.154 INFO:tasks.workunit.client.1.smithi115.stdout:4/253: truncate d1/d15/d17/f26 3862270 0 2024-04-16T14:35:35.155 INFO:tasks.workunit.client.1.smithi115.stdout:4/254: write d1/d15/d31/f3a [452280,98042] 0 2024-04-16T14:35:35.155 INFO:tasks.workunit.client.0.smithi005.stdout:9/294: dread d3/d12/d16/f1b [4194304,4194304] 0 2024-04-16T14:35:35.155 INFO:tasks.workunit.client.0.smithi005.stdout:7/545: dwrite d1/d49/d74/d77/d22/d27/d2e/f81 [0,4194304] 0 2024-04-16T14:35:35.156 INFO:tasks.workunit.client.1.smithi115.stdout:9/317: mknod d1/d10/d20/d2a/c64 0 2024-04-16T14:35:35.157 INFO:tasks.workunit.client.0.smithi005.stdout:5/497: creat d0/d70/fa7 x:0 0 0 2024-04-16T14:35:35.157 INFO:tasks.workunit.client.0.smithi005.stdout:5/498: write d0/d6/f75 [634056,65363] 0 2024-04-16T14:35:35.164 INFO:tasks.workunit.client.0.smithi005.stdout:4/687: dwrite d0/d22/d29/f78 [0,4194304] 0 2024-04-16T14:35:35.164 INFO:tasks.workunit.client.0.smithi005.stdout:7/546: link d1/d49/d74/c89 d1/d49/cb6 0 2024-04-16T14:35:35.164 INFO:tasks.workunit.client.0.smithi005.stdout:7/547: creat d1/d49/d74/d77/d57/fb7 x:0 0 0 2024-04-16T14:35:35.166 INFO:tasks.workunit.client.1.smithi115.stdout:2/264: dread d0/d4/de/d11/f12 [4194304,4194304] 0 2024-04-16T14:35:35.166 INFO:tasks.workunit.client.1.smithi115.stdout:2/265: write d0/d4/de/f48 [195112,9029] 0 2024-04-16T14:35:35.166 INFO:tasks.workunit.client.1.smithi115.stdout:2/266: truncate d0/d4/d24/f44 365544 0 2024-04-16T14:35:35.167 INFO:tasks.workunit.client.1.smithi115.stdout:2/267: truncate d0/d4/f3a 353226 0 2024-04-16T14:35:35.168 INFO:tasks.workunit.client.1.smithi115.stdout:2/268: getdents d0/d4/d24/d21 0 2024-04-16T14:35:35.169 INFO:tasks.workunit.client.0.smithi005.stdout:9/295: dread d3/d12/f2a [0,4194304] 0 2024-04-16T14:35:35.169 INFO:tasks.workunit.client.0.smithi005.stdout:9/296: fsync d3/f41 0 2024-04-16T14:35:35.169 INFO:tasks.workunit.client.0.smithi005.stdout:4/688: truncate d0/f4c 1396285 0 2024-04-16T14:35:35.170 INFO:tasks.workunit.client.0.smithi005.stdout:4/689: write d0/d1b/d1d/d1f/d3e/fcf [840941,95070] 0 2024-04-16T14:35:35.170 INFO:tasks.workunit.client.1.smithi115.stdout:2/269: truncate d0/d4/f7 1308248 0 2024-04-16T14:35:35.170 INFO:tasks.workunit.client.1.smithi115.stdout:2/270: fsync d0/d4/d24/f13 0 2024-04-16T14:35:35.170 INFO:tasks.workunit.client.1.smithi115.stdout:2/271: chown d0/d4/d24/d21 117159405 1 2024-04-16T14:35:35.171 INFO:tasks.workunit.client.1.smithi115.stdout:2/272: read d0/d4/d24/f44 [220838,64118] 0 2024-04-16T14:35:35.172 INFO:tasks.workunit.client.1.smithi115.stdout:2/273: rename d0/d4/d22/d51 to d0/d5d 0 2024-04-16T14:35:35.173 INFO:tasks.workunit.client.0.smithi005.stdout:7/548: rename d1/d49/l91 to d1/d49/d74/d77/d57/d47/d8e/lb8 0 2024-04-16T14:35:35.173 INFO:tasks.workunit.client.1.smithi115.stdout:2/274: symlink d0/d4/d57/l5e 0 2024-04-16T14:35:35.174 INFO:tasks.workunit.client.0.smithi005.stdout:5/499: write d0/d6/d12/f45 [3019031,80419] 0 2024-04-16T14:35:35.182 INFO:tasks.workunit.client.0.smithi005.stdout:5/500: dread d0/d6/d12/d34/d30/f68 [0,4194304] 0 2024-04-16T14:35:35.191 INFO:tasks.workunit.client.0.smithi005.stdout:6/626: dwrite d2/d5/d10/d68/fa2 [0,4194304] 0 2024-04-16T14:35:35.193 INFO:tasks.workunit.client.1.smithi115.stdout:4/255: dwrite d1/d15/d1e/f23 [0,4194304] 0 2024-04-16T14:35:35.196 INFO:tasks.workunit.client.1.smithi115.stdout:4/256: dread d1/d15/f34 [0,4194304] 0 2024-04-16T14:35:35.196 INFO:tasks.workunit.client.1.smithi115.stdout:4/257: write d1/d2/f11 [4355777,111781] 0 2024-04-16T14:35:35.197 INFO:tasks.workunit.client.1.smithi115.stdout:1/210: dwrite f0 [0,4194304] 0 2024-04-16T14:35:35.197 INFO:tasks.workunit.client.1.smithi115.stdout:2/275: dwrite d0/d1b/f38 [4194304,4194304] 0 2024-04-16T14:35:35.198 INFO:tasks.workunit.client.1.smithi115.stdout:1/211: chown df/c20 80337 1 2024-04-16T14:35:35.198 INFO:tasks.workunit.client.0.smithi005.stdout:6/627: dread d2/f18 [0,4194304] 0 2024-04-16T14:35:35.198 INFO:tasks.workunit.client.0.smithi005.stdout:2/314: dwrite d0/d4/d2b/f17 [0,4194304] 0 2024-04-16T14:35:35.200 INFO:tasks.workunit.client.0.smithi005.stdout:3/505: dwrite d2/d9/d5e/f94 [0,4194304] 0 2024-04-16T14:35:35.209 INFO:tasks.workunit.client.1.smithi115.stdout:4/258: write d1/f22 [6874415,41854] 0 2024-04-16T14:35:35.212 INFO:tasks.workunit.client.1.smithi115.stdout:4/259: unlink d1/l1f 0 2024-04-16T14:35:35.213 INFO:tasks.workunit.client.1.smithi115.stdout:4/260: rename d1/d2f/l32 to d1/d15/d24/l3d 0 2024-04-16T14:35:35.218 INFO:tasks.workunit.client.1.smithi115.stdout:1/212: dread df/d2d/f41 [0,4194304] 0 2024-04-16T14:35:35.218 INFO:tasks.workunit.client.1.smithi115.stdout:9/318: dwrite d1/d6/f41 [4194304,4194304] 0 2024-04-16T14:35:35.225 INFO:tasks.workunit.client.1.smithi115.stdout:4/261: write d1/d2/f3c [2435857,106735] 0 2024-04-16T14:35:35.225 INFO:tasks.workunit.client.0.smithi005.stdout:2/315: dwrite d0/d2a/d3a/d46/f5d [0,4194304] 0 2024-04-16T14:35:35.229 INFO:tasks.workunit.client.1.smithi115.stdout:4/262: link d1/d15/d1e/l39 d1/d15/d31/l3e 0 2024-04-16T14:35:35.236 INFO:tasks.workunit.client.1.smithi115.stdout:4/263: link d1/f22 d1/d15/f3f 0 2024-04-16T14:35:35.236 INFO:tasks.workunit.client.1.smithi115.stdout:1/213: dwrite f3 [0,4194304] 0 2024-04-16T14:35:35.239 INFO:tasks.workunit.client.0.smithi005.stdout:4/690: truncate d0/d1b/f62 202013 0 2024-04-16T14:35:35.240 INFO:tasks.workunit.client.0.smithi005.stdout:4/691: chown d0/d4d/l6c 744853293 1 2024-04-16T14:35:35.240 INFO:tasks.workunit.client.0.smithi005.stdout:4/692: truncate d0/d1b/d1d/d1f/d48/fc7 1003819 0 2024-04-16T14:35:35.241 INFO:tasks.workunit.client.1.smithi115.stdout:4/264: rename d1/f3 to d1/d15/d24/f40 0 2024-04-16T14:35:35.241 INFO:tasks.workunit.client.1.smithi115.stdout:4/265: stat d1/f37 0 2024-04-16T14:35:35.242 INFO:tasks.workunit.client.0.smithi005.stdout:9/297: rename d3/d12/f1f to d3/d12/d16/f4d 0 2024-04-16T14:35:35.243 INFO:tasks.workunit.client.0.smithi005.stdout:7/549: symlink d1/d49/d74/d77/d22/d27/d2e/lb9 0 2024-04-16T14:35:35.247 INFO:tasks.workunit.client.1.smithi115.stdout:6/242: sync 2024-04-16T14:35:35.247 INFO:tasks.workunit.client.1.smithi115.stdout:6/243: creat d13/d1a/d25/f4b x:0 0 0 2024-04-16T14:35:35.250 INFO:tasks.workunit.client.0.smithi005.stdout:5/501: creat d0/d6/d12/d34/d8d/fa8 x:0 0 0 2024-04-16T14:35:35.250 INFO:tasks.workunit.client.0.smithi005.stdout:5/502: dread - d0/d70/f96 zero size 2024-04-16T14:35:35.250 INFO:tasks.workunit.client.0.smithi005.stdout:5/503: write d0/d6/d12/d34/d6d/f72 [189296,80163] 0 2024-04-16T14:35:35.251 INFO:tasks.workunit.client.1.smithi115.stdout:4/266: read d1/f2d [1992753,21385] 0 2024-04-16T14:35:35.251 INFO:tasks.workunit.client.1.smithi115.stdout:1/214: dread f3 [0,4194304] 0 2024-04-16T14:35:35.253 INFO:tasks.workunit.client.1.smithi115.stdout:6/244: unlink d13/d1a/d25/d30/d43/f40 0 2024-04-16T14:35:35.253 INFO:tasks.workunit.client.1.smithi115.stdout:6/245: write d13/d1a/d25/d30/d43/f2d [2554928,65172] 0 2024-04-16T14:35:35.256 INFO:tasks.workunit.client.1.smithi115.stdout:9/319: dwrite d1/d6/f45 [0,4194304] 0 2024-04-16T14:35:35.256 INFO:tasks.workunit.client.1.smithi115.stdout:9/320: fsync d1/d6/d2d/d3d/d50/f5e 0 2024-04-16T14:35:35.256 INFO:tasks.workunit.client.0.smithi005.stdout:6/628: rmdir d2/d5/d10/dd6/d8e/daa 0 2024-04-16T14:35:35.256 INFO:tasks.workunit.client.0.smithi005.stdout:6/629: truncate d2/d5/d10/fa3 450115 0 2024-04-16T14:35:35.257 INFO:tasks.workunit.client.0.smithi005.stdout:4/693: dwrite d0/d1b/da5/fac [0,4194304] 0 2024-04-16T14:35:35.258 INFO:tasks.workunit.client.0.smithi005.stdout:4/694: dread d0/d1b/d1d/d1f/d48/fc7 [0,4194304] 0 2024-04-16T14:35:35.258 INFO:tasks.workunit.client.1.smithi115.stdout:1/215: creat df/d2d/d2a/d3e/f46 x:0 0 0 2024-04-16T14:35:35.259 INFO:tasks.workunit.client.1.smithi115.stdout:6/246: mknod d13/d1d/d49/c4c 0 2024-04-16T14:35:35.260 INFO:tasks.workunit.client.0.smithi005.stdout:3/506: unlink d2/d17/d46/d75/d41/l63 0 2024-04-16T14:35:35.261 INFO:tasks.workunit.client.0.smithi005.stdout:2/316: write d0/d29/d3e/f57 [3104496,27385] 0 2024-04-16T14:35:35.264 INFO:tasks.workunit.client.0.smithi005.stdout:9/298: rename d3/d12/d16/f35 to d3/d12/d2b/f4e 0 2024-04-16T14:35:35.264 INFO:tasks.workunit.client.1.smithi115.stdout:9/321: truncate d1/f19 7484996 0 2024-04-16T14:35:35.265 INFO:tasks.workunit.client.1.smithi115.stdout:1/216: getdents df/d36 0 2024-04-16T14:35:35.268 INFO:tasks.workunit.client.1.smithi115.stdout:9/322: mkdir d1/d6/d2d/d4b/d60/d65 0 2024-04-16T14:35:35.268 INFO:tasks.workunit.client.1.smithi115.stdout:9/323: write d1/d10/d20/f3c [529470,97340] 0 2024-04-16T14:35:35.268 INFO:tasks.workunit.client.1.smithi115.stdout:9/324: fdatasync d1/d6/d29/f57 0 2024-04-16T14:35:35.268 INFO:tasks.workunit.client.1.smithi115.stdout:9/325: readlink d1/d6/l1d 0 2024-04-16T14:35:35.268 INFO:tasks.workunit.client.1.smithi115.stdout:9/326: fdatasync d1/d6/d2d/d3d/d50/f56 0 2024-04-16T14:35:35.268 INFO:tasks.workunit.client.0.smithi005.stdout:7/550: unlink d1/d49/d74/d77/d22/d27/f36 0 2024-04-16T14:35:35.269 INFO:tasks.workunit.client.1.smithi115.stdout:1/217: rename df/d13/d40/c42 to df/d2d/c47 0 2024-04-16T14:35:35.269 INFO:tasks.workunit.client.0.smithi005.stdout:5/504: mkdir d0/d6/d6e/d9e/da9 0 2024-04-16T14:35:35.270 INFO:tasks.workunit.client.1.smithi115.stdout:1/218: rmdir df 39 2024-04-16T14:35:35.271 INFO:tasks.workunit.client.0.smithi005.stdout:6/630: symlink d2/d3f/d47/d84/ld8 0 2024-04-16T14:35:35.274 INFO:tasks.workunit.client.0.smithi005.stdout:5/505: dread d0/d6/d12/d34/d42/f59 [0,4194304] 0 2024-04-16T14:35:35.275 INFO:tasks.workunit.client.0.smithi005.stdout:5/506: readlink d0/d70/l80 0 2024-04-16T14:35:35.275 INFO:tasks.workunit.client.1.smithi115.stdout:9/327: write d1/f19 [7636251,46059] 0 2024-04-16T14:35:35.277 INFO:tasks.workunit.client.1.smithi115.stdout:9/328: truncate d1/d10/d20/d36/f52 248441 0 2024-04-16T14:35:35.278 INFO:tasks.workunit.client.1.smithi115.stdout:4/267: dwrite d1/d15/d17/f19 [0,4194304] 0 2024-04-16T14:35:35.278 INFO:tasks.workunit.client.0.smithi005.stdout:4/695: link d0/d1b/d1d/d1f/d48/dab/cba d0/d22/d61/dbe/cdb 0 2024-04-16T14:35:35.279 INFO:tasks.workunit.client.0.smithi005.stdout:4/696: chown d0/f9 513 1 2024-04-16T14:35:35.279 INFO:tasks.workunit.client.0.smithi005.stdout:4/697: dread - d0/d1b/d1d/d1f/d5d/da7/d90/fbd zero size 2024-04-16T14:35:35.280 INFO:tasks.workunit.client.1.smithi115.stdout:9/329: link d1/d10/d20/l4f d1/d10/d20/l66 0 2024-04-16T14:35:35.280 INFO:tasks.workunit.client.0.smithi005.stdout:3/507: rmdir d2/d9/d25/d39/d64 39 2024-04-16T14:35:35.280 INFO:tasks.workunit.client.0.smithi005.stdout:3/508: readlink d2/d17/l81 0 2024-04-16T14:35:35.284 INFO:tasks.workunit.client.1.smithi115.stdout:9/330: read d1/d6/f3e [180632,50268] 0 2024-04-16T14:35:35.284 INFO:tasks.workunit.client.0.smithi005.stdout:9/299: rename d3/ff to d3/d12/d2b/f4f 0 2024-04-16T14:35:35.284 INFO:tasks.workunit.client.0.smithi005.stdout:7/551: mkdir d1/d49/d74/d77/d22/db0/dba 0 2024-04-16T14:35:35.289 INFO:tasks.workunit.client.0.smithi005.stdout:5/507: rmdir d0/d6/d6e/d9e 39 2024-04-16T14:35:35.293 INFO:tasks.workunit.client.0.smithi005.stdout:9/300: creat d3/d49/f50 x:0 0 0 2024-04-16T14:35:35.293 INFO:tasks.workunit.client.0.smithi005.stdout:9/301: chown d3/d12/d16/c3d 1889 1 2024-04-16T14:35:35.295 INFO:tasks.workunit.client.0.smithi005.stdout:4/698: dread d0/d1b/d1d/d1f/d5d/da9/f2f [0,4194304] 0 2024-04-16T14:35:35.297 INFO:tasks.workunit.client.0.smithi005.stdout:7/552: mkdir d1/d49/d74/d77/d22/da0/dbb 0 2024-04-16T14:35:35.300 INFO:tasks.workunit.client.0.smithi005.stdout:7/553: mknod d1/d49/cbc 0 2024-04-16T14:35:35.302 INFO:tasks.workunit.client.0.smithi005.stdout:7/554: mkdir d1/dc/d2f/dbd 0 2024-04-16T14:35:35.302 INFO:tasks.workunit.client.0.smithi005.stdout:7/555: fsync d1/d49/d74/d77/d57/d47/d8d/fac 0 2024-04-16T14:35:35.302 INFO:tasks.workunit.client.0.smithi005.stdout:7/556: truncate d1/dc/d2f/f83 143932 0 2024-04-16T14:35:35.303 INFO:tasks.workunit.client.0.smithi005.stdout:7/557: stat d1/d49/d74/d77/d22/d27/d2e/lb9 0 2024-04-16T14:35:35.304 INFO:tasks.workunit.client.0.smithi005.stdout:7/558: mknod d1/d82/cbe 0 2024-04-16T14:35:35.304 INFO:tasks.workunit.client.0.smithi005.stdout:7/559: creat d1/d85/fbf x:0 0 0 2024-04-16T14:35:35.304 INFO:tasks.workunit.client.0.smithi005.stdout:7/560: fdatasync d1/d49/f6b 0 2024-04-16T14:35:35.304 INFO:tasks.workunit.client.0.smithi005.stdout:7/561: readlink d1/l41 0 2024-04-16T14:35:35.307 INFO:tasks.workunit.client.0.smithi005.stdout:7/562: creat d1/d49/d74/d77/fc0 x:0 0 0 2024-04-16T14:35:35.307 INFO:tasks.workunit.client.1.smithi115.stdout:9/331: read d1/d6/d2d/f1f [3253474,30570] 0 2024-04-16T14:35:35.307 INFO:tasks.workunit.client.0.smithi005.stdout:7/563: mknod d1/d49/d74/d77/d22/da0/dbb/cc1 0 2024-04-16T14:35:35.308 INFO:tasks.workunit.client.1.smithi115.stdout:9/332: dread d1/d10/f44 [0,4194304] 0 2024-04-16T14:35:35.308 INFO:tasks.workunit.client.0.smithi005.stdout:7/564: mknod d1/d49/d74/d77/d22/d27/cc2 0 2024-04-16T14:35:35.310 INFO:tasks.workunit.client.0.smithi005.stdout:7/565: link d1/d49/d74/d77/d22/c58 d1/d85/d96/cc3 0 2024-04-16T14:35:35.310 INFO:tasks.workunit.client.0.smithi005.stdout:7/566: chown d1/l4 3554660 1 2024-04-16T14:35:35.310 INFO:tasks.workunit.client.0.smithi005.stdout:7/567: write d1/d49/d74/d77/d22/d27/f46 [5046231,116468] 0 2024-04-16T14:35:35.310 INFO:tasks.workunit.client.0.smithi005.stdout:7/568: fsync d1/dc/d2f/f5d 0 2024-04-16T14:35:35.310 INFO:tasks.workunit.client.0.smithi005.stdout:7/569: truncate d1/d49/d74/d77/d22/d27/d3a/fb3 92849 0 2024-04-16T14:35:35.311 INFO:tasks.workunit.client.1.smithi115.stdout:6/247: dwrite d13/d1a/d25/d30/d43/f2d [0,4194304] 0 2024-04-16T14:35:35.311 INFO:tasks.workunit.client.1.smithi115.stdout:4/268: dwrite d1/f22 [8388608,4194304] 0 2024-04-16T14:35:35.311 INFO:tasks.workunit.client.1.smithi115.stdout:6/248: truncate d13/d1a/d25/f4a 372325 0 2024-04-16T14:35:35.311 INFO:tasks.workunit.client.1.smithi115.stdout:4/269: write d1/f2d [1806388,72049] 0 2024-04-16T14:35:35.312 INFO:tasks.workunit.client.0.smithi005.stdout:7/570: rmdir d1/d49/d74/d77/d22/db0 39 2024-04-16T14:35:35.312 INFO:tasks.workunit.client.0.smithi005.stdout:7/571: write d1/d49/d74/d77/fc0 [266602,37117] 0 2024-04-16T14:35:35.312 INFO:tasks.workunit.client.0.smithi005.stdout:7/572: fdatasync d1/d85/fb4 0 2024-04-16T14:35:35.313 INFO:tasks.workunit.client.0.smithi005.stdout:6/631: dwrite d2/f18 [0,4194304] 0 2024-04-16T14:35:35.313 INFO:tasks.workunit.client.0.smithi005.stdout:6/632: write d2/d5/d10/dd6/d7a/d9d/fca [313818,95352] 0 2024-04-16T14:35:35.313 INFO:tasks.workunit.client.0.smithi005.stdout:6/633: fsync d2/d5/d10/dd6/d7a/faf 0 2024-04-16T14:35:35.313 INFO:tasks.workunit.client.0.smithi005.stdout:6/634: creat d2/d20/d72/fd9 x:0 0 0 2024-04-16T14:35:35.313 INFO:tasks.workunit.client.0.smithi005.stdout:7/573: link d1/dc/d2f/c3d d1/d49/d74/d77/d22/d27/d3a/d5c/d9e/cc4 0 2024-04-16T14:35:35.313 INFO:tasks.workunit.client.0.smithi005.stdout:7/574: readlink d1/dc/l9a 0 2024-04-16T14:35:35.314 INFO:tasks.workunit.client.0.smithi005.stdout:3/509: dwrite d2/d17/d46/d47/f62 [0,4194304] 0 2024-04-16T14:35:35.318 INFO:tasks.workunit.client.0.smithi005.stdout:7/575: unlink d1/d49/d74/d77/d57/d47/f7c 0 2024-04-16T14:35:35.319 INFO:tasks.workunit.client.1.smithi115.stdout:6/249: mknod d13/d1a/d25/d30/d43/d2c/c4d 0 2024-04-16T14:35:35.319 INFO:tasks.workunit.client.1.smithi115.stdout:6/250: chown d13/d1a/f23 14 1 2024-04-16T14:35:35.319 INFO:tasks.workunit.client.1.smithi115.stdout:6/251: stat d13/d1a/d25/d30/d43/d2c 0 2024-04-16T14:35:35.320 INFO:tasks.workunit.client.0.smithi005.stdout:3/510: creat d2/d9/d51/fa7 x:0 0 0 2024-04-16T14:35:35.322 INFO:tasks.workunit.client.0.smithi005.stdout:3/511: getdents d2/d6b/d7a 0 2024-04-16T14:35:35.324 INFO:tasks.workunit.client.0.smithi005.stdout:3/512: chown d2/d17/d46/d75/d6d/c86 0 1 2024-04-16T14:35:35.324 INFO:tasks.workunit.client.1.smithi115.stdout:6/252: link cf d13/d1a/d25/d30/d43/d2c/c4e 0 2024-04-16T14:35:35.325 INFO:tasks.workunit.client.0.smithi005.stdout:3/513: dread d2/d17/f8b [0,4194304] 0 2024-04-16T14:35:35.325 INFO:tasks.workunit.client.1.smithi115.stdout:4/270: creat d1/d15/d31/f41 x:0 0 0 2024-04-16T14:35:35.328 INFO:tasks.workunit.client.0.smithi005.stdout:3/514: unlink d2/d9/df/c9d 0 2024-04-16T14:35:35.328 INFO:tasks.workunit.client.0.smithi005.stdout:6/635: dread d2/d45/d7b/f86 [0,4194304] 0 2024-04-16T14:35:35.330 INFO:tasks.workunit.client.1.smithi115.stdout:6/253: rename d13/d1a/d25/l35 to d13/d1d/l4f 0 2024-04-16T14:35:35.330 INFO:tasks.workunit.client.1.smithi115.stdout:6/254: readlink d13/d1a/d25/l3e 0 2024-04-16T14:35:35.330 INFO:tasks.workunit.client.1.smithi115.stdout:6/255: mknod d13/d1a/d25/d30/d43/d21/c50 0 2024-04-16T14:35:35.330 INFO:tasks.workunit.client.1.smithi115.stdout:4/271: write d1/d15/d1e/f2b [817106,116218] 0 2024-04-16T14:35:35.330 INFO:tasks.workunit.client.1.smithi115.stdout:6/256: mknod d13/d1a/d25/c51 0 2024-04-16T14:35:35.330 INFO:tasks.workunit.client.1.smithi115.stdout:4/272: mkdir d1/d15/d31/d42 0 2024-04-16T14:35:35.336 INFO:tasks.workunit.client.1.smithi115.stdout:4/273: rmdir d1/d2f 0 2024-04-16T14:35:35.336 INFO:tasks.workunit.client.1.smithi115.stdout:4/274: fdatasync d1/d15/d31/f3a 0 2024-04-16T14:35:35.336 INFO:tasks.workunit.client.1.smithi115.stdout:4/275: truncate d1/d15/d31/f3a 1242839 0 2024-04-16T14:35:35.336 INFO:tasks.workunit.client.1.smithi115.stdout:4/276: getdents d1/d15/d31/d42 0 2024-04-16T14:35:35.336 INFO:tasks.workunit.client.1.smithi115.stdout:4/277: creat d1/d15/d1e/f43 x:0 0 0 2024-04-16T14:35:35.336 INFO:tasks.workunit.client.1.smithi115.stdout:4/278: truncate d1/d2/f11 2951532 0 2024-04-16T14:35:35.336 INFO:tasks.workunit.client.0.smithi005.stdout:6/636: link d2/d20/d3c/ccd d2/d3f/d47/d84/cda 0 2024-04-16T14:35:35.336 INFO:tasks.workunit.client.0.smithi005.stdout:6/637: unlink d2/d5/d10/dd6/d7a/cb1 0 2024-04-16T14:35:35.336 INFO:tasks.workunit.client.0.smithi005.stdout:6/638: getdents d2/d45 0 2024-04-16T14:35:35.336 INFO:tasks.workunit.client.0.smithi005.stdout:6/639: getdents d2/d5/d28 0 2024-04-16T14:35:35.336 INFO:tasks.workunit.client.0.smithi005.stdout:6/640: creat d2/d3f/d53/d54/db5/fdb x:0 0 0 2024-04-16T14:35:35.337 INFO:tasks.workunit.client.0.smithi005.stdout:6/641: mknod d2/d3f/d53/d54/db5/cdc 0 2024-04-16T14:35:35.337 INFO:tasks.workunit.client.0.smithi005.stdout:6/642: getdents d2/d5/d10/dd6/d7a/dbc 0 2024-04-16T14:35:35.337 INFO:tasks.workunit.client.0.smithi005.stdout:6/643: link d2/d20/d3c/l94 d2/d3f/d47/d84/ldd 0 2024-04-16T14:35:35.338 INFO:tasks.workunit.client.0.smithi005.stdout:6/644: unlink d2/d20/d72/f91 0 2024-04-16T14:35:35.344 INFO:tasks.workunit.client.0.smithi005.stdout:9/302: dwrite d3/d12/d16/f1d [0,4194304] 0 2024-04-16T14:35:35.344 INFO:tasks.workunit.client.0.smithi005.stdout:6/645: dread d2/d5/f2a [0,4194304] 0 2024-04-16T14:35:35.345 INFO:tasks.workunit.client.0.smithi005.stdout:6/646: creat d2/d5/d10/fde x:0 0 0 2024-04-16T14:35:35.345 INFO:tasks.workunit.client.0.smithi005.stdout:5/508: dwrite d0/d6/d12/d1c/f22 [0,4194304] 0 2024-04-16T14:35:35.346 INFO:tasks.workunit.client.0.smithi005.stdout:4/699: dwrite d0/d1b/d1d/d1f/d5d/da7/db4/fc4 [0,4194304] 0 2024-04-16T14:35:35.346 INFO:tasks.workunit.client.1.smithi115.stdout:6/257: dwrite fc [0,4194304] 0 2024-04-16T14:35:35.348 INFO:tasks.workunit.client.0.smithi005.stdout:6/647: dread d2/d5/d10/f1d [0,4194304] 0 2024-04-16T14:35:35.348 INFO:tasks.workunit.client.0.smithi005.stdout:6/648: stat d2/d5/d28/f46 0 2024-04-16T14:35:35.348 INFO:tasks.workunit.client.0.smithi005.stdout:6/649: chown d2/d3f/d47/d84/d8c/fcc 9 1 2024-04-16T14:35:35.348 INFO:tasks.workunit.client.0.smithi005.stdout:6/650: fdatasync d2/d5/d10/fd1 0 2024-04-16T14:35:35.350 INFO:tasks.workunit.client.1.smithi115.stdout:6/258: mkdir d13/d1d/d52 0 2024-04-16T14:35:35.350 INFO:tasks.workunit.client.1.smithi115.stdout:7/229: sync 2024-04-16T14:35:35.351 INFO:tasks.workunit.client.0.smithi005.stdout:4/700: symlink d0/d1b/d1d/d4f/d75/ldc 0 2024-04-16T14:35:35.352 INFO:tasks.workunit.client.1.smithi115.stdout:7/230: mkdir d0/d1/d3b/d49/d51 0 2024-04-16T14:35:35.352 INFO:tasks.workunit.client.1.smithi115.stdout:7/231: dread - d0/d1/d3b/f4c zero size 2024-04-16T14:35:35.355 INFO:tasks.workunit.client.0.smithi005.stdout:5/509: write d0/f2 [7788741,110498] 0 2024-04-16T14:35:35.357 INFO:tasks.workunit.client.0.smithi005.stdout:4/701: mkdir d0/d1b/db7/ddd 0 2024-04-16T14:35:35.358 INFO:tasks.workunit.client.0.smithi005.stdout:5/510: symlink d0/d6/d12/d1c/laa 0 2024-04-16T14:35:35.358 INFO:tasks.workunit.client.0.smithi005.stdout:6/651: dread d2/d20/d3c/dcf/f70 [0,4194304] 0 2024-04-16T14:35:35.358 INFO:tasks.workunit.client.0.smithi005.stdout:6/652: write d2/d20/f98 [1018744,28283] 0 2024-04-16T14:35:35.359 INFO:tasks.workunit.client.1.smithi115.stdout:7/232: rmdir d0/d24/d2b 39 2024-04-16T14:35:35.360 INFO:tasks.workunit.client.0.smithi005.stdout:4/702: mkdir d0/d1b/d1d/dde 0 2024-04-16T14:35:35.361 INFO:tasks.workunit.client.1.smithi115.stdout:4/279: dwrite d1/d15/d1e/f43 [0,4194304] 0 2024-04-16T14:35:35.363 INFO:tasks.workunit.client.0.smithi005.stdout:5/511: rename d0/d6/d12/f3a to d0/d6/fab 0 2024-04-16T14:35:35.365 INFO:tasks.workunit.client.0.smithi005.stdout:4/703: creat d0/d22/d29/fdf x:0 0 0 2024-04-16T14:35:35.367 INFO:tasks.workunit.client.0.smithi005.stdout:5/512: symlink d0/d6/d6e/lac 0 2024-04-16T14:35:35.367 INFO:tasks.workunit.client.0.smithi005.stdout:7/576: rmdir d1/d49/d74/d77/d57 39 2024-04-16T14:35:35.367 INFO:tasks.workunit.client.0.smithi005.stdout:7/577: chown d1/d49/d74/d77/d22/d27/d3a/d5c/d9e/cc4 7 1 2024-04-16T14:35:35.370 INFO:tasks.workunit.client.0.smithi005.stdout:4/704: dread d0/f5c [0,4194304] 0 2024-04-16T14:35:35.371 INFO:tasks.workunit.client.0.smithi005.stdout:5/513: mknod d0/d6/d12/d1c/d1e/cad 0 2024-04-16T14:35:35.371 INFO:tasks.workunit.client.0.smithi005.stdout:5/514: chown d0/d6/d12/d34/d30 146768 1 2024-04-16T14:35:35.371 INFO:tasks.workunit.client.0.smithi005.stdout:5/515: truncate d0/d6/d12/d34/d6d/f8e 413998 0 2024-04-16T14:35:35.371 INFO:tasks.workunit.client.0.smithi005.stdout:7/578: getdents d1/d49/d74/d77/d22/da0/dbb 0 2024-04-16T14:35:35.371 INFO:tasks.workunit.client.0.smithi005.stdout:7/579: truncate d1/d49/d74/d77/d57/f4a 5409966 0 2024-04-16T14:35:35.374 INFO:tasks.workunit.client.0.smithi005.stdout:4/705: rename d0/d1b/d1d/d1f/d5d/da9/l81 to d0/d22/d61/le0 0 2024-04-16T14:35:35.374 INFO:tasks.workunit.client.0.smithi005.stdout:4/706: truncate d0/d1b/d1d/d1f/d5d/da7/d90/fd3 89623 0 2024-04-16T14:35:35.374 INFO:tasks.workunit.client.0.smithi005.stdout:4/707: stat d0/d1b/d1d/d1f/d3e/d6d/c5b 0 2024-04-16T14:35:35.375 INFO:tasks.workunit.client.0.smithi005.stdout:5/516: mknod d0/d6/d6e/d9e/cae 0 2024-04-16T14:35:35.379 INFO:tasks.workunit.client.0.smithi005.stdout:4/708: creat d0/d1b/db7/ddd/fe1 x:0 0 0 2024-04-16T14:35:35.379 INFO:tasks.workunit.client.0.smithi005.stdout:4/709: write d0/d1b/d1d/d4f/d75/fd2 [444746,27222] 0 2024-04-16T14:35:35.379 INFO:tasks.workunit.client.0.smithi005.stdout:4/710: readlink d0/d1b/d1d/d4f/l54 0 2024-04-16T14:35:35.380 INFO:tasks.workunit.client.0.smithi005.stdout:5/517: creat d0/faf x:0 0 0 2024-04-16T14:35:35.380 INFO:tasks.workunit.client.0.smithi005.stdout:5/518: fdatasync d0/d6/d12/d34/d6d/f8e 0 2024-04-16T14:35:35.380 INFO:tasks.workunit.client.0.smithi005.stdout:5/519: fdatasync d0/d6/d12/d34/d8d/f62 0 2024-04-16T14:35:35.386 INFO:tasks.workunit.client.0.smithi005.stdout:7/580: rmdir d1/d49 39 2024-04-16T14:35:35.388 INFO:tasks.workunit.client.1.smithi115.stdout:6/259: dwrite d13/d1a/d25/d30/d43/f2d [0,4194304] 0 2024-04-16T14:35:35.388 INFO:tasks.workunit.client.0.smithi005.stdout:4/711: creat d0/d1b/d1d/d1f/fe2 x:0 0 0 2024-04-16T14:35:35.388 INFO:tasks.workunit.client.0.smithi005.stdout:5/520: dread d0/d6/f54 [0,4194304] 0 2024-04-16T14:35:35.388 INFO:tasks.workunit.client.0.smithi005.stdout:7/581: symlink d1/dc/d2f/lc5 0 2024-04-16T14:35:35.388 INFO:tasks.workunit.client.0.smithi005.stdout:9/303: dwrite d3/d12/f26 [0,4194304] 0 2024-04-16T14:35:35.389 INFO:tasks.workunit.client.1.smithi115.stdout:7/233: dwrite d0/fe [0,4194304] 0 2024-04-16T14:35:35.390 INFO:tasks.workunit.client.0.smithi005.stdout:4/712: symlink d0/d1b/le3 0 2024-04-16T14:35:35.390 INFO:tasks.workunit.client.0.smithi005.stdout:4/713: chown d0/d1b/d1d/d1f/d5d/fd5 6004 1 2024-04-16T14:35:35.391 INFO:tasks.workunit.client.0.smithi005.stdout:6/653: dwrite d2/d5/d28/db8/fb9 [0,4194304] 0 2024-04-16T14:35:35.392 INFO:tasks.workunit.client.1.smithi115.stdout:6/260: creat d13/d1d/d52/f53 x:0 0 0 2024-04-16T14:35:35.392 INFO:tasks.workunit.client.1.smithi115.stdout:6/261: write d13/d1a/d25/f4a [819369,97898] 0 2024-04-16T14:35:35.393 INFO:tasks.workunit.client.1.smithi115.stdout:6/262: mknod d13/d1d/d2b/c54 0 2024-04-16T14:35:35.393 INFO:tasks.workunit.client.0.smithi005.stdout:7/582: mkdir d1/d49/d74/d77/d22/db0/dc6 0 2024-04-16T14:35:35.394 INFO:tasks.workunit.client.1.smithi115.stdout:6/263: mkdir d13/d1a/d55 0 2024-04-16T14:35:35.394 INFO:tasks.workunit.client.1.smithi115.stdout:6/264: chown cf 34 1 2024-04-16T14:35:35.395 INFO:tasks.workunit.client.1.smithi115.stdout:6/265: link d13/d1a/d25/f4b d13/d1d/f56 0 2024-04-16T14:35:35.396 INFO:tasks.workunit.client.1.smithi115.stdout:6/266: write d13/d1d/d52/f53 [990643,19385] 0 2024-04-16T14:35:35.396 INFO:tasks.workunit.client.1.smithi115.stdout:6/267: fdatasync d13/d1a/f23 0 2024-04-16T14:35:35.396 INFO:tasks.workunit.client.1.smithi115.stdout:6/268: dread - d13/d1a/d25/f27 zero size 2024-04-16T14:35:35.396 INFO:tasks.workunit.client.1.smithi115.stdout:6/269: rename d13/d1d/c33 to d13/d1a/d25/c57 0 2024-04-16T14:35:35.397 INFO:tasks.workunit.client.0.smithi005.stdout:9/304: rename d3/d12/f26 to d3/d12/d16/f51 0 2024-04-16T14:35:35.397 INFO:tasks.workunit.client.0.smithi005.stdout:9/305: readlink d3/d12/d16/l20 0 2024-04-16T14:35:35.398 INFO:tasks.workunit.client.0.smithi005.stdout:9/306: read d3/f41 [137092,11764] 0 2024-04-16T14:35:35.398 INFO:tasks.workunit.client.0.smithi005.stdout:9/307: truncate d3/d12/d2b/f4e 755685 0 2024-04-16T14:35:35.398 INFO:tasks.workunit.client.0.smithi005.stdout:9/308: chown d3/c22 10547 1 2024-04-16T14:35:35.398 INFO:tasks.workunit.client.0.smithi005.stdout:9/309: chown d3/f25 241756 1 2024-04-16T14:35:35.400 INFO:tasks.workunit.client.0.smithi005.stdout:6/654: creat d2/d5/d10/dd6/d8e/fdf x:0 0 0 2024-04-16T14:35:35.401 INFO:tasks.workunit.client.0.smithi005.stdout:7/583: symlink d1/d82/lc7 0 2024-04-16T14:35:35.402 INFO:tasks.workunit.client.1.smithi115.stdout:4/280: dwrite d1/f2d [4194304,4194304] 0 2024-04-16T14:35:35.403 INFO:tasks.workunit.client.0.smithi005.stdout:9/310: creat d3/d12/f52 x:0 0 0 2024-04-16T14:35:35.403 INFO:tasks.workunit.client.0.smithi005.stdout:9/311: chown d3/d12/f3e 2 1 2024-04-16T14:35:35.404 INFO:tasks.workunit.client.1.smithi115.stdout:7/234: dread d0/fe [0,4194304] 0 2024-04-16T14:35:35.404 INFO:tasks.workunit.client.0.smithi005.stdout:4/714: dwrite d0/f12 [4194304,4194304] 0 2024-04-16T14:35:35.405 INFO:tasks.workunit.client.0.smithi005.stdout:6/655: creat d2/d5/d10/dd6/d7a/d9d/fe0 x:0 0 0 2024-04-16T14:35:35.408 INFO:tasks.workunit.client.0.smithi005.stdout:7/584: unlink d1/d49/d74/d77/d22/d27/d2e/f81 0 2024-04-16T14:35:35.408 INFO:tasks.workunit.client.1.smithi115.stdout:4/281: rename d1/d15/d17/f19 to d1/d15/d31/f44 0 2024-04-16T14:35:35.409 INFO:tasks.workunit.client.1.smithi115.stdout:7/235: write d0/fe [2651567,51675] 0 2024-04-16T14:35:35.410 INFO:tasks.workunit.client.1.smithi115.stdout:6/270: dread d13/f2a [0,4194304] 0 2024-04-16T14:35:35.413 INFO:tasks.workunit.client.1.smithi115.stdout:6/271: creat d13/d1a/d55/f58 x:0 0 0 2024-04-16T14:35:35.413 INFO:tasks.workunit.client.1.smithi115.stdout:6/272: dread - d13/d1d/f56 zero size 2024-04-16T14:35:35.414 INFO:tasks.workunit.client.0.smithi005.stdout:7/585: dread d1/d49/d74/d77/d22/d27/d3a/f40 [0,4194304] 0 2024-04-16T14:35:35.414 INFO:tasks.workunit.client.0.smithi005.stdout:7/586: fsync d1/d82/f76 0 2024-04-16T14:35:35.415 INFO:tasks.workunit.client.1.smithi115.stdout:6/273: truncate fc 433600 0 2024-04-16T14:35:35.417 INFO:tasks.workunit.client.1.smithi115.stdout:4/282: dread d1/f2d [0,4194304] 0 2024-04-16T14:35:35.417 INFO:tasks.workunit.client.1.smithi115.stdout:4/283: creat d1/d15/d31/f45 x:0 0 0 2024-04-16T14:35:35.417 INFO:tasks.workunit.client.1.smithi115.stdout:4/284: write d1/d15/d31/f45 [595103,119532] 0 2024-04-16T14:35:35.417 INFO:tasks.workunit.client.1.smithi115.stdout:6/274: mknod d13/d1a/d25/d30/d43/c59 0 2024-04-16T14:35:35.419 INFO:tasks.workunit.client.0.smithi005.stdout:9/312: dread d3/d12/d16/f1a [0,4194304] 0 2024-04-16T14:35:35.421 INFO:tasks.workunit.client.1.smithi115.stdout:6/275: rename d13/d1a/d25/d30/d43/d21 to d13/d1d/d2b/d46/d5a 0 2024-04-16T14:35:35.421 INFO:tasks.workunit.client.1.smithi115.stdout:6/276: chown d13/l15 1 1 2024-04-16T14:35:35.421 INFO:tasks.workunit.client.1.smithi115.stdout:6/277: write d13/d1d/f36 [2061161,60883] 0 2024-04-16T14:35:35.422 INFO:tasks.workunit.client.1.smithi115.stdout:6/278: getdents d13/d1d 0 2024-04-16T14:35:35.424 INFO:tasks.workunit.client.1.smithi115.stdout:6/279: mkdir d13/d1d/d2b/d5b 0 2024-04-16T14:35:35.425 INFO:tasks.workunit.client.1.smithi115.stdout:6/280: creat d13/d1d/f5c x:0 0 0 2024-04-16T14:35:35.425 INFO:tasks.workunit.client.1.smithi115.stdout:6/281: readlink d13/l14 0 2024-04-16T14:35:35.425 INFO:tasks.workunit.client.1.smithi115.stdout:6/282: read - d13/d1d/f5c zero size 2024-04-16T14:35:35.427 INFO:tasks.workunit.client.1.smithi115.stdout:5/229: sync 2024-04-16T14:35:35.427 INFO:tasks.workunit.client.1.smithi115.stdout:5/230: dread - dc/f1c zero size 2024-04-16T14:35:35.429 INFO:tasks.workunit.client.1.smithi115.stdout:6/283: rename d13/d1d/d2b/d46/l3a to d13/d1d/l5d 0 2024-04-16T14:35:35.430 INFO:tasks.workunit.client.0.smithi005.stdout:9/313: write d3/d12/f28 [2996623,110785] 0 2024-04-16T14:35:35.433 INFO:tasks.workunit.client.1.smithi115.stdout:4/285: dread d1/d15/d1e/f23 [0,4194304] 0 2024-04-16T14:35:35.435 INFO:tasks.workunit.client.1.smithi115.stdout:4/286: mkdir d1/d15/d31/d42/d46 0 2024-04-16T14:35:35.436 INFO:tasks.workunit.client.0.smithi005.stdout:4/715: getdents d0/d1b/d1d/d1f/d3e/d6d 0 2024-04-16T14:35:35.437 INFO:tasks.workunit.client.1.smithi115.stdout:4/287: symlink d1/d15/d17/l47 0 2024-04-16T14:35:35.437 INFO:tasks.workunit.client.1.smithi115.stdout:4/288: rmdir d1/d15/d24 39 2024-04-16T14:35:35.438 INFO:tasks.workunit.client.0.smithi005.stdout:4/716: chown d0/d4d/l68 2442925 1 2024-04-16T14:35:35.439 INFO:tasks.workunit.client.0.smithi005.stdout:6/656: mkdir d2/de1 0 2024-04-16T14:35:35.439 INFO:tasks.workunit.client.1.smithi115.stdout:6/284: dread d13/d1d/f36 [0,4194304] 0 2024-04-16T14:35:35.439 INFO:tasks.workunit.client.1.smithi115.stdout:6/285: readlink d13/d1a/d25/d30/l41 0 2024-04-16T14:35:35.439 INFO:tasks.workunit.client.1.smithi115.stdout:6/286: dread - d13/d1a/d25/f4b zero size 2024-04-16T14:35:35.440 INFO:tasks.workunit.client.1.smithi115.stdout:6/287: write d13/d1d/f5c [1028725,61156] 0 2024-04-16T14:35:35.440 INFO:tasks.workunit.client.0.smithi005.stdout:6/657: unlink d2/d20/d3c/dcf/fa1 0 2024-04-16T14:35:35.441 INFO:tasks.workunit.client.0.smithi005.stdout:6/658: creat d2/d3f/d47/fe2 x:0 0 0 2024-04-16T14:35:35.442 INFO:tasks.workunit.client.0.smithi005.stdout:6/659: creat d2/d3f/d47/d84/da5/fe3 x:0 0 0 2024-04-16T14:35:35.444 INFO:tasks.workunit.client.0.smithi005.stdout:7/587: dwrite d1/dc/d2f/fa6 [0,4194304] 0 2024-04-16T14:35:35.444 INFO:tasks.workunit.client.0.smithi005.stdout:7/588: stat d1/d82/f76 0 2024-04-16T14:35:35.444 INFO:tasks.workunit.client.0.smithi005.stdout:7/589: write d1/dc/f18 [719738,115496] 0 2024-04-16T14:35:35.446 INFO:tasks.workunit.client.0.smithi005.stdout:6/660: rmdir d2/d5/d10 39 2024-04-16T14:35:35.447 INFO:tasks.workunit.client.1.smithi115.stdout:7/236: dwrite d0/d1/f1f [0,4194304] 0 2024-04-16T14:35:35.448 INFO:tasks.workunit.client.1.smithi115.stdout:7/237: dread - d0/d1/d3b/d49/f4d zero size 2024-04-16T14:35:35.449 INFO:tasks.workunit.client.0.smithi005.stdout:7/590: rename d1/d49/d74/d77/f17 to d1/d49/d74/d77/d57/d47/daa/fc8 0 2024-04-16T14:35:35.452 INFO:tasks.workunit.client.0.smithi005.stdout:6/661: link d2/d5/d28/db8/fb9 d2/d5/fe4 0 2024-04-16T14:35:35.455 INFO:tasks.workunit.client.0.smithi005.stdout:7/591: symlink d1/d49/d74/d77/d22/d27/d3a/d5c/d9e/lc9 0 2024-04-16T14:35:35.455 INFO:tasks.workunit.client.0.smithi005.stdout:7/592: write d1/d49/d74/d77/d57/d47/d8e/fad [595017,52763] 0 2024-04-16T14:35:35.455 INFO:tasks.workunit.client.0.smithi005.stdout:6/662: mknod d2/d45/d7b/ce5 0 2024-04-16T14:35:35.457 INFO:tasks.workunit.client.0.smithi005.stdout:7/593: creat d1/d49/d74/d77/d22/da9/fca x:0 0 0 2024-04-16T14:35:35.461 INFO:tasks.workunit.client.1.smithi115.stdout:6/288: dwrite f0 [0,4194304] 0 2024-04-16T14:35:35.461 INFO:tasks.workunit.client.0.smithi005.stdout:7/594: mkdir d1/d49/d74/d77/d22/da0/dbb/dcb 0 2024-04-16T14:35:35.462 INFO:tasks.workunit.client.1.smithi115.stdout:6/289: truncate f8 89389 0 2024-04-16T14:35:35.472 INFO:tasks.workunit.client.0.smithi005.stdout:7/595: creat d1/d49/d74/fcc x:0 0 0 2024-04-16T14:35:35.473 INFO:tasks.workunit.client.0.smithi005.stdout:7/596: truncate d1/f29 1544382 0 2024-04-16T14:35:35.474 INFO:tasks.workunit.client.0.smithi005.stdout:7/597: truncate d1/d49/d74/d77/d57/d47/f84 14308 0 2024-04-16T14:35:35.475 INFO:tasks.workunit.client.0.smithi005.stdout:7/598: read - d1/dc/d2f/d4f/f92 zero size 2024-04-16T14:35:35.475 INFO:tasks.workunit.client.0.smithi005.stdout:7/599: truncate d1/d49/f5f 4528115 0 2024-04-16T14:35:35.480 INFO:tasks.workunit.client.0.smithi005.stdout:7/600: dread d1/d49/f5b [0,4194304] 0 2024-04-16T14:35:35.481 INFO:tasks.workunit.client.0.smithi005.stdout:7/601: mknod d1/d85/d96/ccd 0 2024-04-16T14:35:35.481 INFO:tasks.workunit.client.0.smithi005.stdout:7/602: chown d1/d49/d74/d77/d22/da0/fa7 1713985851 1 2024-04-16T14:35:35.482 INFO:tasks.workunit.client.0.smithi005.stdout:7/603: truncate d1/d49/d74/d77/d22/d27/f64 105566 0 2024-04-16T14:35:35.483 INFO:tasks.workunit.client.0.smithi005.stdout:7/604: link d1/d49/d74/d77/d22/c58 d1/d49/d74/d77/d57/d47/d8e/cce 0 2024-04-16T14:35:35.484 INFO:tasks.workunit.client.0.smithi005.stdout:7/605: creat d1/d82/fcf x:0 0 0 2024-04-16T14:35:35.488 INFO:tasks.workunit.client.1.smithi115.stdout:6/290: dread d13/d1a/d25/d30/d43/f2d [0,4194304] 0 2024-04-16T14:35:35.489 INFO:tasks.workunit.client.1.smithi115.stdout:6/291: creat d13/f5e x:0 0 0 2024-04-16T14:35:35.491 INFO:tasks.workunit.client.1.smithi115.stdout:5/231: dwrite dc/f11 [0,4194304] 0 2024-04-16T14:35:35.491 INFO:tasks.workunit.client.1.smithi115.stdout:5/232: chown dc/f13 4060485 1 2024-04-16T14:35:35.491 INFO:tasks.workunit.client.1.smithi115.stdout:5/233: symlink dc/d15/d4d/l4f 0 2024-04-16T14:35:35.494 INFO:tasks.workunit.client.1.smithi115.stdout:4/289: dwrite d1/d15/d17/f26 [4194304,4194304] 0 2024-04-16T14:35:35.495 INFO:tasks.workunit.client.0.smithi005.stdout:7/606: dwrite d1/d49/fb5 [0,4194304] 0 2024-04-16T14:35:35.497 INFO:tasks.workunit.client.0.smithi005.stdout:9/314: dwrite d3/d12/d16/f39 [0,4194304] 0 2024-04-16T14:35:35.497 INFO:tasks.workunit.client.0.smithi005.stdout:4/717: dwrite d0/d1b/d1d/d1f/d48/f8a [0,4194304] 0 2024-04-16T14:35:35.497 INFO:tasks.workunit.client.1.smithi115.stdout:7/238: dwrite d0/d1/f34 [0,4194304] 0 2024-04-16T14:35:35.500 INFO:tasks.workunit.client.0.smithi005.stdout:7/607: unlink d1/d49/d74/d77/l32 0 2024-04-16T14:35:35.500 INFO:tasks.workunit.client.0.smithi005.stdout:7/608: write d1/d49/d74/d77/d22/d27/f46 [5327186,2763] 0 2024-04-16T14:35:35.506 INFO:tasks.workunit.client.0.smithi005.stdout:6/663: rmdir d2 39 2024-04-16T14:35:35.506 INFO:tasks.workunit.client.0.smithi005.stdout:6/664: truncate d2/d3f/d53/d54/f5e 605127 0 2024-04-16T14:35:35.507 INFO:tasks.workunit.client.1.smithi115.stdout:7/239: read d0/d2/d3a/f33 [2170157,32147] 0 2024-04-16T14:35:35.507 INFO:tasks.workunit.client.0.smithi005.stdout:9/315: rename d3/f8 to d3/d12/d16/d46/d47/f53 0 2024-04-16T14:35:35.509 INFO:tasks.workunit.client.0.smithi005.stdout:4/718: getdents d0/d22 0 2024-04-16T14:35:35.509 INFO:tasks.workunit.client.1.smithi115.stdout:7/240: truncate d0/d1/d3b/f50 1128591 0 2024-04-16T14:35:35.510 INFO:tasks.workunit.client.1.smithi115.stdout:7/241: symlink d0/d2/d3a/l52 0 2024-04-16T14:35:35.512 INFO:tasks.workunit.client.0.smithi005.stdout:7/609: unlink d1/d49/fb5 0 2024-04-16T14:35:35.512 INFO:tasks.workunit.client.0.smithi005.stdout:7/610: chown d1/f55 11417753 1 2024-04-16T14:35:35.512 INFO:tasks.workunit.client.1.smithi115.stdout:7/242: rename d0/d24/l2e to d0/d1/d3b/d3e/l53 0 2024-04-16T14:35:35.513 INFO:tasks.workunit.client.0.smithi005.stdout:6/665: mknod d2/d3f/d53/dba/ce6 0 2024-04-16T14:35:35.514 INFO:tasks.workunit.client.1.smithi115.stdout:6/292: dwrite d13/d1d/f36 [0,4194304] 0 2024-04-16T14:35:35.515 INFO:tasks.workunit.client.1.smithi115.stdout:6/293: stat d13/d1a/d25/d30/d43/d2c/c4d 0 2024-04-16T14:35:35.515 INFO:tasks.workunit.client.1.smithi115.stdout:6/294: truncate d13/d1d/f5c 1320653 0 2024-04-16T14:35:35.515 INFO:tasks.workunit.client.1.smithi115.stdout:5/234: dwrite dc/f3b [0,4194304] 0 2024-04-16T14:35:35.516 INFO:tasks.workunit.client.0.smithi005.stdout:9/316: mknod d3/c54 0 2024-04-16T14:35:35.517 INFO:tasks.workunit.client.0.smithi005.stdout:9/317: fdatasync d3/d12/d16/f1b 0 2024-04-16T14:35:35.518 INFO:tasks.workunit.client.0.smithi005.stdout:4/719: mkdir d0/d1b/d1d/d1f/d5d/da7/d90/de4 0 2024-04-16T14:35:35.523 INFO:tasks.workunit.client.0.smithi005.stdout:7/611: symlink d1/ld0 0 2024-04-16T14:35:35.523 INFO:tasks.workunit.client.1.smithi115.stdout:0/196: sync 2024-04-16T14:35:35.523 INFO:tasks.workunit.client.1.smithi115.stdout:0/197: truncate d6/d10/f40 423605 0 2024-04-16T14:35:35.523 INFO:tasks.workunit.client.1.smithi115.stdout:0/198: write d6/d10/f20 [5215938,111446] 0 2024-04-16T14:35:35.524 INFO:tasks.workunit.client.1.smithi115.stdout:9/333: sync 2024-04-16T14:35:35.524 INFO:tasks.workunit.client.1.smithi115.stdout:3/317: sync 2024-04-16T14:35:35.524 INFO:tasks.workunit.client.1.smithi115.stdout:2/276: sync 2024-04-16T14:35:35.524 INFO:tasks.workunit.client.1.smithi115.stdout:8/260: sync 2024-04-16T14:35:35.524 INFO:tasks.workunit.client.1.smithi115.stdout:1/219: sync 2024-04-16T14:35:35.525 INFO:tasks.workunit.client.1.smithi115.stdout:1/220: chown df/d13/d40 21 1 2024-04-16T14:35:35.526 INFO:tasks.workunit.client.1.smithi115.stdout:0/199: creat d6/d10/d12/d31/d35/d28/f49 x:0 0 0 2024-04-16T14:35:35.529 INFO:tasks.workunit.client.1.smithi115.stdout:9/334: creat d1/d6/f67 x:0 0 0 2024-04-16T14:35:35.530 INFO:tasks.workunit.client.0.smithi005.stdout:9/318: getdents d3/d12/d2b 0 2024-04-16T14:35:35.531 INFO:tasks.workunit.client.1.smithi115.stdout:2/277: symlink d0/d4/de/d11/d36/l5f 0 2024-04-16T14:35:35.532 INFO:tasks.workunit.client.1.smithi115.stdout:8/261: symlink d0/db/d10/d17/d22/l4e 0 2024-04-16T14:35:35.533 INFO:tasks.workunit.client.1.smithi115.stdout:1/221: truncate df/f25 1116004 0 2024-04-16T14:35:35.534 INFO:tasks.workunit.client.0.smithi005.stdout:9/319: mkdir d3/d49/d4b/d55 0 2024-04-16T14:35:35.535 INFO:tasks.workunit.client.1.smithi115.stdout:0/200: mkdir d6/d10/d12/d1f/d36/d4a 0 2024-04-16T14:35:35.537 INFO:tasks.workunit.client.1.smithi115.stdout:9/335: symlink d1/d6/l68 0 2024-04-16T14:35:35.539 INFO:tasks.workunit.client.0.smithi005.stdout:9/320: link d3/d12/d16/c31 d3/d49/d4b/d55/c56 0 2024-04-16T14:35:35.540 INFO:tasks.workunit.client.1.smithi115.stdout:2/278: rename d0/d4/de/d11/l33 to d0/d4/de/l60 0 2024-04-16T14:35:35.547 INFO:tasks.workunit.client.0.smithi005.stdout:9/321: creat d3/d49/d4b/d55/f57 x:0 0 0 2024-04-16T14:35:35.547 INFO:tasks.workunit.client.0.smithi005.stdout:9/322: write d3/f41 [577527,64377] 0 2024-04-16T14:35:35.548 INFO:tasks.workunit.client.1.smithi115.stdout:8/262: symlink d0/db/d44/l4f 0 2024-04-16T14:35:35.549 INFO:tasks.workunit.client.1.smithi115.stdout:1/222: write df/f14 [460682,94486] 0 2024-04-16T14:35:35.549 INFO:tasks.workunit.client.1.smithi115.stdout:2/279: dread d0/fd [0,4194304] 0 2024-04-16T14:35:35.549 INFO:tasks.workunit.client.1.smithi115.stdout:8/263: symlink d0/db/d10/d17/d2c/l50 0 2024-04-16T14:35:35.549 INFO:tasks.workunit.client.1.smithi115.stdout:8/264: chown d0/db/f12 8 1 2024-04-16T14:35:35.549 INFO:tasks.workunit.client.1.smithi115.stdout:6/295: dwrite d13/d1a/d25/f32 [0,4194304] 0 2024-04-16T14:35:35.553 INFO:tasks.workunit.client.1.smithi115.stdout:8/265: truncate d0/db/f1b 2976608 0 2024-04-16T14:35:35.554 INFO:tasks.workunit.client.1.smithi115.stdout:8/266: readlink d0/db/d10/l38 0 2024-04-16T14:35:35.554 INFO:tasks.workunit.client.0.smithi005.stdout:4/720: dwrite d0/d1b/d1d/d4f/f86 [0,4194304] 0 2024-04-16T14:35:35.554 INFO:tasks.workunit.client.0.smithi005.stdout:4/721: chown d0/f12 456 1 2024-04-16T14:35:35.554 INFO:tasks.workunit.client.0.smithi005.stdout:4/722: write d0/d1b/da5/fac [4758105,84160] 0 2024-04-16T14:35:35.554 INFO:tasks.workunit.client.0.smithi005.stdout:4/723: write d0/d1b/d1d/d1f/d3e/daa/fc9 [749817,42401] 0 2024-04-16T14:35:35.556 INFO:tasks.workunit.client.0.smithi005.stdout:4/724: creat d0/d1b/d1d/dc3/fe5 x:0 0 0 2024-04-16T14:35:35.557 INFO:tasks.workunit.client.0.smithi005.stdout:4/725: symlink d0/d1b/d1d/d1f/d48/dab/le6 0 2024-04-16T14:35:35.557 INFO:tasks.workunit.client.0.smithi005.stdout:4/726: stat d0/d1b/d1d/d1f/d3e/fcc 0 2024-04-16T14:35:35.558 INFO:tasks.workunit.client.0.smithi005.stdout:4/727: creat d0/d22/d61/fe7 x:0 0 0 2024-04-16T14:35:35.558 INFO:tasks.workunit.client.0.smithi005.stdout:4/728: creat d0/d1b/d1d/d1f/d3e/daa/fe8 x:0 0 0 2024-04-16T14:35:35.558 INFO:tasks.workunit.client.1.smithi115.stdout:2/280: dread d0/d4/d24/d21/d3b/f3f [0,4194304] 0 2024-04-16T14:35:35.560 INFO:tasks.workunit.client.0.smithi005.stdout:4/729: creat d0/d1b/d1d/dde/fe9 x:0 0 0 2024-04-16T14:35:35.562 INFO:tasks.workunit.client.0.smithi005.stdout:4/730: truncate d0/f5 211411 0 2024-04-16T14:35:35.566 INFO:tasks.workunit.client.0.smithi005.stdout:7/612: dwrite d1/d49/d74/d77/d22/f59 [0,4194304] 0 2024-04-16T14:35:35.568 INFO:tasks.workunit.client.0.smithi005.stdout:7/613: creat d1/d49/d74/d77/d22/d27/d3a/d5c/d9e/fd1 x:0 0 0 2024-04-16T14:35:35.568 INFO:tasks.workunit.client.0.smithi005.stdout:7/614: dread - d1/d82/f76 zero size 2024-04-16T14:35:35.570 INFO:tasks.workunit.client.0.smithi005.stdout:7/615: unlink d1/dc/d2f/fa5 0 2024-04-16T14:35:35.570 INFO:tasks.workunit.client.1.smithi115.stdout:2/281: write d0/d1b/f38 [368403,26794] 0 2024-04-16T14:35:35.571 INFO:tasks.workunit.client.1.smithi115.stdout:7/243: dwrite d0/d2/d3a/d30/f32 [0,4194304] 0 2024-04-16T14:35:35.572 INFO:tasks.workunit.client.1.smithi115.stdout:7/244: truncate d0/f36 4968951 0 2024-04-16T14:35:35.572 INFO:tasks.workunit.client.1.smithi115.stdout:7/245: chown d0/d2/d3a/d30 4347 1 2024-04-16T14:35:35.572 INFO:tasks.workunit.client.1.smithi115.stdout:7/246: fdatasync d0/d1/f34 0 2024-04-16T14:35:35.573 INFO:tasks.workunit.client.0.smithi005.stdout:4/731: dread d0/f4c [0,4194304] 0 2024-04-16T14:35:35.573 INFO:tasks.workunit.client.1.smithi115.stdout:7/247: truncate d0/d1/f34 884133 0 2024-04-16T14:35:35.573 INFO:tasks.workunit.client.1.smithi115.stdout:7/248: fdatasync d0/d2/d3a/f33 0 2024-04-16T14:35:35.574 INFO:tasks.workunit.client.1.smithi115.stdout:2/282: rmdir d0/d2a 0 2024-04-16T14:35:35.574 INFO:tasks.workunit.client.1.smithi115.stdout:7/249: creat d0/d1/d3b/d3e/f54 x:0 0 0 2024-04-16T14:35:35.575 INFO:tasks.workunit.client.0.smithi005.stdout:4/732: dread d0/d1b/d1d/d4f/d75/f82 [0,4194304] 0 2024-04-16T14:35:35.576 INFO:tasks.workunit.client.1.smithi115.stdout:2/283: rmdir d0/d5d 0 2024-04-16T14:35:35.576 INFO:tasks.workunit.client.0.smithi005.stdout:4/733: unlink d0/c8d 0 2024-04-16T14:35:35.577 INFO:tasks.workunit.client.1.smithi115.stdout:7/250: symlink d0/d2/d3a/d30/l55 0 2024-04-16T14:35:35.577 INFO:tasks.workunit.client.1.smithi115.stdout:7/251: read - d0/d1/d3b/f4c zero size 2024-04-16T14:35:35.577 INFO:tasks.workunit.client.1.smithi115.stdout:7/252: creat d0/d1/d3b/d3e/f56 x:0 0 0 2024-04-16T14:35:35.577 INFO:tasks.workunit.client.1.smithi115.stdout:2/284: rename d0/d4/de/d53 to d0/d4/d24/d23/d52/d5a/d61 0 2024-04-16T14:35:35.578 INFO:tasks.workunit.client.1.smithi115.stdout:7/253: mknod d0/d2/c57 0 2024-04-16T14:35:35.580 INFO:tasks.workunit.client.1.smithi115.stdout:2/285: rmdir d0/d4/d22 39 2024-04-16T14:35:35.580 INFO:tasks.workunit.client.1.smithi115.stdout:2/286: chown d0/d4/d24/d21 68 1 2024-04-16T14:35:35.580 INFO:tasks.workunit.client.1.smithi115.stdout:2/287: truncate d0/d1b/f38 9219597 0 2024-04-16T14:35:35.580 INFO:tasks.workunit.client.1.smithi115.stdout:2/288: fdatasync d0/d4/de/d11/f12 0 2024-04-16T14:35:35.582 INFO:tasks.workunit.client.1.smithi115.stdout:7/254: rename d0/d1/l1b to d0/d1/l58 0 2024-04-16T14:35:35.582 INFO:tasks.workunit.client.1.smithi115.stdout:7/255: write d0/d24/d40/f44 [953923,44035] 0 2024-04-16T14:35:35.584 INFO:tasks.workunit.client.1.smithi115.stdout:2/289: creat d0/d4/de/d11/f62 x:0 0 0 2024-04-16T14:35:35.584 INFO:tasks.workunit.client.1.smithi115.stdout:2/290: fdatasync d0/d4/d24/f13 0 2024-04-16T14:35:35.586 INFO:tasks.workunit.client.0.smithi005.stdout:7/616: dread d1/d49/d74/d77/f11 [0,4194304] 0 2024-04-16T14:35:35.586 INFO:tasks.workunit.client.0.smithi005.stdout:7/617: creat d1/d82/fd2 x:0 0 0 2024-04-16T14:35:35.586 INFO:tasks.workunit.client.0.smithi005.stdout:7/618: write d1/d49/f6b [1924584,116327] 0 2024-04-16T14:35:35.586 INFO:tasks.workunit.client.0.smithi005.stdout:7/619: chown d1/d85/d96/ccd 30600069 1 2024-04-16T14:35:35.589 INFO:tasks.workunit.client.1.smithi115.stdout:4/290: dwrite d1/d15/d31/f45 [0,4194304] 0 2024-04-16T14:35:35.589 INFO:tasks.workunit.client.1.smithi115.stdout:3/318: dwrite dc/d24/d33/f6a [0,4194304] 0 2024-04-16T14:35:35.589 INFO:tasks.workunit.client.0.smithi005.stdout:7/620: rename d1/d49/f5b to d1/dc/d2f/dbd/fd3 0 2024-04-16T14:35:35.590 INFO:tasks.workunit.client.1.smithi115.stdout:1/223: fdatasync df/d2d/d2a/d2c/f21 0 2024-04-16T14:35:35.591 INFO:tasks.workunit.client.1.smithi115.stdout:6/296: dwrite f12 [0,4194304] 0 2024-04-16T14:35:35.593 INFO:tasks.workunit.client.1.smithi115.stdout:8/267: dwrite d0/db/d10/d25/d2d/d3b/f3c [0,4194304] 0 2024-04-16T14:35:35.593 INFO:tasks.workunit.client.1.smithi115.stdout:8/268: write d0/f1a [4623131,77901] 0 2024-04-16T14:35:35.593 INFO:tasks.workunit.client.1.smithi115.stdout:8/269: truncate d0/db/d10/d17/f18 1083018 0 2024-04-16T14:35:35.593 INFO:tasks.workunit.client.1.smithi115.stdout:8/270: write d0/db/d10/f42 [594874,111602] 0 2024-04-16T14:35:35.594 INFO:tasks.workunit.client.1.smithi115.stdout:0/201: dwrite d6/d38/f3d [0,4194304] 0 2024-04-16T14:35:35.594 INFO:tasks.workunit.client.1.smithi115.stdout:0/202: getdents d6/d10/d12/d1f/d36/d4a 0 2024-04-16T14:35:35.594 INFO:tasks.workunit.client.0.smithi005.stdout:4/734: dwrite d0/d1b/d1d/d1f/d5d/f93 [0,4194304] 0 2024-04-16T14:35:35.596 INFO:tasks.workunit.client.1.smithi115.stdout:7/256: read d0/f36 [1455224,47578] 0 2024-04-16T14:35:35.596 INFO:tasks.workunit.client.1.smithi115.stdout:7/257: chown d0/d2/c41 3 1 2024-04-16T14:35:35.597 INFO:tasks.workunit.client.0.smithi005.stdout:9/323: dwrite d3/d12/f30 [0,4194304] 0 2024-04-16T14:35:35.598 INFO:tasks.workunit.client.1.smithi115.stdout:3/319: dread f4 [0,4194304] 0 2024-04-16T14:35:35.603 INFO:tasks.workunit.client.0.smithi005.stdout:4/735: creat d0/d1b/d1d/d1f/d5d/da9/fea x:0 0 0 2024-04-16T14:35:35.605 INFO:tasks.workunit.client.0.smithi005.stdout:7/621: write d1/d49/d74/d77/d22/d27/d3a/d5c/f62 [4175953,42193] 0 2024-04-16T14:35:35.606 INFO:tasks.workunit.client.1.smithi115.stdout:0/203: write f1 [2393884,29180] 0 2024-04-16T14:35:35.607 INFO:tasks.workunit.client.0.smithi005.stdout:9/324: symlink d3/d12/d2b/l58 0 2024-04-16T14:35:35.609 INFO:tasks.workunit.client.0.smithi005.stdout:4/736: link d0/d1b/d1d/d1f/d5d/fa8 d0/d1b/d1d/d1f/d3e/feb 0 2024-04-16T14:35:35.611 INFO:tasks.workunit.client.0.smithi005.stdout:7/622: rmdir d1/d49/d74/d77/d22/da0/dbb 39 2024-04-16T14:35:35.612 INFO:tasks.workunit.client.0.smithi005.stdout:7/623: symlink d1/d49/d74/d77/d22/d27/d2e/ld4 0 2024-04-16T14:35:35.613 INFO:tasks.workunit.client.1.smithi115.stdout:8/271: symlink d0/db/d10/d17/d2c/l51 0 2024-04-16T14:35:35.613 INFO:tasks.workunit.client.1.smithi115.stdout:3/320: stat c5 0 2024-04-16T14:35:35.613 INFO:tasks.workunit.client.1.smithi115.stdout:3/321: fsync dc/d24/d33/f68 0 2024-04-16T14:35:35.614 INFO:tasks.workunit.client.1.smithi115.stdout:0/204: mkdir d6/d10/d12/d1f/d36/d4b 0 2024-04-16T14:35:35.614 INFO:tasks.workunit.client.1.smithi115.stdout:7/258: write d0/d2/d3a/d30/f32 [271781,10660] 0 2024-04-16T14:35:35.614 INFO:tasks.workunit.client.1.smithi115.stdout:2/291: dwrite d0/d4/d24/d10/f39 [0,4194304] 0 2024-04-16T14:35:35.617 INFO:tasks.workunit.client.1.smithi115.stdout:8/272: mkdir d0/db/d10/d17/d2c/d52 0 2024-04-16T14:35:35.618 INFO:tasks.workunit.client.1.smithi115.stdout:1/224: dwrite df/f27 [4194304,4194304] 0 2024-04-16T14:35:35.618 INFO:tasks.workunit.client.1.smithi115.stdout:1/225: read - df/d2d/f1e zero size 2024-04-16T14:35:35.619 INFO:tasks.workunit.client.1.smithi115.stdout:0/205: creat d6/d10/d12/d1f/d36/d4a/f4c x:0 0 0 2024-04-16T14:35:35.622 INFO:tasks.workunit.client.0.smithi005.stdout:9/325: write d3/f25 [897363,43885] 0 2024-04-16T14:35:35.622 INFO:tasks.workunit.client.0.smithi005.stdout:9/326: truncate d3/f3c 5350185 0 2024-04-16T14:35:35.622 INFO:tasks.workunit.client.0.smithi005.stdout:9/327: chown d3/d12/d16/l27 99 1 2024-04-16T14:35:35.623 INFO:tasks.workunit.client.0.smithi005.stdout:9/328: creat d3/d12/d2b/f59 x:0 0 0 2024-04-16T14:35:35.623 INFO:tasks.workunit.client.1.smithi115.stdout:3/322: dread f4 [0,4194304] 0 2024-04-16T14:35:35.623 INFO:tasks.workunit.client.1.smithi115.stdout:2/292: creat d0/d4/de/d11/d36/f63 x:0 0 0 2024-04-16T14:35:35.623 INFO:tasks.workunit.client.1.smithi115.stdout:2/293: write d0/d4/de/d11/f12 [4520835,22274] 0 2024-04-16T14:35:35.624 INFO:tasks.workunit.client.1.smithi115.stdout:2/294: dread - d0/d1b/f4b zero size 2024-04-16T14:35:35.624 INFO:tasks.workunit.client.0.smithi005.stdout:9/329: creat d3/d12/d16/d46/d47/f5a x:0 0 0 2024-04-16T14:35:35.625 INFO:tasks.workunit.client.1.smithi115.stdout:2/295: dread d0/fd [0,4194304] 0 2024-04-16T14:35:35.625 INFO:tasks.workunit.client.1.smithi115.stdout:6/297: rename d13/d1a/d25 to d13/d1d/d2b/d5f 0 2024-04-16T14:35:35.625 INFO:tasks.workunit.client.1.smithi115.stdout:6/298: readlink d13/l14 0 2024-04-16T14:35:35.626 INFO:tasks.workunit.client.0.smithi005.stdout:9/330: link d3/d12/d16/c33 d3/d12/c5b 0 2024-04-16T14:35:35.628 INFO:tasks.workunit.client.0.smithi005.stdout:9/331: unlink d3/d12/f2a 0 2024-04-16T14:35:35.628 INFO:tasks.workunit.client.0.smithi005.stdout:9/332: chown d3/d12/d16/l40 396 1 2024-04-16T14:35:35.629 INFO:tasks.workunit.client.1.smithi115.stdout:1/226: mkdir df/d35/d48 0 2024-04-16T14:35:35.630 INFO:tasks.workunit.client.0.smithi005.stdout:9/333: mkdir d3/d49/d4b/d5c 0 2024-04-16T14:35:35.630 INFO:tasks.workunit.client.0.smithi005.stdout:9/334: dread - d3/d49/d4b/d55/f57 zero size 2024-04-16T14:35:35.631 INFO:tasks.workunit.client.0.smithi005.stdout:9/335: getdents d3/d49/d4b/d55 0 2024-04-16T14:35:35.632 INFO:tasks.workunit.client.1.smithi115.stdout:7/259: rename d0/d1/d3b/d49/d51 to d0/d2/d3a/d59 0 2024-04-16T14:35:35.637 INFO:tasks.workunit.client.1.smithi115.stdout:7/260: dread d0/d2/f35 [0,4194304] 0 2024-04-16T14:35:35.638 INFO:tasks.workunit.client.1.smithi115.stdout:1/227: creat df/f49 x:0 0 0 2024-04-16T14:35:35.639 INFO:tasks.workunit.client.1.smithi115.stdout:3/323: rmdir dc/d24/d36 39 2024-04-16T14:35:35.639 INFO:tasks.workunit.client.1.smithi115.stdout:3/324: chown dc/d29/d4d/d56/f5c 112222 1 2024-04-16T14:35:35.639 INFO:tasks.workunit.client.1.smithi115.stdout:3/325: stat dc/d24/d33/c43 0 2024-04-16T14:35:35.639 INFO:tasks.workunit.client.1.smithi115.stdout:1/228: read df/f25 [700525,89985] 0 2024-04-16T14:35:35.640 INFO:tasks.workunit.client.1.smithi115.stdout:1/229: stat df/d36/l43 0 2024-04-16T14:35:35.640 INFO:tasks.workunit.client.1.smithi115.stdout:1/230: creat df/d2d/d2a/d2c/f4a x:0 0 0 2024-04-16T14:35:35.640 INFO:tasks.workunit.client.1.smithi115.stdout:1/231: write df/d36/f3d [412814,22521] 0 2024-04-16T14:35:35.640 INFO:tasks.workunit.client.1.smithi115.stdout:1/232: read df/d36/f3d [73055,117739] 0 2024-04-16T14:35:35.644 INFO:tasks.workunit.client.1.smithi115.stdout:1/233: mknod df/d35/d48/c4b 0 2024-04-16T14:35:35.647 INFO:tasks.workunit.client.1.smithi115.stdout:1/234: creat df/d35/d48/f4c x:0 0 0 2024-04-16T14:35:35.649 INFO:tasks.workunit.client.1.smithi115.stdout:1/235: unlink df/f1c 0 2024-04-16T14:35:35.660 INFO:tasks.workunit.client.1.smithi115.stdout:4/291: dwrite d1/d15/d1e/f29 [4194304,4194304] 0 2024-04-16T14:35:35.661 INFO:tasks.workunit.client.1.smithi115.stdout:7/261: dwrite d0/f36 [0,4194304] 0 2024-04-16T14:35:35.662 INFO:tasks.workunit.client.1.smithi115.stdout:4/292: truncate d1/d15/f3f 7536924 0 2024-04-16T14:35:35.664 INFO:tasks.workunit.client.1.smithi115.stdout:7/262: mkdir d0/d1/d3b/d5a 0 2024-04-16T14:35:35.667 INFO:tasks.workunit.client.0.smithi005.stdout:7/624: dwrite d1/d49/f5f [0,4194304] 0 2024-04-16T14:35:35.667 INFO:tasks.workunit.client.1.smithi115.stdout:6/299: dwrite d13/f2a [4194304,4194304] 0 2024-04-16T14:35:35.668 INFO:tasks.workunit.client.0.smithi005.stdout:9/336: dwrite d3/f41 [0,4194304] 0 2024-04-16T14:35:35.668 INFO:tasks.workunit.client.0.smithi005.stdout:4/737: dwrite d0/d1b/d1d/d1f/d5d/fa8 [0,4194304] 0 2024-04-16T14:35:35.669 INFO:tasks.workunit.client.0.smithi005.stdout:4/738: stat d0/d1b/d1d/d1f/d5d/da7/c91 0 2024-04-16T14:35:35.669 INFO:tasks.workunit.client.0.smithi005.stdout:4/739: write d0/d22/d29/fdf [491090,80540] 0 2024-04-16T14:35:35.669 INFO:tasks.workunit.client.0.smithi005.stdout:4/740: creat d0/d1b/d1d/d1f/d3e/daa/fec x:0 0 0 2024-04-16T14:35:35.672 INFO:tasks.workunit.client.1.smithi115.stdout:8/273: rmdir d0/db/d10 39 2024-04-16T14:35:35.672 INFO:tasks.workunit.client.1.smithi115.stdout:8/274: chown d0/db/d10/d17/d2c/l47 33 1 2024-04-16T14:35:35.674 INFO:tasks.workunit.client.1.smithi115.stdout:6/300: rmdir d13/d1a/d55 39 2024-04-16T14:35:35.676 INFO:tasks.workunit.client.0.smithi005.stdout:0/523: sync 2024-04-16T14:35:35.677 INFO:tasks.workunit.client.0.smithi005.stdout:0/524: readlink da/df/d26/d39/d55/l5d 0 2024-04-16T14:35:35.677 INFO:tasks.workunit.client.1.smithi115.stdout:6/301: mkdir d13/d1d/d49/d60 0 2024-04-16T14:35:35.678 INFO:tasks.workunit.client.0.smithi005.stdout:4/741: dread d0/d1b/d1d/f53 [0,4194304] 0 2024-04-16T14:35:35.678 INFO:tasks.workunit.client.0.smithi005.stdout:4/742: stat d0/d1b/da5/fac 0 2024-04-16T14:35:35.678 INFO:tasks.workunit.client.0.smithi005.stdout:4/743: readlink d0/d1b/d1d/d1f/d5d/da9/lad 0 2024-04-16T14:35:35.678 INFO:tasks.workunit.client.0.smithi005.stdout:4/744: write d0/d1b/d1d/d1f/f7d [1081815,69499] 0 2024-04-16T14:35:35.678 INFO:tasks.workunit.client.0.smithi005.stdout:0/525: rename da/df/d50/l85 to da/df/d1b/d24/d75/lb3 0 2024-04-16T14:35:35.679 INFO:tasks.workunit.client.0.smithi005.stdout:4/745: mkdir d0/d22/d61/ded 0 2024-04-16T14:35:35.679 INFO:tasks.workunit.client.0.smithi005.stdout:4/746: fdatasync d0/f10 0 2024-04-16T14:35:35.679 INFO:tasks.workunit.client.0.smithi005.stdout:4/747: fsync d0/d1b/d1d/d1f/d48/dab/db2/fd1 0 2024-04-16T14:35:35.679 INFO:tasks.workunit.client.0.smithi005.stdout:4/748: chown d0/d1b/d1d/dc3/fe5 7 1 2024-04-16T14:35:35.680 INFO:tasks.workunit.client.0.smithi005.stdout:4/749: chown d0/d4d 6 1 2024-04-16T14:35:35.680 INFO:tasks.workunit.client.0.smithi005.stdout:0/526: mknod da/df/d1b/d71/cb4 0 2024-04-16T14:35:35.681 INFO:tasks.workunit.client.1.smithi115.stdout:6/302: unlink d13/d1d/f36 0 2024-04-16T14:35:35.682 INFO:tasks.workunit.client.1.smithi115.stdout:6/303: read d13/d1d/d2b/d46/d5a/f3b [112351,44647] 0 2024-04-16T14:35:35.682 INFO:tasks.workunit.client.0.smithi005.stdout:9/337: read d3/d12/d16/f39 [191488,82448] 0 2024-04-16T14:35:35.682 INFO:tasks.workunit.client.0.smithi005.stdout:0/527: truncate da/df/d1b/d3a/d53/f8f 934008 0 2024-04-16T14:35:35.682 INFO:tasks.workunit.client.0.smithi005.stdout:0/528: truncate da/df/d1b/d3a/d53/d5a/d67/f8d 1181810 0 2024-04-16T14:35:35.682 INFO:tasks.workunit.client.0.smithi005.stdout:0/529: chown da/df/d1b/d3a/d96/dab 223357763 1 2024-04-16T14:35:35.683 INFO:tasks.workunit.client.0.smithi005.stdout:0/530: readlink da/df/d1b/d24/l40 0 2024-04-16T14:35:35.683 INFO:tasks.workunit.client.0.smithi005.stdout:0/531: symlink da/df/d26/d39/d55/lb5 0 2024-04-16T14:35:35.683 INFO:tasks.workunit.client.1.smithi115.stdout:0/206: rename d6/d10/d12/d1f/d36/d4a to d6/d30/d4d 0 2024-04-16T14:35:35.683 INFO:tasks.workunit.client.1.smithi115.stdout:0/207: truncate d6/d30/d4d/f4c 55078 0 2024-04-16T14:35:35.683 INFO:tasks.workunit.client.1.smithi115.stdout:2/296: rename d0 to d0/d4/d24/d10/d64 22 2024-04-16T14:35:35.683 INFO:tasks.workunit.client.1.smithi115.stdout:2/297: chown d0/d4/d24/d21/d3b/f3f 1 1 2024-04-16T14:35:35.684 INFO:tasks.workunit.client.0.smithi005.stdout:0/532: getdents da/d7c 0 2024-04-16T14:35:35.692 INFO:tasks.workunit.client.0.smithi005.stdout:9/338: dread d3/d12/d2b/f44 [0,4194304] 0 2024-04-16T14:35:35.692 INFO:tasks.workunit.client.0.smithi005.stdout:4/750: read d0/d1b/d1d/d1f/d5d/da9/f2f [1494536,18019] 0 2024-04-16T14:35:35.692 INFO:tasks.workunit.client.0.smithi005.stdout:4/751: write d0/d1b/f62 [1026693,3569] 0 2024-04-16T14:35:35.693 INFO:tasks.workunit.client.1.smithi115.stdout:1/236: rename df/d2d/d2a to df/d13/d4d 0 2024-04-16T14:35:35.693 INFO:tasks.workunit.client.1.smithi115.stdout:4/293: dwrite d1/d15/d17/f26 [0,4194304] 0 2024-04-16T14:35:35.695 INFO:tasks.workunit.client.1.smithi115.stdout:8/275: truncate d0/db/d10/d17/d2c/f43 3294389 0 2024-04-16T14:35:35.695 INFO:tasks.workunit.client.1.smithi115.stdout:8/276: write d0/f1f [2853239,23568] 0 2024-04-16T14:35:35.695 INFO:tasks.workunit.client.1.smithi115.stdout:8/277: stat d0/db/d10/l2e 0 2024-04-16T14:35:35.696 INFO:tasks.workunit.client.0.smithi005.stdout:4/752: dread d0/f4c [0,4194304] 0 2024-04-16T14:35:35.696 INFO:tasks.workunit.client.0.smithi005.stdout:9/339: read d3/d12/f3e [649563,35959] 0 2024-04-16T14:35:35.697 INFO:tasks.workunit.client.0.smithi005.stdout:4/753: mknod d0/d4d/cee 0 2024-04-16T14:35:35.697 INFO:tasks.workunit.client.0.smithi005.stdout:4/754: write d0/d1b/d1d/d1f/d5d/da9/fea [59423,65947] 0 2024-04-16T14:35:35.697 INFO:tasks.workunit.client.1.smithi115.stdout:0/208: write d6/f41 [3567188,10311] 0 2024-04-16T14:35:35.698 INFO:tasks.workunit.client.0.smithi005.stdout:9/340: creat d3/d49/d4b/d55/f5d x:0 0 0 2024-04-16T14:35:35.699 INFO:tasks.workunit.client.1.smithi115.stdout:1/237: creat df/d36/f4e x:0 0 0 2024-04-16T14:35:35.701 INFO:tasks.workunit.client.0.smithi005.stdout:4/755: symlink d0/d1b/d1d/d4f/d75/lef 0 2024-04-16T14:35:35.701 INFO:tasks.workunit.client.1.smithi115.stdout:2/298: dread d0/d4/d24/d23/f2c [0,4194304] 0 2024-04-16T14:35:35.701 INFO:tasks.workunit.client.1.smithi115.stdout:2/299: chown d0/d4/de/d11/f1e 6 1 2024-04-16T14:35:35.702 INFO:tasks.workunit.client.1.smithi115.stdout:6/304: dwrite d13/d1d/d2b/d46/d5a/f3c [0,4194304] 0 2024-04-16T14:35:35.702 INFO:tasks.workunit.client.1.smithi115.stdout:6/305: readlink d13/d1d/d2b/d5f/d30/l41 0 2024-04-16T14:35:35.702 INFO:tasks.workunit.client.0.smithi005.stdout:9/341: creat d3/d12/d16/d46/f5e x:0 0 0 2024-04-16T14:35:35.705 INFO:tasks.workunit.client.1.smithi115.stdout:7/263: rename d0/c4 to d0/d1/d3b/d49/c5b 0 2024-04-16T14:35:35.707 INFO:tasks.workunit.client.0.smithi005.stdout:9/342: symlink d3/d49/d4b/d55/l5f 0 2024-04-16T14:35:35.707 INFO:tasks.workunit.client.0.smithi005.stdout:9/343: stat d3/la 0 2024-04-16T14:35:35.708 INFO:tasks.workunit.client.0.smithi005.stdout:4/756: getdents d0/d1b/d1d/d1f/d5d/da7/d90 0 2024-04-16T14:35:35.709 INFO:tasks.workunit.client.0.smithi005.stdout:4/757: chown d0/d1b/d1d/d4f 12 1 2024-04-16T14:35:35.711 INFO:tasks.workunit.client.0.smithi005.stdout:9/344: mkdir d3/d12/d16/d46/d47/d60 0 2024-04-16T14:35:35.711 INFO:tasks.workunit.client.0.smithi005.stdout:9/345: chown d3/d12/d16/f39 85667951 1 2024-04-16T14:35:35.711 INFO:tasks.workunit.client.1.smithi115.stdout:1/238: creat df/d13/d4d/f4f x:0 0 0 2024-04-16T14:35:35.712 INFO:tasks.workunit.client.0.smithi005.stdout:4/758: mknod d0/d22/d61/cf0 0 2024-04-16T14:35:35.712 INFO:tasks.workunit.client.0.smithi005.stdout:4/759: creat d0/d1b/d1d/d1f/d3e/daa/ff1 x:0 0 0 2024-04-16T14:35:35.714 INFO:tasks.workunit.client.0.smithi005.stdout:9/346: mknod d3/d12/d16/d46/d47/c61 0 2024-04-16T14:35:35.715 INFO:tasks.workunit.client.0.smithi005.stdout:4/760: rmdir d0/d1b/db7/ddd 39 2024-04-16T14:35:35.716 INFO:tasks.workunit.client.0.smithi005.stdout:0/533: dwrite da/df/d50/f63 [4194304,4194304] 0 2024-04-16T14:35:35.717 INFO:tasks.workunit.client.0.smithi005.stdout:4/761: mkdir d0/d22/df2 0 2024-04-16T14:35:35.717 INFO:tasks.workunit.client.0.smithi005.stdout:4/762: dread - d0/f5f zero size 2024-04-16T14:35:35.717 INFO:tasks.workunit.client.0.smithi005.stdout:4/763: getdents d0/d1b/d1d/d1f/d5d/da7/d90/de4 0 2024-04-16T14:35:35.717 INFO:tasks.workunit.client.0.smithi005.stdout:0/534: mkdir da/df/d1b/db6 0 2024-04-16T14:35:35.719 INFO:tasks.workunit.client.0.smithi005.stdout:4/764: rename d0/d22/d29/f2d to d0/d1b/d1d/dde/ff3 0 2024-04-16T14:35:35.723 INFO:tasks.workunit.client.0.smithi005.stdout:4/765: dread d0/f4c [0,4194304] 0 2024-04-16T14:35:35.723 INFO:tasks.workunit.client.0.smithi005.stdout:4/766: readlink d0/d1b/d1d/l3d 0 2024-04-16T14:35:35.723 INFO:tasks.workunit.client.0.smithi005.stdout:4/767: fdatasync d0/d1b/d1d/d1f/d3e/fcf 0 2024-04-16T14:35:35.723 INFO:tasks.workunit.client.0.smithi005.stdout:4/768: read - d0/d1b/da5/fca zero size 2024-04-16T14:35:35.724 INFO:tasks.workunit.client.1.smithi115.stdout:6/306: mknod d13/d1d/d2b/d5f/d30/c61 0 2024-04-16T14:35:35.724 INFO:tasks.workunit.client.1.smithi115.stdout:6/307: fdatasync d13/d1d/d2b/d5f/f27 0 2024-04-16T14:35:35.726 INFO:tasks.workunit.client.1.smithi115.stdout:1/239: fsync df/f11 0 2024-04-16T14:35:35.729 INFO:tasks.workunit.client.1.smithi115.stdout:1/240: mknod df/d13/d4d/c50 0 2024-04-16T14:35:35.730 INFO:tasks.workunit.client.0.smithi005.stdout:9/347: write d3/d12/d2b/f4f [225365,108590] 0 2024-04-16T14:35:35.731 INFO:tasks.workunit.client.1.smithi115.stdout:1/241: mknod df/d13/d3a/c51 0 2024-04-16T14:35:35.731 INFO:tasks.workunit.client.1.smithi115.stdout:1/242: truncate df/d13/d4d/f34 1607390 0 2024-04-16T14:35:35.732 INFO:tasks.workunit.client.0.smithi005.stdout:9/348: symlink d3/d12/d16/d46/l62 0 2024-04-16T14:35:35.733 INFO:tasks.workunit.client.0.smithi005.stdout:9/349: symlink d3/l63 0 2024-04-16T14:35:35.734 INFO:tasks.workunit.client.0.smithi005.stdout:9/350: mknod d3/d12/d16/c64 0 2024-04-16T14:35:35.735 INFO:tasks.workunit.client.0.smithi005.stdout:9/351: mkdir d3/d49/d4b/d5c/d65 0 2024-04-16T14:35:35.735 INFO:tasks.workunit.client.0.smithi005.stdout:9/352: chown d3/d12/d16/f51 5015 1 2024-04-16T14:35:35.735 INFO:tasks.workunit.client.0.smithi005.stdout:9/353: chown d3/c3a 1 1 2024-04-16T14:35:35.742 INFO:tasks.workunit.client.1.smithi115.stdout:6/308: dread d13/d1d/d2b/d5f/d30/d43/d2c/f39 [0,4194304] 0 2024-04-16T14:35:35.742 INFO:tasks.workunit.client.1.smithi115.stdout:6/309: rmdir d13/d1d/d2b/d5f/d30 39 2024-04-16T14:35:35.743 INFO:tasks.workunit.client.1.smithi115.stdout:6/310: mkdir d13/d1d/d2b/d46/d5a/d62 0 2024-04-16T14:35:35.744 INFO:tasks.workunit.client.1.smithi115.stdout:6/311: read - d13/d1d/d2b/d5f/f27 zero size 2024-04-16T14:35:35.744 INFO:tasks.workunit.client.1.smithi115.stdout:6/312: mkdir d13/d1d/d2b/d46/d63 0 2024-04-16T14:35:35.753 INFO:tasks.workunit.client.0.smithi005.stdout:9/354: dread d3/d12/f28 [0,4194304] 0 2024-04-16T14:35:35.763 INFO:tasks.workunit.client.1.smithi115.stdout:8/278: dwrite d0/db/f12 [4194304,4194304] 0 2024-04-16T14:35:35.763 INFO:tasks.workunit.client.1.smithi115.stdout:8/279: fdatasync d0/db/d10/d17/f3a 0 2024-04-16T14:35:35.766 INFO:tasks.workunit.client.1.smithi115.stdout:8/280: rename d0/db/d10/d25/f34 to d0/f53 0 2024-04-16T14:35:35.770 INFO:tasks.workunit.client.1.smithi115.stdout:0/209: dwrite d6/fb [0,4194304] 0 2024-04-16T14:35:35.770 INFO:tasks.workunit.client.1.smithi115.stdout:0/210: chown d6/f1e 5965222 1 2024-04-16T14:35:35.770 INFO:tasks.workunit.client.1.smithi115.stdout:2/300: dwrite d0/d4/de/d11/f12 [0,4194304] 0 2024-04-16T14:35:35.770 INFO:tasks.workunit.client.1.smithi115.stdout:2/301: fsync d0/d1b/f41 0 2024-04-16T14:35:35.770 INFO:tasks.workunit.client.1.smithi115.stdout:2/302: fdatasync d0/f2d 0 2024-04-16T14:35:35.770 INFO:tasks.workunit.client.1.smithi115.stdout:7/264: dwrite d0/fe [0,4194304] 0 2024-04-16T14:35:35.770 INFO:tasks.workunit.client.1.smithi115.stdout:7/265: stat d0/d1 0 2024-04-16T14:35:35.770 INFO:tasks.workunit.client.1.smithi115.stdout:7/266: chown d0/f36 52495 1 2024-04-16T14:35:35.770 INFO:tasks.workunit.client.1.smithi115.stdout:7/267: creat d0/d1/d3b/d3e/f5c x:0 0 0 2024-04-16T14:35:35.770 INFO:tasks.workunit.client.1.smithi115.stdout:7/268: read d0/d2/d3a/f33 [3587501,122385] 0 2024-04-16T14:35:35.771 INFO:tasks.workunit.client.0.smithi005.stdout:9/355: dread d3/d12/f30 [0,4194304] 0 2024-04-16T14:35:35.772 INFO:tasks.workunit.client.0.smithi005.stdout:0/535: dwrite da/df/d1b/d3a/d53/d5a/d67/d79/f84 [4194304,4194304] 0 2024-04-16T14:35:35.772 INFO:tasks.workunit.client.0.smithi005.stdout:9/356: creat d3/d49/f66 x:0 0 0 2024-04-16T14:35:35.772 INFO:tasks.workunit.client.0.smithi005.stdout:4/769: dwrite d0/d1b/d1d/d1f/d3e/fcc [0,4194304] 0 2024-04-16T14:35:35.772 INFO:tasks.workunit.client.1.smithi115.stdout:0/211: truncate d6/d10/d12/f14 3165671 0 2024-04-16T14:35:35.774 INFO:tasks.workunit.client.1.smithi115.stdout:2/303: rename d0/d4/d24/d23/d52/d5a to d0/d47/d65 0 2024-04-16T14:35:35.778 INFO:tasks.workunit.client.1.smithi115.stdout:1/243: dwrite df/d2d/f41 [4194304,4194304] 0 2024-04-16T14:35:35.778 INFO:tasks.workunit.client.1.smithi115.stdout:6/313: dwrite d13/d1d/f56 [0,4194304] 0 2024-04-16T14:35:35.782 INFO:tasks.workunit.client.0.smithi005.stdout:9/357: read d3/f7 [974632,106986] 0 2024-04-16T14:35:35.783 INFO:tasks.workunit.client.0.smithi005.stdout:4/770: creat d0/d47/ff4 x:0 0 0 2024-04-16T14:35:35.784 INFO:tasks.workunit.client.0.smithi005.stdout:9/358: mknod d3/d12/d16/d46/d47/d60/c67 0 2024-04-16T14:35:35.786 INFO:tasks.workunit.client.0.smithi005.stdout:4/771: symlink d0/d1b/d1d/d1f/d5d/da7/d90/de4/lf5 0 2024-04-16T14:35:35.786 INFO:tasks.workunit.client.0.smithi005.stdout:4/772: read d0/d1b/d1d/d1f/d5d/da9/fea [90551,106999] 0 2024-04-16T14:35:35.786 INFO:tasks.workunit.client.0.smithi005.stdout:4/773: write d0/d1b/d1d/d1f/d3e/f5e [662157,108532] 0 2024-04-16T14:35:35.786 INFO:tasks.workunit.client.0.smithi005.stdout:4/774: read d0/d1b/d1d/d1f/d3e/daa/fc9 [686622,112759] 0 2024-04-16T14:35:35.786 INFO:tasks.workunit.client.0.smithi005.stdout:4/775: write d0/d1b/db7/ddd/fe1 [194628,99358] 0 2024-04-16T14:35:35.787 INFO:tasks.workunit.client.0.smithi005.stdout:4/776: dread - d0/d1b/da5/fb3 zero size 2024-04-16T14:35:35.788 INFO:tasks.workunit.client.1.smithi115.stdout:0/212: mkdir d6/d1b/d4e 0 2024-04-16T14:35:35.788 INFO:tasks.workunit.client.1.smithi115.stdout:0/213: creat d6/f4f x:0 0 0 2024-04-16T14:35:35.788 INFO:tasks.workunit.client.0.smithi005.stdout:9/359: unlink d3/d12/d16/d46/d47/f53 0 2024-04-16T14:35:35.789 INFO:tasks.workunit.client.0.smithi005.stdout:0/536: dwrite da/df/d1b/d24/f9c [0,4194304] 0 2024-04-16T14:35:35.790 INFO:tasks.workunit.client.0.smithi005.stdout:4/777: unlink d0/d1b/d1d/d1f/d3e/fcc 0 2024-04-16T14:35:35.790 INFO:tasks.workunit.client.1.smithi115.stdout:7/269: rename d0/d1/d3b/d3f/d48 to d0/d1/d3b/d49/d5d 0 2024-04-16T14:35:35.791 INFO:tasks.workunit.client.0.smithi005.stdout:0/537: stat da/df/d26/d39/l66 0 2024-04-16T14:35:35.792 INFO:tasks.workunit.client.1.smithi115.stdout:2/304: mknod d0/d4/de/c66 0 2024-04-16T14:35:35.797 INFO:tasks.workunit.client.1.smithi115.stdout:1/244: creat df/d13/d4d/f52 x:0 0 0 2024-04-16T14:35:35.797 INFO:tasks.workunit.client.1.smithi115.stdout:1/245: fdatasync f9 0 2024-04-16T14:35:35.802 INFO:tasks.workunit.client.1.smithi115.stdout:6/314: unlink d13/d1d/d2b/d5f/f27 0 2024-04-16T14:35:35.803 INFO:tasks.workunit.client.0.smithi005.stdout:4/778: dread d0/d1b/da5/fac [0,4194304] 0 2024-04-16T14:35:35.803 INFO:tasks.workunit.client.0.smithi005.stdout:4/779: rmdir d0/d1b/d1d/d1f/d5d/da7/d90 39 2024-04-16T14:35:35.804 INFO:tasks.workunit.client.1.smithi115.stdout:6/315: dread f8 [0,4194304] 0 2024-04-16T14:35:35.805 INFO:tasks.workunit.client.1.smithi115.stdout:6/316: write d13/d1d/d52/f53 [797949,91099] 0 2024-04-16T14:35:35.805 INFO:tasks.workunit.client.0.smithi005.stdout:4/780: mknod d0/d1b/d1d/d1f/d48/dab/db2/cf6 0 2024-04-16T14:35:35.805 INFO:tasks.workunit.client.0.smithi005.stdout:4/781: fsync d0/f58 0 2024-04-16T14:35:35.805 INFO:tasks.workunit.client.0.smithi005.stdout:4/782: truncate d0/d1b/d1d/d1f/f36 2107192 0 2024-04-16T14:35:35.805 INFO:tasks.workunit.client.0.smithi005.stdout:4/783: chown d0/d22/d61/c9f 0 1 2024-04-16T14:35:35.806 INFO:tasks.workunit.client.1.smithi115.stdout:0/214: creat d6/d10/d12/d31/d35/d44/f50 x:0 0 0 2024-04-16T14:35:35.806 INFO:tasks.workunit.client.0.smithi005.stdout:4/784: unlink d0/d1b/d1d/d1f/f7d 0 2024-04-16T14:35:35.809 INFO:tasks.workunit.client.1.smithi115.stdout:7/270: rename d0/d24/d2b/c4f to d0/d1/d3b/d3f/c5e 0 2024-04-16T14:35:35.809 INFO:tasks.workunit.client.1.smithi115.stdout:7/271: creat d0/d1/d3b/d3e/f5f x:0 0 0 2024-04-16T14:35:35.810 INFO:tasks.workunit.client.1.smithi115.stdout:2/305: getdents d0/d4/d22 0 2024-04-16T14:35:35.811 INFO:tasks.workunit.client.1.smithi115.stdout:1/246: unlink fa 0 2024-04-16T14:35:35.813 INFO:tasks.workunit.client.0.smithi005.stdout:9/360: dwrite d3/d12/f30 [0,4194304] 0 2024-04-16T14:35:35.814 INFO:tasks.workunit.client.0.smithi005.stdout:9/361: getdents d3/d12/d16/d46/d47 0 2024-04-16T14:35:35.814 INFO:tasks.workunit.client.0.smithi005.stdout:9/362: truncate d3/d49/d4b/d55/f5d 1020369 0 2024-04-16T14:35:35.815 INFO:tasks.workunit.client.1.smithi115.stdout:6/317: creat d13/d1d/d2b/d46/d63/f64 x:0 0 0 2024-04-16T14:35:35.815 INFO:tasks.workunit.client.0.smithi005.stdout:9/363: write d3/d49/d4b/d55/f5d [19438,32558] 0 2024-04-16T14:35:35.815 INFO:tasks.workunit.client.0.smithi005.stdout:9/364: write d3/f14 [911721,19047] 0 2024-04-16T14:35:35.815 INFO:tasks.workunit.client.0.smithi005.stdout:9/365: chown d3/f41 58811 1 2024-04-16T14:35:35.816 INFO:tasks.workunit.client.0.smithi005.stdout:9/366: fdatasync d3/d49/d4b/d55/f57 0 2024-04-16T14:35:35.817 INFO:tasks.workunit.client.0.smithi005.stdout:9/367: link d3/d12/d2b/c2e d3/c68 0 2024-04-16T14:35:35.818 INFO:tasks.workunit.client.1.smithi115.stdout:0/215: symlink d6/d30/d4d/l51 0 2024-04-16T14:35:35.820 INFO:tasks.workunit.client.1.smithi115.stdout:2/306: rename d0/d4/de/f48 to d0/d4/d57/f67 0 2024-04-16T14:35:35.822 INFO:tasks.workunit.client.1.smithi115.stdout:1/247: getdents df/d13/d4d/d2c 0 2024-04-16T14:35:35.822 INFO:tasks.workunit.client.1.smithi115.stdout:1/248: readlink df/d36/l43 0 2024-04-16T14:35:35.822 INFO:tasks.workunit.client.1.smithi115.stdout:1/249: chown df/d35/d48/c4b 224326 1 2024-04-16T14:35:35.824 INFO:tasks.workunit.client.0.smithi005.stdout:9/368: fsync d3/f14 0 2024-04-16T14:35:35.824 INFO:tasks.workunit.client.0.smithi005.stdout:9/369: dread - d3/d12/d16/d46/d47/f5a zero size 2024-04-16T14:35:35.824 INFO:tasks.workunit.client.0.smithi005.stdout:9/370: read d3/d12/d16/f39 [2556495,3372] 0 2024-04-16T14:35:35.825 INFO:tasks.workunit.client.1.smithi115.stdout:6/318: symlink d13/d1d/d52/l65 0 2024-04-16T14:35:35.825 INFO:tasks.workunit.client.0.smithi005.stdout:4/785: dwrite d0/d1b/d1d/d1f/d5d/da7/d90/fd3 [0,4194304] 0 2024-04-16T14:35:35.825 INFO:tasks.workunit.client.0.smithi005.stdout:0/538: dwrite da/df/d26/d39/fae [0,4194304] 0 2024-04-16T14:35:35.826 INFO:tasks.workunit.client.1.smithi115.stdout:1/250: creat df/d13/d4d/d3e/f53 x:0 0 0 2024-04-16T14:35:35.827 INFO:tasks.workunit.client.1.smithi115.stdout:6/319: creat d13/d1d/d2b/d5f/d30/f66 x:0 0 0 2024-04-16T14:35:35.828 INFO:tasks.workunit.client.0.smithi005.stdout:9/371: unlink d3/l18 0 2024-04-16T14:35:35.830 INFO:tasks.workunit.client.1.smithi115.stdout:1/251: mkdir df/d13/d4d/d2c/d54 0 2024-04-16T14:35:35.831 INFO:tasks.workunit.client.1.smithi115.stdout:2/307: write d0/d4/de/d11/f12 [2761172,18773] 0 2024-04-16T14:35:35.831 INFO:tasks.workunit.client.1.smithi115.stdout:2/308: dread - d0/d1b/f3d zero size 2024-04-16T14:35:35.833 INFO:tasks.workunit.client.0.smithi005.stdout:9/372: dread d3/d12/f28 [0,4194304] 0 2024-04-16T14:35:35.834 INFO:tasks.workunit.client.0.smithi005.stdout:8/513: sync 2024-04-16T14:35:35.834 INFO:tasks.workunit.client.1.smithi115.stdout:6/320: dread d13/d1d/f5c [0,4194304] 0 2024-04-16T14:35:35.835 INFO:tasks.workunit.client.0.smithi005.stdout:4/786: symlink d0/d1b/d1d/d1f/d5d/da7/lf7 0 2024-04-16T14:35:35.836 INFO:tasks.workunit.client.0.smithi005.stdout:0/539: creat da/df/d1b/d24/d75/d81/fb7 x:0 0 0 2024-04-16T14:35:35.837 INFO:tasks.workunit.client.0.smithi005.stdout:8/514: link f3 d5/d40/fb8 0 2024-04-16T14:35:35.838 INFO:tasks.workunit.client.1.smithi115.stdout:2/309: unlink d0/d4/d24/f13 0 2024-04-16T14:35:35.838 INFO:tasks.workunit.client.1.smithi115.stdout:2/310: truncate d0/d4/d57/f67 768918 0 2024-04-16T14:35:35.839 INFO:tasks.workunit.client.0.smithi005.stdout:0/540: mknod da/df/d50/cb8 0 2024-04-16T14:35:35.840 INFO:tasks.workunit.client.1.smithi115.stdout:2/311: creat d0/d4/d24/d21/d59/f68 x:0 0 0 2024-04-16T14:35:35.840 INFO:tasks.workunit.client.1.smithi115.stdout:2/312: truncate d0/d4/de/d11/d25/f30 711367 0 2024-04-16T14:35:35.840 INFO:tasks.workunit.client.1.smithi115.stdout:2/313: stat d0/d4/d24/d21/d3b/f3f 0 2024-04-16T14:35:35.841 INFO:tasks.workunit.client.0.smithi005.stdout:8/515: creat d5/d11/d6c/d71/fb9 x:0 0 0 2024-04-16T14:35:35.841 INFO:tasks.workunit.client.0.smithi005.stdout:8/516: chown d5/d7b/da8/db7/d8a/da1/d3d/f52 498032 1 2024-04-16T14:35:35.843 INFO:tasks.workunit.client.0.smithi005.stdout:0/541: rename da/df/d1b/d3a/d53/d5a/ca6 to da/df/d1b/d24/cb9 0 2024-04-16T14:35:35.844 INFO:tasks.workunit.client.1.smithi115.stdout:2/314: truncate d0/d4/d24/f34 3984787 0 2024-04-16T14:35:35.845 INFO:tasks.workunit.client.0.smithi005.stdout:0/542: symlink da/df/d26/d39/lba 0 2024-04-16T14:35:35.845 INFO:tasks.workunit.client.0.smithi005.stdout:0/543: readlink da/l6f 0 2024-04-16T14:35:35.849 INFO:tasks.workunit.client.1.smithi115.stdout:6/321: dread d13/d1d/d2b/d5f/f4b [0,4194304] 0 2024-04-16T14:35:35.849 INFO:tasks.workunit.client.1.smithi115.stdout:2/315: creat d0/d4/d4a/f69 x:0 0 0 2024-04-16T14:35:35.849 INFO:tasks.workunit.client.1.smithi115.stdout:2/316: fsync d0/d4/d24/f19 0 2024-04-16T14:35:35.849 INFO:tasks.workunit.client.1.smithi115.stdout:2/317: write d0/d4/de/d11/f1e [2425745,81623] 0 2024-04-16T14:35:35.849 INFO:tasks.workunit.client.1.smithi115.stdout:2/318: fdatasync d0/d4/de/d11/d25/f30 0 2024-04-16T14:35:35.849 INFO:tasks.workunit.client.1.smithi115.stdout:2/319: write d0/d4/ff [1898837,22264] 0 2024-04-16T14:35:35.849 INFO:tasks.workunit.client.1.smithi115.stdout:2/320: fsync d0/d4/de/d11/f62 0 2024-04-16T14:35:35.849 INFO:tasks.workunit.client.1.smithi115.stdout:0/216: dwrite d6/d10/f22 [0,4194304] 0 2024-04-16T14:35:35.851 INFO:tasks.workunit.client.0.smithi005.stdout:8/517: dread d5/d7b/da8/db7/f1d [0,4194304] 0 2024-04-16T14:35:35.851 INFO:tasks.workunit.client.0.smithi005.stdout:8/518: fsync d5/f43 0 2024-04-16T14:35:35.853 INFO:tasks.workunit.client.0.smithi005.stdout:8/519: mkdir d5/d7b/da8/db7/d8a/da1/d3d/dba 0 2024-04-16T14:35:35.854 INFO:tasks.workunit.client.0.smithi005.stdout:0/544: read da/df/d26/f4c [193695,80621] 0 2024-04-16T14:35:35.854 INFO:tasks.workunit.client.0.smithi005.stdout:0/545: chown da/df/d1b/d3a/d53/d5a/d67/f8d 216257 1 2024-04-16T14:35:35.855 INFO:tasks.workunit.client.1.smithi115.stdout:2/321: creat d0/d1b/f6a x:0 0 0 2024-04-16T14:35:35.856 INFO:tasks.workunit.client.0.smithi005.stdout:8/520: link d5/d9b/l9c d5/d7b/lbb 0 2024-04-16T14:35:35.857 INFO:tasks.workunit.client.0.smithi005.stdout:8/521: creat d5/d11/d6c/d71/fbc x:0 0 0 2024-04-16T14:35:35.857 INFO:tasks.workunit.client.1.smithi115.stdout:1/252: dwrite df/d13/d4d/f4f [0,4194304] 0 2024-04-16T14:35:35.861 INFO:tasks.workunit.client.1.smithi115.stdout:6/322: dread f0 [0,4194304] 0 2024-04-16T14:35:35.863 INFO:tasks.workunit.client.1.smithi115.stdout:6/323: creat d13/d1d/d2b/f67 x:0 0 0 2024-04-16T14:35:35.863 INFO:tasks.workunit.client.1.smithi115.stdout:6/324: write d13/d1d/d2b/d5f/f4a [994819,90315] 0 2024-04-16T14:35:35.864 INFO:tasks.workunit.client.0.smithi005.stdout:9/373: dwrite d3/f41 [0,4194304] 0 2024-04-16T14:35:35.868 INFO:tasks.workunit.client.1.smithi115.stdout:2/322: dread d0/d4/d24/d10/f39 [0,4194304] 0 2024-04-16T14:35:35.870 INFO:tasks.workunit.client.0.smithi005.stdout:4/787: dwrite d0/d1b/d1d/dde/ff3 [0,4194304] 0 2024-04-16T14:35:35.870 INFO:tasks.workunit.client.1.smithi115.stdout:6/325: mkdir d13/d1d/d68 0 2024-04-16T14:35:35.872 INFO:tasks.workunit.client.0.smithi005.stdout:4/788: mkdir d0/df8 0 2024-04-16T14:35:35.873 INFO:tasks.workunit.client.1.smithi115.stdout:0/217: dwrite d6/f25 [0,4194304] 0 2024-04-16T14:35:35.873 INFO:tasks.workunit.client.1.smithi115.stdout:6/326: mknod d13/d1a/d55/c69 0 2024-04-16T14:35:35.875 INFO:tasks.workunit.client.0.smithi005.stdout:0/546: dread da/df/d1b/d24/f90 [0,4194304] 0 2024-04-16T14:35:35.876 INFO:tasks.workunit.client.0.smithi005.stdout:0/547: rmdir da/df/d26/d8e 39 2024-04-16T14:35:35.877 INFO:tasks.workunit.client.0.smithi005.stdout:0/548: truncate da/df/f94 2855524 0 2024-04-16T14:35:35.882 INFO:tasks.workunit.client.1.smithi115.stdout:9/336: sync 2024-04-16T14:35:35.883 INFO:tasks.workunit.client.1.smithi115.stdout:5/235: sync 2024-04-16T14:35:35.883 INFO:tasks.workunit.client.1.smithi115.stdout:5/236: rmdir dc/d15/d4d 39 2024-04-16T14:35:35.883 INFO:tasks.workunit.client.0.smithi005.stdout:0/549: mknod da/df/d1b/d3a/d53/d5a/cbb 0 2024-04-16T14:35:35.883 INFO:tasks.workunit.client.0.smithi005.stdout:0/550: dread - da/df/d1b/d3a/d53/fad zero size 2024-04-16T14:35:35.884 INFO:tasks.workunit.client.0.smithi005.stdout:0/551: dread - da/df/d1b/d3a/d53/d5a/d99/f9e zero size 2024-04-16T14:35:35.884 INFO:tasks.workunit.client.0.smithi005.stdout:0/552: write da/df/d1b/d71/fa0 [437409,95181] 0 2024-04-16T14:35:35.884 INFO:tasks.workunit.client.0.smithi005.stdout:0/553: dread - da/df/d1b/d24/f7e zero size 2024-04-16T14:35:35.884 INFO:tasks.workunit.client.0.smithi005.stdout:4/789: dread d0/d22/d29/fdf [0,4194304] 0 2024-04-16T14:35:35.884 INFO:tasks.workunit.client.0.smithi005.stdout:4/790: chown d0/d4d/l6c 2830 1 2024-04-16T14:35:35.885 INFO:tasks.workunit.client.0.smithi005.stdout:4/791: creat d0/d1b/d1d/d1f/d5d/da9/ff9 x:0 0 0 2024-04-16T14:35:35.886 INFO:tasks.workunit.client.1.smithi115.stdout:5/237: symlink dc/d15/d2d/l50 0 2024-04-16T14:35:35.887 INFO:tasks.workunit.client.1.smithi115.stdout:5/238: write dc/d15/d2d/f32 [996893,84848] 0 2024-04-16T14:35:35.887 INFO:tasks.workunit.client.1.smithi115.stdout:5/239: write dc/d3d/f42 [502875,50875] 0 2024-04-16T14:35:35.887 INFO:tasks.workunit.client.1.smithi115.stdout:5/240: chown dc/d3d/d41 9353 1 2024-04-16T14:35:35.887 INFO:tasks.workunit.client.0.smithi005.stdout:4/792: mkdir d0/d22/d61/ded/dfa 0 2024-04-16T14:35:35.887 INFO:tasks.workunit.client.0.smithi005.stdout:8/522: dwrite d5/f23 [0,4194304] 0 2024-04-16T14:35:35.889 INFO:tasks.workunit.client.1.smithi115.stdout:0/218: read d6/fb [3180836,34927] 0 2024-04-16T14:35:35.889 INFO:tasks.workunit.client.1.smithi115.stdout:0/219: write f1 [677182,122873] 0 2024-04-16T14:35:35.890 INFO:tasks.workunit.client.0.smithi005.stdout:4/793: dread d0/f5c [0,4194304] 0 2024-04-16T14:35:35.890 INFO:tasks.workunit.client.0.smithi005.stdout:8/523: symlink d5/d7b/da8/db7/d8a/da1/lbd 0 2024-04-16T14:35:35.893 INFO:tasks.workunit.client.0.smithi005.stdout:4/794: creat d0/d1b/d1d/d1f/d48/dab/dcb/ffb x:0 0 0 2024-04-16T14:35:35.893 INFO:tasks.workunit.client.0.smithi005.stdout:4/795: read - d0/d22/d61/fe7 zero size 2024-04-16T14:35:35.895 INFO:tasks.workunit.client.0.smithi005.stdout:4/796: unlink d0/d1b/d1d/d1f/d3e/l8f 0 2024-04-16T14:35:35.900 INFO:tasks.workunit.client.1.smithi115.stdout:1/253: dwrite df/d13/d4d/d3e/f46 [0,4194304] 0 2024-04-16T14:35:35.900 INFO:tasks.workunit.client.0.smithi005.stdout:0/554: dread da/fc [0,4194304] 0 2024-04-16T14:35:35.901 INFO:tasks.workunit.client.1.smithi115.stdout:1/254: dread df/d13/d4d/f32 [0,4194304] 0 2024-04-16T14:35:35.903 INFO:tasks.workunit.client.0.smithi005.stdout:0/555: mkdir da/df/d1b/d3a/d53/dbc 0 2024-04-16T14:35:35.903 INFO:tasks.workunit.client.1.smithi115.stdout:5/241: write dc/d15/f24 [152260,72568] 0 2024-04-16T14:35:35.904 INFO:tasks.workunit.client.0.smithi005.stdout:0/556: unlink da/c74 0 2024-04-16T14:35:35.906 INFO:tasks.workunit.client.0.smithi005.stdout:0/557: mknod da/df/d1b/d3a/d53/d5a/d99/cbd 0 2024-04-16T14:35:35.906 INFO:tasks.workunit.client.0.smithi005.stdout:0/558: chown da/df/d1b/d3a/d53/dbc 2236 1 2024-04-16T14:35:35.907 INFO:tasks.workunit.client.1.smithi115.stdout:1/255: rename df/d13/d40 to df/d13/d4d/d2c/d54/d55 0 2024-04-16T14:35:35.907 INFO:tasks.workunit.client.0.smithi005.stdout:8/524: write d5/d7b/da8/db7/d8a/da1/d68/f75 [3314452,13816] 0 2024-04-16T14:35:35.909 INFO:tasks.workunit.client.1.smithi115.stdout:5/242: rename l3 to dc/d3d/l51 0 2024-04-16T14:35:35.910 INFO:tasks.workunit.client.0.smithi005.stdout:4/797: write d0/d1b/d1d/d1f/d5d/da7/d90/fd3 [1817632,53394] 0 2024-04-16T14:35:35.911 INFO:tasks.workunit.client.1.smithi115.stdout:1/256: creat df/d36/d3c/f56 x:0 0 0 2024-04-16T14:35:35.912 INFO:tasks.workunit.client.1.smithi115.stdout:5/243: getdents dc/d15/d4d 0 2024-04-16T14:35:35.912 INFO:tasks.workunit.client.0.smithi005.stdout:0/559: dread da/df/d1b/d24/f38 [0,4194304] 0 2024-04-16T14:35:35.912 INFO:tasks.workunit.client.0.smithi005.stdout:8/525: creat d5/d7b/da8/db7/d8a/da1/d3d/d7f/fbe x:0 0 0 2024-04-16T14:35:35.912 INFO:tasks.workunit.client.0.smithi005.stdout:8/526: chown d5/d7b/da8/db7/d8a/da1/ca3 1115166592 1 2024-04-16T14:35:35.913 INFO:tasks.workunit.client.1.smithi115.stdout:1/257: getdents df/d35/d48 0 2024-04-16T14:35:35.914 INFO:tasks.workunit.client.1.smithi115.stdout:1/258: rmdir df/d13/d3a 39 2024-04-16T14:35:35.914 INFO:tasks.workunit.client.1.smithi115.stdout:1/259: chown fe 1 1 2024-04-16T14:35:35.915 INFO:tasks.workunit.client.0.smithi005.stdout:0/560: mknod da/df/d1b/cbe 0 2024-04-16T14:35:35.915 INFO:tasks.workunit.client.1.smithi115.stdout:1/260: creat df/d35/d48/f57 x:0 0 0 2024-04-16T14:35:35.916 INFO:tasks.workunit.client.0.smithi005.stdout:8/527: mknod d5/cbf 0 2024-04-16T14:35:35.917 INFO:tasks.workunit.client.0.smithi005.stdout:8/528: chown d5/d11/f20 535 1 2024-04-16T14:35:35.917 INFO:tasks.workunit.client.0.smithi005.stdout:8/529: chown d5/l64 83218 1 2024-04-16T14:35:35.917 INFO:tasks.workunit.client.1.smithi115.stdout:1/261: symlink df/d13/d3a/l58 0 2024-04-16T14:35:35.920 INFO:tasks.workunit.client.0.smithi005.stdout:8/530: mkdir d5/d7b/da8/db7/d8a/da1/d3d/dba/dc0 0 2024-04-16T14:35:35.920 INFO:tasks.workunit.client.0.smithi005.stdout:8/531: write d5/f3a [4842301,41828] 0 2024-04-16T14:35:35.921 INFO:tasks.workunit.client.0.smithi005.stdout:8/532: creat d5/d55/d5a/fc1 x:0 0 0 2024-04-16T14:35:35.922 INFO:tasks.workunit.client.1.smithi115.stdout:1/262: dread df/f23 [0,4194304] 0 2024-04-16T14:35:35.922 INFO:tasks.workunit.client.1.smithi115.stdout:1/263: fsync f3 0 2024-04-16T14:35:35.922 INFO:tasks.workunit.client.1.smithi115.stdout:1/264: write df/d35/f39 [567132,64468] 0 2024-04-16T14:35:35.924 INFO:tasks.workunit.client.0.smithi005.stdout:8/533: mknod d5/d7b/da8/db7/d8a/da1/d3d/dba/cc2 0 2024-04-16T14:35:35.924 INFO:tasks.workunit.client.0.smithi005.stdout:8/534: write d5/d7b/da8/db7/d8a/da1/d3d/d7f/f81 [1419988,130370] 0 2024-04-16T14:35:35.925 INFO:tasks.workunit.client.0.smithi005.stdout:8/535: unlink d5/d11/f62 0 2024-04-16T14:35:35.925 INFO:tasks.workunit.client.0.smithi005.stdout:8/536: dread - d5/d7b/da8/db7/d8a/da1/d3d/d7f/d8d/f98 zero size 2024-04-16T14:35:35.925 INFO:tasks.workunit.client.0.smithi005.stdout:8/537: rmdir d5/d7b/da8/da5 39 2024-04-16T14:35:35.925 INFO:tasks.workunit.client.0.smithi005.stdout:8/538: write d5/d7b/da8/db7/d8a/fab [626977,14136] 0 2024-04-16T14:35:35.926 INFO:tasks.workunit.client.1.smithi115.stdout:2/323: dwrite d0/d4/f3a [0,4194304] 0 2024-04-16T14:35:35.927 INFO:tasks.workunit.client.1.smithi115.stdout:0/220: dwrite d6/d10/f22 [0,4194304] 0 2024-04-16T14:35:35.927 INFO:tasks.workunit.client.0.smithi005.stdout:9/374: dwrite d3/d12/d16/f19 [0,4194304] 0 2024-04-16T14:35:35.927 INFO:tasks.workunit.client.0.smithi005.stdout:8/539: link d5/d40/d4b/l9f d5/d40/d4b/lc3 0 2024-04-16T14:35:35.927 INFO:tasks.workunit.client.0.smithi005.stdout:8/540: chown d5/d11/f20 2000 1 2024-04-16T14:35:35.928 INFO:tasks.workunit.client.1.smithi115.stdout:9/337: dwrite d1/d6/d33/f38 [0,4194304] 0 2024-04-16T14:35:35.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:35 smithi115 ceph-mon[37295]: pgmap v22: 65 pgs: 65 active+clean; 1.1 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 114 MiB/s rd, 135 MiB/s wr, 496 op/s 2024-04-16T14:35:35.932 INFO:tasks.workunit.client.0.smithi005.stdout:9/375: creat d3/d12/d16/d46/d47/d60/f69 x:0 0 0 2024-04-16T14:35:35.932 INFO:tasks.workunit.client.0.smithi005.stdout:9/376: creat d3/d12/d16/d46/d47/d60/f6a x:0 0 0 2024-04-16T14:35:35.932 INFO:tasks.workunit.client.0.smithi005.stdout:9/377: write d3/d12/d16/d46/d47/f5a [926730,113862] 0 2024-04-16T14:35:35.932 INFO:tasks.workunit.client.0.smithi005.stdout:0/561: read da/df/d26/f45 [1311081,81825] 0 2024-04-16T14:35:35.932 INFO:tasks.workunit.client.0.smithi005.stdout:8/541: mknod d5/cc4 0 2024-04-16T14:35:35.933 INFO:tasks.workunit.client.1.smithi115.stdout:2/324: rename d0/d4/de/d11/d36/f63 to d0/d4/f6b 0 2024-04-16T14:35:35.933 INFO:tasks.workunit.client.1.smithi115.stdout:2/325: chown d0/d1b/f6a 2087 1 2024-04-16T14:35:35.933 INFO:tasks.workunit.client.1.smithi115.stdout:0/221: mknod d6/d1b/d4e/c52 0 2024-04-16T14:35:35.933 INFO:tasks.workunit.client.1.smithi115.stdout:9/338: symlink d1/d6/d2d/d4b/d60/l69 0 2024-04-16T14:35:35.934 INFO:tasks.workunit.client.1.smithi115.stdout:0/222: creat d6/d10/d12/d31/d35/d28/f53 x:0 0 0 2024-04-16T14:35:35.935 INFO:tasks.workunit.client.1.smithi115.stdout:6/327: dwrite f12 [4194304,4194304] 0 2024-04-16T14:35:35.935 INFO:tasks.workunit.client.1.smithi115.stdout:6/328: fdatasync d13/d1d/d2b/d46/d5a/f3b 0 2024-04-16T14:35:35.937 INFO:tasks.workunit.client.1.smithi115.stdout:9/339: creat d1/d10/d20/d2a/f6a x:0 0 0 2024-04-16T14:35:35.937 INFO:tasks.workunit.client.0.smithi005.stdout:0/562: rename da/df/d1b/d24/l40 to da/df/d1b/db6/lbf 0 2024-04-16T14:35:35.938 INFO:tasks.workunit.client.0.smithi005.stdout:0/563: fsync da/d7c/fa3 0 2024-04-16T14:35:35.938 INFO:tasks.workunit.client.1.smithi115.stdout:0/223: mkdir d6/d54 0 2024-04-16T14:35:35.941 INFO:tasks.workunit.client.0.smithi005.stdout:0/564: read da/df/d1b/d3a/fa4 [487100,40384] 0 2024-04-16T14:35:35.948 INFO:tasks.workunit.client.0.smithi005.stdout:8/542: write d5/d7b/da8/db7/f5b [119785,92115] 0 2024-04-16T14:35:35.948 INFO:tasks.workunit.client.0.smithi005.stdout:8/543: write d5/d11/f45 [668647,67911] 0 2024-04-16T14:35:35.949 INFO:tasks.workunit.client.0.smithi005.stdout:8/544: chown d5/d11/f44 1623 1 2024-04-16T14:35:35.949 INFO:tasks.workunit.client.0.smithi005.stdout:8/545: write d5/d7b/da8/db7/d8a/f91 [2921143,2357] 0 2024-04-16T14:35:35.949 INFO:tasks.workunit.client.0.smithi005.stdout:8/546: truncate d5/d7b/da8/db7/d8a/da1/f31 5158464 0 2024-04-16T14:35:35.949 INFO:tasks.workunit.client.0.smithi005.stdout:8/547: creat d5/d11/d6c/d71/fc5 x:0 0 0 2024-04-16T14:35:35.949 INFO:tasks.workunit.client.0.smithi005.stdout:8/548: chown d5/d7b/da8/db7/d8a/da1/d68/c69 41616517 1 2024-04-16T14:35:35.949 INFO:tasks.workunit.client.0.smithi005.stdout:4/798: rmdir d0/d1b/d1d 39 2024-04-16T14:35:35.949 INFO:tasks.workunit.client.0.smithi005.stdout:4/799: readlink d0/d1b/le3 0 2024-04-16T14:35:35.950 INFO:tasks.workunit.client.0.smithi005.stdout:1/599: sync 2024-04-16T14:35:35.950 INFO:tasks.workunit.client.0.smithi005.stdout:2/317: sync 2024-04-16T14:35:35.950 INFO:tasks.workunit.client.0.smithi005.stdout:0/565: dread da/f30 [0,4194304] 0 2024-04-16T14:35:35.950 INFO:tasks.workunit.client.0.smithi005.stdout:0/566: stat da/f32 0 2024-04-16T14:35:35.950 INFO:tasks.workunit.client.1.smithi115.stdout:6/329: read d13/d1d/f56 [476110,82088] 0 2024-04-16T14:35:35.951 INFO:tasks.workunit.client.1.smithi115.stdout:9/340: dread d1/d6/d2d/f1f [0,4194304] 0 2024-04-16T14:35:35.951 INFO:tasks.workunit.client.0.smithi005.stdout:8/549: creat d5/d7b/da8/db7/d74/fc6 x:0 0 0 2024-04-16T14:35:35.951 INFO:tasks.workunit.client.0.smithi005.stdout:8/550: readlink d5/l7 0 2024-04-16T14:35:35.952 INFO:tasks.workunit.client.1.smithi115.stdout:5/244: dread dc/d15/f24 [0,4194304] 0 2024-04-16T14:35:35.952 INFO:tasks.workunit.client.0.smithi005.stdout:2/318: getdents d0/d2a/d3a 0 2024-04-16T14:35:35.955 INFO:tasks.workunit.client.0.smithi005.stdout:8/551: unlink d5/d11/l7d 0 2024-04-16T14:35:35.957 INFO:tasks.workunit.client.0.smithi005.stdout:2/319: symlink d0/d29/l64 0 2024-04-16T14:35:35.957 INFO:tasks.workunit.client.0.smithi005.stdout:1/600: write d2/d1c/d15/d2a/d1a/f3b [115479,125196] 0 2024-04-16T14:35:35.958 INFO:tasks.workunit.client.1.smithi115.stdout:9/341: link d1/d6/f67 d1/d10/f6b 0 2024-04-16T14:35:35.959 INFO:tasks.workunit.client.0.smithi005.stdout:8/552: creat d5/d9b/fc7 x:0 0 0 2024-04-16T14:35:35.959 INFO:tasks.workunit.client.0.smithi005.stdout:8/553: readlink d5/d7b/lae 0 2024-04-16T14:35:35.961 INFO:tasks.workunit.client.0.smithi005.stdout:2/320: link d0/d1c/c2e d0/d1c/d39/c65 0 2024-04-16T14:35:35.963 INFO:tasks.workunit.client.0.smithi005.stdout:1/601: symlink d2/d1c/d15/d6f/ld9 0 2024-04-16T14:35:35.963 INFO:tasks.workunit.client.0.smithi005.stdout:1/602: write d2/d1c/d15/d2a/d25/f5c [3787171,22618] 0 2024-04-16T14:35:35.964 INFO:tasks.workunit.client.1.smithi115.stdout:1/265: dwrite df/f10 [0,4194304] 0 2024-04-16T14:35:35.964 INFO:tasks.workunit.client.1.smithi115.stdout:1/266: chown df/d13/d4d/f34 6522740 1 2024-04-16T14:35:35.967 INFO:tasks.workunit.client.0.smithi005.stdout:4/800: dread d0/d1b/d1d/d1f/d3e/feb [0,4194304] 0 2024-04-16T14:35:35.968 INFO:tasks.workunit.client.0.smithi005.stdout:2/321: rmdir d0/d61 0 2024-04-16T14:35:35.968 INFO:tasks.workunit.client.0.smithi005.stdout:2/322: creat d0/d4/f66 x:0 0 0 2024-04-16T14:35:35.969 INFO:tasks.workunit.client.0.smithi005.stdout:2/323: read d0/d29/f49 [286648,43968] 0 2024-04-16T14:35:35.970 INFO:tasks.workunit.client.0.smithi005.stdout:4/801: dread d0/d1b/d1d/d1f/d3e/d6d/fd9 [0,4194304] 0 2024-04-16T14:35:35.973 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:35 smithi005 ceph-mon[28964]: pgmap v22: 65 pgs: 65 active+clean; 1.1 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 114 MiB/s rd, 135 MiB/s wr, 496 op/s 2024-04-16T14:35:35.976 INFO:tasks.workunit.client.0.smithi005.stdout:1/603: link d2/f62 d2/d1c/d15/d2a/d19/d42/d64/d76/fda 0 2024-04-16T14:35:35.978 INFO:tasks.workunit.client.0.smithi005.stdout:4/802: truncate d0/f4c 1334792 0 2024-04-16T14:35:35.980 INFO:tasks.workunit.client.0.smithi005.stdout:1/604: mknod d2/d1c/d15/d2a/d19/d42/cdb 0 2024-04-16T14:35:35.980 INFO:tasks.workunit.client.0.smithi005.stdout:1/605: readlink d2/lc 0 2024-04-16T14:35:35.980 INFO:tasks.workunit.client.0.smithi005.stdout:1/606: chown d2/d1c/d15/d2a/d19/c31 4 1 2024-04-16T14:35:35.980 INFO:tasks.workunit.client.0.smithi005.stdout:9/378: dwrite d3/d12/f28 [0,4194304] 0 2024-04-16T14:35:35.981 INFO:tasks.workunit.client.0.smithi005.stdout:9/379: stat d3/d12/d16/d46/d47/d60 0 2024-04-16T14:35:35.981 INFO:tasks.workunit.client.0.smithi005.stdout:9/380: readlink d3/d12/l13 0 2024-04-16T14:35:35.982 INFO:tasks.workunit.client.0.smithi005.stdout:4/803: mknod d0/d22/d61/ded/dfa/cfc 0 2024-04-16T14:35:35.984 INFO:tasks.workunit.client.0.smithi005.stdout:7/625: sync 2024-04-16T14:35:35.984 INFO:tasks.workunit.client.0.smithi005.stdout:3/515: sync 2024-04-16T14:35:35.984 INFO:tasks.workunit.client.0.smithi005.stdout:5/521: sync 2024-04-16T14:35:35.984 INFO:tasks.workunit.client.0.smithi005.stdout:7/626: readlink d1/ld0 0 2024-04-16T14:35:35.984 INFO:tasks.workunit.client.0.smithi005.stdout:5/522: truncate d0/d6/d12/d1c/f1f 4419837 0 2024-04-16T14:35:35.985 INFO:tasks.workunit.client.0.smithi005.stdout:6/666: sync 2024-04-16T14:35:35.986 INFO:tasks.workunit.client.0.smithi005.stdout:9/381: symlink d3/d49/l6b 0 2024-04-16T14:35:35.986 INFO:tasks.workunit.client.0.smithi005.stdout:9/382: creat d3/d12/f6c x:0 0 0 2024-04-16T14:35:35.987 INFO:tasks.workunit.client.0.smithi005.stdout:4/804: dread d0/d1b/d1d/d1f/d5d/fa8 [0,4194304] 0 2024-04-16T14:35:35.987 INFO:tasks.workunit.client.0.smithi005.stdout:4/805: readlink d0/d1b/d1d/d1f/l32 0 2024-04-16T14:35:35.987 INFO:tasks.workunit.client.0.smithi005.stdout:3/516: rename d2/d9/d5e/ca1 to d2/d17/d46/ca8 0 2024-04-16T14:35:35.989 INFO:tasks.workunit.client.0.smithi005.stdout:5/523: symlink d0/d6/d12/lb0 0 2024-04-16T14:35:35.989 INFO:tasks.workunit.client.1.smithi115.stdout:9/342: rename d1/d10 to d1/d6/d2d/d4b/d6c 0 2024-04-16T14:35:35.989 INFO:tasks.workunit.client.1.smithi115.stdout:9/343: chown d1/d6/d2d/l53 1 1 2024-04-16T14:35:35.990 INFO:tasks.workunit.client.0.smithi005.stdout:6/667: creat d2/d3f/d53/d54/fe7 x:0 0 0 2024-04-16T14:35:35.991 INFO:tasks.workunit.client.1.smithi115.stdout:9/344: symlink d1/d6/d2d/d4b/l6d 0 2024-04-16T14:35:35.992 INFO:tasks.workunit.client.0.smithi005.stdout:9/383: getdents d3/d12/d16 0 2024-04-16T14:35:35.994 INFO:tasks.workunit.client.1.smithi115.stdout:9/345: creat d1/d6/d2d/d4b/d6c/d20/d2a/f6e x:0 0 0 2024-04-16T14:35:35.998 INFO:tasks.workunit.client.1.smithi115.stdout:0/224: dwrite d6/d10/d12/f1c [0,4194304] 0 2024-04-16T14:35:35.999 INFO:tasks.workunit.client.0.smithi005.stdout:6/668: dread d2/d3f/d47/f83 [0,4194304] 0 2024-04-16T14:35:35.999 INFO:tasks.workunit.client.0.smithi005.stdout:6/669: read - d2/d5/d10/dd6/d8e/f9e zero size 2024-04-16T14:35:36.002 INFO:tasks.workunit.client.0.smithi005.stdout:6/670: link d2/d5/d10/dd6/d7a/d9d/fe0 d2/de1/fe8 0 2024-04-16T14:35:36.002 INFO:tasks.workunit.client.0.smithi005.stdout:6/671: readlink d2/d20/d33/d64/lcb 0 2024-04-16T14:35:36.002 INFO:tasks.workunit.client.0.smithi005.stdout:7/627: write d1/d49/d74/d77/d22/d27/f45 [621883,12514] 0 2024-04-16T14:35:36.002 INFO:tasks.workunit.client.1.smithi115.stdout:0/225: rename d6/d10/d12/f1c to d6/d10/f55 0 2024-04-16T14:35:36.002 INFO:tasks.workunit.client.1.smithi115.stdout:0/226: chown d6/d10/f55 178 1 2024-04-16T14:35:36.002 INFO:tasks.workunit.client.1.smithi115.stdout:0/227: fsync d6/d10/d12/d31/d35/d44/f50 0 2024-04-16T14:35:36.003 INFO:tasks.workunit.client.0.smithi005.stdout:6/672: truncate d2/d5/d10/f13 301678 0 2024-04-16T14:35:36.004 INFO:tasks.workunit.client.1.smithi115.stdout:5/245: dwrite dc/d15/f31 [0,4194304] 0 2024-04-16T14:35:36.004 INFO:tasks.workunit.client.1.smithi115.stdout:5/246: stat dc/d15/l1e 0 2024-04-16T14:35:36.005 INFO:tasks.workunit.client.0.smithi005.stdout:7/628: link d1/d49/d74/fcc d1/d85/fd5 0 2024-04-16T14:35:36.007 INFO:tasks.workunit.client.0.smithi005.stdout:6/673: creat d2/d45/fe9 x:0 0 0 2024-04-16T14:35:36.008 INFO:tasks.workunit.client.1.smithi115.stdout:5/247: mknod dc/d15/d4d/c52 0 2024-04-16T14:35:36.008 INFO:tasks.workunit.client.1.smithi115.stdout:5/248: write dc/f1c [404852,74624] 0 2024-04-16T14:35:36.008 INFO:tasks.workunit.client.1.smithi115.stdout:5/249: chown dc/d15/d4d/l4f 397575 1 2024-04-16T14:35:36.008 INFO:tasks.workunit.client.0.smithi005.stdout:7/629: mknod d1/d49/d74/d77/d22/cd6 0 2024-04-16T14:35:36.008 INFO:tasks.workunit.client.0.smithi005.stdout:7/630: truncate d1/d82/f76 408064 0 2024-04-16T14:35:36.010 INFO:tasks.workunit.client.1.smithi115.stdout:6/330: dwrite d13/d1a/f23 [0,4194304] 0 2024-04-16T14:35:36.011 INFO:tasks.workunit.client.1.smithi115.stdout:5/250: creat dc/d15/f53 x:0 0 0 2024-04-16T14:35:36.011 INFO:tasks.workunit.client.0.smithi005.stdout:5/524: write d0/f8 [815,18745] 0 2024-04-16T14:35:36.011 INFO:tasks.workunit.client.0.smithi005.stdout:8/554: dwrite d5/d7b/da8/db7/d8a/da1/d3d/d7f/f9d [0,4194304] 0 2024-04-16T14:35:36.011 INFO:tasks.workunit.client.0.smithi005.stdout:5/525: creat d0/d6/d12/d34/d8d/d5e/d74/fb1 x:0 0 0 2024-04-16T14:35:36.011 INFO:tasks.workunit.client.0.smithi005.stdout:7/631: dread d1/dc/d2f/f83 [0,4194304] 0 2024-04-16T14:35:36.011 INFO:tasks.workunit.client.0.smithi005.stdout:6/674: creat d2/d20/fea x:0 0 0 2024-04-16T14:35:36.012 INFO:tasks.workunit.client.1.smithi115.stdout:6/331: creat d13/d1d/d2b/d5f/f6a x:0 0 0 2024-04-16T14:35:36.017 INFO:tasks.workunit.client.0.smithi005.stdout:7/632: dread d1/dc/f18 [0,4194304] 0 2024-04-16T14:35:36.017 INFO:tasks.workunit.client.0.smithi005.stdout:7/633: fdatasync d1/d49/d74/d77/d22/d27/d3a/d5c/d9e/fd1 0 2024-04-16T14:35:36.019 INFO:tasks.workunit.client.0.smithi005.stdout:5/526: mknod d0/d6/d12/d34/d6d/cb2 0 2024-04-16T14:35:36.019 INFO:tasks.workunit.client.0.smithi005.stdout:5/527: readlink d0/d6/d12/d34/l33 0 2024-04-16T14:35:36.019 INFO:tasks.workunit.client.1.smithi115.stdout:0/228: dread d6/d10/d12/d31/d35/f3c [0,4194304] 0 2024-04-16T14:35:36.019 INFO:tasks.workunit.client.1.smithi115.stdout:0/229: fdatasync d6/d10/d12/f14 0 2024-04-16T14:35:36.020 INFO:tasks.workunit.client.1.smithi115.stdout:1/267: dwrite df/f27 [4194304,4194304] 0 2024-04-16T14:35:36.020 INFO:tasks.workunit.client.1.smithi115.stdout:1/268: fdatasync df/d13/f16 0 2024-04-16T14:35:36.021 INFO:tasks.workunit.client.0.smithi005.stdout:6/675: rmdir d2/d5/d28/db8 39 2024-04-16T14:35:36.021 INFO:tasks.workunit.client.0.smithi005.stdout:6/676: write d2/d5/d10/f3e [4530808,74436] 0 2024-04-16T14:35:36.021 INFO:tasks.workunit.client.0.smithi005.stdout:6/677: chown d2/d3f/d53/d54/db5/cb7 137 1 2024-04-16T14:35:36.021 INFO:tasks.workunit.client.0.smithi005.stdout:1/607: dwrite d2/d74/dd7/f8f [0,4194304] 0 2024-04-16T14:35:36.021 INFO:tasks.workunit.client.0.smithi005.stdout:1/608: truncate d2/d1c/d15/d2a/d19/d42/d64/d76/fda 1174815 0 2024-04-16T14:35:36.021 INFO:tasks.workunit.client.0.smithi005.stdout:1/609: read d2/f62 [1023504,26490] 0 2024-04-16T14:35:36.027 INFO:tasks.workunit.client.0.smithi005.stdout:8/555: dread d5/d40/d4b/f93 [0,4194304] 0 2024-04-16T14:35:36.030 INFO:tasks.workunit.client.0.smithi005.stdout:1/610: dread d2/d1c/d15/d2a/d1a/d21/f89 [4194304,4194304] 0 2024-04-16T14:35:36.030 INFO:tasks.workunit.client.0.smithi005.stdout:1/611: dread - d2/d1c/d15/d2a/d19/d20/d27/f79 zero size 2024-04-16T14:35:36.031 INFO:tasks.workunit.client.0.smithi005.stdout:5/528: getdents d0/d6/d12/d34/d8d 0 2024-04-16T14:35:36.031 INFO:tasks.workunit.client.0.smithi005.stdout:5/529: fdatasync d0/faf 0 2024-04-16T14:35:36.033 INFO:tasks.workunit.client.0.smithi005.stdout:6/678: dread d2/d45/d7b/db2/fbb [0,4194304] 0 2024-04-16T14:35:36.033 INFO:tasks.workunit.client.0.smithi005.stdout:4/806: dwrite d0/d1b/d1d/d1f/d3e/f5e [0,4194304] 0 2024-04-16T14:35:36.034 INFO:tasks.workunit.client.0.smithi005.stdout:3/517: dwrite d2/d17/d46/d75/d6d/f72 [0,4194304] 0 2024-04-16T14:35:36.038 INFO:tasks.workunit.client.0.smithi005.stdout:1/612: unlink d2/d1c/d15/d2a/d19/d42/d64/d76/f97 0 2024-04-16T14:35:36.038 INFO:tasks.workunit.client.0.smithi005.stdout:1/613: write d2/d2c/d85/dab/d51/fc3 [115035,121613] 0 2024-04-16T14:35:36.038 INFO:tasks.workunit.client.0.smithi005.stdout:1/614: truncate d2/d1c/d15/d2a/d1a/f3b 4678580 0 2024-04-16T14:35:36.038 INFO:tasks.workunit.client.0.smithi005.stdout:1/615: chown d2/d1c/d15/d2a/d25/f5c 74567505 1 2024-04-16T14:35:36.039 INFO:tasks.workunit.client.0.smithi005.stdout:6/679: creat d2/d3f/d47/d84/dbf/feb x:0 0 0 2024-04-16T14:35:36.042 INFO:tasks.workunit.client.0.smithi005.stdout:1/616: creat d2/fdc x:0 0 0 2024-04-16T14:35:36.043 INFO:tasks.workunit.client.0.smithi005.stdout:6/680: creat d2/d3f/fec x:0 0 0 2024-04-16T14:35:36.044 INFO:tasks.workunit.client.0.smithi005.stdout:3/518: read d2/d9/f55 [1659733,3466] 0 2024-04-16T14:35:36.044 INFO:tasks.workunit.client.0.smithi005.stdout:3/519: readlink d2/d17/l7c 0 2024-04-16T14:35:36.044 INFO:tasks.workunit.client.0.smithi005.stdout:6/681: link d2/d5/d10/d68/fa2 d2/d5/d28/db8/fed 0 2024-04-16T14:35:36.046 INFO:tasks.workunit.client.0.smithi005.stdout:3/520: creat d2/d9/d25/d39/d64/fa9 x:0 0 0 2024-04-16T14:35:36.046 INFO:tasks.workunit.client.0.smithi005.stdout:3/521: write d2/fe [228688,19411] 0 2024-04-16T14:35:36.046 INFO:tasks.workunit.client.0.smithi005.stdout:3/522: chown d2/d9/d25/l34 14344120 1 2024-04-16T14:35:36.046 INFO:tasks.workunit.client.0.smithi005.stdout:3/523: stat d2/d17/d46/d75/d41/c6c 0 2024-04-16T14:35:36.053 INFO:tasks.workunit.client.1.smithi115.stdout:5/251: dwrite dc/f34 [0,4194304] 0 2024-04-16T14:35:36.053 INFO:tasks.workunit.client.1.smithi115.stdout:5/252: truncate dc/f2c 1014110 0 2024-04-16T14:35:36.054 INFO:tasks.workunit.client.0.smithi005.stdout:3/524: read d2/d17/d46/d47/f62 [162796,16122] 0 2024-04-16T14:35:36.054 INFO:tasks.workunit.client.0.smithi005.stdout:3/525: dread - d2/d9/d25/d39/f6a zero size 2024-04-16T14:35:36.054 INFO:tasks.workunit.client.0.smithi005.stdout:7/634: dwrite d1/dc/d2f/f4c [0,4194304] 0 2024-04-16T14:35:36.054 INFO:tasks.workunit.client.0.smithi005.stdout:7/635: read - d1/d49/d74/d77/d22/da9/fca zero size 2024-04-16T14:35:36.054 INFO:tasks.workunit.client.0.smithi005.stdout:7/636: chown d1/d49/d74/d77/d22/d27/d2e/ld4 745456 1 2024-04-16T14:35:36.055 INFO:tasks.workunit.client.1.smithi115.stdout:9/346: dwrite d1/d6/d2d/f1f [0,4194304] 0 2024-04-16T14:35:36.055 INFO:tasks.workunit.client.0.smithi005.stdout:3/526: mkdir d2/d9/df/daa 0 2024-04-16T14:35:36.056 INFO:tasks.workunit.client.0.smithi005.stdout:4/807: dwrite d0/d47/fae [4194304,4194304] 0 2024-04-16T14:35:36.056 INFO:tasks.workunit.client.0.smithi005.stdout:4/808: chown d0/d4d/l68 23150 1 2024-04-16T14:35:36.057 INFO:tasks.workunit.client.0.smithi005.stdout:7/637: link d1/d49/d74/d77/d22/da0/fb2 d1/d49/d74/d77/d22/d27/fd7 0 2024-04-16T14:35:36.059 INFO:tasks.workunit.client.0.smithi005.stdout:4/809: creat d0/d1b/d1d/d1f/d48/dab/ffd x:0 0 0 2024-04-16T14:35:36.059 INFO:tasks.workunit.client.0.smithi005.stdout:4/810: chown d0/d22/d61/c87 13 1 2024-04-16T14:35:36.059 INFO:tasks.workunit.client.1.smithi115.stdout:3/326: sync 2024-04-16T14:35:36.061 INFO:tasks.workunit.client.0.smithi005.stdout:7/638: symlink d1/d49/d74/d77/d22/d27/ld8 0 2024-04-16T14:35:36.062 INFO:tasks.workunit.client.0.smithi005.stdout:7/639: write d1/dc/d2f/f83 [946861,66683] 0 2024-04-16T14:35:36.062 INFO:tasks.workunit.client.0.smithi005.stdout:7/640: write d1/d49/d74/d77/d22/da9/fca [15786,5509] 0 2024-04-16T14:35:36.064 INFO:tasks.workunit.client.0.smithi005.stdout:6/682: dwrite d2/d3f/d47/d84/da5/fe3 [0,4194304] 0 2024-04-16T14:35:36.064 INFO:tasks.workunit.client.0.smithi005.stdout:3/527: dread d2/d9/f35 [0,4194304] 0 2024-04-16T14:35:36.069 INFO:tasks.workunit.client.0.smithi005.stdout:6/683: rename d2/d3f/d47/f41 to d2/d3f/d47/fee 0 2024-04-16T14:35:36.069 INFO:tasks.workunit.client.0.smithi005.stdout:6/684: chown d2/d5/d10/dd6/d7a/ld3 1740071219 1 2024-04-16T14:35:36.070 INFO:tasks.workunit.client.0.smithi005.stdout:6/685: rmdir d2/d20/d72 39 2024-04-16T14:35:36.070 INFO:tasks.workunit.client.0.smithi005.stdout:6/686: chown d2/d5/f37 651 1 2024-04-16T14:35:36.070 INFO:tasks.workunit.client.0.smithi005.stdout:6/687: chown d2/d5/l65 823588784 1 2024-04-16T14:35:36.072 INFO:tasks.workunit.client.0.smithi005.stdout:4/811: dread d0/f19 [4194304,4194304] 0 2024-04-16T14:35:36.074 INFO:tasks.workunit.client.0.smithi005.stdout:4/812: creat d0/d1b/d1d/d1f/ffe x:0 0 0 2024-04-16T14:35:36.075 INFO:tasks.workunit.client.0.smithi005.stdout:4/813: chown d0/d1b/d1d/d1f/d5d/lb9 26068329 1 2024-04-16T14:35:36.076 INFO:tasks.workunit.client.0.smithi005.stdout:4/814: mknod d0/d1b/d1d/dde/cff 0 2024-04-16T14:35:36.076 INFO:tasks.workunit.client.0.smithi005.stdout:4/815: stat d0/d1b/d1d/d1f/d48/f8b 0 2024-04-16T14:35:36.076 INFO:tasks.workunit.client.0.smithi005.stdout:4/816: dread - d0/d1b/d1d/d1f/d5d/fd5 zero size 2024-04-16T14:35:36.076 INFO:tasks.workunit.client.0.smithi005.stdout:4/817: fdatasync d0/d1b/d1d/d1f/d3e/f5e 0 2024-04-16T14:35:36.077 INFO:tasks.workunit.client.0.smithi005.stdout:4/818: chown d0/d1b/d1d/d1f/ffe 37595 1 2024-04-16T14:35:36.077 INFO:tasks.workunit.client.0.smithi005.stdout:4/819: readlink d0/lc 0 2024-04-16T14:35:36.077 INFO:tasks.workunit.client.0.smithi005.stdout:7/641: write d1/d49/d74/d77/d22/d27/f44 [3397249,96141] 0 2024-04-16T14:35:36.080 INFO:tasks.workunit.client.0.smithi005.stdout:7/642: creat d1/d49/d74/d77/d22/d27/fd9 x:0 0 0 2024-04-16T14:35:36.080 INFO:tasks.workunit.client.0.smithi005.stdout:7/643: chown d1/dc/d2f/d4f/c70 124 1 2024-04-16T14:35:36.082 INFO:tasks.workunit.client.0.smithi005.stdout:8/556: rename d5/d7b/da8/db7/d8a/da1/l6e to d5/d7b/da8/db7/d74/lc8 0 2024-04-16T14:35:36.083 INFO:tasks.workunit.client.0.smithi005.stdout:7/644: getdents d1/d49/d74/d77/d57 0 2024-04-16T14:35:36.084 INFO:tasks.workunit.client.0.smithi005.stdout:4/820: dread d0/f10 [0,4194304] 0 2024-04-16T14:35:36.088 INFO:tasks.workunit.client.1.smithi115.stdout:9/347: dwrite d1/d6/d2d/d4b/f5a [0,4194304] 0 2024-04-16T14:35:36.088 INFO:tasks.workunit.client.0.smithi005.stdout:3/528: write d2/d17/d46/d75/d41/f65 [1374901,124633] 0 2024-04-16T14:35:36.090 INFO:tasks.workunit.client.1.smithi115.stdout:9/348: creat d1/d6/d33/f6f x:0 0 0 2024-04-16T14:35:36.093 INFO:tasks.workunit.client.0.smithi005.stdout:4/821: dread d0/d1b/d1d/d1f/d3e/f55 [4194304,4194304] 0 2024-04-16T14:35:36.093 INFO:tasks.workunit.client.1.smithi115.stdout:9/349: unlink d1/d6/d33/f38 0 2024-04-16T14:35:36.094 INFO:tasks.workunit.client.1.smithi115.stdout:5/253: dwrite dc/d15/f24 [0,4194304] 0 2024-04-16T14:35:36.094 INFO:tasks.workunit.client.1.smithi115.stdout:5/254: creat dc/d3d/d41/f54 x:0 0 0 2024-04-16T14:35:36.094 INFO:tasks.workunit.client.1.smithi115.stdout:9/350: symlink d1/d6/d2d/d4b/d6c/l70 0 2024-04-16T14:35:36.095 INFO:tasks.workunit.client.1.smithi115.stdout:9/351: write f0 [3590625,129549] 0 2024-04-16T14:35:36.097 INFO:tasks.workunit.client.0.smithi005.stdout:8/557: write d5/d7b/f33 [7124831,62682] 0 2024-04-16T14:35:36.098 INFO:tasks.workunit.client.1.smithi115.stdout:9/352: creat d1/d6/d2d/f71 x:0 0 0 2024-04-16T14:35:36.101 INFO:tasks.workunit.client.1.smithi115.stdout:5/255: symlink dc/d15/l55 0 2024-04-16T14:35:36.101 INFO:tasks.workunit.client.1.smithi115.stdout:5/256: creat dc/f56 x:0 0 0 2024-04-16T14:35:36.102 INFO:tasks.workunit.client.1.smithi115.stdout:9/353: symlink d1/d6/d2d/d4b/d6c/d20/l72 0 2024-04-16T14:35:36.104 INFO:tasks.workunit.client.0.smithi005.stdout:7/645: creat d1/d49/d74/d77/d57/d47/daa/fda x:0 0 0 2024-04-16T14:35:36.104 INFO:tasks.workunit.client.0.smithi005.stdout:7/646: dread - d1/d49/d74/d77/d22/d27/fd9 zero size 2024-04-16T14:35:36.105 INFO:tasks.workunit.client.1.smithi115.stdout:9/354: symlink d1/d6/d2d/d3d/d49/l73 0 2024-04-16T14:35:36.118 INFO:tasks.workunit.client.0.smithi005.stdout:4/822: dwrite d0/d1b/d1d/d1f/d5d/da9/f3b [0,4194304] 0 2024-04-16T14:35:36.120 INFO:tasks.workunit.client.0.smithi005.stdout:4/823: dread d0/f4c [0,4194304] 0 2024-04-16T14:35:36.124 INFO:tasks.workunit.client.0.smithi005.stdout:3/529: unlink d2/d9/d25/d39/d64/l69 0 2024-04-16T14:35:36.125 INFO:tasks.workunit.client.1.smithi115.stdout:9/355: dwrite d1/d6/d29/f5d [0,4194304] 0 2024-04-16T14:35:36.126 INFO:tasks.workunit.client.1.smithi115.stdout:9/356: stat d1/d6/f17 0 2024-04-16T14:35:36.127 INFO:tasks.workunit.client.1.smithi115.stdout:5/257: dwrite dc/f2c [0,4194304] 0 2024-04-16T14:35:36.128 INFO:tasks.workunit.client.1.smithi115.stdout:9/357: write d1/f3 [1582272,87344] 0 2024-04-16T14:35:36.143 INFO:tasks.workunit.client.1.smithi115.stdout:5/258: dwrite dc/f2b [4194304,4194304] 0 2024-04-16T14:35:36.143 INFO:tasks.workunit.client.1.smithi115.stdout:5/259: fdatasync dc/d15/f3e 0 2024-04-16T14:35:36.145 INFO:tasks.workunit.client.1.smithi115.stdout:5/260: mknod dc/c57 0 2024-04-16T14:35:36.150 INFO:tasks.workunit.client.1.smithi115.stdout:5/261: rename l6 to dc/d3d/l58 0 2024-04-16T14:35:36.150 INFO:tasks.workunit.client.1.smithi115.stdout:5/262: mknod dc/d15/d4d/c59 0 2024-04-16T14:35:36.150 INFO:tasks.workunit.client.1.smithi115.stdout:5/263: fsync dc/f26 0 2024-04-16T14:35:36.150 INFO:tasks.workunit.client.1.smithi115.stdout:5/264: creat dc/d3d/f5a x:0 0 0 2024-04-16T14:35:36.151 INFO:tasks.workunit.client.1.smithi115.stdout:5/265: symlink dc/d15/d35/l5b 0 2024-04-16T14:35:36.152 INFO:tasks.workunit.client.1.smithi115.stdout:4/294: sync 2024-04-16T14:35:36.155 INFO:tasks.workunit.client.1.smithi115.stdout:5/266: dread dc/d3d/f42 [0,4194304] 0 2024-04-16T14:35:36.158 INFO:tasks.workunit.client.1.smithi115.stdout:5/267: mknod dc/d3d/d41/c5c 0 2024-04-16T14:35:36.168 INFO:tasks.workunit.client.1.smithi115.stdout:5/268: read dc/d15/f31 [4127603,27442] 0 2024-04-16T14:35:36.170 INFO:tasks.workunit.client.1.smithi115.stdout:4/295: dwrite d1/d15/d31/f45 [4194304,4194304] 0 2024-04-16T14:35:36.172 INFO:tasks.workunit.client.1.smithi115.stdout:4/296: rmdir d1/d15/d1e 39 2024-04-16T14:35:36.174 INFO:tasks.workunit.client.1.smithi115.stdout:4/297: unlink d1/f37 0 2024-04-16T14:35:36.174 INFO:tasks.workunit.client.0.smithi005.stdout:5/530: rename d0/d6/d12/d34/d8d/d5e/d74 to d0/d70/db3 0 2024-04-16T14:35:36.175 INFO:tasks.workunit.client.1.smithi115.stdout:4/298: truncate d1/d2/f8 1485939 0 2024-04-16T14:35:36.176 INFO:tasks.workunit.client.0.smithi005.stdout:4/824: mkdir d0/d1b/db7/d100 0 2024-04-16T14:35:36.177 INFO:tasks.workunit.client.0.smithi005.stdout:3/530: symlink d2/d9/d25/d39/lab 0 2024-04-16T14:35:36.177 INFO:tasks.workunit.client.0.smithi005.stdout:3/531: creat d2/d92/fac x:0 0 0 2024-04-16T14:35:36.181 INFO:tasks.workunit.client.1.smithi115.stdout:5/269: write dc/f3b [1350375,92837] 0 2024-04-16T14:35:36.184 INFO:tasks.workunit.client.1.smithi115.stdout:5/270: write dc/f12 [749342,390] 0 2024-04-16T14:35:36.184 INFO:tasks.workunit.client.1.smithi115.stdout:5/271: write dc/d15/f19 [5242688,45254] 0 2024-04-16T14:35:36.186 INFO:tasks.workunit.client.1.smithi115.stdout:5/272: mkdir dc/d5d 0 2024-04-16T14:35:36.194 INFO:tasks.workunit.client.1.smithi115.stdout:4/299: dwrite d1/d15/d31/f44 [0,4194304] 0 2024-04-16T14:35:36.202 INFO:tasks.workunit.client.0.smithi005.stdout:5/531: dwrite d0/d6/f54 [0,4194304] 0 2024-04-16T14:35:36.202 INFO:tasks.workunit.client.0.smithi005.stdout:5/532: fdatasync d0/d6/d12/d1c/d81/d82/f88 0 2024-04-16T14:35:36.203 INFO:tasks.workunit.client.0.smithi005.stdout:3/532: mknod d2/d9/df/cad 0 2024-04-16T14:35:36.203 INFO:tasks.workunit.client.0.smithi005.stdout:3/533: write d2/d9/d7d/fa5 [766341,64368] 0 2024-04-16T14:35:36.205 INFO:tasks.workunit.client.1.smithi115.stdout:5/273: dwrite dc/f21 [0,4194304] 0 2024-04-16T14:35:36.206 INFO:tasks.workunit.client.1.smithi115.stdout:5/274: fsync dc/f26 0 2024-04-16T14:35:36.208 INFO:tasks.workunit.client.0.smithi005.stdout:5/533: creat d0/fb4 x:0 0 0 2024-04-16T14:35:36.210 INFO:tasks.workunit.client.0.smithi005.stdout:5/534: truncate d0/d6/d12/d34/f49 1364207 0 2024-04-16T14:35:36.211 INFO:tasks.workunit.client.0.smithi005.stdout:5/535: dread - d0/d6/d6e/f7a zero size 2024-04-16T14:35:36.212 INFO:tasks.workunit.client.0.smithi005.stdout:5/536: symlink d0/d6/d6e/d9e/da9/lb5 0 2024-04-16T14:35:36.215 INFO:tasks.workunit.client.1.smithi115.stdout:5/275: dread dc/f21 [0,4194304] 0 2024-04-16T14:35:36.215 INFO:tasks.workunit.client.1.smithi115.stdout:5/276: dread - dc/d3d/d41/f54 zero size 2024-04-16T14:35:36.223 INFO:tasks.workunit.client.0.smithi005.stdout:3/534: symlink d2/d9/lae 0 2024-04-16T14:35:36.224 INFO:tasks.workunit.client.0.smithi005.stdout:3/535: stat d2/d9/d51/c8a 0 2024-04-16T14:35:36.225 INFO:tasks.workunit.client.0.smithi005.stdout:3/536: mknod d2/d17/caf 0 2024-04-16T14:35:36.227 INFO:tasks.workunit.client.0.smithi005.stdout:3/537: symlink d2/d9/d25/d39/lb0 0 2024-04-16T14:35:36.227 INFO:tasks.workunit.client.0.smithi005.stdout:3/538: chown d2/d17/d46/d75/d41/d79/fa4 2 1 2024-04-16T14:35:36.228 INFO:tasks.workunit.client.0.smithi005.stdout:3/539: creat d2/d17/d46/d47/fb1 x:0 0 0 2024-04-16T14:35:36.229 INFO:tasks.workunit.client.0.smithi005.stdout:3/540: truncate d2/f71 2571141 0 2024-04-16T14:35:36.230 INFO:tasks.workunit.client.0.smithi005.stdout:3/541: creat d2/d9/d25/d39/d9c/fb2 x:0 0 0 2024-04-16T14:35:36.235 INFO:tasks.workunit.client.0.smithi005.stdout:1/617: rename d2/d1c/d15/d2a/d1a/f44 to d2/d1c/fdd 0 2024-04-16T14:35:36.237 INFO:tasks.workunit.client.0.smithi005.stdout:6/688: rename d2/d5/d10/dd6/d7a/d9d/fe0 to d2/d20/d3c/fef 0 2024-04-16T14:35:36.237 INFO:tasks.workunit.client.0.smithi005.stdout:6/689: write d2/d20/d3c/fef [67907,70314] 0 2024-04-16T14:35:36.238 INFO:tasks.workunit.client.1.smithi115.stdout:5/277: dwrite dc/d15/f17 [8388608,4194304] 0 2024-04-16T14:35:36.238 INFO:tasks.workunit.client.1.smithi115.stdout:5/278: chown dc/d3d/d41 1 1 2024-04-16T14:35:36.238 INFO:tasks.workunit.client.0.smithi005.stdout:1/618: creat d2/d1c/d15/d2a/d19/d20/fde x:0 0 0 2024-04-16T14:35:36.238 INFO:tasks.workunit.client.0.smithi005.stdout:1/619: readlink d2/d1c/d15/d2a/d19/d42/d71/dac/d99/ld0 0 2024-04-16T14:35:36.240 INFO:tasks.workunit.client.0.smithi005.stdout:6/690: mkdir d2/de1/df0 0 2024-04-16T14:35:36.240 INFO:tasks.workunit.client.0.smithi005.stdout:6/691: write d2/d3f/d53/d54/db5/fdb [422877,51949] 0 2024-04-16T14:35:36.240 INFO:tasks.workunit.client.1.smithi115.stdout:5/279: rename dc/d15/d35/f39 to dc/d3d/f5e 0 2024-04-16T14:35:36.242 INFO:tasks.workunit.client.0.smithi005.stdout:1/620: mkdir d2/d1c/d15/d2a/d19/d42/d71/dac/ddf 0 2024-04-16T14:35:36.243 INFO:tasks.workunit.client.0.smithi005.stdout:8/558: creat d5/d7b/da8/db7/d8a/da1/fc9 x:0 0 0 2024-04-16T14:35:36.244 INFO:tasks.workunit.client.0.smithi005.stdout:1/621: mkdir d2/d1c/d15/d2a/d19/dc9/de0 0 2024-04-16T14:35:36.249 INFO:tasks.workunit.client.0.smithi005.stdout:1/622: creat d2/d1c/d15/d2a/d1a/d21/fe1 x:0 0 0 2024-04-16T14:35:36.250 INFO:tasks.workunit.client.0.smithi005.stdout:6/692: write d2/d5/d28/f46 [1034012,24336] 0 2024-04-16T14:35:36.251 INFO:tasks.workunit.client.0.smithi005.stdout:1/623: creat d2/d2c/d85/dab/d51/dc4/fe2 x:0 0 0 2024-04-16T14:35:36.254 INFO:tasks.workunit.client.0.smithi005.stdout:6/693: mkdir d2/d3f/d47/d84/da5/df1 0 2024-04-16T14:35:36.256 INFO:tasks.workunit.client.0.smithi005.stdout:5/537: rename d0/d6/d12/d34/d30/l66 to d0/d6/d12/lb6 0 2024-04-16T14:35:36.256 INFO:tasks.workunit.client.0.smithi005.stdout:5/538: chown d0/d70/f96 34602216 1 2024-04-16T14:35:36.258 INFO:tasks.workunit.client.0.smithi005.stdout:6/694: unlink d2/d5/d10/dd6/d7a/faf 0 2024-04-16T14:35:36.258 INFO:tasks.workunit.client.0.smithi005.stdout:7/647: rmdir d1/d49/d74/d77/d22/d27/d3a 39 2024-04-16T14:35:36.258 INFO:tasks.workunit.client.0.smithi005.stdout:7/648: write d1/d49/d74/d77/d57/d47/f90 [350409,100469] 0 2024-04-16T14:35:36.259 INFO:tasks.workunit.client.1.smithi115.stdout:5/280: dwrite dc/d15/f31 [0,4194304] 0 2024-04-16T14:35:36.259 INFO:tasks.workunit.client.1.smithi115.stdout:5/281: chown dc/d15/f17 1 1 2024-04-16T14:35:36.260 INFO:tasks.workunit.client.0.smithi005.stdout:7/649: symlink d1/d85/d96/ldb 0 2024-04-16T14:35:36.261 INFO:tasks.workunit.client.1.smithi115.stdout:5/282: rename dc/d15/d2d/f4a to dc/d15/f5f 0 2024-04-16T14:35:36.261 INFO:tasks.workunit.client.1.smithi115.stdout:5/283: readlink dc/d15/l25 0 2024-04-16T14:35:36.261 INFO:tasks.workunit.client.0.smithi005.stdout:7/650: rename d1/d49/d74/d77/d22/d27/f46 to d1/d49/d74/fdc 0 2024-04-16T14:35:36.263 INFO:tasks.workunit.client.0.smithi005.stdout:1/624: write d2/d1c/d15/d6f/f8d [3049228,123428] 0 2024-04-16T14:35:36.263 INFO:tasks.workunit.client.0.smithi005.stdout:7/651: link d1/d49/d74/d77/d22/d27/ld8 d1/d85/ldd 0 2024-04-16T14:35:36.266 INFO:tasks.workunit.client.0.smithi005.stdout:8/559: dwrite d5/d7b/da8/db7/d8a/da1/d3d/f87 [0,4194304] 0 2024-04-16T14:35:36.268 INFO:tasks.workunit.client.0.smithi005.stdout:3/542: getdents d2/d17 0 2024-04-16T14:35:36.268 INFO:tasks.workunit.client.0.smithi005.stdout:3/543: readlink d2/d17/d46/l52 0 2024-04-16T14:35:36.268 INFO:tasks.workunit.client.0.smithi005.stdout:3/544: chown d2/f2b 10662991 1 2024-04-16T14:35:36.268 INFO:tasks.workunit.client.0.smithi005.stdout:3/545: write d2/d17/d46/f57 [425142,95561] 0 2024-04-16T14:35:36.269 INFO:tasks.workunit.client.0.smithi005.stdout:6/695: write d2/d5/d10/dd6/fa6 [1629737,71632] 0 2024-04-16T14:35:36.269 INFO:tasks.workunit.client.0.smithi005.stdout:6/696: readlink d2/d20/d72/l93 0 2024-04-16T14:35:36.269 INFO:tasks.workunit.client.0.smithi005.stdout:6/697: fdatasync d2/f26 0 2024-04-16T14:35:36.270 INFO:tasks.workunit.client.0.smithi005.stdout:6/698: fdatasync d2/df/f32 0 2024-04-16T14:35:36.270 INFO:tasks.workunit.client.0.smithi005.stdout:6/699: chown d2/d5/d10/d68/f73 179285 1 2024-04-16T14:35:36.272 INFO:tasks.workunit.client.0.smithi005.stdout:5/539: dread d0/d6/d12/f14 [0,4194304] 0 2024-04-16T14:35:36.272 INFO:tasks.workunit.client.0.smithi005.stdout:8/560: rename d5/d40/fa2 to d5/d40/d8e/fca 0 2024-04-16T14:35:36.272 INFO:tasks.workunit.client.0.smithi005.stdout:8/561: dread - d5/d7b/da8/da5/fa6 zero size 2024-04-16T14:35:36.272 INFO:tasks.workunit.client.0.smithi005.stdout:8/562: dread - d5/d11/d6c/faa zero size 2024-04-16T14:35:36.272 INFO:tasks.workunit.client.0.smithi005.stdout:8/563: chown d5/d7b/l2e 120936511 1 2024-04-16T14:35:36.277 INFO:tasks.workunit.client.0.smithi005.stdout:6/700: symlink d2/d5/d28/lf2 0 2024-04-16T14:35:36.278 INFO:tasks.workunit.client.0.smithi005.stdout:6/701: chown d2/d5/d28/c58 20604 1 2024-04-16T14:35:36.282 INFO:tasks.workunit.client.1.smithi115.stdout:5/284: dwrite dc/d15/f5f [0,4194304] 0 2024-04-16T14:35:36.284 INFO:tasks.workunit.client.0.smithi005.stdout:5/540: link d0/ca d0/d6/d12/d34/d42/cb7 0 2024-04-16T14:35:36.286 INFO:tasks.workunit.client.0.smithi005.stdout:5/541: mkdir d0/d6/d6e/db8 0 2024-04-16T14:35:36.286 INFO:tasks.workunit.client.0.smithi005.stdout:5/542: chown d0/d6/d12/d1c/l44 403527939 1 2024-04-16T14:35:36.286 INFO:tasks.workunit.client.0.smithi005.stdout:5/543: chown d0/d70/fa7 692076 1 2024-04-16T14:35:36.286 INFO:tasks.workunit.client.0.smithi005.stdout:5/544: chown d0/d6/l2f 55081025 1 2024-04-16T14:35:36.286 INFO:tasks.workunit.client.0.smithi005.stdout:5/545: creat d0/d6/d6e/fb9 x:0 0 0 2024-04-16T14:35:36.288 INFO:tasks.workunit.client.1.smithi115.stdout:5/285: rename dc/d15/f2f to dc/d15/d2d/f60 0 2024-04-16T14:35:36.288 INFO:tasks.workunit.client.1.smithi115.stdout:5/286: chown dc/d15/l1e 133051 1 2024-04-16T14:35:36.288 INFO:tasks.workunit.client.1.smithi115.stdout:5/287: fsync dc/d15/d35/f48 0 2024-04-16T14:35:36.289 INFO:tasks.workunit.client.1.smithi115.stdout:5/288: read - dc/d3d/d41/f54 zero size 2024-04-16T14:35:36.289 INFO:tasks.workunit.client.1.smithi115.stdout:5/289: chown dc/c49 917 1 2024-04-16T14:35:36.289 INFO:tasks.workunit.client.1.smithi115.stdout:5/290: mknod dc/d3d/d41/c61 0 2024-04-16T14:35:36.292 INFO:tasks.workunit.client.1.smithi115.stdout:5/291: mknod dc/d15/c62 0 2024-04-16T14:35:36.293 INFO:tasks.workunit.client.1.smithi115.stdout:5/292: dread dc/d3d/f42 [0,4194304] 0 2024-04-16T14:35:36.294 INFO:tasks.workunit.client.0.smithi005.stdout:6/702: dwrite d2/d3f/d53/f88 [0,4194304] 0 2024-04-16T14:35:36.294 INFO:tasks.workunit.client.0.smithi005.stdout:6/703: read - d2/d5/d10/fde zero size 2024-04-16T14:35:36.294 INFO:tasks.workunit.client.0.smithi005.stdout:6/704: chown d2/d20/d3c/dcf/c97 46 1 2024-04-16T14:35:36.294 INFO:tasks.workunit.client.0.smithi005.stdout:7/652: dwrite d1/d49/d74/d77/d22/d27/f45 [0,4194304] 0 2024-04-16T14:35:36.295 INFO:tasks.workunit.client.1.smithi115.stdout:5/293: mknod dc/d15/d2d/c63 0 2024-04-16T14:35:36.295 INFO:tasks.workunit.client.0.smithi005.stdout:5/546: dread d0/f52 [0,4194304] 0 2024-04-16T14:35:36.295 INFO:tasks.workunit.client.0.smithi005.stdout:5/547: chown d0/d6/d12 33 1 2024-04-16T14:35:36.296 INFO:tasks.workunit.client.0.smithi005.stdout:6/705: mknod d2/d20/d3c/cf3 0 2024-04-16T14:35:36.296 INFO:tasks.workunit.client.0.smithi005.stdout:6/706: read d2/d45/d7b/f82 [17948,55100] 0 2024-04-16T14:35:36.296 INFO:tasks.workunit.client.0.smithi005.stdout:6/707: chown d2/d5/d10/fde 27966693 1 2024-04-16T14:35:36.297 INFO:tasks.workunit.client.0.smithi005.stdout:5/548: mkdir d0/d6/d12/d1c/d1e/d73/dba 0 2024-04-16T14:35:36.297 INFO:tasks.workunit.client.0.smithi005.stdout:5/549: readlink d0/d6/d12/l89 0 2024-04-16T14:35:36.298 INFO:tasks.workunit.client.1.smithi115.stdout:5/294: truncate dc/d15/f5f 362420 0 2024-04-16T14:35:36.298 INFO:tasks.workunit.client.0.smithi005.stdout:6/708: mknod d2/d3f/d47/d84/cf4 0 2024-04-16T14:35:36.298 INFO:tasks.workunit.client.0.smithi005.stdout:6/709: chown d2/d5/d10/dd6/d7a/dbc 0 1 2024-04-16T14:35:36.299 INFO:tasks.workunit.client.0.smithi005.stdout:5/550: mknod d0/d6/d6e/cbb 0 2024-04-16T14:35:36.299 INFO:tasks.workunit.client.0.smithi005.stdout:5/551: dread - d0/d70/f96 zero size 2024-04-16T14:35:36.300 INFO:tasks.workunit.client.0.smithi005.stdout:6/710: rename d2/d3f/d47/d84/fc2 to d2/d20/d33/ff5 0 2024-04-16T14:35:36.301 INFO:tasks.workunit.client.0.smithi005.stdout:6/711: stat d2/d5/f22 0 2024-04-16T14:35:36.301 INFO:tasks.workunit.client.0.smithi005.stdout:5/552: rmdir d0/d6/d12 39 2024-04-16T14:35:36.303 INFO:tasks.workunit.client.0.smithi005.stdout:6/712: mknod d2/d20/d33/d64/cf6 0 2024-04-16T14:35:36.303 INFO:tasks.workunit.client.0.smithi005.stdout:6/713: chown d2/d3f/d47/f83 836760 1 2024-04-16T14:35:36.306 INFO:tasks.workunit.client.0.smithi005.stdout:5/553: creat d0/d6/d12/d34/d8d/d5e/fbc x:0 0 0 2024-04-16T14:35:36.306 INFO:tasks.workunit.client.0.smithi005.stdout:5/554: truncate d0/d70/fa7 1034248 0 2024-04-16T14:35:36.308 INFO:tasks.workunit.client.0.smithi005.stdout:5/555: link d0/d6/f4f d0/d70/fbd 0 2024-04-16T14:35:36.308 INFO:tasks.workunit.client.0.smithi005.stdout:5/556: chown d0/d70/l80 13 1 2024-04-16T14:35:36.310 INFO:tasks.workunit.client.0.smithi005.stdout:6/714: write d2/d45/d7b/db2/fbb [2904912,79648] 0 2024-04-16T14:35:36.312 INFO:tasks.workunit.client.0.smithi005.stdout:6/715: mknod d2/d3f/d53/d54/db5/cf7 0 2024-04-16T14:35:36.312 INFO:tasks.workunit.client.1.smithi115.stdout:7/272: sync 2024-04-16T14:35:36.312 INFO:tasks.workunit.client.1.smithi115.stdout:8/281: sync 2024-04-16T14:35:36.312 INFO:tasks.workunit.client.1.smithi115.stdout:8/282: chown d0/db/d10/d17/d22 519858 1 2024-04-16T14:35:36.312 INFO:tasks.workunit.client.0.smithi005.stdout:6/716: mkdir d2/d3f/d47/d84/da5/df1/df8 0 2024-04-16T14:35:36.312 INFO:tasks.workunit.client.0.smithi005.stdout:6/717: chown d2/d45/d7b/db2/fbb 6785709 1 2024-04-16T14:35:36.313 INFO:tasks.workunit.client.0.smithi005.stdout:6/718: mkdir d2/d20/df9 0 2024-04-16T14:35:36.314 INFO:tasks.workunit.client.1.smithi115.stdout:7/273: creat d0/d1/d3b/f60 x:0 0 0 2024-04-16T14:35:36.314 INFO:tasks.workunit.client.0.smithi005.stdout:6/719: rmdir d2/d3f/d53/dba 39 2024-04-16T14:35:36.315 INFO:tasks.workunit.client.1.smithi115.stdout:7/274: unlink d0/d2/l14 0 2024-04-16T14:35:36.316 INFO:tasks.workunit.client.1.smithi115.stdout:7/275: creat d0/d24/f61 x:0 0 0 2024-04-16T14:35:36.316 INFO:tasks.workunit.client.1.smithi115.stdout:7/276: readlink d0/d2/l1d 0 2024-04-16T14:35:36.318 INFO:tasks.workunit.client.1.smithi115.stdout:7/277: stat d0/l8 0 2024-04-16T14:35:36.318 INFO:tasks.workunit.client.0.smithi005.stdout:6/720: dread d2/d5/d10/dd6/f80 [0,4194304] 0 2024-04-16T14:35:36.318 INFO:tasks.workunit.client.1.smithi115.stdout:7/278: mknod d0/d1/d3b/d3f/c62 0 2024-04-16T14:35:36.319 INFO:tasks.workunit.client.0.smithi005.stdout:6/721: creat d2/d20/df9/ffa x:0 0 0 2024-04-16T14:35:36.319 INFO:tasks.workunit.client.0.smithi005.stdout:6/722: chown d2/d5/d10/d68/c8a 1451044 1 2024-04-16T14:35:36.320 INFO:tasks.workunit.client.1.smithi115.stdout:7/279: symlink d0/d1/d3b/d5a/l63 0 2024-04-16T14:35:36.320 INFO:tasks.workunit.client.0.smithi005.stdout:7/653: dwrite d1/d85/fbf [0,4194304] 0 2024-04-16T14:35:36.320 INFO:tasks.workunit.client.0.smithi005.stdout:7/654: chown d1/dc/f7e 138837069 1 2024-04-16T14:35:36.320 INFO:tasks.workunit.client.0.smithi005.stdout:6/723: mknod d2/d20/df9/cfb 0 2024-04-16T14:35:36.321 INFO:tasks.workunit.client.1.smithi115.stdout:7/280: mkdir d0/d24/d2b/d64 0 2024-04-16T14:35:36.323 INFO:tasks.workunit.client.1.smithi115.stdout:8/283: dread d0/db/f15 [0,4194304] 0 2024-04-16T14:35:36.323 INFO:tasks.workunit.client.1.smithi115.stdout:8/284: write d0/db/d10/d25/d2d/f45 [18695,67648] 0 2024-04-16T14:35:36.323 INFO:tasks.workunit.client.0.smithi005.stdout:7/655: rename d1/d49/d74/c89 to d1/d49/d74/d77/d22/d27/d3a/d5c/cde 0 2024-04-16T14:35:36.324 INFO:tasks.workunit.client.1.smithi115.stdout:8/285: rmdir d0/db/d10/d17/d2c 39 2024-04-16T14:35:36.324 INFO:tasks.workunit.client.0.smithi005.stdout:6/724: truncate d2/d20/d33/f63 1646118 0 2024-04-16T14:35:36.325 INFO:tasks.workunit.client.0.smithi005.stdout:6/725: fsync d2/d45/d7b/f86 0 2024-04-16T14:35:36.325 INFO:tasks.workunit.client.0.smithi005.stdout:6/726: chown d2/d3f/d53/f88 69667 1 2024-04-16T14:35:36.325 INFO:tasks.workunit.client.0.smithi005.stdout:7/656: read d1/d49/d74/d77/d22/da0/fa7 [481074,186] 0 2024-04-16T14:35:36.325 INFO:tasks.workunit.client.1.smithi115.stdout:5/295: dwrite dc/d15/f53 [0,4194304] 0 2024-04-16T14:35:36.325 INFO:tasks.workunit.client.1.smithi115.stdout:8/286: creat d0/db/d10/d25/d2d/d3b/f54 x:0 0 0 2024-04-16T14:35:36.326 INFO:tasks.workunit.client.0.smithi005.stdout:6/727: read d2/d5/d10/f5a [410139,21250] 0 2024-04-16T14:35:36.327 INFO:tasks.workunit.client.0.smithi005.stdout:7/657: mkdir d1/d49/d74/ddf 0 2024-04-16T14:35:36.328 INFO:tasks.workunit.client.1.smithi115.stdout:5/296: mknod dc/d15/d35/c64 0 2024-04-16T14:35:36.330 INFO:tasks.workunit.client.0.smithi005.stdout:7/658: rmdir d1/d82 39 2024-04-16T14:35:36.331 INFO:tasks.workunit.client.1.smithi115.stdout:5/297: link dc/d3d/f5a dc/f65 0 2024-04-16T14:35:36.332 INFO:tasks.workunit.client.1.smithi115.stdout:7/281: getdents d0/d24 0 2024-04-16T14:35:36.335 INFO:tasks.workunit.client.1.smithi115.stdout:7/282: rmdir d0/d2/d3a/d59 0 2024-04-16T14:35:36.335 INFO:tasks.workunit.client.1.smithi115.stdout:7/283: fdatasync d0/d2/d3a/d30/f32 0 2024-04-16T14:35:36.335 INFO:tasks.workunit.client.1.smithi115.stdout:7/284: dread - d0/d1/d3b/d3e/f54 zero size 2024-04-16T14:35:36.335 INFO:tasks.workunit.client.1.smithi115.stdout:7/285: truncate d0/d1/d3b/d3e/f5c 740887 0 2024-04-16T14:35:36.337 INFO:tasks.workunit.client.0.smithi005.stdout:5/557: dwrite d0/d6/f54 [0,4194304] 0 2024-04-16T14:35:36.339 INFO:tasks.workunit.client.0.smithi005.stdout:5/558: symlink d0/d6/d6e/d9e/lbe 0 2024-04-16T14:35:36.347 INFO:tasks.workunit.client.1.smithi115.stdout:8/287: dread d0/db/f15 [0,4194304] 0 2024-04-16T14:35:36.347 INFO:tasks.workunit.client.1.smithi115.stdout:8/288: chown d0/db/f24 10 1 2024-04-16T14:35:36.369 INFO:tasks.workunit.client.1.smithi115.stdout:7/286: dwrite d0/f36 [4194304,4194304] 0 2024-04-16T14:35:36.372 INFO:tasks.workunit.client.1.smithi115.stdout:7/287: dread d0/d1/f34 [0,4194304] 0 2024-04-16T14:35:36.372 INFO:tasks.workunit.client.1.smithi115.stdout:7/288: chown d0/c3d 893350 1 2024-04-16T14:35:36.373 INFO:tasks.workunit.client.1.smithi115.stdout:7/289: write d0/d1/d3b/d3e/f5f [248238,116064] 0 2024-04-16T14:35:36.373 INFO:tasks.workunit.client.1.smithi115.stdout:7/290: symlink d0/d1/d3b/l65 0 2024-04-16T14:35:36.373 INFO:tasks.workunit.client.1.smithi115.stdout:7/291: unlink d0/d1/f34 0 2024-04-16T14:35:36.375 INFO:tasks.workunit.client.1.smithi115.stdout:7/292: link d0/c23 d0/d1/d3b/d3e/c66 0 2024-04-16T14:35:36.380 INFO:tasks.workunit.client.0.smithi005.stdout:6/728: dwrite f0 [0,4194304] 0 2024-04-16T14:35:36.381 INFO:tasks.workunit.client.0.smithi005.stdout:7/659: dwrite d1/d49/d74/d77/d57/d47/d8d/fac [0,4194304] 0 2024-04-16T14:35:36.381 INFO:tasks.workunit.client.0.smithi005.stdout:7/660: stat d1/dc 0 2024-04-16T14:35:36.381 INFO:tasks.workunit.client.0.smithi005.stdout:5/559: dwrite d0/d6/f75 [0,4194304] 0 2024-04-16T14:35:36.381 INFO:tasks.workunit.client.0.smithi005.stdout:5/560: fdatasync d0/d6/d12/d34/f5a 0 2024-04-16T14:35:36.382 INFO:tasks.workunit.client.1.smithi115.stdout:8/289: dwrite d0/f53 [0,4194304] 0 2024-04-16T14:35:36.382 INFO:tasks.workunit.client.1.smithi115.stdout:8/290: stat d0/db/d10/d25 0 2024-04-16T14:35:36.382 INFO:tasks.workunit.client.1.smithi115.stdout:8/291: creat d0/db/f55 x:0 0 0 2024-04-16T14:35:36.382 INFO:tasks.workunit.client.0.smithi005.stdout:7/661: rename d1/d49/d74/d77/d22/d27/f64 to d1/d49/d74/d77/d57/d47/fe0 0 2024-04-16T14:35:36.382 INFO:tasks.workunit.client.0.smithi005.stdout:7/662: write d1/d49/d74/d77/d22/d27/d3a/f40 [2285090,16183] 0 2024-04-16T14:35:36.383 INFO:tasks.workunit.client.0.smithi005.stdout:6/729: dread d2/d45/f74 [0,4194304] 0 2024-04-16T14:35:36.386 INFO:tasks.workunit.client.0.smithi005.stdout:7/663: mkdir d1/d85/d96/de1 0 2024-04-16T14:35:36.387 INFO:tasks.workunit.client.0.smithi005.stdout:7/664: truncate d1/f29 604821 0 2024-04-16T14:35:36.387 INFO:tasks.workunit.client.0.smithi005.stdout:6/730: write d2/d45/d7b/f86 [4469622,49951] 0 2024-04-16T14:35:36.387 INFO:tasks.workunit.client.0.smithi005.stdout:6/731: chown d2/d3f/d53/d54/db5/cdc 2 1 2024-04-16T14:35:36.387 INFO:tasks.workunit.client.0.smithi005.stdout:6/732: chown d2/d3f/d47/d84/d8c/fce 39 1 2024-04-16T14:35:36.388 INFO:tasks.workunit.client.0.smithi005.stdout:6/733: write d2/d20/f98 [1688769,40784] 0 2024-04-16T14:35:36.388 INFO:tasks.workunit.client.0.smithi005.stdout:6/734: dread - d2/d3f/d53/d54/fe7 zero size 2024-04-16T14:35:36.391 INFO:tasks.workunit.client.0.smithi005.stdout:7/665: symlink d1/d49/d74/d77/d22/da0/le2 0 2024-04-16T14:35:36.391 INFO:tasks.workunit.client.0.smithi005.stdout:6/735: symlink d2/d45/d7b/db2/lfc 0 2024-04-16T14:35:36.391 INFO:tasks.workunit.client.0.smithi005.stdout:6/736: write d2/d5/d28/f38 [4974363,16708] 0 2024-04-16T14:35:36.392 INFO:tasks.workunit.client.0.smithi005.stdout:7/666: symlink d1/d49/d74/d77/d57/d47/d8e/le3 0 2024-04-16T14:35:36.392 INFO:tasks.workunit.client.0.smithi005.stdout:7/667: write d1/dc/f7d [4768355,75002] 0 2024-04-16T14:35:36.392 INFO:tasks.workunit.client.1.smithi115.stdout:8/292: mkdir d0/db/d10/d25/d2d/d3b/d56 0 2024-04-16T14:35:36.392 INFO:tasks.workunit.client.1.smithi115.stdout:8/293: mknod d0/db/d10/d17/d22/c57 0 2024-04-16T14:35:36.392 INFO:tasks.workunit.client.1.smithi115.stdout:8/294: dread - d0/db/f55 zero size 2024-04-16T14:35:36.392 INFO:tasks.workunit.client.1.smithi115.stdout:8/295: creat d0/db/f58 x:0 0 0 2024-04-16T14:35:36.392 INFO:tasks.workunit.client.1.smithi115.stdout:7/293: dwrite d0/d1/d3b/d49/f4d [0,4194304] 0 2024-04-16T14:35:36.392 INFO:tasks.workunit.client.1.smithi115.stdout:8/296: unlink d0/c7 0 2024-04-16T14:35:36.393 INFO:tasks.workunit.client.1.smithi115.stdout:7/294: symlink d0/d2/d3a/l67 0 2024-04-16T14:35:36.393 INFO:tasks.workunit.client.1.smithi115.stdout:7/295: fdatasync d0/d1/d3b/d3e/f54 0 2024-04-16T14:35:36.394 INFO:tasks.workunit.client.0.smithi005.stdout:7/668: unlink d1/d49/d74/d77/d22/d27/d3a/d5c/cde 0 2024-04-16T14:35:36.394 INFO:tasks.workunit.client.0.smithi005.stdout:7/669: write d1/d49/d74/d77/d22/d27/d3a/fb3 [208958,41485] 0 2024-04-16T14:35:36.394 INFO:tasks.workunit.client.0.smithi005.stdout:7/670: creat d1/d49/d74/d77/d57/d47/daa/fe4 x:0 0 0 2024-04-16T14:35:36.395 INFO:tasks.workunit.client.1.smithi115.stdout:8/297: creat d0/db/d44/f59 x:0 0 0 2024-04-16T14:35:36.395 INFO:tasks.workunit.client.1.smithi115.stdout:8/298: write d0/db/d10/d25/d2d/d3b/f54 [519946,60587] 0 2024-04-16T14:35:36.395 INFO:tasks.workunit.client.1.smithi115.stdout:8/299: truncate d0/db/f58 1014281 0 2024-04-16T14:35:36.395 INFO:tasks.workunit.client.1.smithi115.stdout:2/326: sync 2024-04-16T14:35:36.395 INFO:tasks.workunit.client.1.smithi115.stdout:8/300: rmdir d0/db/d10/d17/d2c 39 2024-04-16T14:35:36.396 INFO:tasks.workunit.client.1.smithi115.stdout:2/327: creat d0/d4/d24/d23/f6c x:0 0 0 2024-04-16T14:35:36.398 INFO:tasks.workunit.client.1.smithi115.stdout:7/296: link d0/c15 d0/d2/d3a/c68 0 2024-04-16T14:35:36.400 INFO:tasks.workunit.client.0.smithi005.stdout:5/561: dwrite d0/d70/db3/f9f [0,4194304] 0 2024-04-16T14:35:36.401 INFO:tasks.workunit.client.0.smithi005.stdout:5/562: chown d0/d6/d12/d34/c92 489560 1 2024-04-16T14:35:36.403 INFO:tasks.workunit.client.1.smithi115.stdout:8/301: read d0/db/f1b [1911576,70094] 0 2024-04-16T14:35:36.403 INFO:tasks.workunit.client.0.smithi005.stdout:6/737: dread d2/d45/d7b/f82 [0,4194304] 0 2024-04-16T14:35:36.404 INFO:tasks.workunit.client.0.smithi005.stdout:6/738: read - d2/d5/d10/fde zero size 2024-04-16T14:35:36.404 INFO:tasks.workunit.client.0.smithi005.stdout:6/739: chown d2/d45/d7b/ce5 2040837060 1 2024-04-16T14:35:36.405 INFO:tasks.workunit.client.0.smithi005.stdout:7/671: fdatasync d1/dc/f7d 0 2024-04-16T14:35:36.405 INFO:tasks.workunit.client.0.smithi005.stdout:7/672: chown d1/dc/d2f/f3e 69325 1 2024-04-16T14:35:36.409 INFO:tasks.workunit.client.1.smithi115.stdout:2/328: write d0/d4/d24/d21/d3b/f3f [845405,116975] 0 2024-04-16T14:35:36.411 INFO:tasks.workunit.client.0.smithi005.stdout:6/740: dread d2/d45/f74 [0,4194304] 0 2024-04-16T14:35:36.411 INFO:tasks.workunit.client.0.smithi005.stdout:6/741: chown d2/d3f/d53/dba 64519062 1 2024-04-16T14:35:36.412 INFO:tasks.workunit.client.1.smithi115.stdout:8/302: rename d0/db/d10/d17/f3a to d0/db/d10/d17/d2c/f5a 0 2024-04-16T14:35:36.412 INFO:tasks.workunit.client.0.smithi005.stdout:6/742: unlink d2/d3f/d47/l3a 0 2024-04-16T14:35:36.414 INFO:tasks.workunit.client.0.smithi005.stdout:6/743: mknod d2/d3f/cfd 0 2024-04-16T14:35:36.414 INFO:tasks.workunit.client.1.smithi115.stdout:7/297: write d0/fe [1538889,5913] 0 2024-04-16T14:35:36.415 INFO:tasks.workunit.client.0.smithi005.stdout:6/744: creat d2/d3f/d53/d54/db5/ffe x:0 0 0 2024-04-16T14:35:36.416 INFO:tasks.workunit.client.1.smithi115.stdout:7/298: symlink d0/d1/d3b/d5a/l69 0 2024-04-16T14:35:36.416 INFO:tasks.workunit.client.1.smithi115.stdout:7/299: write d0/d1/d3b/f60 [673701,14152] 0 2024-04-16T14:35:36.416 INFO:tasks.workunit.client.1.smithi115.stdout:7/300: chown d0/d1/d3b/d3e/f5f 13250010 1 2024-04-16T14:35:36.420 INFO:tasks.workunit.client.1.smithi115.stdout:8/303: unlink d0/db/d10/f4b 0 2024-04-16T14:35:36.421 INFO:tasks.workunit.client.0.smithi005.stdout:7/673: dread d1/dc/d2f/f60 [0,4194304] 0 2024-04-16T14:35:36.421 INFO:tasks.workunit.client.1.smithi115.stdout:8/304: dread d0/db/f58 [0,4194304] 0 2024-04-16T14:35:36.422 INFO:tasks.workunit.client.0.smithi005.stdout:7/674: fdatasync d1/d49/f6b 0 2024-04-16T14:35:36.423 INFO:tasks.workunit.client.0.smithi005.stdout:7/675: dread d1/d49/d74/d77/d57/d47/f63 [0,4194304] 0 2024-04-16T14:35:36.430 INFO:tasks.workunit.client.0.smithi005.stdout:6/745: read d2/d3f/d53/d54/fc8 [3960478,94726] 0 2024-04-16T14:35:36.430 INFO:tasks.workunit.client.0.smithi005.stdout:6/746: readlink d2/d5/d10/dd6/d8e/l8b 0 2024-04-16T14:35:36.431 INFO:tasks.workunit.client.0.smithi005.stdout:6/747: mkdir d2/d3f/d53/d54/dff 0 2024-04-16T14:35:36.434 INFO:tasks.workunit.client.1.smithi115.stdout:2/329: dwrite d0/d4/d57/f67 [0,4194304] 0 2024-04-16T14:35:36.435 INFO:tasks.workunit.client.0.smithi005.stdout:5/563: dwrite d0/d6/d12/d34/d6d/f72 [0,4194304] 0 2024-04-16T14:35:36.437 INFO:tasks.workunit.client.0.smithi005.stdout:5/564: rename d0/d6/c50 to d0/d6/d6e/db8/cbf 0 2024-04-16T14:35:36.437 INFO:tasks.workunit.client.0.smithi005.stdout:5/565: readlink d0/d6/l2f 0 2024-04-16T14:35:36.441 INFO:tasks.workunit.client.0.smithi005.stdout:5/566: rename d0/d6/d12/d34 to d0/d6/d12/dc0 0 2024-04-16T14:35:36.441 INFO:tasks.workunit.client.0.smithi005.stdout:5/567: stat d0/d6/d12/dc0/c6b 0 2024-04-16T14:35:36.442 INFO:tasks.workunit.client.1.smithi115.stdout:2/330: mkdir d0/d4/de/d11/d6d 0 2024-04-16T14:35:36.443 INFO:tasks.workunit.client.1.smithi115.stdout:8/305: mkdir d0/db/d10/d25/d2d/d3b/d56/d5b 0 2024-04-16T14:35:36.444 INFO:tasks.workunit.client.0.smithi005.stdout:5/568: creat d0/d70/db3/fc1 x:0 0 0 2024-04-16T14:35:36.444 INFO:tasks.workunit.client.1.smithi115.stdout:8/306: rename d0/db/d10/d17/d2c/l47 to d0/l5c 0 2024-04-16T14:35:36.445 INFO:tasks.workunit.client.1.smithi115.stdout:8/307: read d0/db/d10/d25/d2d/f35 [73590,111673] 0 2024-04-16T14:35:36.445 INFO:tasks.workunit.client.1.smithi115.stdout:8/308: getdents d0/db/d10/d17/d22 0 2024-04-16T14:35:36.446 INFO:tasks.workunit.client.0.smithi005.stdout:5/569: creat d0/d6/d12/d1c/d1e/d73/dba/fc2 x:0 0 0 2024-04-16T14:35:36.446 INFO:tasks.workunit.client.1.smithi115.stdout:8/309: creat d0/db/d10/d17/d22/f5d x:0 0 0 2024-04-16T14:35:36.447 INFO:tasks.workunit.client.0.smithi005.stdout:6/748: dwrite d2/d5/d10/dd6/d8e/fdf [0,4194304] 0 2024-04-16T14:35:36.450 INFO:tasks.workunit.client.1.smithi115.stdout:3/327: sync 2024-04-16T14:35:36.450 INFO:tasks.workunit.client.1.smithi115.stdout:9/358: sync 2024-04-16T14:35:36.450 INFO:tasks.workunit.client.1.smithi115.stdout:9/359: truncate d1/d6/d2d/d4b/d6c/d20/d2a/f6e 845405 0 2024-04-16T14:35:36.451 INFO:tasks.workunit.client.1.smithi115.stdout:0/230: sync 2024-04-16T14:35:36.451 INFO:tasks.workunit.client.1.smithi115.stdout:4/300: sync 2024-04-16T14:35:36.451 INFO:tasks.workunit.client.1.smithi115.stdout:2/331: dread d0/d4/d24/d21/d3b/f3f [0,4194304] 0 2024-04-16T14:35:36.451 INFO:tasks.workunit.client.1.smithi115.stdout:1/269: sync 2024-04-16T14:35:36.451 INFO:tasks.workunit.client.1.smithi115.stdout:1/270: fsync df/d13/d4d/d2c/f24 0 2024-04-16T14:35:36.451 INFO:tasks.workunit.client.1.smithi115.stdout:6/332: sync 2024-04-16T14:35:36.453 INFO:tasks.workunit.client.1.smithi115.stdout:3/328: rename dc/d24/c2b to dc/d29/d4d/c6e 0 2024-04-16T14:35:36.454 INFO:tasks.workunit.client.0.smithi005.stdout:6/749: link d2/d5/d10/f44 d2/d3f/d47/d84/da5/df1/f100 0 2024-04-16T14:35:36.455 INFO:tasks.workunit.client.1.smithi115.stdout:0/231: mknod d6/d10/d12/d1f/d36/c56 0 2024-04-16T14:35:36.455 INFO:tasks.workunit.client.1.smithi115.stdout:0/232: fsync d6/d10/f55 0 2024-04-16T14:35:36.455 INFO:tasks.workunit.client.1.smithi115.stdout:0/233: chown d6/d1b/d4e 0 1 2024-04-16T14:35:36.457 INFO:tasks.workunit.client.1.smithi115.stdout:1/271: creat df/d13/f59 x:0 0 0 2024-04-16T14:35:36.459 INFO:tasks.workunit.client.1.smithi115.stdout:8/310: dread d0/f53 [0,4194304] 0 2024-04-16T14:35:36.459 INFO:tasks.workunit.client.1.smithi115.stdout:3/329: creat dc/d24/f6f x:0 0 0 2024-04-16T14:35:36.460 INFO:tasks.workunit.client.1.smithi115.stdout:4/301: creat d1/d15/d24/f48 x:0 0 0 2024-04-16T14:35:36.462 INFO:tasks.workunit.client.1.smithi115.stdout:9/360: dread d1/d6/d2d/d4b/d6c/d20/d2a/f37 [0,4194304] 0 2024-04-16T14:35:36.462 INFO:tasks.workunit.client.1.smithi115.stdout:9/361: dread - d1/d6/d2d/d3d/d50/f5e zero size 2024-04-16T14:35:36.462 INFO:tasks.workunit.client.1.smithi115.stdout:9/362: write d1/d6/d29/f54 [116357,82219] 0 2024-04-16T14:35:36.462 INFO:tasks.workunit.client.1.smithi115.stdout:1/272: creat df/d2d/f5a x:0 0 0 2024-04-16T14:35:36.462 INFO:tasks.workunit.client.1.smithi115.stdout:8/311: rmdir d0/db/d10/d25 39 2024-04-16T14:35:36.463 INFO:tasks.workunit.client.1.smithi115.stdout:6/333: write f12 [1655859,38523] 0 2024-04-16T14:35:36.463 INFO:tasks.workunit.client.1.smithi115.stdout:6/334: chown d13/d1d/d2b/c54 53 1 2024-04-16T14:35:36.463 INFO:tasks.workunit.client.0.smithi005.stdout:5/570: rmdir d0 39 2024-04-16T14:35:36.464 INFO:tasks.workunit.client.1.smithi115.stdout:4/302: link d1/d2/l1b d1/d15/d17/l49 0 2024-04-16T14:35:36.464 INFO:tasks.workunit.client.1.smithi115.stdout:9/363: creat d1/d6/d2d/d4b/d6c/f74 x:0 0 0 2024-04-16T14:35:36.465 INFO:tasks.workunit.client.1.smithi115.stdout:1/273: creat df/f5b x:0 0 0 2024-04-16T14:35:36.467 INFO:tasks.workunit.client.0.smithi005.stdout:5/571: getdents d0/d6/d12 0 2024-04-16T14:35:36.468 INFO:tasks.workunit.client.1.smithi115.stdout:8/312: rename d0/db/fd to d0/db/d10/d17/d2c/f5e 0 2024-04-16T14:35:36.468 INFO:tasks.workunit.client.1.smithi115.stdout:6/335: rmdir d13/d1d/d2b/d46/d5a 39 2024-04-16T14:35:36.468 INFO:tasks.workunit.client.1.smithi115.stdout:2/332: dwrite d0/f2d [0,4194304] 0 2024-04-16T14:35:36.469 INFO:tasks.workunit.client.0.smithi005.stdout:5/572: creat d0/d6/d12/dc0/d42/fc3 x:0 0 0 2024-04-16T14:35:36.470 INFO:tasks.workunit.client.1.smithi115.stdout:4/303: creat d1/d15/d31/d42/f4a x:0 0 0 2024-04-16T14:35:36.470 INFO:tasks.workunit.client.0.smithi005.stdout:5/573: creat d0/d6/d6e/d9e/fc4 x:0 0 0 2024-04-16T14:35:36.470 INFO:tasks.workunit.client.0.smithi005.stdout:5/574: readlink d0/d6/d12/dc0/l33 0 2024-04-16T14:35:36.471 INFO:tasks.workunit.client.1.smithi115.stdout:8/313: dread d0/db/f1b [0,4194304] 0 2024-04-16T14:35:36.472 INFO:tasks.workunit.client.1.smithi115.stdout:6/336: creat d13/d1d/d2b/d46/f6b x:0 0 0 2024-04-16T14:35:36.473 INFO:tasks.workunit.client.0.smithi005.stdout:5/575: rename d0/d6/d12/dc0/d6d/f72 to d0/d6/d12/dc0/d8d/d5e/fc5 0 2024-04-16T14:35:36.473 INFO:tasks.workunit.client.0.smithi005.stdout:5/576: truncate d0/d6/d98/f9a 522246 0 2024-04-16T14:35:36.473 INFO:tasks.workunit.client.0.smithi005.stdout:5/577: write d0/d70/db3/fc1 [116029,32374] 0 2024-04-16T14:35:36.477 INFO:tasks.workunit.client.1.smithi115.stdout:8/314: link d0/db/d10/d17/f4c d0/db/d10/d25/f5f 0 2024-04-16T14:35:36.479 INFO:tasks.workunit.client.1.smithi115.stdout:1/274: rename df/l17 to df/l5c 0 2024-04-16T14:35:36.480 INFO:tasks.workunit.client.0.smithi005.stdout:6/750: dwrite d2/d20/d3c/dcf/f61 [0,4194304] 0 2024-04-16T14:35:36.480 INFO:tasks.workunit.client.0.smithi005.stdout:6/751: write d2/d5/d10/dd6/d7a/fc7 [770221,44321] 0 2024-04-16T14:35:36.482 INFO:tasks.workunit.client.1.smithi115.stdout:1/275: mknod df/d35/c5d 0 2024-04-16T14:35:36.483 INFO:tasks.workunit.client.0.smithi005.stdout:6/752: dread d2/d20/d3c/fef [0,4194304] 0 2024-04-16T14:35:36.484 INFO:tasks.workunit.client.0.smithi005.stdout:6/753: creat d2/d5/d10/dd6/f101 x:0 0 0 2024-04-16T14:35:36.484 INFO:tasks.workunit.client.0.smithi005.stdout:6/754: chown d2/d5/d10/dd6/fa6 16758735 1 2024-04-16T14:35:36.485 INFO:tasks.workunit.client.1.smithi115.stdout:6/337: write f0 [2392078,83223] 0 2024-04-16T14:35:36.485 INFO:tasks.workunit.client.1.smithi115.stdout:6/338: getdents d13/d1d/d68 0 2024-04-16T14:35:36.485 INFO:tasks.workunit.client.1.smithi115.stdout:8/315: link d0/db/d10/d17/d22/f32 d0/db/d10/d17/d2c/f60 0 2024-04-16T14:35:36.486 INFO:tasks.workunit.client.0.smithi005.stdout:5/578: dread d0/d6/d12/dc0/d8d/d5e/f5d [0,4194304] 0 2024-04-16T14:35:36.488 INFO:tasks.workunit.client.0.smithi005.stdout:5/579: creat d0/d6/d12/d1c/d1e/fc6 x:0 0 0 2024-04-16T14:35:36.488 INFO:tasks.workunit.client.0.smithi005.stdout:5/580: write d0/d6/d12/d1c/d1e/d73/dba/fc2 [202809,14324] 0 2024-04-16T14:35:36.488 INFO:tasks.workunit.client.0.smithi005.stdout:5/581: chown d0/d6/d12/d1c/l35 53504 1 2024-04-16T14:35:36.488 INFO:tasks.workunit.client.0.smithi005.stdout:5/582: dread - d0/d6/d12/dc0/d42/f9c zero size 2024-04-16T14:35:36.489 INFO:tasks.workunit.client.0.smithi005.stdout:5/583: symlink d0/d6/d12/dc0/d30/d97/lc7 0 2024-04-16T14:35:36.489 INFO:tasks.workunit.client.1.smithi115.stdout:8/316: mkdir d0/db/d10/d17/d2c/d61 0 2024-04-16T14:35:36.489 INFO:tasks.workunit.client.1.smithi115.stdout:8/317: readlink d0/db/d10/l38 0 2024-04-16T14:35:36.489 INFO:tasks.workunit.client.1.smithi115.stdout:8/318: chown d0/db/d10/d17/d2c/l51 1715779514 1 2024-04-16T14:35:36.490 INFO:tasks.workunit.client.1.smithi115.stdout:8/319: creat d0/f62 x:0 0 0 2024-04-16T14:35:36.490 INFO:tasks.workunit.client.1.smithi115.stdout:8/320: rmdir d0/db/d44 39 2024-04-16T14:35:36.491 INFO:tasks.workunit.client.0.smithi005.stdout:5/584: rename d0/d6/d12/f23 to d0/d6/d12/dc0/d42/fc8 0 2024-04-16T14:35:36.497 INFO:tasks.workunit.client.1.smithi115.stdout:2/333: dwrite d0/d4/f6b [0,4194304] 0 2024-04-16T14:35:36.498 INFO:tasks.workunit.client.1.smithi115.stdout:6/339: read d13/d1d/d2b/d5f/d30/d43/d2c/f39 [2135421,10021] 0 2024-04-16T14:35:36.499 INFO:tasks.workunit.client.1.smithi115.stdout:4/304: dwrite d1/d2/ff [0,4194304] 0 2024-04-16T14:35:36.500 INFO:tasks.workunit.client.0.smithi005.stdout:6/755: dread d2/df/f32 [0,4194304] 0 2024-04-16T14:35:36.500 INFO:tasks.workunit.client.1.smithi115.stdout:4/305: write d1/d2/f3c [2500697,82382] 0 2024-04-16T14:35:36.501 INFO:tasks.workunit.client.1.smithi115.stdout:6/340: symlink d13/d1a/l6c 0 2024-04-16T14:35:36.502 INFO:tasks.workunit.client.1.smithi115.stdout:4/306: readlink d1/d15/l33 0 2024-04-16T14:35:36.502 INFO:tasks.workunit.client.1.smithi115.stdout:4/307: truncate d1/d2/f8 1701010 0 2024-04-16T14:35:36.502 INFO:tasks.workunit.client.1.smithi115.stdout:4/308: chown d1/d15/d31/f3a 125 1 2024-04-16T14:35:36.502 INFO:tasks.workunit.client.1.smithi115.stdout:4/309: creat d1/d15/d31/f4b x:0 0 0 2024-04-16T14:35:36.504 INFO:tasks.workunit.client.1.smithi115.stdout:2/334: dread d0/d4/de/d11/d25/f30 [0,4194304] 0 2024-04-16T14:35:36.504 INFO:tasks.workunit.client.1.smithi115.stdout:6/341: creat d13/d1d/d49/f6d x:0 0 0 2024-04-16T14:35:36.507 INFO:tasks.workunit.client.1.smithi115.stdout:6/342: dread f8 [0,4194304] 0 2024-04-16T14:35:36.507 INFO:tasks.workunit.client.1.smithi115.stdout:6/343: creat d13/d1d/d49/f6e x:0 0 0 2024-04-16T14:35:36.507 INFO:tasks.workunit.client.1.smithi115.stdout:6/344: creat d13/d1d/f6f x:0 0 0 2024-04-16T14:35:36.507 INFO:tasks.workunit.client.1.smithi115.stdout:6/345: creat d13/d1d/d49/f70 x:0 0 0 2024-04-16T14:35:36.508 INFO:tasks.workunit.client.1.smithi115.stdout:4/310: symlink d1/d15/d24/l4c 0 2024-04-16T14:35:36.511 INFO:tasks.workunit.client.1.smithi115.stdout:8/321: dwrite d0/db/d10/d17/f18 [0,4194304] 0 2024-04-16T14:35:36.512 INFO:tasks.workunit.client.1.smithi115.stdout:2/335: link d0/d4/de/f37 d0/d4/de/d11/d36/f6e 0 2024-04-16T14:35:36.516 INFO:tasks.workunit.client.0.smithi005.stdout:5/585: dwrite d0/f11 [0,4194304] 0 2024-04-16T14:35:36.523 INFO:tasks.workunit.client.1.smithi115.stdout:8/322: write d0/db/d10/d25/d2d/d3b/f3c [3675145,82100] 0 2024-04-16T14:35:36.523 INFO:tasks.workunit.client.1.smithi115.stdout:6/346: rename d13/d1d/d2b/d46/d5a/d3f to d13/d1d/d71 0 2024-04-16T14:35:36.523 INFO:tasks.workunit.client.1.smithi115.stdout:1/276: rmdir df/d2d 39 2024-04-16T14:35:36.523 INFO:tasks.workunit.client.1.smithi115.stdout:1/277: readlink df/d13/d3a/l58 0 2024-04-16T14:35:36.525 INFO:tasks.workunit.client.0.smithi005.stdout:2/324: sync 2024-04-16T14:35:36.526 INFO:tasks.workunit.client.0.smithi005.stdout:0/567: sync 2024-04-16T14:35:36.526 INFO:tasks.workunit.client.0.smithi005.stdout:9/384: sync 2024-04-16T14:35:36.526 INFO:tasks.workunit.client.0.smithi005.stdout:4/825: sync 2024-04-16T14:35:36.526 INFO:tasks.workunit.client.0.smithi005.stdout:2/325: truncate d0/d4/f3b 5279 0 2024-04-16T14:35:36.528 INFO:tasks.workunit.client.0.smithi005.stdout:9/385: unlink d3/d12/l2c 0 2024-04-16T14:35:36.528 INFO:tasks.workunit.client.0.smithi005.stdout:0/568: getdents da/df/d1b/d3a/d53/d5a/d99 0 2024-04-16T14:35:36.530 INFO:tasks.workunit.client.0.smithi005.stdout:9/386: mknod d3/c6d 0 2024-04-16T14:35:36.533 INFO:tasks.workunit.client.0.smithi005.stdout:0/569: rename da/fc to da/df/d1b/d3a/d53/d5a/d99/fc0 0 2024-04-16T14:35:36.533 INFO:tasks.workunit.client.0.smithi005.stdout:0/570: write da/df/d26/f45 [1194843,23963] 0 2024-04-16T14:35:36.534 INFO:tasks.workunit.client.0.smithi005.stdout:4/826: dread d0/d1b/d1d/f9a [0,4194304] 0 2024-04-16T14:35:36.534 INFO:tasks.workunit.client.0.smithi005.stdout:4/827: creat d0/d4d/f101 x:0 0 0 2024-04-16T14:35:36.535 INFO:tasks.workunit.client.1.smithi115.stdout:2/336: creat d0/d4/d24/d23/d52/f6f x:0 0 0 2024-04-16T14:35:36.535 INFO:tasks.workunit.client.0.smithi005.stdout:9/387: rename d3/c2d to d3/d49/c6e 0 2024-04-16T14:35:36.537 INFO:tasks.workunit.client.1.smithi115.stdout:8/323: mknod d0/db/d10/d17/d2c/d61/c63 0 2024-04-16T14:35:36.537 INFO:tasks.workunit.client.0.smithi005.stdout:9/388: rmdir d3/d49/d4b/d55 39 2024-04-16T14:35:36.537 INFO:tasks.workunit.client.0.smithi005.stdout:9/389: chown d3/d12/d16/l20 64995 1 2024-04-16T14:35:36.538 INFO:tasks.workunit.client.1.smithi115.stdout:1/278: stat df/d13/c38 0 2024-04-16T14:35:36.538 INFO:tasks.workunit.client.1.smithi115.stdout:1/279: truncate df/d13/d4d/f52 868166 0 2024-04-16T14:35:36.538 INFO:tasks.workunit.client.0.smithi005.stdout:9/390: rename d3/d12/c38 to d3/d49/c6f 0 2024-04-16T14:35:36.541 INFO:tasks.workunit.client.1.smithi115.stdout:8/324: dread d0/db/f30 [0,4194304] 0 2024-04-16T14:35:36.542 INFO:tasks.workunit.client.0.smithi005.stdout:6/756: dwrite d2/d5/d28/db8/fed [0,4194304] 0 2024-04-16T14:35:36.543 INFO:tasks.workunit.client.1.smithi115.stdout:2/337: mkdir d0/d47/d65/d61/d70 0 2024-04-16T14:35:36.543 INFO:tasks.workunit.client.1.smithi115.stdout:2/338: fsync d0/d4/f7 0 2024-04-16T14:35:36.543 INFO:tasks.workunit.client.1.smithi115.stdout:2/339: write d0/d4/de/f37 [2181434,84932] 0 2024-04-16T14:35:36.543 INFO:tasks.workunit.client.0.smithi005.stdout:6/757: write d2/d20/d3c/dcf/d6e/fab [87745,86153] 0 2024-04-16T14:35:36.550 INFO:tasks.workunit.client.0.smithi005.stdout:6/758: dread d2/d5/f2f [4194304,4194304] 0 2024-04-16T14:35:36.551 INFO:tasks.workunit.client.0.smithi005.stdout:6/759: symlink d2/d3f/d53/l102 0 2024-04-16T14:35:36.551 INFO:tasks.workunit.client.0.smithi005.stdout:6/760: write d2/d45/fe9 [300488,29940] 0 2024-04-16T14:35:36.552 INFO:tasks.workunit.client.0.smithi005.stdout:6/761: symlink d2/d5/d10/d68/l103 0 2024-04-16T14:35:36.553 INFO:tasks.workunit.client.0.smithi005.stdout:6/762: rmdir d2/d3f/d53/dba 39 2024-04-16T14:35:36.558 INFO:tasks.workunit.client.1.smithi115.stdout:4/311: dwrite d1/f2d [4194304,4194304] 0 2024-04-16T14:35:36.559 INFO:tasks.workunit.client.0.smithi005.stdout:5/586: dwrite d0/f76 [0,4194304] 0 2024-04-16T14:35:36.560 INFO:tasks.workunit.client.1.smithi115.stdout:4/312: creat d1/d15/f4d x:0 0 0 2024-04-16T14:35:36.567 INFO:tasks.workunit.client.1.smithi115.stdout:4/313: read d1/d2/f8 [939853,65571] 0 2024-04-16T14:35:36.567 INFO:tasks.workunit.client.1.smithi115.stdout:4/314: write d1/d15/d1e/f2b [945116,107104] 0 2024-04-16T14:35:36.575 INFO:tasks.workunit.client.1.smithi115.stdout:4/315: dread d1/f2d [0,4194304] 0 2024-04-16T14:35:36.576 INFO:tasks.workunit.client.1.smithi115.stdout:4/316: symlink d1/d15/d31/l4e 0 2024-04-16T14:35:36.576 INFO:tasks.workunit.client.1.smithi115.stdout:4/317: rmdir d1/d15/d1e 39 2024-04-16T14:35:36.581 INFO:tasks.workunit.client.1.smithi115.stdout:6/347: dwrite d13/d1d/d2b/d5f/d30/d43/d2c/f39 [4194304,4194304] 0 2024-04-16T14:35:36.599 INFO:tasks.workunit.client.1.smithi115.stdout:6/348: rmdir d13/d1d/d71 0 2024-04-16T14:35:36.599 INFO:tasks.workunit.client.1.smithi115.stdout:6/349: mkdir d13/d1d/d47/d72 0 2024-04-16T14:35:36.601 INFO:tasks.workunit.client.1.smithi115.stdout:6/350: creat d13/d1d/d2b/d46/d5a/f73 x:0 0 0 2024-04-16T14:35:36.604 INFO:tasks.workunit.client.1.smithi115.stdout:8/325: dwrite d0/db/f30 [0,4194304] 0 2024-04-16T14:35:36.604 INFO:tasks.workunit.client.1.smithi115.stdout:2/340: dwrite d0/d1b/f6a [0,4194304] 0 2024-04-16T14:35:36.604 INFO:tasks.workunit.client.0.smithi005.stdout:0/571: dwrite da/df/d1b/d3a/d53/f8f [0,4194304] 0 2024-04-16T14:35:36.605 INFO:tasks.workunit.client.0.smithi005.stdout:6/763: dwrite d2/d45/d7b/db2/fbb [0,4194304] 0 2024-04-16T14:35:36.605 INFO:tasks.workunit.client.0.smithi005.stdout:6/764: creat d2/d5/d10/dd6/f104 x:0 0 0 2024-04-16T14:35:36.605 INFO:tasks.workunit.client.0.smithi005.stdout:6/765: fdatasync d2/d3f/d47/d84/da5/fc9 0 2024-04-16T14:35:36.605 INFO:tasks.workunit.client.0.smithi005.stdout:5/587: dwrite d0/d70/f90 [4194304,4194304] 0 2024-04-16T14:35:36.605 INFO:tasks.workunit.client.0.smithi005.stdout:5/588: write d0/d6/d12/dc0/d30/f68 [4431515,120502] 0 2024-04-16T14:35:36.605 INFO:tasks.workunit.client.1.smithi115.stdout:4/318: dwrite d1/f22 [0,4194304] 0 2024-04-16T14:35:36.609 INFO:tasks.workunit.client.0.smithi005.stdout:0/572: unlink da/df/d26/d39/f9a 0 2024-04-16T14:35:36.609 INFO:tasks.workunit.client.0.smithi005.stdout:0/573: chown da/l64 0 1 2024-04-16T14:35:36.609 INFO:tasks.workunit.client.0.smithi005.stdout:0/574: write da/df/d1b/f62 [304659,31494] 0 2024-04-16T14:35:36.610 INFO:tasks.workunit.client.1.smithi115.stdout:2/341: dread d0/d4/d24/d21/d3b/f3f [0,4194304] 0 2024-04-16T14:35:36.610 INFO:tasks.workunit.client.1.smithi115.stdout:2/342: stat d0/d1b/c49 0 2024-04-16T14:35:36.612 INFO:tasks.workunit.client.0.smithi005.stdout:6/766: dread d2/d20/fbd [0,4194304] 0 2024-04-16T14:35:36.614 INFO:tasks.workunit.client.1.smithi115.stdout:5/298: sync 2024-04-16T14:35:36.615 INFO:tasks.workunit.client.0.smithi005.stdout:9/391: rmdir d3/d12 39 2024-04-16T14:35:36.616 INFO:tasks.workunit.client.1.smithi115.stdout:8/326: mkdir d0/db/d10/d17/d2c/d61/d64 0 2024-04-16T14:35:36.616 INFO:tasks.workunit.client.0.smithi005.stdout:5/589: link d0/d6/d6e/d9e/fc4 d0/d6/d12/d1c/d81/fc9 0 2024-04-16T14:35:36.619 INFO:tasks.workunit.client.0.smithi005.stdout:6/767: creat d2/d5/d10/dd6/d7a/f105 x:0 0 0 2024-04-16T14:35:36.619 INFO:tasks.workunit.client.0.smithi005.stdout:6/768: fsync d2/d3f/d47/fe2 0 2024-04-16T14:35:36.620 INFO:tasks.workunit.client.0.smithi005.stdout:5/590: rmdir d0/d6/d12/d1c/d1e/d73 39 2024-04-16T14:35:36.620 INFO:tasks.workunit.client.1.smithi115.stdout:6/351: rmdir d13/d1d 39 2024-04-16T14:35:36.622 INFO:tasks.workunit.client.0.smithi005.stdout:5/591: creat d0/d6/d12/d1c/d1e/d73/fca x:0 0 0 2024-04-16T14:35:36.622 INFO:tasks.workunit.client.1.smithi115.stdout:4/319: mknod d1/d15/d24/c4f 0 2024-04-16T14:35:36.623 INFO:tasks.workunit.client.1.smithi115.stdout:4/320: chown d1/d15/d24/c4f 1868 1 2024-04-16T14:35:36.623 INFO:tasks.workunit.client.1.smithi115.stdout:4/321: chown d1/d15/d1e/f35 44034 1 2024-04-16T14:35:36.623 INFO:tasks.workunit.client.0.smithi005.stdout:5/592: rmdir d0/d70 39 2024-04-16T14:35:36.623 INFO:tasks.workunit.client.0.smithi005.stdout:5/593: stat d0/d6/d12/dc0/d8d/f62 0 2024-04-16T14:35:36.624 INFO:tasks.workunit.client.1.smithi115.stdout:8/327: unlink d0/db/d10/d17/d2c/c37 0 2024-04-16T14:35:36.624 INFO:tasks.workunit.client.0.smithi005.stdout:5/594: symlink d0/d70/db3/lcb 0 2024-04-16T14:35:36.625 INFO:tasks.workunit.client.0.smithi005.stdout:9/392: write d3/d12/d16/f1a [6335993,17648] 0 2024-04-16T14:35:36.626 INFO:tasks.workunit.client.0.smithi005.stdout:5/595: truncate d0/f8 1472845 0 2024-04-16T14:35:36.626 INFO:tasks.workunit.client.1.smithi115.stdout:6/352: creat d13/d1d/d49/f74 x:0 0 0 2024-04-16T14:35:36.626 INFO:tasks.workunit.client.1.smithi115.stdout:6/353: chown d13/d1d/l1f 145501568 1 2024-04-16T14:35:36.627 INFO:tasks.workunit.client.1.smithi115.stdout:4/322: link d1/d15/d24/f40 d1/d15/d31/d42/d46/f50 0 2024-04-16T14:35:36.627 INFO:tasks.workunit.client.0.smithi005.stdout:3/546: sync 2024-04-16T14:35:36.627 INFO:tasks.workunit.client.0.smithi005.stdout:1/625: sync 2024-04-16T14:35:36.630 INFO:tasks.workunit.client.0.smithi005.stdout:9/393: dread d3/d49/d4b/d55/f5d [0,4194304] 0 2024-04-16T14:35:36.630 INFO:tasks.workunit.client.0.smithi005.stdout:1/626: creat d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/dc5/dbc/dcf/fe3 x:0 0 0 2024-04-16T14:35:36.631 INFO:tasks.workunit.client.0.smithi005.stdout:6/769: dread d2/d3f/d47/d84/da5/fe3 [0,4194304] 0 2024-04-16T14:35:36.632 INFO:tasks.workunit.client.0.smithi005.stdout:1/627: creat d2/d74/fe4 x:0 0 0 2024-04-16T14:35:36.634 INFO:tasks.workunit.client.0.smithi005.stdout:6/770: dread - d2/d20/d33/ff5 zero size 2024-04-16T14:35:36.636 INFO:tasks.workunit.client.0.smithi005.stdout:6/771: rmdir d2/d3f/d53/d54/db5 39 2024-04-16T14:35:36.638 INFO:tasks.workunit.client.0.smithi005.stdout:6/772: mknod d2/d5/d10/dd6/d7a/dbc/c106 0 2024-04-16T14:35:36.640 INFO:tasks.workunit.client.1.smithi115.stdout:6/354: write d13/d1d/d2b/d5f/d30/d43/f2d [3554957,5648] 0 2024-04-16T14:35:36.641 INFO:tasks.workunit.client.0.smithi005.stdout:0/575: dwrite da/df/f1d [0,4194304] 0 2024-04-16T14:35:36.641 INFO:tasks.workunit.client.0.smithi005.stdout:0/576: write da/df/d1b/d24/f28 [325786,54597] 0 2024-04-16T14:35:36.642 INFO:tasks.workunit.client.1.smithi115.stdout:6/355: rmdir d13/d1d/d2b/d5f 39 2024-04-16T14:35:36.642 INFO:tasks.workunit.client.1.smithi115.stdout:6/356: dread - d13/d1d/d2b/d5f/f6a zero size 2024-04-16T14:35:36.643 INFO:tasks.workunit.client.1.smithi115.stdout:6/357: chown d13/d1d/d2b 58 1 2024-04-16T14:35:36.643 INFO:tasks.workunit.client.1.smithi115.stdout:4/323: dread d1/f22 [0,4194304] 0 2024-04-16T14:35:36.644 INFO:tasks.workunit.client.1.smithi115.stdout:2/343: dwrite d0/d4/ff [0,4194304] 0 2024-04-16T14:35:36.645 INFO:tasks.workunit.client.1.smithi115.stdout:4/324: symlink d1/d15/d31/d42/d46/l51 0 2024-04-16T14:35:36.647 INFO:tasks.workunit.client.1.smithi115.stdout:2/344: mkdir d0/d4/d24/d23/d71 0 2024-04-16T14:35:36.647 INFO:tasks.workunit.client.1.smithi115.stdout:2/345: write d0/d1b/f3d [495909,37055] 0 2024-04-16T14:35:36.647 INFO:tasks.workunit.client.0.smithi005.stdout:1/628: dread d2/d1c/d15/d2a/d19/d42/d71/dac/fa1 [0,4194304] 0 2024-04-16T14:35:36.648 INFO:tasks.workunit.client.0.smithi005.stdout:1/629: fdatasync d2/d1c/d15/d2a/d19/d42/f56 0 2024-04-16T14:35:36.648 INFO:tasks.workunit.client.0.smithi005.stdout:5/596: dwrite d0/d6/d12/dc0/d8d/f83 [0,4194304] 0 2024-04-16T14:35:36.648 INFO:tasks.workunit.client.0.smithi005.stdout:3/547: dwrite d2/f21 [4194304,4194304] 0 2024-04-16T14:35:36.650 INFO:tasks.workunit.client.0.smithi005.stdout:1/630: rename d2/d1c/d15/d2a/d19/f40 to d2/d1c/d15/d2a/d19/dc9/fe5 0 2024-04-16T14:35:36.650 INFO:tasks.workunit.client.0.smithi005.stdout:1/631: write d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/fbe [2730115,25306] 0 2024-04-16T14:35:36.657 INFO:tasks.workunit.client.0.smithi005.stdout:3/548: symlink d2/d9/d25/d39/d64/lb3 0 2024-04-16T14:35:36.667 INFO:tasks.workunit.client.0.smithi005.stdout:1/632: creat d2/d1c/d15/d2a/d19/dc9/fe6 x:0 0 0 2024-04-16T14:35:36.667 INFO:tasks.workunit.client.0.smithi005.stdout:3/549: mknod d2/d9/df/daa/cb4 0 2024-04-16T14:35:36.668 INFO:tasks.workunit.client.0.smithi005.stdout:3/550: creat d2/d17/d46/d47/fb5 x:0 0 0 2024-04-16T14:35:36.668 INFO:tasks.workunit.client.1.smithi115.stdout:4/325: dread d1/d2/f11 [0,4194304] 0 2024-04-16T14:35:36.669 INFO:tasks.workunit.client.0.smithi005.stdout:1/633: creat d2/d1c/d15/d2a/d19/d20/d27/fe7 x:0 0 0 2024-04-16T14:35:36.669 INFO:tasks.workunit.client.0.smithi005.stdout:1/634: creat d2/d74/d7a/fe8 x:0 0 0 2024-04-16T14:35:36.669 INFO:tasks.workunit.client.0.smithi005.stdout:1/635: write d2/d1c/d15/d2a/d1a/d21/f30 [3556153,65961] 0 2024-04-16T14:35:36.669 INFO:tasks.workunit.client.0.smithi005.stdout:6/773: dwrite d2/d3f/f4f [0,4194304] 0 2024-04-16T14:35:36.670 INFO:tasks.workunit.client.0.smithi005.stdout:6/774: write d2/d5/d28/f46 [2847974,113794] 0 2024-04-16T14:35:36.672 INFO:tasks.workunit.client.0.smithi005.stdout:1/636: creat d2/d1c/d15/d2a/d19/d42/d64/fe9 x:0 0 0 2024-04-16T14:35:36.672 INFO:tasks.workunit.client.0.smithi005.stdout:5/597: dwrite d0/d6/d12/dc0/d42/f59 [0,4194304] 0 2024-04-16T14:35:36.672 INFO:tasks.workunit.client.0.smithi005.stdout:5/598: stat d0/d6/f31 0 2024-04-16T14:35:36.672 INFO:tasks.workunit.client.0.smithi005.stdout:5/599: readlink d0/d6/d6e/d9e/lbe 0 2024-04-16T14:35:36.673 INFO:tasks.workunit.client.0.smithi005.stdout:5/600: dread - d0/d6/d12/d1c/d1e/f7b zero size 2024-04-16T14:35:36.673 INFO:tasks.workunit.client.0.smithi005.stdout:5/601: readlink d0/d6/l2f 0 2024-04-16T14:35:36.673 INFO:tasks.workunit.client.1.smithi115.stdout:6/358: dwrite d13/d1d/d2b/f67 [0,4194304] 0 2024-04-16T14:35:36.673 INFO:tasks.workunit.client.1.smithi115.stdout:6/359: dread - d13/d1d/d2b/d46/f6b zero size 2024-04-16T14:35:36.675 INFO:tasks.workunit.client.0.smithi005.stdout:6/775: mknod d2/d3f/d47/d84/dbf/c107 0 2024-04-16T14:35:36.677 INFO:tasks.workunit.client.0.smithi005.stdout:1/637: link d2/d1c/d15/d2a/d19/d20/d27/c47 d2/d1c/cea 0 2024-04-16T14:35:36.677 INFO:tasks.workunit.client.0.smithi005.stdout:1/638: fsync d2/d1c/dd8/fbb 0 2024-04-16T14:35:36.677 INFO:tasks.workunit.client.0.smithi005.stdout:1/639: chown d2/d2c/d85/dab/d51/fc3 8098 1 2024-04-16T14:35:36.677 INFO:tasks.workunit.client.0.smithi005.stdout:1/640: stat d2/d1c/l5e 0 2024-04-16T14:35:36.679 INFO:tasks.workunit.client.1.smithi115.stdout:2/346: dwrite d0/d4/d24/d10/f39 [0,4194304] 0 2024-04-16T14:35:36.679 INFO:tasks.workunit.client.1.smithi115.stdout:2/347: truncate d0/d1b/f41 243835 0 2024-04-16T14:35:36.680 INFO:tasks.workunit.client.1.smithi115.stdout:4/326: rmdir d1 39 2024-04-16T14:35:36.680 INFO:tasks.workunit.client.1.smithi115.stdout:4/327: stat d1/d15/d1e/f29 0 2024-04-16T14:35:36.680 INFO:tasks.workunit.client.1.smithi115.stdout:4/328: chown d1/d15 24266481 1 2024-04-16T14:35:36.680 INFO:tasks.workunit.client.1.smithi115.stdout:4/329: stat d1/d15/d24/l4c 0 2024-04-16T14:35:36.681 INFO:tasks.workunit.client.1.smithi115.stdout:6/360: dread f0 [0,4194304] 0 2024-04-16T14:35:36.681 INFO:tasks.workunit.client.1.smithi115.stdout:6/361: stat d13/d1d/d68 0 2024-04-16T14:35:36.681 INFO:tasks.workunit.client.1.smithi115.stdout:6/362: chown d13/d1d/d2b 7536497 1 2024-04-16T14:35:36.681 INFO:tasks.workunit.client.0.smithi005.stdout:5/602: mkdir d0/d6/d12/dcc 0 2024-04-16T14:35:36.681 INFO:tasks.workunit.client.0.smithi005.stdout:3/551: write d2/d17/f76 [3982067,111756] 0 2024-04-16T14:35:36.681 INFO:tasks.workunit.client.0.smithi005.stdout:3/552: creat d2/d9/d5e/fb6 x:0 0 0 2024-04-16T14:35:36.682 INFO:tasks.workunit.client.0.smithi005.stdout:6/776: creat d2/d45/d7b/dd2/f108 x:0 0 0 2024-04-16T14:35:36.684 INFO:tasks.workunit.client.0.smithi005.stdout:5/603: mknod d0/d6/d12/d1c/d81/d82/ccd 0 2024-04-16T14:35:36.686 INFO:tasks.workunit.client.1.smithi115.stdout:2/348: mkdir d0/d4/de/d11/d6d/d72 0 2024-04-16T14:35:36.686 INFO:tasks.workunit.client.1.smithi115.stdout:2/349: creat d0/d4/d24/d21/d59/f73 x:0 0 0 2024-04-16T14:35:36.686 INFO:tasks.workunit.client.1.smithi115.stdout:2/350: chown d0/d4/l4d 24213 1 2024-04-16T14:35:36.686 INFO:tasks.workunit.client.1.smithi115.stdout:4/330: rename c0 to d1/d15/d17/c52 0 2024-04-16T14:35:36.689 INFO:tasks.workunit.client.1.smithi115.stdout:2/351: unlink d0/d4/d24/d21/d3b/c40 0 2024-04-16T14:35:36.689 INFO:tasks.workunit.client.1.smithi115.stdout:2/352: getdents d0/d47/d65/d61/d70 0 2024-04-16T14:35:36.689 INFO:tasks.workunit.client.0.smithi005.stdout:3/553: link d2/d9/df/l13 d2/d9/d25/d39/lb7 0 2024-04-16T14:35:36.691 INFO:tasks.workunit.client.1.smithi115.stdout:2/353: creat d0/d4/d24/d21/f74 x:0 0 0 2024-04-16T14:35:36.691 INFO:tasks.workunit.client.1.smithi115.stdout:2/354: stat d0/d4/d24/d10/c31 0 2024-04-16T14:35:36.692 INFO:tasks.workunit.client.1.smithi115.stdout:2/355: dread d0/d4/d24/f44 [0,4194304] 0 2024-04-16T14:35:36.692 INFO:tasks.workunit.client.1.smithi115.stdout:2/356: truncate d0/fd 986356 0 2024-04-16T14:35:36.692 INFO:tasks.workunit.client.1.smithi115.stdout:4/331: rename d1/d15/l2c to d1/d15/d1e/l53 0 2024-04-16T14:35:36.692 INFO:tasks.workunit.client.0.smithi005.stdout:5/604: rename d0/d6/d12/c7c to d0/d6/d12/d1c/d1e/d73/dba/cce 0 2024-04-16T14:35:36.693 INFO:tasks.workunit.client.1.smithi115.stdout:2/357: link d0/d4/l4d d0/l75 0 2024-04-16T14:35:36.695 INFO:tasks.workunit.client.1.smithi115.stdout:2/358: link d0/l75 d0/d4/d24/d10/l76 0 2024-04-16T14:35:36.697 INFO:tasks.workunit.client.0.smithi005.stdout:3/554: rename d2/d9/d25/f96 to d2/d17/d46/d75/d9b/fb8 0 2024-04-16T14:35:36.703 INFO:tasks.workunit.client.1.smithi115.stdout:4/332: dread d1/d2/ff [0,4194304] 0 2024-04-16T14:35:36.703 INFO:tasks.workunit.client.1.smithi115.stdout:4/333: fdatasync d1/d15/d1e/f35 0 2024-04-16T14:35:36.705 INFO:tasks.workunit.client.0.smithi005.stdout:5/605: dread d0/d6/d12/d1c/f22 [0,4194304] 0 2024-04-16T14:35:36.706 INFO:tasks.workunit.client.1.smithi115.stdout:0/234: sync 2024-04-16T14:35:36.706 INFO:tasks.workunit.client.1.smithi115.stdout:7/301: sync 2024-04-16T14:35:36.706 INFO:tasks.workunit.client.1.smithi115.stdout:0/235: fdatasync d6/d10/d12/d1f/f32 0 2024-04-16T14:35:36.707 INFO:tasks.workunit.client.1.smithi115.stdout:7/302: truncate d0/d1/f20 4318335 0 2024-04-16T14:35:36.707 INFO:tasks.workunit.client.1.smithi115.stdout:0/236: fsync d6/d10/f55 0 2024-04-16T14:35:36.707 INFO:tasks.workunit.client.1.smithi115.stdout:7/303: read d0/d2/d3a/d30/f32 [2101411,90920] 0 2024-04-16T14:35:36.707 INFO:tasks.workunit.client.1.smithi115.stdout:6/363: dwrite d13/d1a/f23 [0,4194304] 0 2024-04-16T14:35:36.708 INFO:tasks.workunit.client.0.smithi005.stdout:8/564: sync 2024-04-16T14:35:36.710 INFO:tasks.workunit.client.1.smithi115.stdout:6/364: unlink d13/d1d/d2b/d5f/d30/l41 0 2024-04-16T14:35:36.712 INFO:tasks.workunit.client.0.smithi005.stdout:1/641: dwrite d2/d1c/d15/f63 [0,4194304] 0 2024-04-16T14:35:36.712 INFO:tasks.workunit.client.0.smithi005.stdout:1/642: readlink d2/d1c/d15/la4 0 2024-04-16T14:35:36.712 INFO:tasks.workunit.client.1.smithi115.stdout:2/359: write d0/f2d [2932285,114038] 0 2024-04-16T14:35:36.715 INFO:tasks.workunit.client.0.smithi005.stdout:1/643: mknod d2/d1c/d15/d2a/d19/d20/d27/d73/ceb 0 2024-04-16T14:35:36.717 INFO:tasks.workunit.client.1.smithi115.stdout:2/360: getdents d0/d4/de/d11/d25 0 2024-04-16T14:35:36.718 INFO:tasks.workunit.client.1.smithi115.stdout:2/361: creat d0/d47/d65/f77 x:0 0 0 2024-04-16T14:35:36.722 INFO:tasks.workunit.client.1.smithi115.stdout:4/334: dread d1/f4 [0,4194304] 0 2024-04-16T14:35:36.728 INFO:tasks.workunit.client.0.smithi005.stdout:1/644: dread d2/d1c/d15/d2a/d25/f5c [0,4194304] 0 2024-04-16T14:35:36.728 INFO:tasks.workunit.client.0.smithi005.stdout:5/606: dwrite d0/d6/d12/d1c/d1e/fc6 [0,4194304] 0 2024-04-16T14:35:36.729 INFO:tasks.workunit.client.0.smithi005.stdout:1/645: write d2/d1c/d15/d2a/d1a/d21/fe1 [343514,17375] 0 2024-04-16T14:35:36.729 INFO:tasks.workunit.client.0.smithi005.stdout:1/646: chown d2/d1c/d15/d2a/d19/d20/d27/d73/c86 533746329 1 2024-04-16T14:35:36.729 INFO:tasks.workunit.client.0.smithi005.stdout:1/647: chown d2/d2c/f4f 513 1 2024-04-16T14:35:36.729 INFO:tasks.workunit.client.0.smithi005.stdout:1/648: chown d2/d1c/d15/d2a/d19/d42/d71/dac/f9f 9413 1 2024-04-16T14:35:36.729 INFO:tasks.workunit.client.0.smithi005.stdout:1/649: readlink d2/d1c/d15/d6f/ld9 0 2024-04-16T14:35:36.729 INFO:tasks.workunit.client.0.smithi005.stdout:1/650: creat d2/d1c/d15/d2a/d19/d20/fec x:0 0 0 2024-04-16T14:35:36.729 INFO:tasks.workunit.client.0.smithi005.stdout:1/651: write d2/d1c/d15/d2a/d1a/d21/f89 [8777409,97518] 0 2024-04-16T14:35:36.731 INFO:tasks.workunit.client.0.smithi005.stdout:5/607: getdents d0 0 2024-04-16T14:35:36.732 INFO:tasks.workunit.client.0.smithi005.stdout:5/608: dread - d0/faf zero size 2024-04-16T14:35:36.746 INFO:tasks.workunit.client.0.smithi005.stdout:3/555: dwrite d2/d17/d46/d75/d9b/fb8 [0,4194304] 0 2024-04-16T14:35:36.747 INFO:tasks.workunit.client.1.smithi115.stdout:4/335: dread d1/d15/d1e/f43 [0,4194304] 0 2024-04-16T14:35:36.747 INFO:tasks.workunit.client.1.smithi115.stdout:4/336: truncate d1/d15/d1e/f43 5198377 0 2024-04-16T14:35:36.747 INFO:tasks.workunit.client.1.smithi115.stdout:4/337: readlink d1/d15/d31/l4e 0 2024-04-16T14:35:36.748 INFO:tasks.workunit.client.0.smithi005.stdout:3/556: link d2/d17/l81 d2/d9/d51/lb9 0 2024-04-16T14:35:36.748 INFO:tasks.workunit.client.0.smithi005.stdout:3/557: write d2/d17/d46/f4b [1092524,111690] 0 2024-04-16T14:35:36.748 INFO:tasks.workunit.client.0.smithi005.stdout:3/558: chown d2/d9/df/cad 854 1 2024-04-16T14:35:36.748 INFO:tasks.workunit.client.0.smithi005.stdout:3/559: readlink d2/d17/d46/d47/l4d 0 2024-04-16T14:35:36.748 INFO:tasks.workunit.client.0.smithi005.stdout:3/560: write d2/d6b/f99 [542655,41054] 0 2024-04-16T14:35:36.748 INFO:tasks.workunit.client.0.smithi005.stdout:3/561: write d2/f2c [760785,24465] 0 2024-04-16T14:35:36.748 INFO:tasks.workunit.client.0.smithi005.stdout:3/562: truncate d2/d9/d25/d39/d9c/fb2 814358 0 2024-04-16T14:35:36.748 INFO:tasks.workunit.client.0.smithi005.stdout:1/652: dread d2/d74/dd7/f68 [0,4194304] 0 2024-04-16T14:35:36.749 INFO:tasks.workunit.client.1.smithi115.stdout:4/338: mknod d1/d15/d31/d42/c54 0 2024-04-16T14:35:36.749 INFO:tasks.workunit.client.1.smithi115.stdout:4/339: readlink d1/d15/d1e/l39 0 2024-04-16T14:35:36.749 INFO:tasks.workunit.client.1.smithi115.stdout:4/340: mkdir d1/d15/d31/d55 0 2024-04-16T14:35:36.749 INFO:tasks.workunit.client.1.smithi115.stdout:4/341: fsync d1/d15/d1e/f2b 0 2024-04-16T14:35:36.751 INFO:tasks.workunit.client.0.smithi005.stdout:5/609: write d0/d6/d6e/f7e [3515241,63390] 0 2024-04-16T14:35:36.751 INFO:tasks.workunit.client.0.smithi005.stdout:1/653: write d2/d1c/d15/d2a/d1a/f3b [4361243,112334] 0 2024-04-16T14:35:36.751 INFO:tasks.workunit.client.0.smithi005.stdout:6/777: dwrite d2/d5/d28/f46 [0,4194304] 0 2024-04-16T14:35:36.751 INFO:tasks.workunit.client.0.smithi005.stdout:1/654: chown d2/d1c/d15/d2a/d25 7 1 2024-04-16T14:35:36.751 INFO:tasks.workunit.client.0.smithi005.stdout:6/778: stat d2/d3f/d47/d84/da5/lac 0 2024-04-16T14:35:36.751 INFO:tasks.workunit.client.0.smithi005.stdout:1/655: stat d2/d1c/d15/d2a/d19/dc9/fe5 0 2024-04-16T14:35:36.751 INFO:tasks.workunit.client.0.smithi005.stdout:6/779: write d2/d45/f74 [2289277,88814] 0 2024-04-16T14:35:36.751 INFO:tasks.workunit.client.0.smithi005.stdout:6/780: write d2/d20/fc5 [294715,59402] 0 2024-04-16T14:35:36.751 INFO:tasks.workunit.client.0.smithi005.stdout:6/781: chown d2/d3f/f4f 0 1 2024-04-16T14:35:36.751 INFO:tasks.workunit.client.0.smithi005.stdout:6/782: fdatasync d2/fd0 0 2024-04-16T14:35:36.754 INFO:tasks.workunit.client.0.smithi005.stdout:1/656: creat d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/dc5/dcd/fed x:0 0 0 2024-04-16T14:35:36.755 INFO:tasks.workunit.client.0.smithi005.stdout:6/783: mkdir d2/d5/d10/dd6/d7a/d109 0 2024-04-16T14:35:36.756 INFO:tasks.workunit.client.0.smithi005.stdout:1/657: creat d2/fee x:0 0 0 2024-04-16T14:35:36.757 INFO:tasks.workunit.client.0.smithi005.stdout:6/784: rename d2/d5/d10/dd6/d7a/d9d to d2/d3f/d47/d84/da5/d10a 0 2024-04-16T14:35:36.758 INFO:tasks.workunit.client.0.smithi005.stdout:1/658: mknod d2/d2c/cef 0 2024-04-16T14:35:36.759 INFO:tasks.workunit.client.0.smithi005.stdout:1/659: getdents d2/d1c/d15/d2a/d19/d42/d71/dac/ddf 0 2024-04-16T14:35:36.759 INFO:tasks.workunit.client.0.smithi005.stdout:1/660: dread - d2/fdc zero size 2024-04-16T14:35:36.759 INFO:tasks.workunit.client.0.smithi005.stdout:1/661: creat d2/d1c/d15/d2a/d19/d20/d27/ff0 x:0 0 0 2024-04-16T14:35:36.759 INFO:tasks.workunit.client.0.smithi005.stdout:1/662: truncate d2/d1c/d15/d2a/d19/fa9 710359 0 2024-04-16T14:35:36.759 INFO:tasks.workunit.client.0.smithi005.stdout:1/663: read d2/d2c/d85/dab/d51/fb9 [20492,38215] 0 2024-04-16T14:35:36.761 INFO:tasks.workunit.client.0.smithi005.stdout:6/785: creat d2/d3f/d9f/f10b x:0 0 0 2024-04-16T14:35:36.763 INFO:tasks.workunit.client.1.smithi115.stdout:6/365: dwrite d13/d1d/d2b/d46/f6b [0,4194304] 0 2024-04-16T14:35:36.763 INFO:tasks.workunit.client.1.smithi115.stdout:0/237: dwrite d6/d10/f20 [4194304,4194304] 0 2024-04-16T14:35:36.763 INFO:tasks.workunit.client.1.smithi115.stdout:7/304: dwrite d0/d1/f1f [0,4194304] 0 2024-04-16T14:35:36.763 INFO:tasks.workunit.client.0.smithi005.stdout:8/565: dwrite d5/d7b/da8/db7/d8a/da1/d68/f75 [0,4194304] 0 2024-04-16T14:35:36.764 INFO:tasks.workunit.client.0.smithi005.stdout:8/566: truncate d5/d7b/da8/db7/d8a/da1/f96 669727 0 2024-04-16T14:35:36.764 INFO:tasks.workunit.client.0.smithi005.stdout:8/567: fdatasync d5/d40/f70 0 2024-04-16T14:35:36.765 INFO:tasks.workunit.client.1.smithi115.stdout:0/238: mkdir d6/d54/d57 0 2024-04-16T14:35:36.765 INFO:tasks.workunit.client.1.smithi115.stdout:4/342: dread d1/d15/d31/f44 [0,4194304] 0 2024-04-16T14:35:36.766 INFO:tasks.workunit.client.0.smithi005.stdout:8/568: mkdir d5/d7b/da8/db7/d8a/da1/d68/dcb 0 2024-04-16T14:35:36.766 INFO:tasks.workunit.client.0.smithi005.stdout:8/569: read d5/d7b/da8/db7/f5b [1079104,16788] 0 2024-04-16T14:35:36.767 INFO:tasks.workunit.client.1.smithi115.stdout:7/305: stat d0/l25 0 2024-04-16T14:35:36.767 INFO:tasks.workunit.client.1.smithi115.stdout:7/306: chown d0/d2/d3a/l67 1 1 2024-04-16T14:35:36.767 INFO:tasks.workunit.client.1.smithi115.stdout:7/307: write d0/d1/d3b/f60 [1515033,62559] 0 2024-04-16T14:35:36.767 INFO:tasks.workunit.client.1.smithi115.stdout:6/366: dread d13/d1d/d2b/d5f/d30/d43/f2d [0,4194304] 0 2024-04-16T14:35:36.767 INFO:tasks.workunit.client.1.smithi115.stdout:7/308: read d0/d1/d3b/d3e/f5c [42159,119119] 0 2024-04-16T14:35:36.767 INFO:tasks.workunit.client.1.smithi115.stdout:0/239: symlink d6/d30/l58 0 2024-04-16T14:35:36.768 INFO:tasks.workunit.client.0.smithi005.stdout:1/664: dread d2/d74/dd7/f8f [0,4194304] 0 2024-04-16T14:35:36.768 INFO:tasks.workunit.client.1.smithi115.stdout:2/362: dwrite d0/d4/f3a [0,4194304] 0 2024-04-16T14:35:36.768 INFO:tasks.workunit.client.1.smithi115.stdout:4/343: creat d1/d15/d31/d55/f56 x:0 0 0 2024-04-16T14:35:36.768 INFO:tasks.workunit.client.1.smithi115.stdout:4/344: truncate d1/d15/d31/d42/f4a 721547 0 2024-04-16T14:35:36.768 INFO:tasks.workunit.client.0.smithi005.stdout:1/665: truncate d2/d1c/d15/f1d 1087204 0 2024-04-16T14:35:36.769 INFO:tasks.workunit.client.1.smithi115.stdout:6/367: symlink d13/d1a/d55/l75 0 2024-04-16T14:35:36.772 INFO:tasks.workunit.client.1.smithi115.stdout:2/363: symlink d0/d4/d57/l78 0 2024-04-16T14:35:36.772 INFO:tasks.workunit.client.1.smithi115.stdout:2/364: fdatasync d0/d4/de/f37 0 2024-04-16T14:35:36.774 INFO:tasks.workunit.client.1.smithi115.stdout:2/365: dread d0/d1b/f41 [0,4194304] 0 2024-04-16T14:35:36.774 INFO:tasks.workunit.client.1.smithi115.stdout:2/366: read - d0/d4/d24/d21/f74 zero size 2024-04-16T14:35:36.774 INFO:tasks.workunit.client.1.smithi115.stdout:4/345: creat d1/d15/f57 x:0 0 0 2024-04-16T14:35:36.775 INFO:tasks.workunit.client.1.smithi115.stdout:2/367: creat d0/d4/d24/f79 x:0 0 0 2024-04-16T14:35:36.777 INFO:tasks.workunit.client.1.smithi115.stdout:4/346: unlink d1/d15/d24/l4c 0 2024-04-16T14:35:36.777 INFO:tasks.workunit.client.1.smithi115.stdout:4/347: fdatasync d1/d15/d1e/f2b 0 2024-04-16T14:35:36.778 INFO:tasks.workunit.client.0.smithi005.stdout:6/786: dread d2/d5/d28/f46 [0,4194304] 0 2024-04-16T14:35:36.778 INFO:tasks.workunit.client.0.smithi005.stdout:6/787: chown d2/d5/d10/dd6/d7a/ld3 34223 1 2024-04-16T14:35:36.778 INFO:tasks.workunit.client.0.smithi005.stdout:6/788: chown d2/d5/d10/dd6/f57 392877 1 2024-04-16T14:35:36.778 INFO:tasks.workunit.client.0.smithi005.stdout:6/789: readlink d2/d3f/d47/d84/ld8 0 2024-04-16T14:35:36.779 INFO:tasks.workunit.client.0.smithi005.stdout:6/790: symlink d2/d5/d10/d68/l10c 0 2024-04-16T14:35:36.779 INFO:tasks.workunit.client.0.smithi005.stdout:6/791: truncate d2/d5/d10/dd6/f57 5444620 0 2024-04-16T14:35:36.779 INFO:tasks.workunit.client.0.smithi005.stdout:6/792: stat d2/d3f/fec 0 2024-04-16T14:35:36.779 INFO:tasks.workunit.client.1.smithi115.stdout:0/240: write d6/d10/d12/d31/d35/f3c [787032,70904] 0 2024-04-16T14:35:36.779 INFO:tasks.workunit.client.1.smithi115.stdout:0/241: creat d6/d10/d12/d31/d35/f59 x:0 0 0 2024-04-16T14:35:36.779 INFO:tasks.workunit.client.1.smithi115.stdout:2/368: symlink d0/d4/d24/d21/d59/l7a 0 2024-04-16T14:35:36.783 INFO:tasks.workunit.client.1.smithi115.stdout:6/368: write d13/d1d/d2b/f67 [3294850,28325] 0 2024-04-16T14:35:36.783 INFO:tasks.workunit.client.0.smithi005.stdout:6/793: dread d2/d5/d28/f38 [4194304,4194304] 0 2024-04-16T14:35:36.784 INFO:tasks.workunit.client.0.smithi005.stdout:3/563: dwrite d2/fe [0,4194304] 0 2024-04-16T14:35:36.785 INFO:tasks.workunit.client.0.smithi005.stdout:6/794: rename d2/d3f/d47/d84/cf4 to d2/d5/d10/d68/c10d 0 2024-04-16T14:35:36.786 INFO:tasks.workunit.client.0.smithi005.stdout:3/564: mkdir d2/dba 0 2024-04-16T14:35:36.786 INFO:tasks.workunit.client.0.smithi005.stdout:3/565: fsync d2/d9/f55 0 2024-04-16T14:35:36.786 INFO:tasks.workunit.client.0.smithi005.stdout:6/795: dread d2/d5/d10/f1d [0,4194304] 0 2024-04-16T14:35:36.787 INFO:tasks.workunit.client.0.smithi005.stdout:5/610: dwrite d0/d6/d12/dc0/f5a [0,4194304] 0 2024-04-16T14:35:36.788 INFO:tasks.workunit.client.0.smithi005.stdout:3/566: symlink d2/d17/d46/d75/d41/lbb 0 2024-04-16T14:35:36.788 INFO:tasks.workunit.client.0.smithi005.stdout:3/567: fsync d2/d9/d25/f91 0 2024-04-16T14:35:36.788 INFO:tasks.workunit.client.0.smithi005.stdout:3/568: dread - d2/d9/d51/fa7 zero size 2024-04-16T14:35:36.789 INFO:tasks.workunit.client.1.smithi115.stdout:6/369: rename d13/d1d/d49/c4c to d13/d1a/d55/c76 0 2024-04-16T14:35:36.789 INFO:tasks.workunit.client.1.smithi115.stdout:6/370: chown d13/d1a/f23 1662175193 1 2024-04-16T14:35:36.789 INFO:tasks.workunit.client.1.smithi115.stdout:6/371: creat d13/d1a/f77 x:0 0 0 2024-04-16T14:35:36.791 INFO:tasks.workunit.client.1.smithi115.stdout:2/369: getdents d0/d4/de/d11 0 2024-04-16T14:35:36.791 INFO:tasks.workunit.client.1.smithi115.stdout:2/370: write d0/d4/d24/f79 [590368,57562] 0 2024-04-16T14:35:36.791 INFO:tasks.workunit.client.0.smithi005.stdout:3/569: creat d2/d17/d46/d75/d9b/fbc x:0 0 0 2024-04-16T14:35:36.791 INFO:tasks.workunit.client.0.smithi005.stdout:3/570: dread - d2/d17/d46/d75/d41/d79/fa4 zero size 2024-04-16T14:35:36.792 INFO:tasks.workunit.client.0.smithi005.stdout:3/571: mkdir d2/d17/d46/d75/d9b/dbd 0 2024-04-16T14:35:36.793 INFO:tasks.workunit.client.0.smithi005.stdout:3/572: creat d2/d9/df/fbe x:0 0 0 2024-04-16T14:35:36.794 INFO:tasks.workunit.client.1.smithi115.stdout:6/372: mknod d13/d1d/d2b/d46/d63/c78 0 2024-04-16T14:35:36.795 INFO:tasks.workunit.client.0.smithi005.stdout:3/573: mkdir d2/d9/df/dbf 0 2024-04-16T14:35:36.798 INFO:tasks.workunit.client.0.smithi005.stdout:3/574: rename d2/d9/f35 to d2/d92/fc0 0 2024-04-16T14:35:36.798 INFO:tasks.workunit.client.0.smithi005.stdout:3/575: fdatasync d2/d17/d46/d47/f62 0 2024-04-16T14:35:36.798 INFO:tasks.workunit.client.0.smithi005.stdout:3/576: creat d2/d9/d51/fc1 x:0 0 0 2024-04-16T14:35:36.798 INFO:tasks.workunit.client.0.smithi005.stdout:6/796: dread d2/d5/f8 [4194304,4194304] 0 2024-04-16T14:35:36.798 INFO:tasks.workunit.client.0.smithi005.stdout:6/797: stat d2/d3f/d47/d84/d8c 0 2024-04-16T14:35:36.798 INFO:tasks.workunit.client.0.smithi005.stdout:6/798: chown d2/d3f/cc4 838 1 2024-04-16T14:35:36.798 INFO:tasks.workunit.client.0.smithi005.stdout:5/611: read d0/d6/d12/dc0/d8d/d5e/f84 [201044,19900] 0 2024-04-16T14:35:36.800 INFO:tasks.workunit.client.0.smithi005.stdout:3/577: mknod d2/d9/d51/cc2 0 2024-04-16T14:35:36.800 INFO:tasks.workunit.client.0.smithi005.stdout:3/578: creat d2/d17/d46/d75/d41/d79/fc3 x:0 0 0 2024-04-16T14:35:36.800 INFO:tasks.workunit.client.0.smithi005.stdout:3/579: write d2/d9/d51/fc1 [283088,12028] 0 2024-04-16T14:35:36.801 INFO:tasks.workunit.client.0.smithi005.stdout:5/612: creat d0/d6/d12/fcf x:0 0 0 2024-04-16T14:35:36.801 INFO:tasks.workunit.client.1.smithi115.stdout:0/242: getdents d6/d30 0 2024-04-16T14:35:36.801 INFO:tasks.workunit.client.1.smithi115.stdout:0/243: chown d6/d30/d4d/f4c 28398 1 2024-04-16T14:35:36.802 INFO:tasks.workunit.client.1.smithi115.stdout:0/244: readlink d6/d38/l37 0 2024-04-16T14:35:36.802 INFO:tasks.workunit.client.1.smithi115.stdout:0/245: chown d6/f33 5288790 1 2024-04-16T14:35:36.802 INFO:tasks.workunit.client.1.smithi115.stdout:0/246: symlink d6/l5a 0 2024-04-16T14:35:36.803 INFO:tasks.workunit.client.1.smithi115.stdout:0/247: chown d6/d10/d12/d1f/c2f 191625164 1 2024-04-16T14:35:36.803 INFO:tasks.workunit.client.1.smithi115.stdout:0/248: dread - d6/d10/d12/d31/d35/d28/f53 zero size 2024-04-16T14:35:36.803 INFO:tasks.workunit.client.1.smithi115.stdout:0/249: creat d6/d10/d12/d31/d35/d28/f5b x:0 0 0 2024-04-16T14:35:36.803 INFO:tasks.workunit.client.1.smithi115.stdout:0/250: write f1 [3970580,27682] 0 2024-04-16T14:35:36.804 INFO:tasks.workunit.client.0.smithi005.stdout:3/580: mkdir d2/d9/df/daa/dc4 0 2024-04-16T14:35:36.804 INFO:tasks.workunit.client.0.smithi005.stdout:3/581: dread - d2/d6b/d7a/f8c zero size 2024-04-16T14:35:36.804 INFO:tasks.workunit.client.1.smithi115.stdout:3/330: sync 2024-04-16T14:35:36.804 INFO:tasks.workunit.client.1.smithi115.stdout:5/299: sync 2024-04-16T14:35:36.804 INFO:tasks.workunit.client.1.smithi115.stdout:1/280: sync 2024-04-16T14:35:36.804 INFO:tasks.workunit.client.1.smithi115.stdout:8/328: sync 2024-04-16T14:35:36.804 INFO:tasks.workunit.client.1.smithi115.stdout:3/331: write dc/d29/d4d/f6d [466983,16326] 0 2024-04-16T14:35:36.805 INFO:tasks.workunit.client.1.smithi115.stdout:3/332: truncate f6 2012084 0 2024-04-16T14:35:36.805 INFO:tasks.workunit.client.0.smithi005.stdout:5/613: creat d0/d6/d12/d1c/fd0 x:0 0 0 2024-04-16T14:35:36.805 INFO:tasks.workunit.client.1.smithi115.stdout:2/371: write d0/d4/d24/d23/f2c [3798753,117661] 0 2024-04-16T14:35:36.806 INFO:tasks.workunit.client.1.smithi115.stdout:5/300: link dc/d15/c38 dc/d5d/c66 0 2024-04-16T14:35:36.806 INFO:tasks.workunit.client.1.smithi115.stdout:5/301: chown dc/d3d/f47 12594000 1 2024-04-16T14:35:36.806 INFO:tasks.workunit.client.1.smithi115.stdout:5/302: truncate dc/d15/f5f 539657 0 2024-04-16T14:35:36.806 INFO:tasks.workunit.client.1.smithi115.stdout:5/303: creat dc/d15/d2d/f67 x:0 0 0 2024-04-16T14:35:36.806 INFO:tasks.workunit.client.1.smithi115.stdout:5/304: readlink dc/d15/l23 0 2024-04-16T14:35:36.806 INFO:tasks.workunit.client.1.smithi115.stdout:9/364: sync 2024-04-16T14:35:36.807 INFO:tasks.workunit.client.1.smithi115.stdout:9/365: write d1/f19 [4462801,127111] 0 2024-04-16T14:35:36.807 INFO:tasks.workunit.client.1.smithi115.stdout:9/366: chown d1/d6/d2d/d4b/d6c/d20/d2a/l48 999 1 2024-04-16T14:35:36.808 INFO:tasks.workunit.client.0.smithi005.stdout:5/614: mkdir d0/dd1 0 2024-04-16T14:35:36.808 INFO:tasks.workunit.client.0.smithi005.stdout:5/615: chown d0/d6/d12/d1c/d1e/cad 454957242 1 2024-04-16T14:35:36.808 INFO:tasks.workunit.client.0.smithi005.stdout:5/616: stat d0/d6/d6e/d9e/cae 0 2024-04-16T14:35:36.808 INFO:tasks.workunit.client.0.smithi005.stdout:1/666: dwrite d2/d1c/d15/d2a/d19/d20/f53 [0,4194304] 0 2024-04-16T14:35:36.808 INFO:tasks.workunit.client.0.smithi005.stdout:1/667: fsync d2/d1c/d15/d2a/d19/d42/d64/fd2 0 2024-04-16T14:35:36.810 INFO:tasks.workunit.client.0.smithi005.stdout:8/570: dwrite d5/d11/f4a [8388608,4194304] 0 2024-04-16T14:35:36.811 INFO:tasks.workunit.client.1.smithi115.stdout:4/348: dwrite d1/f2d [4194304,4194304] 0 2024-04-16T14:35:36.811 INFO:tasks.workunit.client.1.smithi115.stdout:1/281: mknod df/d36/d3c/c5e 0 2024-04-16T14:35:36.812 INFO:tasks.workunit.client.0.smithi005.stdout:1/668: unlink d2/d1c/d15/d2a/d19/f84 0 2024-04-16T14:35:36.815 INFO:tasks.workunit.client.1.smithi115.stdout:0/251: dread d6/fc [4194304,4194304] 0 2024-04-16T14:35:36.821 INFO:tasks.workunit.client.1.smithi115.stdout:5/305: mkdir dc/d3d/d68 0 2024-04-16T14:35:36.821 INFO:tasks.workunit.client.1.smithi115.stdout:5/306: write dc/d15/f18 [3943610,110479] 0 2024-04-16T14:35:36.821 INFO:tasks.workunit.client.1.smithi115.stdout:8/329: symlink d0/db/d10/d25/l65 0 2024-04-16T14:35:36.821 INFO:tasks.workunit.client.1.smithi115.stdout:8/330: truncate d0/db/f55 790005 0 2024-04-16T14:35:36.821 INFO:tasks.workunit.client.1.smithi115.stdout:3/333: dread dc/f22 [0,4194304] 0 2024-04-16T14:35:36.821 INFO:tasks.workunit.client.0.smithi005.stdout:8/571: dread d5/d7b/f83 [0,4194304] 0 2024-04-16T14:35:36.826 INFO:tasks.workunit.client.0.smithi005.stdout:1/669: truncate d2/d74/dd7/f81 572537 0 2024-04-16T14:35:36.826 INFO:tasks.workunit.client.0.smithi005.stdout:1/670: chown d2/d1c/d15/d2a/d1a/d21/f89 453 1 2024-04-16T14:35:36.828 INFO:tasks.workunit.client.0.smithi005.stdout:1/671: dread d2/d1c/fdd [0,4194304] 0 2024-04-16T14:35:36.828 INFO:tasks.workunit.client.0.smithi005.stdout:1/672: fdatasync d2/d1c/d15/d2a/d19/d20/fde 0 2024-04-16T14:35:36.828 INFO:tasks.workunit.client.0.smithi005.stdout:5/617: dread d0/d70/db3/f86 [0,4194304] 0 2024-04-16T14:35:36.829 INFO:tasks.workunit.client.1.smithi115.stdout:1/282: unlink df/d2d/f3f 0 2024-04-16T14:35:36.829 INFO:tasks.workunit.client.1.smithi115.stdout:1/283: creat df/d36/f5f x:0 0 0 2024-04-16T14:35:36.830 INFO:tasks.workunit.client.0.smithi005.stdout:1/673: creat d2/d1c/d15/ff1 x:0 0 0 2024-04-16T14:35:36.830 INFO:tasks.workunit.client.0.smithi005.stdout:1/674: dread - d2/d1c/d15/d2a/d19/d20/fec zero size 2024-04-16T14:35:36.831 INFO:tasks.workunit.client.0.smithi005.stdout:1/675: write d2/fee [94530,106563] 0 2024-04-16T14:35:36.831 INFO:tasks.workunit.client.1.smithi115.stdout:8/331: unlink d0/db/d10/d17/f1d 0 2024-04-16T14:35:36.831 INFO:tasks.workunit.client.1.smithi115.stdout:8/332: read d0/f1f [1973797,90519] 0 2024-04-16T14:35:36.832 INFO:tasks.workunit.client.0.smithi005.stdout:5/618: mkdir d0/d6/d12/d1c/dd2 0 2024-04-16T14:35:36.832 INFO:tasks.workunit.client.0.smithi005.stdout:5/619: chown d0/d6/d12/dc0/d42/cb7 1014793 1 2024-04-16T14:35:36.832 INFO:tasks.workunit.client.1.smithi115.stdout:3/334: unlink dc/d24/d33/f62 0 2024-04-16T14:35:36.833 INFO:tasks.workunit.client.0.smithi005.stdout:1/676: symlink d2/lf2 0 2024-04-16T14:35:36.833 INFO:tasks.workunit.client.0.smithi005.stdout:1/677: write d2/d1c/d15/d6f/f8d [3756714,109507] 0 2024-04-16T14:35:36.834 INFO:tasks.workunit.client.0.smithi005.stdout:1/678: chown d2/fee 128839 1 2024-04-16T14:35:36.834 INFO:tasks.workunit.client.0.smithi005.stdout:1/679: getdents d2/d1c/d15/d2a/d19/d42/d71/dac/ddf 0 2024-04-16T14:35:36.835 INFO:tasks.workunit.client.1.smithi115.stdout:4/349: rename d1/d15/d24/f48 to d1/d15/f58 0 2024-04-16T14:35:36.836 INFO:tasks.workunit.client.1.smithi115.stdout:1/284: creat df/d13/d3a/f60 x:0 0 0 2024-04-16T14:35:36.839 INFO:tasks.workunit.client.1.smithi115.stdout:3/335: rename dc/f5b to dc/d24/f70 0 2024-04-16T14:35:36.842 INFO:tasks.workunit.client.1.smithi115.stdout:3/336: rename dc/c51 to dc/c71 0 2024-04-16T14:35:36.844 INFO:tasks.workunit.client.0.smithi005.stdout:1/680: read d2/d1c/d15/d2a/d25/f5c [6887336,111231] 0 2024-04-16T14:35:36.844 INFO:tasks.workunit.client.1.smithi115.stdout:3/337: creat dc/d24/d36/f72 x:0 0 0 2024-04-16T14:35:36.845 INFO:tasks.workunit.client.0.smithi005.stdout:1/681: symlink d2/d1c/d15/d2a/d19/d6e/lf3 0 2024-04-16T14:35:36.845 INFO:tasks.workunit.client.0.smithi005.stdout:1/682: truncate d2/d1c/d15/d2a/d19/dc9/fe5 970962 0 2024-04-16T14:35:36.845 INFO:tasks.workunit.client.0.smithi005.stdout:1/683: fdatasync d2/d1c/d15/d2a/d19/d20/d27/f79 0 2024-04-16T14:35:36.846 INFO:tasks.workunit.client.1.smithi115.stdout:3/338: creat dc/d24/d33/d4b/f73 x:0 0 0 2024-04-16T14:35:36.846 INFO:tasks.workunit.client.1.smithi115.stdout:3/339: readlink dc/d29/l5d 0 2024-04-16T14:35:36.847 INFO:tasks.workunit.client.1.smithi115.stdout:8/333: dread d0/db/f12 [4194304,4194304] 0 2024-04-16T14:35:36.847 INFO:tasks.workunit.client.1.smithi115.stdout:8/334: fdatasync d0/db/d10/d17/f2b 0 2024-04-16T14:35:36.847 INFO:tasks.workunit.client.0.smithi005.stdout:8/572: dread d5/d11/f44 [0,4194304] 0 2024-04-16T14:35:36.847 INFO:tasks.workunit.client.0.smithi005.stdout:8/573: fdatasync d5/d7b/da8/db7/d8a/da1/d3d/f52 0 2024-04-16T14:35:36.847 INFO:tasks.workunit.client.0.smithi005.stdout:8/574: chown d5/f43 1696898073 1 2024-04-16T14:35:36.848 INFO:tasks.workunit.client.1.smithi115.stdout:8/335: mknod d0/db/d10/c66 0 2024-04-16T14:35:36.849 INFO:tasks.workunit.client.1.smithi115.stdout:8/336: chown d0/db/d10/l38 1783 1 2024-04-16T14:35:36.849 INFO:tasks.workunit.client.1.smithi115.stdout:4/350: write d1/d15/f3f [2305518,104467] 0 2024-04-16T14:35:36.850 INFO:tasks.workunit.client.1.smithi115.stdout:4/351: write d1/d2/ff [4596568,74203] 0 2024-04-16T14:35:36.850 INFO:tasks.workunit.client.1.smithi115.stdout:8/337: creat d0/db/d10/d25/f67 x:0 0 0 2024-04-16T14:35:36.850 INFO:tasks.workunit.client.1.smithi115.stdout:2/372: dwrite d0/d47/d65/f77 [0,4194304] 0 2024-04-16T14:35:36.850 INFO:tasks.workunit.client.1.smithi115.stdout:2/373: chown d0/d1b/f4b 121353 1 2024-04-16T14:35:36.850 INFO:tasks.workunit.client.1.smithi115.stdout:2/374: readlink d0/d4/d57/l78 0 2024-04-16T14:35:36.851 INFO:tasks.workunit.client.1.smithi115.stdout:2/375: fsync d0/d1b/f41 0 2024-04-16T14:35:36.851 INFO:tasks.workunit.client.1.smithi115.stdout:4/352: truncate d1/d2/f11 1318086 0 2024-04-16T14:35:36.852 INFO:tasks.workunit.client.1.smithi115.stdout:8/338: creat d0/db/d10/d17/d2c/d61/d64/f68 x:0 0 0 2024-04-16T14:35:36.855 INFO:tasks.workunit.client.1.smithi115.stdout:4/353: symlink d1/d15/d31/d42/d46/l59 0 2024-04-16T14:35:36.856 INFO:tasks.workunit.client.1.smithi115.stdout:4/354: mknod d1/c5a 0 2024-04-16T14:35:36.857 INFO:tasks.workunit.client.1.smithi115.stdout:4/355: chown d1/d15/d1e/f35 61052691 1 2024-04-16T14:35:36.860 INFO:tasks.workunit.client.1.smithi115.stdout:4/356: creat d1/d2/f5b x:0 0 0 2024-04-16T14:35:36.860 INFO:tasks.workunit.client.1.smithi115.stdout:3/340: dread dc/d24/d36/f4e [0,4194304] 0 2024-04-16T14:35:36.863 INFO:tasks.workunit.client.1.smithi115.stdout:2/376: write d0/d4/f3a [1070953,30113] 0 2024-04-16T14:35:36.863 INFO:tasks.workunit.client.1.smithi115.stdout:2/377: chown d0 21 1 2024-04-16T14:35:36.863 INFO:tasks.workunit.client.1.smithi115.stdout:4/357: symlink d1/d15/d31/d42/l5c 0 2024-04-16T14:35:36.866 INFO:tasks.workunit.client.1.smithi115.stdout:2/378: getdents d0 0 2024-04-16T14:35:36.866 INFO:tasks.workunit.client.1.smithi115.stdout:2/379: creat d0/d47/d65/f7b x:0 0 0 2024-04-16T14:35:36.866 INFO:tasks.workunit.client.1.smithi115.stdout:3/341: dread f6 [0,4194304] 0 2024-04-16T14:35:36.866 INFO:tasks.workunit.client.1.smithi115.stdout:3/342: creat dc/d24/d33/f74 x:0 0 0 2024-04-16T14:35:36.866 INFO:tasks.workunit.client.1.smithi115.stdout:4/358: creat d1/d15/d1e/f5d x:0 0 0 2024-04-16T14:35:36.867 INFO:tasks.workunit.client.0.smithi005.stdout:3/582: dwrite d2/d17/f38 [4194304,4194304] 0 2024-04-16T14:35:36.867 INFO:tasks.workunit.client.0.smithi005.stdout:3/583: dread d2/d9/d25/d39/f7f [0,4194304] 0 2024-04-16T14:35:36.867 INFO:tasks.workunit.client.0.smithi005.stdout:3/584: chown d2/d9/d25/d39 1469868225 1 2024-04-16T14:35:36.868 INFO:tasks.workunit.client.0.smithi005.stdout:3/585: dread - d2/d9/d25/d39/f6a zero size 2024-04-16T14:35:36.869 INFO:tasks.workunit.client.1.smithi115.stdout:2/380: rename d0/d1b/f6a to d0/d4/d24/d23/f7c 0 2024-04-16T14:35:36.870 INFO:tasks.workunit.client.0.smithi005.stdout:3/586: rename d2/d9/d25/d39/lab to d2/d9/d25/lc5 0 2024-04-16T14:35:36.870 INFO:tasks.workunit.client.0.smithi005.stdout:3/587: write d2/d9/d25/d39/f7f [1015493,14271] 0 2024-04-16T14:35:36.870 INFO:tasks.workunit.client.1.smithi115.stdout:3/343: rmdir dc/d29/d4d/d56/d66 0 2024-04-16T14:35:36.871 INFO:tasks.workunit.client.0.smithi005.stdout:3/588: mknod d2/d6b/d7a/cc6 0 2024-04-16T14:35:36.871 INFO:tasks.workunit.client.1.smithi115.stdout:4/359: symlink d1/d15/d1e/l5e 0 2024-04-16T14:35:36.872 INFO:tasks.workunit.client.1.smithi115.stdout:2/381: mknod d0/d47/c7d 0 2024-04-16T14:35:36.872 INFO:tasks.workunit.client.0.smithi005.stdout:3/589: creat d2/d9/fc7 x:0 0 0 2024-04-16T14:35:36.873 INFO:tasks.workunit.client.1.smithi115.stdout:4/360: mknod d1/d15/d24/c5f 0 2024-04-16T14:35:36.873 INFO:tasks.workunit.client.0.smithi005.stdout:3/590: fdatasync d2/d17/d46/d75/d6d/f73 0 2024-04-16T14:35:36.875 INFO:tasks.workunit.client.1.smithi115.stdout:4/361: symlink d1/d15/d31/l60 0 2024-04-16T14:35:36.875 INFO:tasks.workunit.client.1.smithi115.stdout:4/362: fdatasync d1/d15/f58 0 2024-04-16T14:35:36.876 INFO:tasks.workunit.client.1.smithi115.stdout:4/363: symlink d1/d15/d1e/l61 0 2024-04-16T14:35:36.877 INFO:tasks.workunit.client.1.smithi115.stdout:3/344: dread dc/f21 [0,4194304] 0 2024-04-16T14:35:36.877 INFO:tasks.workunit.client.1.smithi115.stdout:9/367: dwrite d1/d6/d2d/d3d/d50/f5e [0,4194304] 0 2024-04-16T14:35:36.877 INFO:tasks.workunit.client.1.smithi115.stdout:3/345: write dc/d24/d36/f72 [122859,40059] 0 2024-04-16T14:35:36.877 INFO:tasks.workunit.client.1.smithi115.stdout:9/368: fsync d1/d6/d2d/f71 0 2024-04-16T14:35:36.878 INFO:tasks.workunit.client.1.smithi115.stdout:5/307: dwrite dc/d15/f27 [0,4194304] 0 2024-04-16T14:35:36.880 INFO:tasks.workunit.client.1.smithi115.stdout:3/346: symlink dc/d29/d39/l75 0 2024-04-16T14:35:36.881 INFO:tasks.workunit.client.1.smithi115.stdout:4/364: getdents d1/d15/d31/d55 0 2024-04-16T14:35:36.884 INFO:tasks.workunit.client.1.smithi115.stdout:9/369: getdents d1/d6/d2d/d4b/d6c 0 2024-04-16T14:35:36.886 INFO:tasks.workunit.client.1.smithi115.stdout:3/347: truncate dc/f27 3851419 0 2024-04-16T14:35:36.887 INFO:tasks.workunit.client.0.smithi005.stdout:0/577: sync 2024-04-16T14:35:36.887 INFO:tasks.workunit.client.0.smithi005.stdout:2/326: sync 2024-04-16T14:35:36.887 INFO:tasks.workunit.client.0.smithi005.stdout:7/676: sync 2024-04-16T14:35:36.887 INFO:tasks.workunit.client.0.smithi005.stdout:4/828: sync 2024-04-16T14:35:36.888 INFO:tasks.workunit.client.0.smithi005.stdout:4/829: chown d0/d1b/d1d/d4f/d75/cc8 7489231 1 2024-04-16T14:35:36.888 INFO:tasks.workunit.client.0.smithi005.stdout:7/677: chown d1/d49/d74/d77/d22/d27/f2b 149282746 1 2024-04-16T14:35:36.888 INFO:tasks.workunit.client.0.smithi005.stdout:9/394: sync 2024-04-16T14:35:36.889 INFO:tasks.workunit.client.0.smithi005.stdout:2/327: mkdir d0/d1c/d59/d67 0 2024-04-16T14:35:36.891 INFO:tasks.workunit.client.0.smithi005.stdout:7/678: creat d1/d49/d74/ddf/fe5 x:0 0 0 2024-04-16T14:35:36.893 INFO:tasks.workunit.client.0.smithi005.stdout:4/830: symlink d0/d1b/d1d/d1f/d5d/da7/d90/de4/l102 0 2024-04-16T14:35:36.894 INFO:tasks.workunit.client.0.smithi005.stdout:9/395: link d3/d49/f66 d3/d49/d4b/f70 0 2024-04-16T14:35:36.896 INFO:tasks.workunit.client.0.smithi005.stdout:4/831: mkdir d0/d1b/d1d/dc3/d103 0 2024-04-16T14:35:36.897 INFO:tasks.workunit.client.1.smithi115.stdout:5/308: dread dc/d15/f24 [0,4194304] 0 2024-04-16T14:35:36.897 INFO:tasks.workunit.client.1.smithi115.stdout:2/382: dread d0/d47/d65/f77 [0,4194304] 0 2024-04-16T14:35:36.897 INFO:tasks.workunit.client.1.smithi115.stdout:2/383: dread - d0/d4/d24/d23/d52/f6f zero size 2024-04-16T14:35:36.897 INFO:tasks.workunit.client.1.smithi115.stdout:0/252: dwrite d6/d10/d12/d31/d35/d44/f50 [0,4194304] 0 2024-04-16T14:35:36.897 INFO:tasks.workunit.client.1.smithi115.stdout:2/384: creat d0/d4/d24/d10/f7e x:0 0 0 2024-04-16T14:35:36.898 INFO:tasks.workunit.client.1.smithi115.stdout:8/339: dwrite d0/db/d10/d17/d2c/f43 [0,4194304] 0 2024-04-16T14:35:36.899 INFO:tasks.workunit.client.0.smithi005.stdout:5/620: dwrite d0/d6/d12/fcf [0,4194304] 0 2024-04-16T14:35:36.899 INFO:tasks.workunit.client.0.smithi005.stdout:1/684: dwrite d2/d1c/d15/d2a/d19/d20/d27/f54 [0,4194304] 0 2024-04-16T14:35:36.900 INFO:tasks.workunit.client.0.smithi005.stdout:1/685: stat d2/d1c/d15/d2a/c60 0 2024-04-16T14:35:36.900 INFO:tasks.workunit.client.0.smithi005.stdout:1/686: write d2/d1c/d15/d2a/d19/d42/d64/d76/faf [958109,39871] 0 2024-04-16T14:35:36.900 INFO:tasks.workunit.client.0.smithi005.stdout:8/575: dwrite d5/f43 [0,4194304] 0 2024-04-16T14:35:36.900 INFO:tasks.workunit.client.0.smithi005.stdout:9/396: symlink d3/d12/d2b/l71 0 2024-04-16T14:35:36.901 INFO:tasks.workunit.client.0.smithi005.stdout:4/832: mkdir d0/d1b/d1d/d1f/d3e/d6d/da1/d104 0 2024-04-16T14:35:36.901 INFO:tasks.workunit.client.0.smithi005.stdout:4/833: write d0/d22/d61/fe7 [890270,37058] 0 2024-04-16T14:35:36.903 INFO:tasks.workunit.client.0.smithi005.stdout:9/397: dread d3/f10 [0,4194304] 0 2024-04-16T14:35:36.903 INFO:tasks.workunit.client.1.smithi115.stdout:0/253: rename d6/d10/f22 to d6/d10/d12/d1f/d36/d4b/f5c 0 2024-04-16T14:35:36.903 INFO:tasks.workunit.client.1.smithi115.stdout:1/285: dwrite df/f25 [0,4194304] 0 2024-04-16T14:35:36.908 INFO:tasks.workunit.client.0.smithi005.stdout:1/687: rename d2/d1c/d15/d2a/d19/d42/d71/dac/ddf to d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/dc5/df4 0 2024-04-16T14:35:36.911 INFO:tasks.workunit.client.0.smithi005.stdout:8/576: symlink d5/da0/lcc 0 2024-04-16T14:35:36.912 INFO:tasks.workunit.client.0.smithi005.stdout:8/577: chown d5/d7b/c3e 4 1 2024-04-16T14:35:36.912 INFO:tasks.workunit.client.0.smithi005.stdout:8/578: fsync d5/d7b/da8/db7/d8a/da1/d3d/d7f/f9d 0 2024-04-16T14:35:36.912 INFO:tasks.workunit.client.0.smithi005.stdout:9/398: creat d3/d12/d2b/f72 x:0 0 0 2024-04-16T14:35:36.912 INFO:tasks.workunit.client.0.smithi005.stdout:1/688: creat d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/ff5 x:0 0 0 2024-04-16T14:35:36.912 INFO:tasks.workunit.client.0.smithi005.stdout:1/689: dread - d2/d1c/d15/ff1 zero size 2024-04-16T14:35:36.912 INFO:tasks.workunit.client.1.smithi115.stdout:5/309: dread dc/f2c [0,4194304] 0 2024-04-16T14:35:36.913 INFO:tasks.workunit.client.0.smithi005.stdout:8/579: rename d5/d7b/da8/db7/d8a/da1/d3d/dba/dc0 to d5/d7b/da8/db7/d8a/da1/d3d/dba/dcd 0 2024-04-16T14:35:36.918 INFO:tasks.workunit.client.1.smithi115.stdout:4/365: dwrite d1/d15/d24/f40 [0,4194304] 0 2024-04-16T14:35:36.919 INFO:tasks.workunit.client.0.smithi005.stdout:2/328: dwrite d0/d1c/f33 [0,4194304] 0 2024-04-16T14:35:36.919 INFO:tasks.workunit.client.1.smithi115.stdout:0/254: mknod d6/d54/d57/c5d 0 2024-04-16T14:35:36.921 INFO:tasks.workunit.client.1.smithi115.stdout:1/286: rename f9 to df/d35/d48/f61 0 2024-04-16T14:35:36.921 INFO:tasks.workunit.client.0.smithi005.stdout:1/690: dread d2/d2c/d85/dab/f93 [0,4194304] 0 2024-04-16T14:35:36.923 INFO:tasks.workunit.client.0.smithi005.stdout:2/329: creat d0/d1c/d39/f68 x:0 0 0 2024-04-16T14:35:36.925 INFO:tasks.workunit.client.1.smithi115.stdout:2/385: rmdir d0/d4/d24/d23/d52 39 2024-04-16T14:35:36.926 INFO:tasks.workunit.client.0.smithi005.stdout:1/691: creat d2/d1c/d15/d2a/ff6 x:0 0 0 2024-04-16T14:35:36.927 INFO:tasks.workunit.client.1.smithi115.stdout:4/366: unlink d1/d15/d31/f45 0 2024-04-16T14:35:36.929 INFO:tasks.workunit.client.0.smithi005.stdout:2/330: mknod d0/c69 0 2024-04-16T14:35:36.932 INFO:tasks.workunit.client.1.smithi115.stdout:0/255: mknod d6/d10/d12/d1f/d36/c5e 0 2024-04-16T14:35:36.937 INFO:tasks.workunit.client.1.smithi115.stdout:4/367: symlink d1/d15/d24/l62 0 2024-04-16T14:35:36.978 INFO:tasks.workunit.client.0.smithi005.stdout:4/834: dwrite d0/d1b/d1d/d1f/d5d/da9/f3b [0,4194304] 0 2024-04-16T14:35:36.978 INFO:tasks.workunit.client.0.smithi005.stdout:4/835: creat d0/d1b/d1d/d1f/f105 x:0 0 0 2024-04-16T14:35:36.979 INFO:tasks.workunit.client.0.smithi005.stdout:9/399: dwrite d3/d12/d16/f4d [0,4194304] 0 2024-04-16T14:35:36.979 INFO:tasks.workunit.client.0.smithi005.stdout:8/580: dwrite d5/d40/d4b/f93 [0,4194304] 0 2024-04-16T14:35:36.979 INFO:tasks.workunit.client.1.smithi115.stdout:8/340: dwrite d0/db/d10/f42 [0,4194304] 0 2024-04-16T14:35:36.979 INFO:tasks.workunit.client.1.smithi115.stdout:5/310: dwrite dc/d3d/f5a [0,4194304] 0 2024-04-16T14:35:36.980 INFO:tasks.workunit.client.1.smithi115.stdout:2/386: dwrite d0/d4/d24/d21/d59/f68 [0,4194304] 0 2024-04-16T14:35:36.980 INFO:tasks.workunit.client.0.smithi005.stdout:2/331: dwrite d0/d2a/f52 [0,4194304] 0 2024-04-16T14:35:36.980 INFO:tasks.workunit.client.0.smithi005.stdout:2/332: fsync d0/d4/f28 0 2024-04-16T14:35:36.981 INFO:tasks.workunit.client.1.smithi115.stdout:8/341: truncate d0/f3 507504 0 2024-04-16T14:35:36.982 INFO:tasks.workunit.client.0.smithi005.stdout:4/836: unlink d0/d1b/d1d/d1f/d5d/da7/lf7 0 2024-04-16T14:35:36.983 INFO:tasks.workunit.client.1.smithi115.stdout:5/311: mkdir dc/d15/d35/d69 0 2024-04-16T14:35:36.983 INFO:tasks.workunit.client.0.smithi005.stdout:8/581: getdents d5/d7b/da8/db7/d8a 0 2024-04-16T14:35:36.983 INFO:tasks.workunit.client.0.smithi005.stdout:8/582: creat d5/d40/d8e/fce x:0 0 0 2024-04-16T14:35:36.985 INFO:tasks.workunit.client.0.smithi005.stdout:5/621: dwrite d0/d6/d12/dc0/d8d/d5e/f84 [0,4194304] 0 2024-04-16T14:35:36.986 INFO:tasks.workunit.client.0.smithi005.stdout:5/622: chown d0/d6/d12/d1c/c60 5812 1 2024-04-16T14:35:36.986 INFO:tasks.workunit.client.1.smithi115.stdout:2/387: unlink d0/d4/f6b 0 2024-04-16T14:35:36.987 INFO:tasks.workunit.client.1.smithi115.stdout:2/388: getdents d0/d47 0 2024-04-16T14:35:36.987 INFO:tasks.workunit.client.1.smithi115.stdout:0/256: getdents d6/d54/d57 0 2024-04-16T14:35:36.989 INFO:tasks.workunit.client.0.smithi005.stdout:4/837: link d0/d1b/d1d/d1f/d3e/f5e d0/d1b/d1d/dc3/f106 0 2024-04-16T14:35:36.990 INFO:tasks.workunit.client.1.smithi115.stdout:2/389: rmdir d0/d47/d65/d61 39 2024-04-16T14:35:36.990 INFO:tasks.workunit.client.1.smithi115.stdout:2/390: readlink d0/d4/d24/d10/l76 0 2024-04-16T14:35:36.990 INFO:tasks.workunit.client.1.smithi115.stdout:1/287: dwrite df/d13/d4d/d2c/f33 [0,4194304] 0 2024-04-16T14:35:36.993 INFO:tasks.workunit.client.0.smithi005.stdout:8/583: creat d5/d7b/da8/fcf x:0 0 0 2024-04-16T14:35:36.993 INFO:tasks.workunit.client.1.smithi115.stdout:1/288: dread df/d13/d4d/f32 [0,4194304] 0 2024-04-16T14:35:36.993 INFO:tasks.workunit.client.0.smithi005.stdout:2/333: dread d0/d29/f49 [0,4194304] 0 2024-04-16T14:35:36.995 INFO:tasks.workunit.client.0.smithi005.stdout:9/400: write d3/d12/d16/d46/d47/f5a [836835,84350] 0 2024-04-16T14:35:36.997 INFO:tasks.workunit.client.0.smithi005.stdout:8/584: creat d5/d7b/da8/db7/d8a/da1/fd0 x:0 0 0 2024-04-16T14:35:36.997 INFO:tasks.workunit.client.1.smithi115.stdout:1/289: link df/d13/d4d/d2c/f3b df/d13/d4d/d3e/f62 0 2024-04-16T14:35:36.998 INFO:tasks.workunit.client.1.smithi115.stdout:1/290: write df/d35/d48/f4c [444567,42659] 0 2024-04-16T14:35:36.998 INFO:tasks.workunit.client.1.smithi115.stdout:1/291: dread - df/d36/f5f zero size 2024-04-16T14:35:36.998 INFO:tasks.workunit.client.1.smithi115.stdout:8/342: dread d0/db/d10/f42 [0,4194304] 0 2024-04-16T14:35:36.998 INFO:tasks.workunit.client.0.smithi005.stdout:9/401: link d3/d49/d4b/d55/l5f d3/d12/d2b/l73 0 2024-04-16T14:35:36.999 INFO:tasks.workunit.client.1.smithi115.stdout:8/343: creat d0/db/d10/d17/f69 x:0 0 0 2024-04-16T14:35:37.002 INFO:tasks.workunit.client.0.smithi005.stdout:8/585: mkdir d5/d7b/da8/db7/d8a/da1/d3d/d7f/d8d/dd1 0 2024-04-16T14:35:37.002 INFO:tasks.workunit.client.0.smithi005.stdout:8/586: write d5/d11/d6c/d71/fb9 [381143,37497] 0 2024-04-16T14:35:37.002 INFO:tasks.workunit.client.1.smithi115.stdout:3/348: dread dc/f27 [0,4194304] 0 2024-04-16T14:35:37.002 INFO:tasks.workunit.client.1.smithi115.stdout:3/349: read dc/f31 [445001,86010] 0 2024-04-16T14:35:37.003 INFO:tasks.workunit.client.0.smithi005.stdout:2/334: link d0/d29/d3e/l4d d0/d1c/d39/d48/l6a 0 2024-04-16T14:35:37.003 INFO:tasks.workunit.client.0.smithi005.stdout:9/402: getdents d3/d12 0 2024-04-16T14:35:37.004 INFO:tasks.workunit.client.1.smithi115.stdout:3/350: rmdir dc/d24/d33 39 2024-04-16T14:35:37.005 INFO:tasks.workunit.client.0.smithi005.stdout:1/692: dwrite d2/d74/dd7/f90 [0,4194304] 0 2024-04-16T14:35:37.006 INFO:tasks.workunit.client.1.smithi115.stdout:3/351: link dc/d29/d4d/d56/f5c dc/d29/d39/f76 0 2024-04-16T14:35:37.008 INFO:tasks.workunit.client.1.smithi115.stdout:3/352: mkdir dc/d29/d77 0 2024-04-16T14:35:37.009 INFO:tasks.workunit.client.1.smithi115.stdout:3/353: creat dc/d24/d36/d60/f78 x:0 0 0 2024-04-16T14:35:37.009 INFO:tasks.workunit.client.1.smithi115.stdout:0/257: write d6/d10/d12/d1f/f32 [751649,75731] 0 2024-04-16T14:35:37.011 INFO:tasks.workunit.client.0.smithi005.stdout:1/693: rename d2/d1c/d15/d2a/d19/d20/l32 to d2/d1c/d15/d2a/db6/lf7 0 2024-04-16T14:35:37.012 INFO:tasks.workunit.client.1.smithi115.stdout:3/354: creat dc/d24/d33/f79 x:0 0 0 2024-04-16T14:35:37.012 INFO:tasks.workunit.client.1.smithi115.stdout:0/258: mkdir d6/d10/d12/d5f 0 2024-04-16T14:35:37.014 INFO:tasks.workunit.client.1.smithi115.stdout:0/259: mknod d6/d1b/d4e/c60 0 2024-04-16T14:35:37.015 INFO:tasks.workunit.client.0.smithi005.stdout:2/335: read d0/d2a/f63 [3706051,53952] 0 2024-04-16T14:35:37.017 INFO:tasks.workunit.client.1.smithi115.stdout:0/260: unlink d6/l5a 0 2024-04-16T14:35:37.017 INFO:tasks.workunit.client.0.smithi005.stdout:4/838: dwrite d0/d1b/d1d/d1f/d3e/fcf [0,4194304] 0 2024-04-16T14:35:37.018 INFO:tasks.workunit.client.0.smithi005.stdout:5/623: dwrite d0/d6/d12/f45 [4194304,4194304] 0 2024-04-16T14:35:37.019 INFO:tasks.workunit.client.1.smithi115.stdout:4/368: dwrite d1/d15/d31/d55/f56 [0,4194304] 0 2024-04-16T14:35:37.019 INFO:tasks.workunit.client.0.smithi005.stdout:4/839: read d0/d1b/d1d/d4f/d75/fd2 [142673,44151] 0 2024-04-16T14:35:37.020 INFO:tasks.workunit.client.1.smithi115.stdout:2/391: dwrite d0/d4/d24/d23/f2c [0,4194304] 0 2024-04-16T14:35:37.020 INFO:tasks.workunit.client.1.smithi115.stdout:0/261: rename d6/d1b/c47 to d6/d10/d12/d31/c61 0 2024-04-16T14:35:37.024 INFO:tasks.workunit.client.0.smithi005.stdout:1/694: mkdir d2/d1c/d15/d2a/d19/dc9/de0/df8 0 2024-04-16T14:35:37.027 INFO:tasks.workunit.client.1.smithi115.stdout:2/392: creat d0/d47/f7f x:0 0 0 2024-04-16T14:35:37.028 INFO:tasks.workunit.client.0.smithi005.stdout:2/336: mkdir d0/d4/d2b/d6b 0 2024-04-16T14:35:37.029 INFO:tasks.workunit.client.1.smithi115.stdout:2/393: mkdir d0/d4/d24/d23/d80 0 2024-04-16T14:35:37.030 INFO:tasks.workunit.client.0.smithi005.stdout:4/840: rename d0/d1b/d1d/d1f/d3e/d6d/da1 to d0/d22/d29/d107 0 2024-04-16T14:35:37.030 INFO:tasks.workunit.client.0.smithi005.stdout:4/841: dread - d0/d1b/d1d/dde/fe9 zero size 2024-04-16T14:35:37.031 INFO:tasks.workunit.client.0.smithi005.stdout:1/695: mknod d2/d1c/d15/d2a/d19/d20/cf9 0 2024-04-16T14:35:37.032 INFO:tasks.workunit.client.1.smithi115.stdout:5/312: dwrite dc/d15/f18 [0,4194304] 0 2024-04-16T14:35:37.032 INFO:tasks.workunit.client.1.smithi115.stdout:5/313: creat dc/d3d/f6a x:0 0 0 2024-04-16T14:35:37.033 INFO:tasks.workunit.client.0.smithi005.stdout:4/842: mknod d0/d1b/d1d/d1f/d5d/da7/db4/c108 0 2024-04-16T14:35:37.033 INFO:tasks.workunit.client.0.smithi005.stdout:5/624: read d0/d6/d12/dc0/d30/f68 [2960463,16487] 0 2024-04-16T14:35:37.033 INFO:tasks.workunit.client.0.smithi005.stdout:5/625: truncate d0/d6/d6e/d9e/fc4 109924 0 2024-04-16T14:35:37.033 INFO:tasks.workunit.client.0.smithi005.stdout:5/626: write d0/d6/d6e/f7e [2995262,84680] 0 2024-04-16T14:35:37.033 INFO:tasks.workunit.client.1.smithi115.stdout:5/314: readlink dc/d15/l1b 0 2024-04-16T14:35:37.034 INFO:tasks.workunit.client.0.smithi005.stdout:1/696: unlink d2/d1c/d15/d2a/d1a/d21/fe1 0 2024-04-16T14:35:37.034 INFO:tasks.workunit.client.1.smithi115.stdout:5/315: mknod dc/d3d/c6b 0 2024-04-16T14:35:37.035 INFO:tasks.workunit.client.0.smithi005.stdout:4/843: creat d0/d22/d29/d107/d104/f109 x:0 0 0 2024-04-16T14:35:37.036 INFO:tasks.workunit.client.0.smithi005.stdout:4/844: rename d0/d4d/cee to d0/d22/d61/dbe/c10a 0 2024-04-16T14:35:37.038 INFO:tasks.workunit.client.0.smithi005.stdout:4/845: link d0/d1b/da5/fac d0/d1b/db7/ddd/f10b 0 2024-04-16T14:35:37.040 INFO:tasks.workunit.client.0.smithi005.stdout:4/846: mknod d0/d47/c10c 0 2024-04-16T14:35:37.040 INFO:tasks.workunit.client.0.smithi005.stdout:4/847: chown d0/d1b/d1d/dde/fe9 1301297 1 2024-04-16T14:35:37.040 INFO:tasks.workunit.client.0.smithi005.stdout:4/848: chown d0/d1b/l65 22185792 1 2024-04-16T14:35:37.041 INFO:tasks.workunit.client.0.smithi005.stdout:4/849: mkdir d0/d22/df2/d10d 0 2024-04-16T14:35:37.041 INFO:tasks.workunit.client.0.smithi005.stdout:4/850: truncate d0/d1b/d1d/d1f/d5d/da9/ff9 516058 0 2024-04-16T14:35:37.041 INFO:tasks.workunit.client.0.smithi005.stdout:4/851: write d0/d1b/da5/fca [493195,13535] 0 2024-04-16T14:35:37.042 INFO:tasks.workunit.client.1.smithi115.stdout:3/355: dwrite dc/d24/d36/f4e [0,4194304] 0 2024-04-16T14:35:37.042 INFO:tasks.workunit.client.0.smithi005.stdout:4/852: mknod d0/d1b/d1d/d1f/d3e/c10e 0 2024-04-16T14:35:37.042 INFO:tasks.workunit.client.1.smithi115.stdout:3/356: creat dc/d24/d36/d60/f7a x:0 0 0 2024-04-16T14:35:37.042 INFO:tasks.workunit.client.1.smithi115.stdout:3/357: write dc/d29/d39/f76 [14030,32015] 0 2024-04-16T14:35:37.045 INFO:tasks.workunit.client.1.smithi115.stdout:3/358: write dc/d24/d33/d4b/f55 [742059,109309] 0 2024-04-16T14:35:37.045 INFO:tasks.workunit.client.0.smithi005.stdout:4/853: symlink d0/d1b/db7/ddd/l10f 0 2024-04-16T14:35:37.046 INFO:tasks.workunit.client.0.smithi005.stdout:2/337: write d0/d2a/d3a/d46/f5d [492880,112320] 0 2024-04-16T14:35:37.046 INFO:tasks.workunit.client.0.smithi005.stdout:2/338: stat d0/d2a/d3a/d46/f56 0 2024-04-16T14:35:37.046 INFO:tasks.workunit.client.0.smithi005.stdout:2/339: fdatasync d0/d1c/d59/f5a 0 2024-04-16T14:35:37.046 INFO:tasks.workunit.client.0.smithi005.stdout:4/854: creat d0/d1b/d1d/d1f/d48/dab/dcb/f110 x:0 0 0 2024-04-16T14:35:37.048 INFO:tasks.workunit.client.1.smithi115.stdout:0/262: write d6/d10/d12/d31/d35/d44/f50 [3332480,72881] 0 2024-04-16T14:35:37.048 INFO:tasks.workunit.client.1.smithi115.stdout:0/263: readlink d6/l13 0 2024-04-16T14:35:37.048 INFO:tasks.workunit.client.1.smithi115.stdout:0/264: chown d6/d10/d12/d31/d35/d44/f50 7 1 2024-04-16T14:35:37.048 INFO:tasks.workunit.client.1.smithi115.stdout:3/359: getdents dc/d24 0 2024-04-16T14:35:37.049 INFO:tasks.workunit.client.0.smithi005.stdout:2/340: mknod d0/d1c/d39/c6c 0 2024-04-16T14:35:37.051 INFO:tasks.workunit.client.1.smithi115.stdout:0/265: mknod d6/d10/d12/d5f/c62 0 2024-04-16T14:35:37.051 INFO:tasks.workunit.client.0.smithi005.stdout:2/341: link d0/d4/d2b/c23 d0/d4/d2b/d6b/c6d 0 2024-04-16T14:35:37.057 INFO:tasks.workunit.client.0.smithi005.stdout:2/342: unlink d0/d29/d3e/c3f 0 2024-04-16T14:35:37.059 INFO:tasks.workunit.client.0.smithi005.stdout:2/343: symlink d0/l6e 0 2024-04-16T14:35:37.059 INFO:tasks.workunit.client.0.smithi005.stdout:2/344: chown d0/d29 21 1 2024-04-16T14:35:37.064 INFO:tasks.workunit.client.1.smithi115.stdout:4/369: dwrite d1/d15/f57 [0,4194304] 0 2024-04-16T14:35:37.064 INFO:tasks.workunit.client.1.smithi115.stdout:8/344: dwrite d0/db/d10/f1e [0,4194304] 0 2024-04-16T14:35:37.065 INFO:tasks.workunit.client.1.smithi115.stdout:4/370: fsync d1/d15/d31/f44 0 2024-04-16T14:35:37.065 INFO:tasks.workunit.client.1.smithi115.stdout:4/371: write d1/d15/f4d [293677,15222] 0 2024-04-16T14:35:37.065 INFO:tasks.workunit.client.1.smithi115.stdout:4/372: read d1/d2/f11 [98654,70172] 0 2024-04-16T14:35:37.065 INFO:tasks.workunit.client.1.smithi115.stdout:4/373: write d1/d15/d1e/f2b [679647,11552] 0 2024-04-16T14:35:37.065 INFO:tasks.workunit.client.1.smithi115.stdout:4/374: write d1/f2d [9268039,65268] 0 2024-04-16T14:35:37.065 INFO:tasks.workunit.client.1.smithi115.stdout:4/375: write d1/d15/f58 [918805,86548] 0 2024-04-16T14:35:37.067 INFO:tasks.workunit.client.1.smithi115.stdout:8/345: creat d0/db/d10/d17/d2c/d61/f6a x:0 0 0 2024-04-16T14:35:37.069 INFO:tasks.workunit.client.1.smithi115.stdout:4/376: creat d1/d15/d31/d42/d46/f63 x:0 0 0 2024-04-16T14:35:37.070 INFO:tasks.workunit.client.1.smithi115.stdout:8/346: mkdir d0/db/d10/d17/d2c/d61/d6b 0 2024-04-16T14:35:37.070 INFO:tasks.workunit.client.1.smithi115.stdout:8/347: fdatasync d0/db/d10/d17/d2c/f5e 0 2024-04-16T14:35:37.070 INFO:tasks.workunit.client.1.smithi115.stdout:7/309: sync 2024-04-16T14:35:37.071 INFO:tasks.workunit.client.0.smithi005.stdout:2/345: write d0/d1c/f33 [459780,129334] 0 2024-04-16T14:35:37.071 INFO:tasks.workunit.client.0.smithi005.stdout:2/346: creat d0/d4/d2b/d5e/f6f x:0 0 0 2024-04-16T14:35:37.071 INFO:tasks.workunit.client.0.smithi005.stdout:2/347: creat d0/d4/d2b/d5e/f70 x:0 0 0 2024-04-16T14:35:37.071 INFO:tasks.workunit.client.0.smithi005.stdout:2/348: readlink d0/d1c/l38 0 2024-04-16T14:35:37.071 INFO:tasks.workunit.client.0.smithi005.stdout:1/697: dwrite d2/d1c/d15/d2a/d25/f36 [0,4194304] 0 2024-04-16T14:35:37.072 INFO:tasks.workunit.client.0.smithi005.stdout:1/698: chown d2/f62 221764638 1 2024-04-16T14:35:37.072 INFO:tasks.workunit.client.1.smithi115.stdout:6/373: sync 2024-04-16T14:35:37.072 INFO:tasks.workunit.client.1.smithi115.stdout:9/370: sync 2024-04-16T14:35:37.073 INFO:tasks.workunit.client.0.smithi005.stdout:2/349: creat d0/d29/d3e/f71 x:0 0 0 2024-04-16T14:35:37.073 INFO:tasks.workunit.client.1.smithi115.stdout:2/394: dwrite d0/d47/d65/f77 [0,4194304] 0 2024-04-16T14:35:37.074 INFO:tasks.workunit.client.1.smithi115.stdout:2/395: dread - d0/d4/d24/d10/f7e zero size 2024-04-16T14:35:37.074 INFO:tasks.workunit.client.1.smithi115.stdout:2/396: creat d0/d4/d4a/f81 x:0 0 0 2024-04-16T14:35:37.074 INFO:tasks.workunit.client.0.smithi005.stdout:1/699: mknod d2/d1c/d15/d2a/d19/dc9/cfa 0 2024-04-16T14:35:37.075 INFO:tasks.workunit.client.1.smithi115.stdout:6/374: creat d13/d1d/d47/d72/f79 x:0 0 0 2024-04-16T14:35:37.075 INFO:tasks.workunit.client.1.smithi115.stdout:6/375: chown f12 372 1 2024-04-16T14:35:37.075 INFO:tasks.workunit.client.1.smithi115.stdout:6/376: write d13/d1d/d49/f6e [653841,31529] 0 2024-04-16T14:35:37.075 INFO:tasks.workunit.client.1.smithi115.stdout:9/371: link d1/d6/d2d/d4b/c4d d1/d6/d2d/d4b/d6c/d20/d36/c75 0 2024-04-16T14:35:37.076 INFO:tasks.workunit.client.0.smithi005.stdout:2/350: creat d0/d4/d2b/f72 x:0 0 0 2024-04-16T14:35:37.078 INFO:tasks.workunit.client.0.smithi005.stdout:2/351: mknod d0/c73 0 2024-04-16T14:35:37.079 INFO:tasks.workunit.client.1.smithi115.stdout:6/377: link d13/d1d/d52/f53 d13/d1d/d2b/d46/f7a 0 2024-04-16T14:35:37.079 INFO:tasks.workunit.client.1.smithi115.stdout:6/378: fsync d13/d1d/d49/f6d 0 2024-04-16T14:35:37.079 INFO:tasks.workunit.client.1.smithi115.stdout:5/316: dwrite f2 [0,4194304] 0 2024-04-16T14:35:37.080 INFO:tasks.workunit.client.0.smithi005.stdout:1/700: rmdir d2/d1c/d15/d2a/d19/d42/d71 39 2024-04-16T14:35:37.080 INFO:tasks.workunit.client.0.smithi005.stdout:1/701: write d2/d1c/d15/d6f/f8d [1389417,102612] 0 2024-04-16T14:35:37.081 INFO:tasks.workunit.client.1.smithi115.stdout:9/372: link d1/d6/d2d/d4b/d6c/c30 d1/d6/d2d/d4b/d60/c76 0 2024-04-16T14:35:37.081 INFO:tasks.workunit.client.0.smithi005.stdout:4/855: dwrite d0/d1b/d1d/d1f/ffe [0,4194304] 0 2024-04-16T14:35:37.081 INFO:tasks.workunit.client.0.smithi005.stdout:4/856: chown d0/l18 5 1 2024-04-16T14:35:37.082 INFO:tasks.workunit.client.1.smithi115.stdout:6/379: symlink d13/d1d/d2b/d46/l7b 0 2024-04-16T14:35:37.082 INFO:tasks.workunit.client.1.smithi115.stdout:6/380: chown fc 1 1 2024-04-16T14:35:37.083 INFO:tasks.workunit.client.1.smithi115.stdout:6/381: chown d13/d1d 1 1 2024-04-16T14:35:37.083 INFO:tasks.workunit.client.0.smithi005.stdout:2/352: mknod d0/d1c/d39/d48/c74 0 2024-04-16T14:35:37.085 INFO:tasks.workunit.client.0.smithi005.stdout:1/702: dread d2/d1c/d15/d2a/d19/dc9/fe5 [0,4194304] 0 2024-04-16T14:35:37.085 INFO:tasks.workunit.client.0.smithi005.stdout:1/703: readlink d2/d2c/d85/lc2 0 2024-04-16T14:35:37.085 INFO:tasks.workunit.client.0.smithi005.stdout:1/704: chown d2/d1c/d15/d2a/d19/d42/f56 3833 1 2024-04-16T14:35:37.085 INFO:tasks.workunit.client.0.smithi005.stdout:2/353: symlink d0/d4/d2b/d5e/l75 0 2024-04-16T14:35:37.086 INFO:tasks.workunit.client.1.smithi115.stdout:5/317: unlink dc/d3d/f47 0 2024-04-16T14:35:37.086 INFO:tasks.workunit.client.1.smithi115.stdout:5/318: fdatasync dc/d3d/f5a 0 2024-04-16T14:35:37.087 INFO:tasks.workunit.client.1.smithi115.stdout:2/397: dread d0/d4/f3a [0,4194304] 0 2024-04-16T14:35:37.087 INFO:tasks.workunit.client.1.smithi115.stdout:3/360: dwrite dc/d24/d36/f72 [0,4194304] 0 2024-04-16T14:35:37.091 INFO:tasks.workunit.client.1.smithi115.stdout:9/373: creat d1/d6/d2d/d4b/d6c/f77 x:0 0 0 2024-04-16T14:35:37.093 INFO:tasks.workunit.client.1.smithi115.stdout:6/382: creat d13/d1d/d2b/d5f/d30/f7c x:0 0 0 2024-04-16T14:35:37.094 INFO:tasks.workunit.client.1.smithi115.stdout:8/348: dwrite d0/db/d10/f42 [0,4194304] 0 2024-04-16T14:35:37.096 INFO:tasks.workunit.client.0.smithi005.stdout:1/705: fsync d2/d1c/d15/d6f/f8d 0 2024-04-16T14:35:37.096 INFO:tasks.workunit.client.1.smithi115.stdout:2/398: mknod d0/c82 0 2024-04-16T14:35:37.097 INFO:tasks.workunit.client.1.smithi115.stdout:2/399: chown d0/d4/de/d11/f20 1000873 1 2024-04-16T14:35:37.097 INFO:tasks.workunit.client.0.smithi005.stdout:1/706: dread d2/d1c/fdd [0,4194304] 0 2024-04-16T14:35:37.098 INFO:tasks.workunit.client.1.smithi115.stdout:3/361: creat dc/d29/f7b x:0 0 0 2024-04-16T14:35:37.099 INFO:tasks.workunit.client.1.smithi115.stdout:9/374: link d1/d6/d2d/d3d/d50/l5c d1/d6/d2d/d3d/l78 0 2024-04-16T14:35:37.102 INFO:tasks.workunit.client.1.smithi115.stdout:6/383: link d13/d1d/d2b/d5f/d30/f7c d13/d1d/d2b/d46/f7d 0 2024-04-16T14:35:37.103 INFO:tasks.workunit.client.0.smithi005.stdout:1/707: symlink d2/d1c/d15/d2a/db6/lfb 0 2024-04-16T14:35:37.103 INFO:tasks.workunit.client.1.smithi115.stdout:5/319: write dc/d15/f18 [2250317,40961] 0 2024-04-16T14:35:37.103 INFO:tasks.workunit.client.1.smithi115.stdout:8/349: mkdir d0/db/d10/d17/d2c/d52/d6c 0 2024-04-16T14:35:37.104 INFO:tasks.workunit.client.1.smithi115.stdout:8/350: dread - d0/db/d10/d25/f46 zero size 2024-04-16T14:35:37.104 INFO:tasks.workunit.client.1.smithi115.stdout:8/351: stat d0/c3e 0 2024-04-16T14:35:37.104 INFO:tasks.workunit.client.1.smithi115.stdout:8/352: chown d0/db/d10/d25/d2d/d3b 10039 1 2024-04-16T14:35:37.105 INFO:tasks.workunit.client.0.smithi005.stdout:1/708: link d2/d1c/d15/d2a/f16 d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/dc5/df4/ffc 0 2024-04-16T14:35:37.107 INFO:tasks.workunit.client.1.smithi115.stdout:5/320: mknod dc/d15/c6c 0 2024-04-16T14:35:37.107 INFO:tasks.workunit.client.1.smithi115.stdout:5/321: readlink dc/l44 0 2024-04-16T14:35:37.107 INFO:tasks.workunit.client.0.smithi005.stdout:1/709: unlink d2/d2c/d85/dab/d51/l80 0 2024-04-16T14:35:37.108 INFO:tasks.workunit.client.0.smithi005.stdout:1/710: mknod d2/d1c/d15/d2a/cfd 0 2024-04-16T14:35:37.109 INFO:tasks.workunit.client.0.smithi005.stdout:1/711: truncate d2/d2c/d85/dab/f35 4674510 0 2024-04-16T14:35:37.109 INFO:tasks.workunit.client.1.smithi115.stdout:8/353: rename d0/db/d10/d17/d2c/f5a to d0/db/d10/f6d 0 2024-04-16T14:35:37.109 INFO:tasks.workunit.client.1.smithi115.stdout:5/322: mknod dc/c6d 0 2024-04-16T14:35:37.109 INFO:tasks.workunit.client.1.smithi115.stdout:5/323: dread - dc/d15/d35/f3f zero size 2024-04-16T14:35:37.111 INFO:tasks.workunit.client.1.smithi115.stdout:8/354: link d0/db/d10/d17/d2c/d61/c63 d0/db/d10/d17/d2c/d61/d6b/c6e 0 2024-04-16T14:35:37.112 INFO:tasks.workunit.client.1.smithi115.stdout:5/324: mknod dc/d3d/d41/c6e 0 2024-04-16T14:35:37.112 INFO:tasks.workunit.client.1.smithi115.stdout:5/325: chown dc/d15/f18 799 1 2024-04-16T14:35:37.112 INFO:tasks.workunit.client.1.smithi115.stdout:5/326: dread - dc/d15/d2d/f67 zero size 2024-04-16T14:35:37.113 INFO:tasks.workunit.client.1.smithi115.stdout:8/355: creat d0/db/d10/d17/d22/f6f x:0 0 0 2024-04-16T14:35:37.114 INFO:tasks.workunit.client.1.smithi115.stdout:5/327: creat dc/d15/d4d/f6f x:0 0 0 2024-04-16T14:35:37.122 INFO:tasks.workunit.client.0.smithi005.stdout:1/712: dread d2/d2c/d85/dab/f35 [0,4194304] 0 2024-04-16T14:35:37.123 INFO:tasks.workunit.client.0.smithi005.stdout:1/713: fsync d2/d1c/d15/d2a/d19/d20/fec 0 2024-04-16T14:35:37.125 INFO:tasks.workunit.client.0.smithi005.stdout:1/714: symlink d2/d74/lfe 0 2024-04-16T14:35:37.125 INFO:tasks.workunit.client.0.smithi005.stdout:1/715: write d2/d74/dd7/f81 [430750,97144] 0 2024-04-16T14:35:37.127 INFO:tasks.workunit.client.0.smithi005.stdout:1/716: unlink d2/d1c/dd8/lb7 0 2024-04-16T14:35:37.127 INFO:tasks.workunit.client.0.smithi005.stdout:1/717: fsync d2/d1c/d15/d2a/ff6 0 2024-04-16T14:35:37.127 INFO:tasks.workunit.client.0.smithi005.stdout:1/718: dread - d2/d2c/d85/dab/d51/dc4/fe2 zero size 2024-04-16T14:35:37.127 INFO:tasks.workunit.client.0.smithi005.stdout:1/719: readlink d2/lf2 0 2024-04-16T14:35:37.127 INFO:tasks.workunit.client.0.smithi005.stdout:1/720: symlink d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/dc5/dcd/lff 0 2024-04-16T14:35:37.127 INFO:tasks.workunit.client.0.smithi005.stdout:1/721: read - d2/d74/fe4 zero size 2024-04-16T14:35:37.128 INFO:tasks.workunit.client.1.smithi115.stdout:5/328: write dc/d15/f53 [2495217,73216] 0 2024-04-16T14:35:37.128 INFO:tasks.workunit.client.0.smithi005.stdout:1/722: mkdir d2/d74/d7a/d100 0 2024-04-16T14:35:37.128 INFO:tasks.workunit.client.1.smithi115.stdout:8/356: dread d0/db/d10/f1e [0,4194304] 0 2024-04-16T14:35:37.131 INFO:tasks.workunit.client.1.smithi115.stdout:5/329: dread dc/f12 [0,4194304] 0 2024-04-16T14:35:37.131 INFO:tasks.workunit.client.1.smithi115.stdout:5/330: fsync dc/d3d/f6a 0 2024-04-16T14:35:37.132 INFO:tasks.workunit.client.1.smithi115.stdout:5/331: creat dc/d15/d35/d69/f70 x:0 0 0 2024-04-16T14:35:37.133 INFO:tasks.workunit.client.1.smithi115.stdout:5/332: write dc/d3d/d41/f46 [700386,16695] 0 2024-04-16T14:35:37.133 INFO:tasks.workunit.client.1.smithi115.stdout:5/333: write dc/f65 [4345001,58963] 0 2024-04-16T14:35:37.134 INFO:tasks.workunit.client.1.smithi115.stdout:5/334: mkdir dc/d15/d35/d71 0 2024-04-16T14:35:37.134 INFO:tasks.workunit.client.0.smithi005.stdout:1/723: dread d2/d74/dd7/fb2 [0,4194304] 0 2024-04-16T14:35:37.134 INFO:tasks.workunit.client.0.smithi005.stdout:1/724: getdents d2/d1c/d15/da0 0 2024-04-16T14:35:37.134 INFO:tasks.workunit.client.0.smithi005.stdout:1/725: write d2/d2c/d85/dab/d51/dc4/fe2 [325433,45910] 0 2024-04-16T14:35:37.136 INFO:tasks.workunit.client.0.smithi005.stdout:1/726: link d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/c5b d2/d74/dd7/c101 0 2024-04-16T14:35:37.136 INFO:tasks.workunit.client.0.smithi005.stdout:1/727: fsync d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/ff5 0 2024-04-16T14:35:37.136 INFO:tasks.workunit.client.0.smithi005.stdout:1/728: write d2/d1c/d15/d2a/d19/d42/d64/fe9 [576476,78973] 0 2024-04-16T14:35:37.136 INFO:tasks.workunit.client.0.smithi005.stdout:1/729: mkdir d2/d102 0 2024-04-16T14:35:37.136 INFO:tasks.workunit.client.0.smithi005.stdout:1/730: write d2/d2c/d85/dab/d51/f6a [9387756,72790] 0 2024-04-16T14:35:37.137 INFO:tasks.workunit.client.0.smithi005.stdout:1/731: rmdir d2/d2c/d85 39 2024-04-16T14:35:37.138 INFO:tasks.workunit.client.0.smithi005.stdout:1/732: chown d2/d1c/d15/d2a/d19/d42/d64/d76/c78 2041098 1 2024-04-16T14:35:37.141 INFO:tasks.workunit.client.1.smithi115.stdout:8/357: write d0/db/d10/d17/f18 [106794,108276] 0 2024-04-16T14:35:37.144 INFO:tasks.workunit.client.0.smithi005.stdout:4/857: dwrite d0/d1b/d1d/d1f/d5d/da7/d90/fd3 [0,4194304] 0 2024-04-16T14:35:37.157 INFO:tasks.workunit.client.1.smithi115.stdout:7/310: dwrite d0/d2/d3a/f33 [0,4194304] 0 2024-04-16T14:35:37.157 INFO:tasks.workunit.client.1.smithi115.stdout:7/311: read - d0/d1/d3b/d3e/f56 zero size 2024-04-16T14:35:37.157 INFO:tasks.workunit.client.1.smithi115.stdout:7/312: fsync d0/d1/d3b/d3e/f54 0 2024-04-16T14:35:37.157 INFO:tasks.workunit.client.1.smithi115.stdout:6/384: dwrite d13/d1d/f5c [0,4194304] 0 2024-04-16T14:35:37.157 INFO:tasks.workunit.client.1.smithi115.stdout:2/400: dwrite d0/f2d [0,4194304] 0 2024-04-16T14:35:37.157 INFO:tasks.workunit.client.1.smithi115.stdout:2/401: truncate d0/d4/de/d11/f20 4579643 0 2024-04-16T14:35:37.158 INFO:tasks.workunit.client.0.smithi005.stdout:2/354: dwrite d0/d2a/f63 [0,4194304] 0 2024-04-16T14:35:37.158 INFO:tasks.workunit.client.0.smithi005.stdout:2/355: readlink d0/d2a/d3a/d46/l4a 0 2024-04-16T14:35:37.158 INFO:tasks.workunit.client.0.smithi005.stdout:2/356: chown d0/d2a/c32 346 1 2024-04-16T14:35:37.158 INFO:tasks.workunit.client.0.smithi005.stdout:2/357: write d0/d4/d2b/d5e/f6f [859122,87115] 0 2024-04-16T14:35:37.158 INFO:tasks.workunit.client.0.smithi005.stdout:2/358: truncate d0/d29/d3e/f57 2973691 0 2024-04-16T14:35:37.158 INFO:tasks.workunit.client.0.smithi005.stdout:2/359: stat d0/d4/d2b 0 2024-04-16T14:35:37.159 INFO:tasks.workunit.client.0.smithi005.stdout:2/360: creat d0/d2a/d3a/f76 x:0 0 0 2024-04-16T14:35:37.160 INFO:tasks.workunit.client.1.smithi115.stdout:6/385: creat d13/d1d/d2b/d46/d5a/d62/f7e x:0 0 0 2024-04-16T14:35:37.160 INFO:tasks.workunit.client.0.smithi005.stdout:2/361: symlink d0/d4/d2b/l77 0 2024-04-16T14:35:37.160 INFO:tasks.workunit.client.0.smithi005.stdout:2/362: truncate d0/d4/d2b/f72 522825 0 2024-04-16T14:35:37.161 INFO:tasks.workunit.client.0.smithi005.stdout:2/363: creat d0/d4/f78 x:0 0 0 2024-04-16T14:35:37.161 INFO:tasks.workunit.client.1.smithi115.stdout:2/402: mkdir d0/d4/d24/d23/d83 0 2024-04-16T14:35:37.161 INFO:tasks.workunit.client.0.smithi005.stdout:2/364: dread - d0/d29/d3e/f42 zero size 2024-04-16T14:35:37.162 INFO:tasks.workunit.client.0.smithi005.stdout:2/365: creat d0/d4/d2b/d5e/f79 x:0 0 0 2024-04-16T14:35:37.162 INFO:tasks.workunit.client.1.smithi115.stdout:7/313: dread d0/d24/d40/f44 [0,4194304] 0 2024-04-16T14:35:37.162 INFO:tasks.workunit.client.0.smithi005.stdout:2/366: mkdir d0/d1c/d59/d7a 0 2024-04-16T14:35:37.163 INFO:tasks.workunit.client.1.smithi115.stdout:6/386: unlink d13/d1d/l4f 0 2024-04-16T14:35:37.163 INFO:tasks.workunit.client.1.smithi115.stdout:6/387: chown d13/d1d/d52 737101 1 2024-04-16T14:35:37.164 INFO:tasks.workunit.client.0.smithi005.stdout:2/367: rename d0/d4/f45 to d0/d1c/d39/d48/f7b 0 2024-04-16T14:35:37.164 INFO:tasks.workunit.client.0.smithi005.stdout:2/368: read - d0/d2a/d3a/d46/f56 zero size 2024-04-16T14:35:37.164 INFO:tasks.workunit.client.1.smithi115.stdout:2/403: symlink d0/d4/de/d11/l84 0 2024-04-16T14:35:37.164 INFO:tasks.workunit.client.0.smithi005.stdout:2/369: creat d0/d1c/d39/d48/f7c x:0 0 0 2024-04-16T14:35:37.165 INFO:tasks.workunit.client.1.smithi115.stdout:3/362: dwrite dc/d29/d4d/d56/f5a [0,4194304] 0 2024-04-16T14:35:37.165 INFO:tasks.workunit.client.1.smithi115.stdout:9/375: dwrite d1/d6/d2d/f1f [0,4194304] 0 2024-04-16T14:35:37.166 INFO:tasks.workunit.client.0.smithi005.stdout:2/370: rename d0/d29/l64 to d0/d1c/d39/l7d 0 2024-04-16T14:35:37.167 INFO:tasks.workunit.client.1.smithi115.stdout:6/388: link d13/d1d/d2b/d5f/d30/d43/d2c/f39 d13/f7f 0 2024-04-16T14:35:37.167 INFO:tasks.workunit.client.1.smithi115.stdout:6/389: creat d13/d1d/d2b/d5f/d30/f80 x:0 0 0 2024-04-16T14:35:37.167 INFO:tasks.workunit.client.1.smithi115.stdout:6/390: stat d13/d1d/d2b 0 2024-04-16T14:35:37.167 INFO:tasks.workunit.client.0.smithi005.stdout:2/371: stat d0/l43 0 2024-04-16T14:35:37.167 INFO:tasks.workunit.client.1.smithi115.stdout:5/335: dwrite dc/f26 [0,4194304] 0 2024-04-16T14:35:37.168 INFO:tasks.workunit.client.1.smithi115.stdout:2/404: creat d0/d47/d65/d61/d70/f85 x:0 0 0 2024-04-16T14:35:37.168 INFO:tasks.workunit.client.1.smithi115.stdout:8/358: dwrite d0/db/d10/d25/f67 [0,4194304] 0 2024-04-16T14:35:37.169 INFO:tasks.workunit.client.0.smithi005.stdout:4/858: dwrite d0/f5f [0,4194304] 0 2024-04-16T14:35:37.169 INFO:tasks.workunit.client.0.smithi005.stdout:4/859: readlink d0/d1b/d1d/d4f/l60 0 2024-04-16T14:35:37.169 INFO:tasks.workunit.client.1.smithi115.stdout:9/376: mkdir d1/d6/d2d/d3d/d50/d79 0 2024-04-16T14:35:37.170 INFO:tasks.workunit.client.0.smithi005.stdout:2/372: link d0/d4/d2b/d5e/f60 d0/d2a/d3a/f7e 0 2024-04-16T14:35:37.174 INFO:tasks.workunit.client.1.smithi115.stdout:6/391: mknod d13/d1d/d2b/d5f/d30/c81 0 2024-04-16T14:35:37.176 INFO:tasks.workunit.client.1.smithi115.stdout:9/377: dread d1/d6/f3e [0,4194304] 0 2024-04-16T14:35:37.181 INFO:tasks.workunit.client.1.smithi115.stdout:2/405: mkdir d0/d4/de/d11/d36/d86 0 2024-04-16T14:35:37.181 INFO:tasks.workunit.client.1.smithi115.stdout:2/406: write d0/d47/d65/f7b [117403,17775] 0 2024-04-16T14:35:37.181 INFO:tasks.workunit.client.1.smithi115.stdout:2/407: readlink d0/d4/d57/l78 0 2024-04-16T14:35:37.181 INFO:tasks.workunit.client.1.smithi115.stdout:2/408: write d0/d4/d24/d21/d3b/f56 [535406,13154] 0 2024-04-16T14:35:37.181 INFO:tasks.workunit.client.0.smithi005.stdout:4/860: creat d0/d1b/d1d/d1f/d5d/da7/d90/de4/f111 x:0 0 0 2024-04-16T14:35:37.182 INFO:tasks.workunit.client.1.smithi115.stdout:8/359: mknod d0/db/d10/d17/d2c/d52/d6c/c70 0 2024-04-16T14:35:37.183 INFO:tasks.workunit.client.0.smithi005.stdout:4/861: creat d0/d1b/db7/d100/f112 x:0 0 0 2024-04-16T14:35:37.183 INFO:tasks.workunit.client.1.smithi115.stdout:5/336: dread dc/d15/f18 [0,4194304] 0 2024-04-16T14:35:37.183 INFO:tasks.workunit.client.1.smithi115.stdout:6/392: creat d13/d1d/d2b/f82 x:0 0 0 2024-04-16T14:35:37.184 INFO:tasks.workunit.client.0.smithi005.stdout:4/862: rmdir d0/d1b/d1d/d1f/d48 39 2024-04-16T14:35:37.185 INFO:tasks.workunit.client.1.smithi115.stdout:9/378: chown d1/c11 4 1 2024-04-16T14:35:37.187 INFO:tasks.workunit.client.1.smithi115.stdout:2/409: unlink d0/fb 0 2024-04-16T14:35:37.187 INFO:tasks.workunit.client.1.smithi115.stdout:2/410: write d0/d4/de/f37 [3100947,64608] 0 2024-04-16T14:35:37.188 INFO:tasks.workunit.client.1.smithi115.stdout:8/360: mkdir d0/db/d10/d17/d2c/d52/d6c/d71 0 2024-04-16T14:35:37.190 INFO:tasks.workunit.client.1.smithi115.stdout:6/393: symlink d13/d1d/d2b/d5f/d30/l83 0 2024-04-16T14:35:37.190 INFO:tasks.workunit.client.1.smithi115.stdout:6/394: stat d13/d1d/d2b/d46/d5a/d62 0 2024-04-16T14:35:37.192 INFO:tasks.workunit.client.1.smithi115.stdout:2/411: rename d0/d4/de/c66 to d0/d47/d65/d61/d70/c87 0 2024-04-16T14:35:37.194 INFO:tasks.workunit.client.1.smithi115.stdout:6/395: symlink d13/l84 0 2024-04-16T14:35:37.198 INFO:tasks.workunit.client.1.smithi115.stdout:8/361: write d0/db/d10/f1e [4092970,6264] 0 2024-04-16T14:35:37.198 INFO:tasks.workunit.client.1.smithi115.stdout:8/362: dread - d0/db/d10/d17/d2c/d61/f6a zero size 2024-04-16T14:35:37.198 INFO:tasks.workunit.client.1.smithi115.stdout:8/363: chown d0/db/d10/d17/d2c/d61/d6b/c6e 159865 1 2024-04-16T14:35:37.198 INFO:tasks.workunit.client.1.smithi115.stdout:8/364: dread - d0/db/d10/d17/f4c zero size 2024-04-16T14:35:37.198 INFO:tasks.workunit.client.1.smithi115.stdout:2/412: creat d0/d4/de/d11/f88 x:0 0 0 2024-04-16T14:35:37.199 INFO:tasks.workunit.client.1.smithi115.stdout:3/363: dwrite dc/f67 [0,4194304] 0 2024-04-16T14:35:37.199 INFO:tasks.workunit.client.1.smithi115.stdout:3/364: dread - dc/d29/d4d/d56/f58 zero size 2024-04-16T14:35:37.199 INFO:tasks.workunit.client.1.smithi115.stdout:6/396: symlink d13/d1d/d2b/d5b/l85 0 2024-04-16T14:35:37.201 INFO:tasks.workunit.client.0.smithi005.stdout:4/863: write d0/d1b/d1d/d1f/d3e/feb [2786366,10031] 0 2024-04-16T14:35:37.201 INFO:tasks.workunit.client.1.smithi115.stdout:7/314: dwrite d0/d2/f35 [0,4194304] 0 2024-04-16T14:35:37.203 INFO:tasks.workunit.client.0.smithi005.stdout:1/733: dwrite d2/d1c/d15/d2a/d19/d42/d64/fe9 [0,4194304] 0 2024-04-16T14:35:37.203 INFO:tasks.workunit.client.0.smithi005.stdout:1/734: truncate d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/dc5/dbc/fba 745644 0 2024-04-16T14:35:37.204 INFO:tasks.workunit.client.1.smithi115.stdout:9/379: write d1/d6/d2d/d4b/f5a [2405705,80935] 0 2024-04-16T14:35:37.204 INFO:tasks.workunit.client.1.smithi115.stdout:9/380: fdatasync d1/d6/d2d/d4b/d6c/f44 0 2024-04-16T14:35:37.204 INFO:tasks.workunit.client.1.smithi115.stdout:9/381: creat d1/d6/d29/f7a x:0 0 0 2024-04-16T14:35:37.204 INFO:tasks.workunit.client.1.smithi115.stdout:9/382: write d1/d6/d33/f6f [959085,103305] 0 2024-04-16T14:35:37.204 INFO:tasks.workunit.client.1.smithi115.stdout:2/413: link d0/d4/f7 d0/d4/d24/d10/f89 0 2024-04-16T14:35:37.205 INFO:tasks.workunit.client.0.smithi005.stdout:4/864: creat d0/d1b/d1d/dc3/d103/f113 x:0 0 0 2024-04-16T14:35:37.205 INFO:tasks.workunit.client.1.smithi115.stdout:9/383: dread d1/d6/f3e [0,4194304] 0 2024-04-16T14:35:37.208 INFO:tasks.workunit.client.1.smithi115.stdout:3/365: unlink dc/d29/d4d/f5e 0 2024-04-16T14:35:37.208 INFO:tasks.workunit.client.0.smithi005.stdout:1/735: mkdir d2/d1c/d15/d2a/d19/d42/d71/d103 0 2024-04-16T14:35:37.208 INFO:tasks.workunit.client.0.smithi005.stdout:1/736: fsync d2/d1c/d15/d2a/d19/dc9/fe5 0 2024-04-16T14:35:37.209 INFO:tasks.workunit.client.1.smithi115.stdout:6/397: symlink d13/d1d/d2b/d46/d63/l86 0 2024-04-16T14:35:37.210 INFO:tasks.workunit.client.0.smithi005.stdout:4/865: link d0/d22/d61/l69 d0/d1b/d1d/d1f/l114 0 2024-04-16T14:35:37.211 INFO:tasks.workunit.client.1.smithi115.stdout:7/315: write d0/d2/f35 [1050180,110133] 0 2024-04-16T14:35:37.211 INFO:tasks.workunit.client.1.smithi115.stdout:7/316: creat d0/d24/d40/f6a x:0 0 0 2024-04-16T14:35:37.212 INFO:tasks.workunit.client.0.smithi005.stdout:2/373: write d0/d29/d3e/f57 [3465838,83685] 0 2024-04-16T14:35:37.212 INFO:tasks.workunit.client.0.smithi005.stdout:2/374: chown d0/d1c/d59/d7a 344365 1 2024-04-16T14:35:37.213 INFO:tasks.workunit.client.0.smithi005.stdout:1/737: symlink d2/d74/d7a/l104 0 2024-04-16T14:35:37.214 INFO:tasks.workunit.client.0.smithi005.stdout:1/738: readlink d2/d74/d7a/l7f 0 2024-04-16T14:35:37.214 INFO:tasks.workunit.client.0.smithi005.stdout:1/739: rename d2/d1c/d15/d2a/d19/d42/d71/dac/cb5 to d2/d1c/d15/d2a/d19/d42/d71/d103/c105 0 2024-04-16T14:35:37.216 INFO:tasks.workunit.client.1.smithi115.stdout:9/384: write d1/d6/d29/f5d [1076795,51501] 0 2024-04-16T14:35:37.216 INFO:tasks.workunit.client.1.smithi115.stdout:9/385: dread - d1/d6/d2d/d4b/d6c/f6b zero size 2024-04-16T14:35:37.216 INFO:tasks.workunit.client.0.smithi005.stdout:1/740: symlink d2/d1c/d15/d6f/l106 0 2024-04-16T14:35:37.216 INFO:tasks.workunit.client.1.smithi115.stdout:3/366: write dc/f67 [2702688,62155] 0 2024-04-16T14:35:37.221 INFO:tasks.workunit.client.0.smithi005.stdout:2/375: write d0/d2a/d3a/d46/f4b [2861944,82383] 0 2024-04-16T14:35:37.224 INFO:tasks.workunit.client.0.smithi005.stdout:2/376: mknod d0/d2a/d3a/d46/c7f 0 2024-04-16T14:35:37.225 INFO:tasks.workunit.client.1.smithi115.stdout:5/337: dwrite dc/d3d/d41/f46 [0,4194304] 0 2024-04-16T14:35:37.225 INFO:tasks.workunit.client.1.smithi115.stdout:8/365: rmdir d0 39 2024-04-16T14:35:37.226 INFO:tasks.workunit.client.0.smithi005.stdout:1/741: read d2/d1c/d15/d2a/d19/d42/f56 [1271835,53618] 0 2024-04-16T14:35:37.226 INFO:tasks.workunit.client.0.smithi005.stdout:1/742: chown d2/d74/d7a 4042 1 2024-04-16T14:35:37.230 INFO:tasks.workunit.client.0.smithi005.stdout:2/377: rmdir d0/d4 39 2024-04-16T14:35:37.231 INFO:tasks.workunit.client.0.smithi005.stdout:1/743: symlink d2/d1c/dd8/l107 0 2024-04-16T14:35:37.235 INFO:tasks.workunit.client.0.smithi005.stdout:1/744: read d2/fee [77727,1269] 0 2024-04-16T14:35:37.236 INFO:tasks.workunit.client.0.smithi005.stdout:1/745: rmdir d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/dc5/dbc/dcf 39 2024-04-16T14:35:37.237 INFO:tasks.workunit.client.1.smithi115.stdout:3/367: dwrite dc/d29/d4d/d56/f5a [0,4194304] 0 2024-04-16T14:35:37.244 INFO:tasks.workunit.client.1.smithi115.stdout:2/414: mknod d0/d47/d65/d61/c8a 0 2024-04-16T14:35:37.245 INFO:tasks.workunit.client.1.smithi115.stdout:2/415: write d0/d47/d65/f7b [32802,93459] 0 2024-04-16T14:35:37.249 INFO:tasks.workunit.client.1.smithi115.stdout:7/317: mkdir d0/d2/d3a/d30/d6b 0 2024-04-16T14:35:37.250 INFO:tasks.workunit.client.1.smithi115.stdout:9/386: mknod d1/d6/d2d/d4b/c7b 0 2024-04-16T14:35:37.252 INFO:tasks.workunit.client.1.smithi115.stdout:8/366: link d0/db/f26 d0/db/d10/d17/f72 0 2024-04-16T14:35:37.258 INFO:tasks.workunit.client.1.smithi115.stdout:1/292: sync 2024-04-16T14:35:37.259 INFO:tasks.workunit.client.1.smithi115.stdout:7/318: dread d0/d1/f20 [0,4194304] 0 2024-04-16T14:35:37.259 INFO:tasks.workunit.client.1.smithi115.stdout:9/387: truncate d1/d6/d2d/d4b/d6c/d20/d2a/f37 3196528 0 2024-04-16T14:35:37.260 INFO:tasks.workunit.client.1.smithi115.stdout:3/368: getdents dc/d24/d33 0 2024-04-16T14:35:37.261 INFO:tasks.workunit.client.1.smithi115.stdout:6/398: rename d13/d1d/d47/d72 to d13/d1d/d87 0 2024-04-16T14:35:37.262 INFO:tasks.workunit.client.1.smithi115.stdout:6/399: stat d13/d1d/d2b/d5f/d30/f80 0 2024-04-16T14:35:37.262 INFO:tasks.workunit.client.1.smithi115.stdout:6/400: write d13/d1d/d2b/f67 [4862458,92723] 0 2024-04-16T14:35:37.264 INFO:tasks.workunit.client.0.smithi005.stdout:1/746: dwrite d2/d1c/d15/d2a/d19/d20/d27/fe7 [0,4194304] 0 2024-04-16T14:35:37.264 INFO:tasks.workunit.client.0.smithi005.stdout:1/747: readlink d2/d74/lfe 0 2024-04-16T14:35:37.264 INFO:tasks.workunit.client.0.smithi005.stdout:2/378: dwrite d0/f2 [0,4194304] 0 2024-04-16T14:35:37.264 INFO:tasks.workunit.client.0.smithi005.stdout:1/748: creat d2/d1c/d15/d2a/f108 x:0 0 0 2024-04-16T14:35:37.264 INFO:tasks.workunit.client.0.smithi005.stdout:2/379: readlink d0/d1c/d39/l7d 0 2024-04-16T14:35:37.264 INFO:tasks.workunit.client.0.smithi005.stdout:2/380: read d0/d4/f6 [384560,85707] 0 2024-04-16T14:35:37.264 INFO:tasks.workunit.client.0.smithi005.stdout:2/381: chown d0/c69 30 1 2024-04-16T14:35:37.264 INFO:tasks.workunit.client.0.smithi005.stdout:2/382: readlink d0/d1c/d39/d48/l54 0 2024-04-16T14:35:37.265 INFO:tasks.workunit.client.1.smithi115.stdout:1/293: link df/d13/f16 df/d36/d3c/f63 0 2024-04-16T14:35:37.265 INFO:tasks.workunit.client.1.smithi115.stdout:1/294: fdatasync df/d13/d4d/d3e/f62 0 2024-04-16T14:35:37.266 INFO:tasks.workunit.client.1.smithi115.stdout:8/367: write d0/f53 [924723,128601] 0 2024-04-16T14:35:37.267 INFO:tasks.workunit.client.1.smithi115.stdout:9/388: creat d1/d6/d2d/d3d/f7c x:0 0 0 2024-04-16T14:35:37.269 INFO:tasks.workunit.client.1.smithi115.stdout:3/369: unlink dc/d24/d33/f79 0 2024-04-16T14:35:37.271 INFO:tasks.workunit.client.0.smithi005.stdout:2/383: creat d0/d4/d2b/d6b/f80 x:0 0 0 2024-04-16T14:35:37.271 INFO:tasks.workunit.client.0.smithi005.stdout:2/384: fdatasync d0/d4/d2b/f17 0 2024-04-16T14:35:37.271 INFO:tasks.workunit.client.0.smithi005.stdout:2/385: fdatasync d0/d4/f3b 0 2024-04-16T14:35:37.271 INFO:tasks.workunit.client.0.smithi005.stdout:2/386: chown d0/d1c/d59/d67 5 1 2024-04-16T14:35:37.272 INFO:tasks.workunit.client.0.smithi005.stdout:2/387: truncate d0/d2a/d3a/d46/f5d 2260146 0 2024-04-16T14:35:37.272 INFO:tasks.workunit.client.0.smithi005.stdout:2/388: creat d0/d1c/d39/d48/f81 x:0 0 0 2024-04-16T14:35:37.272 INFO:tasks.workunit.client.1.smithi115.stdout:1/295: unlink df/d13/d4d/f52 0 2024-04-16T14:35:37.274 INFO:tasks.workunit.client.1.smithi115.stdout:9/389: stat d1/d6/f2b 0 2024-04-16T14:35:37.276 INFO:tasks.workunit.client.1.smithi115.stdout:3/370: mknod dc/d29/c7c 0 2024-04-16T14:35:37.278 INFO:tasks.workunit.client.1.smithi115.stdout:1/296: creat df/f64 x:0 0 0 2024-04-16T14:35:37.280 INFO:tasks.workunit.client.1.smithi115.stdout:9/390: unlink d1/d6/d2d/d4b/d6c/c27 0 2024-04-16T14:35:37.281 INFO:tasks.workunit.client.1.smithi115.stdout:3/371: symlink dc/d29/d77/l7d 0 2024-04-16T14:35:37.283 INFO:tasks.workunit.client.1.smithi115.stdout:8/368: dread d0/db/f15 [0,4194304] 0 2024-04-16T14:35:37.283 INFO:tasks.workunit.client.1.smithi115.stdout:1/297: creat df/d35/f65 x:0 0 0 2024-04-16T14:35:37.284 INFO:tasks.workunit.client.1.smithi115.stdout:9/391: mknod d1/d6/d2d/d4b/d6c/d20/d36/c7d 0 2024-04-16T14:35:37.285 INFO:tasks.workunit.client.1.smithi115.stdout:9/392: write d1/d6/d2d/d4b/d6c/d20/d36/f39 [1698174,7669] 0 2024-04-16T14:35:37.287 INFO:tasks.workunit.client.1.smithi115.stdout:6/401: write d13/f2a [1675290,75341] 0 2024-04-16T14:35:37.288 INFO:tasks.workunit.client.1.smithi115.stdout:3/372: mkdir dc/d29/d4d/d56/d7e 0 2024-04-16T14:35:37.288 INFO:tasks.workunit.client.1.smithi115.stdout:3/373: creat dc/d29/f7f x:0 0 0 2024-04-16T14:35:37.290 INFO:tasks.workunit.client.1.smithi115.stdout:9/393: symlink d1/d6/d2d/d3d/l7e 0 2024-04-16T14:35:37.291 INFO:tasks.workunit.client.0.smithi005.stdout:3/591: sync 2024-04-16T14:35:37.291 INFO:tasks.workunit.client.0.smithi005.stdout:6/799: sync 2024-04-16T14:35:37.291 INFO:tasks.workunit.client.0.smithi005.stdout:3/592: chown d2/d17/d46/d75/f8f 5 1 2024-04-16T14:35:37.292 INFO:tasks.workunit.client.0.smithi005.stdout:6/800: write d2/d5/d10/fde [58155,74434] 0 2024-04-16T14:35:37.292 INFO:tasks.workunit.client.0.smithi005.stdout:6/801: chown d2/d5/f2f 15824864 1 2024-04-16T14:35:37.292 INFO:tasks.workunit.client.0.smithi005.stdout:6/802: truncate d2/fd0 855250 0 2024-04-16T14:35:37.293 INFO:tasks.workunit.client.1.smithi115.stdout:8/369: dread d0/db/f15 [0,4194304] 0 2024-04-16T14:35:37.293 INFO:tasks.workunit.client.1.smithi115.stdout:8/370: chown d0/db/d10/d17/d2c/d61/f6a 58711540 1 2024-04-16T14:35:37.294 INFO:tasks.workunit.client.0.smithi005.stdout:6/803: link d2/d3f/d47/d84/cda d2/d20/d3c/dcf/d6e/c10e 0 2024-04-16T14:35:37.294 INFO:tasks.workunit.client.1.smithi115.stdout:3/374: mkdir dc/d24/d80 0 2024-04-16T14:35:37.294 INFO:tasks.workunit.client.1.smithi115.stdout:3/375: read - dc/d24/f6f zero size 2024-04-16T14:35:37.295 INFO:tasks.workunit.client.0.smithi005.stdout:1/749: dwrite d2/d1c/d15/d2a/d19/fa9 [0,4194304] 0 2024-04-16T14:35:37.295 INFO:tasks.workunit.client.0.smithi005.stdout:6/804: getdents d2/d45 0 2024-04-16T14:35:37.296 INFO:tasks.workunit.client.1.smithi115.stdout:2/416: dwrite d0/d4/d4a/f81 [0,4194304] 0 2024-04-16T14:35:37.297 INFO:tasks.workunit.client.1.smithi115.stdout:1/298: write df/d13/d4d/d3e/f46 [1687668,125454] 0 2024-04-16T14:35:37.298 INFO:tasks.workunit.client.0.smithi005.stdout:1/750: mknod d2/d1c/d15/d2a/d25/c109 0 2024-04-16T14:35:37.298 INFO:tasks.workunit.client.0.smithi005.stdout:1/751: chown d2/d74/dd7 483914 1 2024-04-16T14:35:37.299 INFO:tasks.workunit.client.0.smithi005.stdout:6/805: creat d2/d3f/d53/f10f x:0 0 0 2024-04-16T14:35:37.299 INFO:tasks.workunit.client.0.smithi005.stdout:6/806: chown d2/d20/f7f 0 1 2024-04-16T14:35:37.299 INFO:tasks.workunit.client.0.smithi005.stdout:6/807: write d2/d3f/d53/d54/fc8 [2115609,99426] 0 2024-04-16T14:35:37.300 INFO:tasks.workunit.client.0.smithi005.stdout:3/593: dread d2/d9/d5e/f94 [0,4194304] 0 2024-04-16T14:35:37.300 INFO:tasks.workunit.client.0.smithi005.stdout:2/389: dwrite d0/d2a/d3a/f7e [0,4194304] 0 2024-04-16T14:35:37.300 INFO:tasks.workunit.client.0.smithi005.stdout:2/390: readlink d0/d4/d2b/d5e/l75 0 2024-04-16T14:35:37.300 INFO:tasks.workunit.client.0.smithi005.stdout:2/391: chown d0/d4/ca 252499555 1 2024-04-16T14:35:37.301 INFO:tasks.workunit.client.1.smithi115.stdout:9/394: mkdir d1/d7f 0 2024-04-16T14:35:37.301 INFO:tasks.workunit.client.1.smithi115.stdout:9/395: stat d1/d6/d2d/d4b/c7b 0 2024-04-16T14:35:37.301 INFO:tasks.workunit.client.1.smithi115.stdout:6/402: write d13/f2a [7883079,90873] 0 2024-04-16T14:35:37.301 INFO:tasks.workunit.client.1.smithi115.stdout:7/319: dwrite d0/d1/d3b/d3e/f54 [0,4194304] 0 2024-04-16T14:35:37.301 INFO:tasks.workunit.client.1.smithi115.stdout:7/320: read d0/d1/d3b/d3e/f5c [69126,69009] 0 2024-04-16T14:35:37.302 INFO:tasks.workunit.client.1.smithi115.stdout:3/376: mkdir dc/d24/d33/d4b/d81 0 2024-04-16T14:35:37.304 INFO:tasks.workunit.client.0.smithi005.stdout:6/808: truncate d2/d5/f8 11975475 0 2024-04-16T14:35:37.304 INFO:tasks.workunit.client.0.smithi005.stdout:6/809: truncate d2/d5/d10/fa3 685815 0 2024-04-16T14:35:37.308 INFO:tasks.workunit.client.0.smithi005.stdout:6/810: getdents d2/de1 0 2024-04-16T14:35:37.308 INFO:tasks.workunit.client.1.smithi115.stdout:2/417: mknod d0/d47/d65/d61/c8b 0 2024-04-16T14:35:37.310 INFO:tasks.workunit.client.0.smithi005.stdout:6/811: mknod d2/d3f/c110 0 2024-04-16T14:35:37.312 INFO:tasks.workunit.client.1.smithi115.stdout:1/299: symlink df/d13/d4d/l66 0 2024-04-16T14:35:37.312 INFO:tasks.workunit.client.1.smithi115.stdout:1/300: dread - df/d36/f5f zero size 2024-04-16T14:35:37.313 INFO:tasks.workunit.client.0.smithi005.stdout:2/392: dread d0/d4/d2b/f17 [0,4194304] 0 2024-04-16T14:35:37.314 INFO:tasks.workunit.client.1.smithi115.stdout:1/301: dread df/d13/d4d/f34 [0,4194304] 0 2024-04-16T14:35:37.314 INFO:tasks.workunit.client.0.smithi005.stdout:6/812: dread d2/d5/d10/dd6/d7a/fc7 [0,4194304] 0 2024-04-16T14:35:37.314 INFO:tasks.workunit.client.0.smithi005.stdout:6/813: write d2/d20/d3c/f5d [3030829,108818] 0 2024-04-16T14:35:37.315 INFO:tasks.workunit.client.0.smithi005.stdout:6/814: chown d2/d3f/d47/f52 3 1 2024-04-16T14:35:37.316 INFO:tasks.workunit.client.1.smithi115.stdout:7/321: mknod d0/d1/d3b/c6c 0 2024-04-16T14:35:37.316 INFO:tasks.workunit.client.1.smithi115.stdout:7/322: chown d0/d24/f4a 6308 1 2024-04-16T14:35:37.317 INFO:tasks.workunit.client.0.smithi005.stdout:2/393: mknod d0/d2a/d3a/c82 0 2024-04-16T14:35:37.317 INFO:tasks.workunit.client.1.smithi115.stdout:6/403: write d13/d1d/d2b/d46/d5a/f3c [529563,53664] 0 2024-04-16T14:35:37.318 INFO:tasks.workunit.client.0.smithi005.stdout:6/815: mkdir d2/d3f/d53/dba/d111 0 2024-04-16T14:35:37.319 INFO:tasks.workunit.client.0.smithi005.stdout:6/816: truncate d2/d5/d10/f5a 367057 0 2024-04-16T14:35:37.320 INFO:tasks.workunit.client.1.smithi115.stdout:3/377: rename f3 to dc/d24/f82 0 2024-04-16T14:35:37.320 INFO:tasks.workunit.client.0.smithi005.stdout:6/817: symlink d2/d5/d28/l112 0 2024-04-16T14:35:37.321 INFO:tasks.workunit.client.1.smithi115.stdout:8/371: dwrite d0/db/d10/f42 [4194304,4194304] 0 2024-04-16T14:35:37.321 INFO:tasks.workunit.client.1.smithi115.stdout:8/372: fsync d0/db/d10/d25/d2d/f4d 0 2024-04-16T14:35:37.321 INFO:tasks.workunit.client.1.smithi115.stdout:2/418: fdatasync d0/d4/d24/d21/f74 0 2024-04-16T14:35:37.323 INFO:tasks.workunit.client.1.smithi115.stdout:1/302: rmdir df/d13/d4d/d2c 39 2024-04-16T14:35:37.323 INFO:tasks.workunit.client.1.smithi115.stdout:1/303: chown df/d35 506425 1 2024-04-16T14:35:37.323 INFO:tasks.workunit.client.1.smithi115.stdout:1/304: fsync df/d13/f16 0 2024-04-16T14:35:37.323 INFO:tasks.workunit.client.0.smithi005.stdout:2/394: dread d0/d2a/f63 [0,4194304] 0 2024-04-16T14:35:37.325 INFO:tasks.workunit.client.1.smithi115.stdout:7/323: symlink d0/d2/l6d 0 2024-04-16T14:35:37.325 INFO:tasks.workunit.client.1.smithi115.stdout:3/378: getdents dc/d24/d33/d4b/d65 0 2024-04-16T14:35:37.326 INFO:tasks.workunit.client.0.smithi005.stdout:2/395: rename d0/d4/f28 to d0/d1c/f83 0 2024-04-16T14:35:37.326 INFO:tasks.workunit.client.0.smithi005.stdout:2/396: stat d0/d1c/d59/c5c 0 2024-04-16T14:35:37.328 INFO:tasks.workunit.client.1.smithi115.stdout:9/396: dwrite d1/d6/f41 [4194304,4194304] 0 2024-04-16T14:35:37.328 INFO:tasks.workunit.client.1.smithi115.stdout:9/397: chown d1/d6/d2d/d4b/d6c/l70 1 1 2024-04-16T14:35:37.328 INFO:tasks.workunit.client.1.smithi115.stdout:9/398: truncate d1/d6/d29/f5d 4682328 0 2024-04-16T14:35:37.329 INFO:tasks.workunit.client.1.smithi115.stdout:9/399: stat d1/d6 0 2024-04-16T14:35:37.329 INFO:tasks.workunit.client.1.smithi115.stdout:2/419: readlink d0/d4/de/d11/l1c 0 2024-04-16T14:35:37.329 INFO:tasks.workunit.client.1.smithi115.stdout:3/379: mknod dc/d24/d80/c83 0 2024-04-16T14:35:37.335 INFO:tasks.workunit.client.1.smithi115.stdout:2/420: creat d0/d4/d24/d23/d71/f8c x:0 0 0 2024-04-16T14:35:37.336 INFO:tasks.workunit.client.1.smithi115.stdout:8/373: dread d0/db/f1b [0,4194304] 0 2024-04-16T14:35:37.336 INFO:tasks.workunit.client.1.smithi115.stdout:3/380: mkdir dc/d29/d4d/d56/d7e/d84 0 2024-04-16T14:35:37.337 INFO:tasks.workunit.client.1.smithi115.stdout:7/324: write d0/d1/d3b/d3e/f54 [3839571,101986] 0 2024-04-16T14:35:37.339 INFO:tasks.workunit.client.1.smithi115.stdout:7/325: mknod d0/d1/d3b/d49/c6e 0 2024-04-16T14:35:37.340 INFO:tasks.workunit.client.1.smithi115.stdout:7/326: symlink d0/d1/d3b/l6f 0 2024-04-16T14:35:37.340 INFO:tasks.workunit.client.1.smithi115.stdout:7/327: write d0/d24/f61 [192226,16210] 0 2024-04-16T14:35:37.341 INFO:tasks.workunit.client.1.smithi115.stdout:9/400: dread d1/d6/d2d/d3d/d50/f5e [0,4194304] 0 2024-04-16T14:35:37.341 INFO:tasks.workunit.client.1.smithi115.stdout:7/328: symlink d0/d2/d3a/d30/l70 0 2024-04-16T14:35:37.342 INFO:tasks.workunit.client.1.smithi115.stdout:9/401: creat d1/d6/d2d/d4b/d60/d65/f80 x:0 0 0 2024-04-16T14:35:37.344 INFO:tasks.workunit.client.1.smithi115.stdout:9/402: dread d1/d6/d2d/d4b/d6c/d20/d2a/f6e [0,4194304] 0 2024-04-16T14:35:37.344 INFO:tasks.workunit.client.1.smithi115.stdout:9/403: write d1/d6/d2d/d4b/d6c/f44 [809225,126837] 0 2024-04-16T14:35:37.344 INFO:tasks.workunit.client.1.smithi115.stdout:7/329: creat d0/d24/d2b/d64/f71 x:0 0 0 2024-04-16T14:35:37.346 INFO:tasks.workunit.client.0.smithi005.stdout:1/752: dwrite d2/d1c/d15/f9c [0,4194304] 0 2024-04-16T14:35:37.346 INFO:tasks.workunit.client.1.smithi115.stdout:9/404: rename d1/d6/d2d/d4b/d6c/l2e to d1/d6/d2d/d4b/d60/l81 0 2024-04-16T14:35:37.347 INFO:tasks.workunit.client.1.smithi115.stdout:9/405: read d1/d6/d2d/d4b/d6c/d20/d2a/f6e [469426,63433] 0 2024-04-16T14:35:37.348 INFO:tasks.workunit.client.1.smithi115.stdout:8/374: dread d0/db/d10/d25/d2d/d3b/f3c [0,4194304] 0 2024-04-16T14:35:37.348 INFO:tasks.workunit.client.1.smithi115.stdout:8/375: write d0/db/d10/d25/d2d/f35 [1550497,35260] 0 2024-04-16T14:35:37.348 INFO:tasks.workunit.client.1.smithi115.stdout:7/330: symlink d0/d1/d3b/l72 0 2024-04-16T14:35:37.349 INFO:tasks.workunit.client.0.smithi005.stdout:1/753: rename d2/d1c/d15/d2a/d19/d42/d64/d76/f72 to d2/d1c/dd8/f10a 0 2024-04-16T14:35:37.349 INFO:tasks.workunit.client.0.smithi005.stdout:1/754: write d2/d1c/f17 [42850,93441] 0 2024-04-16T14:35:37.350 INFO:tasks.workunit.client.1.smithi115.stdout:9/406: rename d1/d6/d2d/d4b/d6c/d20/d36/f39 to d1/d6/d2d/d3d/f82 0 2024-04-16T14:35:37.352 INFO:tasks.workunit.client.1.smithi115.stdout:8/376: mkdir d0/db/d10/d25/d2d/d73 0 2024-04-16T14:35:37.353 INFO:tasks.workunit.client.1.smithi115.stdout:7/331: mkdir d0/d2/d3a/d73 0 2024-04-16T14:35:37.355 INFO:tasks.workunit.client.0.smithi005.stdout:1/755: dread d2/d74/dd7/f90 [0,4194304] 0 2024-04-16T14:35:37.359 INFO:tasks.workunit.client.0.smithi005.stdout:1/756: rename d2/d1c/d15/d2a/d19/d20/d27/f54 to d2/d74/dd7/f10b 0 2024-04-16T14:35:37.359 INFO:tasks.workunit.client.0.smithi005.stdout:1/757: chown d2/d1c 24864155 1 2024-04-16T14:35:37.359 INFO:tasks.workunit.client.0.smithi005.stdout:1/758: creat d2/d1c/d15/d2a/d19/d20/d27/f10c x:0 0 0 2024-04-16T14:35:37.359 INFO:tasks.workunit.client.1.smithi115.stdout:9/407: rmdir d1/d6/d2d/d4b 39 2024-04-16T14:35:37.359 INFO:tasks.workunit.client.1.smithi115.stdout:9/408: read - d1/d6/d2d/d4b/d6c/f77 zero size 2024-04-16T14:35:37.359 INFO:tasks.workunit.client.1.smithi115.stdout:9/409: read d1/d6/d2d/d4b/d6c/d20/f2c [565192,23278] 0 2024-04-16T14:35:37.360 INFO:tasks.workunit.client.0.smithi005.stdout:1/759: symlink d2/d74/d7a/d100/l10d 0 2024-04-16T14:35:37.361 INFO:tasks.workunit.client.1.smithi115.stdout:9/410: mkdir d1/d83 0 2024-04-16T14:35:37.371 INFO:tasks.workunit.client.0.smithi005.stdout:2/397: dwrite d0/d4/d2b/d5e/f60 [0,4194304] 0 2024-04-16T14:35:37.372 INFO:tasks.workunit.client.1.smithi115.stdout:9/411: write d1/d6/d2d/d4b/d6c/d20/f22 [2002759,76660] 0 2024-04-16T14:35:37.372 INFO:tasks.workunit.client.1.smithi115.stdout:9/412: truncate d1/d6/d2d/d4b/d60/d65/f80 1033722 0 2024-04-16T14:35:37.376 INFO:tasks.workunit.client.0.smithi005.stdout:6/818: dwrite d2/d20/fbd [0,4194304] 0 2024-04-16T14:35:37.376 INFO:tasks.workunit.client.0.smithi005.stdout:6/819: chown d2/d5/d10/d68/c8a 1 1 2024-04-16T14:35:37.377 INFO:tasks.workunit.client.1.smithi115.stdout:9/413: symlink d1/d6/d33/l84 0 2024-04-16T14:35:37.377 INFO:tasks.workunit.client.1.smithi115.stdout:9/414: creat d1/d6/d33/f85 x:0 0 0 2024-04-16T14:35:37.378 INFO:tasks.workunit.client.0.smithi005.stdout:6/820: stat d2/d20/d33/l4b 0 2024-04-16T14:35:37.382 INFO:tasks.workunit.client.0.smithi005.stdout:6/821: symlink d2/d5/d28/l113 0 2024-04-16T14:35:37.383 INFO:tasks.workunit.client.0.smithi005.stdout:3/594: dwrite d2/f2c [0,4194304] 0 2024-04-16T14:35:37.383 INFO:tasks.workunit.client.0.smithi005.stdout:6/822: rename d2/d20/d33/l4b to d2/d5/d10/dd6/d8e/l114 0 2024-04-16T14:35:37.384 INFO:tasks.workunit.client.1.smithi115.stdout:9/415: creat d1/f86 x:0 0 0 2024-04-16T14:35:37.384 INFO:tasks.workunit.client.1.smithi115.stdout:6/404: dwrite d13/d1a/f77 [0,4194304] 0 2024-04-16T14:35:37.384 INFO:tasks.workunit.client.1.smithi115.stdout:6/405: write d13/f2a [5708124,80918] 0 2024-04-16T14:35:37.384 INFO:tasks.workunit.client.1.smithi115.stdout:1/305: dwrite df/d35/f65 [0,4194304] 0 2024-04-16T14:35:37.384 INFO:tasks.workunit.client.1.smithi115.stdout:1/306: write df/d2d/f5a [30926,11177] 0 2024-04-16T14:35:37.384 INFO:tasks.workunit.client.1.smithi115.stdout:3/381: dwrite dc/f11 [0,4194304] 0 2024-04-16T14:35:37.384 INFO:tasks.workunit.client.1.smithi115.stdout:9/416: creat d1/d6/d2d/d4b/d6c/d20/f87 x:0 0 0 2024-04-16T14:35:37.385 INFO:tasks.workunit.client.1.smithi115.stdout:6/406: mknod d13/d1d/d2b/d46/d5a/c88 0 2024-04-16T14:35:37.385 INFO:tasks.workunit.client.1.smithi115.stdout:6/407: write d13/d1a/d55/f58 [760541,55638] 0 2024-04-16T14:35:37.388 INFO:tasks.workunit.client.1.smithi115.stdout:6/408: rmdir d13/d1d/d87 39 2024-04-16T14:35:37.389 INFO:tasks.workunit.client.1.smithi115.stdout:3/382: dread dc/d24/f49 [0,4194304] 0 2024-04-16T14:35:37.389 INFO:tasks.workunit.client.1.smithi115.stdout:3/383: creat dc/d29/f85 x:0 0 0 2024-04-16T14:35:37.389 INFO:tasks.workunit.client.1.smithi115.stdout:3/384: getdents dc/d24/d33/d4b/d65/d69 0 2024-04-16T14:35:37.390 INFO:tasks.workunit.client.1.smithi115.stdout:7/332: dwrite d0/d1/d3b/d3e/f5c [0,4194304] 0 2024-04-16T14:35:37.391 INFO:tasks.workunit.client.0.smithi005.stdout:1/760: dwrite d2/d1c/d15/ff1 [0,4194304] 0 2024-04-16T14:35:37.392 INFO:tasks.workunit.client.0.smithi005.stdout:6/823: mkdir d2/d20/d33/d115 0 2024-04-16T14:35:37.395 INFO:tasks.workunit.client.1.smithi115.stdout:7/333: creat d0/d2/d3a/d30/f74 x:0 0 0 2024-04-16T14:35:37.396 INFO:tasks.workunit.client.0.smithi005.stdout:3/595: dread d2/d17/f6f [0,4194304] 0 2024-04-16T14:35:37.396 INFO:tasks.workunit.client.0.smithi005.stdout:3/596: write d2/d17/d46/d47/fb5 [226191,96842] 0 2024-04-16T14:35:37.396 INFO:tasks.workunit.client.0.smithi005.stdout:3/597: write d2/d17/d46/d47/fb5 [941640,34933] 0 2024-04-16T14:35:37.396 INFO:tasks.workunit.client.0.smithi005.stdout:3/598: creat d2/d9/df/fc8 x:0 0 0 2024-04-16T14:35:37.399 INFO:tasks.workunit.client.0.smithi005.stdout:6/824: rmdir d2/de1/df0 0 2024-04-16T14:35:37.399 INFO:tasks.workunit.client.0.smithi005.stdout:6/825: readlink d2/d5/l65 0 2024-04-16T14:35:37.399 INFO:tasks.workunit.client.0.smithi005.stdout:6/826: fdatasync d2/d3f/f4f 0 2024-04-16T14:35:37.399 INFO:tasks.workunit.client.0.smithi005.stdout:6/827: readlink d2/d3f/d47/d84/ldd 0 2024-04-16T14:35:37.401 INFO:tasks.workunit.client.0.smithi005.stdout:6/828: mknod d2/de1/c116 0 2024-04-16T14:35:37.401 INFO:tasks.workunit.client.1.smithi115.stdout:3/385: write f4 [2426380,21118] 0 2024-04-16T14:35:37.402 INFO:tasks.workunit.client.1.smithi115.stdout:3/386: write dc/d29/d4d/f59 [126815,106119] 0 2024-04-16T14:35:37.402 INFO:tasks.workunit.client.1.smithi115.stdout:3/387: getdents dc/d29/d4d/d56/d7e/d84 0 2024-04-16T14:35:37.403 INFO:tasks.workunit.client.0.smithi005.stdout:6/829: mkdir d2/d3f/d53/d54/dff/d117 0 2024-04-16T14:35:37.405 INFO:tasks.workunit.client.0.smithi005.stdout:6/830: getdents d2/d3f/d47/d84 0 2024-04-16T14:35:37.405 INFO:tasks.workunit.client.1.smithi115.stdout:8/377: rename d0/db/d10/d25/d2d to d0/db/d10/d17/d2c/d52/d74 0 2024-04-16T14:35:37.405 INFO:tasks.workunit.client.1.smithi115.stdout:8/378: fdatasync d0/db/f24 0 2024-04-16T14:35:37.406 INFO:tasks.workunit.client.1.smithi115.stdout:8/379: dread - d0/db/d10/d25/f5f zero size 2024-04-16T14:35:37.406 INFO:tasks.workunit.client.1.smithi115.stdout:8/380: truncate d0/db/d10/d25/f46 900048 0 2024-04-16T14:35:37.406 INFO:tasks.workunit.client.0.smithi005.stdout:3/599: read d2/d9/d51/f58 [2361081,2996] 0 2024-04-16T14:35:37.406 INFO:tasks.workunit.client.0.smithi005.stdout:6/831: creat d2/d20/d3c/dcf/f118 x:0 0 0 2024-04-16T14:35:37.407 INFO:tasks.workunit.client.1.smithi115.stdout:1/307: rename df/d35/d48/f57 to df/d35/f67 0 2024-04-16T14:35:37.407 INFO:tasks.workunit.client.1.smithi115.stdout:1/308: fdatasync df/d13/d4d/d3e/f46 0 2024-04-16T14:35:37.407 INFO:tasks.workunit.client.1.smithi115.stdout:8/381: truncate d0/db/f15 3625195 0 2024-04-16T14:35:37.408 INFO:tasks.workunit.client.1.smithi115.stdout:8/382: chown d0/db/f55 14 1 2024-04-16T14:35:37.408 INFO:tasks.workunit.client.0.smithi005.stdout:6/832: creat d2/d5/f119 x:0 0 0 2024-04-16T14:35:37.409 INFO:tasks.workunit.client.1.smithi115.stdout:9/417: rename d1/d83 to d1/d6/d2d/d3d/d49/d88 0 2024-04-16T14:35:37.409 INFO:tasks.workunit.client.0.smithi005.stdout:6/833: rename d2/d3f/d47/d84/ldd to d2/d3f/d47/l11a 0 2024-04-16T14:35:37.410 INFO:tasks.workunit.client.1.smithi115.stdout:1/309: truncate df/f25 121853 0 2024-04-16T14:35:37.411 INFO:tasks.workunit.client.1.smithi115.stdout:8/383: unlink d0/db/d10/d25/f46 0 2024-04-16T14:35:37.412 INFO:tasks.workunit.client.0.smithi005.stdout:6/834: creat d2/d3f/d53/dba/d111/f11b x:0 0 0 2024-04-16T14:35:37.413 INFO:tasks.workunit.client.0.smithi005.stdout:3/600: dread d2/d92/fc0 [0,4194304] 0 2024-04-16T14:35:37.413 INFO:tasks.workunit.client.0.smithi005.stdout:3/601: readlink d2/d17/d46/d47/l82 0 2024-04-16T14:35:37.414 INFO:tasks.workunit.client.1.smithi115.stdout:6/409: rename d13/d1d/d2b/f67 to d13/d1d/d2b/d46/d63/f89 0 2024-04-16T14:35:37.415 INFO:tasks.workunit.client.1.smithi115.stdout:3/388: dread dc/d24/d36/f3b [0,4194304] 0 2024-04-16T14:35:37.415 INFO:tasks.workunit.client.1.smithi115.stdout:3/389: chown dc/d29/f2e 1638590 1 2024-04-16T14:35:37.415 INFO:tasks.workunit.client.1.smithi115.stdout:3/390: fdatasync dc/f64 0 2024-04-16T14:35:37.415 INFO:tasks.workunit.client.1.smithi115.stdout:3/391: fdatasync dc/f21 0 2024-04-16T14:35:37.415 INFO:tasks.workunit.client.1.smithi115.stdout:3/392: truncate dc/d24/f6f 934460 0 2024-04-16T14:35:37.415 INFO:tasks.workunit.client.1.smithi115.stdout:9/418: mknod d1/d7f/c89 0 2024-04-16T14:35:37.415 INFO:tasks.workunit.client.1.smithi115.stdout:9/419: truncate d1/d6/d2d/d4b/d6c/d20/d2a/f6e 1070780 0 2024-04-16T14:35:37.416 INFO:tasks.workunit.client.0.smithi005.stdout:6/835: rename d2/d5/d10/f3e to d2/d3f/d53/d54/dff/f11c 0 2024-04-16T14:35:37.416 INFO:tasks.workunit.client.0.smithi005.stdout:6/836: chown d2/d3f/d53/f88 1 1 2024-04-16T14:35:37.416 INFO:tasks.workunit.client.0.smithi005.stdout:6/837: dread - d2/d3f/d47/d84/dbf/feb zero size 2024-04-16T14:35:37.416 INFO:tasks.workunit.client.1.smithi115.stdout:1/310: mkdir df/d13/d4d/d68 0 2024-04-16T14:35:37.416 INFO:tasks.workunit.client.1.smithi115.stdout:1/311: read - df/d13/d4d/d3e/f62 zero size 2024-04-16T14:35:37.417 INFO:tasks.workunit.client.0.smithi005.stdout:0/578: sync 2024-04-16T14:35:37.417 INFO:tasks.workunit.client.0.smithi005.stdout:9/403: sync 2024-04-16T14:35:37.417 INFO:tasks.workunit.client.0.smithi005.stdout:8/587: sync 2024-04-16T14:35:37.417 INFO:tasks.workunit.client.0.smithi005.stdout:9/404: fdatasync d3/d12/d16/f19 0 2024-04-16T14:35:37.417 INFO:tasks.workunit.client.0.smithi005.stdout:9/405: readlink d3/la 0 2024-04-16T14:35:37.417 INFO:tasks.workunit.client.0.smithi005.stdout:7/679: sync 2024-04-16T14:35:37.418 INFO:tasks.workunit.client.0.smithi005.stdout:7/680: dread - d1/d85/fb4 zero size 2024-04-16T14:35:37.418 INFO:tasks.workunit.client.0.smithi005.stdout:4/866: sync 2024-04-16T14:35:37.418 INFO:tasks.workunit.client.0.smithi005.stdout:5/627: sync 2024-04-16T14:35:37.418 INFO:tasks.workunit.client.1.smithi115.stdout:0/266: sync 2024-04-16T14:35:37.418 INFO:tasks.workunit.client.1.smithi115.stdout:3/393: mkdir dc/d29/d39/d86 0 2024-04-16T14:35:37.420 INFO:tasks.workunit.client.0.smithi005.stdout:8/588: creat d5/d7b/da8/db7/d8a/da1/d3d/fd2 x:0 0 0 2024-04-16T14:35:37.420 INFO:tasks.workunit.client.1.smithi115.stdout:9/420: creat d1/d6/d2d/d4b/d6c/d20/d36/f8a x:0 0 0 2024-04-16T14:35:37.421 INFO:tasks.workunit.client.0.smithi005.stdout:9/406: symlink d3/d49/d4b/l74 0 2024-04-16T14:35:37.421 INFO:tasks.workunit.client.0.smithi005.stdout:9/407: write d3/d49/f50 [550541,81508] 0 2024-04-16T14:35:37.421 INFO:tasks.workunit.client.0.smithi005.stdout:9/408: read - d3/d12/d2b/f59 zero size 2024-04-16T14:35:37.421 INFO:tasks.workunit.client.0.smithi005.stdout:9/409: readlink d3/d12/d16/l27 0 2024-04-16T14:35:37.421 INFO:tasks.workunit.client.1.smithi115.stdout:8/384: rename d0/db/d10/f1e to d0/db/d10/d17/d22/f75 0 2024-04-16T14:35:37.422 INFO:tasks.workunit.client.0.smithi005.stdout:3/602: dread d2/d17/f38 [4194304,4194304] 0 2024-04-16T14:35:37.424 INFO:tasks.workunit.client.1.smithi115.stdout:0/267: getdents d6/d1b 0 2024-04-16T14:35:37.424 INFO:tasks.workunit.client.0.smithi005.stdout:7/681: creat d1/d49/d74/d77/fe6 x:0 0 0 2024-04-16T14:35:37.425 INFO:tasks.workunit.client.1.smithi115.stdout:3/394: mknod dc/d24/d33/d4b/d65/c87 0 2024-04-16T14:35:37.426 INFO:tasks.workunit.client.0.smithi005.stdout:5/628: mknod d0/d6/d98/cd3 0 2024-04-16T14:35:37.428 INFO:tasks.workunit.client.1.smithi115.stdout:9/421: rename d1/d6/d2d/d3d/l78 to d1/d6/d2d/d3d/d49/d88/l8b 0 2024-04-16T14:35:37.428 INFO:tasks.workunit.client.1.smithi115.stdout:9/422: readlink d1/d6/d2d/d3d/d50/l51 0 2024-04-16T14:35:37.428 INFO:tasks.workunit.client.1.smithi115.stdout:9/423: readlink d1/d6/d2d/d3d/d49/d88/l8b 0 2024-04-16T14:35:37.428 INFO:tasks.workunit.client.0.smithi005.stdout:8/589: mkdir d5/d7b/da8/db7/d8a/da1/d68/dd3 0 2024-04-16T14:35:37.428 INFO:tasks.workunit.client.1.smithi115.stdout:8/385: readlink d0/db/d10/d17/d22/l4e 0 2024-04-16T14:35:37.429 INFO:tasks.workunit.client.1.smithi115.stdout:0/268: getdents d6/d10/d12/d5f 0 2024-04-16T14:35:37.429 INFO:tasks.workunit.client.1.smithi115.stdout:0/269: creat d6/d10/f63 x:0 0 0 2024-04-16T14:35:37.430 INFO:tasks.workunit.client.0.smithi005.stdout:9/410: unlink d3/d12/d16/d46/f5e 0 2024-04-16T14:35:37.430 INFO:tasks.workunit.client.0.smithi005.stdout:9/411: write d3/f3c [5348063,21422] 0 2024-04-16T14:35:37.431 INFO:tasks.workunit.client.1.smithi115.stdout:6/410: dread d13/d1d/d2b/d46/f6b [0,4194304] 0 2024-04-16T14:35:37.431 INFO:tasks.workunit.client.1.smithi115.stdout:3/395: symlink dc/l88 0 2024-04-16T14:35:37.433 INFO:tasks.workunit.client.1.smithi115.stdout:8/386: creat d0/db/d10/d17/d2c/d61/f76 x:0 0 0 2024-04-16T14:35:37.433 INFO:tasks.workunit.client.0.smithi005.stdout:5/629: creat d0/d6/d12/dc0/d30/d97/fd4 x:0 0 0 2024-04-16T14:35:37.433 INFO:tasks.workunit.client.0.smithi005.stdout:5/630: chown d0/d6/d12/d1c/d1e/d73/dba 1044986910 1 2024-04-16T14:35:37.433 INFO:tasks.workunit.client.0.smithi005.stdout:5/631: chown d0/d6/d12/dc0/d30/c67 55 1 2024-04-16T14:35:37.433 INFO:tasks.workunit.client.0.smithi005.stdout:5/632: chown d0/d70/l80 775911172 1 2024-04-16T14:35:37.434 INFO:tasks.workunit.client.0.smithi005.stdout:3/603: dread d2/f2c [0,4194304] 0 2024-04-16T14:35:37.434 INFO:tasks.workunit.client.0.smithi005.stdout:3/604: fdatasync d2/d17/d46/d75/d9b/fbc 0 2024-04-16T14:35:37.435 INFO:tasks.workunit.client.0.smithi005.stdout:9/412: creat d3/d12/d16/d46/d47/d60/f75 x:0 0 0 2024-04-16T14:35:37.437 INFO:tasks.workunit.client.0.smithi005.stdout:5/633: rename d0/d6/fa1 to d0/d6/d12/dc0/d30/fd5 0 2024-04-16T14:35:37.438 INFO:tasks.workunit.client.1.smithi115.stdout:6/411: creat d13/d1d/d2b/d46/f8a x:0 0 0 2024-04-16T14:35:37.439 INFO:tasks.workunit.client.1.smithi115.stdout:9/424: dread d1/d6/f3e [0,4194304] 0 2024-04-16T14:35:37.439 INFO:tasks.workunit.client.1.smithi115.stdout:3/396: getdents dc/d29/d4d/d56/d7e 0 2024-04-16T14:35:37.440 INFO:tasks.workunit.client.0.smithi005.stdout:3/605: mknod d2/d17/d46/d47/cc9 0 2024-04-16T14:35:37.441 INFO:tasks.workunit.client.1.smithi115.stdout:8/387: creat d0/db/d10/d17/d2c/d52/d74/d3b/f77 x:0 0 0 2024-04-16T14:35:37.442 INFO:tasks.workunit.client.0.smithi005.stdout:9/413: unlink d3/d12/d16/d46/d47/f5a 0 2024-04-16T14:35:37.442 INFO:tasks.workunit.client.0.smithi005.stdout:9/414: dread - d3/d12/d16/d46/d47/d60/f75 zero size 2024-04-16T14:35:37.443 INFO:tasks.workunit.client.1.smithi115.stdout:9/425: unlink d1/d6/d2d/d4b/d6c/d20/f3c 0 2024-04-16T14:35:37.444 INFO:tasks.workunit.client.0.smithi005.stdout:5/634: creat d0/d6/d12/dc0/d6d/fd6 x:0 0 0 2024-04-16T14:35:37.444 INFO:tasks.workunit.client.0.smithi005.stdout:5/635: chown d0/d6/d12/d1c/d81/l91 4812 1 2024-04-16T14:35:37.444 INFO:tasks.workunit.client.1.smithi115.stdout:3/397: write dc/d24/d33/f68 [713012,62384] 0 2024-04-16T14:35:37.445 INFO:tasks.workunit.client.1.smithi115.stdout:3/398: creat dc/d29/d39/d86/f89 x:0 0 0 2024-04-16T14:35:37.446 INFO:tasks.workunit.client.0.smithi005.stdout:3/606: link d2/d9/d51/c8a d2/d17/d46/d75/d9b/cca 0 2024-04-16T14:35:37.446 INFO:tasks.workunit.client.0.smithi005.stdout:3/607: readlink d2/d9/lae 0 2024-04-16T14:35:37.446 INFO:tasks.workunit.client.0.smithi005.stdout:3/608: dread - d2/d6b/d7a/f8c zero size 2024-04-16T14:35:37.446 INFO:tasks.workunit.client.0.smithi005.stdout:3/609: creat d2/d17/d46/d75/d9b/fcb x:0 0 0 2024-04-16T14:35:37.447 INFO:tasks.workunit.client.0.smithi005.stdout:7/682: dread d1/d49/d74/d77/d22/f8c [0,4194304] 0 2024-04-16T14:35:37.448 INFO:tasks.workunit.client.0.smithi005.stdout:5/636: mkdir d0/d6/d12/d1c/d81/dd7 0 2024-04-16T14:35:37.448 INFO:tasks.workunit.client.0.smithi005.stdout:5/637: readlink d0/d6/d12/dc0/l6c 0 2024-04-16T14:35:37.449 INFO:tasks.workunit.client.0.smithi005.stdout:5/638: truncate d0/d6/d6e/f7a 51958 0 2024-04-16T14:35:37.449 INFO:tasks.workunit.client.0.smithi005.stdout:5/639: dread - d0/d6/d12/dc0/d30/d97/fd4 zero size 2024-04-16T14:35:37.450 INFO:tasks.workunit.client.0.smithi005.stdout:3/610: rmdir d2/d17/d46 39 2024-04-16T14:35:37.450 INFO:tasks.workunit.client.0.smithi005.stdout:3/611: chown d2/d17/d46/d75/d41/c7b 100304 1 2024-04-16T14:35:37.454 INFO:tasks.workunit.client.0.smithi005.stdout:3/612: rmdir d2/d9/d5e/d9f 0 2024-04-16T14:35:37.454 INFO:tasks.workunit.client.0.smithi005.stdout:3/613: fsync d2/d17/d46/d75/d9b/fb8 0 2024-04-16T14:35:37.457 INFO:tasks.workunit.client.0.smithi005.stdout:3/614: rmdir d2/dba 0 2024-04-16T14:35:37.460 INFO:tasks.workunit.client.0.smithi005.stdout:1/761: dwrite d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/dc5/df4/ffc [0,4194304] 0 2024-04-16T14:35:37.460 INFO:tasks.workunit.client.0.smithi005.stdout:1/762: stat d2/d2c 0 2024-04-16T14:35:37.461 INFO:tasks.workunit.client.1.smithi115.stdout:7/334: dwrite d0/d1/d3b/d3e/f56 [0,4194304] 0 2024-04-16T14:35:37.461 INFO:tasks.workunit.client.1.smithi115.stdout:7/335: fdatasync d0/d24/f37 0 2024-04-16T14:35:37.461 INFO:tasks.workunit.client.0.smithi005.stdout:3/615: rename d2/l1a to d2/d9/df/dbf/lcc 0 2024-04-16T14:35:37.461 INFO:tasks.workunit.client.0.smithi005.stdout:3/616: fdatasync d2/f2c 0 2024-04-16T14:35:37.463 INFO:tasks.workunit.client.0.smithi005.stdout:1/763: unlink d2/f3f 0 2024-04-16T14:35:37.463 INFO:tasks.workunit.client.0.smithi005.stdout:1/764: dread - d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/dc5/fd5 zero size 2024-04-16T14:35:37.465 INFO:tasks.workunit.client.1.smithi115.stdout:3/399: write dc/d24/d36/f4e [4054983,41768] 0 2024-04-16T14:35:37.465 INFO:tasks.workunit.client.1.smithi115.stdout:7/336: rename d0/f36 to d0/d2/d3a/d30/d6b/f75 0 2024-04-16T14:35:37.467 INFO:tasks.workunit.client.1.smithi115.stdout:3/400: mkdir dc/d29/d4d/d56/d8a 0 2024-04-16T14:35:37.468 INFO:tasks.workunit.client.1.smithi115.stdout:7/337: rename d0/d1/d3b/l6f to d0/d2/d3a/d73/l76 0 2024-04-16T14:35:37.468 INFO:tasks.workunit.client.0.smithi005.stdout:3/617: dread d2/f44 [4194304,4194304] 0 2024-04-16T14:35:37.470 INFO:tasks.workunit.client.1.smithi115.stdout:4/377: sync 2024-04-16T14:35:37.470 INFO:tasks.workunit.client.1.smithi115.stdout:4/378: write d1/d2/f8 [2607456,96738] 0 2024-04-16T14:35:37.472 INFO:tasks.workunit.client.1.smithi115.stdout:3/401: unlink dc/d29/d4d/f6d 0 2024-04-16T14:35:37.474 INFO:tasks.workunit.client.1.smithi115.stdout:7/338: creat d0/d1/d3b/d49/d5d/f77 x:0 0 0 2024-04-16T14:35:37.480 INFO:tasks.workunit.client.0.smithi005.stdout:0/579: dwrite da/d7c/faf [0,4194304] 0 2024-04-16T14:35:37.480 INFO:tasks.workunit.client.1.smithi115.stdout:1/312: dwrite df/d13/d4d/d2c/f24 [0,4194304] 0 2024-04-16T14:35:37.480 INFO:tasks.workunit.client.1.smithi115.stdout:0/270: dwrite d6/d30/d4d/f4c [0,4194304] 0 2024-04-16T14:35:37.481 INFO:tasks.workunit.client.1.smithi115.stdout:1/313: creat df/d35/d48/f69 x:0 0 0 2024-04-16T14:35:37.481 INFO:tasks.workunit.client.0.smithi005.stdout:3/618: write d2/d17/d46/d47/fb5 [781469,31955] 0 2024-04-16T14:35:37.481 INFO:tasks.workunit.client.0.smithi005.stdout:3/619: stat d2/fe 0 2024-04-16T14:35:37.482 INFO:tasks.workunit.client.1.smithi115.stdout:1/314: write df/d35/f39 [298186,69465] 0 2024-04-16T14:35:37.482 INFO:tasks.workunit.client.1.smithi115.stdout:1/315: fsync df/d35/d48/f4c 0 2024-04-16T14:35:37.482 INFO:tasks.workunit.client.1.smithi115.stdout:1/316: dread - df/d13/f59 zero size 2024-04-16T14:35:37.482 INFO:tasks.workunit.client.1.smithi115.stdout:1/317: write df/f1d [1307921,77452] 0 2024-04-16T14:35:37.482 INFO:tasks.workunit.client.1.smithi115.stdout:1/318: write df/d35/d48/f61 [3412827,113777] 0 2024-04-16T14:35:37.482 INFO:tasks.workunit.client.1.smithi115.stdout:1/319: write df/f23 [777563,24169] 0 2024-04-16T14:35:37.484 INFO:tasks.workunit.client.1.smithi115.stdout:4/379: dread d1/d15/d1e/f35 [0,4194304] 0 2024-04-16T14:35:37.485 INFO:tasks.workunit.client.1.smithi115.stdout:0/271: mkdir d6/d10/d12/d5f/d64 0 2024-04-16T14:35:37.485 INFO:tasks.workunit.client.1.smithi115.stdout:0/272: creat d6/f65 x:0 0 0 2024-04-16T14:35:37.486 INFO:tasks.workunit.client.0.smithi005.stdout:3/620: dread d2/f2c [0,4194304] 0 2024-04-16T14:35:37.486 INFO:tasks.workunit.client.0.smithi005.stdout:3/621: rmdir d2/d9/d25/d39 39 2024-04-16T14:35:37.487 INFO:tasks.workunit.client.1.smithi115.stdout:1/320: rename df/d35/d48/f61 to df/d36/f6a 0 2024-04-16T14:35:37.488 INFO:tasks.workunit.client.1.smithi115.stdout:1/321: write df/d35/d48/f4c [789243,4623] 0 2024-04-16T14:35:37.488 INFO:tasks.workunit.client.1.smithi115.stdout:1/322: stat df/d36/f3d 0 2024-04-16T14:35:37.489 INFO:tasks.workunit.client.1.smithi115.stdout:4/380: rmdir d1/d2 39 2024-04-16T14:35:37.489 INFO:tasks.workunit.client.1.smithi115.stdout:4/381: chown d1/d15/d31/l3e 15202 1 2024-04-16T14:35:37.491 INFO:tasks.workunit.client.1.smithi115.stdout:9/426: dwrite d1/d6/d33/f85 [0,4194304] 0 2024-04-16T14:35:37.491 INFO:tasks.workunit.client.1.smithi115.stdout:9/427: stat d1/d6/d2d/d4b/d6c/d20/d36/f52 0 2024-04-16T14:35:37.491 INFO:tasks.workunit.client.1.smithi115.stdout:9/428: write d1/d6/d2d/d4b/d6c/d20/f22 [552093,129962] 0 2024-04-16T14:35:37.492 INFO:tasks.workunit.client.0.smithi005.stdout:7/683: dwrite d1/d49/d74/fdc [0,4194304] 0 2024-04-16T14:35:37.492 INFO:tasks.workunit.client.0.smithi005.stdout:8/590: dwrite d5/d7b/da8/db7/d8a/da1/fd0 [0,4194304] 0 2024-04-16T14:35:37.492 INFO:tasks.workunit.client.0.smithi005.stdout:8/591: fsync d5/d11/f5f 0 2024-04-16T14:35:37.492 INFO:tasks.workunit.client.0.smithi005.stdout:8/592: stat d5/d11 0 2024-04-16T14:35:37.492 INFO:tasks.workunit.client.0.smithi005.stdout:1/765: dwrite d2/d1c/d15/d2a/f16 [0,4194304] 0 2024-04-16T14:35:37.492 INFO:tasks.workunit.client.0.smithi005.stdout:1/766: stat d2/d1c/d15/d2a/cfd 0 2024-04-16T14:35:37.498 INFO:tasks.workunit.client.1.smithi115.stdout:0/273: write d6/f25 [4143644,14610] 0 2024-04-16T14:35:37.498 INFO:tasks.workunit.client.1.smithi115.stdout:0/274: fsync d6/d30/d4d/f4c 0 2024-04-16T14:35:37.499 INFO:tasks.workunit.client.1.smithi115.stdout:9/429: rename d1/d6/d2d/d4b/d6c/d20/l4f to d1/d6/d2d/d4b/d6c/d20/d2a/l8c 0 2024-04-16T14:35:37.504 INFO:tasks.workunit.client.1.smithi115.stdout:1/323: write df/f1a [3692025,85985] 0 2024-04-16T14:35:37.504 INFO:tasks.workunit.client.1.smithi115.stdout:1/324: creat df/d35/d48/f6b x:0 0 0 2024-04-16T14:35:37.504 INFO:tasks.workunit.client.1.smithi115.stdout:8/388: dwrite d0/db/d10/d17/f4c [0,4194304] 0 2024-04-16T14:35:37.504 INFO:tasks.workunit.client.1.smithi115.stdout:8/389: dread - d0/db/d10/d17/d22/f5d zero size 2024-04-16T14:35:37.506 INFO:tasks.workunit.client.1.smithi115.stdout:9/430: link d1/d6/d2d/c18 d1/d6/c8d 0 2024-04-16T14:35:37.508 INFO:tasks.workunit.client.0.smithi005.stdout:8/593: creat d5/d7b/da8/da5/fd4 x:0 0 0 2024-04-16T14:35:37.510 INFO:tasks.workunit.client.0.smithi005.stdout:1/767: mknod d2/d1c/d15/c10e 0 2024-04-16T14:35:37.511 INFO:tasks.workunit.client.1.smithi115.stdout:1/325: rmdir df/d13/d4d/d2c/d54 39 2024-04-16T14:35:37.518 INFO:tasks.workunit.client.1.smithi115.stdout:6/412: rmdir d13/d1d/d2b/d46 39 2024-04-16T14:35:37.519 INFO:tasks.workunit.client.1.smithi115.stdout:6/413: chown d13/d1d/d2b/d46/d5a/c50 44 1 2024-04-16T14:35:37.519 INFO:tasks.workunit.client.1.smithi115.stdout:9/431: dread d1/d6/d2d/d3d/d50/f5e [0,4194304] 0 2024-04-16T14:35:37.519 INFO:tasks.workunit.client.1.smithi115.stdout:6/414: write d13/d1a/f44 [812596,112411] 0 2024-04-16T14:35:37.519 INFO:tasks.workunit.client.1.smithi115.stdout:9/432: creat d1/d6/d29/f8e x:0 0 0 2024-04-16T14:35:37.519 INFO:tasks.workunit.client.1.smithi115.stdout:6/415: fsync d13/d1d/d2b/d46/d5a/d62/f7e 0 2024-04-16T14:35:37.519 INFO:tasks.workunit.client.0.smithi005.stdout:8/594: link d5/d40/fb8 d5/d55/d5a/fd5 0 2024-04-16T14:35:37.520 INFO:tasks.workunit.client.1.smithi115.stdout:6/416: write f11 [315831,106228] 0 2024-04-16T14:35:37.524 INFO:tasks.workunit.client.0.smithi005.stdout:1/768: link d2/fee d2/d1c/d15/f10f 0 2024-04-16T14:35:37.524 INFO:tasks.workunit.client.0.smithi005.stdout:1/769: dread - d2/d1c/d15/d2a/d19/d20/fec zero size 2024-04-16T14:35:37.524 INFO:tasks.workunit.client.0.smithi005.stdout:1/770: stat d2/d1c/d15/la4 0 2024-04-16T14:35:37.525 INFO:tasks.workunit.client.0.smithi005.stdout:1/771: getdents d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/dc5/dbc/dcf 0 2024-04-16T14:35:37.526 INFO:tasks.workunit.client.1.smithi115.stdout:8/390: mknod d0/db/c78 0 2024-04-16T14:35:37.526 INFO:tasks.workunit.client.1.smithi115.stdout:8/391: readlink d0/db/l33 0 2024-04-16T14:35:37.526 INFO:tasks.workunit.client.1.smithi115.stdout:0/275: dwrite f1 [4194304,4194304] 0 2024-04-16T14:35:37.526 INFO:tasks.workunit.client.1.smithi115.stdout:0/276: dread - d6/f4f zero size 2024-04-16T14:35:37.526 INFO:tasks.workunit.client.1.smithi115.stdout:8/392: read d0/db/d10/d17/d2c/d52/d74/f45 [13272,121467] 0 2024-04-16T14:35:37.527 INFO:tasks.workunit.client.0.smithi005.stdout:9/415: fsync d3/d12/d16/d46/d47/d60/f75 0 2024-04-16T14:35:37.527 INFO:tasks.workunit.client.0.smithi005.stdout:3/622: dwrite d2/d9/d5e/fb6 [0,4194304] 0 2024-04-16T14:35:37.527 INFO:tasks.workunit.client.0.smithi005.stdout:9/416: mknod d3/d49/d4b/c76 0 2024-04-16T14:35:37.528 INFO:tasks.workunit.client.1.smithi115.stdout:3/402: dwrite dc/d24/d33/f68 [0,4194304] 0 2024-04-16T14:35:37.528 INFO:tasks.workunit.client.1.smithi115.stdout:3/403: creat dc/d29/d39/d86/f8b x:0 0 0 2024-04-16T14:35:37.528 INFO:tasks.workunit.client.1.smithi115.stdout:0/277: dread d6/f33 [0,4194304] 0 2024-04-16T14:35:37.528 INFO:tasks.workunit.client.1.smithi115.stdout:0/278: creat d6/d10/d12/d31/d35/d28/f66 x:0 0 0 2024-04-16T14:35:37.529 INFO:tasks.workunit.client.0.smithi005.stdout:7/684: dwrite d1/d49/d74/d77/d22/da0/fa7 [0,4194304] 0 2024-04-16T14:35:37.529 INFO:tasks.workunit.client.1.smithi115.stdout:4/382: dwrite d1/d15/d24/f40 [0,4194304] 0 2024-04-16T14:35:37.530 INFO:tasks.workunit.client.1.smithi115.stdout:9/433: rename d1/d6/d2d/d3d/d50/d79 to d1/d6/d2d/d4b/d8f 0 2024-04-16T14:35:37.530 INFO:tasks.workunit.client.1.smithi115.stdout:9/434: write d1/d6/d29/f8e [856800,2402] 0 2024-04-16T14:35:37.531 INFO:tasks.workunit.client.1.smithi115.stdout:1/326: dwrite f3 [0,4194304] 0 2024-04-16T14:35:37.532 INFO:tasks.workunit.client.1.smithi115.stdout:6/417: getdents d13/d1a/d55 0 2024-04-16T14:35:37.532 INFO:tasks.workunit.client.1.smithi115.stdout:6/418: creat d13/d1d/d49/f8b x:0 0 0 2024-04-16T14:35:37.532 INFO:tasks.workunit.client.0.smithi005.stdout:3/623: creat d2/d9/d25/d39/fcd x:0 0 0 2024-04-16T14:35:37.532 INFO:tasks.workunit.client.0.smithi005.stdout:3/624: chown d2/d17/d46/c5f 1 1 2024-04-16T14:35:37.533 INFO:tasks.workunit.client.1.smithi115.stdout:8/393: rmdir d0/db 39 2024-04-16T14:35:37.533 INFO:tasks.workunit.client.0.smithi005.stdout:8/595: read d5/d7b/da8/db7/fb2 [2268770,68321] 0 2024-04-16T14:35:37.534 INFO:tasks.workunit.client.0.smithi005.stdout:8/596: write d5/d7b/da8/db7/d8a/da1/d3d/fd2 [920581,88693] 0 2024-04-16T14:35:37.534 INFO:tasks.workunit.client.0.smithi005.stdout:8/597: creat d5/d7b/da8/db7/d74/fd6 x:0 0 0 2024-04-16T14:35:37.534 INFO:tasks.workunit.client.0.smithi005.stdout:9/417: mkdir d3/d77 0 2024-04-16T14:35:37.535 INFO:tasks.workunit.client.0.smithi005.stdout:1/772: dread d2/d1c/d15/d2a/d19/d20/d27/f34 [0,4194304] 0 2024-04-16T14:35:37.536 INFO:tasks.workunit.client.0.smithi005.stdout:1/773: readlink d2/lf2 0 2024-04-16T14:35:37.536 INFO:tasks.workunit.client.0.smithi005.stdout:5/640: getdents d0/d6/d12/d1c/d81 0 2024-04-16T14:35:37.536 INFO:tasks.workunit.client.1.smithi115.stdout:3/404: chown dc/d24/d33/f6a 24741 1 2024-04-16T14:35:37.536 INFO:tasks.workunit.client.1.smithi115.stdout:3/405: write dc/d24/d36/d60/f7a [905562,80835] 0 2024-04-16T14:35:37.536 INFO:tasks.workunit.client.1.smithi115.stdout:3/406: stat dc/d29 0 2024-04-16T14:35:37.536 INFO:tasks.workunit.client.1.smithi115.stdout:3/407: chown dc/f21 72520222 1 2024-04-16T14:35:37.541 INFO:tasks.workunit.client.0.smithi005.stdout:3/625: truncate d2/d17/d46/d75/d9b/fb8 1725303 0 2024-04-16T14:35:37.541 INFO:tasks.workunit.client.1.smithi115.stdout:0/279: mknod d6/d10/d12/d5f/c67 0 2024-04-16T14:35:37.541 INFO:tasks.workunit.client.1.smithi115.stdout:6/419: dread d13/d1a/f77 [0,4194304] 0 2024-04-16T14:35:37.542 INFO:tasks.workunit.client.1.smithi115.stdout:4/383: truncate d1/d15/d1e/f35 1460204 0 2024-04-16T14:35:37.542 INFO:tasks.workunit.client.1.smithi115.stdout:4/384: readlink d1/d15/d1e/l27 0 2024-04-16T14:35:37.543 INFO:tasks.workunit.client.1.smithi115.stdout:9/435: mkdir d1/d6/d2d/d4b/d90 0 2024-04-16T14:35:37.544 INFO:tasks.workunit.client.0.smithi005.stdout:8/598: rename d5/d55/fb5 to d5/d11/d6c/fd7 0 2024-04-16T14:35:37.545 INFO:tasks.workunit.client.1.smithi115.stdout:1/327: unlink df/d13/d4d/d3e/f53 0 2024-04-16T14:35:37.546 INFO:tasks.workunit.client.0.smithi005.stdout:9/418: unlink d3/d12/d2b/l58 0 2024-04-16T14:35:37.547 INFO:tasks.workunit.client.0.smithi005.stdout:1/774: unlink d2/d1c/d15/d2a/d19/dc9/cfa 0 2024-04-16T14:35:37.547 INFO:tasks.workunit.client.1.smithi115.stdout:8/394: link d0/db/d10/d25/f67 d0/db/d10/d17/d2c/d61/d6b/f79 0 2024-04-16T14:35:37.548 INFO:tasks.workunit.client.0.smithi005.stdout:3/626: mkdir d2/d9/df/daa/dc4/dce 0 2024-04-16T14:35:37.549 INFO:tasks.workunit.client.1.smithi115.stdout:3/408: rename dc/d29/d4d/d56/d7e/d84 to dc/d24/d36/d8c 0 2024-04-16T14:35:37.549 INFO:tasks.workunit.client.1.smithi115.stdout:3/409: chown dc/c1f 1564812703 1 2024-04-16T14:35:37.550 INFO:tasks.workunit.client.1.smithi115.stdout:0/280: mknod d6/d1b/d4e/c68 0 2024-04-16T14:35:37.551 INFO:tasks.workunit.client.0.smithi005.stdout:3/627: dread d2/d17/d46/d75/f42 [0,4194304] 0 2024-04-16T14:35:37.551 INFO:tasks.workunit.client.0.smithi005.stdout:3/628: write d2/d17/d46/d75/d41/f65 [4732139,95699] 0 2024-04-16T14:35:37.551 INFO:tasks.workunit.client.0.smithi005.stdout:5/641: rename d0/d6/d98 to d0/d6/d12/dc0/d8d/dd8 0 2024-04-16T14:35:37.551 INFO:tasks.workunit.client.0.smithi005.stdout:5/642: dread - d0/d6/d12/dc0/d8d/f62 zero size 2024-04-16T14:35:37.552 INFO:tasks.workunit.client.0.smithi005.stdout:5/643: readlink d0/d6/d12/d1c/l44 0 2024-04-16T14:35:37.552 INFO:tasks.workunit.client.1.smithi115.stdout:6/420: mkdir d13/d1d/d52/d8c 0 2024-04-16T14:35:37.552 INFO:tasks.workunit.client.1.smithi115.stdout:6/421: chown d13/d1d/d2b/d5b/l85 0 1 2024-04-16T14:35:37.553 INFO:tasks.workunit.client.1.smithi115.stdout:4/385: truncate d1/f4 3019965 0 2024-04-16T14:35:37.553 INFO:tasks.workunit.client.1.smithi115.stdout:1/328: rmdir df/d13/d4d/d2c/d54/d55 39 2024-04-16T14:35:37.553 INFO:tasks.workunit.client.1.smithi115.stdout:1/329: write df/d13/d4d/d2c/f3b [107182,38673] 0 2024-04-16T14:35:37.554 INFO:tasks.workunit.client.0.smithi005.stdout:9/419: creat d3/d49/d4b/d55/f78 x:0 0 0 2024-04-16T14:35:37.554 INFO:tasks.workunit.client.0.smithi005.stdout:8/599: dread d5/fb [0,4194304] 0 2024-04-16T14:35:37.554 INFO:tasks.workunit.client.1.smithi115.stdout:8/395: symlink d0/db/d10/d17/d2c/l7a 0 2024-04-16T14:35:37.555 INFO:tasks.workunit.client.0.smithi005.stdout:1/775: getdents d2/d1c/d15/d2a/d1a 0 2024-04-16T14:35:37.555 INFO:tasks.workunit.client.1.smithi115.stdout:1/330: dread df/d35/d48/f4c [0,4194304] 0 2024-04-16T14:35:37.557 INFO:tasks.workunit.client.1.smithi115.stdout:3/410: rename dc/c32 to dc/d29/d77/c8d 0 2024-04-16T14:35:37.558 INFO:tasks.workunit.client.0.smithi005.stdout:5/644: symlink d0/d6/d12/dc0/ld9 0 2024-04-16T14:35:37.558 INFO:tasks.workunit.client.0.smithi005.stdout:5/645: fdatasync d0/d6/d12/f45 0 2024-04-16T14:35:37.559 INFO:tasks.workunit.client.1.smithi115.stdout:0/281: creat d6/d10/d12/d1f/d36/d4b/f69 x:0 0 0 2024-04-16T14:35:37.560 INFO:tasks.workunit.client.0.smithi005.stdout:8/600: creat d5/d7b/da8/db7/d8a/da1/d3d/dba/dcd/fd8 x:0 0 0 2024-04-16T14:35:37.562 INFO:tasks.workunit.client.0.smithi005.stdout:1/776: mknod d2/d1c/d15/da0/c110 0 2024-04-16T14:35:37.562 INFO:tasks.workunit.client.0.smithi005.stdout:1/777: readlink d2/d1c/d15/d6f/l106 0 2024-04-16T14:35:37.563 INFO:tasks.workunit.client.1.smithi115.stdout:6/422: unlink d13/d1d/d2b/d46/f7a 0 2024-04-16T14:35:37.563 INFO:tasks.workunit.client.0.smithi005.stdout:8/601: rmdir d5/d7b/da8/db7/d8a/da1/d3d/dba 39 2024-04-16T14:35:37.563 INFO:tasks.workunit.client.0.smithi005.stdout:8/602: read - d5/d7b/da8/db7/d8a/da1/d3d/d7f/fbe zero size 2024-04-16T14:35:37.567 INFO:tasks.workunit.client.1.smithi115.stdout:4/386: creat d1/d15/f64 x:0 0 0 2024-04-16T14:35:37.568 INFO:tasks.workunit.client.0.smithi005.stdout:1/778: truncate d2/d1c/d15/d2a/d1a/d21/f89 1148324 0 2024-04-16T14:35:37.568 INFO:tasks.workunit.client.0.smithi005.stdout:1/779: chown d2/d74/dd7/f68 110 1 2024-04-16T14:35:37.570 INFO:tasks.workunit.client.1.smithi115.stdout:1/331: write f0 [1443185,128982] 0 2024-04-16T14:35:37.573 INFO:tasks.workunit.client.0.smithi005.stdout:8/603: mkdir d5/d7b/da8/db7/d8a/da1/d68/dcb/dd9 0 2024-04-16T14:35:37.574 INFO:tasks.workunit.client.1.smithi115.stdout:3/411: symlink dc/d29/d4d/d56/d7e/l8e 0 2024-04-16T14:35:37.574 INFO:tasks.workunit.client.1.smithi115.stdout:9/436: rename d1/d6/d2d/d4b/d6c/d20/d2a to d1/d6/d2d/d4b/d8f/d91 0 2024-04-16T14:35:37.574 INFO:tasks.workunit.client.1.smithi115.stdout:9/437: read - d1/d6/d29/f57 zero size 2024-04-16T14:35:37.574 INFO:tasks.workunit.client.1.smithi115.stdout:3/412: mknod dc/d29/d4d/d56/d7e/c8f 0 2024-04-16T14:35:37.575 INFO:tasks.workunit.client.0.smithi005.stdout:8/604: mknod d5/d7b/da8/db7/d8a/da1/d3d/d7f/d8d/dd1/cda 0 2024-04-16T14:35:37.576 INFO:tasks.workunit.client.1.smithi115.stdout:9/438: write d1/d6/d29/f32 [730923,61684] 0 2024-04-16T14:35:37.576 INFO:tasks.workunit.client.1.smithi115.stdout:9/439: chown d1/d6/d2d/d4b/c4d 97905215 1 2024-04-16T14:35:37.576 INFO:tasks.workunit.client.1.smithi115.stdout:9/440: chown d1/d6/d2d/d4b/d6c/l70 1 1 2024-04-16T14:35:37.576 INFO:tasks.workunit.client.1.smithi115.stdout:9/441: write d1/d6/d2d/d4b/d6c/d20/d36/f52 [1125277,103106] 0 2024-04-16T14:35:37.578 INFO:tasks.workunit.client.1.smithi115.stdout:0/282: rename d6/d10/d12/d1f/f32 to d6/d10/d12/d1f/d36/d4b/f6a 0 2024-04-16T14:35:37.578 INFO:tasks.workunit.client.0.smithi005.stdout:2/398: sync 2024-04-16T14:35:37.579 INFO:tasks.workunit.client.0.smithi005.stdout:8/605: link d5/d7b/da8/db7/d8a/da1/d3d/dba/dcd/fd8 d5/d9b/fdb 0 2024-04-16T14:35:37.580 INFO:tasks.workunit.client.1.smithi115.stdout:5/338: sync 2024-04-16T14:35:37.580 INFO:tasks.workunit.client.1.smithi115.stdout:5/339: fdatasync dc/d15/f53 0 2024-04-16T14:35:37.580 INFO:tasks.workunit.client.1.smithi115.stdout:5/340: stat dc/d15/c62 0 2024-04-16T14:35:37.581 INFO:tasks.workunit.client.0.smithi005.stdout:2/399: mkdir d0/d1c/d59/d7a/d84 0 2024-04-16T14:35:37.583 INFO:tasks.workunit.client.1.smithi115.stdout:0/283: rmdir d6/d10/d12/d5f/d64 0 2024-04-16T14:35:37.586 INFO:tasks.workunit.client.1.smithi115.stdout:5/341: link dc/d15/f3e dc/d15/d35/d69/f72 0 2024-04-16T14:35:37.586 INFO:tasks.workunit.client.1.smithi115.stdout:5/342: fdatasync dc/f34 0 2024-04-16T14:35:37.588 INFO:tasks.workunit.client.1.smithi115.stdout:1/332: write df/d13/d4d/f4f [838406,126609] 0 2024-04-16T14:35:37.588 INFO:tasks.workunit.client.1.smithi115.stdout:1/333: write f0 [1646781,70459] 0 2024-04-16T14:35:37.588 INFO:tasks.workunit.client.1.smithi115.stdout:1/334: read - df/d13/d4d/d2c/f4a zero size 2024-04-16T14:35:37.591 INFO:tasks.workunit.client.0.smithi005.stdout:8/606: dread d5/d7b/f4e [0,4194304] 0 2024-04-16T14:35:37.593 INFO:tasks.workunit.client.0.smithi005.stdout:8/607: link d5/d7b/c3e d5/d55/cdc 0 2024-04-16T14:35:37.616 INFO:tasks.workunit.client.1.smithi115.stdout:0/284: dread d6/d10/d12/d1f/d36/d4b/f5c [0,4194304] 0 2024-04-16T14:35:37.627 INFO:tasks.workunit.client.0.smithi005.stdout:3/629: dwrite d2/d9/d25/d39/d9c/f85 [0,4194304] 0 2024-04-16T14:35:37.628 INFO:tasks.workunit.client.0.smithi005.stdout:5/646: dwrite d0/d6/d12/dc0/d8d/f62 [0,4194304] 0 2024-04-16T14:35:37.628 INFO:tasks.workunit.client.0.smithi005.stdout:2/400: dwrite d0/d1c/d39/d48/f7b [0,4194304] 0 2024-04-16T14:35:37.628 INFO:tasks.workunit.client.0.smithi005.stdout:2/401: write d0/d4/d2b/f11 [3456629,87997] 0 2024-04-16T14:35:37.629 INFO:tasks.workunit.client.1.smithi115.stdout:2/421: sync 2024-04-16T14:35:37.629 INFO:tasks.workunit.client.1.smithi115.stdout:2/422: write d0/d4/d24/f19 [761358,80409] 0 2024-04-16T14:35:37.630 INFO:tasks.workunit.client.1.smithi115.stdout:6/423: dwrite d13/d1d/d2b/d5f/f4b [0,4194304] 0 2024-04-16T14:35:37.631 INFO:tasks.workunit.client.0.smithi005.stdout:9/420: dwrite d3/d49/f50 [0,4194304] 0 2024-04-16T14:35:37.631 INFO:tasks.workunit.client.0.smithi005.stdout:9/421: truncate d3/d12/d2b/f59 1030524 0 2024-04-16T14:35:37.632 INFO:tasks.workunit.client.1.smithi115.stdout:3/413: dwrite dc/d24/d33/d4b/f73 [0,4194304] 0 2024-04-16T14:35:37.632 INFO:tasks.workunit.client.1.smithi115.stdout:3/414: stat dc/d24/d33/d4b/d81 0 2024-04-16T14:35:37.632 INFO:tasks.workunit.client.1.smithi115.stdout:1/335: dwrite df/d13/d4d/f34 [0,4194304] 0 2024-04-16T14:35:37.632 INFO:tasks.workunit.client.1.smithi115.stdout:1/336: creat df/d36/d3c/f6c x:0 0 0 2024-04-16T14:35:37.633 INFO:tasks.workunit.client.0.smithi005.stdout:5/647: mkdir d0/d6/d12/d1c/d81/d82/dda 0 2024-04-16T14:35:37.634 INFO:tasks.workunit.client.0.smithi005.stdout:8/608: dwrite d5/d11/f20 [0,4194304] 0 2024-04-16T14:35:37.634 INFO:tasks.workunit.client.0.smithi005.stdout:8/609: truncate d5/d7b/da8/db7/f5d 895840 0 2024-04-16T14:35:37.634 INFO:tasks.workunit.client.0.smithi005.stdout:8/610: chown d5/d40/c6a 5 1 2024-04-16T14:35:37.634 INFO:tasks.workunit.client.0.smithi005.stdout:1/780: dwrite d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/dc5/dbc/dcf/fe3 [0,4194304] 0 2024-04-16T14:35:37.635 INFO:tasks.workunit.client.1.smithi115.stdout:8/396: dwrite d0/db/f12 [0,4194304] 0 2024-04-16T14:35:37.635 INFO:tasks.workunit.client.1.smithi115.stdout:8/397: write d0/db/d10/d17/d2c/d52/d74/f35 [1923248,6044] 0 2024-04-16T14:35:37.641 INFO:tasks.workunit.client.0.smithi005.stdout:9/422: creat d3/d49/d4b/d5c/d65/f79 x:0 0 0 2024-04-16T14:35:37.642 INFO:tasks.workunit.client.1.smithi115.stdout:1/337: dread df/f10 [4194304,4194304] 0 2024-04-16T14:35:37.642 INFO:tasks.workunit.client.1.smithi115.stdout:1/338: truncate df/d36/d3c/f56 345496 0 2024-04-16T14:35:37.642 INFO:tasks.workunit.client.0.smithi005.stdout:5/648: mkdir d0/d6/d6e/d9e/ddb 0 2024-04-16T14:35:37.651 INFO:tasks.workunit.client.0.smithi005.stdout:8/611: unlink d5/d7b/lae 0 2024-04-16T14:35:37.651 INFO:tasks.workunit.client.0.smithi005.stdout:3/630: dwrite d2/d9/d25/d39/f3b [0,4194304] 0 2024-04-16T14:35:37.651 INFO:tasks.workunit.client.0.smithi005.stdout:3/631: write d2/d9/d25/f91 [346137,32349] 0 2024-04-16T14:35:37.651 INFO:tasks.workunit.client.0.smithi005.stdout:3/632: creat d2/d17/d46/d75/fcf x:0 0 0 2024-04-16T14:35:37.655 INFO:tasks.workunit.client.0.smithi005.stdout:1/781: link d2/d1c/d15/d2a/ff6 d2/d1c/d15/d2a/d19/dc9/de0/f111 0 2024-04-16T14:35:37.656 INFO:tasks.workunit.client.0.smithi005.stdout:9/423: dread d3/f25 [0,4194304] 0 2024-04-16T14:35:37.656 INFO:tasks.workunit.client.0.smithi005.stdout:9/424: write d3/d12/d2b/f4e [255901,98819] 0 2024-04-16T14:35:37.657 INFO:tasks.workunit.client.0.smithi005.stdout:5/649: getdents d0/d6/d12/dc0 0 2024-04-16T14:35:37.657 INFO:tasks.workunit.client.0.smithi005.stdout:9/425: dread d3/d12/d2b/f59 [0,4194304] 0 2024-04-16T14:35:37.659 INFO:tasks.workunit.client.0.smithi005.stdout:8/612: symlink d5/d55/d5a/ldd 0 2024-04-16T14:35:37.659 INFO:tasks.workunit.client.1.smithi115.stdout:5/343: mknod dc/d15/c73 0 2024-04-16T14:35:37.660 INFO:tasks.workunit.client.1.smithi115.stdout:5/344: dread - dc/d3d/f6a zero size 2024-04-16T14:35:37.661 INFO:tasks.workunit.client.1.smithi115.stdout:0/285: link d6/f25 d6/d54/f6b 0 2024-04-16T14:35:37.663 INFO:tasks.workunit.client.0.smithi005.stdout:3/633: truncate d2/d17/f76 1915689 0 2024-04-16T14:35:37.663 INFO:tasks.workunit.client.0.smithi005.stdout:3/634: readlink d2/d9/d5e/l61 0 2024-04-16T14:35:37.665 INFO:tasks.workunit.client.0.smithi005.stdout:1/782: symlink d2/d1c/d15/d2a/d19/dc9/de0/df8/l112 0 2024-04-16T14:35:37.667 INFO:tasks.workunit.client.0.smithi005.stdout:2/402: truncate d0/d4/d2b/f11 3303604 0 2024-04-16T14:35:37.667 INFO:tasks.workunit.client.0.smithi005.stdout:2/403: write d0/d4/f6 [3231083,30661] 0 2024-04-16T14:35:37.668 INFO:tasks.workunit.client.0.smithi005.stdout:5/650: creat d0/fdc x:0 0 0 2024-04-16T14:35:37.671 INFO:tasks.workunit.client.0.smithi005.stdout:9/426: truncate d3/d12/d16/f1d 3557160 0 2024-04-16T14:35:37.671 INFO:tasks.workunit.client.1.smithi115.stdout:6/424: rmdir d13/d1d/d2b/d5f/d30/d43 39 2024-04-16T14:35:37.674 INFO:tasks.workunit.client.0.smithi005.stdout:2/404: unlink d0/l43 0 2024-04-16T14:35:37.679 INFO:tasks.workunit.client.0.smithi005.stdout:8/613: dwrite d5/d55/f5e [0,4194304] 0 2024-04-16T14:35:37.682 INFO:tasks.workunit.client.0.smithi005.stdout:3/635: mkdir d2/d17/d46/d75/d6d/dd0 0 2024-04-16T14:35:37.682 INFO:tasks.workunit.client.0.smithi005.stdout:3/636: fsync d2/d17/d46/d75/d9b/fbc 0 2024-04-16T14:35:37.682 INFO:tasks.workunit.client.0.smithi005.stdout:3/637: write d2/f21 [1601760,100382] 0 2024-04-16T14:35:37.682 INFO:tasks.workunit.client.0.smithi005.stdout:5/651: read d0/d6/f54 [8353203,90474] 0 2024-04-16T14:35:37.683 INFO:tasks.workunit.client.0.smithi005.stdout:1/783: dwrite d2/d1c/d15/d2a/d19/d42/d64/d76/faf [0,4194304] 0 2024-04-16T14:35:37.683 INFO:tasks.workunit.client.0.smithi005.stdout:1/784: fsync d2/d1c/d15/d2a/d19/d20/fec 0 2024-04-16T14:35:37.685 INFO:tasks.workunit.client.0.smithi005.stdout:2/405: mkdir d0/d1c/d39/d85 0 2024-04-16T14:35:37.686 INFO:tasks.workunit.client.0.smithi005.stdout:2/406: read - d0/d2a/d3a/d46/f56 zero size 2024-04-16T14:35:37.686 INFO:tasks.workunit.client.0.smithi005.stdout:9/427: getdents d3/d49/d4b/d5c/d65 0 2024-04-16T14:35:37.689 INFO:tasks.workunit.client.0.smithi005.stdout:8/614: truncate d5/fb 7323339 0 2024-04-16T14:35:37.689 INFO:tasks.workunit.client.0.smithi005.stdout:8/615: readlink d5/l64 0 2024-04-16T14:35:37.693 INFO:tasks.workunit.client.0.smithi005.stdout:3/638: creat d2/d17/fd1 x:0 0 0 2024-04-16T14:35:37.696 INFO:tasks.workunit.client.0.smithi005.stdout:5/652: link d0/d6/fab d0/d6/d6e/db8/fdd 0 2024-04-16T14:35:37.696 INFO:tasks.workunit.client.0.smithi005.stdout:5/653: write d0/d6/f31 [282505,13237] 0 2024-04-16T14:35:37.696 INFO:tasks.workunit.client.1.smithi115.stdout:3/415: symlink dc/d29/d4d/d56/d7e/l90 0 2024-04-16T14:35:37.696 INFO:tasks.workunit.client.1.smithi115.stdout:6/425: dwrite d13/d1a/f23 [0,4194304] 0 2024-04-16T14:35:37.697 INFO:tasks.workunit.client.1.smithi115.stdout:6/426: write d13/d1a/f29 [1404043,20445] 0 2024-04-16T14:35:37.700 INFO:tasks.workunit.client.0.smithi005.stdout:8/616: read d5/d11/f4a [8845641,91799] 0 2024-04-16T14:35:37.703 INFO:tasks.workunit.client.0.smithi005.stdout:1/785: link d2/d74/fe4 d2/d74/d7a/f113 0 2024-04-16T14:35:37.703 INFO:tasks.workunit.client.1.smithi115.stdout:3/416: dread dc/d24/f49 [0,4194304] 0 2024-04-16T14:35:37.710 INFO:tasks.workunit.client.0.smithi005.stdout:2/407: mknod d0/d4/d2b/c86 0 2024-04-16T14:35:37.712 INFO:tasks.workunit.client.1.smithi115.stdout:6/427: dwrite d13/d1d/d49/f8b [0,4194304] 0 2024-04-16T14:35:37.712 INFO:tasks.workunit.client.1.smithi115.stdout:6/428: readlink d13/d1d/d2b/d5f/d30/d43/d2c/l3d 0 2024-04-16T14:35:37.713 INFO:tasks.workunit.client.0.smithi005.stdout:9/428: mknod d3/d49/d4b/d5c/d65/c7a 0 2024-04-16T14:35:37.713 INFO:tasks.workunit.client.0.smithi005.stdout:8/617: read d5/d7b/da8/db7/d8a/da1/d68/f75 [2309281,78707] 0 2024-04-16T14:35:37.720 INFO:tasks.workunit.client.0.smithi005.stdout:5/654: link d0/d6/d12/dc0/d42/ca6 d0/d70/cde 0 2024-04-16T14:35:37.720 INFO:tasks.workunit.client.1.smithi115.stdout:8/398: link d0/db/d10/d17/d2c/d52/d74/d3b/f77 d0/db/d10/d17/f7b 0 2024-04-16T14:35:37.720 INFO:tasks.workunit.client.1.smithi115.stdout:3/417: dwrite dc/d29/f7b [0,4194304] 0 2024-04-16T14:35:37.720 INFO:tasks.workunit.client.1.smithi115.stdout:3/418: dread - dc/d24/f70 zero size 2024-04-16T14:35:37.721 INFO:tasks.workunit.client.1.smithi115.stdout:3/419: stat dc/d24/d33/d4b/d65/c87 0 2024-04-16T14:35:37.721 INFO:tasks.workunit.client.1.smithi115.stdout:1/339: mkdir df/d13/d4d/d6d 0 2024-04-16T14:35:37.723 INFO:tasks.workunit.client.0.smithi005.stdout:1/786: creat d2/d1c/d15/d2a/d19/dc9/de0/f114 x:0 0 0 2024-04-16T14:35:37.723 INFO:tasks.workunit.client.0.smithi005.stdout:1/787: fdatasync d2/d1c/d15/d2a/d25/f36 0 2024-04-16T14:35:37.725 INFO:tasks.workunit.client.0.smithi005.stdout:2/408: mknod d0/d4/d2b/d6b/c87 0 2024-04-16T14:35:37.725 INFO:tasks.workunit.client.0.smithi005.stdout:2/409: chown d0/d29/f4c 148535175 1 2024-04-16T14:35:37.727 INFO:tasks.workunit.client.0.smithi005.stdout:9/429: truncate d3/d12/f3e 716708 0 2024-04-16T14:35:37.729 INFO:tasks.workunit.client.1.smithi115.stdout:5/345: link dc/d3d/d41/c5c dc/d15/d2d/c74 0 2024-04-16T14:35:37.730 INFO:tasks.workunit.client.0.smithi005.stdout:8/618: symlink d5/d55/d5a/lde 0 2024-04-16T14:35:37.730 INFO:tasks.workunit.client.0.smithi005.stdout:8/619: chown d5/d11/d6c/f7e 85 1 2024-04-16T14:35:37.730 INFO:tasks.workunit.client.0.smithi005.stdout:8/620: write d5/d9b/fc7 [618103,120437] 0 2024-04-16T14:35:37.732 INFO:tasks.workunit.client.0.smithi005.stdout:3/639: getdents d2/d17/d46/d75/d9b 0 2024-04-16T14:35:37.732 INFO:tasks.workunit.client.0.smithi005.stdout:3/640: truncate d2/d17/d46/d75/f8f 56315 0 2024-04-16T14:35:37.732 INFO:tasks.workunit.client.0.smithi005.stdout:3/641: chown d2/d17/d46/d75/fcf 54 1 2024-04-16T14:35:37.732 INFO:tasks.workunit.client.0.smithi005.stdout:3/642: write d2/f21 [3681730,49817] 0 2024-04-16T14:35:37.733 INFO:tasks.workunit.client.1.smithi115.stdout:2/423: truncate d0/d4/ff 1538432 0 2024-04-16T14:35:37.733 INFO:tasks.workunit.client.1.smithi115.stdout:2/424: fdatasync d0/d4/d24/d23/f7c 0 2024-04-16T14:35:37.736 INFO:tasks.workunit.client.0.smithi005.stdout:5/655: unlink d0/d6/d6e/lac 0 2024-04-16T14:35:37.736 INFO:tasks.workunit.client.0.smithi005.stdout:5/656: chown d0/d6/d12/dc0/d8d/f62 2 1 2024-04-16T14:35:37.736 INFO:tasks.workunit.client.0.smithi005.stdout:5/657: creat d0/d6/d6e/d9e/fdf x:0 0 0 2024-04-16T14:35:37.736 INFO:tasks.workunit.client.0.smithi005.stdout:5/658: write d0/d70/db3/fc1 [286155,41715] 0 2024-04-16T14:35:37.737 INFO:tasks.workunit.client.0.smithi005.stdout:1/788: rename d2/d1c/d15/d2a/d19/d20/d27/c47 to d2/d74/c115 0 2024-04-16T14:35:37.739 INFO:tasks.workunit.client.0.smithi005.stdout:2/410: fsync d0/d29/d3e/f4f 0 2024-04-16T14:35:37.740 INFO:tasks.workunit.client.1.smithi115.stdout:6/429: unlink d13/d1a/d55/l75 0 2024-04-16T14:35:37.741 INFO:tasks.workunit.client.0.smithi005.stdout:8/621: dread d5/d11/f20 [0,4194304] 0 2024-04-16T14:35:37.742 INFO:tasks.workunit.client.0.smithi005.stdout:9/430: mkdir d3/d49/d4b/d55/d7b 0 2024-04-16T14:35:37.743 INFO:tasks.workunit.client.1.smithi115.stdout:1/340: dwrite df/d36/f6a [0,4194304] 0 2024-04-16T14:35:37.745 INFO:tasks.workunit.client.1.smithi115.stdout:2/425: dread d0/d4/de/d11/f12 [4194304,4194304] 0 2024-04-16T14:35:37.746 INFO:tasks.workunit.client.0.smithi005.stdout:5/659: rename d0/d6/d12/dc0/d42/ca6 to d0/d6/ce0 0 2024-04-16T14:35:37.746 INFO:tasks.workunit.client.0.smithi005.stdout:5/660: write d0/d6/d12/d1c/d81/fc9 [663643,80433] 0 2024-04-16T14:35:37.746 INFO:tasks.workunit.client.0.smithi005.stdout:1/789: dread d2/d1c/f3d [0,4194304] 0 2024-04-16T14:35:37.746 INFO:tasks.workunit.client.0.smithi005.stdout:1/790: dread - d2/d1c/d15/d2a/d19/d20/d27/ff0 zero size 2024-04-16T14:35:37.747 INFO:tasks.workunit.client.0.smithi005.stdout:1/791: stat d2/d1c/d15/d2a/db6/lfb 0 2024-04-16T14:35:37.749 INFO:tasks.workunit.client.0.smithi005.stdout:2/411: truncate d0/d2a/d3a/d46/f4b 1976811 0 2024-04-16T14:35:37.749 INFO:tasks.workunit.client.0.smithi005.stdout:6/838: sync 2024-04-16T14:35:37.749 INFO:tasks.workunit.client.0.smithi005.stdout:6/839: creat d2/d20/df9/f11d x:0 0 0 2024-04-16T14:35:37.750 INFO:tasks.workunit.client.0.smithi005.stdout:1/792: rename d2/fdc to d2/d74/d7a/d100/f116 0 2024-04-16T14:35:37.750 INFO:tasks.workunit.client.0.smithi005.stdout:1/793: chown d2/d74/d7a/d100/l10d 67022 1 2024-04-16T14:35:37.750 INFO:tasks.workunit.client.0.smithi005.stdout:1/794: chown d2/d1c/d15/d2a/d25/f48 886 1 2024-04-16T14:35:37.752 INFO:tasks.workunit.client.0.smithi005.stdout:6/840: rmdir d2/d5/d10/d68 39 2024-04-16T14:35:37.752 INFO:tasks.workunit.client.0.smithi005.stdout:6/841: fdatasync d2/d5/d10/dd6/fa6 0 2024-04-16T14:35:37.753 INFO:tasks.workunit.client.0.smithi005.stdout:1/795: dread d2/fee [0,4194304] 0 2024-04-16T14:35:37.755 INFO:tasks.workunit.client.1.smithi115.stdout:3/420: link dc/d29/d4d/c6e dc/d24/d36/d60/c91 0 2024-04-16T14:35:37.755 INFO:tasks.workunit.client.0.smithi005.stdout:2/412: rename d0/d1c/d39/c65 to d0/d1c/d59/d7a/d84/c88 0 2024-04-16T14:35:37.757 INFO:tasks.workunit.client.0.smithi005.stdout:9/431: read d3/d12/d16/f19 [3015907,66540] 0 2024-04-16T14:35:37.757 INFO:tasks.workunit.client.0.smithi005.stdout:5/661: read d0/d6/d12/dc0/d8d/f83 [2998518,14092] 0 2024-04-16T14:35:37.758 INFO:tasks.workunit.client.0.smithi005.stdout:5/662: write d0/d6/d12/d1c/d81/fc9 [1541607,93737] 0 2024-04-16T14:35:37.758 INFO:tasks.workunit.client.0.smithi005.stdout:5/663: chown d0/d6/d12/d1c 12051 1 2024-04-16T14:35:37.758 INFO:tasks.workunit.client.0.smithi005.stdout:1/796: link d2/d1c/d15/d2a/d19/d42/d64/f69 d2/d2c/d85/dab/d51/f117 0 2024-04-16T14:35:37.758 INFO:tasks.workunit.client.0.smithi005.stdout:1/797: truncate d2/d1c/d15/ff1 4237318 0 2024-04-16T14:35:37.759 INFO:tasks.workunit.client.1.smithi115.stdout:5/346: symlink dc/d3d/d41/l75 0 2024-04-16T14:35:37.761 INFO:tasks.workunit.client.0.smithi005.stdout:5/664: symlink d0/le1 0 2024-04-16T14:35:37.762 INFO:tasks.workunit.client.1.smithi115.stdout:0/286: getdents d6/d10/d12 0 2024-04-16T14:35:37.762 INFO:tasks.workunit.client.0.smithi005.stdout:6/842: read d2/d5/f2a [1384563,46543] 0 2024-04-16T14:35:37.763 INFO:tasks.workunit.client.1.smithi115.stdout:2/426: dwrite d0/d4/d24/d23/f2c [4194304,4194304] 0 2024-04-16T14:35:37.764 INFO:tasks.workunit.client.1.smithi115.stdout:2/427: creat d0/d4/d24/d23/f8d x:0 0 0 2024-04-16T14:35:37.764 INFO:tasks.workunit.client.1.smithi115.stdout:2/428: creat d0/d47/f8e x:0 0 0 2024-04-16T14:35:37.764 INFO:tasks.workunit.client.0.smithi005.stdout:8/622: dwrite d5/d11/f5f [0,4194304] 0 2024-04-16T14:35:37.764 INFO:tasks.workunit.client.0.smithi005.stdout:1/798: symlink d2/d1c/d15/d2a/d19/d20/d27/l118 0 2024-04-16T14:35:37.766 INFO:tasks.workunit.client.0.smithi005.stdout:6/843: creat d2/d45/d7b/db2/f11e x:0 0 0 2024-04-16T14:35:37.767 INFO:tasks.workunit.client.1.smithi115.stdout:6/430: link d13/d1d/d2b/d46/f6b d13/d1d/d49/f8d 0 2024-04-16T14:35:37.769 INFO:tasks.workunit.client.1.smithi115.stdout:8/399: mkdir d0/db/d10/d25/d7c 0 2024-04-16T14:35:37.770 INFO:tasks.workunit.client.0.smithi005.stdout:1/799: creat d2/d1c/d15/d2a/d19/d42/d71/dac/f119 x:0 0 0 2024-04-16T14:35:37.770 INFO:tasks.workunit.client.0.smithi005.stdout:9/432: write d3/d12/f30 [2916869,9154] 0 2024-04-16T14:35:37.770 INFO:tasks.workunit.client.0.smithi005.stdout:5/665: write d0/d6/d12/f14 [2811358,65500] 0 2024-04-16T14:35:37.772 INFO:tasks.workunit.client.0.smithi005.stdout:6/844: mkdir d2/d3f/d47/d84/da5/d11f 0 2024-04-16T14:35:37.774 INFO:tasks.workunit.client.1.smithi115.stdout:1/341: mknod df/d2d/c6e 0 2024-04-16T14:35:37.775 INFO:tasks.workunit.client.0.smithi005.stdout:9/433: rename d3/c54 to d3/d12/d16/d46/d47/c7c 0 2024-04-16T14:35:37.779 INFO:tasks.workunit.client.0.smithi005.stdout:8/623: dread d5/f23 [0,4194304] 0 2024-04-16T14:35:37.780 INFO:tasks.workunit.client.1.smithi115.stdout:3/421: rename dc/d24/d33/f68 to dc/d24/d33/d4b/d81/f92 0 2024-04-16T14:35:37.781 INFO:tasks.workunit.client.1.smithi115.stdout:3/422: write dc/d29/d39/d86/f8b [547288,40396] 0 2024-04-16T14:35:37.782 INFO:tasks.workunit.client.0.smithi005.stdout:8/624: rmdir d5/d7b/da8/db7/d8a/da1/d68/dd3 0 2024-04-16T14:35:37.784 INFO:tasks.workunit.client.0.smithi005.stdout:8/625: truncate d5/d7b/da8/db7/f15 3389961 0 2024-04-16T14:35:37.784 INFO:tasks.workunit.client.0.smithi005.stdout:8/626: readlink d5/l2d 0 2024-04-16T14:35:37.784 INFO:tasks.workunit.client.0.smithi005.stdout:2/413: dwrite d0/d4/d2b/f11 [0,4194304] 0 2024-04-16T14:35:37.786 INFO:tasks.workunit.client.0.smithi005.stdout:8/627: symlink d5/d9b/ldf 0 2024-04-16T14:35:37.787 INFO:tasks.workunit.client.1.smithi115.stdout:0/287: rmdir d6/d54 39 2024-04-16T14:35:37.791 INFO:tasks.workunit.client.0.smithi005.stdout:1/800: write d2/d2c/d85/dab/f35 [433535,111428] 0 2024-04-16T14:35:37.791 INFO:tasks.workunit.client.0.smithi005.stdout:8/628: rename d5/d7b/da8/fa7 to d5/d55/fe0 0 2024-04-16T14:35:37.799 INFO:tasks.workunit.client.0.smithi005.stdout:1/801: dread d2/d1c/d15/d2a/d25/f48 [0,4194304] 0 2024-04-16T14:35:37.803 INFO:tasks.workunit.client.0.smithi005.stdout:1/802: link d2/d1c/d15/d2a/d25/cd4 d2/d1c/d15/d2a/d19/d42/d64/c11a 0 2024-04-16T14:35:37.803 INFO:tasks.workunit.client.0.smithi005.stdout:1/803: readlink d2/d1c/d15/d2a/d19/lae 0 2024-04-16T14:35:37.805 INFO:tasks.workunit.client.1.smithi115.stdout:3/423: rmdir dc 39 2024-04-16T14:35:37.806 INFO:tasks.workunit.client.0.smithi005.stdout:1/804: dread d2/d2c/d85/dab/d51/fc3 [0,4194304] 0 2024-04-16T14:35:37.806 INFO:tasks.workunit.client.0.smithi005.stdout:1/805: truncate d2/d2c/f4f 3667424 0 2024-04-16T14:35:37.809 INFO:tasks.workunit.client.1.smithi115.stdout:2/429: link d0/d1b/c49 d0/d4/d22/c8f 0 2024-04-16T14:35:37.809 INFO:tasks.workunit.client.1.smithi115.stdout:2/430: dread - d0/d4/d24/d21/d59/f73 zero size 2024-04-16T14:35:37.811 INFO:tasks.workunit.client.1.smithi115.stdout:2/431: rename d0/d4/d24/d21/d59/l7a to d0/d1b/l90 0 2024-04-16T14:35:37.811 INFO:tasks.workunit.client.1.smithi115.stdout:2/432: chown d0/d4/de/d11/d36/d86 188265519 1 2024-04-16T14:35:37.811 INFO:tasks.workunit.client.1.smithi115.stdout:2/433: creat d0/d47/d65/d61/d70/f91 x:0 0 0 2024-04-16T14:35:37.813 INFO:tasks.workunit.client.1.smithi115.stdout:7/339: sync 2024-04-16T14:35:37.813 INFO:tasks.workunit.client.1.smithi115.stdout:2/434: creat d0/d47/d65/d61/f92 x:0 0 0 2024-04-16T14:35:37.813 INFO:tasks.workunit.client.1.smithi115.stdout:2/435: creat d0/d4/d24/d23/d71/f93 x:0 0 0 2024-04-16T14:35:37.814 INFO:tasks.workunit.client.1.smithi115.stdout:7/340: mknod d0/d24/d2b/d64/c78 0 2024-04-16T14:35:37.816 INFO:tasks.workunit.client.1.smithi115.stdout:2/436: readlink d0/d4/l4f 0 2024-04-16T14:35:37.817 INFO:tasks.workunit.client.1.smithi115.stdout:2/437: stat d0/d4/d24/f34 0 2024-04-16T14:35:37.818 INFO:tasks.workunit.client.0.smithi005.stdout:8/629: dwrite d5/d7b/da8/db7/d8a/da1/fc9 [0,4194304] 0 2024-04-16T14:35:37.818 INFO:tasks.workunit.client.0.smithi005.stdout:8/630: creat d5/d7b/da8/fe1 x:0 0 0 2024-04-16T14:35:37.818 INFO:tasks.workunit.client.0.smithi005.stdout:8/631: fsync d5/d40/d8e/fca 0 2024-04-16T14:35:37.819 INFO:tasks.workunit.client.1.smithi115.stdout:2/438: getdents d0/d4/d24/d21 0 2024-04-16T14:35:37.819 INFO:tasks.workunit.client.0.smithi005.stdout:5/666: dwrite d0/d6/d12/fcf [0,4194304] 0 2024-04-16T14:35:37.821 INFO:tasks.workunit.client.0.smithi005.stdout:8/632: rmdir d5/d11 39 2024-04-16T14:35:37.822 INFO:tasks.workunit.client.0.smithi005.stdout:5/667: creat d0/d6/d6e/d9e/da9/fe2 x:0 0 0 2024-04-16T14:35:37.826 INFO:tasks.workunit.client.1.smithi115.stdout:3/424: dread dc/d29/f2e [4194304,4194304] 0 2024-04-16T14:35:37.826 INFO:tasks.workunit.client.1.smithi115.stdout:5/347: rmdir dc/d3d/d41 39 2024-04-16T14:35:37.829 INFO:tasks.workunit.client.1.smithi115.stdout:5/348: rename dc/d15/f31 to dc/d15/d4d/f76 0 2024-04-16T14:35:37.830 INFO:tasks.workunit.client.1.smithi115.stdout:4/387: sync 2024-04-16T14:35:37.831 INFO:tasks.workunit.client.1.smithi115.stdout:0/288: dwrite d6/d10/d12/d31/d35/f3c [4194304,4194304] 0 2024-04-16T14:35:37.831 INFO:tasks.workunit.client.1.smithi115.stdout:0/289: fdatasync d6/d30/d4d/f4c 0 2024-04-16T14:35:37.831 INFO:tasks.workunit.client.1.smithi115.stdout:5/349: rmdir dc/d3d/d41 39 2024-04-16T14:35:37.831 INFO:tasks.workunit.client.1.smithi115.stdout:1/342: dwrite df/f1a [0,4194304] 0 2024-04-16T14:35:37.832 INFO:tasks.workunit.client.0.smithi005.stdout:2/414: dwrite d0/d4/d2b/d5e/f60 [0,4194304] 0 2024-04-16T14:35:37.832 INFO:tasks.workunit.client.1.smithi115.stdout:6/431: dwrite d13/d1d/d2b/d46/d5a/f3b [0,4194304] 0 2024-04-16T14:35:37.832 INFO:tasks.workunit.client.0.smithi005.stdout:9/434: dwrite d3/d12/f6c [0,4194304] 0 2024-04-16T14:35:37.833 INFO:tasks.workunit.client.0.smithi005.stdout:2/415: mkdir d0/d29/d89 0 2024-04-16T14:35:37.833 INFO:tasks.workunit.client.0.smithi005.stdout:2/416: write d0/d4/d2b/d6b/f80 [58523,79132] 0 2024-04-16T14:35:37.836 INFO:tasks.workunit.client.1.smithi115.stdout:0/290: unlink d6/d10/d12/d1f/c26 0 2024-04-16T14:35:37.836 INFO:tasks.workunit.client.1.smithi115.stdout:0/291: dread - d6/f65 zero size 2024-04-16T14:35:37.836 INFO:tasks.workunit.client.1.smithi115.stdout:9/442: sync 2024-04-16T14:35:37.838 INFO:tasks.workunit.client.1.smithi115.stdout:1/343: rename df/d35/d48/f69 to df/d13/d4d/d2c/d54/d55/f6f 0 2024-04-16T14:35:37.842 INFO:tasks.workunit.client.1.smithi115.stdout:0/292: creat d6/d1b/f6c x:0 0 0 2024-04-16T14:35:37.844 INFO:tasks.workunit.client.1.smithi115.stdout:9/443: creat d1/f92 x:0 0 0 2024-04-16T14:35:37.845 INFO:tasks.workunit.client.1.smithi115.stdout:4/388: write d1/d15/d31/f44 [2144251,63568] 0 2024-04-16T14:35:37.845 INFO:tasks.workunit.client.1.smithi115.stdout:4/389: creat d1/d15/d1e/f65 x:0 0 0 2024-04-16T14:35:37.845 INFO:tasks.workunit.client.1.smithi115.stdout:4/390: chown d1/d15/d31/d42/d46/f50 1761 1 2024-04-16T14:35:37.848 INFO:tasks.workunit.client.0.smithi005.stdout:1/806: dwrite d2/d1c/d15/d2a/d1a/d21/f89 [0,4194304] 0 2024-04-16T14:35:37.848 INFO:tasks.workunit.client.1.smithi115.stdout:1/344: truncate fb 7269188 0 2024-04-16T14:35:37.848 INFO:tasks.workunit.client.1.smithi115.stdout:1/345: chown df/d13/d3a/c51 49701 1 2024-04-16T14:35:37.848 INFO:tasks.workunit.client.1.smithi115.stdout:1/346: readlink df/l26 0 2024-04-16T14:35:37.851 INFO:tasks.workunit.client.1.smithi115.stdout:0/293: truncate d6/d10/f55 3413337 0 2024-04-16T14:35:37.851 INFO:tasks.workunit.client.0.smithi005.stdout:8/633: dwrite d5/d7b/da8/db7/f51 [0,4194304] 0 2024-04-16T14:35:37.851 INFO:tasks.workunit.client.0.smithi005.stdout:8/634: chown d5/d7b/da8/db7/f25 14 1 2024-04-16T14:35:37.851 INFO:tasks.workunit.client.0.smithi005.stdout:8/635: write d5/d40/f61 [1598501,70881] 0 2024-04-16T14:35:37.852 INFO:tasks.workunit.client.0.smithi005.stdout:1/807: rmdir d2/d74/d7a/d100 39 2024-04-16T14:35:37.852 INFO:tasks.workunit.client.0.smithi005.stdout:1/808: fdatasync d2/d1c/d15/d2a/d1a/d21/f30 0 2024-04-16T14:35:37.852 INFO:tasks.workunit.client.1.smithi115.stdout:7/341: dwrite d0/d24/f37 [0,4194304] 0 2024-04-16T14:35:37.855 INFO:tasks.workunit.client.1.smithi115.stdout:4/391: rename d1/d15/f3f to d1/d15/d24/f66 0 2024-04-16T14:35:37.857 INFO:tasks.workunit.client.1.smithi115.stdout:1/347: mknod df/d36/c70 0 2024-04-16T14:35:37.858 INFO:tasks.workunit.client.1.smithi115.stdout:9/444: dread d1/d6/d2d/d3d/d50/f56 [0,4194304] 0 2024-04-16T14:35:37.858 INFO:tasks.workunit.client.1.smithi115.stdout:9/445: chown d1/d6/d2d/d4b/d8f/d91/c64 0 1 2024-04-16T14:35:37.858 INFO:tasks.workunit.client.1.smithi115.stdout:9/446: write d1/d6/d29/f54 [199940,2311] 0 2024-04-16T14:35:37.860 INFO:tasks.workunit.client.0.smithi005.stdout:8/636: truncate d5/d40/fb8 2474712 0 2024-04-16T14:35:37.860 INFO:tasks.workunit.client.0.smithi005.stdout:8/637: chown d5/d11/c80 789 1 2024-04-16T14:35:37.860 INFO:tasks.workunit.client.0.smithi005.stdout:8/638: truncate d5/d7b/da8/fe1 100756 0 2024-04-16T14:35:37.860 INFO:tasks.workunit.client.0.smithi005.stdout:8/639: readlink d5/d7b/da8/db7/d8a/l8c 0 2024-04-16T14:35:37.861 INFO:tasks.workunit.client.0.smithi005.stdout:8/640: write d5/d11/f47 [592437,8085] 0 2024-04-16T14:35:37.861 INFO:tasks.workunit.client.1.smithi115.stdout:4/392: mknod d1/d15/d31/d42/d46/c67 0 2024-04-16T14:35:37.861 INFO:tasks.workunit.client.1.smithi115.stdout:4/393: dread - d1/d15/d31/f4b zero size 2024-04-16T14:35:37.861 INFO:tasks.workunit.client.1.smithi115.stdout:1/348: creat df/d13/d4d/d68/f71 x:0 0 0 2024-04-16T14:35:37.862 INFO:tasks.workunit.client.1.smithi115.stdout:1/349: write df/d13/d3a/f60 [444739,130702] 0 2024-04-16T14:35:37.863 INFO:tasks.workunit.client.1.smithi115.stdout:9/447: creat d1/d7f/f93 x:0 0 0 2024-04-16T14:35:37.866 INFO:tasks.workunit.client.1.smithi115.stdout:1/350: mkdir df/d13/d72 0 2024-04-16T14:35:37.867 INFO:tasks.workunit.client.1.smithi115.stdout:2/439: rmdir d0/d1b 39 2024-04-16T14:35:37.867 INFO:tasks.workunit.client.1.smithi115.stdout:2/440: creat d0/d47/f94 x:0 0 0 2024-04-16T14:35:37.869 INFO:tasks.workunit.client.1.smithi115.stdout:1/351: creat df/d13/d4d/d6d/f73 x:0 0 0 2024-04-16T14:35:37.869 INFO:tasks.workunit.client.1.smithi115.stdout:7/342: dread d0/d2/d3a/d30/d6b/f75 [0,4194304] 0 2024-04-16T14:35:37.869 INFO:tasks.workunit.client.1.smithi115.stdout:0/294: dread d6/f41 [0,4194304] 0 2024-04-16T14:35:37.873 INFO:tasks.workunit.client.0.smithi005.stdout:2/417: dwrite d0/d29/d3e/f71 [0,4194304] 0 2024-04-16T14:35:37.874 INFO:tasks.workunit.client.1.smithi115.stdout:2/441: rmdir d0/d47/d65/d61/d70 39 2024-04-16T14:35:37.876 INFO:tasks.workunit.client.1.smithi115.stdout:5/350: getdents dc/d15 0 2024-04-16T14:35:37.877 INFO:tasks.workunit.client.1.smithi115.stdout:4/394: dread d1/d2/f8 [0,4194304] 0 2024-04-16T14:35:37.878 INFO:tasks.workunit.client.1.smithi115.stdout:2/442: mkdir d0/d4/de/d11/d25/d95 0 2024-04-16T14:35:37.878 INFO:tasks.workunit.client.1.smithi115.stdout:2/443: creat d0/d4/de/d11/f96 x:0 0 0 2024-04-16T14:35:37.879 INFO:tasks.workunit.client.1.smithi115.stdout:9/448: dread d1/d6/d2d/d3d/d50/f5e [0,4194304] 0 2024-04-16T14:35:37.880 INFO:tasks.workunit.client.1.smithi115.stdout:9/449: dread - d1/d6/d2d/d4b/d6c/d20/f87 zero size 2024-04-16T14:35:37.880 INFO:tasks.workunit.client.0.smithi005.stdout:8/641: write d5/d7b/da8/db7/d8a/da1/fd0 [602673,45566] 0 2024-04-16T14:35:37.881 INFO:tasks.workunit.client.1.smithi115.stdout:7/343: write d0/d2/d3a/f33 [516339,61498] 0 2024-04-16T14:35:37.881 INFO:tasks.workunit.client.1.smithi115.stdout:7/344: fsync d0/d1/f20 0 2024-04-16T14:35:37.881 INFO:tasks.workunit.client.1.smithi115.stdout:7/345: write d0/d2/d3a/d30/f32 [3723747,28630] 0 2024-04-16T14:35:37.881 INFO:tasks.workunit.client.1.smithi115.stdout:7/346: stat d0/d1/d3b/l65 0 2024-04-16T14:35:37.881 INFO:tasks.workunit.client.1.smithi115.stdout:1/352: getdents df/d13/d4d/d2c/d54/d55 0 2024-04-16T14:35:37.883 INFO:tasks.workunit.client.0.smithi005.stdout:8/642: rename d5/d40/d8e/daf to d5/d7b/da8/db7/d8a/da1/d3d/d7f/d8d/de2 0 2024-04-16T14:35:37.883 INFO:tasks.workunit.client.0.smithi005.stdout:8/643: fsync d5/d40/f70 0 2024-04-16T14:35:37.885 INFO:tasks.workunit.client.1.smithi115.stdout:1/353: dread df/f25 [0,4194304] 0 2024-04-16T14:35:37.885 INFO:tasks.workunit.client.1.smithi115.stdout:1/354: creat df/d13/f74 x:0 0 0 2024-04-16T14:35:37.887 INFO:tasks.workunit.client.0.smithi005.stdout:1/809: dwrite d2/d1c/d15/f9c [0,4194304] 0 2024-04-16T14:35:37.888 INFO:tasks.workunit.client.1.smithi115.stdout:6/432: dwrite f12 [8388608,4194304] 0 2024-04-16T14:35:37.888 INFO:tasks.workunit.client.1.smithi115.stdout:6/433: fsync d13/f7f 0 2024-04-16T14:35:37.888 INFO:tasks.workunit.client.1.smithi115.stdout:6/434: stat d13/d1d/d49/f70 0 2024-04-16T14:35:37.889 INFO:tasks.workunit.client.0.smithi005.stdout:1/810: read d2/d1c/fdd [233418,130408] 0 2024-04-16T14:35:37.889 INFO:tasks.workunit.client.0.smithi005.stdout:1/811: write d2/d1c/d15/d2a/d19/d42/d71/dac/f119 [3729,84904] 0 2024-04-16T14:35:37.890 INFO:tasks.workunit.client.1.smithi115.stdout:3/425: dwrite dc/d29/d39/d86/f8b [0,4194304] 0 2024-04-16T14:35:37.894 INFO:tasks.workunit.client.1.smithi115.stdout:2/444: symlink d0/d4/d24/d23/d80/l97 0 2024-04-16T14:35:37.894 INFO:tasks.workunit.client.1.smithi115.stdout:3/426: dread dc/d29/d4d/d56/f5c [0,4194304] 0 2024-04-16T14:35:37.896 INFO:tasks.workunit.client.1.smithi115.stdout:5/351: rmdir dc/d15/d35 39 2024-04-16T14:35:37.899 INFO:tasks.workunit.client.1.smithi115.stdout:7/347: mkdir d0/d2/d3a/d30/d79 0 2024-04-16T14:35:37.900 INFO:tasks.workunit.client.1.smithi115.stdout:0/295: dwrite f1 [4194304,4194304] 0 2024-04-16T14:35:37.902 INFO:tasks.workunit.client.1.smithi115.stdout:1/355: mkdir df/d13/d4d/d3e/d75 0 2024-04-16T14:35:37.902 INFO:tasks.workunit.client.1.smithi115.stdout:1/356: chown df/f64 542 1 2024-04-16T14:35:37.902 INFO:tasks.workunit.client.1.smithi115.stdout:1/357: write df/f23 [1343498,85611] 0 2024-04-16T14:35:37.903 INFO:tasks.workunit.client.1.smithi115.stdout:6/435: creat d13/f8e x:0 0 0 2024-04-16T14:35:37.904 INFO:tasks.workunit.client.0.smithi005.stdout:1/812: creat d2/d1c/d15/d2a/d19/d6e/f11b x:0 0 0 2024-04-16T14:35:37.905 INFO:tasks.workunit.client.1.smithi115.stdout:2/445: rename d0/d4/d4a/c5c to d0/d47/d65/c98 0 2024-04-16T14:35:37.909 INFO:tasks.workunit.client.1.smithi115.stdout:7/348: mkdir d0/d1/d3b/d3f/d7a 0 2024-04-16T14:35:37.911 INFO:tasks.workunit.client.0.smithi005.stdout:2/418: dwrite d0/d2a/f31 [0,4194304] 0 2024-04-16T14:35:37.913 INFO:tasks.workunit.client.1.smithi115.stdout:9/450: dwrite d1/d6/d2d/d4b/d6c/d20/d36/f52 [0,4194304] 0 2024-04-16T14:35:37.918 INFO:tasks.workunit.client.1.smithi115.stdout:9/451: chown d1/d6/d2d/d4b/d6c/d20 549 1 2024-04-16T14:35:37.918 INFO:tasks.workunit.client.1.smithi115.stdout:2/446: rmdir d0/d4/de/d11/d6d/d72 0 2024-04-16T14:35:37.918 INFO:tasks.workunit.client.1.smithi115.stdout:4/395: dwrite d1/d15/d1e/f65 [0,4194304] 0 2024-04-16T14:35:37.918 INFO:tasks.workunit.client.1.smithi115.stdout:7/349: creat d0/d1/d3b/d3f/f7b x:0 0 0 2024-04-16T14:35:37.918 INFO:tasks.workunit.client.0.smithi005.stdout:2/419: mknod d0/d1c/d39/c8a 0 2024-04-16T14:35:37.918 INFO:tasks.workunit.client.0.smithi005.stdout:2/420: chown d0/d4/d2b/d5e/f6f 31 1 2024-04-16T14:35:37.918 INFO:tasks.workunit.client.0.smithi005.stdout:2/421: truncate d0/d4/d2b/d5e/f6f 1174267 0 2024-04-16T14:35:37.919 INFO:tasks.workunit.client.0.smithi005.stdout:2/422: write d0/d4/d2b/f11 [4316412,34780] 0 2024-04-16T14:35:37.919 INFO:tasks.workunit.client.0.smithi005.stdout:2/423: creat d0/d29/d89/f8b x:0 0 0 2024-04-16T14:35:37.919 INFO:tasks.workunit.client.0.smithi005.stdout:2/424: symlink d0/d4/d2b/d6b/l8c 0 2024-04-16T14:35:37.919 INFO:tasks.workunit.client.0.smithi005.stdout:2/425: write d0/d1c/d59/f5a [836779,99083] 0 2024-04-16T14:35:37.919 INFO:tasks.workunit.client.1.smithi115.stdout:3/427: dwrite dc/f1c [0,4194304] 0 2024-04-16T14:35:37.922 INFO:tasks.workunit.client.1.smithi115.stdout:7/350: symlink d0/d24/l7c 0 2024-04-16T14:35:37.924 INFO:tasks.workunit.client.1.smithi115.stdout:0/296: rename d6/d38 to d6/d10/d12/d1f/d36/d4b/d6d 0 2024-04-16T14:35:37.924 INFO:tasks.workunit.client.1.smithi115.stdout:0/297: chown d6/d10/d12/d5f 0 1 2024-04-16T14:35:37.925 INFO:tasks.workunit.client.1.smithi115.stdout:3/428: symlink dc/d29/d4d/d56/d7e/l93 0 2024-04-16T14:35:37.925 INFO:tasks.workunit.client.1.smithi115.stdout:7/351: stat d0/d1/l1c 0 2024-04-16T14:35:37.926 INFO:tasks.workunit.client.1.smithi115.stdout:2/447: dread d0/d4/f7 [0,4194304] 0 2024-04-16T14:35:37.927 INFO:tasks.workunit.client.1.smithi115.stdout:1/358: rename df/d13/d4d/d3e/f46 to df/d13/d4d/d2c/f76 0 2024-04-16T14:35:37.927 INFO:tasks.workunit.client.0.smithi005.stdout:2/426: dread d0/d4/fc [0,4194304] 0 2024-04-16T14:35:37.928 INFO:tasks.workunit.client.1.smithi115.stdout:3/429: creat dc/d29/d4d/d56/d7e/f94 x:0 0 0 2024-04-16T14:35:37.928 INFO:tasks.workunit.client.0.smithi005.stdout:2/427: mkdir d0/d1c/d8d 0 2024-04-16T14:35:37.929 INFO:tasks.workunit.client.1.smithi115.stdout:7/352: creat d0/d2/d3a/d73/f7d x:0 0 0 2024-04-16T14:35:37.929 INFO:tasks.workunit.client.0.smithi005.stdout:2/428: creat d0/d29/d3e/f8e x:0 0 0 2024-04-16T14:35:37.929 INFO:tasks.workunit.client.0.smithi005.stdout:2/429: write d0/d1c/d59/f5a [1036740,50678] 0 2024-04-16T14:35:37.930 INFO:tasks.workunit.client.1.smithi115.stdout:2/448: creat d0/d1b/f99 x:0 0 0 2024-04-16T14:35:37.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:37 smithi115 ceph-mon[37295]: pgmap v23: 65 pgs: 65 active+clean; 1.1 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 108 MiB/s rd, 127 MiB/s wr, 449 op/s 2024-04-16T14:35:37.931 INFO:tasks.workunit.client.1.smithi115.stdout:9/452: rename d1/d6/d2d/d4b/d60/d65/f80 to d1/d6/d2d/d3d/d50/f94 0 2024-04-16T14:35:37.931 INFO:tasks.workunit.client.1.smithi115.stdout:1/359: symlink df/d35/l77 0 2024-04-16T14:35:37.932 INFO:tasks.workunit.client.1.smithi115.stdout:7/353: getdents d0 0 2024-04-16T14:35:37.934 INFO:tasks.workunit.client.1.smithi115.stdout:6/436: dwrite d13/d1d/d2b/d5f/d30/d43/d2c/f39 [0,4194304] 0 2024-04-16T14:35:37.934 INFO:tasks.workunit.client.1.smithi115.stdout:6/437: chown d13/c34 28 1 2024-04-16T14:35:37.935 INFO:tasks.workunit.client.1.smithi115.stdout:9/453: creat d1/d6/d2d/d4b/d8f/f95 x:0 0 0 2024-04-16T14:35:37.936 INFO:tasks.workunit.client.1.smithi115.stdout:7/354: symlink d0/d2/d3a/d73/l7e 0 2024-04-16T14:35:37.936 INFO:tasks.workunit.client.1.smithi115.stdout:7/355: chown d0/d2/d3a/d30/d79 0 1 2024-04-16T14:35:37.936 INFO:tasks.workunit.client.1.smithi115.stdout:7/356: fdatasync d0/d2/d3a/d73/f7d 0 2024-04-16T14:35:37.938 INFO:tasks.workunit.client.1.smithi115.stdout:3/430: dread dc/d29/f2e [4194304,4194304] 0 2024-04-16T14:35:37.938 INFO:tasks.workunit.client.1.smithi115.stdout:3/431: write dc/fe [484652,27129] 0 2024-04-16T14:35:37.938 INFO:tasks.workunit.client.1.smithi115.stdout:3/432: write dc/d29/d4d/d56/f58 [846763,77187] 0 2024-04-16T14:35:37.938 INFO:tasks.workunit.client.1.smithi115.stdout:6/438: mknod d13/d1d/d49/c8f 0 2024-04-16T14:35:37.940 INFO:tasks.workunit.client.1.smithi115.stdout:9/454: rename d1/d6/d29/c3b to d1/d6/d2d/d4b/d60/d65/c96 0 2024-04-16T14:35:37.941 INFO:tasks.workunit.client.0.smithi005.stdout:1/813: dwrite d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/dc5/fd5 [0,4194304] 0 2024-04-16T14:35:37.942 INFO:tasks.workunit.client.1.smithi115.stdout:4/396: dwrite d1/d15/d31/d42/f4a [0,4194304] 0 2024-04-16T14:35:37.942 INFO:tasks.workunit.client.1.smithi115.stdout:4/397: readlink d1/d15/d31/d42/d46/l59 0 2024-04-16T14:35:37.942 INFO:tasks.workunit.client.1.smithi115.stdout:5/352: dwrite dc/d15/f3e [12582912,4194304] 0 2024-04-16T14:35:37.942 INFO:tasks.workunit.client.1.smithi115.stdout:5/353: dread - dc/f56 zero size 2024-04-16T14:35:37.943 INFO:tasks.workunit.client.1.smithi115.stdout:5/354: chown dc/f3b 0 1 2024-04-16T14:35:37.944 INFO:tasks.workunit.client.1.smithi115.stdout:6/439: symlink d13/d1d/d2b/d5b/l90 0 2024-04-16T14:35:37.944 INFO:tasks.workunit.client.1.smithi115.stdout:3/433: readlink dc/d24/d33/l42 0 2024-04-16T14:35:37.944 INFO:tasks.workunit.client.0.smithi005.stdout:1/814: link d2/d1c/d15/d2a/d19/d42/d64/c82 d2/d1c/d15/d2a/d19/c11c 0 2024-04-16T14:35:37.945 INFO:tasks.workunit.client.0.smithi005.stdout:1/815: truncate d2/d1c/d15/d2a/d1a/fc7 1024320 0 2024-04-16T14:35:37.945 INFO:tasks.workunit.client.0.smithi005.stdout:1/816: fdatasync d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/dc5/df4/ffc 0 2024-04-16T14:35:37.945 INFO:tasks.workunit.client.0.smithi005.stdout:1/817: dread - d2/d1c/d15/d2a/d19/d42/d71/f75 zero size 2024-04-16T14:35:37.948 INFO:tasks.workunit.client.0.smithi005.stdout:1/818: mkdir d2/d1c/d15/d2a/d25/d11d 0 2024-04-16T14:35:37.948 INFO:tasks.workunit.client.0.smithi005.stdout:1/819: write d2/d1c/fdd [1120834,114753] 0 2024-04-16T14:35:37.948 INFO:tasks.workunit.client.0.smithi005.stdout:1/820: readlink d2/lf2 0 2024-04-16T14:35:37.948 INFO:tasks.workunit.client.0.smithi005.stdout:1/821: stat d2/d74/d7a/l104 0 2024-04-16T14:35:37.948 INFO:tasks.workunit.client.0.smithi005.stdout:1/822: write d2/d74/dd7/f10b [4537179,72682] 0 2024-04-16T14:35:37.949 INFO:tasks.workunit.client.1.smithi115.stdout:7/357: dread d0/d1/f20 [0,4194304] 0 2024-04-16T14:35:37.949 INFO:tasks.workunit.client.1.smithi115.stdout:9/455: read d1/d6/d2d/f5b [1437,88818] 0 2024-04-16T14:35:37.949 INFO:tasks.workunit.client.1.smithi115.stdout:9/456: read - d1/d6/d2d/f71 zero size 2024-04-16T14:35:37.949 INFO:tasks.workunit.client.1.smithi115.stdout:9/457: write d1/d6/d2d/d3d/f7c [352659,115428] 0 2024-04-16T14:35:37.949 INFO:tasks.workunit.client.1.smithi115.stdout:9/458: creat d1/d7f/f97 x:0 0 0 2024-04-16T14:35:37.949 INFO:tasks.workunit.client.1.smithi115.stdout:7/358: creat d0/d1/d3b/f7f x:0 0 0 2024-04-16T14:35:37.949 INFO:tasks.workunit.client.0.smithi005.stdout:1/823: mknod d2/d1c/d15/d2a/d19/dc9/c11e 0 2024-04-16T14:35:37.952 INFO:tasks.workunit.client.0.smithi005.stdout:4/867: sync 2024-04-16T14:35:37.952 INFO:tasks.workunit.client.0.smithi005.stdout:0/580: sync 2024-04-16T14:35:37.953 INFO:tasks.workunit.client.0.smithi005.stdout:4/868: rmdir d0/d22/df2 39 2024-04-16T14:35:37.954 INFO:tasks.workunit.client.1.smithi115.stdout:2/449: dread d0/d4/d57/f67 [0,4194304] 0 2024-04-16T14:35:37.954 INFO:tasks.workunit.client.1.smithi115.stdout:2/450: chown d0/d4/de/d11/d36/l5f 140032 1 2024-04-16T14:35:37.954 INFO:tasks.workunit.client.1.smithi115.stdout:3/434: truncate dc/d24/d33/d4b/f55 655876 0 2024-04-16T14:35:37.954 INFO:tasks.workunit.client.1.smithi115.stdout:5/355: dread f1 [0,4194304] 0 2024-04-16T14:35:37.956 INFO:tasks.workunit.client.0.smithi005.stdout:0/581: getdents da/df/d1b/d3a/d53/d5a/d99 0 2024-04-16T14:35:37.970 INFO:tasks.workunit.client.1.smithi115.stdout:2/451: dread d0/d4/d24/d23/f2c [0,4194304] 0 2024-04-16T14:35:37.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:37 smithi005 ceph-mon[28964]: pgmap v23: 65 pgs: 65 active+clean; 1.1 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 108 MiB/s rd, 127 MiB/s wr, 449 op/s 2024-04-16T14:35:37.976 INFO:tasks.workunit.client.1.smithi115.stdout:2/452: dread d0/fd [0,4194304] 0 2024-04-16T14:35:37.976 INFO:tasks.workunit.client.1.smithi115.stdout:2/453: stat d0/d1b/c58 0 2024-04-16T14:35:37.977 INFO:tasks.workunit.client.1.smithi115.stdout:2/454: getdents d0/d4/d24/d10 0 2024-04-16T14:35:37.979 INFO:tasks.workunit.client.1.smithi115.stdout:5/356: write dc/d15/d35/d69/f72 [9579376,71380] 0 2024-04-16T14:35:37.999 INFO:tasks.workunit.client.1.smithi115.stdout:4/398: dwrite d1/d15/f64 [0,4194304] 0 2024-04-16T14:35:37.999 INFO:tasks.workunit.client.1.smithi115.stdout:4/399: chown d1/d15/d17/c52 2495 1 2024-04-16T14:35:38.002 INFO:tasks.workunit.client.1.smithi115.stdout:1/360: dwrite df/f11 [0,4194304] 0 2024-04-16T14:35:38.002 INFO:tasks.workunit.client.1.smithi115.stdout:1/361: readlink df/d13/d4d/d2c/d54/d55/l44 0 2024-04-16T14:35:38.005 INFO:tasks.workunit.client.0.smithi005.stdout:0/582: dwrite da/df/d1b/d24/d75/d81/fb7 [0,4194304] 0 2024-04-16T14:35:38.006 INFO:tasks.workunit.client.0.smithi005.stdout:1/824: dwrite d2/d1c/d15/d2a/d19/f4a [0,4194304] 0 2024-04-16T14:35:38.006 INFO:tasks.workunit.client.1.smithi115.stdout:6/440: dwrite d13/d1d/d2b/d46/f8a [0,4194304] 0 2024-04-16T14:35:38.006 INFO:tasks.workunit.client.1.smithi115.stdout:3/435: dwrite dc/d29/d4d/d56/f5c [0,4194304] 0 2024-04-16T14:35:38.006 INFO:tasks.workunit.client.1.smithi115.stdout:2/455: dwrite d0/d4/d24/f34 [0,4194304] 0 2024-04-16T14:35:38.006 INFO:tasks.workunit.client.1.smithi115.stdout:1/362: rename df/d36/d3c/f6c to df/d13/d3a/f78 0 2024-04-16T14:35:38.006 INFO:tasks.workunit.client.1.smithi115.stdout:4/400: dread d1/d15/d1e/f29 [0,4194304] 0 2024-04-16T14:35:38.007 INFO:tasks.workunit.client.1.smithi115.stdout:3/436: write dc/f3d [483971,102659] 0 2024-04-16T14:35:38.007 INFO:tasks.workunit.client.0.smithi005.stdout:4/869: dwrite d0/d22/d61/fe7 [0,4194304] 0 2024-04-16T14:35:38.014 INFO:tasks.workunit.client.0.smithi005.stdout:1/825: write d2/d74/dd7/f8f [1485527,37632] 0 2024-04-16T14:35:38.016 INFO:tasks.workunit.client.1.smithi115.stdout:6/441: creat d13/d1d/d2b/d5f/d30/d43/d2c/f91 x:0 0 0 2024-04-16T14:35:38.016 INFO:tasks.workunit.client.1.smithi115.stdout:6/442: stat d13/d1d/d2b/d5f/f6a 0 2024-04-16T14:35:38.017 INFO:tasks.workunit.client.1.smithi115.stdout:5/357: dread dc/d15/d35/d69/f72 [4194304,4194304] 0 2024-04-16T14:35:38.017 INFO:tasks.workunit.client.1.smithi115.stdout:5/358: write dc/f12 [1241110,63347] 0 2024-04-16T14:35:38.017 INFO:tasks.workunit.client.1.smithi115.stdout:5/359: write dc/f1c [594465,26848] 0 2024-04-16T14:35:38.019 INFO:tasks.workunit.client.1.smithi115.stdout:4/401: creat d1/f68 x:0 0 0 2024-04-16T14:35:38.020 INFO:tasks.workunit.client.1.smithi115.stdout:4/402: chown d1/d15/d31/f3a 7537 1 2024-04-16T14:35:38.020 INFO:tasks.workunit.client.1.smithi115.stdout:4/403: chown d1/d15/d24/c4f 2100982 1 2024-04-16T14:35:38.020 INFO:tasks.workunit.client.1.smithi115.stdout:4/404: getdents d1/d15/d31/d55 0 2024-04-16T14:35:38.020 INFO:tasks.workunit.client.0.smithi005.stdout:1/826: rename d2/d2c/d85/dab to d2/d74/dd7/d11f 0 2024-04-16T14:35:38.021 INFO:tasks.workunit.client.0.smithi005.stdout:1/827: write d2/d1c/d15/d2a/d1a/d21/f30 [1347396,122945] 0 2024-04-16T14:35:38.022 INFO:tasks.workunit.client.1.smithi115.stdout:3/437: link f4 dc/d24/d33/d4b/d81/f95 0 2024-04-16T14:35:38.022 INFO:tasks.workunit.client.1.smithi115.stdout:3/438: write dc/d29/d4d/d56/f5a [346632,7184] 0 2024-04-16T14:35:38.024 INFO:tasks.workunit.client.1.smithi115.stdout:6/443: mknod d13/d1d/d52/c92 0 2024-04-16T14:35:38.026 INFO:tasks.workunit.client.1.smithi115.stdout:4/405: dread d1/d15/f4d [0,4194304] 0 2024-04-16T14:35:38.026 INFO:tasks.workunit.client.1.smithi115.stdout:1/363: dwrite df/d36/d3c/f63 [0,4194304] 0 2024-04-16T14:35:38.026 INFO:tasks.workunit.client.1.smithi115.stdout:5/360: link dc/d3d/l58 dc/d5d/l77 0 2024-04-16T14:35:38.026 INFO:tasks.workunit.client.1.smithi115.stdout:1/364: creat df/d36/f79 x:0 0 0 2024-04-16T14:35:38.026 INFO:tasks.workunit.client.1.smithi115.stdout:1/365: readlink df/l5c 0 2024-04-16T14:35:38.028 INFO:tasks.workunit.client.1.smithi115.stdout:3/439: symlink dc/d29/d77/l96 0 2024-04-16T14:35:38.028 INFO:tasks.workunit.client.1.smithi115.stdout:3/440: chown dc/d29/d4d/d56/f58 1 1 2024-04-16T14:35:38.028 INFO:tasks.workunit.client.1.smithi115.stdout:6/444: read d13/d1d/d52/f53 [930680,25456] 0 2024-04-16T14:35:38.029 INFO:tasks.workunit.client.0.smithi005.stdout:4/870: dwrite d0/d1b/d1d/f21 [0,4194304] 0 2024-04-16T14:35:38.036 INFO:tasks.workunit.client.1.smithi115.stdout:3/441: read dc/f22 [3931643,121248] 0 2024-04-16T14:35:38.036 INFO:tasks.workunit.client.1.smithi115.stdout:3/442: write dc/d24/d36/f3b [4940399,4650] 0 2024-04-16T14:35:38.037 INFO:tasks.workunit.client.1.smithi115.stdout:3/443: stat dc/d24/f49 0 2024-04-16T14:35:38.037 INFO:tasks.workunit.client.1.smithi115.stdout:3/444: fdatasync dc/f1c 0 2024-04-16T14:35:38.041 INFO:tasks.workunit.client.1.smithi115.stdout:4/406: symlink d1/l69 0 2024-04-16T14:35:38.042 INFO:tasks.workunit.client.0.smithi005.stdout:1/828: dwrite d2/d74/dd7/d11f/f35 [0,4194304] 0 2024-04-16T14:35:38.042 INFO:tasks.workunit.client.0.smithi005.stdout:1/829: fsync d2/d1c/d15/d2a/d19/d20/f53 0 2024-04-16T14:35:38.045 INFO:tasks.workunit.client.0.smithi005.stdout:4/871: dread d0/d1b/d1d/d1f/d48/f8a [0,4194304] 0 2024-04-16T14:35:38.057 INFO:tasks.workunit.client.0.smithi005.stdout:4/872: write d0/d22/d61/fe7 [2328618,37798] 0 2024-04-16T14:35:38.057 INFO:tasks.workunit.client.0.smithi005.stdout:4/873: fsync d0/d1b/d1d/f53 0 2024-04-16T14:35:38.061 INFO:tasks.workunit.client.1.smithi115.stdout:3/445: dwrite dc/d24/d33/d4b/f4c [0,4194304] 0 2024-04-16T14:35:38.062 INFO:tasks.workunit.client.0.smithi005.stdout:1/830: dwrite d2/d1c/d15/d2a/d19/d42/d64/f69 [0,4194304] 0 2024-04-16T14:35:38.062 INFO:tasks.workunit.client.0.smithi005.stdout:4/874: dread d0/d1b/f7c [0,4194304] 0 2024-04-16T14:35:38.064 INFO:tasks.workunit.client.0.smithi005.stdout:1/831: creat d2/d1c/d15/d2a/d19/d42/d64/d76/f120 x:0 0 0 2024-04-16T14:35:38.064 INFO:tasks.workunit.client.0.smithi005.stdout:1/832: chown d2/d1c/d15/d2a/d19/d42/d64/c82 116649 1 2024-04-16T14:35:38.065 INFO:tasks.workunit.client.0.smithi005.stdout:1/833: creat d2/d1c/d15/d2a/d19/f121 x:0 0 0 2024-04-16T14:35:38.065 INFO:tasks.workunit.client.0.smithi005.stdout:1/834: chown d2/d1c/f6b 2123859685 1 2024-04-16T14:35:38.065 INFO:tasks.workunit.client.0.smithi005.stdout:1/835: stat d2/d1c/f58 0 2024-04-16T14:35:38.065 INFO:tasks.workunit.client.0.smithi005.stdout:1/836: chown d2/d1c/d15/d2a/d19/dc9/fe6 4 1 2024-04-16T14:35:38.066 INFO:tasks.workunit.client.0.smithi005.stdout:1/837: creat d2/d1c/d15/d2a/d19/d42/d71/dac/d99/f122 x:0 0 0 2024-04-16T14:35:38.067 INFO:tasks.workunit.client.0.smithi005.stdout:4/875: dread d0/f7 [4194304,4194304] 0 2024-04-16T14:35:38.068 INFO:tasks.workunit.client.0.smithi005.stdout:1/838: dread d2/d74/dd7/d11f/d51/dc4/fe2 [0,4194304] 0 2024-04-16T14:35:38.069 INFO:tasks.workunit.client.0.smithi005.stdout:4/876: unlink d0/d1b/da5/fca 0 2024-04-16T14:35:38.069 INFO:tasks.workunit.client.0.smithi005.stdout:4/877: chown d0/d1b/da5/lc6 32895867 1 2024-04-16T14:35:38.069 INFO:tasks.workunit.client.0.smithi005.stdout:4/878: chown d0/d22/d61/le0 492498 1 2024-04-16T14:35:38.070 INFO:tasks.workunit.client.0.smithi005.stdout:1/839: fsync d2/d74/dd7/f8f 0 2024-04-16T14:35:38.082 INFO:tasks.workunit.client.0.smithi005.stdout:1/840: read d2/d1c/d15/d2a/d19/d20/f53 [1799013,100505] 0 2024-04-16T14:35:38.083 INFO:tasks.workunit.client.0.smithi005.stdout:1/841: mknod d2/d1c/dd8/c123 0 2024-04-16T14:35:38.083 INFO:tasks.workunit.client.0.smithi005.stdout:1/842: readlink d2/d1c/d15/d6f/ld9 0 2024-04-16T14:35:38.084 INFO:tasks.workunit.client.0.smithi005.stdout:4/879: dwrite d0/d1b/d1d/d1f/d48/dab/fa6 [0,4194304] 0 2024-04-16T14:35:38.084 INFO:tasks.workunit.client.0.smithi005.stdout:1/843: symlink d2/d1c/d15/d2a/d1a/d21/l124 0 2024-04-16T14:35:38.087 INFO:tasks.workunit.client.0.smithi005.stdout:4/880: unlink d0/d22/d61/c9f 0 2024-04-16T14:35:38.087 INFO:tasks.workunit.client.0.smithi005.stdout:4/881: dread - d0/d1b/d1d/d1f/d48/dab/ffd zero size 2024-04-16T14:35:38.092 INFO:tasks.workunit.client.0.smithi005.stdout:4/882: rmdir d0/d1b/d1d/d1f 39 2024-04-16T14:35:38.093 INFO:tasks.workunit.client.0.smithi005.stdout:4/883: rename d0/d1b/d1d/d1f/d5d/fa8 to d0/d1b/d1d/d1f/d5d/f115 0 2024-04-16T14:35:38.094 INFO:tasks.workunit.client.1.smithi115.stdout:1/366: getdents df/d13/d4d/d2c 0 2024-04-16T14:35:38.094 INFO:tasks.workunit.client.1.smithi115.stdout:1/367: dread - df/f64 zero size 2024-04-16T14:35:38.094 INFO:tasks.workunit.client.0.smithi005.stdout:4/884: getdents d0/d1b/d1d/d1f/d48/dab/dcb 0 2024-04-16T14:35:38.095 INFO:tasks.workunit.client.1.smithi115.stdout:6/445: rmdir d13/d1d/d49/d60 0 2024-04-16T14:35:38.095 INFO:tasks.workunit.client.1.smithi115.stdout:6/446: chown d13/d1d/d2b/d46/f6b 7874 1 2024-04-16T14:35:38.097 INFO:tasks.workunit.client.1.smithi115.stdout:3/446: creat dc/d24/d33/d4b/f97 x:0 0 0 2024-04-16T14:35:38.110 INFO:tasks.workunit.client.0.smithi005.stdout:4/885: dwrite d0/d1b/d1d/d1f/da0/fb1 [0,4194304] 0 2024-04-16T14:35:38.110 INFO:tasks.workunit.client.0.smithi005.stdout:4/886: stat d0/d1b/d1d/d1f/d3e/c10e 0 2024-04-16T14:35:38.114 INFO:tasks.workunit.client.1.smithi115.stdout:3/447: dwrite dc/f16 [0,4194304] 0 2024-04-16T14:35:38.116 INFO:tasks.workunit.client.0.smithi005.stdout:4/887: unlink d0/d1b/d1d/d1f/d5d/f115 0 2024-04-16T14:35:38.117 INFO:tasks.workunit.client.0.smithi005.stdout:4/888: mkdir d0/d22/d61/d116 0 2024-04-16T14:35:38.117 INFO:tasks.workunit.client.0.smithi005.stdout:4/889: symlink d0/d1b/db7/ddd/l117 0 2024-04-16T14:35:38.118 INFO:tasks.workunit.client.0.smithi005.stdout:4/890: symlink d0/d1b/d1d/dc3/l118 0 2024-04-16T14:35:38.119 INFO:tasks.workunit.client.0.smithi005.stdout:4/891: rename d0/d1b/d1d/d4f/l54 to d0/d1b/l119 0 2024-04-16T14:35:38.120 INFO:tasks.workunit.client.0.smithi005.stdout:4/892: mknod d0/d22/d61/ded/c11a 0 2024-04-16T14:35:38.121 INFO:tasks.workunit.client.0.smithi005.stdout:4/893: rename d0/f5f to d0/d1b/d1d/d1f/d3e/daa/f11b 0 2024-04-16T14:35:38.121 INFO:tasks.workunit.client.0.smithi005.stdout:4/894: chown d0/d22/c3a 1748 1 2024-04-16T14:35:38.122 INFO:tasks.workunit.client.0.smithi005.stdout:4/895: symlink d0/d22/d29/d107/d104/l11c 0 2024-04-16T14:35:38.122 INFO:tasks.workunit.client.0.smithi005.stdout:4/896: write d0/d47/fbc [1151700,125120] 0 2024-04-16T14:35:38.124 INFO:tasks.workunit.client.0.smithi005.stdout:4/897: rename d0/d1b/d1d/d4f/d75/cc8 to d0/d22/c11d 0 2024-04-16T14:35:38.124 INFO:tasks.workunit.client.0.smithi005.stdout:4/898: write d0/d1b/d1d/d1f/d3e/daa/ff1 [236957,84949] 0 2024-04-16T14:35:38.125 INFO:tasks.workunit.client.0.smithi005.stdout:4/899: rename d0/d47/c10c to d0/d1b/d1d/dde/c11e 0 2024-04-16T14:35:38.125 INFO:tasks.workunit.client.0.smithi005.stdout:4/900: chown d0/d1b/db7/d100/f112 702415231 1 2024-04-16T14:35:38.126 INFO:tasks.workunit.client.1.smithi115.stdout:1/368: unlink fe 0 2024-04-16T14:35:38.126 INFO:tasks.workunit.client.0.smithi005.stdout:4/901: unlink d0/d1b/d1d/d1f/f46 0 2024-04-16T14:35:38.128 INFO:tasks.workunit.client.0.smithi005.stdout:7/685: sync 2024-04-16T14:35:38.128 INFO:tasks.workunit.client.0.smithi005.stdout:7/686: readlink d1/d85/ldd 0 2024-04-16T14:35:38.128 INFO:tasks.workunit.client.0.smithi005.stdout:7/687: creat d1/d49/d74/d77/d22/da9/fe7 x:0 0 0 2024-04-16T14:35:38.129 INFO:tasks.workunit.client.1.smithi115.stdout:3/448: truncate dc/d29/f6b 917902 0 2024-04-16T14:35:38.129 INFO:tasks.workunit.client.0.smithi005.stdout:4/902: dread d0/f2c [0,4194304] 0 2024-04-16T14:35:38.129 INFO:tasks.workunit.client.0.smithi005.stdout:4/903: write d0/d1b/f7c [189681,127559] 0 2024-04-16T14:35:38.131 INFO:tasks.workunit.client.0.smithi005.stdout:7/688: link d1/d49/d74/d77/d22/da0/fa7 d1/d49/d74/d77/d22/da0/fe8 0 2024-04-16T14:35:38.131 INFO:tasks.workunit.client.0.smithi005.stdout:7/689: chown d1/d49/d74/d77/d22/d27/d3a 411 1 2024-04-16T14:35:38.131 INFO:tasks.workunit.client.0.smithi005.stdout:7/690: creat d1/d49/d74/d77/d57/d47/daa/fe9 x:0 0 0 2024-04-16T14:35:38.131 INFO:tasks.workunit.client.1.smithi115.stdout:3/449: mkdir dc/d29/d4d/d56/d98 0 2024-04-16T14:35:38.132 INFO:tasks.workunit.client.1.smithi115.stdout:3/450: readlink dc/d29/d39/l63 0 2024-04-16T14:35:38.132 INFO:tasks.workunit.client.0.smithi005.stdout:4/904: rename d0/d1b/d1d/dc3/fe5 to d0/d1b/d1d/d1f/d48/dab/dcb/f11f 0 2024-04-16T14:35:38.133 INFO:tasks.workunit.client.1.smithi115.stdout:3/451: unlink dc/d24/d33/d4b/f73 0 2024-04-16T14:35:38.143 INFO:tasks.workunit.client.1.smithi115.stdout:1/369: dwrite df/d2d/f41 [0,4194304] 0 2024-04-16T14:35:38.143 INFO:tasks.workunit.client.1.smithi115.stdout:1/370: write df/d13/f74 [593416,116618] 0 2024-04-16T14:35:38.143 INFO:tasks.workunit.client.1.smithi115.stdout:1/371: fsync df/f25 0 2024-04-16T14:35:38.143 INFO:tasks.workunit.client.1.smithi115.stdout:1/372: write df/d36/f4e [722748,65501] 0 2024-04-16T14:35:38.144 INFO:tasks.workunit.client.1.smithi115.stdout:1/373: mknod df/d13/d4d/d2c/d54/c7a 0 2024-04-16T14:35:38.159 INFO:tasks.workunit.client.1.smithi115.stdout:3/452: dwrite dc/f67 [0,4194304] 0 2024-04-16T14:35:38.159 INFO:tasks.workunit.client.1.smithi115.stdout:3/453: dread - dc/d24/d36/d60/f78 zero size 2024-04-16T14:35:38.160 INFO:tasks.workunit.client.1.smithi115.stdout:8/400: sync 2024-04-16T14:35:38.160 INFO:tasks.workunit.client.1.smithi115.stdout:8/401: fdatasync d0/db/f58 0 2024-04-16T14:35:38.161 INFO:tasks.workunit.client.0.smithi005.stdout:7/691: dwrite d1/d49/d74/d77/d22/d27/d3a/d5c/d9e/fd1 [0,4194304] 0 2024-04-16T14:35:38.163 INFO:tasks.workunit.client.0.smithi005.stdout:7/692: rmdir d1/d49/d74/d77/d57/d47 39 2024-04-16T14:35:38.165 INFO:tasks.workunit.client.0.smithi005.stdout:7/693: rename d1/d85/l9d to d1/dc/d2f/d4f/lea 0 2024-04-16T14:35:38.165 INFO:tasks.workunit.client.0.smithi005.stdout:7/694: dread - d1/d49/d74/d77/f65 zero size 2024-04-16T14:35:38.165 INFO:tasks.workunit.client.0.smithi005.stdout:7/695: fsync d1/d82/f76 0 2024-04-16T14:35:38.165 INFO:tasks.workunit.client.0.smithi005.stdout:7/696: truncate d1/d49/d74/d77/f11 4317658 0 2024-04-16T14:35:38.165 INFO:tasks.workunit.client.0.smithi005.stdout:7/697: read d1/d49/d74/d77/d22/d27/d2e/f48 [3816261,30888] 0 2024-04-16T14:35:38.166 INFO:tasks.workunit.client.1.smithi115.stdout:3/454: link dc/d29/f2e dc/d29/d4d/d56/d7e/f99 0 2024-04-16T14:35:38.166 INFO:tasks.workunit.client.0.smithi005.stdout:7/698: creat d1/d49/d74/d77/d22/da0/feb x:0 0 0 2024-04-16T14:35:38.167 INFO:tasks.workunit.client.0.smithi005.stdout:7/699: creat d1/d8a/fec x:0 0 0 2024-04-16T14:35:38.167 INFO:tasks.workunit.client.0.smithi005.stdout:7/700: write d1/d82/fcf [639847,111628] 0 2024-04-16T14:35:38.168 INFO:tasks.workunit.client.0.smithi005.stdout:7/701: mkdir d1/d49/d74/ded 0 2024-04-16T14:35:38.169 INFO:tasks.workunit.client.0.smithi005.stdout:7/702: truncate d1/dc/f7d 2490795 0 2024-04-16T14:35:38.169 INFO:tasks.workunit.client.0.smithi005.stdout:7/703: stat d1/d49/d74/d77/d22/d27/d2e/l9b 0 2024-04-16T14:35:38.169 INFO:tasks.workunit.client.0.smithi005.stdout:7/704: write d1/dc/d2f/f4c [5753876,87141] 0 2024-04-16T14:35:38.169 INFO:tasks.workunit.client.0.smithi005.stdout:7/705: write d1/d49/d74/d77/d22/da9/fab [819389,92846] 0 2024-04-16T14:35:38.169 INFO:tasks.workunit.client.0.smithi005.stdout:7/706: symlink d1/dc/d2f/d4f/lee 0 2024-04-16T14:35:38.170 INFO:tasks.workunit.client.0.smithi005.stdout:7/707: truncate d1/d49/d74/d77/d22/d27/d2e/f48 1920796 0 2024-04-16T14:35:38.171 INFO:tasks.workunit.client.0.smithi005.stdout:7/708: stat d1/dc/l93 0 2024-04-16T14:35:38.172 INFO:tasks.workunit.client.0.smithi005.stdout:7/709: stat d1/d49/d74/d77/d22/d27/d2e/l56 0 2024-04-16T14:35:38.187 INFO:tasks.workunit.client.1.smithi115.stdout:3/455: dwrite dc/d29/f48 [0,4194304] 0 2024-04-16T14:35:38.187 INFO:tasks.workunit.client.1.smithi115.stdout:8/402: dwrite d0/f1f [0,4194304] 0 2024-04-16T14:35:38.188 INFO:tasks.workunit.client.1.smithi115.stdout:3/456: mknod dc/d29/d39/d86/c9a 0 2024-04-16T14:35:38.188 INFO:tasks.workunit.client.1.smithi115.stdout:3/457: creat dc/d29/d4d/d56/f9b x:0 0 0 2024-04-16T14:35:38.190 INFO:tasks.workunit.client.1.smithi115.stdout:8/403: mkdir d0/db/d10/d17/d2c/d61/d7d 0 2024-04-16T14:35:38.190 INFO:tasks.workunit.client.1.smithi115.stdout:8/404: truncate d0/db/d10/d17/f40 818571 0 2024-04-16T14:35:38.196 INFO:tasks.workunit.client.1.smithi115.stdout:3/458: dread dc/d24/f49 [0,4194304] 0 2024-04-16T14:35:38.197 INFO:tasks.workunit.client.1.smithi115.stdout:3/459: fdatasync dc/d29/d39/d86/f8b 0 2024-04-16T14:35:38.197 INFO:tasks.workunit.client.1.smithi115.stdout:3/460: chown dc/d24/d33/f6a 1 1 2024-04-16T14:35:38.197 INFO:tasks.workunit.client.1.smithi115.stdout:3/461: write dc/d24/d33/d4b/f55 [54766,119237] 0 2024-04-16T14:35:38.202 INFO:tasks.workunit.client.0.smithi005.stdout:7/710: dwrite d1/d49/d74/d77/d22/da9/fab [0,4194304] 0 2024-04-16T14:35:38.203 INFO:tasks.workunit.client.0.smithi005.stdout:7/711: creat d1/d49/d74/d77/d22/db0/fef x:0 0 0 2024-04-16T14:35:38.203 INFO:tasks.workunit.client.0.smithi005.stdout:7/712: readlink d1/d49/d74/d77/d22/d27/d2e/l37 0 2024-04-16T14:35:38.214 INFO:tasks.workunit.client.0.smithi005.stdout:7/713: dread d1/d49/d74/d77/d22/f8c [0,4194304] 0 2024-04-16T14:35:38.215 INFO:tasks.workunit.client.1.smithi115.stdout:8/405: dwrite d0/db/d10/d17/d2c/d52/d74/d3b/f77 [0,4194304] 0 2024-04-16T14:35:38.222 INFO:tasks.workunit.client.0.smithi005.stdout:3/643: sync 2024-04-16T14:35:38.224 INFO:tasks.workunit.client.1.smithi115.stdout:8/406: dread d0/db/d10/d25/f5f [0,4194304] 0 2024-04-16T14:35:38.233 INFO:tasks.workunit.client.0.smithi005.stdout:7/714: dwrite d1/d49/d74/d77/d22/d27/d2e/fa3 [0,4194304] 0 2024-04-16T14:35:38.233 INFO:tasks.workunit.client.0.smithi005.stdout:7/715: write d1/d49/d74/d77/d22/d27/d2e/f48 [441789,120020] 0 2024-04-16T14:35:38.235 INFO:tasks.workunit.client.0.smithi005.stdout:3/644: dwrite d2/d9/d25/d39/f7f [0,4194304] 0 2024-04-16T14:35:38.235 INFO:tasks.workunit.client.0.smithi005.stdout:3/645: creat d2/d17/d46/d75/d41/d79/fd2 x:0 0 0 2024-04-16T14:35:38.236 INFO:tasks.workunit.client.0.smithi005.stdout:7/716: getdents d1/d49/d74 0 2024-04-16T14:35:38.239 INFO:tasks.workunit.client.0.smithi005.stdout:7/717: mknod d1/d49/d74/d77/d22/db0/dba/cf0 0 2024-04-16T14:35:38.239 INFO:tasks.workunit.client.1.smithi115.stdout:7/359: sync 2024-04-16T14:35:38.239 INFO:tasks.workunit.client.1.smithi115.stdout:0/298: sync 2024-04-16T14:35:38.240 INFO:tasks.workunit.client.1.smithi115.stdout:9/459: sync 2024-04-16T14:35:38.240 INFO:tasks.workunit.client.1.smithi115.stdout:7/360: stat d0/l8 0 2024-04-16T14:35:38.240 INFO:tasks.workunit.client.0.smithi005.stdout:7/718: unlink d1/d49/d74/d77/d22/d27/c50 0 2024-04-16T14:35:38.240 INFO:tasks.workunit.client.0.smithi005.stdout:7/719: stat d1/dc/d2f/f83 0 2024-04-16T14:35:38.241 INFO:tasks.workunit.client.1.smithi115.stdout:0/299: rename d6/f65 to d6/d10/d12/f6e 0 2024-04-16T14:35:38.241 INFO:tasks.workunit.client.0.smithi005.stdout:7/720: mknod d1/dc/d2f/dbd/cf1 0 2024-04-16T14:35:38.241 INFO:tasks.workunit.client.0.smithi005.stdout:7/721: chown d1/d85/d96/ccd 106290 1 2024-04-16T14:35:38.242 INFO:tasks.workunit.client.1.smithi115.stdout:7/361: mkdir d0/d1/d3b/d3f/d7a/d80 0 2024-04-16T14:35:38.242 INFO:tasks.workunit.client.1.smithi115.stdout:7/362: readlink d0/d1/d3b/d3f/l47 0 2024-04-16T14:35:38.242 INFO:tasks.workunit.client.0.smithi005.stdout:7/722: dread d1/d49/d74/d77/d22/d27/d3a/fb3 [0,4194304] 0 2024-04-16T14:35:38.245 INFO:tasks.workunit.client.0.smithi005.stdout:7/723: creat d1/d49/d74/d77/d22/da0/dbb/dcb/ff2 x:0 0 0 2024-04-16T14:35:38.246 INFO:tasks.workunit.client.0.smithi005.stdout:7/724: mknod d1/d49/d74/d77/d22/da0/cf3 0 2024-04-16T14:35:38.246 INFO:tasks.workunit.client.0.smithi005.stdout:7/725: chown d1/d49/d74/d77/d22/da0/dbb/dcb/ff2 18 1 2024-04-16T14:35:38.248 INFO:tasks.workunit.client.0.smithi005.stdout:7/726: mkdir d1/d49/d74/d77/d22/d27/df4 0 2024-04-16T14:35:38.252 INFO:tasks.workunit.client.1.smithi115.stdout:0/300: read d6/ff [581711,3140] 0 2024-04-16T14:35:38.254 INFO:tasks.workunit.client.1.smithi115.stdout:9/460: dwrite d1/d6/d2d/d3d/d50/f5e [0,4194304] 0 2024-04-16T14:35:38.254 INFO:tasks.workunit.client.1.smithi115.stdout:9/461: truncate d1/d6/d2d/d4b/d6c/d20/f2c 8345392 0 2024-04-16T14:35:38.254 INFO:tasks.workunit.client.1.smithi115.stdout:7/363: dread d0/d1/f1f [0,4194304] 0 2024-04-16T14:35:38.255 INFO:tasks.workunit.client.0.smithi005.stdout:7/727: dread d1/d49/d74/d77/d22/da0/fa7 [0,4194304] 0 2024-04-16T14:35:38.255 INFO:tasks.workunit.client.0.smithi005.stdout:7/728: write d1/d49/d74/d77/d57/d47/faf [690514,88776] 0 2024-04-16T14:35:38.255 INFO:tasks.workunit.client.0.smithi005.stdout:7/729: write d1/d49/d74/d77/d22/d27/d3a/d5c/f62 [4103281,80730] 0 2024-04-16T14:35:38.255 INFO:tasks.workunit.client.0.smithi005.stdout:7/730: dread - d1/d49/d74/d77/d57/d47/daa/fe9 zero size 2024-04-16T14:35:38.256 INFO:tasks.workunit.client.1.smithi115.stdout:9/462: mkdir d1/d6/d2d/d3d/d49/d98 0 2024-04-16T14:35:38.256 INFO:tasks.workunit.client.0.smithi005.stdout:7/731: read d1/d49/d74/d77/d22/da9/fca [5804,20212] 0 2024-04-16T14:35:38.256 INFO:tasks.workunit.client.1.smithi115.stdout:9/463: creat d1/d6/d2d/d4b/d60/f99 x:0 0 0 2024-04-16T14:35:38.257 INFO:tasks.workunit.client.1.smithi115.stdout:9/464: symlink d1/d6/d2d/d4b/l9a 0 2024-04-16T14:35:38.258 INFO:tasks.workunit.client.0.smithi005.stdout:7/732: unlink d1/d49/d74/d77/d22/d27/d3a/l78 0 2024-04-16T14:35:38.258 INFO:tasks.workunit.client.1.smithi115.stdout:0/301: getdents d6 0 2024-04-16T14:35:38.268 INFO:tasks.workunit.client.0.smithi005.stdout:7/733: dread d1/d49/d74/d77/d22/da9/fab [0,4194304] 0 2024-04-16T14:35:38.270 INFO:tasks.workunit.client.0.smithi005.stdout:7/734: symlink d1/d85/d96/de1/lf5 0 2024-04-16T14:35:38.272 INFO:tasks.workunit.client.0.smithi005.stdout:7/735: mknod d1/dc/d2f/dbd/cf6 0 2024-04-16T14:35:38.275 INFO:tasks.workunit.client.0.smithi005.stdout:7/736: getdents d1/d49 0 2024-04-16T14:35:38.276 INFO:tasks.workunit.client.1.smithi115.stdout:9/465: dwrite d1/d6/d2d/d4b/d8f/f95 [0,4194304] 0 2024-04-16T14:35:38.277 INFO:tasks.workunit.client.1.smithi115.stdout:7/364: dwrite d0/d1/d3b/f7f [0,4194304] 0 2024-04-16T14:35:38.278 INFO:tasks.workunit.client.1.smithi115.stdout:9/466: link d1/d6/d2d/d3d/d50/f94 d1/d6/d2d/d3d/d49/d98/f9b 0 2024-04-16T14:35:38.281 INFO:tasks.workunit.client.1.smithi115.stdout:0/302: dwrite d6/d10/d12/d31/d35/d28/f53 [0,4194304] 0 2024-04-16T14:35:38.281 INFO:tasks.workunit.client.1.smithi115.stdout:0/303: readlink d6/d30/l34 0 2024-04-16T14:35:38.281 INFO:tasks.workunit.client.1.smithi115.stdout:9/467: rename d1/d6/d2d/d4b/d8f/d91/c64 to d1/d6/d2d/d4b/c9c 0 2024-04-16T14:35:38.283 INFO:tasks.workunit.client.1.smithi115.stdout:9/468: symlink d1/d6/d2d/d4b/d8f/l9d 0 2024-04-16T14:35:38.283 INFO:tasks.workunit.client.1.smithi115.stdout:9/469: fsync d1/d6/d2d/d4b/d6c/f44 0 2024-04-16T14:35:38.284 INFO:tasks.workunit.client.0.smithi005.stdout:7/737: getdents d1/d49/d74/d77/d22/d27/d3a/d5c 0 2024-04-16T14:35:38.285 INFO:tasks.workunit.client.1.smithi115.stdout:9/470: mknod d1/d6/d2d/d4b/d6c/c9e 0 2024-04-16T14:35:38.285 INFO:tasks.workunit.client.1.smithi115.stdout:9/471: write d1/d6/d2d/d4b/d6c/d20/f22 [2707162,17440] 0 2024-04-16T14:35:38.285 INFO:tasks.workunit.client.1.smithi115.stdout:9/472: creat d1/d6/d2d/d4b/d6c/d20/d36/f9f x:0 0 0 2024-04-16T14:35:38.285 INFO:tasks.workunit.client.1.smithi115.stdout:9/473: fsync d1/d6/d2d/d4b/d6c/f46 0 2024-04-16T14:35:38.288 INFO:tasks.workunit.client.1.smithi115.stdout:9/474: creat d1/d6/d2d/d4b/d90/fa0 x:0 0 0 2024-04-16T14:35:38.288 INFO:tasks.workunit.client.1.smithi115.stdout:9/475: creat d1/d7f/fa1 x:0 0 0 2024-04-16T14:35:38.295 INFO:tasks.workunit.client.1.smithi115.stdout:2/456: sync 2024-04-16T14:35:38.296 INFO:tasks.workunit.client.1.smithi115.stdout:2/457: mknod d0/d4/de/c9a 0 2024-04-16T14:35:38.296 INFO:tasks.workunit.client.1.smithi115.stdout:2/458: symlink d0/d47/d65/d61/d70/l9b 0 2024-04-16T14:35:38.301 INFO:tasks.workunit.client.1.smithi115.stdout:2/459: dread d0/d47/d65/f7b [0,4194304] 0 2024-04-16T14:35:38.302 INFO:tasks.workunit.client.1.smithi115.stdout:2/460: chown d0/d4/d24/f34 24807324 1 2024-04-16T14:35:38.302 INFO:tasks.workunit.client.1.smithi115.stdout:2/461: creat d0/d4/d24/d23/f9c x:0 0 0 2024-04-16T14:35:38.302 INFO:tasks.workunit.client.1.smithi115.stdout:2/462: chown d0/d4/de/d11/c17 98698 1 2024-04-16T14:35:38.302 INFO:tasks.workunit.client.1.smithi115.stdout:2/463: truncate d0/d4/d24/d21/d3b/f3f 4686108 0 2024-04-16T14:35:38.302 INFO:tasks.workunit.client.1.smithi115.stdout:0/304: dwrite d6/d10/d12/f6e [0,4194304] 0 2024-04-16T14:35:38.302 INFO:tasks.workunit.client.1.smithi115.stdout:0/305: creat d6/d10/d12/d31/d35/d44/f6f x:0 0 0 2024-04-16T14:35:38.302 INFO:tasks.workunit.client.1.smithi115.stdout:0/306: fdatasync d6/d10/d12/d31/d35/f3e 0 2024-04-16T14:35:38.302 INFO:tasks.workunit.client.1.smithi115.stdout:7/365: dwrite d0/d2/d3a/f33 [0,4194304] 0 2024-04-16T14:35:38.303 INFO:tasks.workunit.client.1.smithi115.stdout:2/464: mknod d0/d4/de/d11/d36/c9d 0 2024-04-16T14:35:38.303 INFO:tasks.workunit.client.1.smithi115.stdout:2/465: write d0/d47/d65/d61/f92 [633248,23162] 0 2024-04-16T14:35:38.303 INFO:tasks.workunit.client.1.smithi115.stdout:2/466: read d0/d4/de/d11/d25/f30 [410308,23060] 0 2024-04-16T14:35:38.304 INFO:tasks.workunit.client.0.smithi005.stdout:7/738: dwrite d1/dc/d2f/f5a [0,4194304] 0 2024-04-16T14:35:38.305 INFO:tasks.workunit.client.1.smithi115.stdout:9/476: dwrite d1/d6/d2d/d4b/d90/fa0 [0,4194304] 0 2024-04-16T14:35:38.305 INFO:tasks.workunit.client.1.smithi115.stdout:7/366: dread d0/d2/d3a/d30/d6b/f75 [0,4194304] 0 2024-04-16T14:35:38.305 INFO:tasks.workunit.client.1.smithi115.stdout:0/307: mkdir d6/d10/d12/d1f/d36/d4b/d70 0 2024-04-16T14:35:38.306 INFO:tasks.workunit.client.1.smithi115.stdout:0/308: dread d6/d10/f40 [0,4194304] 0 2024-04-16T14:35:38.307 INFO:tasks.workunit.client.1.smithi115.stdout:2/467: unlink d0/d1b/f3d 0 2024-04-16T14:35:38.307 INFO:tasks.workunit.client.1.smithi115.stdout:2/468: dread - d0/d47/f8e zero size 2024-04-16T14:35:38.313 INFO:tasks.workunit.client.1.smithi115.stdout:7/367: mkdir d0/d1/d3b/d3f/d7a/d80/d81 0 2024-04-16T14:35:38.314 INFO:tasks.workunit.client.1.smithi115.stdout:0/309: mkdir d6/d10/d71 0 2024-04-16T14:35:38.315 INFO:tasks.workunit.client.1.smithi115.stdout:2/469: link d0/d1b/f4b d0/d4/d24/d23/d52/f9e 0 2024-04-16T14:35:38.317 INFO:tasks.workunit.client.0.smithi005.stdout:6/845: sync 2024-04-16T14:35:38.318 INFO:tasks.workunit.client.1.smithi115.stdout:9/477: rename d1/d6/d29/f5d to d1/d6/d2d/fa2 0 2024-04-16T14:35:38.319 INFO:tasks.workunit.client.0.smithi005.stdout:6/846: truncate d2/d5/d28/db8/fb9 2130173 0 2024-04-16T14:35:38.319 INFO:tasks.workunit.client.1.smithi115.stdout:7/368: mknod d0/d2/d3a/d30/d6b/c82 0 2024-04-16T14:35:38.319 INFO:tasks.workunit.client.1.smithi115.stdout:7/369: fsync d0/d1/d3b/d3f/f7b 0 2024-04-16T14:35:38.319 INFO:tasks.workunit.client.1.smithi115.stdout:7/370: truncate d0/d2/d3a/d30/f74 567859 0 2024-04-16T14:35:38.319 INFO:tasks.workunit.client.1.smithi115.stdout:7/371: fsync d0/fe 0 2024-04-16T14:35:38.319 INFO:tasks.workunit.client.1.smithi115.stdout:7/372: dread - d0/d1/d3b/d3f/f7b zero size 2024-04-16T14:35:38.320 INFO:tasks.workunit.client.1.smithi115.stdout:0/310: mknod d6/d10/d12/d31/c72 0 2024-04-16T14:35:38.320 INFO:tasks.workunit.client.1.smithi115.stdout:0/311: dread - d6/d10/d12/d31/d35/d28/f66 zero size 2024-04-16T14:35:38.329 INFO:tasks.workunit.client.1.smithi115.stdout:3/462: sync 2024-04-16T14:35:38.329 INFO:tasks.workunit.client.1.smithi115.stdout:4/407: sync 2024-04-16T14:35:38.329 INFO:tasks.workunit.client.1.smithi115.stdout:6/447: sync 2024-04-16T14:35:38.329 INFO:tasks.workunit.client.1.smithi115.stdout:3/463: fsync dc/d24/d33/d4b/d81/f95 0 2024-04-16T14:35:38.329 INFO:tasks.workunit.client.1.smithi115.stdout:8/407: sync 2024-04-16T14:35:38.329 INFO:tasks.workunit.client.1.smithi115.stdout:1/374: sync 2024-04-16T14:35:38.329 INFO:tasks.workunit.client.1.smithi115.stdout:5/361: sync 2024-04-16T14:35:38.330 INFO:tasks.workunit.client.1.smithi115.stdout:6/448: symlink d13/d1d/d2b/d5f/l93 0 2024-04-16T14:35:38.331 INFO:tasks.workunit.client.1.smithi115.stdout:4/408: symlink d1/d15/d31/d42/d46/l6a 0 2024-04-16T14:35:38.333 INFO:tasks.workunit.client.1.smithi115.stdout:4/409: read d1/d15/f58 [523416,107648] 0 2024-04-16T14:35:38.333 INFO:tasks.workunit.client.1.smithi115.stdout:4/410: creat d1/f6b x:0 0 0 2024-04-16T14:35:38.333 INFO:tasks.workunit.client.1.smithi115.stdout:4/411: truncate d1/d2/f8 4427724 0 2024-04-16T14:35:38.334 INFO:tasks.workunit.client.1.smithi115.stdout:8/408: rename d0/db/d10/d17/d2c/d52/d74/d3b/f3c to d0/db/d10/d17/d2c/d61/d6b/f7e 0 2024-04-16T14:35:38.336 INFO:tasks.workunit.client.1.smithi115.stdout:5/362: creat dc/d15/f78 x:0 0 0 2024-04-16T14:35:38.336 INFO:tasks.workunit.client.1.smithi115.stdout:5/363: chown l7 0 1 2024-04-16T14:35:38.337 INFO:tasks.workunit.client.1.smithi115.stdout:6/449: mknod d13/d1d/d47/c94 0 2024-04-16T14:35:38.337 INFO:tasks.workunit.client.1.smithi115.stdout:6/450: write d13/d1d/d2b/d46/f7d [921270,101835] 0 2024-04-16T14:35:38.339 INFO:tasks.workunit.client.1.smithi115.stdout:5/364: mkdir dc/d79 0 2024-04-16T14:35:38.340 INFO:tasks.workunit.client.1.smithi115.stdout:6/451: symlink d13/d1d/d2b/d46/d5a/d62/l95 0 2024-04-16T14:35:38.341 INFO:tasks.workunit.client.1.smithi115.stdout:5/365: fsync dc/d15/f5f 0 2024-04-16T14:35:38.343 INFO:tasks.workunit.client.1.smithi115.stdout:5/366: mknod dc/d79/c7a 0 2024-04-16T14:35:38.344 INFO:tasks.workunit.client.1.smithi115.stdout:5/367: readlink dc/d15/d2d/l50 0 2024-04-16T14:35:38.345 INFO:tasks.workunit.client.1.smithi115.stdout:5/368: chown dc/d15/c1d 563335 1 2024-04-16T14:35:38.346 INFO:tasks.workunit.client.1.smithi115.stdout:5/369: mkdir dc/d3d/d68/d7b 0 2024-04-16T14:35:38.348 INFO:tasks.workunit.client.1.smithi115.stdout:0/312: dread d6/d30/d4d/f4c [0,4194304] 0 2024-04-16T14:35:38.348 INFO:tasks.workunit.client.1.smithi115.stdout:0/313: getdents d6/d54/d57 0 2024-04-16T14:35:38.350 INFO:tasks.workunit.client.1.smithi115.stdout:0/314: creat d6/d10/d12/f73 x:0 0 0 2024-04-16T14:35:38.350 INFO:tasks.workunit.client.1.smithi115.stdout:0/315: chown d6/d10/d12/f14 21086 1 2024-04-16T14:35:38.350 INFO:tasks.workunit.client.1.smithi115.stdout:4/412: dread d1/f4 [0,4194304] 0 2024-04-16T14:35:38.351 INFO:tasks.workunit.client.1.smithi115.stdout:3/464: dread dc/d29/d4d/f59 [0,4194304] 0 2024-04-16T14:35:38.351 INFO:tasks.workunit.client.1.smithi115.stdout:3/465: truncate dc/d24/d36/d60/f78 110251 0 2024-04-16T14:35:38.351 INFO:tasks.workunit.client.1.smithi115.stdout:3/466: readlink dc/d29/d77/l7d 0 2024-04-16T14:35:38.352 INFO:tasks.workunit.client.1.smithi115.stdout:6/452: read d13/d1d/d2b/d46/d5a/f3b [3320580,40505] 0 2024-04-16T14:35:38.352 INFO:tasks.workunit.client.1.smithi115.stdout:3/467: truncate dc/f21 1470102 0 2024-04-16T14:35:38.353 INFO:tasks.workunit.client.1.smithi115.stdout:3/468: dread dc/d24/f6f [0,4194304] 0 2024-04-16T14:35:38.354 INFO:tasks.workunit.client.1.smithi115.stdout:3/469: write dc/f1a [1933359,81602] 0 2024-04-16T14:35:38.357 INFO:tasks.workunit.client.1.smithi115.stdout:6/453: rename d13/d1a to d13/d1d/d2b/d46/d5a/d62/d96 0 2024-04-16T14:35:38.358 INFO:tasks.workunit.client.1.smithi115.stdout:6/454: symlink d13/d1d/d2b/l97 0 2024-04-16T14:35:38.358 INFO:tasks.workunit.client.1.smithi115.stdout:5/370: dread f1 [12582912,4194304] 0 2024-04-16T14:35:38.359 INFO:tasks.workunit.client.1.smithi115.stdout:5/371: symlink dc/d3d/d68/l7c 0 2024-04-16T14:35:38.360 INFO:tasks.workunit.client.1.smithi115.stdout:5/372: mknod dc/d15/d2d/c7d 0 2024-04-16T14:35:38.367 INFO:tasks.workunit.client.0.smithi005.stdout:7/739: dwrite d1/dc/d2f/fa6 [0,4194304] 0 2024-04-16T14:35:38.367 INFO:tasks.workunit.client.0.smithi005.stdout:7/740: creat d1/d49/d74/d77/d22/da0/ff7 x:0 0 0 2024-04-16T14:35:38.367 INFO:tasks.workunit.client.0.smithi005.stdout:7/741: readlink d1/l41 0 2024-04-16T14:35:38.369 INFO:tasks.workunit.client.0.smithi005.stdout:7/742: mknod d1/d49/d74/d77/d22/d27/d3a/d5c/cf8 0 2024-04-16T14:35:38.369 INFO:tasks.workunit.client.0.smithi005.stdout:7/743: chown d1/d49/d74/d77/d57/fb7 823 1 2024-04-16T14:35:38.370 INFO:tasks.workunit.client.0.smithi005.stdout:8/644: sync 2024-04-16T14:35:38.370 INFO:tasks.workunit.client.0.smithi005.stdout:1/844: sync 2024-04-16T14:35:38.370 INFO:tasks.workunit.client.0.smithi005.stdout:2/430: sync 2024-04-16T14:35:38.370 INFO:tasks.workunit.client.0.smithi005.stdout:9/435: sync 2024-04-16T14:35:38.370 INFO:tasks.workunit.client.0.smithi005.stdout:0/583: sync 2024-04-16T14:35:38.370 INFO:tasks.workunit.client.0.smithi005.stdout:7/744: creat d1/d49/d74/d77/d22/d27/d2e/ff9 x:0 0 0 2024-04-16T14:35:38.371 INFO:tasks.workunit.client.1.smithi115.stdout:6/455: write d13/d1d/d2b/d46/d5a/d62/d96/f77 [31900,126482] 0 2024-04-16T14:35:38.371 INFO:tasks.workunit.client.1.smithi115.stdout:6/456: readlink d13/d1d/d52/l65 0 2024-04-16T14:35:38.371 INFO:tasks.workunit.client.1.smithi115.stdout:2/470: dwrite d0/d1b/f41 [0,4194304] 0 2024-04-16T14:35:38.371 INFO:tasks.workunit.client.1.smithi115.stdout:6/457: truncate fc 558128 0 2024-04-16T14:35:38.371 INFO:tasks.workunit.client.1.smithi115.stdout:2/471: truncate d0/d4/d24/d23/d71/f93 647276 0 2024-04-16T14:35:38.371 INFO:tasks.workunit.client.0.smithi005.stdout:8/645: mknod d5/d7b/da8/ce3 0 2024-04-16T14:35:38.372 INFO:tasks.workunit.client.0.smithi005.stdout:1/845: rename d2/d74/dd7/d11f/l38 to d2/d1c/d15/d2a/d19/dc9/l125 0 2024-04-16T14:35:38.372 INFO:tasks.workunit.client.0.smithi005.stdout:1/846: read d2/d74/dd7/f8f [2612404,22808] 0 2024-04-16T14:35:38.372 INFO:tasks.workunit.client.0.smithi005.stdout:1/847: fdatasync d2/d1c/f17 0 2024-04-16T14:35:38.373 INFO:tasks.workunit.client.0.smithi005.stdout:9/436: symlink d3/d49/d4b/d5c/l7d 0 2024-04-16T14:35:38.373 INFO:tasks.workunit.client.1.smithi115.stdout:2/472: symlink d0/d4/d24/d21/l9f 0 2024-04-16T14:35:38.374 INFO:tasks.workunit.client.1.smithi115.stdout:2/473: chown d0/d47/d65/d61/d70/f91 59045361 1 2024-04-16T14:35:38.374 INFO:tasks.workunit.client.1.smithi115.stdout:4/413: dread d1/f2d [4194304,4194304] 0 2024-04-16T14:35:38.374 INFO:tasks.workunit.client.0.smithi005.stdout:7/745: symlink d1/dc/lfa 0 2024-04-16T14:35:38.374 INFO:tasks.workunit.client.0.smithi005.stdout:8/646: readlink d5/d7b/da8/db7/d8a/da1/lbd 0 2024-04-16T14:35:38.376 INFO:tasks.workunit.client.0.smithi005.stdout:8/647: symlink d5/d7b/da8/db7/d8a/da1/d3d/d7f/le4 0 2024-04-16T14:35:38.376 INFO:tasks.workunit.client.0.smithi005.stdout:8/648: write d5/d7b/da8/db7/f5b [2020760,68321] 0 2024-04-16T14:35:38.378 INFO:tasks.workunit.client.1.smithi115.stdout:0/316: dread d6/d10/d12/d31/d35/d44/f50 [0,4194304] 0 2024-04-16T14:35:38.378 INFO:tasks.workunit.client.1.smithi115.stdout:4/414: rename d1/d2/f3c to d1/d15/d31/d42/d46/f6c 0 2024-04-16T14:35:38.379 INFO:tasks.workunit.client.0.smithi005.stdout:2/431: read d0/d4/f3c [1476714,90645] 0 2024-04-16T14:35:38.379 INFO:tasks.workunit.client.0.smithi005.stdout:8/649: mknod d5/d7b/da8/db7/d8a/da1/ce5 0 2024-04-16T14:35:38.381 INFO:tasks.workunit.client.0.smithi005.stdout:2/432: rmdir d0/d1c/d59 39 2024-04-16T14:35:38.384 INFO:tasks.workunit.client.0.smithi005.stdout:0/584: dread da/df/f1d [0,4194304] 0 2024-04-16T14:35:38.384 INFO:tasks.workunit.client.0.smithi005.stdout:0/585: truncate da/df/d1b/d3a/d53/fad 460024 0 2024-04-16T14:35:38.387 INFO:tasks.workunit.client.0.smithi005.stdout:0/586: mknod da/df/d1b/d3a/d53/d5a/d67/d79/cc1 0 2024-04-16T14:35:38.387 INFO:tasks.workunit.client.0.smithi005.stdout:0/587: creat da/df/d50/fc2 x:0 0 0 2024-04-16T14:35:38.388 INFO:tasks.workunit.client.1.smithi115.stdout:9/478: dwrite d1/d6/d2d/d4b/d60/f99 [0,4194304] 0 2024-04-16T14:35:38.392 INFO:tasks.workunit.client.1.smithi115.stdout:9/479: unlink d1/d6/d2d/d3d/f7c 0 2024-04-16T14:35:38.394 INFO:tasks.workunit.client.0.smithi005.stdout:0/588: mknod da/df/d1b/d3a/d53/d5a/d67/d79/cc3 0 2024-04-16T14:35:38.394 INFO:tasks.workunit.client.1.smithi115.stdout:9/480: symlink d1/d6/d33/la3 0 2024-04-16T14:35:38.395 INFO:tasks.workunit.client.0.smithi005.stdout:2/433: write d0/d29/f4c [779924,2939] 0 2024-04-16T14:35:38.396 INFO:tasks.workunit.client.0.smithi005.stdout:1/848: dread d2/d1c/d15/d2a/d19/d20/d27/fe7 [0,4194304] 0 2024-04-16T14:35:38.397 INFO:tasks.workunit.client.0.smithi005.stdout:1/849: readlink d2/d1c/l5e 0 2024-04-16T14:35:38.397 INFO:tasks.workunit.client.0.smithi005.stdout:1/850: chown d2/d1c/d15/d2a/d25/c33 27999480 1 2024-04-16T14:35:38.397 INFO:tasks.workunit.client.0.smithi005.stdout:1/851: fsync d2/d1c/d15/f8b 0 2024-04-16T14:35:38.397 INFO:tasks.workunit.client.1.smithi115.stdout:9/481: rename d1/f19 to d1/d6/d2d/d4b/d8f/fa4 0 2024-04-16T14:35:38.397 INFO:tasks.workunit.client.1.smithi115.stdout:9/482: creat d1/d6/d2d/d3d/fa5 x:0 0 0 2024-04-16T14:35:38.398 INFO:tasks.workunit.client.0.smithi005.stdout:2/434: mknod d0/c8f 0 2024-04-16T14:35:38.398 INFO:tasks.workunit.client.0.smithi005.stdout:2/435: read d0/d2a/d3a/d46/f4b [452513,88457] 0 2024-04-16T14:35:38.398 INFO:tasks.workunit.client.0.smithi005.stdout:2/436: fdatasync d0/d29/d3e/f8e 0 2024-04-16T14:35:38.398 INFO:tasks.workunit.client.0.smithi005.stdout:1/852: rmdir d2/d74/dd7/d11f 39 2024-04-16T14:35:38.400 INFO:tasks.workunit.client.0.smithi005.stdout:2/437: getdents d0/d1c/d59 0 2024-04-16T14:35:38.400 INFO:tasks.workunit.client.0.smithi005.stdout:2/438: write d0/d2a/d3a/f55 [528240,85988] 0 2024-04-16T14:35:38.400 INFO:tasks.workunit.client.1.smithi115.stdout:9/483: rename d1/d6/d2d/d4b/d6c/f46 to d1/d6/d2d/d4b/d6c/d20/fa6 0 2024-04-16T14:35:38.400 INFO:tasks.workunit.client.1.smithi115.stdout:9/484: write d1/d6/d2d/d4b/d8f/d91/f6e [2043727,102337] 0 2024-04-16T14:35:38.401 INFO:tasks.workunit.client.0.smithi005.stdout:1/853: creat d2/d74/dd7/d11f/d51/dc4/f126 x:0 0 0 2024-04-16T14:35:38.403 INFO:tasks.workunit.client.0.smithi005.stdout:2/439: rename d0/d29/d3e/f4f to d0/f90 0 2024-04-16T14:35:38.404 INFO:tasks.workunit.client.0.smithi005.stdout:1/854: mkdir d2/d1c/d127 0 2024-04-16T14:35:38.404 INFO:tasks.workunit.client.0.smithi005.stdout:1/855: write d2/d1c/d15/d2a/d19/d42/d64/fd2 [60481,113737] 0 2024-04-16T14:35:38.404 INFO:tasks.workunit.client.0.smithi005.stdout:1/856: creat d2/d1c/d15/d2a/d19/d42/d71/dac/d99/f128 x:0 0 0 2024-04-16T14:35:38.406 INFO:tasks.workunit.client.0.smithi005.stdout:1/857: symlink d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/dc5/dcd/l129 0 2024-04-16T14:35:38.408 INFO:tasks.workunit.client.0.smithi005.stdout:1/858: unlink d2/d2c/d85/lc2 0 2024-04-16T14:35:38.409 INFO:tasks.workunit.client.0.smithi005.stdout:1/859: mkdir d2/d1c/d12a 0 2024-04-16T14:35:38.414 INFO:tasks.workunit.client.1.smithi115.stdout:7/373: dwrite d0/d1/d3b/f4c [0,4194304] 0 2024-04-16T14:35:38.414 INFO:tasks.workunit.client.1.smithi115.stdout:1/375: dwrite f3 [0,4194304] 0 2024-04-16T14:35:38.414 INFO:tasks.workunit.client.1.smithi115.stdout:8/409: dwrite d0/db/d10/d17/f18 [0,4194304] 0 2024-04-16T14:35:38.415 INFO:tasks.workunit.client.0.smithi005.stdout:6/847: dwrite d2/d5/d10/f13 [0,4194304] 0 2024-04-16T14:35:38.416 INFO:tasks.workunit.client.1.smithi115.stdout:1/376: chown df/d13/d4d/d2c 35 1 2024-04-16T14:35:38.416 INFO:tasks.workunit.client.1.smithi115.stdout:1/377: creat df/d13/d3a/f7b x:0 0 0 2024-04-16T14:35:38.417 INFO:tasks.workunit.client.1.smithi115.stdout:7/374: symlink d0/d1/d3b/d3f/d7a/d80/l83 0 2024-04-16T14:35:38.419 INFO:tasks.workunit.client.1.smithi115.stdout:1/378: fsync df/f25 0 2024-04-16T14:35:38.420 INFO:tasks.workunit.client.1.smithi115.stdout:7/375: rename d0/d1/d3b/f7f to d0/d2/d3a/d30/d6b/f84 0 2024-04-16T14:35:38.428 INFO:tasks.workunit.client.0.smithi005.stdout:0/589: write da/f1a [1093475,119600] 0 2024-04-16T14:35:38.428 INFO:tasks.workunit.client.0.smithi005.stdout:0/590: readlink da/df/d1b/d3a/d53/d5a/d67/l70 0 2024-04-16T14:35:38.436 INFO:tasks.workunit.client.1.smithi115.stdout:1/379: write df/d13/f16 [609388,11696] 0 2024-04-16T14:35:38.437 INFO:tasks.workunit.client.1.smithi115.stdout:1/380: chown df/c29 1416747 1 2024-04-16T14:35:38.438 INFO:tasks.workunit.client.1.smithi115.stdout:1/381: mknod df/d13/d4d/d68/c7c 0 2024-04-16T14:35:38.439 INFO:tasks.workunit.client.1.smithi115.stdout:1/382: mkdir df/d13/d4d/d3e/d7d 0 2024-04-16T14:35:38.439 INFO:tasks.workunit.client.1.smithi115.stdout:1/383: fdatasync df/d13/f59 0 2024-04-16T14:35:38.440 INFO:tasks.workunit.client.0.smithi005.stdout:1/860: read d2/d1c/d15/d2a/d19/d42/d64/f7e [3573920,124993] 0 2024-04-16T14:35:38.440 INFO:tasks.workunit.client.0.smithi005.stdout:1/861: creat d2/d1c/d15/d2a/d19/f12b x:0 0 0 2024-04-16T14:35:38.440 INFO:tasks.workunit.client.0.smithi005.stdout:1/862: fsync d2/d1c/d15/d2a/d19/d42/d71/dac/fa1 0 2024-04-16T14:35:38.440 INFO:tasks.workunit.client.1.smithi115.stdout:1/384: creat df/d13/d4d/d3e/d75/f7e x:0 0 0 2024-04-16T14:35:38.440 INFO:tasks.workunit.client.1.smithi115.stdout:1/385: creat df/f7f x:0 0 0 2024-04-16T14:35:38.443 INFO:tasks.workunit.client.1.smithi115.stdout:1/386: link df/d36/f5f df/d13/d4d/d68/f80 0 2024-04-16T14:35:38.443 INFO:tasks.workunit.client.1.smithi115.stdout:8/410: dread d0/db/d10/d17/d2c/d61/d6b/f7e [0,4194304] 0 2024-04-16T14:35:38.445 INFO:tasks.workunit.client.1.smithi115.stdout:1/387: unlink df/d13/d4d/d2c/f4a 0 2024-04-16T14:35:38.449 INFO:tasks.workunit.client.1.smithi115.stdout:6/458: dwrite d13/f5e [0,4194304] 0 2024-04-16T14:35:38.449 INFO:tasks.workunit.client.1.smithi115.stdout:6/459: read - d13/d1d/d2b/d46/d5a/f73 zero size 2024-04-16T14:35:38.451 INFO:tasks.workunit.client.1.smithi115.stdout:7/376: write d0/d2/d3a/d30/d6b/f75 [5982974,98611] 0 2024-04-16T14:35:38.453 INFO:tasks.workunit.client.1.smithi115.stdout:6/460: unlink d13/d1d/d2b/d46/d5a/f73 0 2024-04-16T14:35:38.455 INFO:tasks.workunit.client.1.smithi115.stdout:6/461: creat d13/d1d/d52/d8c/f98 x:0 0 0 2024-04-16T14:35:38.456 INFO:tasks.workunit.client.1.smithi115.stdout:6/462: mknod d13/d1d/d2b/d5f/d30/d43/c99 0 2024-04-16T14:35:38.456 INFO:tasks.workunit.client.1.smithi115.stdout:5/373: dwrite dc/d15/d35/f48 [0,4194304] 0 2024-04-16T14:35:38.458 INFO:tasks.workunit.client.1.smithi115.stdout:6/463: unlink d13/d1d/d2b/f82 0 2024-04-16T14:35:38.462 INFO:tasks.workunit.client.1.smithi115.stdout:7/377: write d0/d1/d3b/d3e/f5c [3034707,94502] 0 2024-04-16T14:35:38.462 INFO:tasks.workunit.client.1.smithi115.stdout:5/374: chown dc/d15/l25 23331 1 2024-04-16T14:35:38.467 INFO:tasks.workunit.client.1.smithi115.stdout:6/464: dread d13/d1d/d2b/d46/d5a/f3b [0,4194304] 0 2024-04-16T14:35:38.472 INFO:tasks.workunit.client.1.smithi115.stdout:7/378: dread d0/d2/d3a/d30/f32 [0,4194304] 0 2024-04-16T14:35:38.472 INFO:tasks.workunit.client.1.smithi115.stdout:7/379: creat d0/d24/d40/f85 x:0 0 0 2024-04-16T14:35:38.472 INFO:tasks.workunit.client.1.smithi115.stdout:7/380: chown d0/d1/d3b/d49/f4d 0 1 2024-04-16T14:35:38.472 INFO:tasks.workunit.client.1.smithi115.stdout:7/381: creat d0/d2/d3a/d73/f86 x:0 0 0 2024-04-16T14:35:38.473 INFO:tasks.workunit.client.1.smithi115.stdout:0/317: dwrite d6/d10/d12/d31/d35/d28/f66 [0,4194304] 0 2024-04-16T14:35:38.473 INFO:tasks.workunit.client.0.smithi005.stdout:9/437: dwrite d3/d12/f6c [0,4194304] 0 2024-04-16T14:35:38.474 INFO:tasks.workunit.client.0.smithi005.stdout:9/438: creat d3/d12/d16/f7e x:0 0 0 2024-04-16T14:35:38.475 INFO:tasks.workunit.client.0.smithi005.stdout:9/439: readlink d3/d12/d16/d46/l62 0 2024-04-16T14:35:38.475 INFO:tasks.workunit.client.1.smithi115.stdout:5/375: chown dc/d15/l28 15 1 2024-04-16T14:35:38.475 INFO:tasks.workunit.client.1.smithi115.stdout:5/376: creat dc/d3d/f7e x:0 0 0 2024-04-16T14:35:38.478 INFO:tasks.workunit.client.1.smithi115.stdout:4/415: dwrite d1/d15/d31/d42/d46/f6c [0,4194304] 0 2024-04-16T14:35:38.479 INFO:tasks.workunit.client.0.smithi005.stdout:8/650: dwrite d5/d11/d6c/fd7 [0,4194304] 0 2024-04-16T14:35:38.479 INFO:tasks.workunit.client.0.smithi005.stdout:7/746: dwrite d1/d82/fcf [0,4194304] 0 2024-04-16T14:35:38.479 INFO:tasks.workunit.client.0.smithi005.stdout:2/440: dwrite d0/d1c/d59/f5a [0,4194304] 0 2024-04-16T14:35:38.479 INFO:tasks.workunit.client.1.smithi115.stdout:7/382: creat d0/d2/d3a/d30/d6b/f87 x:0 0 0 2024-04-16T14:35:38.480 INFO:tasks.workunit.client.1.smithi115.stdout:2/474: dwrite d0/d47/f7f [0,4194304] 0 2024-04-16T14:35:38.484 INFO:tasks.workunit.client.0.smithi005.stdout:7/747: creat d1/d49/d74/d77/ffb x:0 0 0 2024-04-16T14:35:38.484 INFO:tasks.workunit.client.0.smithi005.stdout:7/748: chown d1/d49/d74/ddf 2 1 2024-04-16T14:35:38.484 INFO:tasks.workunit.client.0.smithi005.stdout:7/749: chown d1/d49/f6b 110 1 2024-04-16T14:35:38.484 INFO:tasks.workunit.client.0.smithi005.stdout:7/750: dread - d1/d49/d74/d77/d57/fb7 zero size 2024-04-16T14:35:38.486 INFO:tasks.workunit.client.0.smithi005.stdout:5/668: sync 2024-04-16T14:35:38.486 INFO:tasks.workunit.client.0.smithi005.stdout:4/905: sync 2024-04-16T14:35:38.487 INFO:tasks.workunit.client.0.smithi005.stdout:1/863: dwrite d2/d74/dd7/f68 [0,4194304] 0 2024-04-16T14:35:38.487 INFO:tasks.workunit.client.1.smithi115.stdout:0/318: link d6/d54/d57/c5d d6/d10/d12/d5f/c74 0 2024-04-16T14:35:38.487 INFO:tasks.workunit.client.1.smithi115.stdout:0/319: chown d6/d1b/d4e/c68 513757467 1 2024-04-16T14:35:38.488 INFO:tasks.workunit.client.0.smithi005.stdout:2/441: mknod d0/c91 0 2024-04-16T14:35:38.488 INFO:tasks.workunit.client.0.smithi005.stdout:0/591: dread da/df/d1b/d24/f90 [0,4194304] 0 2024-04-16T14:35:38.488 INFO:tasks.workunit.client.0.smithi005.stdout:0/592: chown da/df/d1b/d24/d75/l88 6 1 2024-04-16T14:35:38.488 INFO:tasks.workunit.client.0.smithi005.stdout:8/651: mkdir d5/d7b/da8/db7/de6 0 2024-04-16T14:35:38.489 INFO:tasks.workunit.client.1.smithi115.stdout:1/388: dwrite df/f12 [0,4194304] 0 2024-04-16T14:35:38.490 INFO:tasks.workunit.client.1.smithi115.stdout:8/411: dwrite d0/db/d10/d17/d2c/d52/d74/f45 [0,4194304] 0 2024-04-16T14:35:38.490 INFO:tasks.workunit.client.1.smithi115.stdout:6/465: dwrite d13/d1d/d49/f8d [0,4194304] 0 2024-04-16T14:35:38.490 INFO:tasks.workunit.client.1.smithi115.stdout:6/466: stat d13/d1d/d2b/d46/d5a/d62/d96/f77 0 2024-04-16T14:35:38.492 INFO:tasks.workunit.client.1.smithi115.stdout:5/377: link dc/f1c dc/d3d/f7f 0 2024-04-16T14:35:38.493 INFO:tasks.workunit.client.1.smithi115.stdout:5/378: write dc/f56 [1024912,109289] 0 2024-04-16T14:35:38.493 INFO:tasks.workunit.client.0.smithi005.stdout:7/751: unlink d1/d82/f76 0 2024-04-16T14:35:38.493 INFO:tasks.workunit.client.0.smithi005.stdout:7/752: fdatasync d1/d49/d74/f97 0 2024-04-16T14:35:38.494 INFO:tasks.workunit.client.0.smithi005.stdout:5/669: rename d0/d6/d12/dc0/l33 to d0/d6/d12/dc0/le3 0 2024-04-16T14:35:38.495 INFO:tasks.workunit.client.0.smithi005.stdout:4/906: mkdir d0/df8/d120 0 2024-04-16T14:35:38.495 INFO:tasks.workunit.client.0.smithi005.stdout:4/907: readlink d0/d1b/d1d/d1f/d48/l70 0 2024-04-16T14:35:38.496 INFO:tasks.workunit.client.1.smithi115.stdout:2/475: unlink d0/d4/de/d11/d25/f30 0 2024-04-16T14:35:38.497 INFO:tasks.workunit.client.0.smithi005.stdout:1/864: symlink d2/d1c/d15/d2a/d19/d6e/l12c 0 2024-04-16T14:35:38.501 INFO:tasks.workunit.client.0.smithi005.stdout:2/442: unlink d0/d1c/d39/f68 0 2024-04-16T14:35:38.502 INFO:tasks.workunit.client.1.smithi115.stdout:6/467: creat d13/d1d/d68/f9a x:0 0 0 2024-04-16T14:35:38.502 INFO:tasks.workunit.client.0.smithi005.stdout:0/593: mknod da/cc4 0 2024-04-16T14:35:38.503 INFO:tasks.workunit.client.0.smithi005.stdout:8/652: mkdir d5/d7b/da8/db7/d8a/da1/d3d/d7f/de7 0 2024-04-16T14:35:38.503 INFO:tasks.workunit.client.1.smithi115.stdout:5/379: symlink dc/d15/d35/d71/l80 0 2024-04-16T14:35:38.505 INFO:tasks.workunit.client.0.smithi005.stdout:7/753: creat d1/d49/d74/d77/d22/db0/dc6/ffc x:0 0 0 2024-04-16T14:35:38.505 INFO:tasks.workunit.client.0.smithi005.stdout:7/754: fsync d1/d49/d74/d77/d57/fb7 0 2024-04-16T14:35:38.505 INFO:tasks.workunit.client.0.smithi005.stdout:3/646: sync 2024-04-16T14:35:38.506 INFO:tasks.workunit.client.1.smithi115.stdout:9/485: getdents d1/d6/d2d/d4b/d6c 0 2024-04-16T14:35:38.506 INFO:tasks.workunit.client.1.smithi115.stdout:9/486: chown d1/d6/d29/f32 749744 1 2024-04-16T14:35:38.506 INFO:tasks.workunit.client.1.smithi115.stdout:9/487: fdatasync d1/d6/d2d/d4b/d8f/d91/f6a 0 2024-04-16T14:35:38.506 INFO:tasks.workunit.client.1.smithi115.stdout:9/488: stat d1/d6/d2d/d4b/d8f/d91/f58 0 2024-04-16T14:35:38.506 INFO:tasks.workunit.client.1.smithi115.stdout:9/489: fsync d1/d6/d29/f7a 0 2024-04-16T14:35:38.506 INFO:tasks.workunit.client.1.smithi115.stdout:9/490: readlink d1/d6/d29/l34 0 2024-04-16T14:35:38.506 INFO:tasks.workunit.client.0.smithi005.stdout:1/865: getdents d2/d1c/d15/d6f 0 2024-04-16T14:35:38.507 INFO:tasks.workunit.client.1.smithi115.stdout:4/416: rmdir d1 39 2024-04-16T14:35:38.508 INFO:tasks.workunit.client.0.smithi005.stdout:2/443: creat d0/d1c/d59/f92 x:0 0 0 2024-04-16T14:35:38.508 INFO:tasks.workunit.client.0.smithi005.stdout:2/444: readlink d0/d1c/l38 0 2024-04-16T14:35:38.508 INFO:tasks.workunit.client.0.smithi005.stdout:2/445: dread - d0/d4/d2b/d5e/f79 zero size 2024-04-16T14:35:38.508 INFO:tasks.workunit.client.0.smithi005.stdout:2/446: truncate d0/d4/f3b 821973 0 2024-04-16T14:35:38.509 INFO:tasks.workunit.client.0.smithi005.stdout:0/594: creat da/df/d1b/d3a/d53/d5a/d99/fc5 x:0 0 0 2024-04-16T14:35:38.509 INFO:tasks.workunit.client.0.smithi005.stdout:0/595: stat f0 0 2024-04-16T14:35:38.509 INFO:tasks.workunit.client.0.smithi005.stdout:0/596: creat da/df/d1b/d3a/d53/d5a/d99/fc6 x:0 0 0 2024-04-16T14:35:38.510 INFO:tasks.workunit.client.1.smithi115.stdout:2/476: unlink d0/d47/d65/d61/d70/f85 0 2024-04-16T14:35:38.510 INFO:tasks.workunit.client.0.smithi005.stdout:7/755: creat d1/d85/d96/de1/ffd x:0 0 0 2024-04-16T14:35:38.511 INFO:tasks.workunit.client.0.smithi005.stdout:8/653: write d5/d11/f4a [1132065,66786] 0 2024-04-16T14:35:38.511 INFO:tasks.workunit.client.0.smithi005.stdout:8/654: stat d5/d7b/da8/db7/d8a/da1/d3d/d7f 0 2024-04-16T14:35:38.511 INFO:tasks.workunit.client.0.smithi005.stdout:3/647: mknod d2/d9/d51/cd3 0 2024-04-16T14:35:38.512 INFO:tasks.workunit.client.0.smithi005.stdout:4/908: mknod d0/d1b/d1d/d1f/d3e/c121 0 2024-04-16T14:35:38.512 INFO:tasks.workunit.client.1.smithi115.stdout:1/389: unlink df/f11 0 2024-04-16T14:35:38.512 INFO:tasks.workunit.client.1.smithi115.stdout:1/390: write df/d35/f39 [1434259,35314] 0 2024-04-16T14:35:38.513 INFO:tasks.workunit.client.1.smithi115.stdout:8/412: dread d0/db/f26 [0,4194304] 0 2024-04-16T14:35:38.514 INFO:tasks.workunit.client.1.smithi115.stdout:6/468: mknod d13/d1d/d68/c9b 0 2024-04-16T14:35:38.514 INFO:tasks.workunit.client.1.smithi115.stdout:6/469: read - d13/d1d/d87/f79 zero size 2024-04-16T14:35:38.514 INFO:tasks.workunit.client.0.smithi005.stdout:1/866: unlink d2/d1c/d15/d2a/d19/d42/d64/c11a 0 2024-04-16T14:35:38.515 INFO:tasks.workunit.client.1.smithi115.stdout:5/380: mkdir dc/d5d/d81 0 2024-04-16T14:35:38.515 INFO:tasks.workunit.client.1.smithi115.stdout:5/381: chown dc/d15/d2d/c63 0 1 2024-04-16T14:35:38.515 INFO:tasks.workunit.client.1.smithi115.stdout:5/382: fsync dc/f11 0 2024-04-16T14:35:38.516 INFO:tasks.workunit.client.0.smithi005.stdout:2/447: symlink d0/d1c/d59/d67/l93 0 2024-04-16T14:35:38.516 INFO:tasks.workunit.client.0.smithi005.stdout:2/448: chown d0/d1c/d59/f92 211 1 2024-04-16T14:35:38.516 INFO:tasks.workunit.client.0.smithi005.stdout:8/655: dread d5/d11/f45 [0,4194304] 0 2024-04-16T14:35:38.516 INFO:tasks.workunit.client.0.smithi005.stdout:0/597: dread da/df/f1d [0,4194304] 0 2024-04-16T14:35:38.516 INFO:tasks.workunit.client.0.smithi005.stdout:0/598: truncate da/df/d1b/d71/fa0 570703 0 2024-04-16T14:35:38.516 INFO:tasks.workunit.client.0.smithi005.stdout:0/599: fdatasync da/df/d26/f45 0 2024-04-16T14:35:38.516 INFO:tasks.workunit.client.0.smithi005.stdout:0/600: stat da/df/d26/d8e 0 2024-04-16T14:35:38.517 INFO:tasks.workunit.client.1.smithi115.stdout:4/417: mknod d1/d15/d17/c6d 0 2024-04-16T14:35:38.517 INFO:tasks.workunit.client.1.smithi115.stdout:2/477: mkdir d0/d4/d24/da0 0 2024-04-16T14:35:38.518 INFO:tasks.workunit.client.1.smithi115.stdout:9/491: dread d1/d6/d2d/d3d/d50/f5e [0,4194304] 0 2024-04-16T14:35:38.519 INFO:tasks.workunit.client.0.smithi005.stdout:7/756: creat d1/d49/d74/d77/d22/d27/d3a/ffe x:0 0 0 2024-04-16T14:35:38.521 INFO:tasks.workunit.client.1.smithi115.stdout:8/413: mkdir d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f 0 2024-04-16T14:35:38.521 INFO:tasks.workunit.client.0.smithi005.stdout:1/867: creat d2/d1c/d15/d2a/d19/d20/d27/d73/f12d x:0 0 0 2024-04-16T14:35:38.522 INFO:tasks.workunit.client.0.smithi005.stdout:5/670: dwrite d0/fb4 [0,4194304] 0 2024-04-16T14:35:38.523 INFO:tasks.workunit.client.0.smithi005.stdout:2/449: mkdir d0/d2a/d3a/d94 0 2024-04-16T14:35:38.523 INFO:tasks.workunit.client.0.smithi005.stdout:2/450: creat d0/d2a/d3a/f95 x:0 0 0 2024-04-16T14:35:38.523 INFO:tasks.workunit.client.0.smithi005.stdout:2/451: creat d0/d2a/d3a/f96 x:0 0 0 2024-04-16T14:35:38.525 INFO:tasks.workunit.client.0.smithi005.stdout:8/656: mknod d5/d11/d6c/d71/ce8 0 2024-04-16T14:35:38.525 INFO:tasks.workunit.client.1.smithi115.stdout:0/320: dwrite d6/d10/d12/d31/d35/d28/f5b [0,4194304] 0 2024-04-16T14:35:38.525 INFO:tasks.workunit.client.1.smithi115.stdout:7/383: dwrite d0/d24/d40/f44 [0,4194304] 0 2024-04-16T14:35:38.525 INFO:tasks.workunit.client.1.smithi115.stdout:7/384: dread - d0/d24/d40/f85 zero size 2024-04-16T14:35:38.525 INFO:tasks.workunit.client.1.smithi115.stdout:6/470: truncate d13/d1d/d2b/d46/d5a/f3c 405341 0 2024-04-16T14:35:38.526 INFO:tasks.workunit.client.0.smithi005.stdout:9/440: dwrite d3/d12/d16/f39 [0,4194304] 0 2024-04-16T14:35:38.526 INFO:tasks.workunit.client.0.smithi005.stdout:9/441: chown d3/f14 228484609 1 2024-04-16T14:35:38.526 INFO:tasks.workunit.client.0.smithi005.stdout:9/442: write d3/f14 [350003,44367] 0 2024-04-16T14:35:38.526 INFO:tasks.workunit.client.1.smithi115.stdout:4/418: dread d1/f2d [0,4194304] 0 2024-04-16T14:35:38.527 INFO:tasks.workunit.client.0.smithi005.stdout:0/601: rename da/df/d26/d39/d55/lb5 to da/df/d1b/d3a/d53/d5a/d99/lc7 0 2024-04-16T14:35:38.527 INFO:tasks.workunit.client.1.smithi115.stdout:5/383: rename dc/fe to dc/d3d/d41/f82 0 2024-04-16T14:35:38.531 INFO:tasks.workunit.client.0.smithi005.stdout:2/452: creat d0/d2a/f97 x:0 0 0 2024-04-16T14:35:38.531 INFO:tasks.workunit.client.1.smithi115.stdout:9/492: rmdir d1/d6/d2d/d3d/d49/d98 39 2024-04-16T14:35:38.532 INFO:tasks.workunit.client.1.smithi115.stdout:9/493: truncate d1/d6/d2d/d4b/d6c/d20/d36/f9f 804237 0 2024-04-16T14:35:38.533 INFO:tasks.workunit.client.0.smithi005.stdout:0/602: rmdir da/df/d1b/d24/d75 39 2024-04-16T14:35:38.535 INFO:tasks.workunit.client.1.smithi115.stdout:1/391: mkdir df/d2d/d81 0 2024-04-16T14:35:38.535 INFO:tasks.workunit.client.1.smithi115.stdout:6/471: dread d13/d1d/d2b/d46/d5a/f3b [0,4194304] 0 2024-04-16T14:35:38.535 INFO:tasks.workunit.client.1.smithi115.stdout:6/472: write d13/d1d/d49/f6e [705404,62843] 0 2024-04-16T14:35:38.537 INFO:tasks.workunit.client.0.smithi005.stdout:8/657: link d5/f23 d5/d7b/da8/db7/d8a/da1/fe9 0 2024-04-16T14:35:38.537 INFO:tasks.workunit.client.0.smithi005.stdout:8/658: fdatasync d5/d7b/da8/db7/d74/fd6 0 2024-04-16T14:35:38.539 INFO:tasks.workunit.client.0.smithi005.stdout:8/659: truncate d5/d7b/da8/db7/d8a/f91 2274679 0 2024-04-16T14:35:38.539 INFO:tasks.workunit.client.0.smithi005.stdout:8/660: write d5/d11/f67 [653558,72437] 0 2024-04-16T14:35:38.541 INFO:tasks.workunit.client.1.smithi115.stdout:9/494: dread d1/d6/f3e [0,4194304] 0 2024-04-16T14:35:38.541 INFO:tasks.workunit.client.0.smithi005.stdout:3/648: dwrite d2/d9/d25/f91 [0,4194304] 0 2024-04-16T14:35:38.542 INFO:tasks.workunit.client.0.smithi005.stdout:8/661: creat d5/d7b/da8/db7/d8a/da1/d68/dcb/dd9/fea x:0 0 0 2024-04-16T14:35:38.542 INFO:tasks.workunit.client.0.smithi005.stdout:8/662: dread - d5/d11/d6c/faa zero size 2024-04-16T14:35:38.543 INFO:tasks.workunit.client.0.smithi005.stdout:8/663: creat d5/d7b/da8/db7/d74/feb x:0 0 0 2024-04-16T14:35:38.543 INFO:tasks.workunit.client.0.smithi005.stdout:8/664: chown d5/d9b/l9c 52194697 1 2024-04-16T14:35:38.545 INFO:tasks.workunit.client.0.smithi005.stdout:3/649: mknod d2/d9/d25/d39/d9c/cd4 0 2024-04-16T14:35:38.547 INFO:tasks.workunit.client.0.smithi005.stdout:1/868: dread d2/d1c/d15/d2a/f16 [0,4194304] 0 2024-04-16T14:35:38.547 INFO:tasks.workunit.client.0.smithi005.stdout:1/869: write d2/d74/d7a/d100/f116 [449392,70086] 0 2024-04-16T14:35:38.549 INFO:tasks.workunit.client.0.smithi005.stdout:3/650: mkdir d2/d17/d46/d75/d6d/dd5 0 2024-04-16T14:35:38.549 INFO:tasks.workunit.client.0.smithi005.stdout:3/651: stat d2/d17/f76 0 2024-04-16T14:35:38.550 INFO:tasks.workunit.client.0.smithi005.stdout:5/671: dread d0/d6/f36 [0,4194304] 0 2024-04-16T14:35:38.551 INFO:tasks.workunit.client.0.smithi005.stdout:3/652: creat d2/d17/d46/d75/d9b/dbd/fd6 x:0 0 0 2024-04-16T14:35:38.551 INFO:tasks.workunit.client.0.smithi005.stdout:3/653: fsync d2/d6b/f99 0 2024-04-16T14:35:38.552 INFO:tasks.workunit.client.1.smithi115.stdout:7/385: link d0/d2/d3a/d30/d6b/c82 d0/d2/d3a/d73/c88 0 2024-04-16T14:35:38.552 INFO:tasks.workunit.client.1.smithi115.stdout:7/386: chown d0/d1/f20 0 1 2024-04-16T14:35:38.552 INFO:tasks.workunit.client.1.smithi115.stdout:7/387: creat d0/d1/d3b/d3e/f89 x:0 0 0 2024-04-16T14:35:38.552 INFO:tasks.workunit.client.0.smithi005.stdout:0/603: dread da/df/d1b/d3a/d53/f61 [0,4194304] 0 2024-04-16T14:35:38.553 INFO:tasks.workunit.client.0.smithi005.stdout:0/604: write da/df/d1b/d3a/d53/d5a/d99/fc5 [128693,83328] 0 2024-04-16T14:35:38.553 INFO:tasks.workunit.client.0.smithi005.stdout:0/605: truncate da/df/d1b/d3a/f3b 6181891 0 2024-04-16T14:35:38.554 INFO:tasks.workunit.client.1.smithi115.stdout:0/321: rename d6/d10/d12/d31/c72 to d6/d10/d12/d1f/c75 0 2024-04-16T14:35:38.555 INFO:tasks.workunit.client.0.smithi005.stdout:9/443: write d3/d12/f28 [499876,117843] 0 2024-04-16T14:35:38.555 INFO:tasks.workunit.client.0.smithi005.stdout:9/444: truncate d3/d12/d16/f7e 234132 0 2024-04-16T14:35:38.555 INFO:tasks.workunit.client.0.smithi005.stdout:9/445: readlink d3/l29 0 2024-04-16T14:35:38.555 INFO:tasks.workunit.client.0.smithi005.stdout:5/672: rename d0/d6/d12/d1c/d1e/d73/dba to d0/d6/d12/de4 0 2024-04-16T14:35:38.555 INFO:tasks.workunit.client.1.smithi115.stdout:6/473: symlink d13/d1d/d2b/d46/d5a/d62/l9c 0 2024-04-16T14:35:38.555 INFO:tasks.workunit.client.1.smithi115.stdout:6/474: chown d13/d1d/d2b/d46/d63/l86 402 1 2024-04-16T14:35:38.560 INFO:tasks.workunit.client.0.smithi005.stdout:0/606: symlink da/df/d26/d8e/lc8 0 2024-04-16T14:35:38.560 INFO:tasks.workunit.client.1.smithi115.stdout:7/388: truncate d0/d1/d3b/f4c 3289910 0 2024-04-16T14:35:38.560 INFO:tasks.workunit.client.1.smithi115.stdout:7/389: chown d0/d2/c38 13918162 1 2024-04-16T14:35:38.562 INFO:tasks.workunit.client.0.smithi005.stdout:9/446: link d3/d49/d4b/d5c/l7d d3/d49/d4b/l7f 0 2024-04-16T14:35:38.563 INFO:tasks.workunit.client.1.smithi115.stdout:0/322: link f0 d6/d10/d12/d1f/d36/d4b/d6d/f76 0 2024-04-16T14:35:38.563 INFO:tasks.workunit.client.1.smithi115.stdout:0/323: stat d6/d10/d12/d31/d35/d44/f50 0 2024-04-16T14:35:38.564 INFO:tasks.workunit.client.1.smithi115.stdout:9/495: mknod d1/ca7 0 2024-04-16T14:35:38.565 INFO:tasks.workunit.client.0.smithi005.stdout:0/607: symlink da/df/lc9 0 2024-04-16T14:35:38.565 INFO:tasks.workunit.client.0.smithi005.stdout:0/608: stat da/df/d26/d39/d55/f5e 0 2024-04-16T14:35:38.565 INFO:tasks.workunit.client.0.smithi005.stdout:0/609: readlink da/df/d26/d39/d55/d5c/da8/lb1 0 2024-04-16T14:35:38.565 INFO:tasks.workunit.client.0.smithi005.stdout:0/610: fsync da/df/d50/f63 0 2024-04-16T14:35:38.567 INFO:tasks.workunit.client.0.smithi005.stdout:9/447: mknod d3/d12/c80 0 2024-04-16T14:35:38.567 INFO:tasks.workunit.client.0.smithi005.stdout:9/448: chown d3/d12/d16/l40 73664608 1 2024-04-16T14:35:38.567 INFO:tasks.workunit.client.0.smithi005.stdout:9/449: chown d3/f14 58 1 2024-04-16T14:35:38.568 INFO:tasks.workunit.client.0.smithi005.stdout:9/450: write d3/d12/f3e [1445437,91728] 0 2024-04-16T14:35:38.568 INFO:tasks.workunit.client.0.smithi005.stdout:0/611: mknod da/d7c/cca 0 2024-04-16T14:35:38.570 INFO:tasks.workunit.client.1.smithi115.stdout:0/324: link d6/d10/f40 d6/d10/d12/d31/d35/d28/f77 0 2024-04-16T14:35:38.571 INFO:tasks.workunit.client.0.smithi005.stdout:9/451: creat d3/f81 x:0 0 0 2024-04-16T14:35:38.571 INFO:tasks.workunit.client.0.smithi005.stdout:9/452: fsync d3/d12/d16/f7e 0 2024-04-16T14:35:38.571 INFO:tasks.workunit.client.1.smithi115.stdout:8/414: dwrite d0/db/d10/d17/d2c/d52/d74/f35 [0,4194304] 0 2024-04-16T14:35:38.574 INFO:tasks.workunit.client.0.smithi005.stdout:0/612: mkdir da/df/d26/da9/dcb 0 2024-04-16T14:35:38.574 INFO:tasks.workunit.client.1.smithi115.stdout:0/325: mkdir d6/d10/d12/d1f/d36/d78 0 2024-04-16T14:35:38.577 INFO:tasks.workunit.client.0.smithi005.stdout:9/453: link d3/d12/d2b/f72 d3/d77/f82 0 2024-04-16T14:35:38.577 INFO:tasks.workunit.client.0.smithi005.stdout:9/454: chown d3/d49/d4b/d5c/d65/c7a 427489458 1 2024-04-16T14:35:38.580 INFO:tasks.workunit.client.0.smithi005.stdout:0/613: creat da/df/d1b/d3a/d53/fcc x:0 0 0 2024-04-16T14:35:38.580 INFO:tasks.workunit.client.1.smithi115.stdout:4/419: dwrite d1/d15/d31/f44 [0,4194304] 0 2024-04-16T14:35:38.580 INFO:tasks.workunit.client.1.smithi115.stdout:4/420: fdatasync d1/d15/d24/f40 0 2024-04-16T14:35:38.582 INFO:tasks.workunit.client.1.smithi115.stdout:1/392: dwrite f3 [0,4194304] 0 2024-04-16T14:35:38.582 INFO:tasks.workunit.client.1.smithi115.stdout:1/393: readlink df/d13/d4d/l66 0 2024-04-16T14:35:38.583 INFO:tasks.workunit.client.1.smithi115.stdout:5/384: dwrite dc/d15/d35/d69/f72 [12582912,4194304] 0 2024-04-16T14:35:38.583 INFO:tasks.workunit.client.1.smithi115.stdout:5/385: readlink dc/d15/d35/l4e 0 2024-04-16T14:35:38.583 INFO:tasks.workunit.client.0.smithi005.stdout:0/614: rmdir da/df/d26/d39/d55/d5c 39 2024-04-16T14:35:38.584 INFO:tasks.workunit.client.0.smithi005.stdout:0/615: read da/df/d1b/d3a/d53/d5a/d67/f8d [385353,124638] 0 2024-04-16T14:35:38.584 INFO:tasks.workunit.client.0.smithi005.stdout:0/616: fsync da/df/d1b/d24/f7e 0 2024-04-16T14:35:38.584 INFO:tasks.workunit.client.0.smithi005.stdout:0/617: chown da/df/d1b/cbe 54503171 1 2024-04-16T14:35:38.585 INFO:tasks.workunit.client.0.smithi005.stdout:0/618: write da/df/d50/f6d [479105,98839] 0 2024-04-16T14:35:38.585 INFO:tasks.workunit.client.1.smithi115.stdout:8/415: rename d0/db/l33 to d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/l80 0 2024-04-16T14:35:38.586 INFO:tasks.workunit.client.0.smithi005.stdout:0/619: symlink da/df/d26/d39/d55/d5c/da8/lcd 0 2024-04-16T14:35:38.587 INFO:tasks.workunit.client.1.smithi115.stdout:8/416: symlink d0/db/d10/d17/d2c/d52/d74/l81 0 2024-04-16T14:35:38.589 INFO:tasks.workunit.client.1.smithi115.stdout:8/417: chown d0/db/d10/c39 939542177 1 2024-04-16T14:35:38.590 INFO:tasks.workunit.client.1.smithi115.stdout:8/418: symlink d0/db/d10/d17/d2c/d52/l82 0 2024-04-16T14:35:38.592 INFO:tasks.workunit.client.1.smithi115.stdout:8/419: mkdir d0/db/d10/d17/d2c/d61/d64/d83 0 2024-04-16T14:35:38.592 INFO:tasks.workunit.client.1.smithi115.stdout:8/420: write d0/db/d10/d17/f72 [1045585,104857] 0 2024-04-16T14:35:38.592 INFO:tasks.workunit.client.1.smithi115.stdout:8/421: write d0/db/d10/d17/d2c/d52/d74/f4d [476057,45011] 0 2024-04-16T14:35:38.592 INFO:tasks.workunit.client.1.smithi115.stdout:8/422: fsync d0/f1a 0 2024-04-16T14:35:38.594 INFO:tasks.workunit.client.0.smithi005.stdout:2/453: rmdir d0/d2a 39 2024-04-16T14:35:38.597 INFO:tasks.workunit.client.1.smithi115.stdout:4/421: dread d1/d15/d31/f3a [0,4194304] 0 2024-04-16T14:35:38.604 INFO:tasks.workunit.client.1.smithi115.stdout:4/422: unlink d1/d15/c30 0 2024-04-16T14:35:38.605 INFO:tasks.workunit.client.1.smithi115.stdout:4/423: creat d1/d15/d1e/f6e x:0 0 0 2024-04-16T14:35:38.613 INFO:tasks.workunit.client.1.smithi115.stdout:5/386: read dc/d3d/f5e [4127782,104600] 0 2024-04-16T14:35:38.615 INFO:tasks.workunit.client.1.smithi115.stdout:4/424: dread d1/d15/d1e/f65 [0,4194304] 0 2024-04-16T14:35:38.615 INFO:tasks.workunit.client.0.smithi005.stdout:9/455: dread d3/d49/f50 [0,4194304] 0 2024-04-16T14:35:38.615 INFO:tasks.workunit.client.0.smithi005.stdout:9/456: write d3/d12/f30 [4751600,19889] 0 2024-04-16T14:35:38.616 INFO:tasks.workunit.client.1.smithi115.stdout:4/425: symlink d1/d15/d17/l6f 0 2024-04-16T14:35:38.620 INFO:tasks.workunit.client.1.smithi115.stdout:8/423: dread d0/db/d10/d17/d2c/d52/d74/f35 [0,4194304] 0 2024-04-16T14:35:38.620 INFO:tasks.workunit.client.1.smithi115.stdout:8/424: fsync d0/db/d10/d17/f40 0 2024-04-16T14:35:38.623 INFO:tasks.workunit.client.1.smithi115.stdout:5/387: write dc/f65 [814425,84287] 0 2024-04-16T14:35:38.624 INFO:tasks.workunit.client.0.smithi005.stdout:1/870: dwrite d2/d1c/d15/d2a/f16 [0,4194304] 0 2024-04-16T14:35:38.625 INFO:tasks.workunit.client.0.smithi005.stdout:1/871: chown d2/d1c/d15/d2a/d25/f48 67772 1 2024-04-16T14:35:38.625 INFO:tasks.workunit.client.1.smithi115.stdout:5/388: symlink dc/d3d/d41/l83 0 2024-04-16T14:35:38.626 INFO:tasks.workunit.client.0.smithi005.stdout:1/872: creat d2/d2c/f12e x:0 0 0 2024-04-16T14:35:38.626 INFO:tasks.workunit.client.0.smithi005.stdout:1/873: creat d2/d1c/d15/d2a/d19/dc9/f12f x:0 0 0 2024-04-16T14:35:38.626 INFO:tasks.workunit.client.0.smithi005.stdout:1/874: truncate d2/d1c/d15/d2a/d19/d20/fec 979631 0 2024-04-16T14:35:38.627 INFO:tasks.workunit.client.0.smithi005.stdout:1/875: mknod d2/d74/dd7/d11f/d51/dc4/c130 0 2024-04-16T14:35:38.628 INFO:tasks.workunit.client.0.smithi005.stdout:1/876: write d2/d1c/d15/d2a/d19/d42/d71/dac/f9f [1707747,8672] 0 2024-04-16T14:35:38.628 INFO:tasks.workunit.client.0.smithi005.stdout:1/877: fsync d2/d1c/d15/d2a/d19/d42/d64/d76/f120 0 2024-04-16T14:35:38.628 INFO:tasks.workunit.client.0.smithi005.stdout:1/878: rmdir d2/d1c 39 2024-04-16T14:35:38.628 INFO:tasks.workunit.client.0.smithi005.stdout:1/879: dread - d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/dc5/dbc/f8e zero size 2024-04-16T14:35:38.639 INFO:tasks.workunit.client.1.smithi115.stdout:3/470: sync 2024-04-16T14:35:38.641 INFO:tasks.workunit.client.1.smithi115.stdout:3/471: symlink dc/l9c 0 2024-04-16T14:35:38.641 INFO:tasks.workunit.client.1.smithi115.stdout:3/472: symlink dc/d24/d36/d8c/l9d 0 2024-04-16T14:35:38.643 INFO:tasks.workunit.client.1.smithi115.stdout:3/473: symlink dc/d29/d77/l9e 0 2024-04-16T14:35:38.643 INFO:tasks.workunit.client.1.smithi115.stdout:3/474: read - dc/d24/d33/d4b/f97 zero size 2024-04-16T14:35:38.643 INFO:tasks.workunit.client.1.smithi115.stdout:3/475: fsync dc/f15 0 2024-04-16T14:35:38.645 INFO:tasks.workunit.client.1.smithi115.stdout:3/476: rename dc/d29/f2e to dc/d24/d33/d4b/d65/f9f 0 2024-04-16T14:35:38.651 INFO:tasks.workunit.client.0.smithi005.stdout:5/673: dwrite d0/d6/d12/f45 [0,4194304] 0 2024-04-16T14:35:38.652 INFO:tasks.workunit.client.0.smithi005.stdout:5/674: creat d0/d6/d12/d1c/d1e/fe5 x:0 0 0 2024-04-16T14:35:38.652 INFO:tasks.workunit.client.0.smithi005.stdout:5/675: chown d0/d70/f96 47484 1 2024-04-16T14:35:38.654 INFO:tasks.workunit.client.0.smithi005.stdout:5/676: rename d0/d6/d6e/f7e to d0/d70/fe6 0 2024-04-16T14:35:38.655 INFO:tasks.workunit.client.0.smithi005.stdout:5/677: mkdir d0/d6/d12/d1c/d1e/de7 0 2024-04-16T14:35:38.657 INFO:tasks.workunit.client.0.smithi005.stdout:5/678: rename d0/d6/d12/dc0/d8d/dd8/cd3 to d0/d6/d6e/d9e/ddb/ce8 0 2024-04-16T14:35:38.657 INFO:tasks.workunit.client.0.smithi005.stdout:5/679: getdents d0/d6/d12/d1c/d81 0 2024-04-16T14:35:38.658 INFO:tasks.workunit.client.0.smithi005.stdout:5/680: getdents d0/d6/d12/dc0/d30 0 2024-04-16T14:35:38.661 INFO:tasks.workunit.client.0.smithi005.stdout:8/665: dwrite d5/d40/d8e/fac [0,4194304] 0 2024-04-16T14:35:38.662 INFO:tasks.workunit.client.0.smithi005.stdout:8/666: fdatasync d5/d7b/da8/db7/d8a/da1/fe9 0 2024-04-16T14:35:38.662 INFO:tasks.workunit.client.1.smithi115.stdout:9/496: dwrite d1/d6/d2d/d4b/d6c/d20/d36/f9f [0,4194304] 0 2024-04-16T14:35:38.662 INFO:tasks.workunit.client.1.smithi115.stdout:9/497: write d1/d6/d2d/d4b/d8f/d91/f58 [1012111,55675] 0 2024-04-16T14:35:38.662 INFO:tasks.workunit.client.1.smithi115.stdout:6/475: dwrite d13/f2a [0,4194304] 0 2024-04-16T14:35:38.664 INFO:tasks.workunit.client.1.smithi115.stdout:7/390: dwrite d0/d2/d3a/d73/f86 [0,4194304] 0 2024-04-16T14:35:38.664 INFO:tasks.workunit.client.0.smithi005.stdout:8/667: creat d5/d40/fec x:0 0 0 2024-04-16T14:35:38.664 INFO:tasks.workunit.client.0.smithi005.stdout:8/668: chown d5/d55/d5a/ldd 1172 1 2024-04-16T14:35:38.666 INFO:tasks.workunit.client.0.smithi005.stdout:5/681: dread d0/d6/d12/d1c/d81/fc9 [0,4194304] 0 2024-04-16T14:35:38.667 INFO:tasks.workunit.client.0.smithi005.stdout:5/682: creat d0/d6/d12/d1c/d1e/fe9 x:0 0 0 2024-04-16T14:35:38.667 INFO:tasks.workunit.client.0.smithi005.stdout:5/683: write d0/d6/d12/d1c/d1e/fe9 [470136,26441] 0 2024-04-16T14:35:38.667 INFO:tasks.workunit.client.0.smithi005.stdout:2/454: dwrite d0/d2a/f52 [0,4194304] 0 2024-04-16T14:35:38.668 INFO:tasks.workunit.client.1.smithi115.stdout:6/476: mknod d13/d1d/d2b/d5f/d30/c9d 0 2024-04-16T14:35:38.668 INFO:tasks.workunit.client.0.smithi005.stdout:3/654: dwrite d2/d9/d25/d39/fcd [0,4194304] 0 2024-04-16T14:35:38.669 INFO:tasks.workunit.client.1.smithi115.stdout:0/326: dwrite d6/d10/d12/d1f/d36/d4b/f6a [0,4194304] 0 2024-04-16T14:35:38.669 INFO:tasks.workunit.client.0.smithi005.stdout:3/655: read d2/d17/d46/f57 [350694,51116] 0 2024-04-16T14:35:38.672 INFO:tasks.workunit.client.1.smithi115.stdout:9/498: rmdir d1/d6/d2d/d4b/d6c/d20/d36 39 2024-04-16T14:35:38.674 INFO:tasks.workunit.client.1.smithi115.stdout:4/426: dwrite d1/d15/d31/f4b [0,4194304] 0 2024-04-16T14:35:38.674 INFO:tasks.workunit.client.0.smithi005.stdout:8/669: unlink d5/d7b/da8/db7/d8a/da1/fe9 0 2024-04-16T14:35:38.675 INFO:tasks.workunit.client.1.smithi115.stdout:1/394: dwrite df/d36/f3d [0,4194304] 0 2024-04-16T14:35:38.675 INFO:tasks.workunit.client.1.smithi115.stdout:0/327: truncate d6/d10/d12/d31/d35/f3c 1829815 0 2024-04-16T14:35:38.678 INFO:tasks.workunit.client.0.smithi005.stdout:1/880: dwrite d2/d1c/d15/d2a/f16 [0,4194304] 0 2024-04-16T14:35:38.678 INFO:tasks.workunit.client.0.smithi005.stdout:1/881: creat d2/d1c/d15/d2a/d19/d20/f131 x:0 0 0 2024-04-16T14:35:38.679 INFO:tasks.workunit.client.1.smithi115.stdout:3/477: dwrite dc/d24/d33/d4b/f4c [0,4194304] 0 2024-04-16T14:35:38.679 INFO:tasks.workunit.client.1.smithi115.stdout:3/478: write dc/d29/d4d/d56/f9b [327877,23540] 0 2024-04-16T14:35:38.679 INFO:tasks.workunit.client.1.smithi115.stdout:3/479: creat dc/d29/d4d/d56/d7e/fa0 x:0 0 0 2024-04-16T14:35:38.679 INFO:tasks.workunit.client.1.smithi115.stdout:5/389: dwrite dc/d15/d2d/f67 [0,4194304] 0 2024-04-16T14:35:38.679 INFO:tasks.workunit.client.1.smithi115.stdout:5/390: write dc/f11 [4682643,126486] 0 2024-04-16T14:35:38.679 INFO:tasks.workunit.client.1.smithi115.stdout:8/425: dwrite d0/db/d10/f6d [0,4194304] 0 2024-04-16T14:35:38.680 INFO:tasks.workunit.client.0.smithi005.stdout:5/684: mkdir d0/d70/dea 0 2024-04-16T14:35:38.683 INFO:tasks.workunit.client.0.smithi005.stdout:2/455: symlink d0/d1c/d59/d67/l98 0 2024-04-16T14:35:38.684 INFO:tasks.workunit.client.1.smithi115.stdout:4/427: dread d1/d15/f34 [0,4194304] 0 2024-04-16T14:35:38.685 INFO:tasks.workunit.client.1.smithi115.stdout:1/395: creat df/d2d/f82 x:0 0 0 2024-04-16T14:35:38.688 INFO:tasks.workunit.client.0.smithi005.stdout:3/656: symlink d2/d17/d46/ld7 0 2024-04-16T14:35:38.689 INFO:tasks.workunit.client.1.smithi115.stdout:9/499: link d1/d6/d29/f32 d1/fa8 0 2024-04-16T14:35:38.690 INFO:tasks.workunit.client.0.smithi005.stdout:8/670: link d5/d7b/da8/db7/d8a/da1/d68/f75 d5/d7b/da8/db7/d8a/da1/d3d/d7f/d8d/fed 0 2024-04-16T14:35:38.694 INFO:tasks.workunit.client.0.smithi005.stdout:9/457: getdents d3/d77 0 2024-04-16T14:35:38.698 INFO:tasks.workunit.client.1.smithi115.stdout:5/391: rename dc/f56 to dc/d3d/d68/d7b/f84 0 2024-04-16T14:35:38.699 INFO:tasks.workunit.client.0.smithi005.stdout:5/685: symlink d0/d70/leb 0 2024-04-16T14:35:38.700 INFO:tasks.workunit.client.0.smithi005.stdout:2/456: stat d0/d1c/c22 0 2024-04-16T14:35:38.700 INFO:tasks.workunit.client.1.smithi115.stdout:8/426: mkdir d0/db/d10/d17/d2c/d52/d84 0 2024-04-16T14:35:38.702 INFO:tasks.workunit.client.1.smithi115.stdout:0/328: getdents d6/d10/d12/d31/d35/d28 0 2024-04-16T14:35:38.703 INFO:tasks.workunit.client.1.smithi115.stdout:0/329: truncate d6/d10/d12/d31/d35/f3e 1056573 0 2024-04-16T14:35:38.703 INFO:tasks.workunit.client.1.smithi115.stdout:0/330: fdatasync d6/d10/d12/f6e 0 2024-04-16T14:35:38.703 INFO:tasks.workunit.client.1.smithi115.stdout:0/331: chown l5 683 1 2024-04-16T14:35:38.703 INFO:tasks.workunit.client.1.smithi115.stdout:0/332: dread - d6/d30/f43 zero size 2024-04-16T14:35:38.703 INFO:tasks.workunit.client.1.smithi115.stdout:0/333: write d6/d10/d12/d31/d35/d28/f77 [816554,10836] 0 2024-04-16T14:35:38.704 INFO:tasks.workunit.client.0.smithi005.stdout:8/671: link d5/d11/d6c/f7e d5/d7b/da8/db7/d8a/da1/d3d/fee 0 2024-04-16T14:35:38.705 INFO:tasks.workunit.client.0.smithi005.stdout:0/620: dwrite da/df/d1b/d3a/d53/d5a/d99/fc5 [0,4194304] 0 2024-04-16T14:35:38.705 INFO:tasks.workunit.client.0.smithi005.stdout:0/621: creat da/df/d1b/d24/d75/d81/fce x:0 0 0 2024-04-16T14:35:38.705 INFO:tasks.workunit.client.0.smithi005.stdout:9/458: unlink d3/f10 0 2024-04-16T14:35:38.706 INFO:tasks.workunit.client.0.smithi005.stdout:5/686: mkdir d0/d6/d12/dcc/dec 0 2024-04-16T14:35:38.709 INFO:tasks.workunit.client.0.smithi005.stdout:2/457: read d0/d1c/d39/d48/f7b [71488,15137] 0 2024-04-16T14:35:38.709 INFO:tasks.workunit.client.0.smithi005.stdout:2/458: readlink d0/d4/l26 0 2024-04-16T14:35:38.710 INFO:tasks.workunit.client.0.smithi005.stdout:0/622: truncate da/f20 3938165 0 2024-04-16T14:35:38.712 INFO:tasks.workunit.client.0.smithi005.stdout:9/459: symlink d3/l83 0 2024-04-16T14:35:38.716 INFO:tasks.workunit.client.1.smithi115.stdout:8/427: write d0/db/d10/d17/d2c/d52/d74/d3b/f77 [2158993,59891] 0 2024-04-16T14:35:38.718 INFO:tasks.workunit.client.0.smithi005.stdout:2/459: unlink d0/l6e 0 2024-04-16T14:35:38.718 INFO:tasks.workunit.client.0.smithi005.stdout:2/460: chown d0/c16 41 1 2024-04-16T14:35:38.718 INFO:tasks.workunit.client.0.smithi005.stdout:2/461: getdents d0/d2a/d3a/d94 0 2024-04-16T14:35:38.718 INFO:tasks.workunit.client.1.smithi115.stdout:8/428: rmdir d0/db/d10 39 2024-04-16T14:35:38.722 INFO:tasks.workunit.client.0.smithi005.stdout:9/460: unlink d3/d49/c6e 0 2024-04-16T14:35:38.722 INFO:tasks.workunit.client.0.smithi005.stdout:9/461: rename d3/d12/d16/d46/d47 to d3/d12/d16/d46/d47/d60/d84 22 2024-04-16T14:35:38.723 INFO:tasks.workunit.client.0.smithi005.stdout:2/462: mkdir d0/d29/d89/d99 0 2024-04-16T14:35:38.724 INFO:tasks.workunit.client.1.smithi115.stdout:1/396: write df/f27 [4221318,11903] 0 2024-04-16T14:35:38.724 INFO:tasks.workunit.client.1.smithi115.stdout:1/397: write df/f25 [123993,127711] 0 2024-04-16T14:35:38.725 INFO:tasks.workunit.client.0.smithi005.stdout:9/462: creat d3/d49/d4b/d5c/d65/f85 x:0 0 0 2024-04-16T14:35:38.725 INFO:tasks.workunit.client.0.smithi005.stdout:9/463: dread - d3/d12/d16/d46/d47/d60/f69 zero size 2024-04-16T14:35:38.725 INFO:tasks.workunit.client.0.smithi005.stdout:9/464: dread - d3/d49/f66 zero size 2024-04-16T14:35:38.726 INFO:tasks.workunit.client.0.smithi005.stdout:9/465: dread - d3/d12/f52 zero size 2024-04-16T14:35:38.726 INFO:tasks.workunit.client.1.smithi115.stdout:5/392: dread dc/d15/f17 [0,4194304] 0 2024-04-16T14:35:38.726 INFO:tasks.workunit.client.0.smithi005.stdout:2/463: mkdir d0/d4/d2b/d5e/d9a 0 2024-04-16T14:35:38.727 INFO:tasks.workunit.client.0.smithi005.stdout:2/464: dread - d0/d4/f66 zero size 2024-04-16T14:35:38.727 INFO:tasks.workunit.client.1.smithi115.stdout:1/398: rmdir df/d36 39 2024-04-16T14:35:38.728 INFO:tasks.workunit.client.0.smithi005.stdout:9/466: unlink d3/d49/d4b/c76 0 2024-04-16T14:35:38.729 INFO:tasks.workunit.client.0.smithi005.stdout:2/465: mknod d0/d1c/d8d/c9b 0 2024-04-16T14:35:38.730 INFO:tasks.workunit.client.0.smithi005.stdout:2/466: mknod d0/c9c 0 2024-04-16T14:35:38.731 INFO:tasks.workunit.client.0.smithi005.stdout:2/467: dread - d0/d4/f62 zero size 2024-04-16T14:35:38.732 INFO:tasks.workunit.client.1.smithi115.stdout:6/477: dwrite d13/d1d/d2b/d46/d63/f64 [0,4194304] 0 2024-04-16T14:35:38.732 INFO:tasks.workunit.client.1.smithi115.stdout:6/478: dread - d13/d1d/d68/f9a zero size 2024-04-16T14:35:38.733 INFO:tasks.workunit.client.0.smithi005.stdout:1/882: dwrite d2/d1c/d15/d2a/d19/d42/d64/d76/faf [4194304,4194304] 0 2024-04-16T14:35:38.733 INFO:tasks.workunit.client.1.smithi115.stdout:6/479: creat d13/d1d/d2b/d5f/d30/f9e x:0 0 0 2024-04-16T14:35:38.733 INFO:tasks.workunit.client.1.smithi115.stdout:7/391: dwrite d0/d24/f4a [0,4194304] 0 2024-04-16T14:35:38.737 INFO:tasks.workunit.client.0.smithi005.stdout:0/623: dread da/df/d1b/d3a/d53/f8f [0,4194304] 0 2024-04-16T14:35:38.738 INFO:tasks.workunit.client.1.smithi115.stdout:6/480: link d13/d1d/d2b/d46/d5a/f3b d13/d1d/d2b/d46/d5a/d62/d96/f9f 0 2024-04-16T14:35:38.738 INFO:tasks.workunit.client.1.smithi115.stdout:6/481: creat d13/d1d/d68/fa0 x:0 0 0 2024-04-16T14:35:38.739 INFO:tasks.workunit.client.0.smithi005.stdout:9/467: write d3/d12/d16/f39 [525941,21179] 0 2024-04-16T14:35:38.742 INFO:tasks.workunit.client.1.smithi115.stdout:6/482: rmdir d13/d1d/d2b/d5f/d30/d43/d2c 39 2024-04-16T14:35:38.745 INFO:tasks.workunit.client.1.smithi115.stdout:6/483: rename d13/d1d/d2b/d46/d5a/d62/d96/d55/c76 to d13/d1d/d2b/d46/d5a/d62/ca1 0 2024-04-16T14:35:38.745 INFO:tasks.workunit.client.1.smithi115.stdout:6/484: creat d13/d1d/d68/fa2 x:0 0 0 2024-04-16T14:35:38.746 INFO:tasks.workunit.client.0.smithi005.stdout:1/883: rename d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/dc5 to d2/d74/dd7/d11f/d51/d132 0 2024-04-16T14:35:38.746 INFO:tasks.workunit.client.0.smithi005.stdout:1/884: readlink d2/d1c/d15/d2a/d19/d42/d71/dac/lbd 0 2024-04-16T14:35:38.746 INFO:tasks.workunit.client.0.smithi005.stdout:1/885: fdatasync d2/d74/dd7/d11f/d51/fc3 0 2024-04-16T14:35:38.747 INFO:tasks.workunit.client.1.smithi115.stdout:8/429: write d0/f1f [114060,73281] 0 2024-04-16T14:35:38.748 INFO:tasks.workunit.client.0.smithi005.stdout:8/672: dwrite d5/d7b/f83 [0,4194304] 0 2024-04-16T14:35:38.748 INFO:tasks.workunit.client.0.smithi005.stdout:3/657: dwrite d2/d9/d7d/f98 [0,4194304] 0 2024-04-16T14:35:38.749 INFO:tasks.workunit.client.1.smithi115.stdout:6/485: creat d13/d1d/d47/fa3 x:0 0 0 2024-04-16T14:35:38.749 INFO:tasks.workunit.client.1.smithi115.stdout:9/500: dwrite d1/d6/d2d/d4b/d6c/d20/d36/f9f [0,4194304] 0 2024-04-16T14:35:38.749 INFO:tasks.workunit.client.1.smithi115.stdout:6/486: truncate d13/d1d/d2b/d5f/d30/f80 398644 0 2024-04-16T14:35:38.749 INFO:tasks.workunit.client.0.smithi005.stdout:1/886: mkdir d2/d1c/d15/d2a/d25/d133 0 2024-04-16T14:35:38.750 INFO:tasks.workunit.client.1.smithi115.stdout:3/480: dwrite dc/d24/d36/f3b [4194304,4194304] 0 2024-04-16T14:35:38.750 INFO:tasks.workunit.client.1.smithi115.stdout:3/481: chown dc/f18 8939333 1 2024-04-16T14:35:38.750 INFO:tasks.workunit.client.1.smithi115.stdout:4/428: dwrite d1/d2/f11 [0,4194304] 0 2024-04-16T14:35:38.750 INFO:tasks.workunit.client.1.smithi115.stdout:4/429: chown d1/d15/d31/d42/f4a 12408627 1 2024-04-16T14:35:38.750 INFO:tasks.workunit.client.0.smithi005.stdout:5/687: dwrite d0/d6/d12/dc0/d8d/dd8/f9a [0,4194304] 0 2024-04-16T14:35:38.751 INFO:tasks.workunit.client.1.smithi115.stdout:8/430: dread d0/db/d10/d17/d2c/d52/d74/d3b/f54 [0,4194304] 0 2024-04-16T14:35:38.751 INFO:tasks.workunit.client.1.smithi115.stdout:8/431: write d0/db/f1b [1564111,97908] 0 2024-04-16T14:35:38.753 INFO:tasks.workunit.client.0.smithi005.stdout:2/468: dwrite d0/d1c/d39/d48/f7c [0,4194304] 0 2024-04-16T14:35:38.754 INFO:tasks.workunit.client.1.smithi115.stdout:0/334: dwrite d6/d10/d12/d31/d35/d44/f50 [0,4194304] 0 2024-04-16T14:35:38.754 INFO:tasks.workunit.client.1.smithi115.stdout:9/501: rename d1/d6/d2d/d3d/d49/d88/l8b to d1/d6/d2d/d4b/d60/d65/la9 0 2024-04-16T14:35:38.757 INFO:tasks.workunit.client.1.smithi115.stdout:4/430: getdents d1/d15/d31 0 2024-04-16T14:35:38.761 INFO:tasks.workunit.client.1.smithi115.stdout:1/399: dwrite df/d35/f67 [0,4194304] 0 2024-04-16T14:35:38.768 INFO:tasks.workunit.client.1.smithi115.stdout:6/487: dread d13/d1d/f5c [0,4194304] 0 2024-04-16T14:35:38.776 INFO:tasks.workunit.client.1.smithi115.stdout:0/335: symlink d6/l79 0 2024-04-16T14:35:38.777 INFO:tasks.workunit.client.1.smithi115.stdout:9/502: mkdir d1/d6/d2d/d3d/d49/d98/daa 0 2024-04-16T14:35:38.781 INFO:tasks.workunit.client.1.smithi115.stdout:9/503: mkdir d1/d6/d2d/d3d/d50/dab 0 2024-04-16T14:35:38.782 INFO:tasks.workunit.client.1.smithi115.stdout:6/488: dread f0 [0,4194304] 0 2024-04-16T14:35:38.782 INFO:tasks.workunit.client.1.smithi115.stdout:9/504: symlink d1/d6/d2d/d3d/d49/lac 0 2024-04-16T14:35:38.783 INFO:tasks.workunit.client.1.smithi115.stdout:1/400: rename df/d13/d3a to df/d2d/d83 0 2024-04-16T14:35:38.784 INFO:tasks.workunit.client.1.smithi115.stdout:6/489: creat d13/d1d/d2b/d46/d5a/d62/fa4 x:0 0 0 2024-04-16T14:35:38.785 INFO:tasks.workunit.client.1.smithi115.stdout:9/505: symlink d1/d6/d2d/d4b/d6c/d20/d36/lad 0 2024-04-16T14:35:38.785 INFO:tasks.workunit.client.1.smithi115.stdout:1/401: write df/f14 [1322898,87405] 0 2024-04-16T14:35:38.787 INFO:tasks.workunit.client.1.smithi115.stdout:6/490: creat d13/d1d/d2b/d46/d5a/d62/d96/d55/fa5 x:0 0 0 2024-04-16T14:35:38.787 INFO:tasks.workunit.client.1.smithi115.stdout:6/491: write d13/d1d/d49/f6e [1133350,4845] 0 2024-04-16T14:35:38.787 INFO:tasks.workunit.client.1.smithi115.stdout:6/492: chown f12 8028 1 2024-04-16T14:35:38.787 INFO:tasks.workunit.client.1.smithi115.stdout:6/493: truncate d13/d1d/d2b/d46/d5a/d62/d96/d55/fa5 133814 0 2024-04-16T14:35:38.795 INFO:tasks.workunit.client.1.smithi115.stdout:9/506: dread d1/d6/d2d/d4b/d8f/d91/f37 [0,4194304] 0 2024-04-16T14:35:38.833 INFO:tasks.workunit.client.1.smithi115.stdout:9/507: read d1/d6/d29/f54 [63068,26573] 0 2024-04-16T14:35:38.834 INFO:tasks.workunit.client.1.smithi115.stdout:9/508: chown d1/d6/d2d/d4b/d8f/l9d 0 1 2024-04-16T14:35:38.836 INFO:tasks.workunit.client.0.smithi005.stdout:1/887: link d2/d1c/d15/d2a/d1a/d21/f89 d2/d74/d7a/d100/f134 0 2024-04-16T14:35:38.837 INFO:tasks.workunit.client.0.smithi005.stdout:1/888: dread d2/d74/dd7/d11f/d51/d132/dbc/fba [0,4194304] 0 2024-04-16T14:35:38.837 INFO:tasks.workunit.client.0.smithi005.stdout:1/889: dread - d2/d1c/d15/d2a/d19/d20/d27/f10c zero size 2024-04-16T14:35:38.840 INFO:tasks.workunit.client.0.smithi005.stdout:2/469: creat d0/f9d x:0 0 0 2024-04-16T14:35:38.840 INFO:tasks.workunit.client.0.smithi005.stdout:2/470: write d0/d1c/f33 [5241201,84567] 0 2024-04-16T14:35:38.841 INFO:tasks.workunit.client.1.smithi115.stdout:3/482: dread dc/f21 [0,4194304] 0 2024-04-16T14:35:38.844 INFO:tasks.workunit.client.1.smithi115.stdout:9/509: dread d1/d6/d2d/d4b/d6c/d20/d36/f9f [0,4194304] 0 2024-04-16T14:35:38.844 INFO:tasks.workunit.client.1.smithi115.stdout:9/510: readlink d1/d6/d2d/d3d/l7e 0 2024-04-16T14:35:38.844 INFO:tasks.workunit.client.1.smithi115.stdout:9/511: stat d1/d6/d2d/d3d/f82 0 2024-04-16T14:35:38.844 INFO:tasks.workunit.client.1.smithi115.stdout:9/512: chown d1/d6/d2d/d3d/c40 17196 1 2024-04-16T14:35:38.844 INFO:tasks.workunit.client.1.smithi115.stdout:9/513: creat d1/d6/d2d/d4b/d6c/fae x:0 0 0 2024-04-16T14:35:38.845 INFO:tasks.workunit.client.1.smithi115.stdout:9/514: symlink d1/d6/d33/laf 0 2024-04-16T14:35:38.846 INFO:tasks.workunit.client.1.smithi115.stdout:9/515: creat d1/d6/d2d/d3d/d49/d98/daa/fb0 x:0 0 0 2024-04-16T14:35:38.850 INFO:tasks.workunit.client.0.smithi005.stdout:1/890: write d2/d74/dd7/d11f/d51/d132/df4/ffc [3235220,84107] 0 2024-04-16T14:35:38.850 INFO:tasks.workunit.client.0.smithi005.stdout:1/891: dread - d2/d1c/d15/d2a/d19/d42/d64/d76/d5a/ff5 zero size 2024-04-16T14:35:38.851 INFO:tasks.workunit.client.0.smithi005.stdout:1/892: read - d2/d74/fe4 zero size 2024-04-16T14:35:38.872 INFO:tasks.workunit.client.0.smithi005.stdout:0/624: dwrite f1 [0,4194304] 0 2024-04-16T14:35:38.872 INFO:tasks.workunit.client.0.smithi005.stdout:6/848: sync 2024-04-16T14:35:38.872 INFO:tasks.workunit.client.0.smithi005.stdout:6/849: read - d2/d20/df9/ffa zero size 2024-04-16T14:35:38.873 INFO:tasks.workunit.client.0.smithi005.stdout:5/688: dwrite d0/d6/d12/dc0/d30/fd5 [0,4194304] 0 2024-04-16T14:35:38.873 INFO:tasks.workunit.client.1.smithi115.stdout:7/392: dwrite d0/d2/d3a/f33 [0,4194304] 0 2024-04-16T14:35:38.874 INFO:tasks.workunit.client.1.smithi115.stdout:7/393: readlink d0/l25 0 2024-04-16T14:35:38.874 INFO:tasks.workunit.client.1.smithi115.stdout:3/483: dread dc/d24/d36/d60/f78 [0,4194304] 0 2024-04-16T14:35:38.874 INFO:tasks.workunit.client.1.smithi115.stdout:3/484: readlink l9 0 2024-04-16T14:35:38.874 INFO:tasks.workunit.client.1.smithi115.stdout:7/394: rmdir d0/d1/d3b/d3f 39 2024-04-16T14:35:38.874 INFO:tasks.workunit.client.1.smithi115.stdout:7/395: write d0/d1/f20 [3864982,58669] 0 2024-04-16T14:35:38.875 INFO:tasks.workunit.client.1.smithi115.stdout:7/396: stat d0/d2/c41 0 2024-04-16T14:35:38.875 INFO:tasks.workunit.client.1.smithi115.stdout:4/431: dwrite d1/d15/d31/f4b [0,4194304] 0 2024-04-16T14:35:38.876 INFO:tasks.workunit.client.0.smithi005.stdout:2/471: creat d0/d1c/f9e x:0 0 0 2024-04-16T14:35:38.876 INFO:tasks.workunit.client.1.smithi115.stdout:8/432: fdatasync d0/db/d10/d17/f7b 0 2024-04-16T14:35:38.879 INFO:tasks.workunit.client.1.smithi115.stdout:8/433: unlink d0/db/d10/d17/d2c/d61/d6b/f7e 0 2024-04-16T14:35:38.881 INFO:tasks.workunit.client.1.smithi115.stdout:8/434: unlink d0/db/d10/d17/d2c/d61/f6a 0 2024-04-16T14:35:38.883 INFO:tasks.workunit.client.1.smithi115.stdout:8/435: mkdir d0/db/d10/d17/d2c/d85 0 2024-04-16T14:35:38.884 INFO:tasks.workunit.client.0.smithi005.stdout:5/689: dread d0/d6/d12/dc0/d8d/d5e/fc5 [0,4194304] 0 2024-04-16T14:35:38.884 INFO:tasks.workunit.client.0.smithi005.stdout:5/690: fdatasync d0/f2 0 2024-04-16T14:35:38.886 INFO:tasks.workunit.client.0.smithi005.stdout:0/625: getdents da/df/d1b/d3a/d53/d5a/d99 0 2024-04-16T14:35:38.886 INFO:tasks.workunit.client.0.smithi005.stdout:9/468: dwrite d3/d12/d2b/f4e [0,4194304] 0 2024-04-16T14:35:38.887 INFO:tasks.workunit.client.0.smithi005.stdout:9/469: readlink d3/d49/d4b/d5c/l7d 0 2024-04-16T14:35:38.889 INFO:tasks.workunit.client.0.smithi005.stdout:5/691: creat d0/d70/db3/fed x:0 0 0 2024-04-16T14:35:38.890 INFO:tasks.workunit.client.1.smithi115.stdout:1/402: dwrite df/d35/d48/f4c [0,4194304] 0 2024-04-16T14:35:38.890 INFO:tasks.workunit.client.1.smithi115.stdout:1/403: write df/d13/f59 [336929,129750] 0 2024-04-16T14:35:38.891 INFO:tasks.workunit.client.1.smithi115.stdout:1/404: write df/d36/d3c/f56 [1229988,126163] 0 2024-04-16T14:35:38.891 INFO:tasks.workunit.client.1.smithi115.stdout:1/405: write df/d13/d4d/f2e [88054,63258] 0 2024-04-16T14:35:38.891 INFO:tasks.workunit.client.1.smithi115.stdout:1/406: write df/d36/d3c/f63 [5038338,102456] 0 2024-04-16T14:35:38.893 INFO:tasks.workunit.client.0.smithi005.stdout:1/893: dread d2/d74/dd7/f8f [0,4194304] 0 2024-04-16T14:35:38.893 INFO:tasks.workunit.client.0.smithi005.stdout:1/894: creat d2/d1c/d15/d2a/d19/d42/d64/f135 x:0 0 0 2024-04-16T14:35:38.893 INFO:tasks.workunit.client.0.smithi005.stdout:1/895: write d2/d1c/fdd [478498,73584] 0 2024-04-16T14:35:38.893 INFO:tasks.workunit.client.0.smithi005.stdout:1/896: truncate d2/d1c/d15/d2a/f108 560253 0 2024-04-16T14:35:38.893 INFO:tasks.workunit.client.0.smithi005.stdout:1/897: truncate d2/d1c/d15/d2a/d19/d42/f56 4961984 0 2024-04-16T14:35:38.893 INFO:tasks.workunit.client.1.smithi115.stdout:5/393: dwrite dc/f65 [0,4194304] 0 2024-04-16T14:35:38.895 INFO:tasks.workunit.client.0.smithi005.stdout:8/673: dwrite d5/f90 [0,4194304] 0 2024-04-16T14:35:38.895 INFO:tasks.workunit.client.0.smithi005.stdout:8/674: write d5/d55/d5a/fc1 [365166,21578] 0 2024-04-16T14:35:38.895 INFO:tasks.workunit.client.1.smithi115.stdout:1/407: write df/f23 [231286,110860] 0 2024-04-16T14:35:38.896 INFO:tasks.workunit.client.0.smithi005.stdout:0/626: creat da/df/d1b/d24/fcf x:0 0 0 2024-04-16T14:35:38.896 INFO:tasks.workunit.client.0.smithi005.stdout:0/627: write da/f32 [485833,129054] 0 2024-04-16T14:35:38.896 INFO:tasks.workunit.client.1.smithi115.stdout:0/336: dwrite f1 [8388608,4194304] 0 2024-04-16T14:35:38.896 INFO:tasks.workunit.client.1.smithi115.stdout:0/337: chown d6/d1b/d4e/c68 5925549 1 2024-04-16T14:35:38.897 INFO:tasks.workunit.client.1.smithi115.stdout:1/408: mkdir df/d35/d84 0 2024-04-16T14:35:38.898 INFO:tasks.workunit.client.0.smithi005.stdout:2/472: write d0/d4/fc [1336117,1350] 0 2024-04-16T14:35:38.898 INFO:tasks.workunit.client.0.smithi005.stdout:5/692: creat d0/d70/dea/fee x:0 0 0 2024-04-16T14:35:38.899 INFO:tasks.workunit.client.1.smithi115.stdout:2/478: sync 2024-04-16T14:35:38.901 INFO:tasks.workunit.client.1.smithi115.stdout:0/338: mkdir d6/d10/d12/d1f/d36/d4b/d6d/d7a 0 2024-04-16T14:35:38.903 INFO:tasks.workunit.client.1.smithi115.stdout:4/432: read d1/d15/d1e/f29 [204740,87015] 0 2024-04-16T14:35:38.904 INFO:tasks.workunit.client.1.smithi115.stdout:6/494: rename d13/d1d/d2b/d46 to d13/d1d/d2b/d5f/d30/d43/da6 0 2024-04-16T14:35:38.904 INFO:tasks.workunit.client.0.smithi005.stdout:8/675: getdents d5/d7b/da8/db7/d8a/da1/d3d/dba 0 2024-04-16T14:35:38.905 INFO:tasks.workunit.client.0.smithi005.stdout:0/628: mkdir da/df/dd0 0 2024-04-16T14:35:38.906 INFO:tasks.workunit.client.1.smithi115.stdout:2/479: unlink d0/d4/d24/f79 0 2024-04-16T14:35:38.906 INFO:tasks.workunit.client.1.smithi115.stdout:2/480: chown d0/d4/de/d11/d36/f6e 62469634 1 2024-04-16T14:35:38.907 INFO:tasks.workunit.client.0.smithi005.stdout:6/850: dwrite d2/d20/d33/fb3 [0,4194304] 0 2024-04-16T14:35:38.910 INFO:tasks.workunit.client.1.smithi115.stdout:0/339: mknod d6/d10/d12/d1f/d36/d4b/d70/c7b 0 2024-04-16T14:35:38.910 INFO:tasks.workunit.client.1.smithi115.stdout:0/340: truncate d6/d30/f43 422058 0 2024-04-16T14:35:38.910 INFO:tasks.workunit.client.1.smithi115.stdout:0/341: truncate d6/d10/f40 1666716 0 2024-04-16T14:35:38.910 INFO:tasks.workunit.client.1.smithi115.stdout:0/342: readlink d6/d10/d12/l18 0 2024-04-16T14:35:38.910 INFO:tasks.workunit.client.1.smithi115.stdout:0/343: readlink d6/d10/d12/d1f/d36/d4b/d6d/l2b 0 2024-04-16T14:35:38.910 INFO:tasks.workunit.client.1.smithi115.stdout:4/433: link d1/d15/d31/d42/d46/f50 d1/d15/d31/d42/f70 0 2024-04-16T14:35:38.911 INFO:tasks.workunit.client.0.smithi005.stdout:5/693: mkdir d0/d6/d12/dc0/d42/def 0 2024-04-16T14:35:38.911 INFO:tasks.workunit.client.0.smithi005.stdout:5/694: write d0/d70/dea/fee [980191,97835] 0 2024-04-16T14:35:38.911 INFO:tasks.workunit.client.0.smithi005.stdout:5/695: fsync d0/d6/d12/dc0/d8d/d5e/fc5 0 2024-04-16T14:35:38.911 INFO:tasks.workunit.client.0.smithi005.stdout:5/696: chown d0/d6/d6e 706 1 2024-04-16T14:35:38.911 INFO:tasks.workunit.client.0.smithi005.stdout:5/697: write d0/d6/d12/dc0/d6d/fd6 [355195,76325] 0 2024-04-16T14:35:38.912 INFO:tasks.workunit.client.1.smithi115.stdout:1/409: dread df/d13/d4d/f34 [0,4194304] 0 2024-04-16T14:35:38.912 INFO:tasks.workunit.client.1.smithi115.stdout:6/495: mknod d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/d55/ca7 0 2024-04-16T14:35:38.912 INFO:tasks.workunit.client.1.smithi115.stdout:6/496: dread - d13/d1d/d68/fa2 zero size 2024-04-16T14:35:38.913 INFO:tasks.workunit.client.1.smithi115.stdout:5/394: read dc/d15/f27 [562273,70394] 0 2024-04-16T14:35:38.915 INFO:tasks.workunit.client.0.smithi005.stdout:1/898: symlink d2/d1c/d15/d2a/d1a/d21/l136 0 2024-04-16T14:35:38.915 INFO:tasks.workunit.client.0.smithi005.stdout:2/473: write d0/d2a/f63 [567485,25392] 0 2024-04-16T14:35:38.915 INFO:tasks.workunit.client.1.smithi115.stdout:7/397: dwrite d0/d1/f1f [0,4194304] 0 2024-04-16T14:35:38.915 INFO:tasks.workunit.client.1.smithi115.stdout:7/398: write d0/d2/d3a/d30/d6b/f75 [6761094,97324] 0 2024-04-16T14:35:38.915 INFO:tasks.workunit.client.1.smithi115.stdout:9/516: rename d1/d6/l68 to d1/d6/d2d/d4b/d90/lb1 0 2024-04-16T14:35:38.918 INFO:tasks.workunit.client.1.smithi115.stdout:4/434: mknod d1/d15/d24/c71 0 2024-04-16T14:35:38.919 INFO:tasks.workunit.client.0.smithi005.stdout:4/909: sync 2024-04-16T14:35:38.919 INFO:tasks.workunit.client.0.smithi005.stdout:7/757: sync 2024-04-16T14:35:38.919 INFO:tasks.workunit.client.1.smithi115.stdout:2/481: write d0/d4/d4a/f81 [1844886,56163] 0 2024-04-16T14:35:38.919 INFO:tasks.workunit.client.1.smithi115.stdout:2/482: chown d0/d4/de/d11/f88 277738 1 2024-04-16T14:35:38.920 INFO:tasks.workunit.client.1.smithi115.stdout:8/436: getdents d0/db/d10/d17/d2c 0 2024-04-16T14:35:38.921 INFO:tasks.workunit.client.0.smithi005.stdout:9/470: dwrite d3/d12/d16/f39 [0,4194304] 0 2024-04-16T14:35:38.921 INFO:tasks.workunit.client.0.smithi005.stdout:9/471: stat d3/d12/d16/l27 0 2024-04-16T14:35:38.922 INFO:tasks.workunit.client.0.smithi005.stdout:9/472: fsync d3/d12/f3e 0 2024-04-16T14:35:38.922 INFO:tasks.workunit.client.0.smithi005.stdout:9/473: chown d3/d12/c5b 104946106 1 2024-04-16T14:35:38.924 INFO:tasks.workunit.client.1.smithi115.stdout:1/410: creat df/d36/d3c/f85 x:0 0 0 2024-04-16T14:35:38.929 INFO:tasks.workunit.client.1.smithi115.stdout:7/399: symlink d0/d1/l8a 0 2024-04-16T14:35:38.931 INFO:tasks.workunit.client.0.smithi005.stdout:6/851: dwrite d2/d3f/d53/dba/d111/f11b [0,4194304] 0 2024-04-16T14:35:38.931 INFO:tasks.workunit.client.0.smithi005.stdout:6/852: write d2/d5/d10/dd6/f104 [57938,71352] 0 2024-04-16T14:35:38.932 INFO:tasks.workunit.client.1.smithi115.stdout:4/435: mknod d1/c72 0 2024-04-16T14:35:38.932 INFO:tasks.workunit.client.0.smithi005.stdout:8/676: rename d5/d11/d6c to d5/d7b/da8/da5/def 0 2024-04-16T14:35:38.933 INFO:tasks.workunit.client.0.smithi005.stdout:4/910: getdents d0/d1b/d1d/d1f/d5d 0 2024-04-16T14:35:38.934 INFO:tasks.workunit.client.1.smithi115.stdout:8/437: creat d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/f86 x:0 0 0 2024-04-16T14:35:38.938 INFO:tasks.workunit.client.0.smithi005.stdout:6/853: unlink d2/d5/d10/f44 0 2024-04-16T14:35:38.939 INFO:tasks.workunit.client.0.smithi005.stdout:9/474: rmdir d3/d49/d4b/d5c/d65 39 2024-04-16T14:35:38.939 INFO:tasks.workunit.client.0.smithi005.stdout:9/475: readlink d3/d12/d16/l27 0 2024-04-16T14:35:38.940 INFO:tasks.workunit.client.1.smithi115.stdout:3/485: rename dc/d24/d33/f74 to dc/d24/d33/d4b/d65/d69/fa1 0 2024-04-16T14:35:38.944 INFO:tasks.workunit.client.1.smithi115.stdout:0/344: rename d6/d10/d12/d31/d35/d28/f53 to d6/d1b/f7c 0 2024-04-16T14:35:38.944 INFO:tasks.workunit.client.1.smithi115.stdout:0/345: creat d6/d1b/f7d x:0 0 0 2024-04-16T14:35:38.944 INFO:tasks.workunit.client.0.smithi005.stdout:2/474: rename d0/d1c/d39/d48/f7c to d0/d1c/d59/d7a/d84/f9f 0 2024-04-16T14:35:38.946 INFO:tasks.workunit.client.1.smithi115.stdout:6/497: rename d13/d1d/d2b/d5f/d30/d43/d2c/f91 to d13/d1d/d2b/d5f/fa8 0 2024-04-16T14:35:38.947 INFO:tasks.workunit.client.0.smithi005.stdout:9/476: mkdir d3/d12/d16/d86 0 2024-04-16T14:35:38.950 INFO:tasks.workunit.client.1.smithi115.stdout:2/483: dwrite d0/d4/d4a/f69 [0,4194304] 0 2024-04-16T14:35:38.950 INFO:tasks.workunit.client.1.smithi115.stdout:4/436: dread d1/d15/f64 [0,4194304] 0 2024-04-16T14:35:38.950 INFO:tasks.workunit.client.1.smithi115.stdout:5/395: rename dc/d15/l1e to dc/d5d/l85 0 2024-04-16T14:35:38.951 INFO:tasks.workunit.client.0.smithi005.stdout:7/758: rename d1/d49/d74/d77/d22/d27/d2e/l9b to d1/d49/d74/d77/d22/d27/d3a/d5c/d9e/lff 0 2024-04-16T14:35:38.951 INFO:tasks.workunit.client.0.smithi005.stdout:4/911: rename d0/d1b/d1d to d0/d1b/d1d/d1f/da0/d122 22 2024-04-16T14:35:38.951 INFO:tasks.workunit.client.0.smithi005.stdout:4/912: write d0/d1b/db7/ddd/fe1 [1011618,5618] 0 2024-04-16T14:35:38.951 INFO:tasks.workunit.client.0.smithi005.stdout:7/759: write d1/d49/d74/d77/d22/d27/fd9 [537460,60868] 0 2024-04-16T14:35:38.952 INFO:tasks.workunit.client.0.smithi005.stdout:8/677: write d5/fb [3849284,97715] 0 2024-04-16T14:35:38.953 INFO:tasks.workunit.client.0.smithi005.stdout:1/899: dwrite d2/d1c/d15/d2a/d19/d42/d64/d76/faf [0,4194304] 0 2024-04-16T14:35:38.953 INFO:tasks.workunit.client.1.smithi115.stdout:4/437: creat d1/d15/d31/d55/f73 x:0 0 0 2024-04-16T14:35:38.953 INFO:tasks.workunit.client.1.smithi115.stdout:4/438: dread - d1/d15/d1e/f5d zero size 2024-04-16T14:35:38.955 INFO:tasks.workunit.client.1.smithi115.stdout:1/411: rename df/d13/d4d/d2c/f76 to df/d13/d4d/d6d/f86 0 2024-04-16T14:35:38.956 INFO:tasks.workunit.client.1.smithi115.stdout:4/439: rmdir d1 39 2024-04-16T14:35:38.956 INFO:tasks.workunit.client.1.smithi115.stdout:4/440: chown d1/d15/d31/d55 2 1 2024-04-16T14:35:38.956 INFO:tasks.workunit.client.1.smithi115.stdout:4/441: write d1/d2/f8 [2754976,96107] 0 2024-04-16T14:35:38.956 INFO:tasks.workunit.client.0.smithi005.stdout:4/913: rename d0/d22/d61/ded/dfa/cfc to d0/d1b/db7/c123 0 2024-04-16T14:35:38.957 INFO:tasks.workunit.client.1.smithi115.stdout:3/486: rename dc/d29/d39/c50 to dc/d24/d36/d60/ca2 0 2024-04-16T14:35:38.959 INFO:tasks.workunit.client.0.smithi005.stdout:7/760: mknod d1/d49/c100 0 2024-04-16T14:35:38.959 INFO:tasks.workunit.client.1.smithi115.stdout:1/412: symlink df/d2d/l87 0 2024-04-16T14:35:38.959 INFO:tasks.workunit.client.1.smithi115.stdout:1/413: truncate df/d13/d4d/d3e/d75/f7e 846352 0 2024-04-16T14:35:38.960 INFO:tasks.workunit.client.0.smithi005.stdout:2/475: dread d0/d4/d2b/f11 [0,4194304] 0 2024-04-16T14:35:38.960 INFO:tasks.workunit.client.1.smithi115.stdout:7/400: dwrite d0/d1/d3b/d3e/f54 [4194304,4194304] 0 2024-04-16T14:35:38.961 INFO:tasks.workunit.client.1.smithi115.stdout:4/442: creat d1/d15/d17/f74 x:0 0 0 2024-04-16T14:35:38.961 INFO:tasks.workunit.client.1.smithi115.stdout:4/443: fdatasync d1/d15/d31/d42/f70 0 2024-04-16T14:35:38.961 INFO:tasks.workunit.client.1.smithi115.stdout:4/444: truncate d1/d15/d1e/f65 4358159 0 2024-04-16T14:35:38.962 INFO:tasks.workunit.client.1.smithi115.stdout:3/487: dread dc/fe [0,4194304] 0 2024-04-16T14:35:38.962 INFO:tasks.workunit.client.0.smithi005.stdout:5/698: dwrite d0/d6/d12/dc0/d6d/fd6 [0,4194304] 0 2024-04-16T14:35:38.963 INFO:tasks.workunit.client.1.smithi115.stdout:5/396: rename dc/d3d/d41/l83 to dc/d15/d35/d69/l86 0 2024-04-16T14:35:38.964 INFO:tasks.workunit.client.1.smithi115.stdout:2/484: write d0/d1b/f41 [673221,56115] 0 2024-04-16T14:35:38.967 INFO:tasks.workunit.client.0.smithi005.stdout:1/900: write d2/d1c/d15/f9c [1379733,128774] 0 2024-04-16T14:35:38.967 INFO:tasks.workunit.client.1.smithi115.stdout:0/346: dread f1 [4194304,4194304] 0 2024-04-16T14:35:38.968 INFO:tasks.workunit.client.1.smithi115.stdout:1/414: rename df/d13/d4d/f4f to df/d35/f88 0 2024-04-16T14:35:38.968 INFO:tasks.workunit.client.1.smithi115.stdout:1/415: chown df/d2d/c6e 1402699 1 2024-04-16T14:35:38.972 INFO:tasks.workunit.client.0.smithi005.stdout:6/854: rename d2/d5/f37 to d2/d5/d10/dd6/d7a/f120 0 2024-04-16T14:35:38.973 INFO:tasks.workunit.client.1.smithi115.stdout:5/397: mkdir dc/d15/d35/d87 0 2024-04-16T14:35:38.973 INFO:tasks.workunit.client.1.smithi115.stdout:5/398: chown dc/d15/d35/l5b 1406821304 1 2024-04-16T14:35:38.973 INFO:tasks.workunit.client.1.smithi115.stdout:8/438: dwrite d0/db/d10/d17/f40 [0,4194304] 0 2024-04-16T14:35:38.975 INFO:tasks.workunit.client.0.smithi005.stdout:7/761: symlink d1/dc/l101 0 2024-04-16T14:35:38.975 INFO:tasks.workunit.client.1.smithi115.stdout:3/488: dread dc/d24/d33/d4b/d81/f95 [0,4194304] 0 2024-04-16T14:35:38.978 INFO:tasks.workunit.client.0.smithi005.stdout:2/476: unlink d0/d4/d2b/d6b/f80 0 2024-04-16T14:35:38.978 INFO:tasks.workunit.client.0.smithi005.stdout:2/477: truncate d0/d4/f3b 1810692 0 2024-04-16T14:35:38.978 INFO:tasks.workunit.client.0.smithi005.stdout:2/478: creat d0/d29/d89/fa0 x:0 0 0 2024-04-16T14:35:38.978 INFO:tasks.workunit.client.0.smithi005.stdout:2/479: fdatasync d0/d4/f62 0 2024-04-16T14:35:38.978 INFO:tasks.workunit.client.0.smithi005.stdout:2/480: readlink d0/d4/l26 0 2024-04-16T14:35:38.978 INFO:tasks.workunit.client.0.smithi005.stdout:2/481: chown d0/d29 183 1 2024-04-16T14:35:38.978 INFO:tasks.workunit.client.0.smithi005.stdout:2/482: write d0/d2a/d3a/f96 [975964,85819] 0 2024-04-16T14:35:38.978 INFO:tasks.workunit.client.0.smithi005.stdout:2/483: dread - d0/d4/f66 zero size 2024-04-16T14:35:38.978 INFO:tasks.workunit.client.0.smithi005.stdout:2/484: write d0/d2a/d3a/f76 [113912,14602] 0 2024-04-16T14:35:38.979 INFO:tasks.workunit.client.0.smithi005.stdout:5/699: write d0/f28 [3173511,117007] 0 2024-04-16T14:35:38.980 INFO:tasks.workunit.client.1.smithi115.stdout:2/485: readlink d0/d4/l4d 0 2024-04-16T14:35:38.982 INFO:tasks.workunit.client.1.smithi115.stdout:7/401: dread d0/d1/d3b/f4c [0,4194304] 0 2024-04-16T14:35:38.982 INFO:tasks.workunit.client.1.smithi115.stdout:7/402: chown d0/d1/d3b/f50 3588 1 2024-04-16T14:35:38.982 INFO:tasks.workunit.client.1.smithi115.stdout:7/403: readlink d0/l2a 0 2024-04-16T14:35:38.982 INFO:tasks.workunit.client.1.smithi115.stdout:7/404: truncate d0/d24/d40/f6a 582316 0 2024-04-16T14:35:38.982 INFO:tasks.workunit.client.1.smithi115.stdout:7/405: stat d0/d2/d3a/d30/c46 0 2024-04-16T14:35:38.983 INFO:tasks.workunit.client.1.smithi115.stdout:0/347: truncate d6/d10/d12/d1f/d36/d4b/d6d/f76 1224771 0 2024-04-16T14:35:38.984 INFO:tasks.workunit.client.1.smithi115.stdout:4/445: write d1/d15/f64 [3975475,97296] 0 2024-04-16T14:35:38.984 INFO:tasks.workunit.client.1.smithi115.stdout:4/446: fsync d1/f68 0 2024-04-16T14:35:38.984 INFO:tasks.workunit.client.0.smithi005.stdout:9/477: rmdir d3 39 2024-04-16T14:35:38.986 INFO:tasks.workunit.client.1.smithi115.stdout:3/489: dread dc/d29/f7b [0,4194304] 0 2024-04-16T14:35:38.989 INFO:tasks.workunit.client.1.smithi115.stdout:8/439: rename d0/db/d10/d17/d2c/d52/d74/d3b/f77 to d0/db/d10/d17/d2c/d52/d6c/f87 0 2024-04-16T14:35:38.991 INFO:tasks.workunit.client.1.smithi115.stdout:0/348: truncate d6/d10/d12/d1f/d36/d4b/d6d/f3d 352357 0 2024-04-16T14:35:38.991 INFO:tasks.workunit.client.1.smithi115.stdout:0/349: chown d6/d10/d12/d31/f39 178 1 2024-04-16T14:35:38.994 INFO:tasks.workunit.client.0.smithi005.stdout:8/678: rename d5/d7b/da8/c99 to d5/d40/d4b/cf0 0 2024-04-16T14:35:38.995 INFO:tasks.workunit.client.0.smithi005.stdout:8/679: creat d5/d40/d8e/ff1 x:0 0 0 2024-04-16T14:35:38.995 INFO:tasks.workunit.client.1.smithi115.stdout:8/440: link d0/db/d10/d17/d2c/d61/c63 d0/db/d10/d17/d2c/d52/d74/c88 0 2024-04-16T14:35:38.996 INFO:tasks.workunit.client.0.smithi005.stdout:6/855: creat d2/d20/d3c/dcf/d6e/f121 x:0 0 0 2024-04-16T14:35:38.998 INFO:tasks.workunit.client.1.smithi115.stdout:7/406: read d0/d1/d3b/d3e/f56 [493156,63774] 0 2024-04-16T14:35:38.998 INFO:tasks.workunit.client.0.smithi005.stdout:2/485: creat d0/d1c/d59/d67/fa1 x:0 0 0 2024-04-16T14:35:38.999 INFO:tasks.workunit.client.1.smithi115.stdout:3/490: rename dc/d24/d33/d4b/d65 to dc/d24/d33/d4b/da3 0 2024-04-16T14:35:38.999 INFO:tasks.workunit.client.1.smithi115.stdout:7/407: truncate d0/d24/f61 201200 0 2024-04-16T14:35:39.000 INFO:tasks.workunit.client.0.smithi005.stdout:9/478: unlink d3/d12/d2b/f72 0 2024-04-16T14:35:39.003 INFO:tasks.workunit.client.1.smithi115.stdout:0/350: write d6/d10/d12/d1f/d36/d4b/f6a [2390486,70373] 0 2024-04-16T14:35:39.003 INFO:tasks.workunit.client.0.smithi005.stdout:1/901: rmdir d2/d1c/d15/d2a/d19/d20/d27/d73 39 2024-04-16T14:35:39.003 INFO:tasks.workunit.client.0.smithi005.stdout:1/902: chown d2/d1c/d15/d2a/d19/d20/d27/d73 9272755 1 2024-04-16T14:35:39.005 INFO:tasks.workunit.client.1.smithi115.stdout:7/408: dread d0/d1/d3b/d3e/f5f [0,4194304] 0 2024-04-16T14:35:39.005 INFO:tasks.workunit.client.1.smithi115.stdout:0/351: getdents d6/d10/d12/d1f/d36/d4b 0 2024-04-16T14:35:39.006 INFO:tasks.workunit.client.0.smithi005.stdout:8/680: link d5/d11/f47 d5/d7b/da8/da5/def/d71/ff2 0 2024-04-16T14:35:39.008 INFO:tasks.workunit.client.1.smithi115.stdout:7/409: unlink d0/d1/d3b/d49/f4d 0 2024-04-16T14:35:39.008 INFO:tasks.workunit.client.0.smithi005.stdout:7/762: getdents d1/d49/d74/d77 0 2024-04-16T14:35:39.009 INFO:tasks.workunit.client.0.smithi005.stdout:2/486: dread d0/d4/d2b/f17 [0,4194304] 0 2024-04-16T14:35:39.009 INFO:tasks.workunit.client.1.smithi115.stdout:0/352: creat d6/d10/d12/d1f/d36/f7e x:0 0 0 2024-04-16T14:35:39.009 INFO:tasks.workunit.client.1.smithi115.stdout:0/353: creat d6/d1b/f7f x:0 0 0 2024-04-16T14:35:39.010 INFO:tasks.workunit.client.0.smithi005.stdout:9/479: creat d3/d12/d16/d86/f87 x:0 0 0 2024-04-16T14:35:39.010 INFO:tasks.workunit.client.0.smithi005.stdout:9/480: write d3/f14 [601202,79892] 0 2024-04-16T14:35:39.010 INFO:tasks.workunit.client.0.smithi005.stdout:9/481: readlink d3/d49/d4b/l7f 0 2024-04-16T14:35:39.012 INFO:tasks.workunit.client.0.smithi005.stdout:8/681: creat d5/d7b/da8/db7/ff3 x:0 0 0 2024-04-16T14:35:39.012 INFO:tasks.workunit.client.0.smithi005.stdout:8/682: readlink d5/l2d 0 2024-04-16T14:35:39.012 INFO:tasks.workunit.client.1.smithi115.stdout:7/410: rename d0/c23 to d0/d1/d3b/d3f/d7a/d80/d81/c8b 0 2024-04-16T14:35:39.014 INFO:tasks.workunit.client.0.smithi005.stdout:7/763: creat d1/d49/d74/d77/d57/d47/d8d/f102 x:0 0 0 2024-04-16T14:35:39.014 INFO:tasks.workunit.client.0.smithi005.stdout:7/764: dread - d1/d49/d74/d77/fe6 zero size 2024-04-16T14:35:39.015 INFO:tasks.workunit.client.1.smithi115.stdout:3/491: read dc/d24/d33/d4b/d81/f92 [2021672,1761] 0 2024-04-16T14:35:39.015 INFO:tasks.workunit.client.1.smithi115.stdout:3/492: chown dc/c19 1450 1 2024-04-16T14:35:39.015 INFO:tasks.workunit.client.1.smithi115.stdout:2/486: dwrite d0/f1a [0,4194304] 0 2024-04-16T14:35:39.016 INFO:tasks.workunit.client.1.smithi115.stdout:2/487: write d0/d47/d65/f7b [762716,107889] 0 2024-04-16T14:35:39.016 INFO:tasks.workunit.client.1.smithi115.stdout:5/399: dwrite dc/d3d/d68/d7b/f84 [0,4194304] 0 2024-04-16T14:35:39.017 INFO:tasks.workunit.client.0.smithi005.stdout:4/914: dwrite d0/f26 [0,4194304] 0 2024-04-16T14:35:39.017 INFO:tasks.workunit.client.0.smithi005.stdout:6/856: dread d2/d20/d33/f63 [0,4194304] 0 2024-04-16T14:35:39.017 INFO:tasks.workunit.client.0.smithi005.stdout:5/700: dwrite d0/d6/d6e/d9e/fdf [0,4194304] 0 2024-04-16T14:35:39.022 INFO:tasks.workunit.client.1.smithi115.stdout:7/411: rename d0/d1/d3b/d3e/c42 to d0/d1/d3b/d3f/d7a/c8c 0 2024-04-16T14:35:39.022 INFO:tasks.workunit.client.1.smithi115.stdout:1/416: dwrite df/d13/f16 [0,4194304] 0 2024-04-16T14:35:39.022 INFO:tasks.workunit.client.1.smithi115.stdout:5/400: write dc/d3d/d41/f82 [580309,116642] 0 2024-04-16T14:35:39.022 INFO:tasks.workunit.client.1.smithi115.stdout:2/488: creat d0/fa1 x:0 0 0 2024-04-16T14:35:39.022 INFO:tasks.workunit.client.1.smithi115.stdout:4/447: fsync d1/d15/d31/d55/f73 0 2024-04-16T14:35:39.023 INFO:tasks.workunit.client.0.smithi005.stdout:9/482: rename d3/d12/d16/f1a to d3/d77/f88 0 2024-04-16T14:35:39.023 INFO:tasks.workunit.client.0.smithi005.stdout:8/683: symlink d5/d7b/da8/db7/d8a/da1/d68/lf4 0 2024-04-16T14:35:39.023 INFO:tasks.workunit.client.0.smithi005.stdout:2/487: dread d0/d1c/f83 [0,4194304] 0 2024-04-16T14:35:39.023 INFO:tasks.workunit.client.0.smithi005.stdout:2/488: dread - d0/d4/f62 zero size 2024-04-16T14:35:39.023 INFO:tasks.workunit.client.0.smithi005.stdout:4/915: symlink d0/d22/d29/l124 0 2024-04-16T14:35:39.024 INFO:tasks.workunit.client.1.smithi115.stdout:6/498: dwrite d13/d1d/d2b/d5f/d30/d43/da6/f8a [0,4194304] 0 2024-04-16T14:35:39.024 INFO:tasks.workunit.client.1.smithi115.stdout:6/499: write d13/d1d/d52/d8c/f98 [649133,7602] 0 2024-04-16T14:35:39.027 INFO:tasks.workunit.client.0.smithi005.stdout:6/857: link d2/d20/df9/cfb d2/d20/d72/c122 0 2024-04-16T14:35:39.027 INFO:tasks.workunit.client.1.smithi115.stdout:1/417: mknod df/d13/d4d/d2c/d54/c89 0 2024-04-16T14:35:39.028 INFO:tasks.workunit.client.1.smithi115.stdout:8/441: dwrite d0/db/d10/d17/d2c/d52/d74/f35 [4194304,4194304] 0 2024-04-16T14:35:39.028 INFO:tasks.workunit.client.0.smithi005.stdout:5/701: mkdir d0/d6/d12/d1c/d1e/d73/df0 0 2024-04-16T14:35:39.032 INFO:tasks.workunit.client.1.smithi115.stdout:5/401: symlink dc/d15/d35/l88 0 2024-04-16T14:35:39.032 INFO:tasks.workunit.client.1.smithi115.stdout:3/493: read dc/f67 [2987832,114705] 0 2024-04-16T14:35:39.035 INFO:tasks.workunit.client.0.smithi005.stdout:4/916: mknod d0/d1b/d1d/d1f/d5d/da7/d90/de4/c125 0 2024-04-16T14:35:39.036 INFO:tasks.workunit.client.1.smithi115.stdout:2/489: dread d0/d4/d4a/f81 [0,4194304] 0 2024-04-16T14:35:39.038 INFO:tasks.workunit.client.1.smithi115.stdout:2/490: fsync d0/d4/d24/d10/f89 0 2024-04-16T14:35:39.040 INFO:tasks.workunit.client.1.smithi115.stdout:6/500: getdents d13/d1d/d52 0 2024-04-16T14:35:39.040 INFO:tasks.workunit.client.1.smithi115.stdout:6/501: readlink d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/l95 0 2024-04-16T14:35:39.040 INFO:tasks.workunit.client.1.smithi115.stdout:6/502: truncate d13/f8e 203045 0 2024-04-16T14:35:39.042 INFO:tasks.workunit.client.0.smithi005.stdout:6/858: mkdir d2/d3f/d123 0 2024-04-16T14:35:39.043 INFO:tasks.workunit.client.0.smithi005.stdout:5/702: symlink d0/d6/d12/d1c/dd2/lf1 0 2024-04-16T14:35:39.045 INFO:tasks.workunit.client.0.smithi005.stdout:8/684: rmdir d5/d7b/da8/db7/d8a/da1/d68/dcb/dd9 39 2024-04-16T14:35:39.045 INFO:tasks.workunit.client.0.smithi005.stdout:8/685: stat d5/d40/d8e/fce 0 2024-04-16T14:35:39.046 INFO:tasks.workunit.client.1.smithi115.stdout:8/442: mkdir d0/db/d10/d17/d2c/d61/d64/d89 0 2024-04-16T14:35:39.046 INFO:tasks.workunit.client.1.smithi115.stdout:8/443: dread - d0/db/d44/f59 zero size 2024-04-16T14:35:39.046 INFO:tasks.workunit.client.1.smithi115.stdout:8/444: chown d0/db/d10/d25/l65 153512825 1 2024-04-16T14:35:39.046 INFO:tasks.workunit.client.1.smithi115.stdout:0/354: dwrite d6/d1b/f7c [0,4194304] 0 2024-04-16T14:35:39.047 INFO:tasks.workunit.client.1.smithi115.stdout:0/355: fdatasync d6/d1b/f7d 0 2024-04-16T14:35:39.047 INFO:tasks.workunit.client.0.smithi005.stdout:6/859: mknod d2/d20/d72/c124 0 2024-04-16T14:35:39.047 INFO:tasks.workunit.client.0.smithi005.stdout:6/860: creat d2/d20/df9/f125 x:0 0 0 2024-04-16T14:35:39.047 INFO:tasks.workunit.client.0.smithi005.stdout:6/861: truncate d2/d3f/f71 126296 0 2024-04-16T14:35:39.048 INFO:tasks.workunit.client.0.smithi005.stdout:6/862: fsync d2/d20/d72/fd9 0 2024-04-16T14:35:39.050 INFO:tasks.workunit.client.0.smithi005.stdout:5/703: unlink d0/d6/d12/dc0/d8d/d5e/fc5 0 2024-04-16T14:35:39.056 INFO:tasks.workunit.client.0.smithi005.stdout:6/863: truncate d2/d5/d10/dd6/f6d 714127 0 2024-04-16T14:35:39.056 INFO:tasks.workunit.client.0.smithi005.stdout:5/704: symlink d0/d6/d12/lf2 0 2024-04-16T14:35:39.056 INFO:tasks.workunit.client.0.smithi005.stdout:6/864: write d2/d20/d3c/dcf/d6e/f121 [481470,32725] 0 2024-04-16T14:35:39.056 INFO:tasks.workunit.client.0.smithi005.stdout:5/705: fsync d0/f26 0 2024-04-16T14:35:39.057 INFO:tasks.workunit.client.0.smithi005.stdout:5/706: write d0/d70/fe6 [1857982,106893] 0 2024-04-16T14:35:39.059 INFO:tasks.workunit.client.0.smithi005.stdout:6/865: creat d2/d3f/d47/d84/da5/d11f/f126 x:0 0 0 2024-04-16T14:35:39.064 INFO:tasks.workunit.client.0.smithi005.stdout:4/917: dread d0/f26 [0,4194304] 0 2024-04-16T14:35:39.065 INFO:tasks.workunit.client.0.smithi005.stdout:5/707: rename d0/d70/db3/f9f to d0/d70/ff3 0 2024-04-16T14:35:39.069 INFO:tasks.workunit.client.0.smithi005.stdout:5/708: rmdir d0/d6/d12/dc0/d8d/dd8 39 2024-04-16T14:35:39.069 INFO:tasks.workunit.client.0.smithi005.stdout:5/709: write d0/d70/f90 [7863837,33095] 0 2024-04-16T14:35:39.070 INFO:tasks.workunit.client.1.smithi115.stdout:8/445: mkdir d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/d8a 0 2024-04-16T14:35:39.070 INFO:tasks.workunit.client.1.smithi115.stdout:8/446: fdatasync d0/db/f26 0 2024-04-16T14:35:39.070 INFO:tasks.workunit.client.0.smithi005.stdout:6/866: dread d2/d5/d28/db8/fed [0,4194304] 0 2024-04-16T14:35:39.072 INFO:tasks.workunit.client.1.smithi115.stdout:3/494: rmdir dc/d29/d4d 39 2024-04-16T14:35:39.073 INFO:tasks.workunit.client.0.smithi005.stdout:5/710: rmdir d0/d6/d12/dcc/dec 0 2024-04-16T14:35:39.074 INFO:tasks.workunit.client.1.smithi115.stdout:8/447: creat d0/db/d10/d17/d2c/d61/d64/d89/f8b x:0 0 0 2024-04-16T14:35:39.075 INFO:tasks.workunit.client.0.smithi005.stdout:5/711: symlink d0/d6/d12/d1c/d1e/de7/lf4 0 2024-04-16T14:35:39.075 INFO:tasks.workunit.client.1.smithi115.stdout:0/356: link d6/d1b/f7f d6/d10/d12/f80 0 2024-04-16T14:35:39.076 INFO:tasks.workunit.client.1.smithi115.stdout:3/495: mknod dc/d29/d4d/d56/d7e/ca4 0 2024-04-16T14:35:39.078 INFO:tasks.workunit.client.1.smithi115.stdout:8/448: unlink d0/db/c3f 0 2024-04-16T14:35:39.079 INFO:tasks.workunit.client.1.smithi115.stdout:0/357: symlink d6/d1b/l81 0 2024-04-16T14:35:39.079 INFO:tasks.workunit.client.0.smithi005.stdout:4/918: write d0/d1b/d1d/d1f/d5d/f93 [312122,20305] 0 2024-04-16T14:35:39.080 INFO:tasks.workunit.client.1.smithi115.stdout:3/496: creat dc/d29/d4d/d56/d8a/fa5 x:0 0 0 2024-04-16T14:35:39.081 INFO:tasks.workunit.client.0.smithi005.stdout:4/919: symlink d0/d1b/d1d/d4f/d75/l126 0 2024-04-16T14:35:39.081 INFO:tasks.workunit.client.1.smithi115.stdout:8/449: creat d0/db/d10/d17/d2c/d61/d64/f8c x:0 0 0 2024-04-16T14:35:39.083 INFO:tasks.workunit.client.1.smithi115.stdout:0/358: mknod d6/d54/c82 0 2024-04-16T14:35:39.083 INFO:tasks.workunit.client.1.smithi115.stdout:0/359: write d6/d30/f43 [437084,8962] 0 2024-04-16T14:35:39.083 INFO:tasks.workunit.client.1.smithi115.stdout:0/360: write d6/d1b/f6c [889425,16009] 0 2024-04-16T14:35:39.083 INFO:tasks.workunit.client.1.smithi115.stdout:0/361: write d6/d10/d12/d31/f39 [928547,118723] 0 2024-04-16T14:35:39.083 INFO:tasks.workunit.client.1.smithi115.stdout:0/362: dread - d6/d10/d12/d31/d35/f59 zero size 2024-04-16T14:35:39.083 INFO:tasks.workunit.client.1.smithi115.stdout:0/363: write d6/d10/d12/d1f/d36/d4b/d6d/f3d [531720,6430] 0 2024-04-16T14:35:39.084 INFO:tasks.workunit.client.0.smithi005.stdout:4/920: link d0/d1b/d1d/d1f/d48/f8a d0/d1b/db7/d100/f127 0 2024-04-16T14:35:39.084 INFO:tasks.workunit.client.0.smithi005.stdout:4/921: fsync d0/d1b/d1d/d1f/d48/dab/fa6 0 2024-04-16T14:35:39.085 INFO:tasks.workunit.client.0.smithi005.stdout:4/922: truncate d0/d1b/d1d/d1f/d3e/feb 384468 0 2024-04-16T14:35:39.090 INFO:tasks.workunit.client.0.smithi005.stdout:7/765: dwrite d1/dc/d2f/f3e [0,4194304] 0 2024-04-16T14:35:39.091 INFO:tasks.workunit.client.1.smithi115.stdout:4/448: dwrite d1/d15/d31/d42/d46/f63 [0,4194304] 0 2024-04-16T14:35:39.094 INFO:tasks.workunit.client.1.smithi115.stdout:4/449: mknod d1/d15/d31/c75 0 2024-04-16T14:35:39.095 INFO:tasks.workunit.client.0.smithi005.stdout:2/489: dwrite d0/d29/d3e/f57 [0,4194304] 0 2024-04-16T14:35:39.096 INFO:tasks.workunit.client.0.smithi005.stdout:2/490: mkdir d0/d1c/d39/d85/da2 0 2024-04-16T14:35:39.096 INFO:tasks.workunit.client.0.smithi005.stdout:2/491: getdents d0/d4/d2b/d5e/d9a 0 2024-04-16T14:35:39.096 INFO:tasks.workunit.client.0.smithi005.stdout:2/492: dread - d0/d4/d2b/d5e/f70 zero size 2024-04-16T14:35:39.096 INFO:tasks.workunit.client.0.smithi005.stdout:2/493: readlink d0/d1c/l2c 0 2024-04-16T14:35:39.096 INFO:tasks.workunit.client.1.smithi115.stdout:4/450: symlink d1/d15/d17/l76 0 2024-04-16T14:35:39.097 INFO:tasks.workunit.client.1.smithi115.stdout:4/451: fdatasync d1/d15/f58 0 2024-04-16T14:35:39.099 INFO:tasks.workunit.client.1.smithi115.stdout:8/450: read d0/db/d10/d17/d2c/f5e [1400126,18492] 0 2024-04-16T14:35:39.099 INFO:tasks.workunit.client.1.smithi115.stdout:8/451: chown d0/l5c 144632286 1 2024-04-16T14:35:39.100 INFO:tasks.workunit.client.1.smithi115.stdout:8/452: symlink d0/db/d10/d17/d2c/d85/l8d 0 2024-04-16T14:35:39.102 INFO:tasks.workunit.client.1.smithi115.stdout:8/453: mkdir d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/d8a/d8e 0 2024-04-16T14:35:39.117 INFO:tasks.workunit.client.1.smithi115.stdout:2/491: dwrite d0/d4/d24/d21/d3b/f3f [0,4194304] 0 2024-04-16T14:35:39.117 INFO:tasks.workunit.client.1.smithi115.stdout:2/492: fsync d0/d4/d24/d10/f89 0 2024-04-16T14:35:39.118 INFO:tasks.workunit.client.1.smithi115.stdout:2/493: symlink d0/d47/d65/la2 0 2024-04-16T14:35:39.118 INFO:tasks.workunit.client.1.smithi115.stdout:2/494: fsync d0/d47/d65/d61/d70/f91 0 2024-04-16T14:35:39.118 INFO:tasks.workunit.client.1.smithi115.stdout:2/495: write d0/d4/d4a/f81 [2563783,26102] 0 2024-04-16T14:35:39.118 INFO:tasks.workunit.client.1.smithi115.stdout:2/496: chown d0/d1b/c54 12 1 2024-04-16T14:35:39.118 INFO:tasks.workunit.client.1.smithi115.stdout:2/497: stat d0/d1b/c58 0 2024-04-16T14:35:39.119 INFO:tasks.workunit.client.1.smithi115.stdout:2/498: rename d0/d4/de/c14 to d0/d4/d57/ca3 0 2024-04-16T14:35:39.119 INFO:tasks.workunit.client.1.smithi115.stdout:2/499: dread - d0/d4/d24/d10/f7e zero size 2024-04-16T14:35:39.120 INFO:tasks.workunit.client.1.smithi115.stdout:2/500: rename d0/d4/d57/l78 to d0/d4/d24/d21/d59/la4 0 2024-04-16T14:35:39.121 INFO:tasks.workunit.client.1.smithi115.stdout:2/501: write d0/d4/de/d11/f62 [394742,65112] 0 2024-04-16T14:35:39.121 INFO:tasks.workunit.client.1.smithi115.stdout:2/502: stat d0/d4/d57/ca3 0 2024-04-16T14:35:39.122 INFO:tasks.workunit.client.0.smithi005.stdout:7/766: dread d1/dc/d2f/f3e [0,4194304] 0 2024-04-16T14:35:39.122 INFO:tasks.workunit.client.0.smithi005.stdout:7/767: read - d1/d49/d74/d77/d57/d47/daa/fda zero size 2024-04-16T14:35:39.122 INFO:tasks.workunit.client.0.smithi005.stdout:7/768: readlink d1/d49/d74/d77/d22/d27/d2e/l4e 0 2024-04-16T14:35:39.123 INFO:tasks.workunit.client.0.smithi005.stdout:7/769: mkdir d1/d49/d74/d77/d57/d47/daa/d103 0 2024-04-16T14:35:39.123 INFO:tasks.workunit.client.1.smithi115.stdout:2/503: getdents d0/d1b 0 2024-04-16T14:35:39.123 INFO:tasks.workunit.client.1.smithi115.stdout:2/504: truncate d0/d47/d65/d61/f92 1085826 0 2024-04-16T14:35:39.123 INFO:tasks.workunit.client.1.smithi115.stdout:2/505: write d0/d1b/f41 [3178006,28906] 0 2024-04-16T14:35:39.123 INFO:tasks.workunit.client.1.smithi115.stdout:2/506: truncate d0/d4/d24/d10/f7e 189763 0 2024-04-16T14:35:39.125 INFO:tasks.workunit.client.1.smithi115.stdout:5/402: dwrite dc/f1c [0,4194304] 0 2024-04-16T14:35:39.125 INFO:tasks.workunit.client.1.smithi115.stdout:2/507: creat d0/d4/d24/d21/fa5 x:0 0 0 2024-04-16T14:35:39.125 INFO:tasks.workunit.client.1.smithi115.stdout:1/418: dwrite df/d13/d4d/d68/f80 [0,4194304] 0 2024-04-16T14:35:39.125 INFO:tasks.workunit.client.1.smithi115.stdout:1/419: fsync df/d13/f74 0 2024-04-16T14:35:39.125 INFO:tasks.workunit.client.1.smithi115.stdout:1/420: fdatasync df/f7f 0 2024-04-16T14:35:39.125 INFO:tasks.workunit.client.0.smithi005.stdout:9/483: dwrite d3/d12/d16/f19 [0,4194304] 0 2024-04-16T14:35:39.125 INFO:tasks.workunit.client.0.smithi005.stdout:8/686: dwrite d5/d7b/da8/db7/d8a/da1/d3d/d7f/d8d/f97 [0,4194304] 0 2024-04-16T14:35:39.126 INFO:tasks.workunit.client.0.smithi005.stdout:8/687: write d5/d7b/da8/db7/d8a/da1/d3d/fee [1686811,58622] 0 2024-04-16T14:35:39.126 INFO:tasks.workunit.client.0.smithi005.stdout:8/688: chown d5/d55/d5a/ldd 31836 1 2024-04-16T14:35:39.127 INFO:tasks.workunit.client.1.smithi115.stdout:5/403: creat dc/d3d/d68/d7b/f89 x:0 0 0 2024-04-16T14:35:39.128 INFO:tasks.workunit.client.1.smithi115.stdout:2/508: creat d0/d4/d24/d23/d80/fa6 x:0 0 0 2024-04-16T14:35:39.128 INFO:tasks.workunit.client.1.smithi115.stdout:2/509: fsync d0/d4/d24/d21/f74 0 2024-04-16T14:35:39.128 INFO:tasks.workunit.client.1.smithi115.stdout:2/510: creat d0/d4/d24/d21/d3b/fa7 x:0 0 0 2024-04-16T14:35:39.131 INFO:tasks.workunit.client.1.smithi115.stdout:1/421: truncate df/d13/d4d/d2c/f33 228506 0 2024-04-16T14:35:39.132 INFO:tasks.workunit.client.1.smithi115.stdout:5/404: creat dc/d3d/d68/f8a x:0 0 0 2024-04-16T14:35:39.134 INFO:tasks.workunit.client.0.smithi005.stdout:8/689: dread d5/d7b/da8/db7/f1d [0,4194304] 0 2024-04-16T14:35:39.134 INFO:tasks.workunit.client.0.smithi005.stdout:8/690: chown d5/d55/fe0 97914195 1 2024-04-16T14:35:39.135 INFO:tasks.workunit.client.1.smithi115.stdout:2/511: mknod d0/d4/d24/d23/d80/ca8 0 2024-04-16T14:35:39.135 INFO:tasks.workunit.client.1.smithi115.stdout:2/512: fdatasync d0/d47/d65/f77 0 2024-04-16T14:35:39.137 INFO:tasks.workunit.client.1.smithi115.stdout:6/503: dwrite d13/d1d/d47/fa3 [0,4194304] 0 2024-04-16T14:35:39.138 INFO:tasks.workunit.client.0.smithi005.stdout:4/923: dwrite d0/d1b/d1d/d1f/d3e/f55 [0,4194304] 0 2024-04-16T14:35:39.138 INFO:tasks.workunit.client.0.smithi005.stdout:8/691: symlink d5/d7b/da8/db7/d8a/da1/lf5 0 2024-04-16T14:35:39.138 INFO:tasks.workunit.client.0.smithi005.stdout:2/494: dwrite d0/d29/d3e/f42 [0,4194304] 0 2024-04-16T14:35:39.139 INFO:tasks.workunit.client.0.smithi005.stdout:2/495: dread - d0/d29/d89/f8b zero size 2024-04-16T14:35:39.139 INFO:tasks.workunit.client.0.smithi005.stdout:2/496: chown d0/d2a/c3d 85587 1 2024-04-16T14:35:39.139 INFO:tasks.workunit.client.0.smithi005.stdout:6/867: dwrite d2/d5/d10/fd1 [0,4194304] 0 2024-04-16T14:35:39.140 INFO:tasks.workunit.client.1.smithi115.stdout:5/405: write dc/d15/d4d/f6f [815828,63399] 0 2024-04-16T14:35:39.140 INFO:tasks.workunit.client.1.smithi115.stdout:2/513: write d0/d4/f3a [16101,92811] 0 2024-04-16T14:35:39.140 INFO:tasks.workunit.client.1.smithi115.stdout:0/364: dwrite d6/d10/d12/d31/d35/d28/f49 [0,4194304] 0 2024-04-16T14:35:39.140 INFO:tasks.workunit.client.1.smithi115.stdout:3/497: dwrite dc/f16 [0,4194304] 0 2024-04-16T14:35:39.140 INFO:tasks.workunit.client.1.smithi115.stdout:3/498: write dc/d24/d36/d60/f78 [819977,48566] 0 2024-04-16T14:35:39.140 INFO:tasks.workunit.client.1.smithi115.stdout:3/499: readlink dc/d29/l38 0 2024-04-16T14:35:39.140 INFO:tasks.workunit.client.1.smithi115.stdout:8/454: dwrite d0/db/d10/d17/d2c/d52/d74/f45 [0,4194304] 0 2024-04-16T14:35:39.140 INFO:tasks.workunit.client.1.smithi115.stdout:8/455: chown d0/db/d10/d17/d2c/l7a 204 1 2024-04-16T14:35:39.141 INFO:tasks.workunit.client.0.smithi005.stdout:4/924: rename d0/d1b/d1d/d1f/d3e/c121 to d0/d22/d29/d107/c128 0 2024-04-16T14:35:39.147 INFO:tasks.workunit.client.0.smithi005.stdout:2/497: link d0/d1c/d39/l7d d0/d2a/la3 0 2024-04-16T14:35:39.147 INFO:tasks.workunit.client.0.smithi005.stdout:2/498: creat d0/d1c/d39/fa4 x:0 0 0 2024-04-16T14:35:39.147 INFO:tasks.workunit.client.0.smithi005.stdout:2/499: creat d0/d1c/fa5 x:0 0 0 2024-04-16T14:35:39.147 INFO:tasks.workunit.client.0.smithi005.stdout:2/500: chown d0/d1c/d39/d85 2 1 2024-04-16T14:35:39.151 INFO:tasks.workunit.client.0.smithi005.stdout:6/868: mkdir d2/de1/d127 0 2024-04-16T14:35:39.153 INFO:tasks.workunit.client.0.smithi005.stdout:4/925: creat d0/d1b/d1d/d1f/d5d/da9/f129 x:0 0 0 2024-04-16T14:35:39.155 INFO:tasks.workunit.client.1.smithi115.stdout:5/406: dread f2 [0,4194304] 0 2024-04-16T14:35:39.155 INFO:tasks.workunit.client.1.smithi115.stdout:5/407: read - dc/d3d/d68/d7b/f89 zero size 2024-04-16T14:35:39.155 INFO:tasks.workunit.client.1.smithi115.stdout:2/514: rename d0/d4/d24/d21/d3b/fa7 to d0/d4/d4a/fa9 0 2024-04-16T14:35:39.156 INFO:tasks.workunit.client.1.smithi115.stdout:2/515: read d0/d1b/f41 [1756770,26790] 0 2024-04-16T14:35:39.158 INFO:tasks.workunit.client.1.smithi115.stdout:3/500: mknod dc/d29/d77/ca6 0 2024-04-16T14:35:39.160 INFO:tasks.workunit.client.0.smithi005.stdout:6/869: symlink d2/d45/d7b/dd2/l128 0 2024-04-16T14:35:39.161 INFO:tasks.workunit.client.0.smithi005.stdout:2/501: dread d0/d29/f49 [0,4194304] 0 2024-04-16T14:35:39.162 INFO:tasks.workunit.client.0.smithi005.stdout:4/926: symlink d0/d1b/d1d/dc3/d103/l12a 0 2024-04-16T14:35:39.163 INFO:tasks.workunit.client.0.smithi005.stdout:6/870: truncate f0 1924179 0 2024-04-16T14:35:39.167 INFO:tasks.workunit.client.0.smithi005.stdout:2/502: creat d0/d1c/d39/d85/fa6 x:0 0 0 2024-04-16T14:35:39.167 INFO:tasks.workunit.client.0.smithi005.stdout:6/871: rmdir d2/d3f/d47/d84/d8c 39 2024-04-16T14:35:39.167 INFO:tasks.workunit.client.0.smithi005.stdout:6/872: chown d2/d3f/d47/d84/d8c 217 1 2024-04-16T14:35:39.167 INFO:tasks.workunit.client.0.smithi005.stdout:6/873: write d2/d3f/d53/d54/db5/ffe [795026,110095] 0 2024-04-16T14:35:39.167 INFO:tasks.workunit.client.0.smithi005.stdout:6/874: dread - d2/d45/d7b/dd2/f108 zero size 2024-04-16T14:35:39.167 INFO:tasks.workunit.client.0.smithi005.stdout:6/875: fdatasync d2/d3f/d47/d84/dbf/feb 0 2024-04-16T14:35:39.167 INFO:tasks.workunit.client.0.smithi005.stdout:4/927: dread d0/d1b/d1d/d1f/d3e/daa/ff1 [0,4194304] 0 2024-04-16T14:35:39.167 INFO:tasks.workunit.client.0.smithi005.stdout:4/928: write d0/d1b/d1d/d1f/d5d/da7/d90/fd3 [5109845,112926] 0 2024-04-16T14:35:39.168 INFO:tasks.workunit.client.0.smithi005.stdout:2/503: creat d0/d1c/d39/d85/da2/fa7 x:0 0 0 2024-04-16T14:35:39.168 INFO:tasks.workunit.client.0.smithi005.stdout:4/929: dread d0/d1b/db7/ddd/f10b [4194304,4194304] 0 2024-04-16T14:35:39.168 INFO:tasks.workunit.client.0.smithi005.stdout:4/930: chown d0/d22/d29/l31 3113877 1 2024-04-16T14:35:39.168 INFO:tasks.workunit.client.0.smithi005.stdout:4/931: chown d0/d1b/d1d/d1f/d48/dab 198 1 2024-04-16T14:35:39.168 INFO:tasks.workunit.client.0.smithi005.stdout:4/932: chown d0/df8 0 1 2024-04-16T14:35:39.169 INFO:tasks.workunit.client.0.smithi005.stdout:6/876: link d2/d5/d28/db8/fb9 d2/d20/d3c/dcf/f129 0 2024-04-16T14:35:39.169 INFO:tasks.workunit.client.0.smithi005.stdout:6/877: chown f0 1324795 1 2024-04-16T14:35:39.169 INFO:tasks.workunit.client.0.smithi005.stdout:6/878: fsync d2/d3f/d47/f52 0 2024-04-16T14:35:39.169 INFO:tasks.workunit.client.0.smithi005.stdout:6/879: fsync d2/d20/d33/fb3 0 2024-04-16T14:35:39.170 INFO:tasks.workunit.client.0.smithi005.stdout:2/504: creat d0/d2a/fa8 x:0 0 0 2024-04-16T14:35:39.170 INFO:tasks.workunit.client.0.smithi005.stdout:2/505: chown d0/d4/d2b/l77 249022 1 2024-04-16T14:35:39.171 INFO:tasks.workunit.client.1.smithi115.stdout:8/456: creat d0/db/d10/d17/d2c/d85/f8f x:0 0 0 2024-04-16T14:35:39.171 INFO:tasks.workunit.client.0.smithi005.stdout:4/933: link d0/d1b/d1d/d1f/d48/dab/db2/cf6 d0/d22/d29/d107/c12b 0 2024-04-16T14:35:39.172 INFO:tasks.workunit.client.1.smithi115.stdout:5/408: rename dc/d3d/c6b to dc/d15/d35/d71/c8b 0 2024-04-16T14:35:39.172 INFO:tasks.workunit.client.0.smithi005.stdout:6/880: truncate d2/d5/d28/f46 1015281 0 2024-04-16T14:35:39.173 INFO:tasks.workunit.client.1.smithi115.stdout:3/501: creat dc/d24/d33/d4b/da3/fa7 x:0 0 0 2024-04-16T14:35:39.174 INFO:tasks.workunit.client.0.smithi005.stdout:2/506: link d0/d2a/d3a/f96 d0/d1c/d8d/fa9 0 2024-04-16T14:35:39.174 INFO:tasks.workunit.client.0.smithi005.stdout:2/507: fsync d0/d29/d3e/f71 0 2024-04-16T14:35:39.175 INFO:tasks.workunit.client.0.smithi005.stdout:2/508: rename d0/d1c/c22 to d0/d1c/d59/d67/caa 0 2024-04-16T14:35:39.176 INFO:tasks.workunit.client.1.smithi115.stdout:8/457: creat d0/db/d10/d17/d2c/d52/d84/f90 x:0 0 0 2024-04-16T14:35:39.177 INFO:tasks.workunit.client.1.smithi115.stdout:4/452: getdents d1/d15/d17 0 2024-04-16T14:35:39.181 INFO:tasks.workunit.client.1.smithi115.stdout:8/458: link d0/db/d10/c23 d0/db/d10/d17/d2c/d61/d64/c91 0 2024-04-16T14:35:39.181 INFO:tasks.workunit.client.0.smithi005.stdout:6/881: write d2/d5/f22 [1753494,39523] 0 2024-04-16T14:35:39.181 INFO:tasks.workunit.client.1.smithi115.stdout:0/365: dwrite d6/d10/d12/d31/d35/d28/f5b [0,4194304] 0 2024-04-16T14:35:39.182 INFO:tasks.workunit.client.1.smithi115.stdout:6/504: dwrite d13/d1d/d2b/d5f/f6a [0,4194304] 0 2024-04-16T14:35:39.182 INFO:tasks.workunit.client.1.smithi115.stdout:6/505: write d13/d1d/d68/fa2 [153471,24682] 0 2024-04-16T14:35:39.182 INFO:tasks.workunit.client.0.smithi005.stdout:7/770: dwrite d1/dc/d2f/f5a [0,4194304] 0 2024-04-16T14:35:39.183 INFO:tasks.workunit.client.0.smithi005.stdout:7/771: write d1/d49/d74/d77/d57/d47/daa/fe4 [310005,125508] 0 2024-04-16T14:35:39.183 INFO:tasks.workunit.client.0.smithi005.stdout:7/772: chown d1/d49/d74/d77/d22/da0/fb2 911351 1 2024-04-16T14:35:39.183 INFO:tasks.workunit.client.0.smithi005.stdout:7/773: creat d1/d49/d74/d77/d57/d47/daa/f104 x:0 0 0 2024-04-16T14:35:39.183 INFO:tasks.workunit.client.0.smithi005.stdout:7/774: creat d1/d49/d74/d77/d22/db0/dc6/f105 x:0 0 0 2024-04-16T14:35:39.183 INFO:tasks.workunit.client.0.smithi005.stdout:9/484: dwrite d3/d12/f6c [0,4194304] 0 2024-04-16T14:35:39.183 INFO:tasks.workunit.client.0.smithi005.stdout:9/485: chown d3/f14 14497849 1 2024-04-16T14:35:39.184 INFO:tasks.workunit.client.1.smithi115.stdout:8/459: rename d0/db/d10/d17/f40 to d0/db/d10/d17/d2c/d52/d6c/f92 0 2024-04-16T14:35:39.184 INFO:tasks.workunit.client.1.smithi115.stdout:8/460: dread - d0/db/d10/d17/d22/f6f zero size 2024-04-16T14:35:39.184 INFO:tasks.workunit.client.0.smithi005.stdout:6/882: creat d2/f12a x:0 0 0 2024-04-16T14:35:39.184 INFO:tasks.workunit.client.0.smithi005.stdout:8/692: dwrite d5/d7b/da8/db7/f51 [0,4194304] 0 2024-04-16T14:35:39.186 INFO:tasks.workunit.client.0.smithi005.stdout:4/934: write d0/d1b/d1d/dde/ff3 [1168568,41951] 0 2024-04-16T14:35:39.187 INFO:tasks.workunit.client.1.smithi115.stdout:4/453: rename d1/d15/f57 to d1/d15/f77 0 2024-04-16T14:35:39.191 INFO:tasks.workunit.client.1.smithi115.stdout:6/506: symlink d13/d1d/d52/d8c/la9 0 2024-04-16T14:35:39.192 INFO:tasks.workunit.client.0.smithi005.stdout:7/775: dread d1/d49/d74/d77/d22/d27/f2b [0,4194304] 0 2024-04-16T14:35:39.192 INFO:tasks.workunit.client.1.smithi115.stdout:0/366: rename d6/d10/d12/d1f/d36/d78 to d6/d54/d57/d83 0 2024-04-16T14:35:39.194 INFO:tasks.workunit.client.0.smithi005.stdout:9/486: creat d3/d49/f89 x:0 0 0 2024-04-16T14:35:39.195 INFO:tasks.workunit.client.1.smithi115.stdout:8/461: link d0/db/d10/d17/f7b d0/db/d44/f93 0 2024-04-16T14:35:39.195 INFO:tasks.workunit.client.1.smithi115.stdout:8/462: fsync d0/db/f26 0 2024-04-16T14:35:39.195 INFO:tasks.workunit.client.1.smithi115.stdout:8/463: readlink d0/db/d10/d25/l49 0 2024-04-16T14:35:39.198 INFO:tasks.workunit.client.1.smithi115.stdout:5/409: dwrite dc/d15/d35/d69/f70 [0,4194304] 0 2024-04-16T14:35:39.199 INFO:tasks.workunit.client.0.smithi005.stdout:6/883: link d2/d3f/f71 d2/d3f/d47/f12b 0 2024-04-16T14:35:39.199 INFO:tasks.workunit.client.0.smithi005.stdout:6/884: chown d2/d3f/d47/d84/dbf/feb 94682 1 2024-04-16T14:35:39.199 INFO:tasks.workunit.client.1.smithi115.stdout:8/464: unlink d0/db/d10/d25/f3d 0 2024-04-16T14:35:39.200 INFO:tasks.workunit.client.0.smithi005.stdout:4/935: read d0/d1b/d1d/d1f/ffe [3869916,130038] 0 2024-04-16T14:35:39.200 INFO:tasks.workunit.client.0.smithi005.stdout:4/936: chown d0/f4c 4583 1 2024-04-16T14:35:39.201 INFO:tasks.workunit.client.1.smithi115.stdout:1/422: rmdir df/d13/d4d 39 2024-04-16T14:35:39.201 INFO:tasks.workunit.client.1.smithi115.stdout:4/454: write d1/d2/ff [2580494,115028] 0 2024-04-16T14:35:39.202 INFO:tasks.workunit.client.0.smithi005.stdout:7/776: mknod d1/d49/d74/d77/d57/d47/c106 0 2024-04-16T14:35:39.203 INFO:tasks.workunit.client.0.smithi005.stdout:9/487: rmdir d3/d49/d4b/d5c/d65 39 2024-04-16T14:35:39.204 INFO:tasks.workunit.client.1.smithi115.stdout:3/502: dwrite dc/f22 [0,4194304] 0 2024-04-16T14:35:39.204 INFO:tasks.workunit.client.1.smithi115.stdout:3/503: readlink dc/d29/d39/l3c 0 2024-04-16T14:35:39.204 INFO:tasks.workunit.client.0.smithi005.stdout:3/658: sync 2024-04-16T14:35:39.204 INFO:tasks.workunit.client.1.smithi115.stdout:5/410: mkdir dc/d15/d2d/d8c 0 2024-04-16T14:35:39.205 INFO:tasks.workunit.client.0.smithi005.stdout:7/777: symlink d1/d49/d74/d77/d22/db0/l107 0 2024-04-16T14:35:39.206 INFO:tasks.workunit.client.0.smithi005.stdout:7/778: write d1/f6f [4586935,26385] 0 2024-04-16T14:35:39.206 INFO:tasks.workunit.client.1.smithi115.stdout:1/423: link df/d2d/f82 df/d35/f8a 0 2024-04-16T14:35:39.209 INFO:tasks.workunit.client.1.smithi115.stdout:3/504: dread dc/d29/f34 [0,4194304] 0 2024-04-16T14:35:39.209 INFO:tasks.workunit.client.1.smithi115.stdout:3/505: write dc/f64 [640099,118056] 0 2024-04-16T14:35:39.209 INFO:tasks.workunit.client.0.smithi005.stdout:9/488: creat d3/f8a x:0 0 0 2024-04-16T14:35:39.213 INFO:tasks.workunit.client.1.smithi115.stdout:4/455: mkdir d1/d15/d78 0 2024-04-16T14:35:39.215 INFO:tasks.workunit.client.1.smithi115.stdout:2/516: fsync d0/d4/d4a/fa9 0 2024-04-16T14:35:39.216 INFO:tasks.workunit.client.1.smithi115.stdout:2/517: truncate d0/d4/d24/d10/f7e 332837 0 2024-04-16T14:35:39.218 INFO:tasks.workunit.client.0.smithi005.stdout:7/779: dread d1/d49/d74/d77/d57/f4a [4194304,4194304] 0 2024-04-16T14:35:39.220 INFO:tasks.workunit.client.0.smithi005.stdout:8/693: dwrite d5/d7b/da8/da5/def/fd7 [0,4194304] 0 2024-04-16T14:35:39.222 INFO:tasks.workunit.client.0.smithi005.stdout:7/780: rename d1/d85/fd5 to d1/d49/d74/d77/d22/da0/dbb/dcb/f108 0 2024-04-16T14:35:39.222 INFO:tasks.workunit.client.0.smithi005.stdout:7/781: fdatasync d1/d49/d74/d77/d22/d27/d2e/fa3 0 2024-04-16T14:35:39.222 INFO:tasks.workunit.client.0.smithi005.stdout:7/782: dread - d1/d49/d74/d77/d22/da0/dbb/dcb/f108 zero size 2024-04-16T14:35:39.225 INFO:tasks.workunit.client.1.smithi115.stdout:8/465: read d0/db/d10/d17/d2c/d52/d74/f45 [4034049,11123] 0 2024-04-16T14:35:39.226 INFO:tasks.workunit.client.1.smithi115.stdout:9/517: sync 2024-04-16T14:35:39.226 INFO:tasks.workunit.client.1.smithi115.stdout:9/518: chown d1/d6/d2d/d3d/d49/d98/daa 153 1 2024-04-16T14:35:39.227 INFO:tasks.workunit.client.0.smithi005.stdout:6/885: dread d2/d3f/d53/d54/fc8 [0,4194304] 0 2024-04-16T14:35:39.228 INFO:tasks.workunit.client.1.smithi115.stdout:9/519: truncate f0 5421480 0 2024-04-16T14:35:39.228 INFO:tasks.workunit.client.1.smithi115.stdout:7/412: sync 2024-04-16T14:35:39.230 INFO:tasks.workunit.client.1.smithi115.stdout:6/507: rmdir d13/d1d/d52/d8c 39 2024-04-16T14:35:39.230 INFO:tasks.workunit.client.1.smithi115.stdout:6/508: write d13/d1d/d2b/d5f/fa8 [201713,35497] 0 2024-04-16T14:35:39.230 INFO:tasks.workunit.client.1.smithi115.stdout:6/509: chown d13/d1d 417147 1 2024-04-16T14:35:39.230 INFO:tasks.workunit.client.1.smithi115.stdout:6/510: truncate f12 13050291 0 2024-04-16T14:35:39.231 INFO:tasks.workunit.client.1.smithi115.stdout:2/518: dread d0/d4/de/f37 [0,4194304] 0 2024-04-16T14:35:39.232 INFO:tasks.workunit.client.0.smithi005.stdout:8/694: rename d5/d7b/da8/da5/def/d71/l7c to d5/d7b/da8/db7/d8a/da1/lf6 0 2024-04-16T14:35:39.233 INFO:tasks.workunit.client.1.smithi115.stdout:6/511: mkdir d13/d1d/d47/daa 0 2024-04-16T14:35:39.233 INFO:tasks.workunit.client.1.smithi115.stdout:2/519: dread d0/d4/d24/d23/d71/f93 [0,4194304] 0 2024-04-16T14:35:39.234 INFO:tasks.workunit.client.1.smithi115.stdout:2/520: stat d0/d4/d24/l2b 0 2024-04-16T14:35:39.234 INFO:tasks.workunit.client.1.smithi115.stdout:2/521: stat d0/d4/d24/d10/l76 0 2024-04-16T14:35:39.234 INFO:tasks.workunit.client.1.smithi115.stdout:2/522: chown d0/d1b/c54 7262 1 2024-04-16T14:35:39.234 INFO:tasks.workunit.client.1.smithi115.stdout:2/523: fdatasync d0/d4/d24/d21/f74 0 2024-04-16T14:35:39.234 INFO:tasks.workunit.client.1.smithi115.stdout:2/524: chown d0/d4/d22/c5b 347739629 1 2024-04-16T14:35:39.237 INFO:tasks.workunit.client.0.smithi005.stdout:6/886: rmdir d2/d3f/d47/d84/dbf 39 2024-04-16T14:35:39.237 INFO:tasks.workunit.client.0.smithi005.stdout:6/887: read d2/d20/d3c/dcf/d6e/fab [368144,32994] 0 2024-04-16T14:35:39.238 INFO:tasks.workunit.client.0.smithi005.stdout:8/695: dread d5/d11/f45 [0,4194304] 0 2024-04-16T14:35:39.238 INFO:tasks.workunit.client.0.smithi005.stdout:8/696: write d5/d7b/da8/db7/d74/fc6 [786523,29200] 0 2024-04-16T14:35:39.238 INFO:tasks.workunit.client.0.smithi005.stdout:8/697: write d5/d7b/da8/db7/d8a/da1/fd0 [2063646,106820] 0 2024-04-16T14:35:39.238 INFO:tasks.workunit.client.0.smithi005.stdout:8/698: creat d5/d7b/da8/da5/ff7 x:0 0 0 2024-04-16T14:35:39.238 INFO:tasks.workunit.client.0.smithi005.stdout:8/699: fsync d5/d7b/f33 0 2024-04-16T14:35:39.239 INFO:tasks.workunit.client.0.smithi005.stdout:6/888: mknod d2/d45/d7b/db2/c12c 0 2024-04-16T14:35:39.241 INFO:tasks.workunit.client.1.smithi115.stdout:8/466: write d0/db/f12 [6124634,105159] 0 2024-04-16T14:35:39.244 INFO:tasks.workunit.client.1.smithi115.stdout:8/467: mkdir d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/d8a/d94 0 2024-04-16T14:35:39.244 INFO:tasks.workunit.client.1.smithi115.stdout:8/468: fsync d0/db/d10/d17/d2c/d52/d6c/f92 0 2024-04-16T14:35:39.244 INFO:tasks.workunit.client.1.smithi115.stdout:8/469: readlink d0/db/d10/d17/d2c/l51 0 2024-04-16T14:35:39.244 INFO:tasks.workunit.client.1.smithi115.stdout:8/470: fsync d0/db/d10/d17/d2c/d52/d74/f4d 0 2024-04-16T14:35:39.244 INFO:tasks.workunit.client.1.smithi115.stdout:8/471: chown d0/db/d10/d25/f5f 4562668 1 2024-04-16T14:35:39.246 INFO:tasks.workunit.client.0.smithi005.stdout:8/700: dread d5/d11/f5f [0,4194304] 0 2024-04-16T14:35:39.247 INFO:tasks.workunit.client.1.smithi115.stdout:7/413: dread d0/d2/d3a/f33 [0,4194304] 0 2024-04-16T14:35:39.247 INFO:tasks.workunit.client.0.smithi005.stdout:8/701: creat d5/d11/ff8 x:0 0 0 2024-04-16T14:35:39.254 INFO:tasks.workunit.client.0.smithi005.stdout:6/889: dread d2/d20/d33/f63 [0,4194304] 0 2024-04-16T14:35:39.254 INFO:tasks.workunit.client.0.smithi005.stdout:6/890: truncate d2/d5/f6a 22850 0 2024-04-16T14:35:39.254 INFO:tasks.workunit.client.0.smithi005.stdout:6/891: creat d2/d45/d7b/db2/f12d x:0 0 0 2024-04-16T14:35:39.266 INFO:tasks.workunit.client.0.smithi005.stdout:4/937: dwrite d0/f13 [4194304,4194304] 0 2024-04-16T14:35:39.288 INFO:tasks.workunit.client.1.smithi115.stdout:0/367: dwrite d6/d10/d12/f19 [8388608,4194304] 0 2024-04-16T14:35:39.288 INFO:tasks.workunit.client.1.smithi115.stdout:1/424: dwrite df/d13/f30 [0,4194304] 0 2024-04-16T14:35:39.288 INFO:tasks.workunit.client.1.smithi115.stdout:0/368: creat d6/d10/d12/f84 x:0 0 0 2024-04-16T14:35:39.290 INFO:tasks.workunit.client.1.smithi115.stdout:0/369: rmdir d6/d10 39 2024-04-16T14:35:39.295 INFO:tasks.workunit.client.1.smithi115.stdout:1/425: dread df/d36/d3c/f56 [0,4194304] 0 2024-04-16T14:35:39.301 INFO:tasks.workunit.client.0.smithi005.stdout:3/659: dwrite d2/d6b/d7a/f8c [0,4194304] 0 2024-04-16T14:35:39.302 INFO:tasks.workunit.client.1.smithi115.stdout:5/411: dwrite dc/d15/d2d/f67 [4194304,4194304] 0 2024-04-16T14:35:39.302 INFO:tasks.workunit.client.1.smithi115.stdout:5/412: creat dc/f8d x:0 0 0 2024-04-16T14:35:39.306 INFO:tasks.workunit.client.0.smithi005.stdout:3/660: rename d2/d92/f9e to d2/d6b/fd8 0 2024-04-16T14:35:39.307 INFO:tasks.workunit.client.1.smithi115.stdout:0/370: dread d6/d10/d12/d31/d35/d28/f66 [0,4194304] 0 2024-04-16T14:35:39.315 INFO:tasks.workunit.client.1.smithi115.stdout:5/413: dread dc/d15/f18 [0,4194304] 0 2024-04-16T14:35:39.315 INFO:tasks.workunit.client.1.smithi115.stdout:7/414: dwrite d0/d2/d3a/d73/f7d [0,4194304] 0 2024-04-16T14:35:39.315 INFO:tasks.workunit.client.1.smithi115.stdout:3/506: dwrite dc/d29/d39/d86/f8b [4194304,4194304] 0 2024-04-16T14:35:39.315 INFO:tasks.workunit.client.1.smithi115.stdout:3/507: fdatasync dc/d24/d36/f4e 0 2024-04-16T14:35:39.315 INFO:tasks.workunit.client.1.smithi115.stdout:2/525: dwrite d0/d4/d4a/fa9 [0,4194304] 0 2024-04-16T14:35:39.316 INFO:tasks.workunit.client.0.smithi005.stdout:9/489: dwrite d3/f7 [0,4194304] 0 2024-04-16T14:35:39.317 INFO:tasks.workunit.client.1.smithi115.stdout:5/414: mkdir dc/d8e 0 2024-04-16T14:35:39.318 INFO:tasks.workunit.client.0.smithi005.stdout:8/702: dwrite d5/d40/f6d [0,4194304] 0 2024-04-16T14:35:39.318 INFO:tasks.workunit.client.1.smithi115.stdout:7/415: creat d0/d1/d3b/d3f/f8d x:0 0 0 2024-04-16T14:35:39.319 INFO:tasks.workunit.client.0.smithi005.stdout:6/892: dwrite d2/d20/d33/ff5 [0,4194304] 0 2024-04-16T14:35:39.319 INFO:tasks.workunit.client.0.smithi005.stdout:4/938: dwrite d0/d22/d29/d107/d104/f109 [0,4194304] 0 2024-04-16T14:35:39.321 INFO:tasks.workunit.client.1.smithi115.stdout:0/371: write d6/d30/d4d/f4c [1933243,64895] 0 2024-04-16T14:35:39.321 INFO:tasks.workunit.client.1.smithi115.stdout:3/508: creat dc/d24/d80/fa8 x:0 0 0 2024-04-16T14:35:39.322 INFO:tasks.workunit.client.1.smithi115.stdout:8/472: dwrite d0/f53 [0,4194304] 0 2024-04-16T14:35:39.322 INFO:tasks.workunit.client.1.smithi115.stdout:8/473: read d0/db/f15 [1664896,88929] 0 2024-04-16T14:35:39.322 INFO:tasks.workunit.client.1.smithi115.stdout:8/474: stat d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/f86 0 2024-04-16T14:35:39.326 INFO:tasks.workunit.client.1.smithi115.stdout:5/415: getdents dc/d79 0 2024-04-16T14:35:39.326 INFO:tasks.workunit.client.1.smithi115.stdout:5/416: chown dc/d15/d4d 7175801 1 2024-04-16T14:35:39.329 INFO:tasks.workunit.client.1.smithi115.stdout:2/526: dread d0/d47/f7f [0,4194304] 0 2024-04-16T14:35:39.329 INFO:tasks.workunit.client.1.smithi115.stdout:2/527: readlink d0/d4/l4f 0 2024-04-16T14:35:39.330 INFO:tasks.workunit.client.0.smithi005.stdout:4/939: creat d0/d22/df2/d10d/f12c x:0 0 0 2024-04-16T14:35:39.332 INFO:tasks.workunit.client.1.smithi115.stdout:3/509: dread dc/d24/d36/f3b [0,4194304] 0 2024-04-16T14:35:39.332 INFO:tasks.workunit.client.1.smithi115.stdout:3/510: fsync dc/d29/d4d/d56/d7e/f94 0 2024-04-16T14:35:39.333 INFO:tasks.workunit.client.0.smithi005.stdout:3/661: dwrite d2/d9/f53 [0,4194304] 0 2024-04-16T14:35:39.333 INFO:tasks.workunit.client.0.smithi005.stdout:3/662: readlink d2/d9/d51/lb9 0 2024-04-16T14:35:39.333 INFO:tasks.workunit.client.0.smithi005.stdout:4/940: creat d0/d1b/d1d/dc3/f12d x:0 0 0 2024-04-16T14:35:39.333 INFO:tasks.workunit.client.0.smithi005.stdout:4/941: chown d0/f4c 1778207 1 2024-04-16T14:35:39.335 INFO:tasks.workunit.client.0.smithi005.stdout:4/942: rename d0/d1b/fb6 to d0/d1b/d1d/dc3/f12e 0 2024-04-16T14:35:39.335 INFO:tasks.workunit.client.0.smithi005.stdout:4/943: write d0/d22/d29/fdf [684339,58682] 0 2024-04-16T14:35:39.335 INFO:tasks.workunit.client.0.smithi005.stdout:4/944: chown d0/d1b/d1d/d1f/d5d/da9/lad 382 1 2024-04-16T14:35:39.336 INFO:tasks.workunit.client.1.smithi115.stdout:7/416: symlink d0/d24/l8e 0 2024-04-16T14:35:39.337 INFO:tasks.workunit.client.1.smithi115.stdout:5/417: write dc/f26 [1906910,119531] 0 2024-04-16T14:35:39.339 INFO:tasks.workunit.client.1.smithi115.stdout:8/475: unlink d0/db/d10/d17/d2c/d61/d6b/f79 0 2024-04-16T14:35:39.339 INFO:tasks.workunit.client.0.smithi005.stdout:4/945: mkdir d0/d22/df2/d12f 0 2024-04-16T14:35:39.340 INFO:tasks.workunit.client.1.smithi115.stdout:2/528: creat d0/d4/faa x:0 0 0 2024-04-16T14:35:39.342 INFO:tasks.workunit.client.0.smithi005.stdout:4/946: truncate d0/d1b/d1d/dc3/f106 3955823 0 2024-04-16T14:35:39.342 INFO:tasks.workunit.client.1.smithi115.stdout:8/476: symlink d0/db/d10/d17/d2c/d52/l95 0 2024-04-16T14:35:39.343 INFO:tasks.workunit.client.1.smithi115.stdout:2/529: symlink d0/lab 0 2024-04-16T14:35:39.343 INFO:tasks.workunit.client.1.smithi115.stdout:2/530: dread - d0/d4/d24/d21/fa5 zero size 2024-04-16T14:35:39.349 INFO:tasks.workunit.client.0.smithi005.stdout:0/629: sync 2024-04-16T14:35:39.351 INFO:tasks.workunit.client.0.smithi005.stdout:0/630: creat da/df/d26/fd1 x:0 0 0 2024-04-16T14:35:39.352 INFO:tasks.workunit.client.0.smithi005.stdout:0/631: stat da/df/d1b/d24/f9d 0 2024-04-16T14:35:39.353 INFO:tasks.workunit.client.0.smithi005.stdout:0/632: mknod da/df/d26/da9/cd2 0 2024-04-16T14:35:39.354 INFO:tasks.workunit.client.1.smithi115.stdout:0/372: dwrite d6/f41 [0,4194304] 0 2024-04-16T14:35:39.355 INFO:tasks.workunit.client.1.smithi115.stdout:0/373: getdents d6/d10/d71 0 2024-04-16T14:35:39.356 INFO:tasks.workunit.client.0.smithi005.stdout:0/633: symlink da/df/d1b/d3a/d96/dab/ld3 0 2024-04-16T14:35:39.356 INFO:tasks.workunit.client.0.smithi005.stdout:0/634: getdents da/df/dd0 0 2024-04-16T14:35:39.356 INFO:tasks.workunit.client.0.smithi005.stdout:0/635: stat da/df/f21 0 2024-04-16T14:35:39.356 INFO:tasks.workunit.client.0.smithi005.stdout:0/636: fsync da/f2d 0 2024-04-16T14:35:39.356 INFO:tasks.workunit.client.0.smithi005.stdout:0/637: chown da/df/d1b/d3a/d53/d5a/l8c 1599788 1 2024-04-16T14:35:39.356 INFO:tasks.workunit.client.1.smithi115.stdout:0/374: mkdir d6/d10/d12/d31/d35/d44/d85 0 2024-04-16T14:35:39.359 INFO:tasks.workunit.client.0.smithi005.stdout:0/638: dread da/f30 [0,4194304] 0 2024-04-16T14:35:39.359 INFO:tasks.workunit.client.1.smithi115.stdout:7/417: dread d0/d24/f37 [0,4194304] 0 2024-04-16T14:35:39.359 INFO:tasks.workunit.client.1.smithi115.stdout:7/418: readlink d0/l2a 0 2024-04-16T14:35:39.359 INFO:tasks.workunit.client.1.smithi115.stdout:0/375: creat d6/d10/d12/d1f/d36/d4b/f86 x:0 0 0 2024-04-16T14:35:39.359 INFO:tasks.workunit.client.1.smithi115.stdout:7/419: mknod d0/d2/d3a/d30/d6b/c8f 0 2024-04-16T14:35:39.365 INFO:tasks.workunit.client.0.smithi005.stdout:9/490: dwrite d3/f25 [0,4194304] 0 2024-04-16T14:35:39.365 INFO:tasks.workunit.client.0.smithi005.stdout:8/703: dwrite d5/d7b/da8/db7/d8a/da1/d3d/f3f [0,4194304] 0 2024-04-16T14:35:39.369 INFO:tasks.workunit.client.0.smithi005.stdout:8/704: rename d5/d40/f6d to d5/d40/d8e/ff9 0 2024-04-16T14:35:39.369 INFO:tasks.workunit.client.0.smithi005.stdout:8/705: dread - d5/d7b/da8/db7/d8a/da1/d3d/dba/dcd/fd8 zero size 2024-04-16T14:35:39.374 INFO:tasks.workunit.client.0.smithi005.stdout:9/491: dread d3/d12/f3e [0,4194304] 0 2024-04-16T14:35:39.375 INFO:tasks.workunit.client.0.smithi005.stdout:9/492: mknod d3/d12/d16/c8b 0 2024-04-16T14:35:39.375 INFO:tasks.workunit.client.0.smithi005.stdout:9/493: getdents d3/d49/d4b/d55/d7b 0 2024-04-16T14:35:39.378 INFO:tasks.workunit.client.0.smithi005.stdout:9/494: rename d3/d12/d16/f7e to d3/d12/d16/d86/f8c 0 2024-04-16T14:35:39.378 INFO:tasks.workunit.client.0.smithi005.stdout:9/495: chown d3/d49/d4b/d55/c56 167290 1 2024-04-16T14:35:39.380 INFO:tasks.workunit.client.1.smithi115.stdout:8/477: dwrite d0/db/d10/d17/d2c/d52/d74/d3b/f54 [0,4194304] 0 2024-04-16T14:35:39.382 INFO:tasks.workunit.client.1.smithi115.stdout:7/420: write d0/d2/d3a/d73/f86 [3472615,35707] 0 2024-04-16T14:35:39.383 INFO:tasks.workunit.client.1.smithi115.stdout:0/376: read d6/d10/d12/d31/d35/d28/f5b [1575659,50300] 0 2024-04-16T14:35:39.383 INFO:tasks.workunit.client.1.smithi115.stdout:0/377: chown d6/ff 8891228 1 2024-04-16T14:35:39.384 INFO:tasks.workunit.client.1.smithi115.stdout:8/478: rename d0/db/d10/d17/d2c/d52/l82 to d0/db/d10/d17/d2c/d52/d74/d3b/d56/l96 0 2024-04-16T14:35:39.385 INFO:tasks.workunit.client.1.smithi115.stdout:0/378: creat d6/d54/f87 x:0 0 0 2024-04-16T14:35:39.386 INFO:tasks.workunit.client.1.smithi115.stdout:0/379: mkdir d6/d10/d71/d88 0 2024-04-16T14:35:39.392 INFO:tasks.workunit.client.1.smithi115.stdout:7/421: dread d0/d2/d3a/d30/f32 [0,4194304] 0 2024-04-16T14:35:39.392 INFO:tasks.workunit.client.1.smithi115.stdout:7/422: chown d0/d24/d40/f85 114711334 1 2024-04-16T14:35:39.393 INFO:tasks.workunit.client.1.smithi115.stdout:7/423: symlink d0/d2/d3a/d30/d79/l90 0 2024-04-16T14:35:39.394 INFO:tasks.workunit.client.1.smithi115.stdout:7/424: unlink d0/d2/d3a/d73/f86 0 2024-04-16T14:35:39.395 INFO:tasks.workunit.client.1.smithi115.stdout:7/425: creat d0/d1/d3b/d49/f91 x:0 0 0 2024-04-16T14:35:39.396 INFO:tasks.workunit.client.1.smithi115.stdout:7/426: creat d0/d1/d3b/d3f/d7a/d80/d81/f92 x:0 0 0 2024-04-16T14:35:39.396 INFO:tasks.workunit.client.1.smithi115.stdout:7/427: fdatasync d0/d1/d3b/d3e/f54 0 2024-04-16T14:35:39.402 INFO:tasks.workunit.client.1.smithi115.stdout:5/418: dwrite dc/d15/f17 [12582912,4194304] 0 2024-04-16T14:35:39.403 INFO:tasks.workunit.client.1.smithi115.stdout:5/419: mkdir dc/d5d/d8f 0 2024-04-16T14:35:39.404 INFO:tasks.workunit.client.1.smithi115.stdout:5/420: symlink dc/d3d/d68/d7b/l90 0 2024-04-16T14:35:39.404 INFO:tasks.workunit.client.1.smithi115.stdout:7/428: dread d0/d2/f35 [0,4194304] 0 2024-04-16T14:35:39.405 INFO:tasks.workunit.client.1.smithi115.stdout:5/421: creat dc/d3d/d41/f91 x:0 0 0 2024-04-16T14:35:39.406 INFO:tasks.workunit.client.1.smithi115.stdout:2/531: dwrite d0/d4/de/d11/f96 [0,4194304] 0 2024-04-16T14:35:39.406 INFO:tasks.workunit.client.0.smithi005.stdout:3/663: dwrite d2/d9/d51/f58 [0,4194304] 0 2024-04-16T14:35:39.406 INFO:tasks.workunit.client.0.smithi005.stdout:3/664: creat d2/d9/fd9 x:0 0 0 2024-04-16T14:35:39.407 INFO:tasks.workunit.client.1.smithi115.stdout:3/511: dwrite dc/d29/d39/f76 [0,4194304] 0 2024-04-16T14:35:39.407 INFO:tasks.workunit.client.1.smithi115.stdout:3/512: fsync dc/d29/f7b 0 2024-04-16T14:35:39.407 INFO:tasks.workunit.client.0.smithi005.stdout:8/706: dwrite d5/d7b/da8/da5/def/d71/fc5 [0,4194304] 0 2024-04-16T14:35:39.407 INFO:tasks.workunit.client.1.smithi115.stdout:0/380: dwrite d6/d10/f40 [0,4194304] 0 2024-04-16T14:35:39.407 INFO:tasks.workunit.client.1.smithi115.stdout:0/381: creat d6/d10/d12/d1f/f89 x:0 0 0 2024-04-16T14:35:39.407 INFO:tasks.workunit.client.1.smithi115.stdout:0/382: read - d6/d10/d12/f80 zero size 2024-04-16T14:35:39.408 INFO:tasks.workunit.client.1.smithi115.stdout:0/383: write d6/d10/d12/d1f/d36/d4b/d6d/f3d [1408523,85724] 0 2024-04-16T14:35:39.408 INFO:tasks.workunit.client.0.smithi005.stdout:8/707: dread d5/d7b/da8/db7/f5d [0,4194304] 0 2024-04-16T14:35:39.408 INFO:tasks.workunit.client.0.smithi005.stdout:8/708: dread - d5/d55/f86 zero size 2024-04-16T14:35:39.409 INFO:tasks.workunit.client.1.smithi115.stdout:2/532: unlink d0/d4/d24/d10/f39 0 2024-04-16T14:35:39.411 INFO:tasks.workunit.client.1.smithi115.stdout:3/513: rename l9 to dc/d29/d39/la9 0 2024-04-16T14:35:39.414 INFO:tasks.workunit.client.0.smithi005.stdout:3/665: dread d2/f2b [0,4194304] 0 2024-04-16T14:35:39.415 INFO:tasks.workunit.client.0.smithi005.stdout:8/709: mknod d5/d7b/da8/db7/d8a/da1/d68/dcb/dd9/cfa 0 2024-04-16T14:35:39.417 INFO:tasks.workunit.client.1.smithi115.stdout:0/384: mkdir d6/d10/d12/d1f/d36/d4b/d70/d8a 0 2024-04-16T14:35:39.417 INFO:tasks.workunit.client.1.smithi115.stdout:0/385: readlink d6/d10/d12/l18 0 2024-04-16T14:35:39.417 INFO:tasks.workunit.client.0.smithi005.stdout:3/666: mkdir d2/d17/d46/d75/d6d/dd0/dda 0 2024-04-16T14:35:39.418 INFO:tasks.workunit.client.1.smithi115.stdout:0/386: link d6/d10/d12/d31/d35/d44/f50 d6/d30/d4d/f8b 0 2024-04-16T14:35:39.419 INFO:tasks.workunit.client.0.smithi005.stdout:8/710: mknod d5/d40/cfb 0 2024-04-16T14:35:39.420 INFO:tasks.workunit.client.1.smithi115.stdout:0/387: creat d6/d10/d12/d5f/f8c x:0 0 0 2024-04-16T14:35:39.420 INFO:tasks.workunit.client.1.smithi115.stdout:0/388: dread - d6/d10/d12/d31/d35/f59 zero size 2024-04-16T14:35:39.421 INFO:tasks.workunit.client.1.smithi115.stdout:2/533: dread d0/d4/de/d11/f1e [0,4194304] 0 2024-04-16T14:35:39.422 INFO:tasks.workunit.client.0.smithi005.stdout:3/667: unlink d2/d9/d51/c87 0 2024-04-16T14:35:39.422 INFO:tasks.workunit.client.0.smithi005.stdout:3/668: chown d2/d9/d5e/ca6 57 1 2024-04-16T14:35:39.422 INFO:tasks.workunit.client.1.smithi115.stdout:0/389: mkdir d6/d30/d8d 0 2024-04-16T14:35:39.422 INFO:tasks.workunit.client.1.smithi115.stdout:0/390: chown d6/d1b/c3f 63 1 2024-04-16T14:35:39.423 INFO:tasks.workunit.client.1.smithi115.stdout:5/422: dwrite dc/f1c [0,4194304] 0 2024-04-16T14:35:39.423 INFO:tasks.workunit.client.0.smithi005.stdout:8/711: mknod d5/d7b/da8/db7/d8a/da1/d3d/dba/dcd/cfc 0 2024-04-16T14:35:39.423 INFO:tasks.workunit.client.1.smithi115.stdout:2/534: symlink d0/d4/d24/da0/lac 0 2024-04-16T14:35:39.426 INFO:tasks.workunit.client.1.smithi115.stdout:0/391: link d6/d10/d12/d31/d35/f59 d6/d10/d12/d1f/d36/d4b/d6d/f8e 0 2024-04-16T14:35:39.426 INFO:tasks.workunit.client.1.smithi115.stdout:0/392: readlink d6/d30/l58 0 2024-04-16T14:35:39.427 INFO:tasks.workunit.client.0.smithi005.stdout:8/712: getdents d5/d7b 0 2024-04-16T14:35:39.430 INFO:tasks.workunit.client.0.smithi005.stdout:5/712: sync 2024-04-16T14:35:39.430 INFO:tasks.workunit.client.0.smithi005.stdout:1/903: sync 2024-04-16T14:35:39.431 INFO:tasks.workunit.client.0.smithi005.stdout:1/904: getdents d2/d74/dd7/d11f/d51 0 2024-04-16T14:35:39.432 INFO:tasks.workunit.client.0.smithi005.stdout:5/713: rmdir d0/d70/db3 39 2024-04-16T14:35:39.433 INFO:tasks.workunit.client.1.smithi115.stdout:2/535: rename d0/d4/d24/d21/d3b to d0/d47/d65/dad 0 2024-04-16T14:35:39.437 INFO:tasks.workunit.client.1.smithi115.stdout:5/423: dread dc/f2c [0,4194304] 0 2024-04-16T14:35:39.437 INFO:tasks.workunit.client.1.smithi115.stdout:0/393: dread d6/d30/d4d/f4c [0,4194304] 0 2024-04-16T14:35:39.437 INFO:tasks.workunit.client.1.smithi115.stdout:0/394: stat d6/l8 0 2024-04-16T14:35:39.439 INFO:tasks.workunit.client.1.smithi115.stdout:5/424: creat dc/d5d/d8f/f92 x:0 0 0 2024-04-16T14:35:39.439 INFO:tasks.workunit.client.1.smithi115.stdout:5/425: truncate dc/d3d/f6a 688415 0 2024-04-16T14:35:39.439 INFO:tasks.workunit.client.1.smithi115.stdout:5/426: write dc/d3d/d68/f8a [330244,65244] 0 2024-04-16T14:35:39.441 INFO:tasks.workunit.client.1.smithi115.stdout:0/395: creat d6/d54/d57/d83/f8f x:0 0 0 2024-04-16T14:35:39.441 INFO:tasks.workunit.client.1.smithi115.stdout:0/396: dread - d6/d10/d12/d31/d35/f59 zero size 2024-04-16T14:35:39.442 INFO:tasks.workunit.client.0.smithi005.stdout:3/669: dwrite d2/d17/d46/d75/d41/d79/f83 [0,4194304] 0 2024-04-16T14:35:39.442 INFO:tasks.workunit.client.1.smithi115.stdout:0/397: mknod d6/d10/d12/d31/d35/d44/c90 0 2024-04-16T14:35:39.444 INFO:tasks.workunit.client.1.smithi115.stdout:0/398: link d6/f4f d6/d10/d12/d31/f91 0 2024-04-16T14:35:39.445 INFO:tasks.workunit.client.0.smithi005.stdout:3/670: creat d2/d9/df/dbf/fdb x:0 0 0 2024-04-16T14:35:39.455 INFO:tasks.workunit.client.1.smithi115.stdout:3/514: dwrite dc/d29/f6b [0,4194304] 0 2024-04-16T14:35:39.455 INFO:tasks.workunit.client.1.smithi115.stdout:2/536: dwrite d0/d4/d24/f19 [0,4194304] 0 2024-04-16T14:35:39.460 INFO:tasks.workunit.client.1.smithi115.stdout:2/537: rmdir d0/d4/de/d11 39 2024-04-16T14:35:39.460 INFO:tasks.workunit.client.1.smithi115.stdout:2/538: stat d0/d4/de/d11/f88 0 2024-04-16T14:35:39.460 INFO:tasks.workunit.client.1.smithi115.stdout:2/539: chown d0/d4/de/d11/d36/f6e 84662657 1 2024-04-16T14:35:39.460 INFO:tasks.workunit.client.1.smithi115.stdout:2/540: stat d0/d47/d65/f7b 0 2024-04-16T14:35:39.463 INFO:tasks.workunit.client.1.smithi115.stdout:2/541: rename d0/d4/d24/d23/d52 to d0/d47/d65/d61/dae 0 2024-04-16T14:35:39.468 INFO:tasks.workunit.client.0.smithi005.stdout:5/714: dwrite d0/d6/d12/dc0/d42/f57 [4194304,4194304] 0 2024-04-16T14:35:39.468 INFO:tasks.workunit.client.1.smithi115.stdout:0/399: dwrite d6/d10/d12/f80 [0,4194304] 0 2024-04-16T14:35:39.469 INFO:tasks.workunit.client.0.smithi005.stdout:5/715: symlink d0/d6/d12/d1c/d81/d82/lf5 0 2024-04-16T14:35:39.470 INFO:tasks.workunit.client.0.smithi005.stdout:5/716: truncate d0/d6/d12/dc0/d6d/fd6 3941672 0 2024-04-16T14:35:39.470 INFO:tasks.workunit.client.0.smithi005.stdout:5/717: fdatasync d0/d6/d12/d1c/d1e/fe9 0 2024-04-16T14:35:39.475 INFO:tasks.workunit.client.1.smithi115.stdout:2/542: dread d0/d47/d65/f77 [0,4194304] 0 2024-04-16T14:35:39.475 INFO:tasks.workunit.client.1.smithi115.stdout:2/543: write d0/d4/d24/d23/f9c [38364,55038] 0 2024-04-16T14:35:39.475 INFO:tasks.workunit.client.1.smithi115.stdout:2/544: read - d0/d4/d24/d23/f8d zero size 2024-04-16T14:35:39.477 INFO:tasks.workunit.client.1.smithi115.stdout:2/545: rename d0/l75 to d0/d4/de/laf 0 2024-04-16T14:35:39.477 INFO:tasks.workunit.client.1.smithi115.stdout:2/546: dread - d0/d4/d24/d23/f8d zero size 2024-04-16T14:35:39.478 INFO:tasks.workunit.client.1.smithi115.stdout:0/400: dread d6/d10/d12/f80 [0,4194304] 0 2024-04-16T14:35:39.480 INFO:tasks.workunit.client.1.smithi115.stdout:0/401: unlink d6/d10/d12/f84 0 2024-04-16T14:35:39.481 INFO:tasks.workunit.client.1.smithi115.stdout:2/547: dread d0/d47/d65/dad/f56 [0,4194304] 0 2024-04-16T14:35:39.481 INFO:tasks.workunit.client.1.smithi115.stdout:2/548: truncate d0/d4/d24/d23/f7c 5020388 0 2024-04-16T14:35:39.482 INFO:tasks.workunit.client.0.smithi005.stdout:3/671: dwrite d2/d92/fac [0,4194304] 0 2024-04-16T14:35:39.482 INFO:tasks.workunit.client.1.smithi115.stdout:5/427: dwrite dc/f21 [0,4194304] 0 2024-04-16T14:35:39.487 INFO:tasks.workunit.client.0.smithi005.stdout:3/672: rmdir d2/d17/d46/d75/d6d/dd0 39 2024-04-16T14:35:39.488 INFO:tasks.workunit.client.0.smithi005.stdout:3/673: creat d2/d9/d5e/fdc x:0 0 0 2024-04-16T14:35:39.489 INFO:tasks.workunit.client.1.smithi115.stdout:5/428: mkdir dc/d15/d4d/d93 0 2024-04-16T14:35:39.489 INFO:tasks.workunit.client.1.smithi115.stdout:5/429: fsync dc/d15/d2d/f67 0 2024-04-16T14:35:39.493 INFO:tasks.workunit.client.1.smithi115.stdout:2/549: write d0/f1a [1371009,35530] 0 2024-04-16T14:35:39.495 INFO:tasks.workunit.client.1.smithi115.stdout:4/456: sync 2024-04-16T14:35:39.495 INFO:tasks.workunit.client.1.smithi115.stdout:6/512: sync 2024-04-16T14:35:39.495 INFO:tasks.workunit.client.1.smithi115.stdout:9/520: sync 2024-04-16T14:35:39.495 INFO:tasks.workunit.client.1.smithi115.stdout:1/426: sync 2024-04-16T14:35:39.498 INFO:tasks.workunit.client.1.smithi115.stdout:1/427: mknod df/d13/d4d/d2c/d54/c8b 0 2024-04-16T14:35:39.498 INFO:tasks.workunit.client.1.smithi115.stdout:1/428: fdatasync df/f12 0 2024-04-16T14:35:39.503 INFO:tasks.workunit.client.1.smithi115.stdout:5/430: read dc/d15/d35/d69/f70 [1289126,13344] 0 2024-04-16T14:35:39.503 INFO:tasks.workunit.client.1.smithi115.stdout:5/431: fdatasync dc/d15/f17 0 2024-04-16T14:35:39.505 INFO:tasks.workunit.client.1.smithi115.stdout:5/432: symlink dc/d3d/d68/d7b/l94 0 2024-04-16T14:35:39.508 INFO:tasks.workunit.client.1.smithi115.stdout:9/521: dread d1/d6/d2d/d3d/d50/f5e [0,4194304] 0 2024-04-16T14:35:39.511 INFO:tasks.workunit.client.0.smithi005.stdout:7/783: sync 2024-04-16T14:35:39.511 INFO:tasks.workunit.client.0.smithi005.stdout:2/509: sync 2024-04-16T14:35:39.511 INFO:tasks.workunit.client.0.smithi005.stdout:6/893: sync 2024-04-16T14:35:39.511 INFO:tasks.workunit.client.0.smithi005.stdout:6/894: read d2/d20/d3c/fef [97682,16804] 0 2024-04-16T14:35:39.511 INFO:tasks.workunit.client.0.smithi005.stdout:2/510: truncate d0/d2a/d3a/f7e 5124666 0 2024-04-16T14:35:39.511 INFO:tasks.workunit.client.0.smithi005.stdout:2/511: creat d0/d2a/fab x:0 0 0 2024-04-16T14:35:39.512 INFO:tasks.workunit.client.0.smithi005.stdout:2/512: truncate d0/d1c/d39/d48/f81 390989 0 2024-04-16T14:35:39.512 INFO:tasks.workunit.client.0.smithi005.stdout:6/895: truncate d2/d5/d10/fd1 2618394 0 2024-04-16T14:35:39.514 INFO:tasks.workunit.client.0.smithi005.stdout:2/513: creat d0/d4/d2b/d5e/d9a/fac x:0 0 0 2024-04-16T14:35:39.516 INFO:tasks.workunit.client.0.smithi005.stdout:6/896: getdents d2/d20/d33 0 2024-04-16T14:35:39.518 INFO:tasks.workunit.client.0.smithi005.stdout:6/897: mkdir d2/d5/d10/dd6/d12e 0 2024-04-16T14:35:39.521 INFO:tasks.workunit.client.0.smithi005.stdout:6/898: creat d2/d45/f12f x:0 0 0 2024-04-16T14:35:39.522 INFO:tasks.workunit.client.1.smithi115.stdout:5/433: dread dc/d3d/d68/d7b/f84 [0,4194304] 0 2024-04-16T14:35:39.522 INFO:tasks.workunit.client.1.smithi115.stdout:5/434: write dc/d15/f5f [766691,87790] 0 2024-04-16T14:35:39.522 INFO:tasks.workunit.client.1.smithi115.stdout:5/435: creat dc/d3d/d41/f95 x:0 0 0 2024-04-16T14:35:39.522 INFO:tasks.workunit.client.1.smithi115.stdout:5/436: fsync dc/d15/d35/f3f 0 2024-04-16T14:35:39.522 INFO:tasks.workunit.client.0.smithi005.stdout:6/899: truncate d2/f26 1744442 0 2024-04-16T14:35:39.523 INFO:tasks.workunit.client.0.smithi005.stdout:7/784: dread d1/dc/f7e [0,4194304] 0 2024-04-16T14:35:39.523 INFO:tasks.workunit.client.1.smithi115.stdout:9/522: dread d1/d6/f17 [0,4194304] 0 2024-04-16T14:35:39.524 INFO:tasks.workunit.client.0.smithi005.stdout:6/900: symlink d2/d3f/d47/d84/dbf/l130 0 2024-04-16T14:35:39.525 INFO:tasks.workunit.client.1.smithi115.stdout:9/523: mknod d1/d6/d2d/d4b/d90/cb2 0 2024-04-16T14:35:39.525 INFO:tasks.workunit.client.1.smithi115.stdout:9/524: chown d1/d6/d2d/d4b/d6c/d20 144620 1 2024-04-16T14:35:39.526 INFO:tasks.workunit.client.0.smithi005.stdout:7/785: symlink d1/d49/d74/d77/d22/db0/l109 0 2024-04-16T14:35:39.526 INFO:tasks.workunit.client.0.smithi005.stdout:7/786: write d1/dc/d2f/f60 [390906,40623] 0 2024-04-16T14:35:39.526 INFO:tasks.workunit.client.0.smithi005.stdout:6/901: truncate d2/d45/d7b/f86 2557168 0 2024-04-16T14:35:39.527 INFO:tasks.workunit.client.1.smithi115.stdout:9/525: symlink d1/d6/d2d/d4b/d90/lb3 0 2024-04-16T14:35:39.528 INFO:tasks.workunit.client.0.smithi005.stdout:7/787: link d1/d49/d74/d77/c20 d1/d49/c10a 0 2024-04-16T14:35:39.528 INFO:tasks.workunit.client.0.smithi005.stdout:7/788: creat d1/d85/d96/de1/f10b x:0 0 0 2024-04-16T14:35:39.529 INFO:tasks.workunit.client.1.smithi115.stdout:9/526: mknod d1/d6/d2d/d4b/d6c/d20/d36/cb4 0 2024-04-16T14:35:39.529 INFO:tasks.workunit.client.1.smithi115.stdout:9/527: truncate d1/d6/d2d/f5b 996686 0 2024-04-16T14:35:39.530 INFO:tasks.workunit.client.1.smithi115.stdout:9/528: write d1/d7f/f97 [276528,67341] 0 2024-04-16T14:35:39.535 INFO:tasks.workunit.client.1.smithi115.stdout:1/429: write df/d13/d4d/d68/f80 [656046,10135] 0 2024-04-16T14:35:39.539 INFO:tasks.workunit.client.0.smithi005.stdout:5/718: dwrite d0/d6/d12/dc0/d6d/fd6 [0,4194304] 0 2024-04-16T14:35:39.540 INFO:tasks.workunit.client.0.smithi005.stdout:5/719: stat d0/d6/d12/d1c/d1e/d73/l78 0 2024-04-16T14:35:39.540 INFO:tasks.workunit.client.0.smithi005.stdout:5/720: fsync d0/d6/d12/d1c/fd0 0 2024-04-16T14:35:39.542 INFO:tasks.workunit.client.0.smithi005.stdout:5/721: symlink d0/d6/d12/de4/lf6 0 2024-04-16T14:35:39.544 INFO:tasks.workunit.client.0.smithi005.stdout:5/722: mkdir d0/d6/d12/d1c/dd2/df7 0 2024-04-16T14:35:39.544 INFO:tasks.workunit.client.1.smithi115.stdout:0/402: dwrite d6/d30/f43 [0,4194304] 0 2024-04-16T14:35:39.547 INFO:tasks.workunit.client.1.smithi115.stdout:0/403: mknod d6/d10/d12/d1f/d36/d4b/d70/d8a/c92 0 2024-04-16T14:35:39.547 INFO:tasks.workunit.client.1.smithi115.stdout:0/404: chown d6/d10/d12/d31/d35/d44 913 1 2024-04-16T14:35:39.548 INFO:tasks.workunit.client.0.smithi005.stdout:6/902: dread d2/d20/d33/ff5 [0,4194304] 0 2024-04-16T14:35:39.548 INFO:tasks.workunit.client.0.smithi005.stdout:7/789: dread d1/d49/d74/d77/d22/f59 [0,4194304] 0 2024-04-16T14:35:39.548 INFO:tasks.workunit.client.0.smithi005.stdout:7/790: fsync d1/d49/d74/d77/fe6 0 2024-04-16T14:35:39.548 INFO:tasks.workunit.client.0.smithi005.stdout:7/791: write d1/d49/d74/f97 [935251,6098] 0 2024-04-16T14:35:39.548 INFO:tasks.workunit.client.0.smithi005.stdout:7/792: chown d1/d82/fd2 9155 1 2024-04-16T14:35:39.549 INFO:tasks.workunit.client.0.smithi005.stdout:7/793: stat d1/d49/d74/d77/d22/d27/d3a/d5c 0 2024-04-16T14:35:39.549 INFO:tasks.workunit.client.0.smithi005.stdout:6/903: mknod d2/d45/c131 0 2024-04-16T14:35:39.549 INFO:tasks.workunit.client.0.smithi005.stdout:6/904: fdatasync d2/d3f/d47/f12b 0 2024-04-16T14:35:39.550 INFO:tasks.workunit.client.0.smithi005.stdout:6/905: unlink d2/d5/d10/dd6/d7a/c9a 0 2024-04-16T14:35:39.550 INFO:tasks.workunit.client.1.smithi115.stdout:4/457: dwrite d1/d15/d17/f74 [0,4194304] 0 2024-04-16T14:35:39.551 INFO:tasks.workunit.client.0.smithi005.stdout:6/906: getdents d2/d20/d33/d64/d96 0 2024-04-16T14:35:39.551 INFO:tasks.workunit.client.0.smithi005.stdout:3/674: dwrite d2/d17/fd1 [0,4194304] 0 2024-04-16T14:35:39.551 INFO:tasks.workunit.client.0.smithi005.stdout:3/675: read - d2/d9/d25/d39/f6a zero size 2024-04-16T14:35:39.551 INFO:tasks.workunit.client.0.smithi005.stdout:3/676: chown d2/d17/d46/d75/f42 1 1 2024-04-16T14:35:39.552 INFO:tasks.workunit.client.0.smithi005.stdout:3/677: chown d2/f21 31439293 1 2024-04-16T14:35:39.552 INFO:tasks.workunit.client.0.smithi005.stdout:6/907: creat d2/d5/d10/f132 x:0 0 0 2024-04-16T14:35:39.553 INFO:tasks.workunit.client.1.smithi115.stdout:6/513: dwrite d13/d1d/d49/f6d [0,4194304] 0 2024-04-16T14:35:39.554 INFO:tasks.workunit.client.1.smithi115.stdout:9/529: dread d1/d6/d2d/d4b/d8f/fa4 [0,4194304] 0 2024-04-16T14:35:39.554 INFO:tasks.workunit.client.1.smithi115.stdout:9/530: creat d1/d7f/fb5 x:0 0 0 2024-04-16T14:35:39.554 INFO:tasks.workunit.client.1.smithi115.stdout:0/405: dread d6/d10/d12/d31/d35/d28/f66 [0,4194304] 0 2024-04-16T14:35:39.554 INFO:tasks.workunit.client.0.smithi005.stdout:3/678: symlink d2/d17/d46/ldd 0 2024-04-16T14:35:39.557 INFO:tasks.workunit.client.1.smithi115.stdout:2/550: dwrite d0/d1b/f38 [0,4194304] 0 2024-04-16T14:35:39.557 INFO:tasks.workunit.client.1.smithi115.stdout:5/437: dwrite dc/d3d/f7f [0,4194304] 0 2024-04-16T14:35:39.557 INFO:tasks.workunit.client.1.smithi115.stdout:5/438: chown dc/d3d/d41/f54 19 1 2024-04-16T14:35:39.557 INFO:tasks.workunit.client.1.smithi115.stdout:5/439: creat dc/d3d/f96 x:0 0 0 2024-04-16T14:35:39.557 INFO:tasks.workunit.client.1.smithi115.stdout:5/440: readlink dc/l44 0 2024-04-16T14:35:39.559 INFO:tasks.workunit.client.0.smithi005.stdout:3/679: mknod d2/d9/df/dbf/cde 0 2024-04-16T14:35:39.560 INFO:tasks.workunit.client.0.smithi005.stdout:5/723: dread d0/d6/f75 [0,4194304] 0 2024-04-16T14:35:39.560 INFO:tasks.workunit.client.0.smithi005.stdout:6/908: dread d2/d5/d10/dd6/f104 [0,4194304] 0 2024-04-16T14:35:39.560 INFO:tasks.workunit.client.0.smithi005.stdout:6/909: write d2/fd0 [1321183,94148] 0 2024-04-16T14:35:39.561 INFO:tasks.workunit.client.0.smithi005.stdout:3/680: creat d2/d17/d46/d75/d41/fdf x:0 0 0 2024-04-16T14:35:39.562 INFO:tasks.workunit.client.0.smithi005.stdout:6/910: dread d2/d5/d10/fde [0,4194304] 0 2024-04-16T14:35:39.562 INFO:tasks.workunit.client.0.smithi005.stdout:6/911: write d2/d3f/d47/d84/dbf/feb [964676,53764] 0 2024-04-16T14:35:39.562 INFO:tasks.workunit.client.0.smithi005.stdout:6/912: creat d2/d3f/d53/dba/d111/f133 x:0 0 0 2024-04-16T14:35:39.562 INFO:tasks.workunit.client.0.smithi005.stdout:6/913: fsync d2/d20/d3c/dcf/f61 0 2024-04-16T14:35:39.562 INFO:tasks.workunit.client.1.smithi115.stdout:0/406: creat d6/d10/d12/d1f/d36/d4b/d70/f93 x:0 0 0 2024-04-16T14:35:39.563 INFO:tasks.workunit.client.0.smithi005.stdout:5/724: unlink d0/d6/d12/dc0/d30/f68 0 2024-04-16T14:35:39.565 INFO:tasks.workunit.client.0.smithi005.stdout:3/681: mknod d2/d17/d46/d75/d41/d79/ce0 0 2024-04-16T14:35:39.567 INFO:tasks.workunit.client.1.smithi115.stdout:2/551: getdents d0/d47/d65/dad 0 2024-04-16T14:35:39.567 INFO:tasks.workunit.client.1.smithi115.stdout:2/552: chown d0/d47/d65/d61 2 1 2024-04-16T14:35:39.567 INFO:tasks.workunit.client.1.smithi115.stdout:2/553: fsync d0/d4/d24/f19 0 2024-04-16T14:35:39.568 INFO:tasks.workunit.client.0.smithi005.stdout:6/914: creat d2/d3f/d47/d84/da5/d10a/f134 x:0 0 0 2024-04-16T14:35:39.569 INFO:tasks.workunit.client.1.smithi115.stdout:5/441: mknod dc/d3d/d41/c97 0 2024-04-16T14:35:39.569 INFO:tasks.workunit.client.1.smithi115.stdout:5/442: stat dc/d15/d2d/c30 0 2024-04-16T14:35:39.570 INFO:tasks.workunit.client.1.smithi115.stdout:2/554: mknod d0/d4/d57/cb0 0 2024-04-16T14:35:39.571 INFO:tasks.workunit.client.1.smithi115.stdout:6/514: write d13/d1d/d2b/d5f/f32 [7153207,58467] 0 2024-04-16T14:35:39.572 INFO:tasks.workunit.client.0.smithi005.stdout:5/725: mknod d0/d6/d12/d1c/d81/cf8 0 2024-04-16T14:35:39.572 INFO:tasks.workunit.client.1.smithi115.stdout:5/443: rename dc/d15/d2d/f60 to dc/d15/d35/f98 0 2024-04-16T14:35:39.573 INFO:tasks.workunit.client.0.smithi005.stdout:6/915: creat d2/d3f/d47/d84/f135 x:0 0 0 2024-04-16T14:35:39.574 INFO:tasks.workunit.client.1.smithi115.stdout:2/555: symlink d0/lb1 0 2024-04-16T14:35:39.574 INFO:tasks.workunit.client.1.smithi115.stdout:2/556: fdatasync d0/fa1 0 2024-04-16T14:35:39.574 INFO:tasks.workunit.client.1.smithi115.stdout:2/557: readlink d0/l6 0 2024-04-16T14:35:39.575 INFO:tasks.workunit.client.0.smithi005.stdout:5/726: unlink d0/d6/c37 0 2024-04-16T14:35:39.576 INFO:tasks.workunit.client.1.smithi115.stdout:6/515: getdents d13/d1d/d2b/d5f/d30/d43/da6/d63 0 2024-04-16T14:35:39.576 INFO:tasks.workunit.client.1.smithi115.stdout:6/516: read d13/f1c [533347,58997] 0 2024-04-16T14:35:39.576 INFO:tasks.workunit.client.1.smithi115.stdout:6/517: creat d13/d1d/d47/fab x:0 0 0 2024-04-16T14:35:39.576 INFO:tasks.workunit.client.0.smithi005.stdout:3/682: dread d2/d92/fc0 [0,4194304] 0 2024-04-16T14:35:39.576 INFO:tasks.workunit.client.0.smithi005.stdout:3/683: stat d2/d17/d46/d75/d9b/dbd 0 2024-04-16T14:35:39.577 INFO:tasks.workunit.client.1.smithi115.stdout:1/430: dwrite df/d2d/f1e [0,4194304] 0 2024-04-16T14:35:39.577 INFO:tasks.workunit.client.0.smithi005.stdout:5/727: creat d0/d6/d12/dc0/d8d/ff9 x:0 0 0 2024-04-16T14:35:39.578 INFO:tasks.workunit.client.1.smithi115.stdout:9/531: dwrite d1/d6/d33/f85 [0,4194304] 0 2024-04-16T14:35:39.578 INFO:tasks.workunit.client.1.smithi115.stdout:9/532: chown d1/d6/d33/la3 123559350 1 2024-04-16T14:35:39.579 INFO:tasks.workunit.client.1.smithi115.stdout:9/533: write d1/d7f/f93 [641242,14701] 0 2024-04-16T14:35:39.579 INFO:tasks.workunit.client.0.smithi005.stdout:3/684: mkdir d2/d9/df/daa/dc4/de1 0 2024-04-16T14:35:39.582 INFO:tasks.workunit.client.0.smithi005.stdout:3/685: symlink d2/d9/le2 0 2024-04-16T14:35:39.584 INFO:tasks.workunit.client.1.smithi115.stdout:1/431: creat df/d13/d4d/d3e/d75/f8c x:0 0 0 2024-04-16T14:35:39.584 INFO:tasks.workunit.client.1.smithi115.stdout:1/432: chown df/d36/d3c 33 1 2024-04-16T14:35:39.585 INFO:tasks.workunit.client.0.smithi005.stdout:3/686: creat d2/d9/d25/fe3 x:0 0 0 2024-04-16T14:35:39.585 INFO:tasks.workunit.client.0.smithi005.stdout:3/687: creat d2/d9/fe4 x:0 0 0 2024-04-16T14:35:39.586 INFO:tasks.workunit.client.1.smithi115.stdout:5/444: dread dc/f1c [0,4194304] 0 2024-04-16T14:35:39.586 INFO:tasks.workunit.client.1.smithi115.stdout:5/445: write dc/f1f [888184,72979] 0 2024-04-16T14:35:39.587 INFO:tasks.workunit.client.1.smithi115.stdout:9/534: truncate d1/d6/d2d/d3d/d50/f5e 3641325 0 2024-04-16T14:35:39.589 INFO:tasks.workunit.client.1.smithi115.stdout:5/446: creat dc/d79/f99 x:0 0 0 2024-04-16T14:35:39.591 INFO:tasks.workunit.client.1.smithi115.stdout:5/447: write dc/d3d/f5a [4249164,74047] 0 2024-04-16T14:35:39.591 INFO:tasks.workunit.client.1.smithi115.stdout:5/448: readlink dc/d15/d35/l5b 0 2024-04-16T14:35:39.591 INFO:tasks.workunit.client.1.smithi115.stdout:5/449: dread - dc/d3d/f7e zero size 2024-04-16T14:35:39.595 INFO:tasks.workunit.client.1.smithi115.stdout:0/407: dwrite d6/d10/d12/d1f/d36/d4b/f86 [0,4194304] 0 2024-04-16T14:35:39.595 INFO:tasks.workunit.client.0.smithi005.stdout:3/688: write d2/d9/d25/d39/f7f [2076922,69111] 0 2024-04-16T14:35:39.598 INFO:tasks.workunit.client.1.smithi115.stdout:0/408: mkdir d6/d10/d94 0 2024-04-16T14:35:39.598 INFO:tasks.workunit.client.1.smithi115.stdout:0/409: write d6/f25 [2732832,10840] 0 2024-04-16T14:35:39.599 INFO:tasks.workunit.client.1.smithi115.stdout:9/535: dread d1/d6/f45 [0,4194304] 0 2024-04-16T14:35:39.599 INFO:tasks.workunit.client.1.smithi115.stdout:9/536: dread - d1/f92 zero size 2024-04-16T14:35:39.600 INFO:tasks.workunit.client.0.smithi005.stdout:3/689: dread d2/f71 [0,4194304] 0 2024-04-16T14:35:39.600 INFO:tasks.workunit.client.0.smithi005.stdout:3/690: truncate d2/d9/d51/fa7 610355 0 2024-04-16T14:35:39.601 INFO:tasks.workunit.client.1.smithi115.stdout:0/410: creat d6/f95 x:0 0 0 2024-04-16T14:35:39.602 INFO:tasks.workunit.client.1.smithi115.stdout:9/537: creat d1/d6/d2d/d3d/d49/fb6 x:0 0 0 2024-04-16T14:35:39.603 INFO:tasks.workunit.client.1.smithi115.stdout:5/450: write dc/d3d/d41/f46 [1373634,63575] 0 2024-04-16T14:35:39.603 INFO:tasks.workunit.client.0.smithi005.stdout:5/728: dwrite d0/d6/f4f [4194304,4194304] 0 2024-04-16T14:35:39.603 INFO:tasks.workunit.client.0.smithi005.stdout:6/916: dwrite d2/d5/f2a [0,4194304] 0 2024-04-16T14:35:39.603 INFO:tasks.workunit.client.1.smithi115.stdout:0/411: symlink d6/d10/d12/d1f/d36/d4b/d6d/d7a/l96 0 2024-04-16T14:35:39.604 INFO:tasks.workunit.client.0.smithi005.stdout:5/729: truncate d0/d70/fe6 3934998 0 2024-04-16T14:35:39.605 INFO:tasks.workunit.client.1.smithi115.stdout:5/451: mkdir dc/d5d/d81/d9a 0 2024-04-16T14:35:39.606 INFO:tasks.workunit.client.1.smithi115.stdout:0/412: symlink d6/d1b/l97 0 2024-04-16T14:35:39.607 INFO:tasks.workunit.client.1.smithi115.stdout:5/452: mknod dc/d5d/c9b 0 2024-04-16T14:35:39.609 INFO:tasks.workunit.client.0.smithi005.stdout:5/730: mkdir d0/dfa 0 2024-04-16T14:35:39.609 INFO:tasks.workunit.client.0.smithi005.stdout:5/731: write d0/d70/db3/fed [918500,53995] 0 2024-04-16T14:35:39.610 INFO:tasks.workunit.client.1.smithi115.stdout:5/453: link dc/l44 dc/d15/d2d/l9c 0 2024-04-16T14:35:39.610 INFO:tasks.workunit.client.1.smithi115.stdout:8/479: sync 2024-04-16T14:35:39.610 INFO:tasks.workunit.client.1.smithi115.stdout:7/429: sync 2024-04-16T14:35:39.610 INFO:tasks.workunit.client.1.smithi115.stdout:3/515: sync 2024-04-16T14:35:39.611 INFO:tasks.workunit.client.0.smithi005.stdout:5/732: getdents d0/d6/d12/dc0/d6d 0 2024-04-16T14:35:39.611 INFO:tasks.workunit.client.0.smithi005.stdout:5/733: fsync d0/d70/fbd 0 2024-04-16T14:35:39.612 INFO:tasks.workunit.client.1.smithi115.stdout:6/518: dwrite d13/d1d/d2b/d5f/f32 [4194304,4194304] 0 2024-04-16T14:35:39.612 INFO:tasks.workunit.client.1.smithi115.stdout:6/519: dread - d13/d1d/d2b/d5f/d30/f9e zero size 2024-04-16T14:35:39.612 INFO:tasks.workunit.client.1.smithi115.stdout:6/520: chown f11 0 1 2024-04-16T14:35:39.612 INFO:tasks.workunit.client.1.smithi115.stdout:3/516: write dc/f31 [318980,113983] 0 2024-04-16T14:35:39.612 INFO:tasks.workunit.client.1.smithi115.stdout:3/517: readlink dc/d29/d77/l9e 0 2024-04-16T14:35:39.614 INFO:tasks.workunit.client.1.smithi115.stdout:8/480: creat d0/db/d10/f97 x:0 0 0 2024-04-16T14:35:39.616 INFO:tasks.workunit.client.1.smithi115.stdout:9/538: dread d1/d6/d2d/d4b/d60/f99 [0,4194304] 0 2024-04-16T14:35:39.616 INFO:tasks.workunit.client.1.smithi115.stdout:9/539: fdatasync d1/d6/d29/f57 0 2024-04-16T14:35:39.616 INFO:tasks.workunit.client.1.smithi115.stdout:7/430: symlink d0/d1/l93 0 2024-04-16T14:35:39.616 INFO:tasks.workunit.client.1.smithi115.stdout:7/431: chown d0/d2/d3a/d73/c88 1 1 2024-04-16T14:35:39.621 INFO:tasks.workunit.client.1.smithi115.stdout:3/518: creat dc/d24/d36/d8c/faa x:0 0 0 2024-04-16T14:35:39.621 INFO:tasks.workunit.client.1.smithi115.stdout:3/519: fdatasync dc/d24/f49 0 2024-04-16T14:35:39.621 INFO:tasks.workunit.client.1.smithi115.stdout:9/540: mkdir d1/d6/d2d/d3d/db7 0 2024-04-16T14:35:39.621 INFO:tasks.workunit.client.0.smithi005.stdout:6/917: dread d2/d5/f8 [0,4194304] 0 2024-04-16T14:35:39.625 INFO:tasks.workunit.client.1.smithi115.stdout:8/481: dread d0/db/d10/d17/d22/f32 [0,4194304] 0 2024-04-16T14:35:39.625 INFO:tasks.workunit.client.1.smithi115.stdout:8/482: dread - d0/db/d10/d17/d2c/d61/d64/d89/f8b zero size 2024-04-16T14:35:39.625 INFO:tasks.workunit.client.1.smithi115.stdout:8/483: read - d0/db/d10/d17/d2c/d85/f8f zero size 2024-04-16T14:35:39.625 INFO:tasks.workunit.client.1.smithi115.stdout:8/484: write d0/db/d10/d17/d2c/f5e [4929219,40905] 0 2024-04-16T14:35:39.625 INFO:tasks.workunit.client.1.smithi115.stdout:8/485: fdatasync d0/db/d10/f6d 0 2024-04-16T14:35:39.625 INFO:tasks.workunit.client.1.smithi115.stdout:7/432: rmdir d0/d1/d3b/d5a 39 2024-04-16T14:35:39.630 INFO:tasks.workunit.client.1.smithi115.stdout:5/454: dwrite dc/d15/d35/f48 [0,4194304] 0 2024-04-16T14:35:39.634 INFO:tasks.workunit.client.1.smithi115.stdout:5/455: link dc/d15/f27 dc/d5d/d81/f9d 0 2024-04-16T14:35:39.635 INFO:tasks.workunit.client.1.smithi115.stdout:7/433: write d0/d2/d3a/d73/f7d [1684612,76418] 0 2024-04-16T14:35:39.636 INFO:tasks.workunit.client.1.smithi115.stdout:7/434: mkdir d0/d2/d94 0 2024-04-16T14:35:39.636 INFO:tasks.workunit.client.1.smithi115.stdout:7/435: truncate d0/d24/d40/f85 89270 0 2024-04-16T14:35:39.636 INFO:tasks.workunit.client.1.smithi115.stdout:7/436: truncate d0/d24/f37 4507873 0 2024-04-16T14:35:39.638 INFO:tasks.workunit.client.1.smithi115.stdout:7/437: mkdir d0/d2/d3a/d30/d79/d95 0 2024-04-16T14:35:39.642 INFO:tasks.workunit.client.1.smithi115.stdout:3/520: dwrite dc/d29/d4d/d56/d7e/f99 [0,4194304] 0 2024-04-16T14:35:39.643 INFO:tasks.workunit.client.1.smithi115.stdout:3/521: symlink dc/d29/d4d/d56/d98/lab 0 2024-04-16T14:35:39.643 INFO:tasks.workunit.client.1.smithi115.stdout:3/522: write dc/d24/d33/d4b/f97 [360807,130065] 0 2024-04-16T14:35:39.644 INFO:tasks.workunit.client.1.smithi115.stdout:3/523: mkdir dc/d29/d4d/dac 0 2024-04-16T14:35:39.645 INFO:tasks.workunit.client.1.smithi115.stdout:3/524: creat dc/d24/fad x:0 0 0 2024-04-16T14:35:39.646 INFO:tasks.workunit.client.1.smithi115.stdout:3/525: mkdir dc/d24/d36/d60/dae 0 2024-04-16T14:35:39.651 INFO:tasks.workunit.client.1.smithi115.stdout:7/438: dread d0/d2/d3a/d30/f32 [0,4194304] 0 2024-04-16T14:35:39.651 INFO:tasks.workunit.client.1.smithi115.stdout:8/486: dwrite d0/db/d10/d17/d2c/d52/d74/f4d [0,4194304] 0 2024-04-16T14:35:39.651 INFO:tasks.workunit.client.1.smithi115.stdout:9/541: dwrite d1/d6/d2d/d3d/d50/f94 [0,4194304] 0 2024-04-16T14:35:39.651 INFO:tasks.workunit.client.1.smithi115.stdout:8/487: stat d0/db/d10/d17/d2c/d61/d64/d89/f8b 0 2024-04-16T14:35:39.651 INFO:tasks.workunit.client.1.smithi115.stdout:8/488: write d0/db/d10/d17/d2c/d85/f8f [381703,15029] 0 2024-04-16T14:35:39.654 INFO:tasks.workunit.client.1.smithi115.stdout:8/489: symlink d0/db/d10/d17/d2c/d52/d74/d3b/d56/l98 0 2024-04-16T14:35:39.654 INFO:tasks.workunit.client.1.smithi115.stdout:8/490: write d0/db/d10/f97 [756576,85602] 0 2024-04-16T14:35:39.656 INFO:tasks.workunit.client.1.smithi115.stdout:5/456: dwrite dc/d3d/d41/f46 [0,4194304] 0 2024-04-16T14:35:39.657 INFO:tasks.workunit.client.1.smithi115.stdout:5/457: truncate dc/f2b 7667560 0 2024-04-16T14:35:39.658 INFO:tasks.workunit.client.1.smithi115.stdout:5/458: chown dc/d15/l1b 0 1 2024-04-16T14:35:39.658 INFO:tasks.workunit.client.1.smithi115.stdout:5/459: truncate dc/d15/d2d/f32 1454182 0 2024-04-16T14:35:39.658 INFO:tasks.workunit.client.1.smithi115.stdout:5/460: getdents dc/d15/d35/d71 0 2024-04-16T14:35:39.660 INFO:tasks.workunit.client.1.smithi115.stdout:5/461: read dc/d15/d2d/f32 [146112,88000] 0 2024-04-16T14:35:39.663 INFO:tasks.workunit.client.1.smithi115.stdout:6/521: dread f8 [0,4194304] 0 2024-04-16T14:35:39.664 INFO:tasks.workunit.client.1.smithi115.stdout:6/522: link f12 d13/d1d/d2b/fac 0 2024-04-16T14:35:39.672 INFO:tasks.workunit.client.1.smithi115.stdout:6/523: dread d13/f7f [4194304,4194304] 0 2024-04-16T14:35:39.674 INFO:tasks.workunit.client.1.smithi115.stdout:6/524: dread fc [0,4194304] 0 2024-04-16T14:35:39.676 INFO:tasks.workunit.client.1.smithi115.stdout:6/525: dread d13/d1d/d52/d8c/f98 [0,4194304] 0 2024-04-16T14:35:39.676 INFO:tasks.workunit.client.1.smithi115.stdout:6/526: truncate d13/d1d/d2b/d5f/d30/d43/da6/d63/f89 5804313 0 2024-04-16T14:35:39.676 INFO:tasks.workunit.client.1.smithi115.stdout:6/527: readlink d13/d1d/d52/d8c/la9 0 2024-04-16T14:35:39.677 INFO:tasks.workunit.client.1.smithi115.stdout:6/528: link d13/d1d/d68/fa0 d13/d1d/d2b/d5f/d30/d43/da6/d5a/fad 0 2024-04-16T14:35:39.677 INFO:tasks.workunit.client.1.smithi115.stdout:6/529: stat d13/d1d/d2b/d5f 0 2024-04-16T14:35:39.685 INFO:tasks.workunit.client.1.smithi115.stdout:6/530: read d13/d1d/d2b/d5f/d30/d43/da6/f8a [2173933,61610] 0 2024-04-16T14:35:39.700 INFO:tasks.workunit.client.1.smithi115.stdout:6/531: dwrite d13/d1d/d49/f8b [0,4194304] 0 2024-04-16T14:35:39.700 INFO:tasks.workunit.client.1.smithi115.stdout:6/532: symlink d13/d1d/d2b/d5f/d30/lae 0 2024-04-16T14:35:39.717 INFO:tasks.workunit.client.1.smithi115.stdout:6/533: dwrite d13/d1d/f5c [0,4194304] 0 2024-04-16T14:35:39.719 INFO:tasks.workunit.client.1.smithi115.stdout:6/534: creat d13/d1d/d2b/d5f/d30/d43/da6/faf x:0 0 0 2024-04-16T14:35:39.720 INFO:tasks.workunit.client.1.smithi115.stdout:6/535: mkdir d13/d1d/d2b/d5f/d30/d43/da6/d63/db0 0 2024-04-16T14:35:39.720 INFO:tasks.workunit.client.1.smithi115.stdout:6/536: dread - d13/d1d/f6f zero size 2024-04-16T14:35:39.720 INFO:tasks.workunit.client.1.smithi115.stdout:6/537: chown d13/d1d/d2b/d5f/d30/d43/d2c/l3d 144 1 2024-04-16T14:35:39.720 INFO:tasks.workunit.client.1.smithi115.stdout:6/538: creat d13/fb1 x:0 0 0 2024-04-16T14:35:39.729 INFO:tasks.workunit.client.1.smithi115.stdout:6/539: write d13/d1d/d49/f6d [1808733,22578] 0 2024-04-16T14:35:39.729 INFO:tasks.workunit.client.0.smithi005.stdout:0/639: sync 2024-04-16T14:35:39.729 INFO:tasks.workunit.client.0.smithi005.stdout:4/947: sync 2024-04-16T14:35:39.729 INFO:tasks.workunit.client.0.smithi005.stdout:0/640: fdatasync da/f1f 0 2024-04-16T14:35:39.729 INFO:tasks.workunit.client.0.smithi005.stdout:0/641: write da/df/d1b/f62 [290044,46753] 0 2024-04-16T14:35:39.730 INFO:tasks.workunit.client.1.smithi115.stdout:6/540: dread d13/d1d/d52/d8c/f98 [0,4194304] 0 2024-04-16T14:35:39.731 INFO:tasks.workunit.client.0.smithi005.stdout:8/713: sync 2024-04-16T14:35:39.731 INFO:tasks.workunit.client.0.smithi005.stdout:1/905: sync 2024-04-16T14:35:39.731 INFO:tasks.workunit.client.0.smithi005.stdout:8/714: chown d5/d11/f6f 13240103 1 2024-04-16T14:35:39.731 INFO:tasks.workunit.client.0.smithi005.stdout:9/496: sync 2024-04-16T14:35:39.731 INFO:tasks.workunit.client.0.smithi005.stdout:8/715: dread - d5/d7b/da8/da5/def/faa zero size 2024-04-16T14:35:39.731 INFO:tasks.workunit.client.0.smithi005.stdout:9/497: fdatasync d3/f8a 0 2024-04-16T14:35:39.731 INFO:tasks.workunit.client.0.smithi005.stdout:8/716: fdatasync d5/d11/ff8 0 2024-04-16T14:35:39.732 INFO:tasks.workunit.client.1.smithi115.stdout:8/491: dread d0/db/d10/d17/d2c/d85/f8f [0,4194304] 0 2024-04-16T14:35:39.732 INFO:tasks.workunit.client.1.smithi115.stdout:8/492: write d0/db/d10/d17/d22/f32 [1354605,76662] 0 2024-04-16T14:35:39.732 INFO:tasks.workunit.client.1.smithi115.stdout:8/493: chown d0/l48 46563018 1 2024-04-16T14:35:39.732 INFO:tasks.workunit.client.0.smithi005.stdout:4/948: rename d0/d1b/d1d/d1f/fe2 to d0/d1b/d1d/d1f/da0/f130 0 2024-04-16T14:35:39.733 INFO:tasks.workunit.client.0.smithi005.stdout:1/906: rmdir d2/d74/dd7 39 2024-04-16T14:35:39.734 INFO:tasks.workunit.client.0.smithi005.stdout:4/949: mkdir d0/d1b/d1d/dde/d131 0 2024-04-16T14:35:39.736 INFO:tasks.workunit.client.0.smithi005.stdout:1/907: symlink d2/d74/dd7/l137 0 2024-04-16T14:35:39.736 INFO:tasks.workunit.client.0.smithi005.stdout:1/908: chown d2/d74/dd7/d11f/lb0 260 1 2024-04-16T14:35:39.736 INFO:tasks.workunit.client.0.smithi005.stdout:1/909: chown d2/d1c/f58 2872 1 2024-04-16T14:35:39.736 INFO:tasks.workunit.client.0.smithi005.stdout:1/910: stat d2/d1c/d15/d2a/f16 0 2024-04-16T14:35:39.736 INFO:tasks.workunit.client.0.smithi005.stdout:9/498: getdents d3/d12/d16/d86 0 2024-04-16T14:35:39.736 INFO:tasks.workunit.client.0.smithi005.stdout:9/499: readlink d3/d49/d4b/d5c/l7d 0 2024-04-16T14:35:39.736 INFO:tasks.workunit.client.0.smithi005.stdout:9/500: fsync d3/d12/d16/f1d 0 2024-04-16T14:35:39.737 INFO:tasks.workunit.client.0.smithi005.stdout:4/950: dread d0/d1b/db7/ddd/fe1 [0,4194304] 0 2024-04-16T14:35:39.738 INFO:tasks.workunit.client.1.smithi115.stdout:5/462: dread dc/d5d/d81/f9d [0,4194304] 0 2024-04-16T14:35:39.738 INFO:tasks.workunit.client.0.smithi005.stdout:9/501: creat d3/d49/d4b/d5c/d65/f8d x:0 0 0 2024-04-16T14:35:39.738 INFO:tasks.workunit.client.0.smithi005.stdout:9/502: chown d3/d12 273603923 1 2024-04-16T14:35:39.739 INFO:tasks.workunit.client.0.smithi005.stdout:4/951: mknod d0/d4d/c132 0 2024-04-16T14:35:39.740 INFO:tasks.workunit.client.0.smithi005.stdout:1/911: link d2/d74/d7a/fe8 d2/d1c/d15/d2a/d19/d42/d64/d76/f138 0 2024-04-16T14:35:39.741 INFO:tasks.workunit.client.0.smithi005.stdout:4/952: getdents d0/d1b/d1d/d1f/d3e/daa 0 2024-04-16T14:35:39.741 INFO:tasks.workunit.client.0.smithi005.stdout:4/953: write d0/d1b/db7/d100/f112 [400799,30020] 0 2024-04-16T14:35:39.742 INFO:tasks.workunit.client.0.smithi005.stdout:4/954: fsync d0/f1a 0 2024-04-16T14:35:39.743 INFO:tasks.workunit.client.0.smithi005.stdout:1/912: creat d2/d1c/d15/d2a/d19/d20/d27/d73/f139 x:0 0 0 2024-04-16T14:35:39.743 INFO:tasks.workunit.client.0.smithi005.stdout:1/913: creat d2/d1c/d15/d2a/f13a x:0 0 0 2024-04-16T14:35:39.745 INFO:tasks.workunit.client.0.smithi005.stdout:4/955: unlink d0/d1b/d1d/d1f/d48/fc7 0 2024-04-16T14:35:39.751 INFO:tasks.workunit.client.1.smithi115.stdout:3/526: getdents dc/d24 0 2024-04-16T14:35:39.751 INFO:tasks.workunit.client.1.smithi115.stdout:3/527: fsync dc/ff 0 2024-04-16T14:35:39.753 INFO:tasks.workunit.client.0.smithi005.stdout:1/914: getdents d2/d74/d7a 0 2024-04-16T14:35:39.753 INFO:tasks.workunit.client.0.smithi005.stdout:1/915: write d2/d74/d7a/fc1 [921788,27335] 0 2024-04-16T14:35:39.753 INFO:tasks.workunit.client.0.smithi005.stdout:1/916: truncate d2/d74/dd7/f81 1365520 0 2024-04-16T14:35:39.755 INFO:tasks.workunit.client.0.smithi005.stdout:8/717: write d5/f43 [2507227,88416] 0 2024-04-16T14:35:39.756 INFO:tasks.workunit.client.0.smithi005.stdout:1/917: creat d2/d74/dd7/d11f/d51/d132/dcd/f13b x:0 0 0 2024-04-16T14:35:39.758 INFO:tasks.workunit.client.0.smithi005.stdout:8/718: unlink d5/d40/fec 0 2024-04-16T14:35:39.758 INFO:tasks.workunit.client.0.smithi005.stdout:1/918: symlink d2/d2c/l13c 0 2024-04-16T14:35:39.759 INFO:tasks.workunit.client.0.smithi005.stdout:1/919: dread - d2/d1c/d15/d2a/d19/d20/d27/f10c zero size 2024-04-16T14:35:39.759 INFO:tasks.workunit.client.0.smithi005.stdout:8/719: creat d5/d7b/da8/db7/d8a/da1/d3d/dba/dcd/ffd x:0 0 0 2024-04-16T14:35:39.761 INFO:tasks.workunit.client.0.smithi005.stdout:1/920: link d2/d1c/d15/d2a/d19/lae d2/d74/dd7/d11f/l13d 0 2024-04-16T14:35:39.763 INFO:tasks.workunit.client.0.smithi005.stdout:1/921: symlink d2/d74/d7a/l13e 0 2024-04-16T14:35:39.764 INFO:tasks.workunit.client.0.smithi005.stdout:1/922: write d2/d1c/d15/d2a/d19/d20/f53 [1503047,127520] 0 2024-04-16T14:35:39.764 INFO:tasks.workunit.client.0.smithi005.stdout:8/720: rmdir d5/d55/d5a 39 2024-04-16T14:35:39.766 INFO:tasks.workunit.client.0.smithi005.stdout:1/923: truncate d2/d74/dd7/f10b 458954 0 2024-04-16T14:35:39.766 INFO:tasks.workunit.client.0.smithi005.stdout:1/924: write d2/d1c/d15/d2a/d19/d20/d27/f34 [3804960,118972] 0 2024-04-16T14:35:39.766 INFO:tasks.workunit.client.0.smithi005.stdout:8/721: mkdir d5/d40/d8e/dfe 0 2024-04-16T14:35:39.767 INFO:tasks.workunit.client.0.smithi005.stdout:8/722: dread - d5/d7b/da8/da5/def/f8f zero size 2024-04-16T14:35:39.767 INFO:tasks.workunit.client.1.smithi115.stdout:5/463: dwrite dc/d15/d4d/f6f [0,4194304] 0 2024-04-16T14:35:39.768 INFO:tasks.workunit.client.0.smithi005.stdout:1/925: mkdir d2/d1c/d15/d2a/d25/d13f 0 2024-04-16T14:35:39.769 INFO:tasks.workunit.client.0.smithi005.stdout:8/723: getdents d5/d7b/da8/db7/d8a/da1/d3d/d7f/d8d/dd1 0 2024-04-16T14:35:39.771 INFO:tasks.workunit.client.1.smithi115.stdout:5/464: unlink dc/d15/c6c 0 2024-04-16T14:35:39.772 INFO:tasks.workunit.client.1.smithi115.stdout:5/465: write dc/d3d/f6a [1028486,25857] 0 2024-04-16T14:35:39.774 INFO:tasks.workunit.client.0.smithi005.stdout:0/642: dwrite da/df/d1b/d24/fcf [0,4194304] 0 2024-04-16T14:35:39.774 INFO:tasks.workunit.client.0.smithi005.stdout:0/643: fdatasync da/df/d1b/fa5 0 2024-04-16T14:35:39.774 INFO:tasks.workunit.client.0.smithi005.stdout:0/644: chown da/df/d1b/d3a/d53/d5a/d67/d79 8 1 2024-04-16T14:35:39.774 INFO:tasks.workunit.client.0.smithi005.stdout:0/645: creat da/df/d1b/d24/d75/d81/fd4 x:0 0 0 2024-04-16T14:35:39.774 INFO:tasks.workunit.client.0.smithi005.stdout:0/646: truncate da/f1f 7066382 0 2024-04-16T14:35:39.775 INFO:tasks.workunit.client.1.smithi115.stdout:6/541: dwrite d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/d55/fa5 [0,4194304] 0 2024-04-16T14:35:39.775 INFO:tasks.workunit.client.1.smithi115.stdout:8/494: dwrite d0/db/f1b [0,4194304] 0 2024-04-16T14:35:39.775 INFO:tasks.workunit.client.1.smithi115.stdout:8/495: write d0/db/d10/d17/f7b [5113671,69456] 0 2024-04-16T14:35:39.777 INFO:tasks.workunit.client.0.smithi005.stdout:0/647: mknod da/df/d1b/cd5 0 2024-04-16T14:35:39.779 INFO:tasks.workunit.client.1.smithi115.stdout:6/542: symlink d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/lb2 0 2024-04-16T14:35:39.781 INFO:tasks.workunit.client.1.smithi115.stdout:8/496: unlink d0/db/d44/l4f 0 2024-04-16T14:35:39.781 INFO:tasks.workunit.client.1.smithi115.stdout:8/497: read d0/db/d10/d17/d2c/d52/d6c/f87 [2613573,9835] 0 2024-04-16T14:35:39.781 INFO:tasks.workunit.client.1.smithi115.stdout:8/498: fsync d0/db/f12 0 2024-04-16T14:35:39.782 INFO:tasks.workunit.client.1.smithi115.stdout:6/543: creat d13/d1d/d2b/d5f/d30/d43/fb3 x:0 0 0 2024-04-16T14:35:39.783 INFO:tasks.workunit.client.1.smithi115.stdout:8/499: truncate d0/db/d10/d17/d22/f75 1211928 0 2024-04-16T14:35:39.784 INFO:tasks.workunit.client.0.smithi005.stdout:0/648: dread da/f1f [0,4194304] 0 2024-04-16T14:35:39.784 INFO:tasks.workunit.client.1.smithi115.stdout:6/544: truncate d13/d1d/d2b/d5f/d30/d43/da6/f6b 808682 0 2024-04-16T14:35:39.786 INFO:tasks.workunit.client.1.smithi115.stdout:6/545: creat d13/d1d/d2b/d5f/d30/d43/d2c/fb4 x:0 0 0 2024-04-16T14:35:39.786 INFO:tasks.workunit.client.1.smithi115.stdout:6/546: write d13/d1d/d2b/d5f/d30/d43/da6/d5a/fad [357731,96852] 0 2024-04-16T14:35:39.787 INFO:tasks.workunit.client.0.smithi005.stdout:0/649: symlink da/df/d1b/d3a/d53/d5a/d99/ld6 0 2024-04-16T14:35:39.787 INFO:tasks.workunit.client.0.smithi005.stdout:0/650: write da/df/d1b/d3a/d53/fcc [204950,17337] 0 2024-04-16T14:35:39.787 INFO:tasks.workunit.client.0.smithi005.stdout:0/651: fsync da/df/d1b/d24/f9d 0 2024-04-16T14:35:39.787 INFO:tasks.workunit.client.0.smithi005.stdout:0/652: readlink da/df/d26/d39/l66 0 2024-04-16T14:35:39.788 INFO:tasks.workunit.client.0.smithi005.stdout:0/653: mkdir da/df/d26/da9/dcb/dd7 0 2024-04-16T14:35:39.788 INFO:tasks.workunit.client.0.smithi005.stdout:0/654: mkdir da/df/d26/da9/dcb/dd8 0 2024-04-16T14:35:39.790 INFO:tasks.workunit.client.0.smithi005.stdout:4/956: dwrite d0/f58 [0,4194304] 0 2024-04-16T14:35:39.790 INFO:tasks.workunit.client.0.smithi005.stdout:4/957: creat d0/d22/d61/f133 x:0 0 0 2024-04-16T14:35:39.790 INFO:tasks.workunit.client.0.smithi005.stdout:0/655: link da/df/f94 da/df/d1b/d3a/d53/d5a/d99/fd9 0 2024-04-16T14:35:39.796 INFO:tasks.workunit.client.1.smithi115.stdout:8/500: dread d0/db/d10/d17/f18 [0,4194304] 0 2024-04-16T14:35:39.796 INFO:tasks.workunit.client.1.smithi115.stdout:8/501: readlink d0/db/d10/d17/d22/l4e 0 2024-04-16T14:35:39.797 INFO:tasks.workunit.client.1.smithi115.stdout:8/502: creat d0/db/d10/d17/d2c/d52/f99 x:0 0 0 2024-04-16T14:35:39.799 INFO:tasks.workunit.client.1.smithi115.stdout:8/503: unlink d0/f1f 0 2024-04-16T14:35:39.800 INFO:tasks.workunit.client.1.smithi115.stdout:8/504: dread - d0/db/d10/d17/d22/f5d zero size 2024-04-16T14:35:39.801 INFO:tasks.workunit.client.1.smithi115.stdout:4/458: sync 2024-04-16T14:35:39.801 INFO:tasks.workunit.client.1.smithi115.stdout:4/459: stat d1/d15/d24/f40 0 2024-04-16T14:35:39.801 INFO:tasks.workunit.client.1.smithi115.stdout:4/460: fdatasync d1/f22 0 2024-04-16T14:35:39.802 INFO:tasks.workunit.client.1.smithi115.stdout:8/505: rmdir d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f 39 2024-04-16T14:35:39.802 INFO:tasks.workunit.client.1.smithi115.stdout:3/528: dwrite dc/d24/d33/d4b/da3/d69/fa1 [0,4194304] 0 2024-04-16T14:35:39.804 INFO:tasks.workunit.client.1.smithi115.stdout:8/506: unlink d0/db/d10/d17/d2c/f43 0 2024-04-16T14:35:39.807 INFO:tasks.workunit.client.1.smithi115.stdout:4/461: symlink d1/d15/l79 0 2024-04-16T14:35:39.807 INFO:tasks.workunit.client.1.smithi115.stdout:4/462: write d1/d2/ff [5271850,1023] 0 2024-04-16T14:35:39.807 INFO:tasks.workunit.client.1.smithi115.stdout:4/463: dread - d1/d15/d1e/f5d zero size 2024-04-16T14:35:39.808 INFO:tasks.workunit.client.0.smithi005.stdout:4/958: dwrite d0/d22/d29/f78 [0,4194304] 0 2024-04-16T14:35:39.808 INFO:tasks.workunit.client.1.smithi115.stdout:4/464: mkdir d1/d15/d31/d42/d46/d7a 0 2024-04-16T14:35:39.810 INFO:tasks.workunit.client.0.smithi005.stdout:0/656: write da/df/d1b/d3a/d53/f8f [3352392,61511] 0 2024-04-16T14:35:39.810 INFO:tasks.workunit.client.0.smithi005.stdout:1/926: dwrite d2/d1c/d15/d2a/d19/d42/d71/dac/d99/f128 [0,4194304] 0 2024-04-16T14:35:39.811 INFO:tasks.workunit.client.0.smithi005.stdout:4/959: creat d0/f134 x:0 0 0 2024-04-16T14:35:39.811 INFO:tasks.workunit.client.1.smithi115.stdout:8/507: write d0/db/f55 [555007,30688] 0 2024-04-16T14:35:39.813 INFO:tasks.workunit.client.1.smithi115.stdout:8/508: creat d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/f9a x:0 0 0 2024-04-16T14:35:39.816 INFO:tasks.workunit.client.1.smithi115.stdout:8/509: mknod d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/d8a/c9b 0 2024-04-16T14:35:39.816 INFO:tasks.workunit.client.1.smithi115.stdout:8/510: stat d0/db/d10/d17/d2c/d85/f8f 0 2024-04-16T14:35:39.816 INFO:tasks.workunit.client.1.smithi115.stdout:8/511: creat d0/db/d10/d17/d2c/d52/d84/f9c x:0 0 0 2024-04-16T14:35:39.820 INFO:tasks.workunit.client.1.smithi115.stdout:8/512: rename d0/db/c78 to d0/db/d10/d17/d2c/d61/d64/d89/c9d 0 2024-04-16T14:35:39.821 INFO:tasks.workunit.client.1.smithi115.stdout:8/513: fdatasync d0/db/d10/d17/f2b 0 2024-04-16T14:35:39.821 INFO:tasks.workunit.client.1.smithi115.stdout:8/514: creat d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/f9e x:0 0 0 2024-04-16T14:35:39.821 INFO:tasks.workunit.client.1.smithi115.stdout:8/515: readlink d0/db/d10/d17/d2c/l51 0 2024-04-16T14:35:39.822 INFO:tasks.workunit.client.1.smithi115.stdout:4/465: write d1/d15/d31/d42/d46/f50 [4110066,33202] 0 2024-04-16T14:35:39.825 INFO:tasks.workunit.client.1.smithi115.stdout:6/547: getdents d13/d1d/d2b/d5f/d30/d43/d2c 0 2024-04-16T14:35:39.828 INFO:tasks.workunit.client.1.smithi115.stdout:4/466: dread d1/d15/d1e/f2b [0,4194304] 0 2024-04-16T14:35:39.830 INFO:tasks.workunit.client.1.smithi115.stdout:8/516: write d0/db/d10/d17/f4c [3990203,50588] 0 2024-04-16T14:35:39.830 INFO:tasks.workunit.client.1.smithi115.stdout:8/517: fsync d0/db/d10/d17/d22/f5d 0 2024-04-16T14:35:39.831 INFO:tasks.workunit.client.1.smithi115.stdout:4/467: mknod d1/d15/d31/d42/d46/c7b 0 2024-04-16T14:35:39.837 INFO:tasks.workunit.client.1.smithi115.stdout:8/518: creat d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/d8a/f9f x:0 0 0 2024-04-16T14:35:39.837 INFO:tasks.workunit.client.1.smithi115.stdout:8/519: dread - d0/db/f24 zero size 2024-04-16T14:35:39.837 INFO:tasks.workunit.client.1.smithi115.stdout:8/520: read - d0/db/d10/d17/d22/f6f zero size 2024-04-16T14:35:39.837 INFO:tasks.workunit.client.1.smithi115.stdout:8/521: dread - d0/f62 zero size 2024-04-16T14:35:39.837 INFO:tasks.workunit.client.1.smithi115.stdout:8/522: creat d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/d8a/fa0 x:0 0 0 2024-04-16T14:35:39.837 INFO:tasks.workunit.client.1.smithi115.stdout:8/523: read d0/db/d44/f93 [1182298,26114] 0 2024-04-16T14:35:39.837 INFO:tasks.workunit.client.1.smithi115.stdout:8/524: chown d0/db/f24 5632 1 2024-04-16T14:35:39.842 INFO:tasks.workunit.client.1.smithi115.stdout:4/468: dread d1/d15/d1e/f23 [0,4194304] 0 2024-04-16T14:35:39.842 INFO:tasks.workunit.client.1.smithi115.stdout:4/469: link d1/d15/d31/d42/d46/c67 d1/d15/d24/c7c 0 2024-04-16T14:35:39.845 INFO:tasks.workunit.client.0.smithi005.stdout:1/927: write d2/d2c/f4f [3899965,74021] 0 2024-04-16T14:35:39.845 INFO:tasks.workunit.client.0.smithi005.stdout:1/928: creat d2/d1c/d15/d2a/d19/d42/d71/dac/d99/f140 x:0 0 0 2024-04-16T14:35:39.846 INFO:tasks.workunit.client.0.smithi005.stdout:4/960: dwrite d0/d22/d61/fc1 [0,4194304] 0 2024-04-16T14:35:39.846 INFO:tasks.workunit.client.1.smithi115.stdout:3/529: dwrite dc/f15 [0,4194304] 0 2024-04-16T14:35:39.846 INFO:tasks.workunit.client.1.smithi115.stdout:6/548: dwrite d13/d1d/d2b/d5f/d30/f9e [0,4194304] 0 2024-04-16T14:35:39.850 INFO:tasks.workunit.client.1.smithi115.stdout:3/530: creat dc/d29/d4d/d56/d98/faf x:0 0 0 2024-04-16T14:35:39.851 INFO:tasks.workunit.client.1.smithi115.stdout:3/531: chown dc/f67 0 1 2024-04-16T14:35:39.851 INFO:tasks.workunit.client.0.smithi005.stdout:4/961: write d0/f26 [4143450,57535] 0 2024-04-16T14:35:39.853 INFO:tasks.workunit.client.1.smithi115.stdout:8/525: dwrite d0/db/d10/d17/d2c/d52/d84/f9c [0,4194304] 0 2024-04-16T14:35:39.856 INFO:tasks.workunit.client.1.smithi115.stdout:8/526: fsync d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/f9e 0 2024-04-16T14:35:39.859 INFO:tasks.workunit.client.1.smithi115.stdout:3/532: mknod dc/d29/cb0 0 2024-04-16T14:35:39.862 INFO:tasks.workunit.client.1.smithi115.stdout:4/470: dwrite d1/d2/f5b [0,4194304] 0 2024-04-16T14:35:39.865 INFO:tasks.workunit.client.0.smithi005.stdout:4/962: write d0/d1b/d1d/d1f/d3e/f55 [2665917,26129] 0 2024-04-16T14:35:39.865 INFO:tasks.workunit.client.0.smithi005.stdout:4/963: fsync d0/d1b/d1d/dc3/f106 0 2024-04-16T14:35:39.866 INFO:tasks.workunit.client.0.smithi005.stdout:4/964: fdatasync d0/d1b/d1d/d1f/d3e/daa/f11b 0 2024-04-16T14:35:39.866 INFO:tasks.workunit.client.0.smithi005.stdout:4/965: fsync d0/d1b/d1d/d1f/d5d/f93 0 2024-04-16T14:35:39.867 INFO:tasks.workunit.client.0.smithi005.stdout:4/966: mkdir d0/d1b/d1d/dde/d135 0 2024-04-16T14:35:39.867 INFO:tasks.workunit.client.0.smithi005.stdout:4/967: write d0/d22/fda [3398076,8551] 0 2024-04-16T14:35:39.867 INFO:tasks.workunit.client.0.smithi005.stdout:4/968: fsync d0/d1b/d1d/d1f/d5d/da7/d90/fd3 0 2024-04-16T14:35:39.869 INFO:tasks.workunit.client.0.smithi005.stdout:4/969: truncate d0/d1b/db7/ddd/f10b 1894566 0 2024-04-16T14:35:39.870 INFO:tasks.workunit.client.1.smithi115.stdout:3/533: creat dc/d24/d36/d60/dae/fb1 x:0 0 0 2024-04-16T14:35:39.870 INFO:tasks.workunit.client.1.smithi115.stdout:3/534: chown f6 115038389 1 2024-04-16T14:35:39.872 INFO:tasks.workunit.client.1.smithi115.stdout:8/527: truncate d0/db/d10/d17/d2c/d52/d6c/f87 4500935 0 2024-04-16T14:35:39.874 INFO:tasks.workunit.client.1.smithi115.stdout:3/535: creat dc/d24/d33/d4b/da3/d69/fb2 x:0 0 0 2024-04-16T14:35:39.877 INFO:tasks.workunit.client.1.smithi115.stdout:3/536: link dc/d29/d4d/d56/d7e/l93 dc/d24/d33/d4b/da3/d69/lb3 0 2024-04-16T14:35:39.879 INFO:tasks.workunit.client.1.smithi115.stdout:3/537: read dc/d24/d36/d60/f7a [626561,96751] 0 2024-04-16T14:35:39.879 INFO:tasks.workunit.client.1.smithi115.stdout:3/538: truncate f4 5204358 0 2024-04-16T14:35:39.879 INFO:tasks.workunit.client.1.smithi115.stdout:2/558: sync 2024-04-16T14:35:39.881 INFO:tasks.workunit.client.0.smithi005.stdout:4/970: dread d0/d1b/d1d/d1f/d5d/da7/d90/fd3 [0,4194304] 0 2024-04-16T14:35:39.884 INFO:tasks.workunit.client.0.smithi005.stdout:4/971: rename d0/d22/df2/d10d/f12c to d0/d1b/d1d/d1f/d48/dab/dcb/f136 0 2024-04-16T14:35:39.884 INFO:tasks.workunit.client.0.smithi005.stdout:4/972: write d0/d22/d29/f7f [3865747,6280] 0 2024-04-16T14:35:39.885 INFO:tasks.workunit.client.1.smithi115.stdout:4/471: dwrite d1/d15/d31/d42/f70 [0,4194304] 0 2024-04-16T14:35:39.887 INFO:tasks.workunit.client.1.smithi115.stdout:4/472: creat d1/d15/d78/f7d x:0 0 0 2024-04-16T14:35:39.889 INFO:tasks.workunit.client.1.smithi115.stdout:4/473: truncate d1/d15/d31/f4b 514087 0 2024-04-16T14:35:39.889 INFO:tasks.workunit.client.1.smithi115.stdout:3/539: dread dc/f27 [0,4194304] 0 2024-04-16T14:35:39.890 INFO:tasks.workunit.client.1.smithi115.stdout:3/540: creat dc/d24/d33/d4b/da3/d69/fb4 x:0 0 0 2024-04-16T14:35:39.890 INFO:tasks.workunit.client.1.smithi115.stdout:4/474: truncate d1/f2d 7119385 0 2024-04-16T14:35:39.893 INFO:tasks.workunit.client.1.smithi115.stdout:3/541: creat dc/d24/d33/fb5 x:0 0 0 2024-04-16T14:35:39.898 INFO:tasks.workunit.client.1.smithi115.stdout:2/559: dwrite d0/d47/d65/d61/f92 [0,4194304] 0 2024-04-16T14:35:39.898 INFO:tasks.workunit.client.1.smithi115.stdout:2/560: stat d0/d47/c7d 0 2024-04-16T14:35:39.899 INFO:tasks.workunit.client.0.smithi005.stdout:4/973: dread d0/d1b/d1d/dc3/f106 [0,4194304] 0 2024-04-16T14:35:39.899 INFO:tasks.workunit.client.0.smithi005.stdout:4/974: fsync d0/d1b/db7/ddd/fe1 0 2024-04-16T14:35:39.900 INFO:tasks.workunit.client.1.smithi115.stdout:2/561: dread d0/d4/d24/d23/d71/f93 [0,4194304] 0 2024-04-16T14:35:39.900 INFO:tasks.workunit.client.1.smithi115.stdout:2/562: chown d0/d4/d57/l5e 6090 1 2024-04-16T14:35:39.900 INFO:tasks.workunit.client.1.smithi115.stdout:8/528: dwrite d0/db/d10/f6d [0,4194304] 0 2024-04-16T14:35:39.901 INFO:tasks.workunit.client.0.smithi005.stdout:4/975: rename d0/d1b/d1d/d1f/d48/dab to d0/d1b/d1d/d1f/da0/d137 0 2024-04-16T14:35:39.903 INFO:tasks.workunit.client.1.smithi115.stdout:2/563: symlink d0/d4/de/d11/d36/lb2 0 2024-04-16T14:35:39.906 INFO:tasks.workunit.client.1.smithi115.stdout:2/564: rename d0/d4/d22/c8f to d0/d4/d24/d21/cb3 0 2024-04-16T14:35:39.906 INFO:tasks.workunit.client.1.smithi115.stdout:2/565: fsync d0/d4/ff 0 2024-04-16T14:35:39.907 INFO:tasks.workunit.client.0.smithi005.stdout:4/976: read d0/d1b/d1d/d1f/d5d/da7/d90/fd3 [1862253,99663] 0 2024-04-16T14:35:39.907 INFO:tasks.workunit.client.1.smithi115.stdout:2/566: mknod d0/d4/d24/d23/d83/cb4 0 2024-04-16T14:35:39.908 INFO:tasks.workunit.client.0.smithi005.stdout:4/977: truncate d0/d22/d29/d107/d104/f109 1385653 0 2024-04-16T14:35:39.908 INFO:tasks.workunit.client.0.smithi005.stdout:4/978: chown d0/d1b/d1d 68082107 1 2024-04-16T14:35:39.910 INFO:tasks.workunit.client.1.smithi115.stdout:4/475: dwrite d1/d15/d31/f3a [0,4194304] 0 2024-04-16T14:35:39.910 INFO:tasks.workunit.client.1.smithi115.stdout:2/567: rename d0/d4/d24/d23/d80/ca8 to d0/d4/d24/d23/d71/cb5 0 2024-04-16T14:35:39.911 INFO:tasks.workunit.client.0.smithi005.stdout:4/979: rename d0/d1b/d1d/d1f/d3e/fcf to d0/d1b/d1d/d1f/da0/d137/f138 0 2024-04-16T14:35:39.914 INFO:tasks.workunit.client.1.smithi115.stdout:2/568: getdents d0/d4/de/d11/d6d 0 2024-04-16T14:35:39.915 INFO:tasks.workunit.client.1.smithi115.stdout:2/569: symlink d0/d47/d65/d61/d70/lb6 0 2024-04-16T14:35:39.915 INFO:tasks.workunit.client.1.smithi115.stdout:2/570: chown d0/d4/d24/f34 1604027 1 2024-04-16T14:35:39.917 INFO:tasks.workunit.client.1.smithi115.stdout:2/571: unlink d0/d4/d22/c5b 0 2024-04-16T14:35:39.926 INFO:tasks.workunit.client.1.smithi115.stdout:2/572: write d0/d4/ff [1288216,32919] 0 2024-04-16T14:35:39.930 INFO:tasks.workunit.client.1.smithi115.stdout:8/529: dwrite d0/db/d10/d17/d2c/f60 [4194304,4194304] 0 2024-04-16T14:35:39.931 INFO:tasks.workunit.client.1.smithi115.stdout:3/542: dwrite dc/d24/d36/f72 [0,4194304] 0 2024-04-16T14:35:39.931 INFO:tasks.workunit.client.1.smithi115.stdout:3/543: dread - dc/d29/d39/d86/f89 zero size 2024-04-16T14:35:39.931 INFO:tasks.workunit.client.1.smithi115.stdout:3/544: truncate dc/d29/d39/f76 4563645 0 2024-04-16T14:35:39.931 INFO:tasks.workunit.client.1.smithi115.stdout:3/545: write dc/d29/f85 [901460,52630] 0 2024-04-16T14:35:39.932 INFO:tasks.workunit.client.0.smithi005.stdout:4/980: dwrite d0/f58 [0,4194304] 0 2024-04-16T14:35:39.932 INFO:tasks.workunit.client.0.smithi005.stdout:4/981: dread - d0/d1b/d1d/d1f/da0/d137/dcb/ffb zero size 2024-04-16T14:35:39.933 INFO:tasks.workunit.client.0.smithi005.stdout:4/982: rename d0/d22/ca3 to d0/d1b/d1d/dde/d135/c139 0 2024-04-16T14:35:39.937 INFO:tasks.workunit.client.1.smithi115.stdout:2/573: unlink d0/d4/d24/d23/d71/cb5 0 2024-04-16T14:35:39.942 INFO:tasks.workunit.client.1.smithi115.stdout:3/546: write dc/f1c [316509,19436] 0 2024-04-16T14:35:39.942 INFO:tasks.workunit.client.1.smithi115.stdout:3/547: chown dc/d29 315855 1 2024-04-16T14:35:39.942 INFO:tasks.workunit.client.1.smithi115.stdout:3/548: stat dc/f27 0 2024-04-16T14:35:39.942 INFO:tasks.workunit.client.1.smithi115.stdout:8/530: creat d0/db/d10/d17/d2c/d61/d6b/fa1 x:0 0 0 2024-04-16T14:35:39.944 INFO:tasks.workunit.client.1.smithi115.stdout:2/574: creat d0/d4/de/d11/fb7 x:0 0 0 2024-04-16T14:35:39.944 INFO:tasks.workunit.client.1.smithi115.stdout:3/549: creat dc/d24/d33/d4b/d81/fb6 x:0 0 0 2024-04-16T14:35:39.945 INFO:tasks.workunit.client.1.smithi115.stdout:8/531: mkdir d0/db/d10/d17/d2c/d61/d64/d83/da2 0 2024-04-16T14:35:39.947 INFO:tasks.workunit.client.1.smithi115.stdout:2/575: creat d0/d47/d65/dad/fb8 x:0 0 0 2024-04-16T14:35:39.947 INFO:tasks.workunit.client.1.smithi115.stdout:2/576: chown d0/d47/d65/d61/c8b 241486 1 2024-04-16T14:35:39.947 INFO:tasks.workunit.client.1.smithi115.stdout:2/577: chown d0/lb1 1490259149 1 2024-04-16T14:35:39.953 INFO:tasks.workunit.client.1.smithi115.stdout:8/532: symlink d0/db/d10/d17/d2c/d52/la3 0 2024-04-16T14:35:39.953 INFO:tasks.workunit.client.1.smithi115.stdout:3/550: dread dc/d29/d4d/d56/f5c [0,4194304] 0 2024-04-16T14:35:39.953 INFO:tasks.workunit.client.1.smithi115.stdout:3/551: creat dc/d24/d36/d60/dae/fb7 x:0 0 0 2024-04-16T14:35:39.953 INFO:tasks.workunit.client.1.smithi115.stdout:3/552: chown dc/d24/f6f 340021 1 2024-04-16T14:35:39.953 INFO:tasks.workunit.client.1.smithi115.stdout:3/553: creat dc/d29/d4d/d56/d98/fb8 x:0 0 0 2024-04-16T14:35:39.953 INFO:tasks.workunit.client.1.smithi115.stdout:3/554: chown dc/d24/d36/d60/dae 179082 1 2024-04-16T14:35:39.954 INFO:tasks.workunit.client.1.smithi115.stdout:3/555: stat dc/f22 0 2024-04-16T14:35:39.954 INFO:tasks.workunit.client.1.smithi115.stdout:3/556: creat dc/d29/d39/d86/fb9 x:0 0 0 2024-04-16T14:35:39.954 INFO:tasks.workunit.client.1.smithi115.stdout:2/578: mknod d0/d4/d24/d23/d83/cb9 0 2024-04-16T14:35:39.954 INFO:tasks.workunit.client.1.smithi115.stdout:8/533: readlink d0/db/d10/d17/d2c/d85/l8d 0 2024-04-16T14:35:39.954 INFO:tasks.workunit.client.1.smithi115.stdout:3/557: dread dc/d24/d36/d60/f7a [0,4194304] 0 2024-04-16T14:35:39.956 INFO:tasks.workunit.client.0.smithi005.stdout:7/794: sync 2024-04-16T14:35:39.956 INFO:tasks.workunit.client.0.smithi005.stdout:2/514: sync 2024-04-16T14:35:39.956 INFO:tasks.workunit.client.0.smithi005.stdout:2/515: truncate d0/d2a/fab 428339 0 2024-04-16T14:35:39.956 INFO:tasks.workunit.client.0.smithi005.stdout:7/795: creat d1/d8a/f10c x:0 0 0 2024-04-16T14:35:39.956 INFO:tasks.workunit.client.0.smithi005.stdout:7/796: creat d1/d85/d96/de1/f10d x:0 0 0 2024-04-16T14:35:39.956 INFO:tasks.workunit.client.0.smithi005.stdout:7/797: write d1/d49/d74/d77/d57/fb7 [721208,81406] 0 2024-04-16T14:35:39.956 INFO:tasks.workunit.client.0.smithi005.stdout:7/798: read - d1/d49/d74/d77/d22/db0/dc6/ffc zero size 2024-04-16T14:35:39.956 INFO:tasks.workunit.client.0.smithi005.stdout:7/799: read - d1/d85/d96/de1/f10b zero size 2024-04-16T14:35:39.956 INFO:tasks.workunit.client.0.smithi005.stdout:7/800: truncate d1/d49/d74/d77/d22/db0/dc6/f105 280494 0 2024-04-16T14:35:39.956 INFO:tasks.workunit.client.0.smithi005.stdout:7/801: chown d1/d49/d74/d77/d22/d27/d2e/l4e 17169 1 2024-04-16T14:35:39.958 INFO:tasks.workunit.client.0.smithi005.stdout:2/516: creat d0/d1c/d8d/fad x:0 0 0 2024-04-16T14:35:39.959 INFO:tasks.workunit.client.1.smithi115.stdout:2/579: link d0/d4/d24/da0/lac d0/d4/de/lba 0 2024-04-16T14:35:39.961 INFO:tasks.workunit.client.0.smithi005.stdout:2/517: creat d0/d1c/d59/d7a/d84/fae x:0 0 0 2024-04-16T14:35:39.961 INFO:tasks.workunit.client.0.smithi005.stdout:2/518: rename d0/d4 to d0/d4/d2b/d5e/d9a/daf 22 2024-04-16T14:35:39.961 INFO:tasks.workunit.client.1.smithi115.stdout:3/558: mknod dc/d24/d33/d4b/d81/cba 0 2024-04-16T14:35:39.963 INFO:tasks.workunit.client.0.smithi005.stdout:2/519: mkdir d0/d1c/d39/d85/da2/db0 0 2024-04-16T14:35:39.963 INFO:tasks.workunit.client.0.smithi005.stdout:2/520: mknod d0/d1c/d39/d85/cb1 0 2024-04-16T14:35:39.965 INFO:tasks.workunit.client.0.smithi005.stdout:2/521: mknod d0/d1c/d59/cb2 0 2024-04-16T14:35:39.965 INFO:tasks.workunit.client.0.smithi005.stdout:2/522: creat d0/d1c/d39/fb3 x:0 0 0 2024-04-16T14:35:39.966 INFO:tasks.workunit.client.0.smithi005.stdout:2/523: mknod d0/d1c/d39/d85/cb4 0 2024-04-16T14:35:39.967 INFO:tasks.workunit.client.0.smithi005.stdout:2/524: mknod d0/d1c/d59/d7a/d84/cb5 0 2024-04-16T14:35:39.968 INFO:tasks.workunit.client.0.smithi005.stdout:2/525: dread d0/d2a/d3a/f7e [4194304,4194304] 0 2024-04-16T14:35:39.970 INFO:tasks.workunit.client.0.smithi005.stdout:7/802: dwrite d1/f6f [0,4194304] 0 2024-04-16T14:35:39.970 INFO:tasks.workunit.client.0.smithi005.stdout:2/526: rmdir d0/d1c/d59/d67 39 2024-04-16T14:35:39.972 INFO:tasks.workunit.client.0.smithi005.stdout:7/803: mknod d1/d49/d74/d77/d22/c10e 0 2024-04-16T14:35:39.974 INFO:tasks.workunit.client.0.smithi005.stdout:2/527: link d0/d2a/d3a/f53 d0/d2a/d3a/fb6 0 2024-04-16T14:35:39.974 INFO:tasks.workunit.client.0.smithi005.stdout:2/528: fsync d0/d1c/f33 0 2024-04-16T14:35:39.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:39 smithi005 ceph-mon[28964]: pgmap v24: 65 pgs: 65 active+clean; 2.1 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 267 MiB/s rd, 310 MiB/s wr, 702 op/s 2024-04-16T14:35:39.974 INFO:tasks.workunit.client.0.smithi005.stdout:7/804: rmdir d1/d85/d96 39 2024-04-16T14:35:39.975 INFO:tasks.workunit.client.0.smithi005.stdout:2/529: truncate d0/d2a/d3a/f7e 2634631 0 2024-04-16T14:35:39.975 INFO:tasks.workunit.client.1.smithi115.stdout:3/559: write dc/f15 [1103987,85824] 0 2024-04-16T14:35:39.975 INFO:tasks.workunit.client.0.smithi005.stdout:7/805: unlink d1/d49/d74/d77/d57/l72 0 2024-04-16T14:35:39.976 INFO:tasks.workunit.client.1.smithi115.stdout:3/560: rename dc/d29/d77/c8d to dc/d24/d33/d4b/d81/cbb 0 2024-04-16T14:35:39.976 INFO:tasks.workunit.client.0.smithi005.stdout:2/530: symlink d0/d29/lb7 0 2024-04-16T14:35:39.976 INFO:tasks.workunit.client.0.smithi005.stdout:2/531: write d0/d29/d3e/f8e [75337,126647] 0 2024-04-16T14:35:39.977 INFO:tasks.workunit.client.0.smithi005.stdout:7/806: mknod d1/d49/d74/d77/d22/d27/d3a/c10f 0 2024-04-16T14:35:39.978 INFO:tasks.workunit.client.0.smithi005.stdout:2/532: rmdir d0/d29 39 2024-04-16T14:35:39.978 INFO:tasks.workunit.client.1.smithi115.stdout:3/561: mknod dc/d29/cbc 0 2024-04-16T14:35:39.978 INFO:tasks.workunit.client.1.smithi115.stdout:3/562: symlink dc/d24/d33/d4b/lbd 0 2024-04-16T14:35:39.978 INFO:tasks.workunit.client.1.smithi115.stdout:1/433: sync 2024-04-16T14:35:39.978 INFO:tasks.workunit.client.1.smithi115.stdout:9/542: sync 2024-04-16T14:35:39.978 INFO:tasks.workunit.client.1.smithi115.stdout:7/439: sync 2024-04-16T14:35:39.978 INFO:tasks.workunit.client.1.smithi115.stdout:7/440: write d0/d2/d3a/d30/d6b/f84 [4936168,38037] 0 2024-04-16T14:35:39.979 INFO:tasks.workunit.client.1.smithi115.stdout:3/563: unlink dc/l88 0 2024-04-16T14:35:39.980 INFO:tasks.workunit.client.0.smithi005.stdout:7/807: symlink d1/d82/l110 0 2024-04-16T14:35:39.980 INFO:tasks.workunit.client.0.smithi005.stdout:2/533: dread d0/d1c/d8d/fa9 [0,4194304] 0 2024-04-16T14:35:39.980 INFO:tasks.workunit.client.0.smithi005.stdout:2/534: stat d0/d4/f66 0 2024-04-16T14:35:39.980 INFO:tasks.workunit.client.0.smithi005.stdout:7/808: dread d1/d49/d74/d77/d22/d27/d3a/fb3 [0,4194304] 0 2024-04-16T14:35:39.980 INFO:tasks.workunit.client.0.smithi005.stdout:2/535: mknod d0/d2a/d3a/d46/cb8 0 2024-04-16T14:35:39.980 INFO:tasks.workunit.client.0.smithi005.stdout:2/536: truncate d0/d4/d2b/d5e/f70 614246 0 2024-04-16T14:35:39.980 INFO:tasks.workunit.client.1.smithi115.stdout:9/543: mkdir d1/d6/db8 0 2024-04-16T14:35:39.981 INFO:tasks.workunit.client.0.smithi005.stdout:2/537: truncate d0/d2a/d3a/d46/f5d 947726 0 2024-04-16T14:35:39.981 INFO:tasks.workunit.client.0.smithi005.stdout:2/538: write d0/d4/f78 [685488,114864] 0 2024-04-16T14:35:39.981 INFO:tasks.workunit.client.1.smithi115.stdout:0/413: sync 2024-04-16T14:35:39.984 INFO:tasks.workunit.client.1.smithi115.stdout:1/434: truncate df/d13/d4d/d3e/d75/f7e 778988 0 2024-04-16T14:35:39.984 INFO:tasks.workunit.client.1.smithi115.stdout:1/435: fdatasync df/d13/f16 0 2024-04-16T14:35:39.985 INFO:tasks.workunit.client.1.smithi115.stdout:7/441: symlink d0/d2/d94/l96 0 2024-04-16T14:35:39.987 INFO:tasks.workunit.client.1.smithi115.stdout:8/534: dwrite d0/db/d10/d17/f4c [4194304,4194304] 0 2024-04-16T14:35:39.988 INFO:tasks.workunit.client.1.smithi115.stdout:2/580: dwrite d0/d4/d24/d23/f7c [0,4194304] 0 2024-04-16T14:35:39.992 INFO:tasks.workunit.client.1.smithi115.stdout:2/581: rmdir d0/d4/de/d11 39 2024-04-16T14:35:39.995 INFO:tasks.workunit.client.1.smithi115.stdout:2/582: unlink d0/d4/de/d11/f62 0 2024-04-16T14:35:40.017 INFO:tasks.workunit.client.1.smithi115.stdout:7/442: dread d0/d24/f4a [0,4194304] 0 2024-04-16T14:35:40.017 INFO:tasks.workunit.client.1.smithi115.stdout:7/443: symlink d0/d2/l97 0 2024-04-16T14:35:40.018 INFO:tasks.workunit.client.1.smithi115.stdout:7/444: write d0/d24/d40/f6a [551201,7765] 0 2024-04-16T14:35:40.022 INFO:tasks.workunit.client.1.smithi115.stdout:3/564: dwrite dc/d24/d33/d4b/da3/d69/fa1 [0,4194304] 0 2024-04-16T14:35:40.022 INFO:tasks.workunit.client.1.smithi115.stdout:3/565: write dc/d24/d36/f3b [8507378,110539] 0 2024-04-16T14:35:40.022 INFO:tasks.workunit.client.1.smithi115.stdout:3/566: dread - dc/d24/d36/d8c/faa zero size 2024-04-16T14:35:40.026 INFO:tasks.workunit.client.1.smithi115.stdout:7/445: dread d0/d1/d3b/d3e/f54 [4194304,4194304] 0 2024-04-16T14:35:40.026 INFO:tasks.workunit.client.1.smithi115.stdout:7/446: creat d0/d2/d3a/d30/f98 x:0 0 0 2024-04-16T14:35:40.028 INFO:tasks.workunit.client.1.smithi115.stdout:7/447: rename d0/d1/l93 to d0/d1/d3b/l99 0 2024-04-16T14:35:40.030 INFO:tasks.workunit.client.0.smithi005.stdout:7/809: dwrite d1/d49/d74/d77/d22/db0/dc6/f105 [0,4194304] 0 2024-04-16T14:35:40.031 INFO:tasks.workunit.client.1.smithi115.stdout:8/535: dwrite d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/f9e [0,4194304] 0 2024-04-16T14:35:40.031 INFO:tasks.workunit.client.1.smithi115.stdout:9/544: dwrite d1/d6/d2d/d3d/d50/f56 [4194304,4194304] 0 2024-04-16T14:35:40.031 INFO:tasks.workunit.client.1.smithi115.stdout:1/436: dwrite df/d13/d4d/d6d/f73 [0,4194304] 0 2024-04-16T14:35:40.031 INFO:tasks.workunit.client.1.smithi115.stdout:1/437: write df/d2d/d83/f7b [691768,33238] 0 2024-04-16T14:35:40.034 INFO:tasks.workunit.client.1.smithi115.stdout:3/567: dread dc/d24/d33/d4b/d81/f92 [0,4194304] 0 2024-04-16T14:35:40.034 INFO:tasks.workunit.client.1.smithi115.stdout:8/536: mkdir d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/da4 0 2024-04-16T14:35:40.036 INFO:tasks.workunit.client.1.smithi115.stdout:9/545: mknod d1/d6/d2d/d3d/d49/cb9 0 2024-04-16T14:35:40.039 INFO:tasks.workunit.client.1.smithi115.stdout:7/448: dread d0/d2/d3a/d30/d6b/f75 [0,4194304] 0 2024-04-16T14:35:40.040 INFO:tasks.workunit.client.0.smithi005.stdout:2/539: getdents d0/d2a/d3a/d46 0 2024-04-16T14:35:40.046 INFO:tasks.workunit.client.1.smithi115.stdout:3/568: dread dc/f18 [0,4194304] 0 2024-04-16T14:35:40.047 INFO:tasks.workunit.client.0.smithi005.stdout:7/810: dwrite d1/d49/d74/d77/d22/d27/f44 [4194304,4194304] 0 2024-04-16T14:35:40.047 INFO:tasks.workunit.client.0.smithi005.stdout:2/540: write d0/d2a/d3a/f7e [584099,114063] 0 2024-04-16T14:35:40.047 INFO:tasks.workunit.client.0.smithi005.stdout:2/541: write d0/f90 [2379153,130460] 0 2024-04-16T14:35:40.048 INFO:tasks.workunit.client.1.smithi115.stdout:1/438: creat df/d36/f8d x:0 0 0 2024-04-16T14:35:40.048 INFO:tasks.workunit.client.1.smithi115.stdout:1/439: creat df/d35/d48/f8e x:0 0 0 2024-04-16T14:35:40.049 INFO:tasks.workunit.client.0.smithi005.stdout:7/811: getdents d1/d49/d74/d77/d22/db0/dc6 0 2024-04-16T14:35:40.049 INFO:tasks.workunit.client.0.smithi005.stdout:7/812: dread d1/d49/d74/d77/d57/d47/f63 [0,4194304] 0 2024-04-16T14:35:40.049 INFO:tasks.workunit.client.0.smithi005.stdout:7/813: fdatasync d1/d49/d74/d77/d57/d47/d8e/fad 0 2024-04-16T14:35:40.049 INFO:tasks.workunit.client.1.smithi115.stdout:8/537: mkdir d0/da5 0 2024-04-16T14:35:40.051 INFO:tasks.workunit.client.1.smithi115.stdout:9/546: link d1/d6/d2d/c18 d1/d6/d2d/d3d/d49/d98/daa/cba 0 2024-04-16T14:35:40.052 INFO:tasks.workunit.client.1.smithi115.stdout:7/449: getdents d0/d2/d3a 0 2024-04-16T14:35:40.055 INFO:tasks.workunit.client.1.smithi115.stdout:3/569: unlink dc/d29/d4d/d56/f5c 0 2024-04-16T14:35:40.058 INFO:tasks.workunit.client.1.smithi115.stdout:1/440: symlink df/d13/d4d/d2c/d54/l8f 0 2024-04-16T14:35:40.061 INFO:tasks.workunit.client.1.smithi115.stdout:9/547: link d1/d6/d2d/d4b/d6c/f44 d1/d6/d2d/d4b/d60/fbb 0 2024-04-16T14:35:40.061 INFO:tasks.workunit.client.1.smithi115.stdout:9/548: fdatasync d1/d6/d2d/d4b/d6c/d20/f2c 0 2024-04-16T14:35:40.063 INFO:tasks.workunit.client.1.smithi115.stdout:7/450: mknod d0/d24/d40/c9a 0 2024-04-16T14:35:40.065 INFO:tasks.workunit.client.1.smithi115.stdout:1/441: mknod df/d36/c90 0 2024-04-16T14:35:40.065 INFO:tasks.workunit.client.1.smithi115.stdout:9/549: creat d1/d6/d2d/d3d/d49/d88/fbc x:0 0 0 2024-04-16T14:35:40.067 INFO:tasks.workunit.client.1.smithi115.stdout:7/451: link d0/d1/d3b/d3f/d7a/d80/d81/c8b d0/d2/d3a/c9b 0 2024-04-16T14:35:40.067 INFO:tasks.workunit.client.1.smithi115.stdout:7/452: write d0/d2/d3a/d30/d6b/f84 [5234287,25664] 0 2024-04-16T14:35:40.070 INFO:tasks.workunit.client.1.smithi115.stdout:1/442: rename df/d13/d4d/f32 to df/d35/d84/f91 0 2024-04-16T14:35:40.075 INFO:tasks.workunit.client.1.smithi115.stdout:1/443: link df/f27 df/f92 0 2024-04-16T14:35:40.075 INFO:tasks.workunit.client.1.smithi115.stdout:1/444: chown df/d36/f4e 207953 1 2024-04-16T14:35:40.076 INFO:tasks.workunit.client.1.smithi115.stdout:1/445: truncate df/f10 8559806 0 2024-04-16T14:35:40.077 INFO:tasks.workunit.client.1.smithi115.stdout:1/446: chown df/d35/f39 313 1 2024-04-16T14:35:40.077 INFO:tasks.workunit.client.1.smithi115.stdout:1/447: truncate df/f25 123806 0 2024-04-16T14:35:40.077 INFO:tasks.workunit.client.1.smithi115.stdout:1/448: chown df/d36/d3c/f56 16 1 2024-04-16T14:35:40.078 INFO:tasks.workunit.client.1.smithi115.stdout:1/449: write df/d36/f4e [405395,18921] 0 2024-04-16T14:35:40.078 INFO:tasks.workunit.client.1.smithi115.stdout:1/450: getdents df/d13/d4d/d3e/d7d 0 2024-04-16T14:35:40.079 INFO:tasks.workunit.client.1.smithi115.stdout:5/466: sync 2024-04-16T14:35:40.079 INFO:tasks.workunit.client.1.smithi115.stdout:6/549: sync 2024-04-16T14:35:40.079 INFO:tasks.workunit.client.0.smithi005.stdout:7/814: dwrite d1/d49/d74/d77/d22/d27/f2b [0,4194304] 0 2024-04-16T14:35:40.080 INFO:tasks.workunit.client.1.smithi115.stdout:5/467: fsync dc/d15/f19 0 2024-04-16T14:35:40.080 INFO:tasks.workunit.client.1.smithi115.stdout:5/468: stat c4 0 2024-04-16T14:35:40.080 INFO:tasks.workunit.client.1.smithi115.stdout:5/469: write dc/f12 [1755911,18137] 0 2024-04-16T14:35:40.080 INFO:tasks.workunit.client.0.smithi005.stdout:7/815: symlink d1/d49/d74/l111 0 2024-04-16T14:35:40.080 INFO:tasks.workunit.client.0.smithi005.stdout:7/816: readlink d1/d85/d96/ldb 0 2024-04-16T14:35:40.082 INFO:tasks.workunit.client.0.smithi005.stdout:7/817: symlink d1/d49/d74/d77/d22/l112 0 2024-04-16T14:35:40.085 INFO:tasks.workunit.client.0.smithi005.stdout:7/818: link d1/d49/d74/d77/f65 d1/d49/d74/d77/d22/db0/dc6/f113 0 2024-04-16T14:35:40.088 INFO:tasks.workunit.client.1.smithi115.stdout:6/550: dread d13/f1c [0,4194304] 0 2024-04-16T14:35:40.089 INFO:tasks.workunit.client.1.smithi115.stdout:6/551: truncate d13/d1d/d49/f6d 4331790 0 2024-04-16T14:35:40.089 INFO:tasks.workunit.client.1.smithi115.stdout:6/552: write d13/d1d/d2b/d5f/d30/d43/da6/d63/f89 [5776310,51195] 0 2024-04-16T14:35:40.091 INFO:tasks.workunit.client.1.smithi115.stdout:5/470: dread f1 [4194304,4194304] 0 2024-04-16T14:35:40.091 INFO:tasks.workunit.client.0.smithi005.stdout:7/819: dread d1/f6f [0,4194304] 0 2024-04-16T14:35:40.094 INFO:tasks.workunit.client.0.smithi005.stdout:7/820: getdents d1/d49/d74/d77/d22/d27/d2e 0 2024-04-16T14:35:40.095 INFO:tasks.workunit.client.0.smithi005.stdout:7/821: symlink d1/d82/l114 0 2024-04-16T14:35:40.105 INFO:tasks.workunit.client.0.smithi005.stdout:3/691: sync 2024-04-16T14:35:40.108 INFO:tasks.workunit.client.0.smithi005.stdout:3/692: symlink d2/d9/d5e/le5 0 2024-04-16T14:35:40.112 INFO:tasks.workunit.client.0.smithi005.stdout:7/822: dread d1/dc/f7d [0,4194304] 0 2024-04-16T14:35:40.112 INFO:tasks.workunit.client.0.smithi005.stdout:7/823: readlink d1/d49/d74/d77/d22/d27/d3a/d5c/d9e/lff 0 2024-04-16T14:35:40.113 INFO:tasks.workunit.client.0.smithi005.stdout:7/824: mkdir d1/d115 0 2024-04-16T14:35:40.113 INFO:tasks.workunit.client.0.smithi005.stdout:7/825: dread - d1/d49/d74/d77/d57/d47/d8d/f102 zero size 2024-04-16T14:35:40.114 INFO:tasks.workunit.client.0.smithi005.stdout:7/826: link d1/d49/d74/d77/d22/d27/c2a d1/d49/d74/d77/d22/d27/d3a/d5c/d9e/c116 0 2024-04-16T14:35:40.114 INFO:tasks.workunit.client.0.smithi005.stdout:7/827: readlink d1/l38 0 2024-04-16T14:35:40.115 INFO:tasks.workunit.client.0.smithi005.stdout:7/828: rmdir d1/dc 39 2024-04-16T14:35:40.115 INFO:tasks.workunit.client.1.smithi115.stdout:3/570: dwrite dc/d29/d39/d86/fb9 [0,4194304] 0 2024-04-16T14:35:40.115 INFO:tasks.workunit.client.0.smithi005.stdout:7/829: mkdir d1/d49/d74/d77/d22/d27/d117 0 2024-04-16T14:35:40.118 INFO:tasks.workunit.client.1.smithi115.stdout:5/471: dwrite dc/d15/f78 [0,4194304] 0 2024-04-16T14:35:40.118 INFO:tasks.workunit.client.1.smithi115.stdout:9/550: dwrite d1/d6/d29/f7a [0,4194304] 0 2024-04-16T14:35:40.118 INFO:tasks.workunit.client.1.smithi115.stdout:7/453: dwrite d0/d24/d40/f6a [0,4194304] 0 2024-04-16T14:35:40.119 INFO:tasks.workunit.client.1.smithi115.stdout:1/451: dwrite fb [0,4194304] 0 2024-04-16T14:35:40.123 INFO:tasks.workunit.client.1.smithi115.stdout:6/553: dwrite d13/d1d/d47/fa3 [0,4194304] 0 2024-04-16T14:35:40.124 INFO:tasks.workunit.client.1.smithi115.stdout:6/554: dread - d13/d1d/d68/f9a zero size 2024-04-16T14:35:40.126 INFO:tasks.workunit.client.1.smithi115.stdout:5/472: symlink dc/d15/d2d/d8c/l9e 0 2024-04-16T14:35:40.127 INFO:tasks.workunit.client.0.smithi005.stdout:3/693: dread d2/d17/f6f [0,4194304] 0 2024-04-16T14:35:40.129 INFO:tasks.workunit.client.0.smithi005.stdout:3/694: mknod d2/d9/ce6 0 2024-04-16T14:35:40.130 INFO:tasks.workunit.client.0.smithi005.stdout:3/695: readlink d2/d17/l3e 0 2024-04-16T14:35:40.130 INFO:tasks.workunit.client.0.smithi005.stdout:3/696: truncate d2/d9/d25/d39/d64/fa9 377729 0 2024-04-16T14:35:40.130 INFO:tasks.workunit.client.0.smithi005.stdout:3/697: creat d2/d17/d46/d75/d6d/dd0/dda/fe7 x:0 0 0 2024-04-16T14:35:40.132 INFO:tasks.workunit.client.0.smithi005.stdout:3/698: mkdir d2/d17/d46/d47/de8 0 2024-04-16T14:35:40.132 INFO:tasks.workunit.client.0.smithi005.stdout:3/699: rename d2/d9/df to d2/d9/df/daa/dc4/de1/de9 22 2024-04-16T14:35:40.132 INFO:tasks.workunit.client.0.smithi005.stdout:3/700: write d2/d17/d46/d75/d41/d79/fa4 [699137,121119] 0 2024-04-16T14:35:40.133 INFO:tasks.workunit.client.0.smithi005.stdout:7/830: write d1/d49/d74/d77/d22/d27/d3a/d5c/d9e/fd1 [4080672,79717] 0 2024-04-16T14:35:40.133 INFO:tasks.workunit.client.1.smithi115.stdout:1/452: dread df/d2d/f41 [0,4194304] 0 2024-04-16T14:35:40.133 INFO:tasks.workunit.client.1.smithi115.stdout:1/453: chown df/d13/f30 15 1 2024-04-16T14:35:40.134 INFO:tasks.workunit.client.1.smithi115.stdout:7/454: mkdir d0/d24/d2b/d9c 0 2024-04-16T14:35:40.135 INFO:tasks.workunit.client.0.smithi005.stdout:7/831: symlink d1/d8a/l118 0 2024-04-16T14:35:40.135 INFO:tasks.workunit.client.1.smithi115.stdout:6/555: mknod d13/d1d/cb5 0 2024-04-16T14:35:40.135 INFO:tasks.workunit.client.1.smithi115.stdout:6/556: write f11 [2609423,67515] 0 2024-04-16T14:35:40.137 INFO:tasks.workunit.client.0.smithi005.stdout:7/832: dread d1/d49/d74/d77/d57/d47/faf [0,4194304] 0 2024-04-16T14:35:40.137 INFO:tasks.workunit.client.0.smithi005.stdout:7/833: truncate d1/d49/d74/d77/d57/d47/f90 1115404 0 2024-04-16T14:35:40.137 INFO:tasks.workunit.client.1.smithi115.stdout:3/571: dwrite dc/d29/d4d/d56/f9b [0,4194304] 0 2024-04-16T14:35:40.137 INFO:tasks.workunit.client.1.smithi115.stdout:3/572: chown dc/f21 1663960 1 2024-04-16T14:35:40.139 INFO:tasks.workunit.client.1.smithi115.stdout:6/557: dread d13/d1d/d49/f6e [0,4194304] 0 2024-04-16T14:35:40.139 INFO:tasks.workunit.client.1.smithi115.stdout:5/473: rename dc/d15/d35/c3c to dc/d3d/c9f 0 2024-04-16T14:35:40.139 INFO:tasks.workunit.client.1.smithi115.stdout:6/558: chown d13/d1d/d52/f53 15 1 2024-04-16T14:35:40.139 INFO:tasks.workunit.client.1.smithi115.stdout:6/559: fsync d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/fa4 0 2024-04-16T14:35:40.139 INFO:tasks.workunit.client.1.smithi115.stdout:5/474: creat dc/fa0 x:0 0 0 2024-04-16T14:35:40.140 INFO:tasks.workunit.client.0.smithi005.stdout:3/701: read d2/d9/d25/f91 [3079829,67709] 0 2024-04-16T14:35:40.142 INFO:tasks.workunit.client.0.smithi005.stdout:3/702: truncate d2/d17/d46/f4b 1017273 0 2024-04-16T14:35:40.142 INFO:tasks.workunit.client.1.smithi115.stdout:9/551: dwrite d1/d6/d2d/d4b/f5a [0,4194304] 0 2024-04-16T14:35:40.142 INFO:tasks.workunit.client.0.smithi005.stdout:3/703: getdents d2/d92 0 2024-04-16T14:35:40.144 INFO:tasks.workunit.client.0.smithi005.stdout:3/704: dread d2/d9/d51/fc1 [0,4194304] 0 2024-04-16T14:35:40.146 INFO:tasks.workunit.client.0.smithi005.stdout:3/705: rename d2/d9/le2 to d2/d17/d46/d75/d41/lea 0 2024-04-16T14:35:40.148 INFO:tasks.workunit.client.0.smithi005.stdout:3/706: mkdir d2/d17/d46/d47/deb 0 2024-04-16T14:35:40.153 INFO:tasks.workunit.client.1.smithi115.stdout:7/455: truncate d0/d1/d3b/d3e/f54 2991310 0 2024-04-16T14:35:40.153 INFO:tasks.workunit.client.1.smithi115.stdout:7/456: read - d0/d1/d3b/d3e/f89 zero size 2024-04-16T14:35:40.159 INFO:tasks.workunit.client.1.smithi115.stdout:5/475: rmdir dc/d15/d2d/d8c 39 2024-04-16T14:35:40.159 INFO:tasks.workunit.client.1.smithi115.stdout:5/476: chown dc/d15/d35/f3f 126 1 2024-04-16T14:35:40.160 INFO:tasks.workunit.client.0.smithi005.stdout:3/707: write d2/d9/d51/f58 [1209717,8620] 0 2024-04-16T14:35:40.160 INFO:tasks.workunit.client.0.smithi005.stdout:3/708: dread - d2/d17/d46/d75/d6d/dd0/dda/fe7 zero size 2024-04-16T14:35:40.162 INFO:tasks.workunit.client.1.smithi115.stdout:3/573: rename dc/d24/d36/d8c to dc/d29/d4d/d56/d98/dbe 0 2024-04-16T14:35:40.164 INFO:tasks.workunit.client.1.smithi115.stdout:7/457: rename d0/d2/d3a/c68 to d0/d2/d3a/d30/d79/c9d 0 2024-04-16T14:35:40.165 INFO:tasks.workunit.client.0.smithi005.stdout:7/834: dwrite d1/d49/d74/d77/d57/d47/f90 [0,4194304] 0 2024-04-16T14:35:40.165 INFO:tasks.workunit.client.1.smithi115.stdout:5/477: dread dc/f12 [0,4194304] 0 2024-04-16T14:35:40.165 INFO:tasks.workunit.client.1.smithi115.stdout:5/478: readlink dc/d15/d2d/l9c 0 2024-04-16T14:35:40.165 INFO:tasks.workunit.client.1.smithi115.stdout:5/479: write dc/fa0 [820355,83090] 0 2024-04-16T14:35:40.170 INFO:tasks.workunit.client.0.smithi005.stdout:7/835: dread d1/f29 [0,4194304] 0 2024-04-16T14:35:40.170 INFO:tasks.workunit.client.0.smithi005.stdout:7/836: chown d1/d49/d74/d77/d22/da0/dbb/dcb 18335857 1 2024-04-16T14:35:40.175 INFO:tasks.workunit.client.1.smithi115.stdout:3/574: read dc/d24/d36/f72 [1842764,45819] 0 2024-04-16T14:35:40.176 INFO:tasks.workunit.client.1.smithi115.stdout:1/454: dwrite df/f1d [0,4194304] 0 2024-04-16T14:35:40.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:39 smithi115 ceph-mon[37295]: pgmap v24: 65 pgs: 65 active+clean; 2.1 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 267 MiB/s rd, 310 MiB/s wr, 702 op/s 2024-04-16T14:35:40.181 INFO:tasks.workunit.client.1.smithi115.stdout:1/455: dread df/d36/f4e [0,4194304] 0 2024-04-16T14:35:40.182 INFO:tasks.workunit.client.1.smithi115.stdout:4/476: sync 2024-04-16T14:35:40.184 INFO:tasks.workunit.client.1.smithi115.stdout:1/456: symlink df/d35/d84/l93 0 2024-04-16T14:35:40.184 INFO:tasks.workunit.client.1.smithi115.stdout:1/457: chown df/d36/l43 0 1 2024-04-16T14:35:40.184 INFO:tasks.workunit.client.1.smithi115.stdout:6/560: dwrite d13/f8e [0,4194304] 0 2024-04-16T14:35:40.185 INFO:tasks.workunit.client.1.smithi115.stdout:3/575: dread dc/d29/f6b [0,4194304] 0 2024-04-16T14:35:40.185 INFO:tasks.workunit.client.1.smithi115.stdout:6/561: fdatasync d13/d1d/d49/f8d 0 2024-04-16T14:35:40.186 INFO:tasks.workunit.client.1.smithi115.stdout:4/477: mknod d1/d15/d1e/c7e 0 2024-04-16T14:35:40.186 INFO:tasks.workunit.client.1.smithi115.stdout:4/478: creat d1/d15/d31/d55/f7f x:0 0 0 2024-04-16T14:35:40.186 INFO:tasks.workunit.client.1.smithi115.stdout:4/479: readlink d1/d15/d31/l60 0 2024-04-16T14:35:40.186 INFO:tasks.workunit.client.1.smithi115.stdout:4/480: readlink d1/l1c 0 2024-04-16T14:35:40.187 INFO:tasks.workunit.client.1.smithi115.stdout:1/458: rmdir df/d2d/d83 39 2024-04-16T14:35:40.190 INFO:tasks.workunit.client.1.smithi115.stdout:6/562: creat d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/fb6 x:0 0 0 2024-04-16T14:35:40.191 INFO:tasks.workunit.client.1.smithi115.stdout:4/481: creat d1/d15/d17/f80 x:0 0 0 2024-04-16T14:35:40.191 INFO:tasks.workunit.client.1.smithi115.stdout:4/482: creat d1/d15/d1e/f81 x:0 0 0 2024-04-16T14:35:40.192 INFO:tasks.workunit.client.1.smithi115.stdout:1/459: mkdir df/d36/d94 0 2024-04-16T14:35:40.193 INFO:tasks.workunit.client.1.smithi115.stdout:6/563: creat d13/d1d/d2b/d5f/d30/d43/da6/d5a/fb7 x:0 0 0 2024-04-16T14:35:40.194 INFO:tasks.workunit.client.1.smithi115.stdout:4/483: symlink d1/d15/d31/d42/l82 0 2024-04-16T14:35:40.195 INFO:tasks.workunit.client.1.smithi115.stdout:4/484: chown d1/d15/d31/f41 30918196 1 2024-04-16T14:35:40.196 INFO:tasks.workunit.client.1.smithi115.stdout:9/552: dwrite d1/d6/d2d/d4b/d6c/d20/f87 [0,4194304] 0 2024-04-16T14:35:40.197 INFO:tasks.workunit.client.0.smithi005.stdout:3/709: dwrite d2/d9/df/dbf/fdb [0,4194304] 0 2024-04-16T14:35:40.197 INFO:tasks.workunit.client.1.smithi115.stdout:6/564: rename d13/d1d/d2b/d5f/d30/d43/d2c/c4d to d13/d1d/d87/cb8 0 2024-04-16T14:35:40.199 INFO:tasks.workunit.client.1.smithi115.stdout:5/480: dwrite dc/d15/d35/d69/f70 [0,4194304] 0 2024-04-16T14:35:40.200 INFO:tasks.workunit.client.1.smithi115.stdout:7/458: dwrite d0/d24/d40/f85 [0,4194304] 0 2024-04-16T14:35:40.204 INFO:tasks.workunit.client.1.smithi115.stdout:1/460: write df/f92 [1617263,34165] 0 2024-04-16T14:35:40.208 INFO:tasks.workunit.client.1.smithi115.stdout:7/459: mknod d0/d2/d3a/c9e 0 2024-04-16T14:35:40.208 INFO:tasks.workunit.client.1.smithi115.stdout:7/460: read d0/d1/d3b/d3e/f5c [2598135,5514] 0 2024-04-16T14:35:40.208 INFO:tasks.workunit.client.1.smithi115.stdout:7/461: stat d0/d2/cd 0 2024-04-16T14:35:40.209 INFO:tasks.workunit.client.1.smithi115.stdout:9/553: getdents d1/d7f 0 2024-04-16T14:35:40.210 INFO:tasks.workunit.client.1.smithi115.stdout:6/565: write d13/d1d/d2b/d5f/f32 [7172295,23780] 0 2024-04-16T14:35:40.210 INFO:tasks.workunit.client.1.smithi115.stdout:6/566: write d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/fb6 [862445,47379] 0 2024-04-16T14:35:40.210 INFO:tasks.workunit.client.1.smithi115.stdout:3/576: dwrite dc/d24/d33/d4b/da3/fa7 [0,4194304] 0 2024-04-16T14:35:40.211 INFO:tasks.workunit.client.1.smithi115.stdout:1/461: rename df/d36/c90 to df/d13/c95 0 2024-04-16T14:35:40.213 INFO:tasks.workunit.client.1.smithi115.stdout:7/462: link d0/d2/d3a/d30/c46 d0/d2/d3a/d30/d79/d95/c9f 0 2024-04-16T14:35:40.215 INFO:tasks.workunit.client.1.smithi115.stdout:6/567: creat d13/d1d/d2b/d5f/d30/d43/da6/d63/fb9 x:0 0 0 2024-04-16T14:35:40.215 INFO:tasks.workunit.client.1.smithi115.stdout:6/568: creat d13/d1d/d2b/d5f/d30/d43/da6/d5a/fba x:0 0 0 2024-04-16T14:35:40.219 INFO:tasks.workunit.client.1.smithi115.stdout:3/577: link dc/d24/d33/d4b/f4c dc/d24/d33/d4b/da3/d69/fbf 0 2024-04-16T14:35:40.219 INFO:tasks.workunit.client.1.smithi115.stdout:9/554: read d1/d6/f2b [2268903,7745] 0 2024-04-16T14:35:40.219 INFO:tasks.workunit.client.1.smithi115.stdout:4/485: dwrite d1/d15/f77 [0,4194304] 0 2024-04-16T14:35:40.219 INFO:tasks.workunit.client.1.smithi115.stdout:4/486: write d1/d15/f34 [763057,68670] 0 2024-04-16T14:35:40.220 INFO:tasks.workunit.client.1.smithi115.stdout:1/462: creat df/d13/d4d/d3e/f96 x:0 0 0 2024-04-16T14:35:40.221 INFO:tasks.workunit.client.1.smithi115.stdout:1/463: fdatasync df/f92 0 2024-04-16T14:35:40.221 INFO:tasks.workunit.client.1.smithi115.stdout:1/464: write df/d35/d48/f6b [945312,37830] 0 2024-04-16T14:35:40.221 INFO:tasks.workunit.client.1.smithi115.stdout:3/578: dread dc/d29/d4d/d56/f58 [0,4194304] 0 2024-04-16T14:35:40.223 INFO:tasks.workunit.client.1.smithi115.stdout:7/463: creat d0/d2/d3a/d30/d79/d95/fa0 x:0 0 0 2024-04-16T14:35:40.223 INFO:tasks.workunit.client.1.smithi115.stdout:7/464: fdatasync d0/d1/f1f 0 2024-04-16T14:35:40.223 INFO:tasks.workunit.client.1.smithi115.stdout:7/465: fsync d0/d24/d40/f6a 0 2024-04-16T14:35:40.223 INFO:tasks.workunit.client.1.smithi115.stdout:7/466: readlink d0/d1/d3b/d49/l4b 0 2024-04-16T14:35:40.225 INFO:tasks.workunit.client.1.smithi115.stdout:6/569: rename d13/l84 to d13/d1d/d52/lbb 0 2024-04-16T14:35:40.225 INFO:tasks.workunit.client.1.smithi115.stdout:6/570: write d13/d1d/d49/f6d [814193,90333] 0 2024-04-16T14:35:40.226 INFO:tasks.workunit.client.1.smithi115.stdout:0/414: sync 2024-04-16T14:35:40.227 INFO:tasks.workunit.client.1.smithi115.stdout:9/555: creat d1/d6/d2d/d3d/d49/d98/fbd x:0 0 0 2024-04-16T14:35:40.228 INFO:tasks.workunit.client.1.smithi115.stdout:4/487: mkdir d1/d15/d24/d83 0 2024-04-16T14:35:40.228 INFO:tasks.workunit.client.1.smithi115.stdout:4/488: stat d1/d15/d31/d55/f73 0 2024-04-16T14:35:40.228 INFO:tasks.workunit.client.1.smithi115.stdout:4/489: truncate d1/f6b 382530 0 2024-04-16T14:35:40.229 INFO:tasks.workunit.client.1.smithi115.stdout:8/538: sync 2024-04-16T14:35:40.229 INFO:tasks.workunit.client.1.smithi115.stdout:2/583: sync 2024-04-16T14:35:40.229 INFO:tasks.workunit.client.1.smithi115.stdout:8/539: fdatasync d0/db/f58 0 2024-04-16T14:35:40.231 INFO:tasks.workunit.client.1.smithi115.stdout:1/465: symlink df/d13/d4d/d3e/d7d/l97 0 2024-04-16T14:35:40.232 INFO:tasks.workunit.client.1.smithi115.stdout:3/579: symlink dc/d24/d80/lc0 0 2024-04-16T14:35:40.233 INFO:tasks.workunit.client.1.smithi115.stdout:6/571: mkdir d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/dbc 0 2024-04-16T14:35:40.235 INFO:tasks.workunit.client.1.smithi115.stdout:0/415: link d6/d10/d12/d1f/d36/d4b/d6d/c45 d6/d10/d12/d5f/c98 0 2024-04-16T14:35:40.235 INFO:tasks.workunit.client.1.smithi115.stdout:0/416: write d6/d10/f63 [608545,29809] 0 2024-04-16T14:35:40.235 INFO:tasks.workunit.client.1.smithi115.stdout:6/572: write d13/d1d/d2b/d5f/d30/d43/da6/f7d [865555,64760] 0 2024-04-16T14:35:40.235 INFO:tasks.workunit.client.1.smithi115.stdout:0/417: write d6/d10/d12/d1f/d36/d4b/d6d/f3d [2200956,61151] 0 2024-04-16T14:35:40.235 INFO:tasks.workunit.client.1.smithi115.stdout:6/573: fsync d13/d1d/d2b/d5f/d30/d43/d2c/fb4 0 2024-04-16T14:35:40.236 INFO:tasks.workunit.client.1.smithi115.stdout:9/556: mknod d1/d6/d33/cbe 0 2024-04-16T14:35:40.239 INFO:tasks.workunit.client.1.smithi115.stdout:2/584: unlink d0/d4/de/d11/d25/c50 0 2024-04-16T14:35:40.240 INFO:tasks.workunit.client.1.smithi115.stdout:8/540: mknod d0/db/d10/d17/d2c/d52/d74/ca6 0 2024-04-16T14:35:40.241 INFO:tasks.workunit.client.1.smithi115.stdout:1/466: mknod df/d13/d4d/d6d/c98 0 2024-04-16T14:35:40.242 INFO:tasks.workunit.client.1.smithi115.stdout:1/467: fdatasync df/d13/d4d/f2e 0 2024-04-16T14:35:40.242 INFO:tasks.workunit.client.1.smithi115.stdout:3/580: mknod dc/d24/d36/d60/dae/cc1 0 2024-04-16T14:35:40.243 INFO:tasks.workunit.client.0.smithi005.stdout:5/734: sync 2024-04-16T14:35:40.244 INFO:tasks.workunit.client.1.smithi115.stdout:7/467: getdents d0/d2/d3a/d30 0 2024-04-16T14:35:40.244 INFO:tasks.workunit.client.0.smithi005.stdout:5/735: mknod d0/d6/d6e/d9e/da9/cfb 0 2024-04-16T14:35:40.246 INFO:tasks.workunit.client.1.smithi115.stdout:1/468: dread fb [0,4194304] 0 2024-04-16T14:35:40.247 INFO:tasks.workunit.client.1.smithi115.stdout:0/418: rename d6/d30/l34 to d6/d54/l99 0 2024-04-16T14:35:40.250 INFO:tasks.workunit.client.1.smithi115.stdout:9/557: creat d1/d6/d2d/d4b/d8f/d91/fbf x:0 0 0 2024-04-16T14:35:40.256 INFO:tasks.workunit.client.1.smithi115.stdout:6/574: dwrite d13/f1c [0,4194304] 0 2024-04-16T14:35:40.256 INFO:tasks.workunit.client.1.smithi115.stdout:6/575: stat d13/d1d/d52/l65 0 2024-04-16T14:35:40.256 INFO:tasks.workunit.client.1.smithi115.stdout:6/576: creat d13/d1d/d2b/d5f/d30/d43/da6/d5a/fbd x:0 0 0 2024-04-16T14:35:40.256 INFO:tasks.workunit.client.1.smithi115.stdout:6/577: creat d13/d1d/d68/fbe x:0 0 0 2024-04-16T14:35:40.256 INFO:tasks.workunit.client.1.smithi115.stdout:6/578: write f0 [828912,104299] 0 2024-04-16T14:35:40.256 INFO:tasks.workunit.client.1.smithi115.stdout:4/490: rmdir d1/d15 39 2024-04-16T14:35:40.259 INFO:tasks.workunit.client.1.smithi115.stdout:8/541: link d0/db/d10/d17/f2b d0/db/d10/d17/d2c/d61/fa7 0 2024-04-16T14:35:40.259 INFO:tasks.workunit.client.0.smithi005.stdout:5/736: dread d0/d70/db3/f86 [0,4194304] 0 2024-04-16T14:35:40.261 INFO:tasks.workunit.client.0.smithi005.stdout:5/737: creat d0/d6/d12/dc0/d30/ffc x:0 0 0 2024-04-16T14:35:40.262 INFO:tasks.workunit.client.0.smithi005.stdout:5/738: creat d0/d6/d12/d1c/dd2/ffd x:0 0 0 2024-04-16T14:35:40.262 INFO:tasks.workunit.client.1.smithi115.stdout:9/558: symlink d1/d6/d2d/d4b/d60/d65/lc0 0 2024-04-16T14:35:40.263 INFO:tasks.workunit.client.0.smithi005.stdout:5/739: creat d0/d6/ffe x:0 0 0 2024-04-16T14:35:40.264 INFO:tasks.workunit.client.0.smithi005.stdout:5/740: truncate d0/d6/d12/dc0/d30/fd5 2175199 0 2024-04-16T14:35:40.266 INFO:tasks.workunit.client.0.smithi005.stdout:5/741: link d0/d6/d12/l89 d0/d6/d12/d1c/dd2/df7/lff 0 2024-04-16T14:35:40.267 INFO:tasks.workunit.client.0.smithi005.stdout:5/742: creat d0/d6/d12/d1c/dd2/df7/f100 x:0 0 0 2024-04-16T14:35:40.268 INFO:tasks.workunit.client.1.smithi115.stdout:6/579: link d13/d1d/l1f d13/d1d/d52/d8c/lbf 0 2024-04-16T14:35:40.269 INFO:tasks.workunit.client.1.smithi115.stdout:6/580: read d13/d1d/d68/fa2 [31044,70447] 0 2024-04-16T14:35:40.269 INFO:tasks.workunit.client.1.smithi115.stdout:4/491: symlink d1/d15/d1e/l84 0 2024-04-16T14:35:40.269 INFO:tasks.workunit.client.0.smithi005.stdout:5/743: rename d0/d6/d12/dc0/d42/def to d0/d6/d12/dc0/d30/d97/d101 0 2024-04-16T14:35:40.270 INFO:tasks.workunit.client.1.smithi115.stdout:8/542: link d0/db/d44/f59 d0/db/d10/d17/d2c/d52/d74/d73/fa8 0 2024-04-16T14:35:40.270 INFO:tasks.workunit.client.1.smithi115.stdout:8/543: write d0/db/d10/d17/d2c/d61/d64/d89/f8b [45630,118246] 0 2024-04-16T14:35:40.271 INFO:tasks.workunit.client.0.smithi005.stdout:5/744: creat d0/d6/d12/de4/f102 x:0 0 0 2024-04-16T14:35:40.271 INFO:tasks.workunit.client.0.smithi005.stdout:5/745: dread d0/d6/d12/d1c/f2a [0,4194304] 0 2024-04-16T14:35:40.272 INFO:tasks.workunit.client.1.smithi115.stdout:4/492: creat d1/d15/d31/d55/f85 x:0 0 0 2024-04-16T14:35:40.272 INFO:tasks.workunit.client.1.smithi115.stdout:4/493: getdents d1/d15/d31/d42/d46/d7a 0 2024-04-16T14:35:40.274 INFO:tasks.workunit.client.1.smithi115.stdout:8/544: mknod d0/db/d10/d17/d2c/d52/d6c/d71/ca9 0 2024-04-16T14:35:40.274 INFO:tasks.workunit.client.1.smithi115.stdout:8/545: stat d0/db/d10/d17 0 2024-04-16T14:35:40.274 INFO:tasks.workunit.client.1.smithi115.stdout:3/581: read dc/d29/d39/d86/fb9 [4061019,78220] 0 2024-04-16T14:35:40.274 INFO:tasks.workunit.client.1.smithi115.stdout:3/582: creat dc/d29/d4d/d56/d8a/fc2 x:0 0 0 2024-04-16T14:35:40.274 INFO:tasks.workunit.client.1.smithi115.stdout:7/468: dwrite d0/d1/d3b/d49/f91 [0,4194304] 0 2024-04-16T14:35:40.276 INFO:tasks.workunit.client.1.smithi115.stdout:0/419: dwrite d6/d1b/f7f [0,4194304] 0 2024-04-16T14:35:40.277 INFO:tasks.workunit.client.1.smithi115.stdout:1/469: dwrite df/d36/f3d [0,4194304] 0 2024-04-16T14:35:40.277 INFO:tasks.workunit.client.1.smithi115.stdout:3/583: rmdir dc/d29/d77 39 2024-04-16T14:35:40.281 INFO:tasks.workunit.client.1.smithi115.stdout:2/585: rename d0/d4/de to d0/d47/d65/dad/dbb 0 2024-04-16T14:35:40.284 INFO:tasks.workunit.client.0.smithi005.stdout:5/746: rename d0/d6/d12/dc0/d30/d97/d101 to d0/d6/d103 0 2024-04-16T14:35:40.284 INFO:tasks.workunit.client.0.smithi005.stdout:5/747: rename d0/d6 to d0/d6/d12/d1c/d1e/d73/df0/d104 22 2024-04-16T14:35:40.284 INFO:tasks.workunit.client.1.smithi115.stdout:7/469: creat d0/d24/d2b/fa1 x:0 0 0 2024-04-16T14:35:40.286 INFO:tasks.workunit.client.0.smithi005.stdout:5/748: mknod d0/d6/d6e/d9e/ddb/c105 0 2024-04-16T14:35:40.286 INFO:tasks.workunit.client.1.smithi115.stdout:1/470: write df/d2d/f1e [2839386,20819] 0 2024-04-16T14:35:40.287 INFO:tasks.workunit.client.0.smithi005.stdout:5/749: mknod d0/d6/d12/d1c/d81/dd7/c106 0 2024-04-16T14:35:40.287 INFO:tasks.workunit.client.0.smithi005.stdout:5/750: chown d0/d6/d12/dc0/d30/d97/lc7 631690 1 2024-04-16T14:35:40.287 INFO:tasks.workunit.client.0.smithi005.stdout:5/751: chown d0/d6/d12/d1c/dd2/df7/f100 139 1 2024-04-16T14:35:40.287 INFO:tasks.workunit.client.0.smithi005.stdout:5/752: rename d0/d6/d12/d1c/d81/fc9 to d0/d70/f107 0 2024-04-16T14:35:40.292 INFO:tasks.workunit.client.1.smithi115.stdout:0/420: unlink d6/d10/d12/d1f/d36/d4b/f86 0 2024-04-16T14:35:40.295 INFO:tasks.workunit.client.1.smithi115.stdout:3/584: mknod dc/d29/d77/cc3 0 2024-04-16T14:35:40.295 INFO:tasks.workunit.client.1.smithi115.stdout:3/585: fsync dc/d24/f6f 0 2024-04-16T14:35:40.296 INFO:tasks.workunit.client.1.smithi115.stdout:2/586: mkdir d0/d47/d65/dad/dbb/d11/dbc 0 2024-04-16T14:35:40.297 INFO:tasks.workunit.client.1.smithi115.stdout:1/471: truncate df/d35/d48/f4c 3624694 0 2024-04-16T14:35:40.299 INFO:tasks.workunit.client.1.smithi115.stdout:3/586: mknod dc/cc4 0 2024-04-16T14:35:40.299 INFO:tasks.workunit.client.1.smithi115.stdout:2/587: stat d0/d4/d57/ca3 0 2024-04-16T14:35:40.299 INFO:tasks.workunit.client.1.smithi115.stdout:2/588: readlink d0/d47/d65/la2 0 2024-04-16T14:35:40.299 INFO:tasks.workunit.client.1.smithi115.stdout:2/589: chown d0/d4/d24/d10/f89 29 1 2024-04-16T14:35:40.299 INFO:tasks.workunit.client.1.smithi115.stdout:2/590: chown d0/d4/d24/d23/f7c 131 1 2024-04-16T14:35:40.301 INFO:tasks.workunit.client.1.smithi115.stdout:3/587: truncate dc/d24/f6c 1045287 0 2024-04-16T14:35:40.301 INFO:tasks.workunit.client.1.smithi115.stdout:3/588: truncate dc/d29/d4d/d56/d8a/fa5 302741 0 2024-04-16T14:35:40.303 INFO:tasks.workunit.client.1.smithi115.stdout:1/472: dread f0 [4194304,4194304] 0 2024-04-16T14:35:40.304 INFO:tasks.workunit.client.1.smithi115.stdout:1/473: mknod df/d13/d4d/d2c/c99 0 2024-04-16T14:35:40.304 INFO:tasks.workunit.client.1.smithi115.stdout:0/421: dread d6/d10/d12/d31/d35/d44/f50 [0,4194304] 0 2024-04-16T14:35:40.304 INFO:tasks.workunit.client.1.smithi115.stdout:0/422: read - d6/d1b/f7d zero size 2024-04-16T14:35:40.305 INFO:tasks.workunit.client.1.smithi115.stdout:1/474: symlink df/d13/d72/l9a 0 2024-04-16T14:35:40.308 INFO:tasks.workunit.client.1.smithi115.stdout:0/423: unlink d6/f33 0 2024-04-16T14:35:40.308 INFO:tasks.workunit.client.1.smithi115.stdout:0/424: chown d6/d10/d12/d31/d35/d44/c90 27198602 1 2024-04-16T14:35:40.308 INFO:tasks.workunit.client.1.smithi115.stdout:0/425: stat d6/d10/d12/d31/d35/d44 0 2024-04-16T14:35:40.308 INFO:tasks.workunit.client.1.smithi115.stdout:0/426: fdatasync d6/fc 0 2024-04-16T14:35:40.309 INFO:tasks.workunit.client.1.smithi115.stdout:0/427: creat d6/d54/f9a x:0 0 0 2024-04-16T14:35:40.310 INFO:tasks.workunit.client.1.smithi115.stdout:1/475: unlink df/d13/f59 0 2024-04-16T14:35:40.313 INFO:tasks.workunit.client.1.smithi115.stdout:0/428: unlink d6/d10/d12/d1f/d36/d4b/d6d/c45 0 2024-04-16T14:35:40.313 INFO:tasks.workunit.client.1.smithi115.stdout:8/546: dwrite d0/db/d10/d17/d22/f6f [0,4194304] 0 2024-04-16T14:35:40.317 INFO:tasks.workunit.client.1.smithi115.stdout:4/494: dwrite d1/f2d [4194304,4194304] 0 2024-04-16T14:35:40.317 INFO:tasks.workunit.client.1.smithi115.stdout:7/470: dwrite d0/d1/d3b/d3e/f56 [4194304,4194304] 0 2024-04-16T14:35:40.317 INFO:tasks.workunit.client.1.smithi115.stdout:4/495: fsync d1/d15/d31/f41 0 2024-04-16T14:35:40.318 INFO:tasks.workunit.client.1.smithi115.stdout:8/547: mknod d0/db/d10/d25/caa 0 2024-04-16T14:35:40.318 INFO:tasks.workunit.client.1.smithi115.stdout:8/548: write d0/db/f24 [600935,37989] 0 2024-04-16T14:35:40.320 INFO:tasks.workunit.client.1.smithi115.stdout:4/496: mkdir d1/d2/d86 0 2024-04-16T14:35:40.321 INFO:tasks.workunit.client.1.smithi115.stdout:8/549: mkdir d0/db/d10/d17/d2c/d61/d6b/dab 0 2024-04-16T14:35:40.321 INFO:tasks.workunit.client.1.smithi115.stdout:7/471: getdents d0/d24/d2b/d64 0 2024-04-16T14:35:40.322 INFO:tasks.workunit.client.1.smithi115.stdout:8/550: truncate d0/db/d10/d17/f72 744491 0 2024-04-16T14:35:40.326 INFO:tasks.workunit.client.1.smithi115.stdout:7/472: unlink d0/d1/d3b/d49/d5d/f77 0 2024-04-16T14:35:40.331 INFO:tasks.workunit.client.1.smithi115.stdout:7/473: rename d0/d1/d3b/d3f/d7a/d80 to d0/d2/d3a/d30/d6b/da2 0 2024-04-16T14:35:40.332 INFO:tasks.workunit.client.0.smithi005.stdout:5/753: dwrite d0/d6/d12/d1c/d1e/d73/fca [0,4194304] 0 2024-04-16T14:35:40.332 INFO:tasks.workunit.client.0.smithi005.stdout:5/754: write d0/f26 [366670,72151] 0 2024-04-16T14:35:40.333 INFO:tasks.workunit.client.1.smithi115.stdout:7/474: mkdir d0/d24/da3 0 2024-04-16T14:35:40.337 INFO:tasks.workunit.client.0.smithi005.stdout:0/657: sync 2024-04-16T14:35:40.337 INFO:tasks.workunit.client.0.smithi005.stdout:5/755: mkdir d0/d6/d12/d108 0 2024-04-16T14:35:40.337 INFO:tasks.workunit.client.0.smithi005.stdout:5/756: creat d0/d6/d12/d1c/dd2/df7/f109 x:0 0 0 2024-04-16T14:35:40.337 INFO:tasks.workunit.client.0.smithi005.stdout:6/918: sync 2024-04-16T14:35:40.337 INFO:tasks.workunit.client.0.smithi005.stdout:1/929: sync 2024-04-16T14:35:40.337 INFO:tasks.workunit.client.0.smithi005.stdout:6/919: truncate d2/d20/d72/f9c 182682 0 2024-04-16T14:35:40.338 INFO:tasks.workunit.client.0.smithi005.stdout:8/724: sync 2024-04-16T14:35:40.338 INFO:tasks.workunit.client.0.smithi005.stdout:6/920: dread - d2/d20/d72/fd9 zero size 2024-04-16T14:35:40.338 INFO:tasks.workunit.client.0.smithi005.stdout:4/983: sync 2024-04-16T14:35:40.338 INFO:tasks.workunit.client.0.smithi005.stdout:9/503: sync 2024-04-16T14:35:40.338 INFO:tasks.workunit.client.0.smithi005.stdout:8/725: chown d5/d7b/da8/db7/fb2 311 1 2024-04-16T14:35:40.338 INFO:tasks.workunit.client.0.smithi005.stdout:2/542: sync 2024-04-16T14:35:40.338 INFO:tasks.workunit.client.0.smithi005.stdout:4/984: write d0/d1b/d1d/d1f/da0/d137/dcb/f11f [250544,25934] 0 2024-04-16T14:35:40.339 INFO:tasks.workunit.client.0.smithi005.stdout:7/837: sync 2024-04-16T14:35:40.339 INFO:tasks.workunit.client.0.smithi005.stdout:5/757: unlink d0/d70/db3/f86 0 2024-04-16T14:35:40.342 INFO:tasks.workunit.client.0.smithi005.stdout:1/930: unlink d2/d74/dd7/d11f/c9e 0 2024-04-16T14:35:40.342 INFO:tasks.workunit.client.0.smithi005.stdout:1/931: dread - d2/d1c/d15/d2a/d19/d20/fde zero size 2024-04-16T14:35:40.342 INFO:tasks.workunit.client.0.smithi005.stdout:1/932: readlink d2/d1c/d15/d2a/d19/d20/la2 0 2024-04-16T14:35:40.342 INFO:tasks.workunit.client.0.smithi005.stdout:1/933: dread - d2/d1c/d15/d2a/d19/f121 zero size 2024-04-16T14:35:40.344 INFO:tasks.workunit.client.0.smithi005.stdout:8/726: rmdir d5/d7b/da8/db7/d8a/da1/d3d/d7f/d8d/de2 0 2024-04-16T14:35:40.344 INFO:tasks.workunit.client.0.smithi005.stdout:8/727: write d5/d7b/da8/db7/ff3 [9989,86693] 0 2024-04-16T14:35:40.345 INFO:tasks.workunit.client.0.smithi005.stdout:6/921: mknod d2/d5/d10/dd6/d12e/c136 0 2024-04-16T14:35:40.345 INFO:tasks.workunit.client.0.smithi005.stdout:6/922: readlink d2/d3f/d47/l9b 0 2024-04-16T14:35:40.346 INFO:tasks.workunit.client.0.smithi005.stdout:9/504: mkdir d3/d12/d2b/d8e 0 2024-04-16T14:35:40.346 INFO:tasks.workunit.client.0.smithi005.stdout:9/505: fsync d3/d12/d16/d46/d47/d60/f75 0 2024-04-16T14:35:40.348 INFO:tasks.workunit.client.0.smithi005.stdout:4/985: mkdir d0/d47/d13a 0 2024-04-16T14:35:40.348 INFO:tasks.workunit.client.0.smithi005.stdout:4/986: readlink d0/d4d/l59 0 2024-04-16T14:35:40.348 INFO:tasks.workunit.client.0.smithi005.stdout:7/838: truncate d1/dc/d2f/f5a 3157630 0 2024-04-16T14:35:40.348 INFO:tasks.workunit.client.0.smithi005.stdout:7/839: chown d1/d49/d74/d77/d22/da0/le2 3 1 2024-04-16T14:35:40.349 INFO:tasks.workunit.client.0.smithi005.stdout:1/934: creat d2/d74/dd7/d11f/d51/d132/dbc/dcf/f141 x:0 0 0 2024-04-16T14:35:40.350 INFO:tasks.workunit.client.0.smithi005.stdout:1/935: readlink d2/d1c/d15/d2a/d25/l4b 0 2024-04-16T14:35:40.350 INFO:tasks.workunit.client.0.smithi005.stdout:6/923: mknod d2/d3f/d47/d84/d8c/c137 0 2024-04-16T14:35:40.350 INFO:tasks.workunit.client.0.smithi005.stdout:6/924: stat d2/d5/d10/lc3 0 2024-04-16T14:35:40.350 INFO:tasks.workunit.client.0.smithi005.stdout:6/925: fsync f0 0 2024-04-16T14:35:40.351 INFO:tasks.workunit.client.1.smithi115.stdout:3/589: dwrite dc/d24/d33/d4b/f55 [0,4194304] 0 2024-04-16T14:35:40.352 INFO:tasks.workunit.client.1.smithi115.stdout:1/476: dwrite df/d2d/f82 [0,4194304] 0 2024-04-16T14:35:40.352 INFO:tasks.workunit.client.1.smithi115.stdout:1/477: readlink ld 0 2024-04-16T14:35:40.352 INFO:tasks.workunit.client.1.smithi115.stdout:1/478: chown df/d13/d72 518126 1 2024-04-16T14:35:40.352 INFO:tasks.workunit.client.1.smithi115.stdout:1/479: stat df/d13/d4d/d3e/d7d/l97 0 2024-04-16T14:35:40.352 INFO:tasks.workunit.client.1.smithi115.stdout:2/591: dwrite d0/d4/f3a [0,4194304] 0 2024-04-16T14:35:40.353 INFO:tasks.workunit.client.0.smithi005.stdout:2/543: dread d0/d2a/f63 [0,4194304] 0 2024-04-16T14:35:40.353 INFO:tasks.workunit.client.0.smithi005.stdout:9/506: creat d3/d77/f8f x:0 0 0 2024-04-16T14:35:40.353 INFO:tasks.workunit.client.0.smithi005.stdout:2/544: write d0/d4/d2b/f17 [4957422,19499] 0 2024-04-16T14:35:40.353 INFO:tasks.workunit.client.0.smithi005.stdout:5/758: dread d0/d6/d12/dc0/d8d/d5e/f5d [0,4194304] 0 2024-04-16T14:35:40.354 INFO:tasks.workunit.client.1.smithi115.stdout:8/551: dwrite d0/db/f58 [0,4194304] 0 2024-04-16T14:35:40.354 INFO:tasks.workunit.client.0.smithi005.stdout:9/507: symlink d3/d12/l90 0 2024-04-16T14:35:40.356 INFO:tasks.workunit.client.0.smithi005.stdout:2/545: link d0/d1c/l37 d0/d1c/d59/d67/lb9 0 2024-04-16T14:35:40.356 INFO:tasks.workunit.client.0.smithi005.stdout:2/546: stat d0/d29/d3e/f8e 0 2024-04-16T14:35:40.357 INFO:tasks.workunit.client.0.smithi005.stdout:2/547: chown d0/d4/d2b/d6b/l8c 190 1 2024-04-16T14:35:40.357 INFO:tasks.workunit.client.0.smithi005.stdout:2/548: fsync d0/d29/d3e/f57 0 2024-04-16T14:35:40.357 INFO:tasks.workunit.client.0.smithi005.stdout:2/549: chown d0/d4/d2b/c86 7863589 1 2024-04-16T14:35:40.357 INFO:tasks.workunit.client.1.smithi115.stdout:4/497: dwrite d1/d2/ff [0,4194304] 0 2024-04-16T14:35:40.358 INFO:tasks.workunit.client.0.smithi005.stdout:9/508: truncate d3/d12/d16/f4d 2811139 0 2024-04-16T14:35:40.358 INFO:tasks.workunit.client.0.smithi005.stdout:7/840: dread d1/dc/d2f/fa6 [0,4194304] 0 2024-04-16T14:35:40.360 INFO:tasks.workunit.client.0.smithi005.stdout:2/550: creat d0/d29/d3e/fba x:0 0 0 2024-04-16T14:35:40.360 INFO:tasks.workunit.client.0.smithi005.stdout:2/551: fsync d0/d1c/d8d/fa9 0 2024-04-16T14:35:40.361 INFO:tasks.workunit.client.0.smithi005.stdout:6/926: write d2/d20/d3c/dcf/d6e/f87 [2307937,6345] 0 2024-04-16T14:35:40.361 INFO:tasks.workunit.client.0.smithi005.stdout:9/509: rmdir d3/d12/d16/d46/d47 39 2024-04-16T14:35:40.361 INFO:tasks.workunit.client.1.smithi115.stdout:0/429: dwrite f1 [8388608,4194304] 0 2024-04-16T14:35:40.362 INFO:tasks.workunit.client.0.smithi005.stdout:8/728: write d5/d40/d8e/ff9 [3051248,52518] 0 2024-04-16T14:35:40.362 INFO:tasks.workunit.client.0.smithi005.stdout:2/552: rmdir d0/d29 39 2024-04-16T14:35:40.362 INFO:tasks.workunit.client.0.smithi005.stdout:2/553: dread - d0/f9d zero size 2024-04-16T14:35:40.363 INFO:tasks.workunit.client.0.smithi005.stdout:6/927: creat d2/d20/d33/dd4/f138 x:0 0 0 2024-04-16T14:35:40.363 INFO:tasks.workunit.client.0.smithi005.stdout:6/928: stat d2/d3f/d47/d84/da5/d11f 0 2024-04-16T14:35:40.363 INFO:tasks.workunit.client.0.smithi005.stdout:6/929: write d2/d5/d10/dd6/fa6 [5147269,7901] 0 2024-04-16T14:35:40.364 INFO:tasks.workunit.client.0.smithi005.stdout:9/510: truncate d3/d12/d2b/f44 882123 0 2024-04-16T14:35:40.365 INFO:tasks.workunit.client.0.smithi005.stdout:9/511: write d3/d12/d16/d46/d47/d60/f75 [636564,61540] 0 2024-04-16T14:35:40.366 INFO:tasks.workunit.client.0.smithi005.stdout:2/554: mknod d0/d2a/d3a/d94/cbb 0 2024-04-16T14:35:40.366 INFO:tasks.workunit.client.0.smithi005.stdout:2/555: creat d0/d1c/d59/d7a/d84/fbc x:0 0 0 2024-04-16T14:35:40.367 INFO:tasks.workunit.client.1.smithi115.stdout:3/590: write dc/d29/f48 [3539437,12250] 0 2024-04-16T14:35:40.369 INFO:tasks.workunit.client.0.smithi005.stdout:8/729: getdents d5/d11 0 2024-04-16T14:35:40.371 INFO:tasks.workunit.client.0.smithi005.stdout:8/730: creat d5/d7b/da8/db7/d8a/da1/d3d/d7f/de7/fff x:0 0 0 2024-04-16T14:35:40.372 INFO:tasks.workunit.client.1.smithi115.stdout:1/480: dread - df/f5b zero size 2024-04-16T14:35:40.374 INFO:tasks.workunit.client.1.smithi115.stdout:8/552: dread d0/db/d10/d17/f2b [0,4194304] 0 2024-04-16T14:35:40.374 INFO:tasks.workunit.client.0.smithi005.stdout:8/731: creat d5/da0/f100 x:0 0 0 2024-04-16T14:35:40.374 INFO:tasks.workunit.client.0.smithi005.stdout:8/732: write d5/d55/f6b [5064834,93526] 0 2024-04-16T14:35:40.374 INFO:tasks.workunit.client.0.smithi005.stdout:8/733: creat d5/d7b/da8/da5/f101 x:0 0 0 2024-04-16T14:35:40.375 INFO:tasks.workunit.client.1.smithi115.stdout:2/592: creat d0/d47/d65/dad/dbb/d11/d6d/fbd x:0 0 0 2024-04-16T14:35:40.377 INFO:tasks.workunit.client.0.smithi005.stdout:8/734: rename d5/d7b/da8/c94 to d5/d7b/da8/db7/d8a/da1/c102 0 2024-04-16T14:35:40.381 INFO:tasks.workunit.client.1.smithi115.stdout:1/481: dread df/d2d/d83/f60 [0,4194304] 0 2024-04-16T14:35:40.382 INFO:tasks.workunit.client.0.smithi005.stdout:9/512: dread d3/d12/f6c [0,4194304] 0 2024-04-16T14:35:40.383 INFO:tasks.workunit.client.0.smithi005.stdout:9/513: fdatasync d3/d12/f3e 0 2024-04-16T14:35:40.389 INFO:tasks.workunit.client.1.smithi115.stdout:0/430: rename d6/d10/d12/d31/d35/d28 to d6/d10/d12/d31/d35/d9b 0 2024-04-16T14:35:40.392 INFO:tasks.workunit.client.1.smithi115.stdout:3/591: creat dc/d29/d4d/fc5 x:0 0 0 2024-04-16T14:35:40.392 INFO:tasks.workunit.client.1.smithi115.stdout:3/592: chown dc/d24/d33/d4b/f97 241 1 2024-04-16T14:35:40.393 INFO:tasks.workunit.client.1.smithi115.stdout:0/431: dread f0 [0,4194304] 0 2024-04-16T14:35:40.395 INFO:tasks.workunit.client.1.smithi115.stdout:8/553: creat d0/db/d44/fac x:0 0 0 2024-04-16T14:35:40.397 INFO:tasks.workunit.client.1.smithi115.stdout:2/593: rename d0/d1b/l90 to d0/d4/d24/d23/d80/lbe 0 2024-04-16T14:35:40.398 INFO:tasks.workunit.client.1.smithi115.stdout:1/482: link fb df/d36/f9b 0 2024-04-16T14:35:40.399 INFO:tasks.workunit.client.1.smithi115.stdout:3/593: creat dc/d29/d39/fc6 x:0 0 0 2024-04-16T14:35:40.400 INFO:tasks.workunit.client.1.smithi115.stdout:0/432: unlink d6/d10/d12/f73 0 2024-04-16T14:35:40.400 INFO:tasks.workunit.client.1.smithi115.stdout:0/433: fdatasync d6/d30/f43 0 2024-04-16T14:35:40.400 INFO:tasks.workunit.client.1.smithi115.stdout:0/434: fdatasync d6/d10/d12/d1f/d36/d4b/f6a 0 2024-04-16T14:35:40.400 INFO:tasks.workunit.client.1.smithi115.stdout:0/435: chown d6/d30/d4d 13 1 2024-04-16T14:35:40.400 INFO:tasks.workunit.client.1.smithi115.stdout:2/594: getdents d0/d4/d57 0 2024-04-16T14:35:40.401 INFO:tasks.workunit.client.1.smithi115.stdout:1/483: creat df/f9c x:0 0 0 2024-04-16T14:35:40.401 INFO:tasks.workunit.client.1.smithi115.stdout:1/484: fdatasync f0 0 2024-04-16T14:35:40.402 INFO:tasks.workunit.client.1.smithi115.stdout:0/436: symlink d6/d30/d4d/l9c 0 2024-04-16T14:35:40.402 INFO:tasks.workunit.client.1.smithi115.stdout:0/437: creat d6/d10/d12/d1f/d36/d4b/f9d x:0 0 0 2024-04-16T14:35:40.402 INFO:tasks.workunit.client.1.smithi115.stdout:0/438: fdatasync d6/d10/f63 0 2024-04-16T14:35:40.403 INFO:tasks.workunit.client.1.smithi115.stdout:2/595: rename d0/d47/d65/la2 to d0/d47/d65/dad/dbb/d11/d36/d86/lbf 0 2024-04-16T14:35:40.405 INFO:tasks.workunit.client.1.smithi115.stdout:0/439: symlink d6/d10/d12/d1f/d36/d4b/d6d/l9e 0 2024-04-16T14:35:40.405 INFO:tasks.workunit.client.1.smithi115.stdout:0/440: chown d6/d1b/f6c 226682 1 2024-04-16T14:35:40.405 INFO:tasks.workunit.client.1.smithi115.stdout:0/441: stat d6/d1b/f6c 0 2024-04-16T14:35:40.407 INFO:tasks.workunit.client.1.smithi115.stdout:1/485: rename df/d2d/d83/c51 to df/d13/c9d 0 2024-04-16T14:35:40.408 INFO:tasks.workunit.client.1.smithi115.stdout:8/554: write d0/db/d10/f42 [1485408,79964] 0 2024-04-16T14:35:40.408 INFO:tasks.workunit.client.1.smithi115.stdout:2/596: creat d0/d1b/fc0 x:0 0 0 2024-04-16T14:35:40.408 INFO:tasks.workunit.client.1.smithi115.stdout:2/597: truncate d0/d47/f8e 294415 0 2024-04-16T14:35:40.410 INFO:tasks.workunit.client.1.smithi115.stdout:1/486: truncate df/d13/d4d/d2c/f21 554120 0 2024-04-16T14:35:40.415 INFO:tasks.workunit.client.1.smithi115.stdout:8/555: creat d0/db/d10/fad x:0 0 0 2024-04-16T14:35:40.415 INFO:tasks.workunit.client.1.smithi115.stdout:8/556: fsync d0/db/d10/d17/d2c/d61/d64/f68 0 2024-04-16T14:35:40.415 INFO:tasks.workunit.client.1.smithi115.stdout:3/594: write dc/f16 [1443659,2562] 0 2024-04-16T14:35:40.415 INFO:tasks.workunit.client.1.smithi115.stdout:3/595: fsync dc/f15 0 2024-04-16T14:35:40.415 INFO:tasks.workunit.client.1.smithi115.stdout:2/598: rmdir d0/d47/d65/dad/dbb/d11/d36 39 2024-04-16T14:35:40.415 INFO:tasks.workunit.client.1.smithi115.stdout:4/498: dwrite d1/d15/d1e/f5d [0,4194304] 0 2024-04-16T14:35:40.416 INFO:tasks.workunit.client.0.smithi005.stdout:9/514: dwrite d3/f3b [0,4194304] 0 2024-04-16T14:35:40.416 INFO:tasks.workunit.client.0.smithi005.stdout:2/556: dwrite d0/d2a/f52 [0,4194304] 0 2024-04-16T14:35:40.417 INFO:tasks.workunit.client.0.smithi005.stdout:9/515: getdents d3/d49/d4b/d5c/d65 0 2024-04-16T14:35:40.418 INFO:tasks.workunit.client.1.smithi115.stdout:1/487: mknod df/d13/d4d/d3e/c9e 0 2024-04-16T14:35:40.420 INFO:tasks.workunit.client.1.smithi115.stdout:3/596: mknod dc/d29/d4d/d56/d98/dbe/cc7 0 2024-04-16T14:35:40.420 INFO:tasks.workunit.client.1.smithi115.stdout:3/597: write dc/d24/f6f [1392018,45807] 0 2024-04-16T14:35:40.420 INFO:tasks.workunit.client.1.smithi115.stdout:3/598: creat dc/d24/d36/d60/fc8 x:0 0 0 2024-04-16T14:35:40.423 INFO:tasks.workunit.client.0.smithi005.stdout:0/658: dwrite da/df/d1b/f72 [0,4194304] 0 2024-04-16T14:35:40.424 INFO:tasks.workunit.client.1.smithi115.stdout:1/488: rmdir df/d36/d3c 39 2024-04-16T14:35:40.424 INFO:tasks.workunit.client.1.smithi115.stdout:1/489: write df/d36/d3c/f85 [679827,71750] 0 2024-04-16T14:35:40.425 INFO:tasks.workunit.client.1.smithi115.stdout:1/490: chown df/d13/d4d/d2c/c99 232093995 1 2024-04-16T14:35:40.426 INFO:tasks.workunit.client.0.smithi005.stdout:0/659: mkdir da/df/d1b/d3a/d53/d5a/d67/dda 0 2024-04-16T14:35:40.426 INFO:tasks.workunit.client.1.smithi115.stdout:1/491: truncate df/d35/d48/f4c 227641 0 2024-04-16T14:35:40.426 INFO:tasks.workunit.client.1.smithi115.stdout:1/492: truncate df/d35/d48/f8e 171046 0 2024-04-16T14:35:40.429 INFO:tasks.workunit.client.0.smithi005.stdout:0/660: mknod da/cdb 0 2024-04-16T14:35:40.435 INFO:tasks.workunit.client.1.smithi115.stdout:8/557: write d0/db/d10/d25/f67 [1605718,47267] 0 2024-04-16T14:35:40.437 INFO:tasks.workunit.client.1.smithi115.stdout:8/558: dread d0/db/d10/d17/d2c/d52/d6c/f87 [4194304,4194304] 0 2024-04-16T14:35:40.437 INFO:tasks.workunit.client.1.smithi115.stdout:8/559: write d0/db/d10/d17/d2c/d52/d74/d73/fa8 [561688,15029] 0 2024-04-16T14:35:40.440 INFO:tasks.workunit.client.0.smithi005.stdout:4/987: dwrite d0/d1b/d1d/d1f/da0/d137/db2/fd1 [0,4194304] 0 2024-04-16T14:35:40.440 INFO:tasks.workunit.client.0.smithi005.stdout:4/988: write d0/d22/d29/d107/d104/f109 [1493329,129936] 0 2024-04-16T14:35:40.440 INFO:tasks.workunit.client.1.smithi115.stdout:8/560: getdents d0/db/d10/d17/d2c/d85 0 2024-04-16T14:35:40.440 INFO:tasks.workunit.client.1.smithi115.stdout:8/561: fsync d0/db/d10/d17/d2c/d61/d64/f8c 0 2024-04-16T14:35:40.441 INFO:tasks.workunit.client.1.smithi115.stdout:8/562: mkdir d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/d8a/d94/dae 0 2024-04-16T14:35:40.442 INFO:tasks.workunit.client.0.smithi005.stdout:8/735: dwrite d5/d7b/da8/da5/def/d71/fbc [0,4194304] 0 2024-04-16T14:35:40.442 INFO:tasks.workunit.client.1.smithi115.stdout:8/563: mknod d0/db/d10/d17/d2c/d52/d84/caf 0 2024-04-16T14:35:40.445 INFO:tasks.workunit.client.1.smithi115.stdout:8/564: rename d0/db/d10/d17/d2c/d61/fa7 to d0/db/d10/d17/d2c/d61/d6b/fb0 0 2024-04-16T14:35:40.447 INFO:tasks.workunit.client.0.smithi005.stdout:8/736: link d5/d40/d4b/cf0 d5/d55/d5a/c103 0 2024-04-16T14:35:40.451 INFO:tasks.workunit.client.0.smithi005.stdout:5/759: dwrite d0/d6/d6e/d9e/da9/fe2 [0,4194304] 0 2024-04-16T14:35:40.451 INFO:tasks.workunit.client.0.smithi005.stdout:0/661: dread da/f20 [0,4194304] 0 2024-04-16T14:35:40.457 INFO:tasks.workunit.client.0.smithi005.stdout:7/841: dwrite d1/dc/d2f/f60 [0,4194304] 0 2024-04-16T14:35:40.461 INFO:tasks.workunit.client.0.smithi005.stdout:0/662: write da/f1f [2702127,87805] 0 2024-04-16T14:35:40.461 INFO:tasks.workunit.client.0.smithi005.stdout:0/663: write da/df/f94 [3096025,96046] 0 2024-04-16T14:35:40.462 INFO:tasks.workunit.client.1.smithi115.stdout:8/565: dread d0/db/d10/d17/d2c/f5e [0,4194304] 0 2024-04-16T14:35:40.463 INFO:tasks.workunit.client.1.smithi115.stdout:0/442: rmdir d6/d10/d12 39 2024-04-16T14:35:40.463 INFO:tasks.workunit.client.1.smithi115.stdout:5/481: sync 2024-04-16T14:35:40.463 INFO:tasks.workunit.client.1.smithi115.stdout:5/482: stat dc/f2c 0 2024-04-16T14:35:40.464 INFO:tasks.workunit.client.0.smithi005.stdout:0/664: mkdir da/df/d26/d39/d55/ddc 0 2024-04-16T14:35:40.465 INFO:tasks.workunit.client.0.smithi005.stdout:5/760: write d0/d6/d12/dc0/d8d/dd8/f9a [2181324,11581] 0 2024-04-16T14:35:40.465 INFO:tasks.workunit.client.1.smithi115.stdout:0/443: link d6/fc d6/f9f 0 2024-04-16T14:35:40.465 INFO:tasks.workunit.client.1.smithi115.stdout:0/444: chown d6/d10/d12/d31/d35/c3b 809929 1 2024-04-16T14:35:40.466 INFO:tasks.workunit.client.0.smithi005.stdout:5/761: link d0/d70/leb d0/d6/d12/d108/l10a 0 2024-04-16T14:35:40.466 INFO:tasks.workunit.client.0.smithi005.stdout:5/762: read - d0/d6/d12/dc0/d8d/d5e/fbc zero size 2024-04-16T14:35:40.467 INFO:tasks.workunit.client.0.smithi005.stdout:5/763: readlink d0/d6/d6e/d9e/da9/lb5 0 2024-04-16T14:35:40.467 INFO:tasks.workunit.client.1.smithi115.stdout:5/483: rmdir dc/d15/d4d/d93 0 2024-04-16T14:35:40.467 INFO:tasks.workunit.client.0.smithi005.stdout:5/764: unlink d0/d6/d12/d1c/d1e/c95 0 2024-04-16T14:35:40.468 INFO:tasks.workunit.client.1.smithi115.stdout:8/566: dread d0/db/d10/d17/f72 [0,4194304] 0 2024-04-16T14:35:40.468 INFO:tasks.workunit.client.0.smithi005.stdout:5/765: creat d0/d6/d12/dc0/d6d/f10b x:0 0 0 2024-04-16T14:35:40.469 INFO:tasks.workunit.client.1.smithi115.stdout:0/445: dread d6/d10/f63 [0,4194304] 0 2024-04-16T14:35:40.470 INFO:tasks.workunit.client.0.smithi005.stdout:5/766: creat d0/d6/d6e/d9e/ddb/f10c x:0 0 0 2024-04-16T14:35:40.470 INFO:tasks.workunit.client.0.smithi005.stdout:5/767: chown d0/d6/d12/dc0/d8d/d5e/c63 16506492 1 2024-04-16T14:35:40.470 INFO:tasks.workunit.client.0.smithi005.stdout:5/768: symlink d0/d6/d12/l10d 0 2024-04-16T14:35:40.471 INFO:tasks.workunit.client.1.smithi115.stdout:5/484: dread dc/d15/d2d/f32 [0,4194304] 0 2024-04-16T14:35:40.471 INFO:tasks.workunit.client.1.smithi115.stdout:8/567: symlink d0/db/d10/d17/d2c/d52/d6c/lb1 0 2024-04-16T14:35:40.472 INFO:tasks.workunit.client.0.smithi005.stdout:2/557: dwrite d0/d1c/f83 [0,4194304] 0 2024-04-16T14:35:40.475 INFO:tasks.workunit.client.0.smithi005.stdout:2/558: symlink d0/d29/d89/lbd 0 2024-04-16T14:35:40.475 INFO:tasks.workunit.client.0.smithi005.stdout:2/559: creat d0/d2a/fbe x:0 0 0 2024-04-16T14:35:40.475 INFO:tasks.workunit.client.0.smithi005.stdout:2/560: truncate d0/d29/d3e/fba 663848 0 2024-04-16T14:35:40.476 INFO:tasks.workunit.client.1.smithi115.stdout:8/568: link d0/db/d10/d17/d2c/f60 d0/db/d10/d17/d2c/d52/d74/d3b/fb2 0 2024-04-16T14:35:40.477 INFO:tasks.workunit.client.1.smithi115.stdout:5/485: rmdir dc/d3d/d41 39 2024-04-16T14:35:40.479 INFO:tasks.workunit.client.0.smithi005.stdout:2/561: creat d0/d2a/d3a/d46/fbf x:0 0 0 2024-04-16T14:35:40.480 INFO:tasks.workunit.client.1.smithi115.stdout:8/569: creat d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/d8a/d8e/fb3 x:0 0 0 2024-04-16T14:35:40.480 INFO:tasks.workunit.client.1.smithi115.stdout:8/570: creat d0/db/d10/d17/d2c/d52/d84/fb4 x:0 0 0 2024-04-16T14:35:40.480 INFO:tasks.workunit.client.0.smithi005.stdout:0/665: dread da/df/d1b/d24/f28 [0,4194304] 0 2024-04-16T14:35:40.481 INFO:tasks.workunit.client.0.smithi005.stdout:2/562: rename d0/d4/fc to d0/d4/fc0 0 2024-04-16T14:35:40.481 INFO:tasks.workunit.client.0.smithi005.stdout:2/563: dread - d0/d1c/d59/f92 zero size 2024-04-16T14:35:40.481 INFO:tasks.workunit.client.1.smithi115.stdout:5/486: symlink dc/d15/d4d/la1 0 2024-04-16T14:35:40.483 INFO:tasks.workunit.client.0.smithi005.stdout:2/564: mknod d0/d1c/d8d/cc1 0 2024-04-16T14:35:40.484 INFO:tasks.workunit.client.1.smithi115.stdout:8/571: creat d0/fb5 x:0 0 0 2024-04-16T14:35:40.485 INFO:tasks.workunit.client.1.smithi115.stdout:1/493: dwrite df/d13/d4d/d2c/f33 [0,4194304] 0 2024-04-16T14:35:40.486 INFO:tasks.workunit.client.1.smithi115.stdout:8/572: truncate d0/db/d10/d17/d2c/d52/d6c/f87 2930314 0 2024-04-16T14:35:40.486 INFO:tasks.workunit.client.1.smithi115.stdout:8/573: fsync d0/db/f55 0 2024-04-16T14:35:40.490 INFO:tasks.workunit.client.1.smithi115.stdout:4/499: dwrite d1/d15/d1e/f29 [0,4194304] 0 2024-04-16T14:35:40.490 INFO:tasks.workunit.client.0.smithi005.stdout:8/737: dwrite d5/d11/ff8 [0,4194304] 0 2024-04-16T14:35:40.490 INFO:tasks.workunit.client.0.smithi005.stdout:8/738: chown d5/d40/d8e/fce 22386887 1 2024-04-16T14:35:40.493 INFO:tasks.workunit.client.1.smithi115.stdout:4/500: mknod d1/d15/d31/d42/d46/c87 0 2024-04-16T14:35:40.495 INFO:tasks.workunit.client.1.smithi115.stdout:3/599: dwrite dc/d24/d33/d4b/d81/f92 [0,4194304] 0 2024-04-16T14:35:40.495 INFO:tasks.workunit.client.1.smithi115.stdout:3/600: dread - dc/d29/d4d/d56/d7e/f94 zero size 2024-04-16T14:35:40.495 INFO:tasks.workunit.client.1.smithi115.stdout:3/601: dread - dc/d29/d39/fc6 zero size 2024-04-16T14:35:40.495 INFO:tasks.workunit.client.1.smithi115.stdout:1/494: dread df/f92 [4194304,4194304] 0 2024-04-16T14:35:40.496 INFO:tasks.workunit.client.0.smithi005.stdout:9/516: dread d3/d12/d16/f1d [0,4194304] 0 2024-04-16T14:35:40.496 INFO:tasks.workunit.client.0.smithi005.stdout:9/517: write d3/d49/d4b/d55/f57 [328329,26976] 0 2024-04-16T14:35:40.496 INFO:tasks.workunit.client.0.smithi005.stdout:5/769: dwrite d0/d6/d12/dc0/d8d/d5e/f84 [4194304,4194304] 0 2024-04-16T14:35:40.499 INFO:tasks.workunit.client.1.smithi115.stdout:1/495: truncate df/d36/f5f 1762196 0 2024-04-16T14:35:40.500 INFO:tasks.workunit.client.1.smithi115.stdout:1/496: truncate df/d2d/d83/f7b 113768 0 2024-04-16T14:35:40.501 INFO:tasks.workunit.client.0.smithi005.stdout:3/710: sync 2024-04-16T14:35:40.502 INFO:tasks.workunit.client.1.smithi115.stdout:1/497: creat df/d35/d84/f9f x:0 0 0 2024-04-16T14:35:40.502 INFO:tasks.workunit.client.0.smithi005.stdout:9/518: unlink d3/c11 0 2024-04-16T14:35:40.502 INFO:tasks.workunit.client.1.smithi115.stdout:4/501: dread d1/d15/d31/d42/d46/f63 [0,4194304] 0 2024-04-16T14:35:40.503 INFO:tasks.workunit.client.1.smithi115.stdout:1/498: mkdir df/d13/d4d/d68/da0 0 2024-04-16T14:35:40.503 INFO:tasks.workunit.client.0.smithi005.stdout:5/770: mkdir d0/d6/d12/d1c/d81/d82/d10e 0 2024-04-16T14:35:40.504 INFO:tasks.workunit.client.1.smithi115.stdout:4/502: link d1/d2/ff d1/f88 0 2024-04-16T14:35:40.504 INFO:tasks.workunit.client.1.smithi115.stdout:1/499: getdents df/d13/d72 0 2024-04-16T14:35:40.505 INFO:tasks.workunit.client.0.smithi005.stdout:5/771: dread d0/d6/d6e/f7a [0,4194304] 0 2024-04-16T14:35:40.505 INFO:tasks.workunit.client.0.smithi005.stdout:4/989: dwrite d0/d1b/d1d/d1f/d3e/f5e [0,4194304] 0 2024-04-16T14:35:40.505 INFO:tasks.workunit.client.0.smithi005.stdout:7/842: dwrite d1/d49/d74/d77/ffb [0,4194304] 0 2024-04-16T14:35:40.506 INFO:tasks.workunit.client.1.smithi115.stdout:1/500: mknod df/d36/d3c/ca1 0 2024-04-16T14:35:40.506 INFO:tasks.workunit.client.0.smithi005.stdout:3/711: symlink d2/d9/d7d/lec 0 2024-04-16T14:35:40.506 INFO:tasks.workunit.client.1.smithi115.stdout:3/602: read dc/d29/d4d/d56/f9b [285087,69716] 0 2024-04-16T14:35:40.507 INFO:tasks.workunit.client.0.smithi005.stdout:2/565: dwrite d0/d29/d89/f8b [0,4194304] 0 2024-04-16T14:35:40.508 INFO:tasks.workunit.client.0.smithi005.stdout:9/519: mkdir d3/d49/d91 0 2024-04-16T14:35:40.509 INFO:tasks.workunit.client.1.smithi115.stdout:0/446: dwrite d6/d10/f20 [8388608,4194304] 0 2024-04-16T14:35:40.509 INFO:tasks.workunit.client.1.smithi115.stdout:1/501: rename df/f92 to df/d13/d72/fa2 0 2024-04-16T14:35:40.512 INFO:tasks.workunit.client.0.smithi005.stdout:3/712: mknod d2/d17/d46/d75/d9b/dbd/ced 0 2024-04-16T14:35:40.512 INFO:tasks.workunit.client.0.smithi005.stdout:3/713: dread - d2/d17/d46/d75/fcf zero size 2024-04-16T14:35:40.512 INFO:tasks.workunit.client.0.smithi005.stdout:3/714: write d2/d9/fd9 [876105,75864] 0 2024-04-16T14:35:40.513 INFO:tasks.workunit.client.1.smithi115.stdout:8/574: rmdir d0/db/d10/d17/d2c/d61 39 2024-04-16T14:35:40.515 INFO:tasks.workunit.client.1.smithi115.stdout:0/447: link d6/d10/c17 d6/d10/d12/d31/d35/d44/d85/ca0 0 2024-04-16T14:35:40.515 INFO:tasks.workunit.client.1.smithi115.stdout:0/448: dread - d6/f4f zero size 2024-04-16T14:35:40.515 INFO:tasks.workunit.client.0.smithi005.stdout:7/843: dread d1/d49/d74/d77/ffb [0,4194304] 0 2024-04-16T14:35:40.516 INFO:tasks.workunit.client.0.smithi005.stdout:7/844: fdatasync d1/d49/d74/d77/d22/d27/f2b 0 2024-04-16T14:35:40.517 INFO:tasks.workunit.client.0.smithi005.stdout:2/566: unlink d0/d1c/d59/d67/fa1 0 2024-04-16T14:35:40.517 INFO:tasks.workunit.client.1.smithi115.stdout:4/503: dread d1/d15/d24/f40 [0,4194304] 0 2024-04-16T14:35:40.517 INFO:tasks.workunit.client.1.smithi115.stdout:4/504: write d1/f4 [3230038,57120] 0 2024-04-16T14:35:40.517 INFO:tasks.workunit.client.1.smithi115.stdout:4/505: fsync d1/f22 0 2024-04-16T14:35:40.517 INFO:tasks.workunit.client.1.smithi115.stdout:1/502: symlink df/d13/d4d/d2c/d54/la3 0 2024-04-16T14:35:40.518 INFO:tasks.workunit.client.1.smithi115.stdout:1/503: stat df/d13/d4d/d2c/f24 0 2024-04-16T14:35:40.520 INFO:tasks.workunit.client.1.smithi115.stdout:0/449: link d6/d30/d4d/l9c d6/d10/d71/la1 0 2024-04-16T14:35:40.520 INFO:tasks.workunit.client.1.smithi115.stdout:0/450: chown d6/f9f 1675704 1 2024-04-16T14:35:40.520 INFO:tasks.workunit.client.1.smithi115.stdout:0/451: read - d6/d54/f9a zero size 2024-04-16T14:35:40.520 INFO:tasks.workunit.client.1.smithi115.stdout:0/452: read - d6/d10/d12/d1f/f89 zero size 2024-04-16T14:35:40.521 INFO:tasks.workunit.client.0.smithi005.stdout:9/520: creat d3/d12/d16/d46/d47/f92 x:0 0 0 2024-04-16T14:35:40.523 INFO:tasks.workunit.client.1.smithi115.stdout:1/504: dread df/d13/d4d/d3e/f62 [0,4194304] 0 2024-04-16T14:35:40.524 INFO:tasks.workunit.client.0.smithi005.stdout:2/567: creat d0/d2a/d3a/fc2 x:0 0 0 2024-04-16T14:35:40.525 INFO:tasks.workunit.client.1.smithi115.stdout:1/505: creat df/d36/d94/fa4 x:0 0 0 2024-04-16T14:35:40.527 INFO:tasks.workunit.client.0.smithi005.stdout:4/990: dread d0/d1b/d1d/d1f/d5d/da9/f2f [0,4194304] 0 2024-04-16T14:35:40.528 INFO:tasks.workunit.client.1.smithi115.stdout:1/506: rename df/d36/f4e to df/d13/fa5 0 2024-04-16T14:35:40.530 INFO:tasks.workunit.client.1.smithi115.stdout:1/507: truncate df/d2d/f82 1294333 0 2024-04-16T14:35:40.532 INFO:tasks.workunit.client.0.smithi005.stdout:9/521: mknod d3/d49/d91/c93 0 2024-04-16T14:35:40.532 INFO:tasks.workunit.client.1.smithi115.stdout:1/508: rmdir df/d2d/d81 0 2024-04-16T14:35:40.533 INFO:tasks.workunit.client.1.smithi115.stdout:0/453: write d6/d10/d12/f6e [2860489,77398] 0 2024-04-16T14:35:40.534 INFO:tasks.workunit.client.1.smithi115.stdout:1/509: creat df/d36/d3c/fa6 x:0 0 0 2024-04-16T14:35:40.534 INFO:tasks.workunit.client.0.smithi005.stdout:2/568: unlink d0/d2a/d3a/f53 0 2024-04-16T14:35:40.536 INFO:tasks.workunit.client.0.smithi005.stdout:4/991: unlink d0/d1b/d1d/d1f/d48/f8b 0 2024-04-16T14:35:40.536 INFO:tasks.workunit.client.0.smithi005.stdout:4/992: write d0/d1b/f7c [1457500,122387] 0 2024-04-16T14:35:40.536 INFO:tasks.workunit.client.0.smithi005.stdout:4/993: truncate d0/d1b/d1d/f53 4500637 0 2024-04-16T14:35:40.539 INFO:tasks.workunit.client.0.smithi005.stdout:4/994: unlink d0/d22/d61/l64 0 2024-04-16T14:35:40.539 INFO:tasks.workunit.client.0.smithi005.stdout:4/995: fdatasync d0/d1b/db7/d100/f112 0 2024-04-16T14:35:40.540 INFO:tasks.workunit.client.1.smithi115.stdout:9/559: sync 2024-04-16T14:35:40.540 INFO:tasks.workunit.client.1.smithi115.stdout:3/603: dwrite dc/d24/d36/f3b [4194304,4194304] 0 2024-04-16T14:35:40.541 INFO:tasks.workunit.client.0.smithi005.stdout:4/996: creat d0/d22/d61/dbe/f13b x:0 0 0 2024-04-16T14:35:40.541 INFO:tasks.workunit.client.0.smithi005.stdout:4/997: creat d0/d1b/d1d/dc3/d103/f13c x:0 0 0 2024-04-16T14:35:40.541 INFO:tasks.workunit.client.0.smithi005.stdout:4/998: truncate d0/d22/d29/fdf 1359673 0 2024-04-16T14:35:40.544 INFO:tasks.workunit.client.0.smithi005.stdout:9/522: dread d3/d12/d16/f4d [0,4194304] 0 2024-04-16T14:35:40.544 INFO:tasks.workunit.client.0.smithi005.stdout:9/523: fsync d3/d12/f52 0 2024-04-16T14:35:40.544 INFO:tasks.workunit.client.1.smithi115.stdout:3/604: truncate dc/f67 1291346 0 2024-04-16T14:35:40.545 INFO:tasks.workunit.client.0.smithi005.stdout:4/999: unlink d0/d22/d61/le0 0 2024-04-16T14:35:40.546 INFO:tasks.workunit.client.1.smithi115.stdout:9/560: getdents d1/d6/d2d/d4b/d90 0 2024-04-16T14:35:40.546 INFO:tasks.workunit.client.0.smithi005.stdout:5/772: dwrite d0/d70/fe6 [0,4194304] 0 2024-04-16T14:35:40.548 INFO:tasks.workunit.client.0.smithi005.stdout:9/524: rename d3/d49/d4b/d5c/d65/c7a to d3/d49/d4b/d55/c94 0 2024-04-16T14:35:40.548 INFO:tasks.workunit.client.0.smithi005.stdout:7/845: dwrite d1/d49/d74/d77/d22/d27/d3a/d5c/f62 [0,4194304] 0 2024-04-16T14:35:40.548 INFO:tasks.workunit.client.0.smithi005.stdout:7/846: creat d1/d49/d74/d77/d22/da0/dbb/dcb/f119 x:0 0 0 2024-04-16T14:35:40.549 INFO:tasks.workunit.client.1.smithi115.stdout:8/575: dwrite d0/db/f58 [0,4194304] 0 2024-04-16T14:35:40.549 INFO:tasks.workunit.client.1.smithi115.stdout:3/605: symlink dc/d24/d80/lc9 0 2024-04-16T14:35:40.552 INFO:tasks.workunit.client.1.smithi115.stdout:9/561: link d1/f3 d1/d6/d2d/d4b/d60/d65/fc1 0 2024-04-16T14:35:40.552 INFO:tasks.workunit.client.1.smithi115.stdout:9/562: chown d1/d6/d2d/d3d/d49/d98/fbd 438 1 2024-04-16T14:35:40.552 INFO:tasks.workunit.client.1.smithi115.stdout:9/563: creat d1/d6/d2d/d4b/d60/fc2 x:0 0 0 2024-04-16T14:35:40.552 INFO:tasks.workunit.client.1.smithi115.stdout:9/564: creat d1/d6/d2d/d3d/d49/fc3 x:0 0 0 2024-04-16T14:35:40.552 INFO:tasks.workunit.client.1.smithi115.stdout:9/565: stat d1/d6/d2d/d4b 0 2024-04-16T14:35:40.553 INFO:tasks.workunit.client.0.smithi005.stdout:7/847: mknod d1/d49/d74/d77/d22/da0/c11a 0 2024-04-16T14:35:40.554 INFO:tasks.workunit.client.1.smithi115.stdout:8/576: mknod d0/db/d10/d17/d2c/d61/d6b/cb6 0 2024-04-16T14:35:40.555 INFO:tasks.workunit.client.0.smithi005.stdout:7/848: mkdir d1/d85/d96/de1/d11b 0 2024-04-16T14:35:40.558 INFO:tasks.workunit.client.0.smithi005.stdout:7/849: rename d1/d49/d74/d77/d22/d27/d2e/l56 to d1/d49/d74/d77/d22/da0/dbb/dcb/l11c 0 2024-04-16T14:35:40.558 INFO:tasks.workunit.client.0.smithi005.stdout:7/850: chown d1/l38 62778551 1 2024-04-16T14:35:40.561 INFO:tasks.workunit.client.1.smithi115.stdout:9/566: creat d1/d6/d2d/d4b/d8f/fc4 x:0 0 0 2024-04-16T14:35:40.563 INFO:tasks.workunit.client.1.smithi115.stdout:9/567: rmdir d1/d6/d29 39 2024-04-16T14:35:40.564 INFO:tasks.workunit.client.1.smithi115.stdout:9/568: chown d1/d6/d2d/d4b/l6d 75633 1 2024-04-16T14:35:40.570 INFO:tasks.workunit.client.0.smithi005.stdout:9/525: write d3/f25 [3892113,113603] 0 2024-04-16T14:35:40.580 INFO:tasks.workunit.client.1.smithi115.stdout:9/569: write d1/d6/d2d/d4b/d6c/d20/f87 [3387108,87133] 0 2024-04-16T14:35:40.587 INFO:tasks.workunit.client.1.smithi115.stdout:0/454: dwrite d6/d10/d12/d31/d35/d44/f6f [0,4194304] 0 2024-04-16T14:35:40.587 INFO:tasks.workunit.client.1.smithi115.stdout:0/455: fdatasync d6/d54/f87 0 2024-04-16T14:35:40.588 INFO:tasks.workunit.client.1.smithi115.stdout:4/506: dwrite d1/d15/d31/d55/f85 [0,4194304] 0 2024-04-16T14:35:40.588 INFO:tasks.workunit.client.1.smithi115.stdout:9/570: write d1/d6/f45 [2582577,536] 0 2024-04-16T14:35:40.591 INFO:tasks.workunit.client.1.smithi115.stdout:9/571: symlink d1/d6/d2d/d4b/d8f/lc5 0 2024-04-16T14:35:40.592 INFO:tasks.workunit.client.1.smithi115.stdout:9/572: mkdir d1/d6/d2d/d4b/d60/d65/dc6 0 2024-04-16T14:35:40.592 INFO:tasks.workunit.client.1.smithi115.stdout:9/573: chown d1/d6/d29/f7a 595627854 1 2024-04-16T14:35:40.594 INFO:tasks.workunit.client.1.smithi115.stdout:9/574: rename d1/d6/d2d/d4b/d6c/d20/f2c to d1/d6/d2d/fc7 0 2024-04-16T14:35:40.595 INFO:tasks.workunit.client.1.smithi115.stdout:9/575: creat d1/d6/d2d/d3d/d50/dab/fc8 x:0 0 0 2024-04-16T14:35:40.596 INFO:tasks.workunit.client.1.smithi115.stdout:0/456: write d6/d10/d12/d31/d35/d9b/f66 [658191,125090] 0 2024-04-16T14:35:40.596 INFO:tasks.workunit.client.1.smithi115.stdout:9/576: rename d1/d6/d2d/d3d/f82 to d1/d6/d2d/d4b/d60/fc9 0 2024-04-16T14:35:40.598 INFO:tasks.workunit.client.1.smithi115.stdout:9/577: rename d1/d6/d29/f43 to d1/d6/d2d/d3d/db7/fca 0 2024-04-16T14:35:40.600 INFO:tasks.workunit.client.1.smithi115.stdout:9/578: write d1/d6/d29/f8e [112308,75343] 0 2024-04-16T14:35:40.601 INFO:tasks.workunit.client.0.smithi005.stdout:2/569: dwrite d0/d4/d2b/d5e/f70 [0,4194304] 0 2024-04-16T14:35:40.601 INFO:tasks.workunit.client.0.smithi005.stdout:2/570: chown d0/d4/d2b/f1a 166762 1 2024-04-16T14:35:40.601 INFO:tasks.workunit.client.0.smithi005.stdout:2/571: truncate d0/d4/d2b/d5e/f79 321257 0 2024-04-16T14:35:40.601 INFO:tasks.workunit.client.1.smithi115.stdout:1/510: dwrite df/d2d/d83/f7b [0,4194304] 0 2024-04-16T14:35:40.603 INFO:tasks.workunit.client.0.smithi005.stdout:2/572: chown d0/d2a/d3a/d46/cb8 1020676161 1 2024-04-16T14:35:40.604 INFO:tasks.workunit.client.1.smithi115.stdout:3/606: dwrite dc/d29/f7f [0,4194304] 0 2024-04-16T14:35:40.604 INFO:tasks.workunit.client.1.smithi115.stdout:8/577: dwrite d0/db/d10/d17/d22/f32 [4194304,4194304] 0 2024-04-16T14:35:40.604 INFO:tasks.workunit.client.1.smithi115.stdout:3/607: chown dc/d29/d39/d86/fb9 16260 1 2024-04-16T14:35:40.604 INFO:tasks.workunit.client.1.smithi115.stdout:8/578: read d0/db/d44/f93 [945586,4120] 0 2024-04-16T14:35:40.604 INFO:tasks.workunit.client.0.smithi005.stdout:9/526: dwrite d3/d12/d2b/f44 [0,4194304] 0 2024-04-16T14:35:40.604 INFO:tasks.workunit.client.0.smithi005.stdout:9/527: truncate d3/d12/d16/d86/f87 200569 0 2024-04-16T14:35:40.604 INFO:tasks.workunit.client.0.smithi005.stdout:9/528: dread - d3/d49/d4b/d5c/d65/f85 zero size 2024-04-16T14:35:40.604 INFO:tasks.workunit.client.0.smithi005.stdout:7/851: dwrite d1/d49/d74/d77/d22/da0/feb [0,4194304] 0 2024-04-16T14:35:40.613 INFO:tasks.workunit.client.1.smithi115.stdout:1/511: read df/d2d/d83/f7b [3271080,83127] 0 2024-04-16T14:35:40.615 INFO:tasks.workunit.client.1.smithi115.stdout:3/608: mknod dc/d29/d4d/dac/cca 0 2024-04-16T14:35:40.615 INFO:tasks.workunit.client.1.smithi115.stdout:3/609: chown dc/f1c 3142796 1 2024-04-16T14:35:40.616 INFO:tasks.workunit.client.1.smithi115.stdout:8/579: mkdir d0/db/d10/d17/d2c/d52/d74/d3b/d56/db7 0 2024-04-16T14:35:40.617 INFO:tasks.workunit.client.1.smithi115.stdout:1/512: creat df/d13/d4d/d6d/fa7 x:0 0 0 2024-04-16T14:35:40.618 INFO:tasks.workunit.client.0.smithi005.stdout:9/529: write d3/d12/d2b/f4e [3167625,46389] 0 2024-04-16T14:35:40.618 INFO:tasks.workunit.client.0.smithi005.stdout:9/530: write d3/d49/d4b/d5c/d65/f79 [897687,22290] 0 2024-04-16T14:35:40.618 INFO:tasks.workunit.client.0.smithi005.stdout:9/531: truncate d3/d12/d16/d46/d47/d60/f6a 552281 0 2024-04-16T14:35:40.618 INFO:tasks.workunit.client.1.smithi115.stdout:3/610: link dc/d29/d4d/d56/d98/lab dc/d29/d4d/d56/d7e/lcb 0 2024-04-16T14:35:40.619 INFO:tasks.workunit.client.1.smithi115.stdout:8/580: rename d0/db/d10/d17/d2c/d61 to d0/db/d10/d17/d2c/d52/d6c/db8 0 2024-04-16T14:35:40.620 INFO:tasks.workunit.client.1.smithi115.stdout:1/513: mknod df/d2d/ca8 0 2024-04-16T14:35:40.621 INFO:tasks.workunit.client.1.smithi115.stdout:3/611: mkdir dc/d24/d80/dcc 0 2024-04-16T14:35:40.622 INFO:tasks.workunit.client.1.smithi115.stdout:8/581: creat d0/db/d10/d17/d2c/d52/d6c/d71/fb9 x:0 0 0 2024-04-16T14:35:40.623 INFO:tasks.workunit.client.1.smithi115.stdout:3/612: creat dc/d24/fcd x:0 0 0 2024-04-16T14:35:40.624 INFO:tasks.workunit.client.1.smithi115.stdout:8/582: creat d0/db/d10/d25/fba x:0 0 0 2024-04-16T14:35:40.625 INFO:tasks.workunit.client.1.smithi115.stdout:8/583: mkdir d0/db/dbb 0 2024-04-16T14:35:40.625 INFO:tasks.workunit.client.1.smithi115.stdout:8/584: creat d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/fbc x:0 0 0 2024-04-16T14:35:40.628 INFO:tasks.workunit.client.1.smithi115.stdout:8/585: mkdir d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/d8a/d94/dbd 0 2024-04-16T14:35:40.628 INFO:tasks.workunit.client.1.smithi115.stdout:3/613: write dc/fe [207174,44367] 0 2024-04-16T14:35:40.630 INFO:tasks.workunit.client.1.smithi115.stdout:3/614: symlink dc/d29/d77/lce 0 2024-04-16T14:35:40.630 INFO:tasks.workunit.client.1.smithi115.stdout:3/615: chown dc/l28 237013730 1 2024-04-16T14:35:40.630 INFO:tasks.workunit.client.1.smithi115.stdout:3/616: chown dc/d24/d33/d4b/da3/d69/fb2 435 1 2024-04-16T14:35:40.631 INFO:tasks.workunit.client.1.smithi115.stdout:3/617: link dc/d29/d39/d86/c9a dc/ccf 0 2024-04-16T14:35:40.632 INFO:tasks.workunit.client.1.smithi115.stdout:3/618: truncate dc/d29/d39/f76 5542758 0 2024-04-16T14:35:40.633 INFO:tasks.workunit.client.1.smithi115.stdout:6/581: sync 2024-04-16T14:35:40.634 INFO:tasks.workunit.client.1.smithi115.stdout:2/599: sync 2024-04-16T14:35:40.634 INFO:tasks.workunit.client.1.smithi115.stdout:7/475: sync 2024-04-16T14:35:40.634 INFO:tasks.workunit.client.1.smithi115.stdout:2/600: chown d0/d1b/f99 1009199850 1 2024-04-16T14:35:40.636 INFO:tasks.workunit.client.1.smithi115.stdout:7/476: rename d0/d2/d94/l96 to d0/d24/d2b/d64/la4 0 2024-04-16T14:35:40.644 INFO:tasks.workunit.client.1.smithi115.stdout:6/582: rename d13/d1d/d87/cb8 to d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/d55/cc0 0 2024-04-16T14:35:40.644 INFO:tasks.workunit.client.1.smithi115.stdout:5/487: sync 2024-04-16T14:35:40.646 INFO:tasks.workunit.client.1.smithi115.stdout:5/488: mknod dc/d79/ca2 0 2024-04-16T14:35:40.646 INFO:tasks.workunit.client.1.smithi115.stdout:5/489: readlink dc/d15/d35/l5b 0 2024-04-16T14:35:40.647 INFO:tasks.workunit.client.1.smithi115.stdout:6/583: symlink d13/d1d/d87/lc1 0 2024-04-16T14:35:40.647 INFO:tasks.workunit.client.1.smithi115.stdout:6/584: truncate d13/d1d/d2b/d5f/d30/d43/da6/faf 773241 0 2024-04-16T14:35:40.647 INFO:tasks.workunit.client.1.smithi115.stdout:6/585: write d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/f9f [2326747,74537] 0 2024-04-16T14:35:40.648 INFO:tasks.workunit.client.1.smithi115.stdout:6/586: readlink d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/lb2 0 2024-04-16T14:35:40.648 INFO:tasks.workunit.client.0.smithi005.stdout:2/573: creat d0/d29/fc3 x:0 0 0 2024-04-16T14:35:40.654 INFO:tasks.workunit.client.0.smithi005.stdout:7/852: symlink d1/dc/d2f/d4f/l11d 0 2024-04-16T14:35:40.658 INFO:tasks.workunit.client.1.smithi115.stdout:1/514: dwrite df/d2d/f1e [0,4194304] 0 2024-04-16T14:35:40.659 INFO:tasks.workunit.client.1.smithi115.stdout:1/515: mkdir df/d13/d4d/d3e/d75/da9 0 2024-04-16T14:35:40.659 INFO:tasks.workunit.client.1.smithi115.stdout:1/516: creat df/d36/d3c/faa x:0 0 0 2024-04-16T14:35:40.660 INFO:tasks.workunit.client.1.smithi115.stdout:1/517: chown df/d2d/c6e 37290 1 2024-04-16T14:35:40.660 INFO:tasks.workunit.client.1.smithi115.stdout:1/518: fdatasync df/d2d/d83/f60 0 2024-04-16T14:35:40.660 INFO:tasks.workunit.client.0.smithi005.stdout:9/532: link d3/d12/d16/c8b d3/c95 0 2024-04-16T14:35:40.663 INFO:tasks.workunit.client.1.smithi115.stdout:5/490: dread dc/f26 [0,4194304] 0 2024-04-16T14:35:40.663 INFO:tasks.workunit.client.1.smithi115.stdout:1/519: creat df/d13/d4d/d3e/d75/da9/fab x:0 0 0 2024-04-16T14:35:40.663 INFO:tasks.workunit.client.1.smithi115.stdout:1/520: fdatasync df/d36/f3d 0 2024-04-16T14:35:40.665 INFO:tasks.workunit.client.1.smithi115.stdout:3/619: dwrite dc/d24/d33/d4b/d81/f92 [0,4194304] 0 2024-04-16T14:35:40.666 INFO:tasks.workunit.client.1.smithi115.stdout:7/477: dwrite d0/d1/f20 [0,4194304] 0 2024-04-16T14:35:40.669 INFO:tasks.workunit.client.1.smithi115.stdout:3/620: rmdir dc/d29/d77 39 2024-04-16T14:35:40.669 INFO:tasks.workunit.client.1.smithi115.stdout:3/621: fdatasync dc/d29/d39/fc6 0 2024-04-16T14:35:40.677 INFO:tasks.workunit.client.1.smithi115.stdout:5/491: write dc/d3d/d68/d7b/f84 [973802,36946] 0 2024-04-16T14:35:40.677 INFO:tasks.workunit.client.1.smithi115.stdout:5/492: stat dc/d15/d35/f48 0 2024-04-16T14:35:40.677 INFO:tasks.workunit.client.1.smithi115.stdout:2/601: dwrite d0/d47/d65/dad/f56 [0,4194304] 0 2024-04-16T14:35:40.681 INFO:tasks.workunit.client.1.smithi115.stdout:6/587: rmdir d13/d1d/d2b/d5f/d30 39 2024-04-16T14:35:40.681 INFO:tasks.workunit.client.1.smithi115.stdout:1/521: write df/d13/f16 [507012,45261] 0 2024-04-16T14:35:40.682 INFO:tasks.workunit.client.1.smithi115.stdout:1/522: read df/f14 [229106,119230] 0 2024-04-16T14:35:40.682 INFO:tasks.workunit.client.1.smithi115.stdout:1/523: chown df/d35 42930720 1 2024-04-16T14:35:40.684 INFO:tasks.workunit.client.1.smithi115.stdout:2/602: creat d0/d47/d65/dad/dbb/d11/d36/fc1 x:0 0 0 2024-04-16T14:35:40.696 INFO:tasks.workunit.client.1.smithi115.stdout:6/588: write d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/d55/fa5 [1623805,125872] 0 2024-04-16T14:35:40.698 INFO:tasks.workunit.client.0.smithi005.stdout:7/853: dwrite d1/d49/d74/d77/d57/fae [0,4194304] 0 2024-04-16T14:35:40.702 INFO:tasks.workunit.client.0.smithi005.stdout:7/854: link d1/d49/d74/d77/d57/c4b d1/d49/d74/d77/d22/d27/df4/c11e 0 2024-04-16T14:35:40.702 INFO:tasks.workunit.client.0.smithi005.stdout:7/855: fdatasync d1/dc/d2f/dbd/fd3 0 2024-04-16T14:35:40.703 INFO:tasks.workunit.client.0.smithi005.stdout:7/856: symlink d1/d49/d74/d77/d22/da0/dbb/dcb/l11f 0 2024-04-16T14:35:40.704 INFO:tasks.workunit.client.0.smithi005.stdout:7/857: dread - d1/dc/d2f/d4f/f92 zero size 2024-04-16T14:35:40.704 INFO:tasks.workunit.client.0.smithi005.stdout:7/858: readlink d1/d49/d74/d77/d22/db0/l109 0 2024-04-16T14:35:40.704 INFO:tasks.workunit.client.0.smithi005.stdout:7/859: getdents d1/d49/d74/d77/d22/d27/d117 0 2024-04-16T14:35:40.704 INFO:tasks.workunit.client.1.smithi115.stdout:1/524: write df/d2d/f41 [3971652,123951] 0 2024-04-16T14:35:40.705 INFO:tasks.workunit.client.0.smithi005.stdout:7/860: mknod d1/d85/d96/de1/c120 0 2024-04-16T14:35:40.712 INFO:tasks.workunit.client.0.smithi005.stdout:7/861: write d1/d49/f5f [3016713,95233] 0 2024-04-16T14:35:40.712 INFO:tasks.workunit.client.0.smithi005.stdout:7/862: creat d1/d8a/f121 x:0 0 0 2024-04-16T14:35:40.713 INFO:tasks.workunit.client.0.smithi005.stdout:7/863: unlink d1/d49/d74/d77/d57/fae 0 2024-04-16T14:35:40.721 INFO:tasks.workunit.client.0.smithi005.stdout:9/533: dwrite d3/d12/f52 [0,4194304] 0 2024-04-16T14:35:40.721 INFO:tasks.workunit.client.1.smithi115.stdout:7/478: dwrite d0/d2/d3a/d30/d6b/da2/d81/f92 [0,4194304] 0 2024-04-16T14:35:40.721 INFO:tasks.workunit.client.1.smithi115.stdout:7/479: fsync d0/d1/f1f 0 2024-04-16T14:35:40.722 INFO:tasks.workunit.client.1.smithi115.stdout:7/480: truncate d0/d2/d3a/d30/f74 1111917 0 2024-04-16T14:35:40.722 INFO:tasks.workunit.client.1.smithi115.stdout:7/481: stat d0/d2/d3a/d30/l70 0 2024-04-16T14:35:40.724 INFO:tasks.workunit.client.1.smithi115.stdout:5/493: dwrite dc/d3d/d41/f46 [0,4194304] 0 2024-04-16T14:35:40.725 INFO:tasks.workunit.client.1.smithi115.stdout:3/622: dwrite dc/d24/f6f [0,4194304] 0 2024-04-16T14:35:40.725 INFO:tasks.workunit.client.1.smithi115.stdout:2/603: dwrite d0/d1b/f99 [0,4194304] 0 2024-04-16T14:35:40.725 INFO:tasks.workunit.client.1.smithi115.stdout:2/604: stat d0/d4/f3a 0 2024-04-16T14:35:40.725 INFO:tasks.workunit.client.1.smithi115.stdout:2/605: chown d0/d4/d24/da0 152844 1 2024-04-16T14:35:40.725 INFO:tasks.workunit.client.1.smithi115.stdout:2/606: truncate d0/d47/d65/dad/dbb/d11/fb7 949307 0 2024-04-16T14:35:40.726 INFO:tasks.workunit.client.0.smithi005.stdout:9/534: rmdir d3/d12/d16/d46/d47 39 2024-04-16T14:35:40.726 INFO:tasks.workunit.client.0.smithi005.stdout:9/535: read d3/d49/d4b/d55/f5d [626017,129033] 0 2024-04-16T14:35:40.728 INFO:tasks.workunit.client.0.smithi005.stdout:9/536: truncate d3/d12/d2b/f4f 5789627 0 2024-04-16T14:35:40.730 INFO:tasks.workunit.client.0.smithi005.stdout:9/537: creat d3/d49/d4b/d55/f96 x:0 0 0 2024-04-16T14:35:40.731 INFO:tasks.workunit.client.1.smithi115.stdout:7/482: write d0/d1/d3b/d49/f91 [3105026,101793] 0 2024-04-16T14:35:40.731 INFO:tasks.workunit.client.1.smithi115.stdout:7/483: stat d0/d1/d3b/d3f 0 2024-04-16T14:35:40.731 INFO:tasks.workunit.client.0.smithi005.stdout:9/538: mknod d3/d12/c97 0 2024-04-16T14:35:40.734 INFO:tasks.workunit.client.0.smithi005.stdout:7/864: dwrite d1/d49/d74/d77/d57/d47/daa/fe9 [0,4194304] 0 2024-04-16T14:35:40.734 INFO:tasks.workunit.client.1.smithi115.stdout:5/494: dread dc/d3d/d68/d7b/f84 [0,4194304] 0 2024-04-16T14:35:40.737 INFO:tasks.workunit.client.1.smithi115.stdout:3/623: unlink dc/d29/d77/l96 0 2024-04-16T14:35:40.739 INFO:tasks.workunit.client.0.smithi005.stdout:9/539: dread d3/d12/d2b/f44 [0,4194304] 0 2024-04-16T14:35:40.740 INFO:tasks.workunit.client.0.smithi005.stdout:9/540: write d3/d12/d16/d86/f87 [216703,49957] 0 2024-04-16T14:35:40.743 INFO:tasks.workunit.client.0.smithi005.stdout:7/865: write d1/dc/f7e [1537889,55329] 0 2024-04-16T14:35:40.743 INFO:tasks.workunit.client.0.smithi005.stdout:1/936: sync 2024-04-16T14:35:40.744 INFO:tasks.workunit.client.0.smithi005.stdout:1/937: write d2/d74/dd7/d11f/d51/d132/dbc/fba [293073,69196] 0 2024-04-16T14:35:40.745 INFO:tasks.workunit.client.0.smithi005.stdout:7/866: unlink d1/f55 0 2024-04-16T14:35:40.745 INFO:tasks.workunit.client.0.smithi005.stdout:7/867: chown d1/dc/d2f/la1 4451 1 2024-04-16T14:35:40.747 INFO:tasks.workunit.client.0.smithi005.stdout:7/868: creat d1/dc/d2f/dbd/f122 x:0 0 0 2024-04-16T14:35:40.747 INFO:tasks.workunit.client.0.smithi005.stdout:7/869: fsync d1/d49/d74/d77/ffb 0 2024-04-16T14:35:40.747 INFO:tasks.workunit.client.0.smithi005.stdout:7/870: write d1/d49/d74/d77/d22/f8c [5010673,52609] 0 2024-04-16T14:35:40.747 INFO:tasks.workunit.client.0.smithi005.stdout:7/871: stat d1/d49/d74/d77/d57/d47/d8d 0 2024-04-16T14:35:40.747 INFO:tasks.workunit.client.0.smithi005.stdout:7/872: chown d1/dc/d2f/dbd/cf6 3467156 1 2024-04-16T14:35:40.747 INFO:tasks.workunit.client.0.smithi005.stdout:7/873: mknod d1/d49/d74/c123 0 2024-04-16T14:35:40.747 INFO:tasks.workunit.client.0.smithi005.stdout:7/874: write d1/d49/d74/d77/d22/d27/d3a/ffe [276678,114515] 0 2024-04-16T14:35:40.748 INFO:tasks.workunit.client.1.smithi115.stdout:3/624: mkdir dc/d29/d39/d86/dd0 0 2024-04-16T14:35:40.750 INFO:tasks.workunit.client.1.smithi115.stdout:2/607: dread d0/fd [0,4194304] 0 2024-04-16T14:35:40.750 INFO:tasks.workunit.client.1.smithi115.stdout:2/608: stat d0/d4/d24/d10/c31 0 2024-04-16T14:35:40.751 INFO:tasks.workunit.client.1.smithi115.stdout:2/609: symlink d0/d4/d24/d21/d59/lc2 0 2024-04-16T14:35:40.751 INFO:tasks.workunit.client.1.smithi115.stdout:2/610: creat d0/d47/d65/dad/dbb/d11/d36/fc3 x:0 0 0 2024-04-16T14:35:40.752 INFO:tasks.workunit.client.1.smithi115.stdout:3/625: dread dc/f23 [0,4194304] 0 2024-04-16T14:35:40.752 INFO:tasks.workunit.client.1.smithi115.stdout:3/626: write f6 [1163859,59943] 0 2024-04-16T14:35:40.753 INFO:tasks.workunit.client.1.smithi115.stdout:2/611: truncate d0/d47/d65/dad/dbb/d11/f12 2693708 0 2024-04-16T14:35:40.755 INFO:tasks.workunit.client.1.smithi115.stdout:3/627: creat dc/d29/d39/d86/dd0/fd1 x:0 0 0 2024-04-16T14:35:40.755 INFO:tasks.workunit.client.1.smithi115.stdout:3/628: truncate dc/d29/d39/fc6 689311 0 2024-04-16T14:35:40.757 INFO:tasks.workunit.client.1.smithi115.stdout:3/629: rename dc/d29/d4d/d56/d7e/f94 to dc/d24/fd2 0 2024-04-16T14:35:40.757 INFO:tasks.workunit.client.1.smithi115.stdout:3/630: write dc/d24/f82 [2430740,80467] 0 2024-04-16T14:35:40.757 INFO:tasks.workunit.client.1.smithi115.stdout:3/631: fdatasync dc/d29/f85 0 2024-04-16T14:35:40.757 INFO:tasks.workunit.client.1.smithi115.stdout:3/632: dread - dc/d24/d33/fb5 zero size 2024-04-16T14:35:40.758 INFO:tasks.workunit.client.1.smithi115.stdout:3/633: mkdir dc/d24/d33/d4b/dd3 0 2024-04-16T14:35:40.759 INFO:tasks.workunit.client.1.smithi115.stdout:3/634: write dc/d29/f85 [716033,104726] 0 2024-04-16T14:35:40.763 INFO:tasks.workunit.client.1.smithi115.stdout:7/484: dwrite d0/d2/d3a/d30/d79/d95/fa0 [0,4194304] 0 2024-04-16T14:35:40.765 INFO:tasks.workunit.client.1.smithi115.stdout:5/495: dwrite dc/d15/f5f [0,4194304] 0 2024-04-16T14:35:40.768 INFO:tasks.workunit.client.1.smithi115.stdout:7/485: unlink d0/d2/l6d 0 2024-04-16T14:35:40.768 INFO:tasks.workunit.client.1.smithi115.stdout:7/486: write d0/d24/d2b/d64/f71 [106476,125038] 0 2024-04-16T14:35:40.768 INFO:tasks.workunit.client.1.smithi115.stdout:7/487: truncate d0/d24/d2b/fa1 342189 0 2024-04-16T14:35:40.769 INFO:tasks.workunit.client.0.smithi005.stdout:9/541: dwrite d3/d12/f30 [0,4194304] 0 2024-04-16T14:35:40.770 INFO:tasks.workunit.client.1.smithi115.stdout:3/635: write dc/f22 [2059079,36579] 0 2024-04-16T14:35:40.770 INFO:tasks.workunit.client.1.smithi115.stdout:3/636: chown dc/d24/d33/fb5 481386 1 2024-04-16T14:35:40.771 INFO:tasks.workunit.client.1.smithi115.stdout:7/488: link d0/d1/d3b/d3f/f8d d0/fa5 0 2024-04-16T14:35:40.779 INFO:tasks.workunit.client.1.smithi115.stdout:2/612: dwrite d0/d4/d24/d23/d80/fa6 [0,4194304] 0 2024-04-16T14:35:40.787 INFO:tasks.workunit.client.1.smithi115.stdout:2/613: rmdir d0/d47/d65/d61/dae 39 2024-04-16T14:35:40.787 INFO:tasks.workunit.client.1.smithi115.stdout:2/614: mknod d0/d47/cc4 0 2024-04-16T14:35:40.791 INFO:tasks.workunit.client.1.smithi115.stdout:7/489: read d0/d1/f20 [3161079,61156] 0 2024-04-16T14:35:40.791 INFO:tasks.workunit.client.1.smithi115.stdout:2/615: rename d0/d4/d24/d21/cb3 to d0/d4/d24/d23/d83/cc5 0 2024-04-16T14:35:40.791 INFO:tasks.workunit.client.1.smithi115.stdout:2/616: truncate d0/d1b/f41 4841986 0 2024-04-16T14:35:40.791 INFO:tasks.workunit.client.1.smithi115.stdout:3/637: dread dc/d24/d33/d4b/f4c [0,4194304] 0 2024-04-16T14:35:40.792 INFO:tasks.workunit.client.1.smithi115.stdout:2/617: symlink d0/d4/d24/d23/lc6 0 2024-04-16T14:35:40.802 INFO:tasks.workunit.client.1.smithi115.stdout:7/490: dread d0/d2/d3a/d30/f32 [0,4194304] 0 2024-04-16T14:35:40.805 INFO:tasks.workunit.client.1.smithi115.stdout:7/491: creat d0/d2/d3a/d30/d6b/da2/d81/fa6 x:0 0 0 2024-04-16T14:35:40.806 INFO:tasks.workunit.client.1.smithi115.stdout:7/492: mkdir d0/d2/d94/da7 0 2024-04-16T14:35:40.821 INFO:tasks.workunit.client.1.smithi115.stdout:4/507: sync 2024-04-16T14:35:40.822 INFO:tasks.workunit.client.1.smithi115.stdout:4/508: mkdir d1/d15/d31/d89 0 2024-04-16T14:35:40.822 INFO:tasks.workunit.client.1.smithi115.stdout:4/509: fdatasync d1/d15/d17/f26 0 2024-04-16T14:35:40.823 INFO:tasks.workunit.client.1.smithi115.stdout:4/510: truncate d1/d15/d1e/f65 325972 0 2024-04-16T14:35:40.823 INFO:tasks.workunit.client.1.smithi115.stdout:4/511: getdents d1/d15/d24 0 2024-04-16T14:35:40.824 INFO:tasks.workunit.client.0.smithi005.stdout:7/875: dwrite d1/d49/d74/d77/d22/f8c [0,4194304] 0 2024-04-16T14:35:40.825 INFO:tasks.workunit.client.1.smithi115.stdout:4/512: dread d1/f6b [0,4194304] 0 2024-04-16T14:35:40.825 INFO:tasks.workunit.client.1.smithi115.stdout:4/513: chown d1/d15/d17/c6d 4419953 1 2024-04-16T14:35:40.826 INFO:tasks.workunit.client.0.smithi005.stdout:7/876: creat d1/d49/d74/d77/d22/d27/df4/f124 x:0 0 0 2024-04-16T14:35:40.826 INFO:tasks.workunit.client.1.smithi115.stdout:4/514: creat d1/d15/d17/f8a x:0 0 0 2024-04-16T14:35:40.832 INFO:tasks.workunit.client.0.smithi005.stdout:0/666: sync 2024-04-16T14:35:40.832 INFO:tasks.workunit.client.0.smithi005.stdout:6/930: sync 2024-04-16T14:35:40.833 INFO:tasks.workunit.client.0.smithi005.stdout:7/877: dread d1/d49/d74/d77/d22/da0/fe8 [0,4194304] 0 2024-04-16T14:35:40.834 INFO:tasks.workunit.client.0.smithi005.stdout:0/667: mknod da/df/d1b/d3a/d96/cdd 0 2024-04-16T14:35:40.834 INFO:tasks.workunit.client.0.smithi005.stdout:0/668: write da/df/d1b/d3a/d53/d5a/d67/d79/f82 [237054,57980] 0 2024-04-16T14:35:40.834 INFO:tasks.workunit.client.0.smithi005.stdout:0/669: chown da/df/d50/c51 0 1 2024-04-16T14:35:40.836 INFO:tasks.workunit.client.0.smithi005.stdout:9/542: dwrite d3/d49/d4b/d55/f57 [0,4194304] 0 2024-04-16T14:35:40.836 INFO:tasks.workunit.client.0.smithi005.stdout:7/878: unlink d1/d49/d74/d77/d22/d27/d3a/c73 0 2024-04-16T14:35:40.838 INFO:tasks.workunit.client.0.smithi005.stdout:0/670: unlink da/df/d1b/d71/fa0 0 2024-04-16T14:35:40.839 INFO:tasks.workunit.client.0.smithi005.stdout:7/879: dread d1/d49/d74/d77/d57/d47/d8e/fad [0,4194304] 0 2024-04-16T14:35:40.839 INFO:tasks.workunit.client.0.smithi005.stdout:7/880: write d1/dc/f18 [3481770,8488] 0 2024-04-16T14:35:40.841 INFO:tasks.workunit.client.0.smithi005.stdout:0/671: creat da/df/d1b/d24/d75/fde x:0 0 0 2024-04-16T14:35:40.841 INFO:tasks.workunit.client.0.smithi005.stdout:0/672: write da/df/d1b/d24/d75/fde [353119,13519] 0 2024-04-16T14:35:40.842 INFO:tasks.workunit.client.0.smithi005.stdout:7/881: creat d1/d49/d74/d77/d57/f125 x:0 0 0 2024-04-16T14:35:40.842 INFO:tasks.workunit.client.0.smithi005.stdout:7/882: fdatasync d1/d49/d74/d77/d22/d27/f45 0 2024-04-16T14:35:40.842 INFO:tasks.workunit.client.0.smithi005.stdout:0/673: mkdir da/df/d1b/d71/ddf 0 2024-04-16T14:35:40.843 INFO:tasks.workunit.client.0.smithi005.stdout:0/674: chown da/c41 4 1 2024-04-16T14:35:40.844 INFO:tasks.workunit.client.0.smithi005.stdout:7/883: link d1/d49/d74/d77/fc0 d1/d49/d74/ddf/f126 0 2024-04-16T14:35:40.845 INFO:tasks.workunit.client.0.smithi005.stdout:7/884: mknod d1/d49/d74/d77/d57/c127 0 2024-04-16T14:35:40.846 INFO:tasks.workunit.client.1.smithi115.stdout:5/496: dwrite dc/d15/f17 [0,4194304] 0 2024-04-16T14:35:40.846 INFO:tasks.workunit.client.0.smithi005.stdout:9/543: dread d3/d12/d16/d46/d47/d60/f75 [0,4194304] 0 2024-04-16T14:35:40.847 INFO:tasks.workunit.client.0.smithi005.stdout:7/885: getdents d1/d85 0 2024-04-16T14:35:40.847 INFO:tasks.workunit.client.0.smithi005.stdout:7/886: write d1/d85/d96/de1/ffd [66330,64472] 0 2024-04-16T14:35:40.848 INFO:tasks.workunit.client.0.smithi005.stdout:9/544: mknod d3/d12/d16/c98 0 2024-04-16T14:35:40.849 INFO:tasks.workunit.client.0.smithi005.stdout:7/887: mkdir d1/d82/d128 0 2024-04-16T14:35:40.851 INFO:tasks.workunit.client.0.smithi005.stdout:0/675: dread da/df/d1b/f47 [0,4194304] 0 2024-04-16T14:35:40.851 INFO:tasks.workunit.client.0.smithi005.stdout:0/676: dread da/df/d1b/d24/f38 [0,4194304] 0 2024-04-16T14:35:40.852 INFO:tasks.workunit.client.0.smithi005.stdout:0/677: readlink da/df/d1b/d24/d75/l77 0 2024-04-16T14:35:40.853 INFO:tasks.workunit.client.0.smithi005.stdout:7/888: rename d1/d49/cb6 to d1/d49/d74/d77/d22/d27/df4/c129 0 2024-04-16T14:35:40.856 INFO:tasks.workunit.client.1.smithi115.stdout:5/497: dread dc/d3d/f5a [0,4194304] 0 2024-04-16T14:35:40.856 INFO:tasks.workunit.client.0.smithi005.stdout:0/678: rename da/cc4 to da/df/d1b/d3a/d53/dbc/ce0 0 2024-04-16T14:35:40.857 INFO:tasks.workunit.client.1.smithi115.stdout:2/618: dwrite d0/d4/d24/d23/f9c [0,4194304] 0 2024-04-16T14:35:40.857 INFO:tasks.workunit.client.1.smithi115.stdout:2/619: write d0/d1b/f41 [5481184,124550] 0 2024-04-16T14:35:40.857 INFO:tasks.workunit.client.1.smithi115.stdout:2/620: dread - d0/d47/d65/d61/dae/f9e zero size 2024-04-16T14:35:40.857 INFO:tasks.workunit.client.1.smithi115.stdout:2/621: write d0/fa1 [139447,34398] 0 2024-04-16T14:35:40.858 INFO:tasks.workunit.client.1.smithi115.stdout:3/638: dwrite dc/d24/d33/d4b/d81/f92 [0,4194304] 0 2024-04-16T14:35:40.858 INFO:tasks.workunit.client.1.smithi115.stdout:3/639: fsync dc/d29/f48 0 2024-04-16T14:35:40.858 INFO:tasks.workunit.client.1.smithi115.stdout:2/622: read d0/d47/d65/f7b [223616,25314] 0 2024-04-16T14:35:40.858 INFO:tasks.workunit.client.1.smithi115.stdout:5/498: mkdir dc/d5d/d81/d9a/da3 0 2024-04-16T14:35:40.862 INFO:tasks.workunit.client.0.smithi005.stdout:0/679: creat da/df/d26/da9/dcb/dd8/fe1 x:0 0 0 2024-04-16T14:35:40.862 INFO:tasks.workunit.client.0.smithi005.stdout:6/931: dwrite d2/d3f/d47/d84/da5/fc9 [0,4194304] 0 2024-04-16T14:35:40.862 INFO:tasks.workunit.client.1.smithi115.stdout:4/515: dwrite d1/d15/d1e/f5d [4194304,4194304] 0 2024-04-16T14:35:40.863 INFO:tasks.workunit.client.1.smithi115.stdout:7/493: dwrite d0/d1/d3b/d3e/f5f [0,4194304] 0 2024-04-16T14:35:40.863 INFO:tasks.workunit.client.1.smithi115.stdout:7/494: stat d0/d2/d3a/d30 0 2024-04-16T14:35:40.863 INFO:tasks.workunit.client.1.smithi115.stdout:3/640: rename dc/d24/d36/l41 to dc/d29/d4d/d56/d8a/ld4 0 2024-04-16T14:35:40.863 INFO:tasks.workunit.client.1.smithi115.stdout:3/641: creat dc/d24/d33/d4b/da3/d69/fd5 x:0 0 0 2024-04-16T14:35:40.864 INFO:tasks.workunit.client.1.smithi115.stdout:3/642: fdatasync dc/d24/d33/fb5 0 2024-04-16T14:35:40.864 INFO:tasks.workunit.client.1.smithi115.stdout:3/643: chown dc/c1f 1 1 2024-04-16T14:35:40.864 INFO:tasks.workunit.client.0.smithi005.stdout:9/545: write d3/d77/f88 [3889865,15627] 0 2024-04-16T14:35:40.865 INFO:tasks.workunit.client.1.smithi115.stdout:4/516: mkdir d1/d15/d31/d42/d8b 0 2024-04-16T14:35:40.866 INFO:tasks.workunit.client.0.smithi005.stdout:7/889: unlink d1/d49/d74/d77/d22/f8c 0 2024-04-16T14:35:40.867 INFO:tasks.workunit.client.0.smithi005.stdout:9/546: dread d3/d12/d16/d46/d47/d60/f75 [0,4194304] 0 2024-04-16T14:35:40.872 INFO:tasks.workunit.client.1.smithi115.stdout:2/623: write d0/d1b/f38 [8281782,127027] 0 2024-04-16T14:35:40.873 INFO:tasks.workunit.client.0.smithi005.stdout:0/680: rename da/df/d1b/d24/d75/l88 to da/df/d1b/db6/le2 0 2024-04-16T14:35:40.873 INFO:tasks.workunit.client.1.smithi115.stdout:7/495: dread d0/d1/d3b/d49/f91 [0,4194304] 0 2024-04-16T14:35:40.874 INFO:tasks.workunit.client.1.smithi115.stdout:7/496: write d0/d2/d3a/d30/d6b/da2/d81/f92 [4513552,38875] 0 2024-04-16T14:35:40.874 INFO:tasks.workunit.client.1.smithi115.stdout:7/497: write d0/d1/d3b/d3e/f54 [3962175,31709] 0 2024-04-16T14:35:40.877 INFO:tasks.workunit.client.1.smithi115.stdout:2/624: dread d0/d4/d24/d10/f7e [0,4194304] 0 2024-04-16T14:35:40.877 INFO:tasks.workunit.client.1.smithi115.stdout:2/625: fdatasync d0/d4/d24/f44 0 2024-04-16T14:35:40.879 INFO:tasks.workunit.client.1.smithi115.stdout:4/517: rmdir d1/d15/d31/d42 39 2024-04-16T14:35:40.883 INFO:tasks.workunit.client.1.smithi115.stdout:3/644: dread dc/d24/f82 [0,4194304] 0 2024-04-16T14:35:40.884 INFO:tasks.workunit.client.1.smithi115.stdout:4/518: creat d1/d15/d31/d42/d46/f8c x:0 0 0 2024-04-16T14:35:40.885 INFO:tasks.workunit.client.1.smithi115.stdout:3/645: unlink dc/d29/d39/d86/dd0/fd1 0 2024-04-16T14:35:40.892 INFO:tasks.workunit.client.1.smithi115.stdout:2/626: write d0/d4/d24/d23/f7c [2965776,52086] 0 2024-04-16T14:35:40.892 INFO:tasks.workunit.client.1.smithi115.stdout:2/627: chown d0/d4/d24/d10/f89 16136374 1 2024-04-16T14:35:40.892 INFO:tasks.workunit.client.0.smithi005.stdout:9/547: rename d3/l9 to d3/d77/l99 0 2024-04-16T14:35:40.892 INFO:tasks.workunit.client.0.smithi005.stdout:9/548: truncate d3/d12/d16/f39 5181666 0 2024-04-16T14:35:40.894 INFO:tasks.workunit.client.0.smithi005.stdout:9/549: mkdir d3/d49/d4b/d5c/d65/d9a 0 2024-04-16T14:35:40.895 INFO:tasks.workunit.client.1.smithi115.stdout:4/519: write d1/d15/d31/d42/d46/f50 [1854329,70434] 0 2024-04-16T14:35:40.896 INFO:tasks.workunit.client.1.smithi115.stdout:4/520: rmdir d1/d2/d86 0 2024-04-16T14:35:40.897 INFO:tasks.workunit.client.0.smithi005.stdout:9/550: creat d3/d12/d16/d46/f9b x:0 0 0 2024-04-16T14:35:40.899 INFO:tasks.workunit.client.1.smithi115.stdout:4/521: getdents d1/d15/d31/d42 0 2024-04-16T14:35:40.900 INFO:tasks.workunit.client.1.smithi115.stdout:4/522: symlink d1/d15/d31/d89/l8d 0 2024-04-16T14:35:40.904 INFO:tasks.workunit.client.1.smithi115.stdout:2/628: write d0/d4/d24/f19 [1050246,4702] 0 2024-04-16T14:35:40.904 INFO:tasks.workunit.client.1.smithi115.stdout:2/629: fsync d0/d47/d65/dad/f56 0 2024-04-16T14:35:40.904 INFO:tasks.workunit.client.1.smithi115.stdout:2/630: chown d0/d47/d65/dad/dbb/laf 800882861 1 2024-04-16T14:35:40.904 INFO:tasks.workunit.client.1.smithi115.stdout:2/631: truncate d0/d47/d65/d61/dae/f6f 782968 0 2024-04-16T14:35:40.906 INFO:tasks.workunit.client.1.smithi115.stdout:2/632: mkdir d0/d4/d24/dc7 0 2024-04-16T14:35:40.911 INFO:tasks.workunit.client.1.smithi115.stdout:8/586: sync 2024-04-16T14:35:40.911 INFO:tasks.workunit.client.1.smithi115.stdout:8/587: stat d0/db/d10/d17/d22/f6f 0 2024-04-16T14:35:40.911 INFO:tasks.workunit.client.1.smithi115.stdout:9/579: sync 2024-04-16T14:35:40.912 INFO:tasks.workunit.client.1.smithi115.stdout:0/457: sync 2024-04-16T14:35:40.914 INFO:tasks.workunit.client.0.smithi005.stdout:9/551: dread d3/d12/d16/f19 [0,4194304] 0 2024-04-16T14:35:40.914 INFO:tasks.workunit.client.0.smithi005.stdout:9/552: read - d3/d49/f66 zero size 2024-04-16T14:35:40.914 INFO:tasks.workunit.client.1.smithi115.stdout:8/588: creat d0/db/d10/d17/d2c/d52/d6c/db8/d64/d83/da2/fbe x:0 0 0 2024-04-16T14:35:40.914 INFO:tasks.workunit.client.1.smithi115.stdout:8/589: chown d0/db/d10/d17/d2c/d52/d74/c88 1 1 2024-04-16T14:35:40.915 INFO:tasks.workunit.client.1.smithi115.stdout:9/580: rmdir d1/d7f 39 2024-04-16T14:35:40.915 INFO:tasks.workunit.client.1.smithi115.stdout:9/581: fsync d1/d6/d2d/d3d/d50/f56 0 2024-04-16T14:35:40.916 INFO:tasks.workunit.client.1.smithi115.stdout:0/458: creat d6/d10/d12/d1f/d36/fa2 x:0 0 0 2024-04-16T14:35:40.917 INFO:tasks.workunit.client.1.smithi115.stdout:8/590: dread d0/f3 [0,4194304] 0 2024-04-16T14:35:40.917 INFO:tasks.workunit.client.1.smithi115.stdout:0/459: creat d6/d30/d8d/fa3 x:0 0 0 2024-04-16T14:35:40.918 INFO:tasks.workunit.client.1.smithi115.stdout:8/591: mkdir d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/d8a/d94/dbf 0 2024-04-16T14:35:40.918 INFO:tasks.workunit.client.1.smithi115.stdout:8/592: dread - d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/fbc zero size 2024-04-16T14:35:40.918 INFO:tasks.workunit.client.1.smithi115.stdout:0/460: chown d6/d10/d12/d5f/c62 87966 1 2024-04-16T14:35:40.919 INFO:tasks.workunit.client.1.smithi115.stdout:8/593: mkdir d0/db/d10/d25/d7c/dc0 0 2024-04-16T14:35:40.919 INFO:tasks.workunit.client.1.smithi115.stdout:8/594: write d0/db/d10/d17/d2c/d52/d6c/db8/d64/f68 [1026791,105188] 0 2024-04-16T14:35:40.921 INFO:tasks.workunit.client.0.smithi005.stdout:3/715: sync 2024-04-16T14:35:40.921 INFO:tasks.workunit.client.0.smithi005.stdout:2/574: sync 2024-04-16T14:35:40.921 INFO:tasks.workunit.client.0.smithi005.stdout:8/739: sync 2024-04-16T14:35:40.921 INFO:tasks.workunit.client.0.smithi005.stdout:5/773: sync 2024-04-16T14:35:40.921 INFO:tasks.workunit.client.0.smithi005.stdout:8/740: write d5/d7b/da8/db7/d8a/da1/d3d/d7f/fbe [255198,67092] 0 2024-04-16T14:35:40.921 INFO:tasks.workunit.client.0.smithi005.stdout:2/575: write d0/d4/f62 [264447,66074] 0 2024-04-16T14:35:40.921 INFO:tasks.workunit.client.0.smithi005.stdout:8/741: readlink d5/d7b/da8/db7/l95 0 2024-04-16T14:35:40.922 INFO:tasks.workunit.client.1.smithi115.stdout:6/589: sync 2024-04-16T14:35:40.923 INFO:tasks.workunit.client.0.smithi005.stdout:3/716: mkdir d2/d17/d46/d75/d9b/dbd/dee 0 2024-04-16T14:35:40.923 INFO:tasks.workunit.client.0.smithi005.stdout:0/681: dwrite da/df/d1b/d24/d75/fde [0,4194304] 0 2024-04-16T14:35:40.923 INFO:tasks.workunit.client.0.smithi005.stdout:0/682: readlink da/df/d26/l3c 0 2024-04-16T14:35:40.923 INFO:tasks.workunit.client.0.smithi005.stdout:7/890: dwrite d1/d49/d74/d77/d57/f125 [0,4194304] 0 2024-04-16T14:35:40.923 INFO:tasks.workunit.client.0.smithi005.stdout:6/932: dwrite d2/d20/d3c/dcf/f129 [0,4194304] 0 2024-04-16T14:35:40.923 INFO:tasks.workunit.client.0.smithi005.stdout:6/933: chown d2/d3f/d47/d84/f135 2840587 1 2024-04-16T14:35:40.924 INFO:tasks.workunit.client.0.smithi005.stdout:8/742: creat d5/d7b/da8/db7/d8a/da1/d3d/dba/dcd/f104 x:0 0 0 2024-04-16T14:35:40.926 INFO:tasks.workunit.client.0.smithi005.stdout:3/717: symlink d2/lef 0 2024-04-16T14:35:40.926 INFO:tasks.workunit.client.0.smithi005.stdout:3/718: creat d2/d9/d7d/ff0 x:0 0 0 2024-04-16T14:35:40.926 INFO:tasks.workunit.client.1.smithi115.stdout:3/646: dwrite dc/d24/d36/d60/dae/fb7 [0,4194304] 0 2024-04-16T14:35:40.927 INFO:tasks.workunit.client.1.smithi115.stdout:3/647: chown dc/d29/d39/d86/dd0 590 1 2024-04-16T14:35:40.927 INFO:tasks.workunit.client.1.smithi115.stdout:3/648: stat dc/d24/d33/d4b/d81/fb6 0 2024-04-16T14:35:40.927 INFO:tasks.workunit.client.1.smithi115.stdout:3/649: dread - dc/d29/d39/d86/f89 zero size 2024-04-16T14:35:40.927 INFO:tasks.workunit.client.1.smithi115.stdout:3/650: write dc/d29/f48 [2016078,114181] 0 2024-04-16T14:35:40.928 INFO:tasks.workunit.client.0.smithi005.stdout:0/683: rmdir da/df/d26/d39/d55/d5c 39 2024-04-16T14:35:40.928 INFO:tasks.workunit.client.0.smithi005.stdout:0/684: chown da/df/d1b/d3a/d53/f8f 287141609 1 2024-04-16T14:35:40.929 INFO:tasks.workunit.client.1.smithi115.stdout:9/582: read d1/d6/d2d/d4b/d8f/f95 [1182774,28288] 0 2024-04-16T14:35:40.929 INFO:tasks.workunit.client.1.smithi115.stdout:9/583: fdatasync d1/d6/d2d/d3d/d49/fb6 0 2024-04-16T14:35:40.930 INFO:tasks.workunit.client.1.smithi115.stdout:4/523: dwrite d1/f4 [0,4194304] 0 2024-04-16T14:35:40.931 INFO:tasks.workunit.client.1.smithi115.stdout:3/651: mkdir dc/d29/d4d/d56/d98/dbe/dd6 0 2024-04-16T14:35:40.934 INFO:tasks.workunit.client.0.smithi005.stdout:7/891: rename d1/d49/d74/d77/d57/d47/l86 to d1/d49/d74/d77/d57/l12a 0 2024-04-16T14:35:40.934 INFO:tasks.workunit.client.1.smithi115.stdout:9/584: creat d1/d6/fcb x:0 0 0 2024-04-16T14:35:40.934 INFO:tasks.workunit.client.1.smithi115.stdout:9/585: chown d1/d6/d2d/d4b/d90/cb2 11527 1 2024-04-16T14:35:40.936 INFO:tasks.workunit.client.1.smithi115.stdout:4/524: creat d1/d15/f8e x:0 0 0 2024-04-16T14:35:40.936 INFO:tasks.workunit.client.1.smithi115.stdout:4/525: write d1/d15/d31/d42/d46/f50 [763051,14956] 0 2024-04-16T14:35:40.938 INFO:tasks.workunit.client.0.smithi005.stdout:6/934: symlink d2/d20/d33/d115/l139 0 2024-04-16T14:35:40.939 INFO:tasks.workunit.client.1.smithi115.stdout:9/586: getdents d1/d6/d2d/d3d/d49/d88 0 2024-04-16T14:35:40.940 INFO:tasks.workunit.client.1.smithi115.stdout:9/587: stat d1/d6/d2d/d3d/d49/fb6 0 2024-04-16T14:35:40.941 INFO:tasks.workunit.client.0.smithi005.stdout:8/743: symlink d5/d7b/da8/db7/d8a/da1/d3d/dba/l105 0 2024-04-16T14:35:40.942 INFO:tasks.workunit.client.1.smithi115.stdout:1/525: sync 2024-04-16T14:35:40.942 INFO:tasks.workunit.client.1.smithi115.stdout:1/526: readlink df/d13/d4d/d2c/d54/l8f 0 2024-04-16T14:35:40.944 INFO:tasks.workunit.client.0.smithi005.stdout:9/553: write d3/d12/d2b/f4f [1461976,116841] 0 2024-04-16T14:35:40.945 INFO:tasks.workunit.client.1.smithi115.stdout:1/527: symlink df/d13/d4d/d2c/d54/lac 0 2024-04-16T14:35:40.945 INFO:tasks.workunit.client.1.smithi115.stdout:1/528: truncate df/d35/d48/f8e 662430 0 2024-04-16T14:35:40.945 INFO:tasks.workunit.client.1.smithi115.stdout:1/529: write df/d13/f74 [1744740,93872] 0 2024-04-16T14:35:40.946 INFO:tasks.workunit.client.0.smithi005.stdout:0/685: symlink da/df/d26/d39/d55/d5c/le3 0 2024-04-16T14:35:40.946 INFO:tasks.workunit.client.0.smithi005.stdout:0/686: write da/df/d1b/d3a/d53/f8f [960118,23093] 0 2024-04-16T14:35:40.947 INFO:tasks.workunit.client.0.smithi005.stdout:7/892: getdents d1/d49/d74/d77/d57/d47/d8e 0 2024-04-16T14:35:40.947 INFO:tasks.workunit.client.0.smithi005.stdout:7/893: fdatasync d1/d49/d74/d77/d57/d47/fa2 0 2024-04-16T14:35:40.950 INFO:tasks.workunit.client.0.smithi005.stdout:6/935: symlink d2/d20/l13a 0 2024-04-16T14:35:40.950 INFO:tasks.workunit.client.0.smithi005.stdout:3/719: rmdir d2/d17/d46/d75/d41/d79 39 2024-04-16T14:35:40.951 INFO:tasks.workunit.client.1.smithi115.stdout:2/633: rename d0/d4 to d0/d47/d65/dad/dc8 0 2024-04-16T14:35:40.951 INFO:tasks.workunit.client.1.smithi115.stdout:2/634: chown d0/d47/d65/dad/dc8/d24/da0 47855733 1 2024-04-16T14:35:40.951 INFO:tasks.workunit.client.1.smithi115.stdout:2/635: write d0/d47/f8e [560841,87396] 0 2024-04-16T14:35:40.951 INFO:tasks.workunit.client.1.smithi115.stdout:2/636: dread - d0/d47/d65/dad/dbb/d11/f88 zero size 2024-04-16T14:35:40.953 INFO:tasks.workunit.client.1.smithi115.stdout:2/637: mkdir d0/d47/dc9 0 2024-04-16T14:35:40.954 INFO:tasks.workunit.client.0.smithi005.stdout:3/720: mknod d2/d17/d46/d75/d9b/dbd/cf1 0 2024-04-16T14:35:40.954 INFO:tasks.workunit.client.0.smithi005.stdout:3/721: truncate d2/d17/d46/d75/d41/fdf 61887 0 2024-04-16T14:35:40.955 INFO:tasks.workunit.client.1.smithi115.stdout:4/526: rename d1/d15/d31/d42/d46/c87 to d1/d2/c8f 0 2024-04-16T14:35:40.955 INFO:tasks.workunit.client.1.smithi115.stdout:4/527: fdatasync d1/d15/d1e/f2b 0 2024-04-16T14:35:40.957 INFO:tasks.workunit.client.0.smithi005.stdout:3/722: stat d2/d17/l81 0 2024-04-16T14:35:40.957 INFO:tasks.workunit.client.1.smithi115.stdout:4/528: rename d1/d15/f58 to d1/d2/f90 0 2024-04-16T14:35:40.957 INFO:tasks.workunit.client.1.smithi115.stdout:4/529: write d1/f2d [8810795,84204] 0 2024-04-16T14:35:40.958 INFO:tasks.workunit.client.1.smithi115.stdout:8/595: rmdir d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f 39 2024-04-16T14:35:40.959 INFO:tasks.workunit.client.1.smithi115.stdout:8/596: creat d0/db/d44/fc1 x:0 0 0 2024-04-16T14:35:40.959 INFO:tasks.workunit.client.0.smithi005.stdout:7/894: rename d1/d49/d74/d77/d57/l12a to d1/d49/d74/d77/d22/db0/dba/l12b 0 2024-04-16T14:35:40.959 INFO:tasks.workunit.client.0.smithi005.stdout:7/895: dread - d1/d49/d74/d77/d22/d27/df4/f124 zero size 2024-04-16T14:35:40.960 INFO:tasks.workunit.client.0.smithi005.stdout:3/723: rename d2/d9/fc7 to d2/d9/df/daa/dc4/de1/ff2 0 2024-04-16T14:35:40.960 INFO:tasks.workunit.client.0.smithi005.stdout:3/724: write d2/d17/d46/d75/d6d/dd0/dda/fe7 [712749,24403] 0 2024-04-16T14:35:40.962 INFO:tasks.workunit.client.1.smithi115.stdout:8/597: rename d0/db/f58 to d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/fc2 0 2024-04-16T14:35:40.965 INFO:tasks.workunit.client.1.smithi115.stdout:8/598: creat d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/d8a/fc3 x:0 0 0 2024-04-16T14:35:40.965 INFO:tasks.workunit.client.1.smithi115.stdout:8/599: fsync d0/db/d10/d17/f69 0 2024-04-16T14:35:40.965 INFO:tasks.workunit.client.1.smithi115.stdout:8/600: fsync d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/f9a 0 2024-04-16T14:35:40.966 INFO:tasks.workunit.client.1.smithi115.stdout:4/530: dread d1/d15/d1e/f35 [0,4194304] 0 2024-04-16T14:35:40.966 INFO:tasks.workunit.client.1.smithi115.stdout:8/601: getdents d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/d8a/d94 0 2024-04-16T14:35:40.966 INFO:tasks.workunit.client.1.smithi115.stdout:4/531: chown d1/l16 223161751 1 2024-04-16T14:35:40.966 INFO:tasks.workunit.client.0.smithi005.stdout:6/936: write d2/df/f32 [2399451,85237] 0 2024-04-16T14:35:40.969 INFO:tasks.workunit.client.1.smithi115.stdout:4/532: mknod d1/d2/c91 0 2024-04-16T14:35:40.969 INFO:tasks.workunit.client.1.smithi115.stdout:4/533: creat d1/d15/d17/f92 x:0 0 0 2024-04-16T14:35:40.970 INFO:tasks.workunit.client.0.smithi005.stdout:6/937: dread d2/d5/d10/dd6/f80 [0,4194304] 0 2024-04-16T14:35:40.971 INFO:tasks.workunit.client.0.smithi005.stdout:6/938: getdents d2/d3f/d123 0 2024-04-16T14:35:40.971 INFO:tasks.workunit.client.0.smithi005.stdout:6/939: write d2/d3f/d47/d84/dbf/feb [1697811,110365] 0 2024-04-16T14:35:40.971 INFO:tasks.workunit.client.1.smithi115.stdout:8/602: rename d0/db/d10/d17/d2c/d52/d74/d3b/d56/db7 to d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/d8a/d94/dc4 0 2024-04-16T14:35:40.972 INFO:tasks.workunit.client.1.smithi115.stdout:4/534: rename d1/d15/d31/d55/f73 to d1/d15/d31/d42/f93 0 2024-04-16T14:35:40.972 INFO:tasks.workunit.client.1.smithi115.stdout:4/535: readlink d1/d15/d31/l4e 0 2024-04-16T14:35:40.972 INFO:tasks.workunit.client.1.smithi115.stdout:4/536: fdatasync d1/d15/d31/d42/f4a 0 2024-04-16T14:35:40.977 INFO:tasks.workunit.client.0.smithi005.stdout:6/940: write d2/d20/d3c/dcf/f70 [868793,45052] 0 2024-04-16T14:35:40.977 INFO:tasks.workunit.client.0.smithi005.stdout:6/941: rmdir d2/d20/d72 39 2024-04-16T14:35:40.985 INFO:tasks.workunit.client.1.smithi115.stdout:8/603: write d0/f1a [3770760,32794] 0 2024-04-16T14:35:40.987 INFO:tasks.workunit.client.1.smithi115.stdout:6/590: dwrite d13/d1d/d49/f70 [0,4194304] 0 2024-04-16T14:35:40.987 INFO:tasks.workunit.client.1.smithi115.stdout:6/591: chown d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/d55/c69 3873009 1 2024-04-16T14:35:40.987 INFO:tasks.workunit.client.1.smithi115.stdout:6/592: readlink d13/d1d/d2b/d5f/l3e 0 2024-04-16T14:35:40.989 INFO:tasks.workunit.client.0.smithi005.stdout:3/725: dwrite d2/d9/fe4 [0,4194304] 0 2024-04-16T14:35:40.990 INFO:tasks.workunit.client.1.smithi115.stdout:1/530: dwrite df/d13/d4d/f2e [0,4194304] 0 2024-04-16T14:35:40.990 INFO:tasks.workunit.client.1.smithi115.stdout:1/531: truncate df/d13/d4d/d2c/f21 1400656 0 2024-04-16T14:35:40.990 INFO:tasks.workunit.client.1.smithi115.stdout:6/593: creat d13/d1d/d2b/d5b/fc2 x:0 0 0 2024-04-16T14:35:40.990 INFO:tasks.workunit.client.1.smithi115.stdout:6/594: truncate d13/d1d/d2b/d5f/f6a 4559889 0 2024-04-16T14:35:40.990 INFO:tasks.workunit.client.1.smithi115.stdout:6/595: write d13/d1d/d2b/d5f/d30/d43/f2d [2108044,108575] 0 2024-04-16T14:35:40.993 INFO:tasks.workunit.client.1.smithi115.stdout:1/532: mknod df/d35/d48/cad 0 2024-04-16T14:35:40.996 INFO:tasks.workunit.client.1.smithi115.stdout:6/596: getdents d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/d55 0 2024-04-16T14:35:40.996 INFO:tasks.workunit.client.1.smithi115.stdout:6/597: readlink d13/l15 0 2024-04-16T14:35:41.000 INFO:tasks.workunit.client.1.smithi115.stdout:1/533: getdents df/d36/d94 0 2024-04-16T14:35:41.000 INFO:tasks.workunit.client.1.smithi115.stdout:1/534: write df/f9c [197817,101606] 0 2024-04-16T14:35:41.002 INFO:tasks.workunit.client.0.smithi005.stdout:1/938: sync 2024-04-16T14:35:41.002 INFO:tasks.workunit.client.0.smithi005.stdout:1/939: write d2/d1c/d15/d2a/d19/d6e/f11b [660734,106757] 0 2024-04-16T14:35:41.003 INFO:tasks.workunit.client.0.smithi005.stdout:1/940: truncate d2/d74/dd7/d11f/d51/d132/fd5 2088137 0 2024-04-16T14:35:41.003 INFO:tasks.workunit.client.0.smithi005.stdout:1/941: stat d2/d1c/d15/d2a/d1a/d21/l136 0 2024-04-16T14:35:41.003 INFO:tasks.workunit.client.0.smithi005.stdout:1/942: fsync d2/d1c/d15/d2a/d19/d42/d64/d76/f120 0 2024-04-16T14:35:41.003 INFO:tasks.workunit.client.0.smithi005.stdout:1/943: write d2/d1c/fdd [614062,9226] 0 2024-04-16T14:35:41.003 INFO:tasks.workunit.client.0.smithi005.stdout:1/944: dread - d2/d1c/d15/d2a/d19/d42/d71/dac/d99/f122 zero size 2024-04-16T14:35:41.006 INFO:tasks.workunit.client.0.smithi005.stdout:1/945: symlink d2/d1c/dd8/l142 0 2024-04-16T14:35:41.007 INFO:tasks.workunit.client.0.smithi005.stdout:1/946: creat d2/d74/f143 x:0 0 0 2024-04-16T14:35:41.007 INFO:tasks.workunit.client.1.smithi115.stdout:0/461: dwrite d6/d10/d12/d1f/d36/d4b/d70/f93 [0,4194304] 0 2024-04-16T14:35:41.008 INFO:tasks.workunit.client.0.smithi005.stdout:9/554: dwrite d3/d49/d4b/d5c/d65/f85 [0,4194304] 0 2024-04-16T14:35:41.008 INFO:tasks.workunit.client.0.smithi005.stdout:2/576: dwrite d0/d2a/d3a/f76 [0,4194304] 0 2024-04-16T14:35:41.008 INFO:tasks.workunit.client.0.smithi005.stdout:2/577: stat d0/d29/d89 0 2024-04-16T14:35:41.011 INFO:tasks.workunit.client.1.smithi115.stdout:1/535: dread f0 [0,4194304] 0 2024-04-16T14:35:41.011 INFO:tasks.workunit.client.1.smithi115.stdout:0/462: creat d6/d10/d12/d31/d35/d9b/fa4 x:0 0 0 2024-04-16T14:35:41.014 INFO:tasks.workunit.client.0.smithi005.stdout:1/947: mkdir d2/d1c/d15/d2a/d1a/d144 0 2024-04-16T14:35:41.014 INFO:tasks.workunit.client.1.smithi115.stdout:1/536: dread f0 [4194304,4194304] 0 2024-04-16T14:35:41.015 INFO:tasks.workunit.client.1.smithi115.stdout:0/463: rename d6/d1b/f7c to d6/d10/d94/fa5 0 2024-04-16T14:35:41.015 INFO:tasks.workunit.client.1.smithi115.stdout:9/588: dwrite d1/d6/d2d/d4b/d6c/f74 [0,4194304] 0 2024-04-16T14:35:41.018 INFO:tasks.workunit.client.1.smithi115.stdout:2/638: dread d0/d47/d65/dad/dbb/d11/f20 [0,4194304] 0 2024-04-16T14:35:41.021 INFO:tasks.workunit.client.0.smithi005.stdout:2/578: mknod d0/d4/d2b/d5e/cc4 0 2024-04-16T14:35:41.022 INFO:tasks.workunit.client.1.smithi115.stdout:1/537: rename df/d35/d48/f6b to df/d36/fae 0 2024-04-16T14:35:41.022 INFO:tasks.workunit.client.1.smithi115.stdout:1/538: write df/d2d/d83/f7b [1083576,46778] 0 2024-04-16T14:35:41.023 INFO:tasks.workunit.client.1.smithi115.stdout:2/639: dread d0/d47/d65/dad/dc8/d24/d10/f89 [0,4194304] 0 2024-04-16T14:35:41.024 INFO:tasks.workunit.client.1.smithi115.stdout:1/539: rename df/d13/d4d/d2c/d54/c7a to df/d36/d94/caf 0 2024-04-16T14:35:41.025 INFO:tasks.workunit.client.0.smithi005.stdout:2/579: link d0/d29/d89/lbd d0/d4/d2b/d5e/lc5 0 2024-04-16T14:35:41.026 INFO:tasks.workunit.client.1.smithi115.stdout:2/640: creat d0/d47/d65/dad/dc8/d24/fca x:0 0 0 2024-04-16T14:35:41.026 INFO:tasks.workunit.client.1.smithi115.stdout:2/641: chown d0/d47/d65/dad/dc8/d24/fca 700 1 2024-04-16T14:35:41.026 INFO:tasks.workunit.client.0.smithi005.stdout:2/580: mknod d0/d4/d2b/d6b/cc6 0 2024-04-16T14:35:41.026 INFO:tasks.workunit.client.0.smithi005.stdout:2/581: write d0/d29/d89/fa0 [388253,111434] 0 2024-04-16T14:35:41.027 INFO:tasks.workunit.client.0.smithi005.stdout:2/582: dread - d0/d2a/d3a/f95 zero size 2024-04-16T14:35:41.027 INFO:tasks.workunit.client.0.smithi005.stdout:2/583: write d0/d2a/fa8 [466104,18895] 0 2024-04-16T14:35:41.027 INFO:tasks.workunit.client.0.smithi005.stdout:2/584: readlink d0/d4/d2b/d6b/l8c 0 2024-04-16T14:35:41.028 INFO:tasks.workunit.client.1.smithi115.stdout:1/540: symlink df/d13/d4d/d2c/lb0 0 2024-04-16T14:35:41.029 INFO:tasks.workunit.client.0.smithi005.stdout:2/585: symlink d0/d4/d2b/d5e/lc7 0 2024-04-16T14:35:41.029 INFO:tasks.workunit.client.0.smithi005.stdout:2/586: truncate d0/d1c/d39/d85/fa6 372247 0 2024-04-16T14:35:41.029 INFO:tasks.workunit.client.1.smithi115.stdout:0/464: write d6/d10/f55 [2391130,65501] 0 2024-04-16T14:35:41.029 INFO:tasks.workunit.client.1.smithi115.stdout:0/465: write d6/d10/d12/d31/d35/f3c [1890240,19505] 0 2024-04-16T14:35:41.030 INFO:tasks.workunit.client.0.smithi005.stdout:2/587: rmdir d0/d29/d3e 39 2024-04-16T14:35:41.030 INFO:tasks.workunit.client.0.smithi005.stdout:2/588: stat d0/d2a/f63 0 2024-04-16T14:35:41.031 INFO:tasks.workunit.client.1.smithi115.stdout:0/466: getdents d6/d10/d12/d31/d35/d44 0 2024-04-16T14:35:41.031 INFO:tasks.workunit.client.1.smithi115.stdout:0/467: fdatasync d6/d10/d12/d31/d35/d44/f50 0 2024-04-16T14:35:41.032 INFO:tasks.workunit.client.1.smithi115.stdout:0/468: mknod d6/d10/d12/d31/ca6 0 2024-04-16T14:35:41.033 INFO:tasks.workunit.client.0.smithi005.stdout:2/589: mkdir d0/d1c/d39/d85/da2/dc8 0 2024-04-16T14:35:41.034 INFO:tasks.workunit.client.0.smithi005.stdout:2/590: mknod d0/d1c/d8d/cc9 0 2024-04-16T14:35:41.036 INFO:tasks.workunit.client.1.smithi115.stdout:9/589: dread d1/d6/d2d/d4b/d6c/f74 [0,4194304] 0 2024-04-16T14:35:41.037 INFO:tasks.workunit.client.0.smithi005.stdout:2/591: getdents d0/d4/d2b 0 2024-04-16T14:35:41.037 INFO:tasks.workunit.client.0.smithi005.stdout:2/592: stat d0/d2a/d3a/d46/c5f 0 2024-04-16T14:35:41.037 INFO:tasks.workunit.client.0.smithi005.stdout:1/948: dread d2/d1c/d15/d2a/d19/d20/d27/f4c [0,4194304] 0 2024-04-16T14:35:41.038 INFO:tasks.workunit.client.1.smithi115.stdout:9/590: rename d1/d6/d33/la3 to d1/d6/lcc 0 2024-04-16T14:35:41.038 INFO:tasks.workunit.client.1.smithi115.stdout:9/591: write d1/d7f/fa1 [947753,63721] 0 2024-04-16T14:35:41.038 INFO:tasks.workunit.client.1.smithi115.stdout:9/592: dread - d1/d7f/fb5 zero size 2024-04-16T14:35:41.038 INFO:tasks.workunit.client.0.smithi005.stdout:1/949: mkdir d2/d1c/d15/d145 0 2024-04-16T14:35:41.039 INFO:tasks.workunit.client.1.smithi115.stdout:9/593: rename d1/d6/d2d/d4b/d60/fc9 to d1/d6/d2d/d3d/fcd 0 2024-04-16T14:35:41.040 INFO:tasks.workunit.client.0.smithi005.stdout:1/950: truncate d2/d1c/fe 3876063 0 2024-04-16T14:35:41.042 INFO:tasks.workunit.client.1.smithi115.stdout:1/541: write df/f1d [2638500,130004] 0 2024-04-16T14:35:41.042 INFO:tasks.workunit.client.1.smithi115.stdout:9/594: rmdir d1/d6/d2d/d3d/d49 39 2024-04-16T14:35:41.043 INFO:tasks.workunit.client.0.smithi005.stdout:1/951: mkdir d2/d1c/d15/d2a/d19/d42/d71/dac/d99/d146 0 2024-04-16T14:35:41.044 INFO:tasks.workunit.client.0.smithi005.stdout:3/726: dwrite d2/d9/fd9 [0,4194304] 0 2024-04-16T14:35:41.044 INFO:tasks.workunit.client.1.smithi115.stdout:8/604: dwrite d0/db/d10/d17/f7b [0,4194304] 0 2024-04-16T14:35:41.044 INFO:tasks.workunit.client.1.smithi115.stdout:8/605: truncate d0/db/d44/f59 1330785 0 2024-04-16T14:35:41.044 INFO:tasks.workunit.client.1.smithi115.stdout:4/537: dwrite d1/d15/f77 [4194304,4194304] 0 2024-04-16T14:35:41.045 INFO:tasks.workunit.client.1.smithi115.stdout:1/542: stat df/c20 0 2024-04-16T14:35:41.045 INFO:tasks.workunit.client.0.smithi005.stdout:1/952: creat d2/d1c/d15/d2a/d19/d42/f147 x:0 0 0 2024-04-16T14:35:41.046 INFO:tasks.workunit.client.1.smithi115.stdout:8/606: symlink d0/db/d10/d17/d2c/d52/d6c/db8/d64/lc5 0 2024-04-16T14:35:41.047 INFO:tasks.workunit.client.0.smithi005.stdout:9/555: dwrite d3/d49/d4b/d55/f5d [0,4194304] 0 2024-04-16T14:35:41.047 INFO:tasks.workunit.client.0.smithi005.stdout:9/556: stat d3/d49 0 2024-04-16T14:35:41.050 INFO:tasks.workunit.client.1.smithi115.stdout:0/469: dread f1 [4194304,4194304] 0 2024-04-16T14:35:41.050 INFO:tasks.workunit.client.1.smithi115.stdout:0/470: stat d6/d54/d57/d83/f8f 0 2024-04-16T14:35:41.050 INFO:tasks.workunit.client.1.smithi115.stdout:4/538: mknod d1/d15/d31/d42/d8b/c94 0 2024-04-16T14:35:41.050 INFO:tasks.workunit.client.1.smithi115.stdout:4/539: write d1/d15/d17/f8a [821800,47336] 0 2024-04-16T14:35:41.051 INFO:tasks.workunit.client.1.smithi115.stdout:2/642: dwrite d0/d47/d65/f7b [0,4194304] 0 2024-04-16T14:35:41.052 INFO:tasks.workunit.client.1.smithi115.stdout:1/543: creat df/d13/d4d/d2c/fb1 x:0 0 0 2024-04-16T14:35:41.052 INFO:tasks.workunit.client.0.smithi005.stdout:3/727: dread d2/d17/d46/d75/f60 [0,4194304] 0 2024-04-16T14:35:41.058 INFO:tasks.workunit.client.0.smithi005.stdout:9/557: truncate d3/f3b 3323867 0 2024-04-16T14:35:41.061 INFO:tasks.workunit.client.0.smithi005.stdout:9/558: mknod d3/d12/d2b/c9c 0 2024-04-16T14:35:41.061 INFO:tasks.workunit.client.0.smithi005.stdout:9/559: chown d3/d12/d2b/f4e 397 1 2024-04-16T14:35:41.062 INFO:tasks.workunit.client.0.smithi005.stdout:3/728: mkdir d2/d17/d46/d75/d6d/df3 0 2024-04-16T14:35:41.067 INFO:tasks.workunit.client.0.smithi005.stdout:3/729: symlink d2/d17/d46/d47/deb/lf4 0 2024-04-16T14:35:41.067 INFO:tasks.workunit.client.0.smithi005.stdout:3/730: fsync d2/d17/d46/d75/d9b/dbd/fd6 0 2024-04-16T14:35:41.067 INFO:tasks.workunit.client.0.smithi005.stdout:3/731: chown d2/d9/d5e/fdc 371 1 2024-04-16T14:35:41.067 INFO:tasks.workunit.client.0.smithi005.stdout:3/732: link d2/d17/f76 d2/d9/d7d/ff5 0 2024-04-16T14:35:41.067 INFO:tasks.workunit.client.1.smithi115.stdout:2/643: dread d0/d1b/f99 [0,4194304] 0 2024-04-16T14:35:41.067 INFO:tasks.workunit.client.1.smithi115.stdout:2/644: write d0/d47/d65/dad/dc8/d4a/f69 [4451058,50180] 0 2024-04-16T14:35:41.067 INFO:tasks.workunit.client.1.smithi115.stdout:8/607: creat d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/d8a/d94/fc6 x:0 0 0 2024-04-16T14:35:41.067 INFO:tasks.workunit.client.1.smithi115.stdout:4/540: mknod d1/d15/d78/c95 0 2024-04-16T14:35:41.067 INFO:tasks.workunit.client.1.smithi115.stdout:0/471: dread d6/f25 [0,4194304] 0 2024-04-16T14:35:41.067 INFO:tasks.workunit.client.1.smithi115.stdout:2/645: dread d0/d47/d65/dad/dc8/d24/f44 [0,4194304] 0 2024-04-16T14:35:41.071 INFO:tasks.workunit.client.1.smithi115.stdout:0/472: creat d6/d10/d12/d31/d35/d44/fa7 x:0 0 0 2024-04-16T14:35:41.072 INFO:tasks.workunit.client.1.smithi115.stdout:0/473: chown d6/d10 0 1 2024-04-16T14:35:41.072 INFO:tasks.workunit.client.1.smithi115.stdout:0/474: read d6/d10/f55 [1095962,49142] 0 2024-04-16T14:35:41.072 INFO:tasks.workunit.client.1.smithi115.stdout:2/646: truncate d0/d47/d65/dad/dc8/d24/f34 2790167 0 2024-04-16T14:35:41.073 INFO:tasks.workunit.client.0.smithi005.stdout:3/733: write d2/d17/f38 [6387130,41367] 0 2024-04-16T14:35:41.074 INFO:tasks.workunit.client.1.smithi115.stdout:8/608: symlink d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/d8a/d94/dbf/lc7 0 2024-04-16T14:35:41.078 INFO:tasks.workunit.client.0.smithi005.stdout:3/734: read d2/d9/d51/fa7 [264668,62136] 0 2024-04-16T14:35:41.078 INFO:tasks.workunit.client.1.smithi115.stdout:4/541: dread d1/d15/d31/f44 [0,4194304] 0 2024-04-16T14:35:41.079 INFO:tasks.workunit.client.0.smithi005.stdout:3/735: mknod d2/d9/df/cf6 0 2024-04-16T14:35:41.080 INFO:tasks.workunit.client.0.smithi005.stdout:3/736: unlink d2/d17/d46/d75/d41/d79/fc3 0 2024-04-16T14:35:41.082 INFO:tasks.workunit.client.0.smithi005.stdout:1/953: dwrite d2/d74/dd7/d11f/f35 [4194304,4194304] 0 2024-04-16T14:35:41.082 INFO:tasks.workunit.client.0.smithi005.stdout:1/954: readlink d2/d1c/d15/d2a/d19/d20/d27/l118 0 2024-04-16T14:35:41.082 INFO:tasks.workunit.client.0.smithi005.stdout:1/955: truncate d2/d1c/d15/d2a/d19/d42/f147 300660 0 2024-04-16T14:35:41.082 INFO:tasks.workunit.client.0.smithi005.stdout:2/593: dwrite d0/f9d [0,4194304] 0 2024-04-16T14:35:41.082 INFO:tasks.workunit.client.1.smithi115.stdout:9/595: dwrite d1/d6/d2d/d3d/d49/d98/daa/fb0 [0,4194304] 0 2024-04-16T14:35:41.082 INFO:tasks.workunit.client.1.smithi115.stdout:2/647: read d0/d47/d65/f7b [803350,31605] 0 2024-04-16T14:35:41.085 INFO:tasks.workunit.client.1.smithi115.stdout:9/596: truncate d1/d6/d2d/d3d/d50/f56 628854 0 2024-04-16T14:35:41.085 INFO:tasks.workunit.client.0.smithi005.stdout:1/956: mknod d2/d102/c148 0 2024-04-16T14:35:41.086 INFO:tasks.workunit.client.0.smithi005.stdout:1/957: dread - d2/d1c/d15/d2a/d19/d20/d27/ff0 zero size 2024-04-16T14:35:41.086 INFO:tasks.workunit.client.1.smithi115.stdout:0/475: dread d6/d10/d12/d1f/d36/d4b/d70/f93 [0,4194304] 0 2024-04-16T14:35:41.086 INFO:tasks.workunit.client.1.smithi115.stdout:0/476: write d6/f95 [679689,118408] 0 2024-04-16T14:35:41.088 INFO:tasks.workunit.client.1.smithi115.stdout:2/648: symlink d0/d47/d65/d61/lcb 0 2024-04-16T14:35:41.088 INFO:tasks.workunit.client.1.smithi115.stdout:0/477: truncate d6/d30/d4d/f4c 3372614 0 2024-04-16T14:35:41.089 INFO:tasks.workunit.client.1.smithi115.stdout:2/649: mknod d0/d47/d65/d61/d70/ccc 0 2024-04-16T14:35:41.089 INFO:tasks.workunit.client.1.smithi115.stdout:2/650: write d0/fd [1053487,129623] 0 2024-04-16T14:35:41.091 INFO:tasks.workunit.client.1.smithi115.stdout:8/609: dread d0/db/d10/d17/f4c [4194304,4194304] 0 2024-04-16T14:35:41.091 INFO:tasks.workunit.client.1.smithi115.stdout:8/610: dread - d0/db/d10/d17/d22/f5d zero size 2024-04-16T14:35:41.091 INFO:tasks.workunit.client.1.smithi115.stdout:0/478: unlink d6/d30/d8d/fa3 0 2024-04-16T14:35:41.093 INFO:tasks.workunit.client.1.smithi115.stdout:2/651: symlink d0/d47/d65/dad/dbb/d11/d25/lcd 0 2024-04-16T14:35:41.093 INFO:tasks.workunit.client.1.smithi115.stdout:2/652: chown d0/d47/d65/d61/d70 48403720 1 2024-04-16T14:35:41.097 INFO:tasks.workunit.client.1.smithi115.stdout:4/542: write d1/d15/d1e/f5d [4441703,112437] 0 2024-04-16T14:35:41.100 INFO:tasks.workunit.client.1.smithi115.stdout:9/597: write d1/d6/d2d/d3d/db7/fca [2299687,59898] 0 2024-04-16T14:35:41.101 INFO:tasks.workunit.client.0.smithi005.stdout:3/737: dwrite d2/d6b/d7a/f8c [4194304,4194304] 0 2024-04-16T14:35:41.105 INFO:tasks.workunit.client.1.smithi115.stdout:2/653: dread d0/d47/d65/dad/dc8/d24/f19 [0,4194304] 0 2024-04-16T14:35:41.110 INFO:tasks.workunit.client.1.smithi115.stdout:4/543: creat d1/f96 x:0 0 0 2024-04-16T14:35:41.110 INFO:tasks.workunit.client.1.smithi115.stdout:4/544: truncate d1/d15/d31/d55/f7f 1002560 0 2024-04-16T14:35:41.113 INFO:tasks.workunit.client.1.smithi115.stdout:4/545: mknod d1/d15/d31/d42/d46/c97 0 2024-04-16T14:35:41.117 INFO:tasks.workunit.client.1.smithi115.stdout:4/546: creat d1/d15/d31/f98 x:0 0 0 2024-04-16T14:35:41.117 INFO:tasks.workunit.client.1.smithi115.stdout:4/547: dread - d1/d15/d1e/f6e zero size 2024-04-16T14:35:41.118 INFO:tasks.workunit.client.1.smithi115.stdout:1/544: rmdir df/d13 39 2024-04-16T14:35:41.121 INFO:tasks.workunit.client.1.smithi115.stdout:1/545: link df/d13/d4d/d3e/d75/da9/fab df/d13/d4d/d6d/fb2 0 2024-04-16T14:35:41.128 INFO:tasks.workunit.client.1.smithi115.stdout:1/546: dread df/f9c [0,4194304] 0 2024-04-16T14:35:41.128 INFO:tasks.workunit.client.1.smithi115.stdout:4/548: dread d1/d15/d1e/f29 [0,4194304] 0 2024-04-16T14:35:41.128 INFO:tasks.workunit.client.0.smithi005.stdout:2/594: mknod d0/d1c/d59/cca 0 2024-04-16T14:35:41.128 INFO:tasks.workunit.client.0.smithi005.stdout:2/595: chown d0/d1c/d59/cb2 7 1 2024-04-16T14:35:41.129 INFO:tasks.workunit.client.1.smithi115.stdout:8/611: dwrite d0/db/d10/d17/d2c/d52/d6c/d71/fb9 [0,4194304] 0 2024-04-16T14:35:41.129 INFO:tasks.workunit.client.1.smithi115.stdout:8/612: truncate d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/f9a 294057 0 2024-04-16T14:35:41.129 INFO:tasks.workunit.client.1.smithi115.stdout:4/549: rmdir d1/d15/d31/d42 39 2024-04-16T14:35:41.129 INFO:tasks.workunit.client.1.smithi115.stdout:4/550: chown d1/d15/d31/d42/l5c 14 1 2024-04-16T14:35:41.130 INFO:tasks.workunit.client.1.smithi115.stdout:5/499: sync 2024-04-16T14:35:41.131 INFO:tasks.workunit.client.1.smithi115.stdout:5/500: creat dc/d15/d4d/fa4 x:0 0 0 2024-04-16T14:35:41.131 INFO:tasks.workunit.client.1.smithi115.stdout:5/501: chown dc/d3d/d41/c97 1 1 2024-04-16T14:35:41.132 INFO:tasks.workunit.client.0.smithi005.stdout:2/596: dread d0/d1c/d8d/fa9 [0,4194304] 0 2024-04-16T14:35:41.132 INFO:tasks.workunit.client.1.smithi115.stdout:1/547: dread df/d2d/d83/f60 [0,4194304] 0 2024-04-16T14:35:41.132 INFO:tasks.workunit.client.1.smithi115.stdout:1/548: truncate df/d13/d4d/f2e 5012499 0 2024-04-16T14:35:41.135 INFO:tasks.workunit.client.1.smithi115.stdout:8/613: mkdir d0/dc8 0 2024-04-16T14:35:41.135 INFO:tasks.workunit.client.1.smithi115.stdout:8/614: readlink d0/db/d10/d17/d2c/d52/l95 0 2024-04-16T14:35:41.135 INFO:tasks.workunit.client.1.smithi115.stdout:8/615: dread - d0/db/d10/d25/fba zero size 2024-04-16T14:35:41.135 INFO:tasks.workunit.client.1.smithi115.stdout:8/616: read - d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/f86 zero size 2024-04-16T14:35:41.135 INFO:tasks.workunit.client.1.smithi115.stdout:8/617: write d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/d8a/fc3 [113399,105137] 0 2024-04-16T14:35:41.139 INFO:tasks.workunit.client.1.smithi115.stdout:5/502: symlink dc/d15/d35/d87/la5 0 2024-04-16T14:35:41.142 INFO:tasks.workunit.client.1.smithi115.stdout:1/549: dread df/f10 [0,4194304] 0 2024-04-16T14:35:41.150 INFO:tasks.workunit.client.1.smithi115.stdout:2/654: rmdir d0/d47/d65/d61 39 2024-04-16T14:35:41.150 INFO:tasks.workunit.client.1.smithi115.stdout:2/655: chown d0/d47/d65/dad/dc8/d24/d21/d59 284204 1 2024-04-16T14:35:41.153 INFO:tasks.workunit.client.1.smithi115.stdout:1/550: getdents df/d13/d4d/d2c/d54 0 2024-04-16T14:35:41.154 INFO:tasks.workunit.client.1.smithi115.stdout:0/479: rmdir d6 39 2024-04-16T14:35:41.154 INFO:tasks.workunit.client.1.smithi115.stdout:0/480: fsync d6/d10/d12/d31/d35/d44/f6f 0 2024-04-16T14:35:41.157 INFO:tasks.workunit.client.1.smithi115.stdout:8/618: link d0/db/d10/d25/f5f d0/db/d10/d25/fc9 0 2024-04-16T14:35:41.159 INFO:tasks.workunit.client.1.smithi115.stdout:2/656: creat d0/d47/d65/dad/dc8/d22/fce x:0 0 0 2024-04-16T14:35:41.160 INFO:tasks.workunit.client.1.smithi115.stdout:1/551: rmdir df/d13 39 2024-04-16T14:35:41.162 INFO:tasks.workunit.client.1.smithi115.stdout:0/481: creat d6/d10/d12/d1f/d36/d4b/d70/fa8 x:0 0 0 2024-04-16T14:35:41.162 INFO:tasks.workunit.client.1.smithi115.stdout:0/482: write f1 [2241224,44749] 0 2024-04-16T14:35:41.162 INFO:tasks.workunit.client.1.smithi115.stdout:0/483: readlink d6/l8 0 2024-04-16T14:35:41.163 INFO:tasks.workunit.client.1.smithi115.stdout:5/503: dwrite dc/d3d/d41/f54 [0,4194304] 0 2024-04-16T14:35:41.164 INFO:tasks.workunit.client.1.smithi115.stdout:4/551: rmdir d1/d15 39 2024-04-16T14:35:41.165 INFO:tasks.workunit.client.1.smithi115.stdout:1/552: fsync df/d13/d4d/d3e/d75/da9/fab 0 2024-04-16T14:35:41.165 INFO:tasks.workunit.client.1.smithi115.stdout:1/553: truncate df/d36/f3d 4419086 0 2024-04-16T14:35:41.167 INFO:tasks.workunit.client.1.smithi115.stdout:8/619: dread d0/db/d10/d17/f7b [0,4194304] 0 2024-04-16T14:35:41.167 INFO:tasks.workunit.client.1.smithi115.stdout:8/620: creat d0/fca x:0 0 0 2024-04-16T14:35:41.167 INFO:tasks.workunit.client.1.smithi115.stdout:8/621: chown d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/f9a 52 1 2024-04-16T14:35:41.167 INFO:tasks.workunit.client.1.smithi115.stdout:8/622: fdatasync d0/fca 0 2024-04-16T14:35:41.167 INFO:tasks.workunit.client.1.smithi115.stdout:0/484: unlink d6/d10/d12/d31/d35/l3a 0 2024-04-16T14:35:41.172 INFO:tasks.workunit.client.0.smithi005.stdout:9/560: write d3/f3b [4354958,101277] 0 2024-04-16T14:35:41.172 INFO:tasks.workunit.client.0.smithi005.stdout:9/561: getdents d3/d12/d2b/d8e 0 2024-04-16T14:35:41.172 INFO:tasks.workunit.client.1.smithi115.stdout:2/657: dread d0/d47/d65/dad/dc8/d57/f67 [0,4194304] 0 2024-04-16T14:35:41.172 INFO:tasks.workunit.client.1.smithi115.stdout:5/504: readlink dc/d15/l36 0 2024-04-16T14:35:41.172 INFO:tasks.workunit.client.1.smithi115.stdout:7/498: sync 2024-04-16T14:35:41.172 INFO:tasks.workunit.client.1.smithi115.stdout:7/499: fsync d0/d2/d3a/d30/d6b/da2/d81/f92 0 2024-04-16T14:35:41.174 INFO:tasks.workunit.client.1.smithi115.stdout:4/552: creat d1/d15/d31/f99 x:0 0 0 2024-04-16T14:35:41.175 INFO:tasks.workunit.client.1.smithi115.stdout:1/554: symlink df/d36/lb3 0 2024-04-16T14:35:41.180 INFO:tasks.workunit.client.1.smithi115.stdout:2/658: rename d0/d47/d65/dad/dbb/d11/d25/c4c to d0/d47/d65/dad/dc8/d24/d23/d83/ccf 0 2024-04-16T14:35:41.180 INFO:tasks.workunit.client.1.smithi115.stdout:2/659: chown d0/d1b/c49 1871056 1 2024-04-16T14:35:41.182 INFO:tasks.workunit.client.1.smithi115.stdout:8/623: write d0/db/d10/d17/d22/f32 [8001858,28246] 0 2024-04-16T14:35:41.182 INFO:tasks.workunit.client.1.smithi115.stdout:8/624: chown d0/db/d10/d17/f2b 110171755 1 2024-04-16T14:35:41.182 INFO:tasks.workunit.client.1.smithi115.stdout:5/505: readlink dc/d15/l23 0 2024-04-16T14:35:41.186 INFO:tasks.workunit.client.1.smithi115.stdout:7/500: creat d0/d2/d3a/d30/d6b/da2/fa8 x:0 0 0 2024-04-16T14:35:41.186 INFO:tasks.workunit.client.1.smithi115.stdout:4/553: mknod d1/d2/c9a 0 2024-04-16T14:35:41.187 INFO:tasks.workunit.client.1.smithi115.stdout:0/485: symlink d6/d10/d12/d5f/la9 0 2024-04-16T14:35:41.190 INFO:tasks.workunit.client.1.smithi115.stdout:1/555: rename df/d13/f16 to df/d13/d4d/d2c/fb4 0 2024-04-16T14:35:41.193 INFO:tasks.workunit.client.1.smithi115.stdout:8/625: mknod d0/db/d10/d17/d2c/d52/ccb 0 2024-04-16T14:35:41.195 INFO:tasks.workunit.client.1.smithi115.stdout:4/554: creat d1/d15/d31/d42/d8b/f9b x:0 0 0 2024-04-16T14:35:41.198 INFO:tasks.workunit.client.1.smithi115.stdout:2/660: write d0/f2d [2788225,117743] 0 2024-04-16T14:35:41.198 INFO:tasks.workunit.client.1.smithi115.stdout:2/661: stat d0/d47 0 2024-04-16T14:35:41.199 INFO:tasks.workunit.client.1.smithi115.stdout:7/501: rename d0/d1/d3b/d3e/l53 to d0/d2/d3a/d30/d6b/da2/la9 0 2024-04-16T14:35:41.199 INFO:tasks.workunit.client.1.smithi115.stdout:7/502: write d0/d1/d3b/d3e/f54 [1214714,94092] 0 2024-04-16T14:35:41.200 INFO:tasks.workunit.client.1.smithi115.stdout:1/556: symlink df/d13/d4d/d2c/d54/lb5 0 2024-04-16T14:35:41.200 INFO:tasks.workunit.client.1.smithi115.stdout:1/557: stat df/c29 0 2024-04-16T14:35:41.200 INFO:tasks.workunit.client.1.smithi115.stdout:1/558: creat df/d36/d3c/fb6 x:0 0 0 2024-04-16T14:35:41.201 INFO:tasks.workunit.client.1.smithi115.stdout:8/626: write d0/db/d10/d17/d2c/d52/d6c/f87 [3514784,105581] 0 2024-04-16T14:35:41.202 INFO:tasks.workunit.client.1.smithi115.stdout:5/506: write dc/f1c [1570313,86762] 0 2024-04-16T14:35:41.204 INFO:tasks.workunit.client.1.smithi115.stdout:7/503: creat d0/d24/d2b/d9c/faa x:0 0 0 2024-04-16T14:35:41.204 INFO:tasks.workunit.client.1.smithi115.stdout:7/504: fsync d0/d1/d3b/d3e/f89 0 2024-04-16T14:35:41.206 INFO:tasks.workunit.client.1.smithi115.stdout:1/559: rmdir df/d13/d4d/d3e/d75 39 2024-04-16T14:35:41.207 INFO:tasks.workunit.client.1.smithi115.stdout:4/555: mkdir d1/d15/d9c 0 2024-04-16T14:35:41.208 INFO:tasks.workunit.client.1.smithi115.stdout:2/662: dread d0/d47/d65/dad/dc8/d4a/f69 [0,4194304] 0 2024-04-16T14:35:41.211 INFO:tasks.workunit.client.1.smithi115.stdout:8/627: chown d0/db/d10/d17/d2c/l7a 115036671 1 2024-04-16T14:35:41.211 INFO:tasks.workunit.client.1.smithi115.stdout:0/486: dwrite d6/f41 [0,4194304] 0 2024-04-16T14:35:41.212 INFO:tasks.workunit.client.1.smithi115.stdout:5/507: dread dc/f2c [0,4194304] 0 2024-04-16T14:35:41.212 INFO:tasks.workunit.client.0.smithi005.stdout:9/562: mkdir d3/d12/d9d 0 2024-04-16T14:35:41.213 INFO:tasks.workunit.client.0.smithi005.stdout:1/958: getdents d2/d102 0 2024-04-16T14:35:41.213 INFO:tasks.workunit.client.0.smithi005.stdout:1/959: chown d2/d74/dd7/d11f/d51/d132/dcd/lff 3151 1 2024-04-16T14:35:41.213 INFO:tasks.workunit.client.0.smithi005.stdout:1/960: chown d2/d1c/d15/d2a/d1a/d144 215890609 1 2024-04-16T14:35:41.214 INFO:tasks.workunit.client.1.smithi115.stdout:1/560: mkdir df/d13/d4d/d3e/d75/da9/db7 0 2024-04-16T14:35:41.215 INFO:tasks.workunit.client.0.smithi005.stdout:9/563: mknod d3/c9e 0 2024-04-16T14:35:41.215 INFO:tasks.workunit.client.0.smithi005.stdout:9/564: creat d3/d49/d4b/d55/f9f x:0 0 0 2024-04-16T14:35:41.215 INFO:tasks.workunit.client.1.smithi115.stdout:2/663: mknod d0/d1b/cd0 0 2024-04-16T14:35:41.216 INFO:tasks.workunit.client.1.smithi115.stdout:8/628: mkdir d0/db/d10/d17/d2c/d52/dcc 0 2024-04-16T14:35:41.219 INFO:tasks.workunit.client.1.smithi115.stdout:2/664: creat d0/d47/d65/dad/dc8/d24/d21/fd1 x:0 0 0 2024-04-16T14:35:41.220 INFO:tasks.workunit.client.1.smithi115.stdout:5/508: dread dc/d3d/f7f [0,4194304] 0 2024-04-16T14:35:41.220 INFO:tasks.workunit.client.1.smithi115.stdout:5/509: readlink dc/d3d/d41/l75 0 2024-04-16T14:35:41.221 INFO:tasks.workunit.client.1.smithi115.stdout:5/510: write dc/d15/d4d/f6f [4556547,57219] 0 2024-04-16T14:35:41.222 INFO:tasks.workunit.client.1.smithi115.stdout:2/665: symlink d0/d47/d65/dad/dbb/d11/dbc/ld2 0 2024-04-16T14:35:41.223 INFO:tasks.workunit.client.1.smithi115.stdout:5/511: unlink dc/d15/l36 0 2024-04-16T14:35:41.225 INFO:tasks.workunit.client.1.smithi115.stdout:5/512: mknod dc/d5d/d8f/ca6 0 2024-04-16T14:35:41.228 INFO:tasks.workunit.client.1.smithi115.stdout:5/513: rename dc/d3d/d68/f8a to dc/d5d/d8f/fa7 0 2024-04-16T14:35:41.228 INFO:tasks.workunit.client.1.smithi115.stdout:5/514: dread - dc/d3d/f96 zero size 2024-04-16T14:35:41.228 INFO:tasks.workunit.client.1.smithi115.stdout:5/515: truncate dc/d15/d4d/fa4 947658 0 2024-04-16T14:35:41.228 INFO:tasks.workunit.client.1.smithi115.stdout:5/516: fdatasync dc/d3d/d41/f91 0 2024-04-16T14:35:41.228 INFO:tasks.workunit.client.1.smithi115.stdout:5/517: readlink dc/d15/l25 0 2024-04-16T14:35:41.229 INFO:tasks.workunit.client.1.smithi115.stdout:5/518: mknod dc/d5d/d8f/ca8 0 2024-04-16T14:35:41.229 INFO:tasks.workunit.client.1.smithi115.stdout:5/519: dread - dc/d3d/f7e zero size 2024-04-16T14:35:41.232 INFO:tasks.workunit.client.1.smithi115.stdout:5/520: rename dc/f8d to dc/d5d/d81/fa9 0 2024-04-16T14:35:41.232 INFO:tasks.workunit.client.1.smithi115.stdout:5/521: dread - dc/d5d/d81/fa9 zero size 2024-04-16T14:35:41.232 INFO:tasks.workunit.client.1.smithi115.stdout:5/522: readlink dc/d3d/d68/d7b/l94 0 2024-04-16T14:35:41.232 INFO:tasks.workunit.client.1.smithi115.stdout:2/666: write d0/d47/d65/dad/dc8/d4a/fa9 [2948747,99024] 0 2024-04-16T14:35:41.232 INFO:tasks.workunit.client.1.smithi115.stdout:2/667: write d0/f1a [1959068,50216] 0 2024-04-16T14:35:41.239 INFO:tasks.workunit.client.1.smithi115.stdout:4/556: dwrite d1/d15/f77 [4194304,4194304] 0 2024-04-16T14:35:41.239 INFO:tasks.workunit.client.1.smithi115.stdout:7/505: rmdir d0/d24/d2b/d9c 39 2024-04-16T14:35:41.239 INFO:tasks.workunit.client.1.smithi115.stdout:7/506: readlink d0/d1/l58 0 2024-04-16T14:35:41.239 INFO:tasks.workunit.client.1.smithi115.stdout:7/507: write d0/fa5 [363113,119322] 0 2024-04-16T14:35:41.239 INFO:tasks.workunit.client.1.smithi115.stdout:7/508: chown d0/d2/d3a 1 1 2024-04-16T14:35:41.239 INFO:tasks.workunit.client.1.smithi115.stdout:7/509: chown d0/d24/l7c 246923153 1 2024-04-16T14:35:41.240 INFO:tasks.workunit.client.1.smithi115.stdout:1/561: rmdir df/d36 39 2024-04-16T14:35:41.240 INFO:tasks.workunit.client.1.smithi115.stdout:1/562: fsync df/d35/d84/f91 0 2024-04-16T14:35:41.243 INFO:tasks.workunit.client.1.smithi115.stdout:4/557: creat d1/d15/d1e/f9d x:0 0 0 2024-04-16T14:35:41.243 INFO:tasks.workunit.client.1.smithi115.stdout:2/668: read d0/d47/d65/dad/dc8/f3a [4184318,49598] 0 2024-04-16T14:35:41.243 INFO:tasks.workunit.client.1.smithi115.stdout:2/669: dread - d0/d47/d65/dad/dbb/d11/d36/fc3 zero size 2024-04-16T14:35:41.245 INFO:tasks.workunit.client.1.smithi115.stdout:7/510: creat d0/d2/d3a/fab x:0 0 0 2024-04-16T14:35:41.245 INFO:tasks.workunit.client.1.smithi115.stdout:7/511: truncate d0/d24/f37 4558614 0 2024-04-16T14:35:41.247 INFO:tasks.workunit.client.1.smithi115.stdout:1/563: unlink df/d2d/d83/f78 0 2024-04-16T14:35:41.247 INFO:tasks.workunit.client.1.smithi115.stdout:1/564: write df/d36/d3c/fa6 [1002525,23161] 0 2024-04-16T14:35:41.248 INFO:tasks.workunit.client.1.smithi115.stdout:4/558: unlink d1/d15/l33 0 2024-04-16T14:35:41.249 INFO:tasks.workunit.client.1.smithi115.stdout:2/670: creat d0/d47/d65/dad/dc8/d24/d23/d71/fd3 x:0 0 0 2024-04-16T14:35:41.251 INFO:tasks.workunit.client.1.smithi115.stdout:7/512: rename d0/d2/d94 to d0/d2/d3a/dac 0 2024-04-16T14:35:41.251 INFO:tasks.workunit.client.1.smithi115.stdout:7/513: truncate d0/d1/d3b/f60 2396090 0 2024-04-16T14:35:41.251 INFO:tasks.workunit.client.1.smithi115.stdout:7/514: truncate d0/d24/d2b/d9c/faa 764501 0 2024-04-16T14:35:41.251 INFO:tasks.workunit.client.1.smithi115.stdout:7/515: fsync d0/d24/f4a 0 2024-04-16T14:35:41.252 INFO:tasks.workunit.client.1.smithi115.stdout:7/516: creat d0/d2/d3a/d73/fad x:0 0 0 2024-04-16T14:35:41.252 INFO:tasks.workunit.client.1.smithi115.stdout:7/517: creat d0/d1/d3b/d3f/fae x:0 0 0 2024-04-16T14:35:41.252 INFO:tasks.workunit.client.1.smithi115.stdout:0/487: dwrite d6/d10/f20 [4194304,4194304] 0 2024-04-16T14:35:41.252 INFO:tasks.workunit.client.0.smithi005.stdout:9/565: dwrite d3/d49/d4b/d55/f9f [0,4194304] 0 2024-04-16T14:35:41.253 INFO:tasks.workunit.client.0.smithi005.stdout:9/566: write d3/d12/d16/f51 [5038576,76068] 0 2024-04-16T14:35:41.253 INFO:tasks.workunit.client.1.smithi115.stdout:1/565: creat df/d2d/d83/fb8 x:0 0 0 2024-04-16T14:35:41.253 INFO:tasks.workunit.client.1.smithi115.stdout:1/566: fdatasync df/d36/f79 0 2024-04-16T14:35:41.253 INFO:tasks.workunit.client.1.smithi115.stdout:8/629: dwrite d0/f62 [0,4194304] 0 2024-04-16T14:35:41.253 INFO:tasks.workunit.client.1.smithi115.stdout:1/567: write df/d2d/f41 [1008804,61193] 0 2024-04-16T14:35:41.254 INFO:tasks.workunit.client.1.smithi115.stdout:5/523: dwrite dc/d3d/f7e [0,4194304] 0 2024-04-16T14:35:41.254 INFO:tasks.workunit.client.1.smithi115.stdout:4/559: mkdir d1/d15/d17/d9e 0 2024-04-16T14:35:41.255 INFO:tasks.workunit.client.1.smithi115.stdout:5/524: dread dc/d15/d4d/fa4 [0,4194304] 0 2024-04-16T14:35:41.255 INFO:tasks.workunit.client.1.smithi115.stdout:5/525: write dc/d15/d4d/f76 [63385,120750] 0 2024-04-16T14:35:41.256 INFO:tasks.workunit.client.1.smithi115.stdout:7/518: symlink d0/d1/d3b/d49/d5d/laf 0 2024-04-16T14:35:41.256 INFO:tasks.workunit.client.1.smithi115.stdout:7/519: dread - d0/d2/d3a/d30/f98 zero size 2024-04-16T14:35:41.256 INFO:tasks.workunit.client.1.smithi115.stdout:7/520: chown d0/d2/d3a/d30/c46 12750 1 2024-04-16T14:35:41.257 INFO:tasks.workunit.client.1.smithi115.stdout:0/488: symlink d6/d30/d8d/laa 0 2024-04-16T14:35:41.262 INFO:tasks.workunit.client.0.smithi005.stdout:9/567: stat d3/d12/c5b 0 2024-04-16T14:35:41.262 INFO:tasks.workunit.client.0.smithi005.stdout:9/568: write d3/d12/d16/d86/f87 [308342,82272] 0 2024-04-16T14:35:41.270 INFO:tasks.workunit.client.1.smithi115.stdout:1/568: symlink df/d13/d4d/d3e/lb9 0 2024-04-16T14:35:41.272 INFO:tasks.workunit.client.1.smithi115.stdout:0/489: creat d6/d10/d12/d31/d35/d9b/fab x:0 0 0 2024-04-16T14:35:41.274 INFO:tasks.workunit.client.1.smithi115.stdout:1/569: link df/f9c df/d13/d4d/d3e/d75/da9/fba 0 2024-04-16T14:35:41.275 INFO:tasks.workunit.client.0.smithi005.stdout:2/597: mkdir d0/d1c/d39/dcb 0 2024-04-16T14:35:41.277 INFO:tasks.workunit.client.0.smithi005.stdout:2/598: symlink d0/d4/d2b/d5e/lcc 0 2024-04-16T14:35:41.277 INFO:tasks.workunit.client.0.smithi005.stdout:2/599: dread - d0/d1c/d59/d7a/d84/fae zero size 2024-04-16T14:35:41.278 INFO:tasks.workunit.client.0.smithi005.stdout:9/569: read d3/d77/f88 [5821365,16984] 0 2024-04-16T14:35:41.279 INFO:tasks.workunit.client.1.smithi115.stdout:1/570: symlink df/d13/d4d/d3e/d75/da9/lbb 0 2024-04-16T14:35:41.279 INFO:tasks.workunit.client.1.smithi115.stdout:1/571: chown df/d13/d4d/d6d/fa7 4463506 1 2024-04-16T14:35:41.279 INFO:tasks.workunit.client.0.smithi005.stdout:2/600: unlink d0/d1c/d8d/cc9 0 2024-04-16T14:35:41.280 INFO:tasks.workunit.client.1.smithi115.stdout:8/630: rename d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/d8a/d94 to d0/db/dbb/dcd 0 2024-04-16T14:35:41.282 INFO:tasks.workunit.client.1.smithi115.stdout:8/631: creat d0/da5/fce x:0 0 0 2024-04-16T14:35:41.283 INFO:tasks.workunit.client.0.smithi005.stdout:2/601: rmdir d0/d1c/d39/d85/da2/dc8 0 2024-04-16T14:35:41.284 INFO:tasks.workunit.client.1.smithi115.stdout:7/521: dwrite d0/d1/d3b/f50 [0,4194304] 0 2024-04-16T14:35:41.284 INFO:tasks.workunit.client.1.smithi115.stdout:4/560: rename d1/d15/d1e/f35 to d1/d15/d17/f9f 0 2024-04-16T14:35:41.285 INFO:tasks.workunit.client.1.smithi115.stdout:2/671: dwrite d0/d47/d65/dad/dbb/d11/f1e [0,4194304] 0 2024-04-16T14:35:41.285 INFO:tasks.workunit.client.1.smithi115.stdout:5/526: dwrite dc/f12 [0,4194304] 0 2024-04-16T14:35:41.285 INFO:tasks.workunit.client.1.smithi115.stdout:5/527: write dc/f1c [1418547,94212] 0 2024-04-16T14:35:41.286 INFO:tasks.workunit.client.1.smithi115.stdout:1/572: rmdir df/d35 39 2024-04-16T14:35:41.293 INFO:tasks.workunit.client.1.smithi115.stdout:4/561: creat d1/d2/fa0 x:0 0 0 2024-04-16T14:35:41.294 INFO:tasks.workunit.client.1.smithi115.stdout:2/672: rmdir d0/d47/d65/dad/dc8/d24/d21/d59 39 2024-04-16T14:35:41.299 INFO:tasks.workunit.client.1.smithi115.stdout:2/673: dread d0/d47/d65/dad/dc8/d4a/fa9 [0,4194304] 0 2024-04-16T14:35:41.302 INFO:tasks.workunit.client.1.smithi115.stdout:8/632: mknod d0/db/d10/d25/ccf 0 2024-04-16T14:35:41.302 INFO:tasks.workunit.client.1.smithi115.stdout:8/633: stat d0/db/d10/d17/d2c/d52/d74/d3b/fb2 0 2024-04-16T14:35:41.302 INFO:tasks.workunit.client.1.smithi115.stdout:8/634: write d0/db/d10/f6d [5161406,46004] 0 2024-04-16T14:35:41.302 INFO:tasks.workunit.client.1.smithi115.stdout:8/635: dread - d0/db/d10/d17/d2c/d52/d84/fb4 zero size 2024-04-16T14:35:41.302 INFO:tasks.workunit.client.1.smithi115.stdout:8/636: write d0/db/f55 [1042729,111198] 0 2024-04-16T14:35:41.303 INFO:tasks.workunit.client.0.smithi005.stdout:1/961: creat d2/d1c/d15/d2a/d19/d42/d71/f149 x:0 0 0 2024-04-16T14:35:41.303 INFO:tasks.workunit.client.0.smithi005.stdout:1/962: symlink d2/d1c/d15/d145/l14a 0 2024-04-16T14:35:41.304 INFO:tasks.workunit.client.0.smithi005.stdout:2/602: dwrite d0/d4/fc0 [0,4194304] 0 2024-04-16T14:35:41.304 INFO:tasks.workunit.client.0.smithi005.stdout:2/603: chown d0/d2a/c32 124 1 2024-04-16T14:35:41.305 INFO:tasks.workunit.client.1.smithi115.stdout:4/562: symlink d1/la1 0 2024-04-16T14:35:41.305 INFO:tasks.workunit.client.1.smithi115.stdout:4/563: getdents d1/d15/d9c 0 2024-04-16T14:35:41.306 INFO:tasks.workunit.client.1.smithi115.stdout:5/528: rmdir dc/d3d/d68 39 2024-04-16T14:35:41.306 INFO:tasks.workunit.client.1.smithi115.stdout:5/529: fdatasync dc/d15/f17 0 2024-04-16T14:35:41.308 INFO:tasks.workunit.client.1.smithi115.stdout:1/573: dwrite df/d36/f6a [0,4194304] 0 2024-04-16T14:35:41.309 INFO:tasks.workunit.client.1.smithi115.stdout:7/522: rename d0/d1/d3b/d3e to d0/d1/d3b/d3f/db0 0 2024-04-16T14:35:41.310 INFO:tasks.workunit.client.1.smithi115.stdout:7/523: dread d0/d24/d2b/fa1 [0,4194304] 0 2024-04-16T14:35:41.310 INFO:tasks.workunit.client.1.smithi115.stdout:7/524: chown d0/d2/d3a/d73/f7d 40860029 1 2024-04-16T14:35:41.310 INFO:tasks.workunit.client.1.smithi115.stdout:7/525: write d0/d1/d3b/d3f/fae [667410,83467] 0 2024-04-16T14:35:41.310 INFO:tasks.workunit.client.1.smithi115.stdout:4/564: symlink d1/d15/d78/la2 0 2024-04-16T14:35:41.311 INFO:tasks.workunit.client.1.smithi115.stdout:2/674: getdents d0/d47/d65/dad/dc8/d22 0 2024-04-16T14:35:41.311 INFO:tasks.workunit.client.0.smithi005.stdout:9/570: mknod d3/d49/d4b/ca0 0 2024-04-16T14:35:41.313 INFO:tasks.workunit.client.1.smithi115.stdout:8/637: dread d0/db/d10/d25/f5f [0,4194304] 0 2024-04-16T14:35:41.316 INFO:tasks.workunit.client.1.smithi115.stdout:4/565: creat d1/d15/d17/fa3 x:0 0 0 2024-04-16T14:35:41.318 INFO:tasks.workunit.client.1.smithi115.stdout:2/675: symlink d0/d47/d65/dad/dc8/d4a/ld4 0 2024-04-16T14:35:41.319 INFO:tasks.workunit.client.1.smithi115.stdout:2/676: fsync d0/d47/d65/dad/dbb/d11/d36/fc1 0 2024-04-16T14:35:41.319 INFO:tasks.workunit.client.0.smithi005.stdout:1/963: read d2/d1c/d15/d2a/d25/f5c [2122015,17415] 0 2024-04-16T14:35:41.320 INFO:tasks.workunit.client.1.smithi115.stdout:8/638: creat d0/db/d10/d17/fd0 x:0 0 0 2024-04-16T14:35:41.320 INFO:tasks.workunit.client.1.smithi115.stdout:8/639: creat d0/db/d10/d17/d2c/d52/d6c/db8/d64/d83/da2/fd1 x:0 0 0 2024-04-16T14:35:41.320 INFO:tasks.workunit.client.0.smithi005.stdout:1/964: mknod d2/d1c/d15/d2a/d19/d20/d27/d73/c14b 0 2024-04-16T14:35:41.321 INFO:tasks.workunit.client.1.smithi115.stdout:5/530: dread dc/d3d/d41/f46 [0,4194304] 0 2024-04-16T14:35:41.322 INFO:tasks.workunit.client.0.smithi005.stdout:1/965: mknod d2/d74/c14c 0 2024-04-16T14:35:41.322 INFO:tasks.workunit.client.0.smithi005.stdout:9/571: dread d3/d12/d2b/f44 [0,4194304] 0 2024-04-16T14:35:41.323 INFO:tasks.workunit.client.0.smithi005.stdout:1/966: symlink d2/d1c/d15/d2a/d19/dc9/l14d 0 2024-04-16T14:35:41.323 INFO:tasks.workunit.client.0.smithi005.stdout:1/967: chown d2/d1c/d15/d2a/d19/d42/d71/dac/d99/ld0 42751671 1 2024-04-16T14:35:41.324 INFO:tasks.workunit.client.0.smithi005.stdout:9/572: truncate d3/d12/d16/d46/d47/d60/f6a 164710 0 2024-04-16T14:35:41.325 INFO:tasks.workunit.client.1.smithi115.stdout:4/566: mkdir d1/d15/d31/d42/da4 0 2024-04-16T14:35:41.325 INFO:tasks.workunit.client.1.smithi115.stdout:4/567: read d1/d15/d31/d55/f7f [622302,8785] 0 2024-04-16T14:35:41.325 INFO:tasks.workunit.client.0.smithi005.stdout:1/968: rename d2/d1c/d15/d2a/f13a to d2/d74/dd7/d11f/d51/dc4/f14e 0 2024-04-16T14:35:41.327 INFO:tasks.workunit.client.0.smithi005.stdout:9/573: truncate d3/d12/d16/f4d 633603 0 2024-04-16T14:35:41.327 INFO:tasks.workunit.client.0.smithi005.stdout:1/969: dread d2/d74/d7a/d100/f116 [0,4194304] 0 2024-04-16T14:35:41.327 INFO:tasks.workunit.client.0.smithi005.stdout:1/970: stat d2/d1c/d15/d2a/d19/d42/d64 0 2024-04-16T14:35:41.327 INFO:tasks.workunit.client.0.smithi005.stdout:1/971: write d2/d1c/d15/d2a/d19/d42/f56 [3509608,74975] 0 2024-04-16T14:35:41.328 INFO:tasks.workunit.client.1.smithi115.stdout:8/640: rename d0/db/d10/d17/d22/f5d to d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/da4/fd2 0 2024-04-16T14:35:41.328 INFO:tasks.workunit.client.1.smithi115.stdout:8/641: write d0/db/d10/d17/d2c/d52/d84/f9c [4310864,901] 0 2024-04-16T14:35:41.328 INFO:tasks.workunit.client.0.smithi005.stdout:9/574: creat d3/d49/d4b/d5c/d65/d9a/fa1 x:0 0 0 2024-04-16T14:35:41.329 INFO:tasks.workunit.client.1.smithi115.stdout:3/652: sync 2024-04-16T14:35:41.330 INFO:tasks.workunit.client.0.smithi005.stdout:1/972: unlink d2/d74/dd7/d11f/f35 0 2024-04-16T14:35:41.334 INFO:tasks.workunit.client.1.smithi115.stdout:3/653: rmdir dc/d24/d33/d4b/da3 39 2024-04-16T14:35:41.334 INFO:tasks.workunit.client.1.smithi115.stdout:3/654: dread - dc/d24/fd2 zero size 2024-04-16T14:35:41.334 INFO:tasks.workunit.client.1.smithi115.stdout:3/655: chown dc/d24/d36/d60/dae/fb1 155290383 1 2024-04-16T14:35:41.336 INFO:tasks.workunit.client.0.smithi005.stdout:2/604: dwrite d0/d4/d2b/d5e/f79 [0,4194304] 0 2024-04-16T14:35:41.337 INFO:tasks.workunit.client.1.smithi115.stdout:3/656: rename dc/d29/d4d/c6e to dc/d24/d33/d4b/cd7 0 2024-04-16T14:35:41.338 INFO:tasks.workunit.client.1.smithi115.stdout:1/574: dwrite df/d35/f65 [0,4194304] 0 2024-04-16T14:35:41.338 INFO:tasks.workunit.client.1.smithi115.stdout:1/575: dread - df/d13/d4d/d68/f71 zero size 2024-04-16T14:35:41.338 INFO:tasks.workunit.client.1.smithi115.stdout:4/568: write d1/d15/d17/f26 [5294805,21682] 0 2024-04-16T14:35:41.339 INFO:tasks.workunit.client.1.smithi115.stdout:3/657: link dc/d29/d4d/c61 dc/d29/d77/cd8 0 2024-04-16T14:35:41.339 INFO:tasks.workunit.client.1.smithi115.stdout:1/576: write df/d36/d3c/f85 [389118,71938] 0 2024-04-16T14:35:41.339 INFO:tasks.workunit.client.1.smithi115.stdout:1/577: write df/d13/d4d/d2c/f33 [4965033,114644] 0 2024-04-16T14:35:41.339 INFO:tasks.workunit.client.1.smithi115.stdout:1/578: write df/d13/d72/fa2 [694452,61359] 0 2024-04-16T14:35:41.340 INFO:tasks.workunit.client.1.smithi115.stdout:1/579: chown df/d35/f88 16 1 2024-04-16T14:35:41.341 INFO:tasks.workunit.client.1.smithi115.stdout:4/569: symlink d1/la5 0 2024-04-16T14:35:41.344 INFO:tasks.workunit.client.0.smithi005.stdout:2/605: truncate d0/d29/d3e/fba 161227 0 2024-04-16T14:35:41.344 INFO:tasks.workunit.client.0.smithi005.stdout:2/606: read d0/d29/f49 [2248594,125103] 0 2024-04-16T14:35:41.344 INFO:tasks.workunit.client.0.smithi005.stdout:2/607: creat d0/d4/d2b/d5e/d9a/fcd x:0 0 0 2024-04-16T14:35:41.344 INFO:tasks.workunit.client.1.smithi115.stdout:9/598: sync 2024-04-16T14:35:41.345 INFO:tasks.workunit.client.1.smithi115.stdout:6/598: sync 2024-04-16T14:35:41.346 INFO:tasks.workunit.client.1.smithi115.stdout:1/580: getdents df/d13/d4d 0 2024-04-16T14:35:41.346 INFO:tasks.workunit.client.1.smithi115.stdout:9/599: write d1/d6/d2d/d4b/d6c/f44 [104298,72530] 0 2024-04-16T14:35:41.346 INFO:tasks.workunit.client.1.smithi115.stdout:1/581: chown df/d2d/d83/fb8 3215946 1 2024-04-16T14:35:41.347 INFO:tasks.workunit.client.1.smithi115.stdout:4/570: mknod d1/d15/d24/d83/ca6 0 2024-04-16T14:35:41.347 INFO:tasks.workunit.client.0.smithi005.stdout:2/608: truncate d0/d2a/d3a/fc2 208395 0 2024-04-16T14:35:41.351 INFO:tasks.workunit.client.0.smithi005.stdout:2/609: link d0/d29/d3e/f42 d0/d1c/d59/d67/fce 0 2024-04-16T14:35:41.351 INFO:tasks.workunit.client.0.smithi005.stdout:2/610: chown d0/f27 148 1 2024-04-16T14:35:41.351 INFO:tasks.workunit.client.1.smithi115.stdout:6/599: creat d13/d1d/d52/d8c/fc3 x:0 0 0 2024-04-16T14:35:41.351 INFO:tasks.workunit.client.1.smithi115.stdout:6/600: creat d13/d1d/d52/d8c/fc4 x:0 0 0 2024-04-16T14:35:41.353 INFO:tasks.workunit.client.1.smithi115.stdout:6/601: write d13/d1d/d2b/d5f/d30/d43/da6/f6b [59135,116323] 0 2024-04-16T14:35:41.354 INFO:tasks.workunit.client.0.smithi005.stdout:2/611: creat d0/d1c/d59/d7a/fcf x:0 0 0 2024-04-16T14:35:41.354 INFO:tasks.workunit.client.0.smithi005.stdout:2/612: dread - d0/d1c/d39/fb3 zero size 2024-04-16T14:35:41.354 INFO:tasks.workunit.client.0.smithi005.stdout:2/613: symlink d0/d1c/d39/dcb/ld0 0 2024-04-16T14:35:41.354 INFO:tasks.workunit.client.0.smithi005.stdout:2/614: chown d0/d1c/d59/f5a 25061 1 2024-04-16T14:35:41.355 INFO:tasks.workunit.client.0.smithi005.stdout:2/615: rename d0/d4/d2b/d5e to d0/d4/d2b/d5e/dd1 22 2024-04-16T14:35:41.355 INFO:tasks.workunit.client.1.smithi115.stdout:1/582: creat df/d13/d4d/d2c/d54/fbc x:0 0 0 2024-04-16T14:35:41.355 INFO:tasks.workunit.client.1.smithi115.stdout:1/583: dread - df/d36/d3c/fb6 zero size 2024-04-16T14:35:41.356 INFO:tasks.workunit.client.1.smithi115.stdout:9/600: mkdir d1/d6/d2d/d4b/d6c/d20/d36/dce 0 2024-04-16T14:35:41.356 INFO:tasks.workunit.client.0.smithi005.stdout:2/616: mkdir d0/d29/d3e/dd2 0 2024-04-16T14:35:41.356 INFO:tasks.workunit.client.0.smithi005.stdout:2/617: getdents d0/d4/d2b 0 2024-04-16T14:35:41.356 INFO:tasks.workunit.client.0.smithi005.stdout:2/618: chown d0/c69 264606 1 2024-04-16T14:35:41.356 INFO:tasks.workunit.client.0.smithi005.stdout:2/619: truncate d0/d4/d2b/f17 768473 0 2024-04-16T14:35:41.357 INFO:tasks.workunit.client.1.smithi115.stdout:4/571: creat d1/d15/d31/d89/fa7 x:0 0 0 2024-04-16T14:35:41.359 INFO:tasks.workunit.client.0.smithi005.stdout:2/620: link d0/d2a/d3a/d46/fbf d0/d1c/d39/dcb/fd3 0 2024-04-16T14:35:41.361 INFO:tasks.workunit.client.1.smithi115.stdout:1/584: mknod df/d13/d4d/d68/da0/cbd 0 2024-04-16T14:35:41.361 INFO:tasks.workunit.client.1.smithi115.stdout:1/585: chown df/d13/d4d/f34 1 1 2024-04-16T14:35:41.361 INFO:tasks.workunit.client.0.smithi005.stdout:2/621: link d0/d29/d89/f8b d0/d1c/d39/fd4 0 2024-04-16T14:35:41.361 INFO:tasks.workunit.client.0.smithi005.stdout:2/622: write d0/d1c/d59/d7a/d84/fbc [643665,88872] 0 2024-04-16T14:35:41.361 INFO:tasks.workunit.client.0.smithi005.stdout:2/623: chown d0/d2a/d3a/d46/f5d 76293 1 2024-04-16T14:35:41.362 INFO:tasks.workunit.client.1.smithi115.stdout:7/526: rmdir d0/d1/d3b 39 2024-04-16T14:35:41.363 INFO:tasks.workunit.client.0.smithi005.stdout:2/624: symlink d0/d1c/d39/dcb/ld5 0 2024-04-16T14:35:41.363 INFO:tasks.workunit.client.0.smithi005.stdout:2/625: creat d0/fd6 x:0 0 0 2024-04-16T14:35:41.363 INFO:tasks.workunit.client.1.smithi115.stdout:9/601: truncate d1/d6/d2d/d4b/d6c/d20/d36/f9f 3912162 0 2024-04-16T14:35:41.363 INFO:tasks.workunit.client.1.smithi115.stdout:9/602: dread - d1/d6/d2d/d4b/d6c/fae zero size 2024-04-16T14:35:41.363 INFO:tasks.workunit.client.1.smithi115.stdout:9/603: write d1/d6/d2d/d4b/d6c/d20/fa6 [1142210,119573] 0 2024-04-16T14:35:41.364 INFO:tasks.workunit.client.1.smithi115.stdout:2/677: dwrite d0/d47/d65/f7b [4194304,4194304] 0 2024-04-16T14:35:41.364 INFO:tasks.workunit.client.0.smithi005.stdout:9/575: dwrite d3/d12/d16/d46/f9b [0,4194304] 0 2024-04-16T14:35:41.365 INFO:tasks.workunit.client.0.smithi005.stdout:9/576: creat d3/fa2 x:0 0 0 2024-04-16T14:35:41.365 INFO:tasks.workunit.client.1.smithi115.stdout:5/531: dwrite f1 [4194304,4194304] 0 2024-04-16T14:35:41.365 INFO:tasks.workunit.client.1.smithi115.stdout:3/658: dread dc/f11 [0,4194304] 0 2024-04-16T14:35:41.365 INFO:tasks.workunit.client.1.smithi115.stdout:3/659: chown dc/d24/d33/d4b/da3/d69/fb4 19525111 1 2024-04-16T14:35:41.365 INFO:tasks.workunit.client.1.smithi115.stdout:3/660: dread - dc/d24/d36/d60/dae/fb1 zero size 2024-04-16T14:35:41.366 INFO:tasks.workunit.client.1.smithi115.stdout:4/572: creat d1/d15/d31/d42/d46/fa8 x:0 0 0 2024-04-16T14:35:41.367 INFO:tasks.workunit.client.1.smithi115.stdout:1/586: mkdir df/d13/d4d/d2c/d54/dbe 0 2024-04-16T14:35:41.367 INFO:tasks.workunit.client.0.smithi005.stdout:2/626: dread d0/d2a/fa8 [0,4194304] 0 2024-04-16T14:35:41.368 INFO:tasks.workunit.client.1.smithi115.stdout:8/642: dwrite d0/db/d10/d17/d2c/d52/d6c/d71/fb9 [0,4194304] 0 2024-04-16T14:35:41.368 INFO:tasks.workunit.client.1.smithi115.stdout:8/643: write d0/db/d10/d25/f5f [9255668,125130] 0 2024-04-16T14:35:41.369 INFO:tasks.workunit.client.0.smithi005.stdout:1/973: dwrite d2/d74/dd7/f8f [0,4194304] 0 2024-04-16T14:35:41.369 INFO:tasks.workunit.client.0.smithi005.stdout:9/577: fdatasync d3/f3b 0 2024-04-16T14:35:41.369 INFO:tasks.workunit.client.1.smithi115.stdout:7/527: rename d0/d1/d3b to d0/d24/da3/db1 0 2024-04-16T14:35:41.371 INFO:tasks.workunit.client.0.smithi005.stdout:1/974: link d2/d74/dd7/l137 d2/d74/dd7/d11f/d51/dc4/l14f 0 2024-04-16T14:35:41.372 INFO:tasks.workunit.client.1.smithi115.stdout:2/678: dread d0/d47/d65/dad/dc8/ff [0,4194304] 0 2024-04-16T14:35:41.372 INFO:tasks.workunit.client.1.smithi115.stdout:6/602: dwrite d13/d1d/d2b/d5f/d30/d43/da6/d5a/fba [0,4194304] 0 2024-04-16T14:35:41.372 INFO:tasks.workunit.client.1.smithi115.stdout:9/604: creat d1/d6/d2d/d4b/d6c/d20/d36/fcf x:0 0 0 2024-04-16T14:35:41.375 INFO:tasks.workunit.client.1.smithi115.stdout:5/532: mkdir dc/d15/d4d/daa 0 2024-04-16T14:35:41.376 INFO:tasks.workunit.client.0.smithi005.stdout:2/627: mkdir d0/d2a/d3a/d94/dd7 0 2024-04-16T14:35:41.376 INFO:tasks.workunit.client.0.smithi005.stdout:2/628: write d0/d2a/d3a/d46/fbf [334603,73103] 0 2024-04-16T14:35:41.376 INFO:tasks.workunit.client.0.smithi005.stdout:2/629: chown d0/d4/d2b/d6b/c87 502100 1 2024-04-16T14:35:41.377 INFO:tasks.workunit.client.0.smithi005.stdout:1/975: symlink d2/d74/d7a/l150 0 2024-04-16T14:35:41.377 INFO:tasks.workunit.client.0.smithi005.stdout:1/976: write d2/d1c/d15/d2a/d19/d42/d71/f75 [200687,50294] 0 2024-04-16T14:35:41.377 INFO:tasks.workunit.client.0.smithi005.stdout:1/977: fdatasync d2/d74/dd7/d11f/d51/f6a 0 2024-04-16T14:35:41.377 INFO:tasks.workunit.client.0.smithi005.stdout:1/978: creat d2/d74/dd7/d11f/d51/d132/dcd/f151 x:0 0 0 2024-04-16T14:35:41.378 INFO:tasks.workunit.client.0.smithi005.stdout:2/630: stat d0/d2a/d3a/f55 0 2024-04-16T14:35:41.378 INFO:tasks.workunit.client.1.smithi115.stdout:3/661: mkdir dc/d24/d33/d4b/dd3/dd9 0 2024-04-16T14:35:41.378 INFO:tasks.workunit.client.1.smithi115.stdout:3/662: write f6 [963447,43755] 0 2024-04-16T14:35:41.378 INFO:tasks.workunit.client.1.smithi115.stdout:3/663: chown dc/d24/d33/d4b/da3 1738833 1 2024-04-16T14:35:41.378 INFO:tasks.workunit.client.1.smithi115.stdout:3/664: write dc/f27 [1845024,104491] 0 2024-04-16T14:35:41.379 INFO:tasks.workunit.client.1.smithi115.stdout:1/587: truncate df/d13/d4d/d2c/f21 1179875 0 2024-04-16T14:35:41.379 INFO:tasks.workunit.client.1.smithi115.stdout:1/588: read - df/d13/d4d/d3e/d75/f8c zero size 2024-04-16T14:35:41.383 INFO:tasks.workunit.client.1.smithi115.stdout:8/644: symlink d0/db/d10/d17/d2c/d52/ld3 0 2024-04-16T14:35:41.386 INFO:tasks.workunit.client.0.smithi005.stdout:1/979: link d2/d74/dd7/d11f/d51/d132/dcd/lff d2/d1c/d15/d2a/l152 0 2024-04-16T14:35:41.386 INFO:tasks.workunit.client.0.smithi005.stdout:1/980: write d2/d1c/d15/d6f/f8d [4850147,120655] 0 2024-04-16T14:35:41.387 INFO:tasks.workunit.client.1.smithi115.stdout:4/573: rename d1/d15/d31/d42/d46/fa8 to d1/d15/d17/fa9 0 2024-04-16T14:35:41.387 INFO:tasks.workunit.client.1.smithi115.stdout:9/605: dread d1/d6/f17 [0,4194304] 0 2024-04-16T14:35:41.387 INFO:tasks.workunit.client.1.smithi115.stdout:9/606: fsync d1/d6/d2d/d4b/d60/fbb 0 2024-04-16T14:35:41.387 INFO:tasks.workunit.client.1.smithi115.stdout:2/679: dwrite d0/d47/d65/dad/dbb/d11/d6d/fbd [0,4194304] 0 2024-04-16T14:35:41.388 INFO:tasks.workunit.client.0.smithi005.stdout:2/631: unlink d0/d1c/d39/d85/cb1 0 2024-04-16T14:35:41.388 INFO:tasks.workunit.client.1.smithi115.stdout:7/528: rmdir d0/d24/d2b/d9c 39 2024-04-16T14:35:41.389 INFO:tasks.workunit.client.1.smithi115.stdout:7/529: dread d0/d24/d2b/d9c/faa [0,4194304] 0 2024-04-16T14:35:41.389 INFO:tasks.workunit.client.1.smithi115.stdout:7/530: chown d0/d2/d3a/d30/f74 61616210 1 2024-04-16T14:35:41.389 INFO:tasks.workunit.client.1.smithi115.stdout:7/531: fsync d0/d24/f37 0 2024-04-16T14:35:41.400 INFO:tasks.workunit.client.0.smithi005.stdout:1/981: dread d2/d74/dd7/d11f/d51/f117 [0,4194304] 0 2024-04-16T14:35:41.400 INFO:tasks.workunit.client.0.smithi005.stdout:1/982: write d2/d1c/d15/d2a/d19/d42/d71/dac/f9f [1958217,44417] 0 2024-04-16T14:35:41.401 INFO:tasks.workunit.client.0.smithi005.stdout:1/983: symlink d2/d1c/d15/d2a/d19/d42/d64/l153 0 2024-04-16T14:35:41.404 INFO:tasks.workunit.client.0.smithi005.stdout:2/632: dread d0/d1c/d59/d67/fce [0,4194304] 0 2024-04-16T14:35:41.404 INFO:tasks.workunit.client.0.smithi005.stdout:2/633: chown d0/d4/d2b/f1a 70 1 2024-04-16T14:35:41.404 INFO:tasks.workunit.client.0.smithi005.stdout:2/634: chown d0/d1c/d39 346775289 1 2024-04-16T14:35:41.404 INFO:tasks.workunit.client.0.smithi005.stdout:2/635: readlink d0/d1c/d59/d67/lb9 0 2024-04-16T14:35:41.405 INFO:tasks.workunit.client.0.smithi005.stdout:5/774: sync 2024-04-16T14:35:41.405 INFO:tasks.workunit.client.0.smithi005.stdout:5/775: stat d0/d6/d12/d1c/dd2/ffd 0 2024-04-16T14:35:41.405 INFO:tasks.workunit.client.0.smithi005.stdout:5/776: dread - d0/d6/d12/de4/f102 zero size 2024-04-16T14:35:41.405 INFO:tasks.workunit.client.0.smithi005.stdout:5/777: read d0/d6/d12/dc0/d42/fc8 [1870114,36983] 0 2024-04-16T14:35:41.405 INFO:tasks.workunit.client.1.smithi115.stdout:5/533: unlink dc/c57 0 2024-04-16T14:35:41.412 INFO:tasks.workunit.client.1.smithi115.stdout:1/589: rmdir df/d13/d4d/d3e/d75/da9 39 2024-04-16T14:35:41.416 INFO:tasks.workunit.client.1.smithi115.stdout:6/603: rename d13/d1d/d2b/d5f/d30/d43/da6/d5a/fb7 to d13/d1d/d2b/d5f/d30/d43/da6/d63/fc5 0 2024-04-16T14:35:41.417 INFO:tasks.workunit.client.1.smithi115.stdout:4/574: truncate d1/d15/d1e/f43 3896112 0 2024-04-16T14:35:41.417 INFO:tasks.workunit.client.1.smithi115.stdout:6/604: write d13/d1d/d52/d8c/f98 [48288,22829] 0 2024-04-16T14:35:41.420 INFO:tasks.workunit.client.1.smithi115.stdout:2/680: link d0/c28 d0/d47/d65/dad/dbb/d11/d25/d95/cd5 0 2024-04-16T14:35:41.421 INFO:tasks.workunit.client.1.smithi115.stdout:5/534: creat dc/d8e/fab x:0 0 0 2024-04-16T14:35:41.423 INFO:tasks.workunit.client.1.smithi115.stdout:1/590: mkdir df/d36/d94/dbf 0 2024-04-16T14:35:41.425 INFO:tasks.workunit.client.1.smithi115.stdout:8/645: link d0/db/d10/c41 d0/db/d10/d17/d2c/d52/d6c/db8/d64/d83/cd4 0 2024-04-16T14:35:41.425 INFO:tasks.workunit.client.1.smithi115.stdout:8/646: write d0/db/d10/d17/d2c/d52/f99 [147394,36601] 0 2024-04-16T14:35:41.425 INFO:tasks.workunit.client.1.smithi115.stdout:8/647: chown d0/db/dbb/dcd/fc6 1 1 2024-04-16T14:35:41.426 INFO:tasks.workunit.client.1.smithi115.stdout:4/575: read d1/d15/d17/f26 [3682521,61334] 0 2024-04-16T14:35:41.428 INFO:tasks.workunit.client.1.smithi115.stdout:2/681: creat d0/d47/d65/dad/dc8/d24/d21/d59/fd6 x:0 0 0 2024-04-16T14:35:41.430 INFO:tasks.workunit.client.1.smithi115.stdout:5/535: unlink dc/d15/d35/d87/la5 0 2024-04-16T14:35:41.431 INFO:tasks.workunit.client.1.smithi115.stdout:1/591: rename df/d13/d4d/d2c/c99 to df/d13/d4d/d2c/d54/d55/cc0 0 2024-04-16T14:35:41.433 INFO:tasks.workunit.client.1.smithi115.stdout:2/682: unlink d0/d1b/cd0 0 2024-04-16T14:35:41.434 INFO:tasks.workunit.client.1.smithi115.stdout:5/536: write dc/d15/f53 [1199372,72232] 0 2024-04-16T14:35:41.434 INFO:tasks.workunit.client.1.smithi115.stdout:5/537: fdatasync dc/d15/f18 0 2024-04-16T14:35:41.436 INFO:tasks.workunit.client.1.smithi115.stdout:1/592: creat df/d13/d4d/d3e/d75/da9/db7/fc1 x:0 0 0 2024-04-16T14:35:41.438 INFO:tasks.workunit.client.1.smithi115.stdout:2/683: getdents d0/d47/d65/dad/dc8/d24/d23/d83 0 2024-04-16T14:35:41.438 INFO:tasks.workunit.client.1.smithi115.stdout:2/684: truncate d0/d47/d65/dad/dc8/d24/d23/f8d 405795 0 2024-04-16T14:35:41.441 INFO:tasks.workunit.client.1.smithi115.stdout:5/538: unlink dc/d15/l25 0 2024-04-16T14:35:41.443 INFO:tasks.workunit.client.0.smithi005.stdout:1/984: write d2/d1c/d15/d2a/d19/d20/d27/fe7 [3201245,51153] 0 2024-04-16T14:35:41.444 INFO:tasks.workunit.client.1.smithi115.stdout:2/685: rename d0/d47/d65/dad/dc8/d24/d21/fa5 to d0/d47/d65/dad/dc8/d24/d23/d83/fd7 0 2024-04-16T14:35:41.444 INFO:tasks.workunit.client.1.smithi115.stdout:2/686: write d0/d47/d65/dad/dc8/f3a [2968632,130030] 0 2024-04-16T14:35:41.444 INFO:tasks.workunit.client.1.smithi115.stdout:2/687: creat d0/d47/d65/dad/dbb/d11/d36/fd8 x:0 0 0 2024-04-16T14:35:41.444 INFO:tasks.workunit.client.1.smithi115.stdout:2/688: dread - d0/d47/d65/dad/dc8/d24/d21/f74 zero size 2024-04-16T14:35:41.444 INFO:tasks.workunit.client.1.smithi115.stdout:2/689: write d0/fa1 [546353,35476] 0 2024-04-16T14:35:41.444 INFO:tasks.workunit.client.1.smithi115.stdout:2/690: fsync d0/d47/f94 0 2024-04-16T14:35:41.446 INFO:tasks.workunit.client.1.smithi115.stdout:2/691: link d0/d47/d65/dad/dc8/d24/d23/f9c d0/d47/d65/dad/dc8/d24/da0/fd9 0 2024-04-16T14:35:41.450 INFO:tasks.workunit.client.0.smithi005.stdout:5/778: dread d0/d6/d12/dc0/d30/fd5 [0,4194304] 0 2024-04-16T14:35:41.450 INFO:tasks.workunit.client.0.smithi005.stdout:5/779: stat d0/d6/d12/d1c/dd2/lf1 0 2024-04-16T14:35:41.450 INFO:tasks.workunit.client.0.smithi005.stdout:5/780: chown d0/d6/d103 3788 1 2024-04-16T14:35:41.450 INFO:tasks.workunit.client.0.smithi005.stdout:5/781: mknod d0/d6/d12/dc0/d8d/dd8/c10f 0 2024-04-16T14:35:41.451 INFO:tasks.workunit.client.1.smithi115.stdout:3/665: dwrite dc/f16 [0,4194304] 0 2024-04-16T14:35:41.453 INFO:tasks.workunit.client.0.smithi005.stdout:5/782: link d0/d6/d12/dc0/l5c d0/l110 0 2024-04-16T14:35:41.455 INFO:tasks.workunit.client.1.smithi115.stdout:3/666: rename dc/d24/d36/d60/f78 to dc/d29/fda 0 2024-04-16T14:35:41.457 INFO:tasks.workunit.client.1.smithi115.stdout:3/667: creat dc/fdb x:0 0 0 2024-04-16T14:35:41.458 INFO:tasks.workunit.client.1.smithi115.stdout:3/668: link dc/d24/d33/d4b/da3/d69/fb2 dc/d29/d77/fdc 0 2024-04-16T14:35:41.460 INFO:tasks.workunit.client.1.smithi115.stdout:3/669: rename dc/d29/d39/d86/f8b to dc/d29/d4d/d56/d98/dbe/dd6/fdd 0 2024-04-16T14:35:41.462 INFO:tasks.workunit.client.1.smithi115.stdout:3/670: rename dc/d24/d80/dcc to dc/d24/d33/dde 0 2024-04-16T14:35:41.463 INFO:tasks.workunit.client.1.smithi115.stdout:3/671: link dc/d29/d4d/d56/d8a/fc2 dc/d24/d33/d4b/d81/fdf 0 2024-04-16T14:35:41.464 INFO:tasks.workunit.client.1.smithi115.stdout:3/672: mkdir dc/d24/d33/d4b/dd3/dd9/de0 0 2024-04-16T14:35:41.470 INFO:tasks.workunit.client.0.smithi005.stdout:5/783: dread d0/d6/d12/d1c/f22 [0,4194304] 0 2024-04-16T14:35:41.477 INFO:tasks.workunit.client.0.smithi005.stdout:5/784: write d0/d6/d6e/d9e/fdf [3836052,123249] 0 2024-04-16T14:35:41.480 INFO:tasks.workunit.client.0.smithi005.stdout:5/785: rmdir d0/d6/d12/d1c 39 2024-04-16T14:35:41.481 INFO:tasks.workunit.client.0.smithi005.stdout:5/786: truncate d0/d6/d12/dc0/d8d/dd8/f9a 2224664 0 2024-04-16T14:35:41.487 INFO:tasks.workunit.client.0.smithi005.stdout:5/787: dread d0/d6/d12/f41 [0,4194304] 0 2024-04-16T14:35:41.488 INFO:tasks.workunit.client.0.smithi005.stdout:5/788: unlink d0/d6/d12/dc0/d30/ffc 0 2024-04-16T14:35:41.489 INFO:tasks.workunit.client.0.smithi005.stdout:5/789: stat d0/d6/d6e/d9e 0 2024-04-16T14:35:41.489 INFO:tasks.workunit.client.0.smithi005.stdout:5/790: write d0/d6/d12/dc0/d8d/dd8/fa2 [876581,191] 0 2024-04-16T14:35:41.494 INFO:tasks.workunit.client.0.smithi005.stdout:5/791: dread d0/d6/d12/d1c/d81/d82/f88 [0,4194304] 0 2024-04-16T14:35:41.495 INFO:tasks.workunit.client.0.smithi005.stdout:5/792: mkdir d0/d6/d103/d111 0 2024-04-16T14:35:41.502 INFO:tasks.workunit.client.1.smithi115.stdout:9/607: dwrite d1/d6/d2d/d4b/d60/fbb [0,4194304] 0 2024-04-16T14:35:41.506 INFO:tasks.workunit.client.1.smithi115.stdout:7/532: dwrite d0/d24/da3/db1/d3f/f7b [0,4194304] 0 2024-04-16T14:35:41.507 INFO:tasks.workunit.client.0.smithi005.stdout:9/578: dwrite d3/d12/d16/d46/d47/d60/f6a [0,4194304] 0 2024-04-16T14:35:41.507 INFO:tasks.workunit.client.1.smithi115.stdout:9/608: getdents d1/d6/d2d/d4b/d60 0 2024-04-16T14:35:41.507 INFO:tasks.workunit.client.1.smithi115.stdout:9/609: chown d1/d6/d2d/d4b/d6c/d20/d36/cb4 7796525 1 2024-04-16T14:35:41.509 INFO:tasks.workunit.client.0.smithi005.stdout:9/579: creat d3/d49/d4b/d5c/d65/fa3 x:0 0 0 2024-04-16T14:35:41.513 INFO:tasks.workunit.client.0.smithi005.stdout:9/580: rename d3/f3b to d3/d49/d4b/fa4 0 2024-04-16T14:35:41.513 INFO:tasks.workunit.client.0.smithi005.stdout:2/636: dwrite d0/d2a/d3a/f95 [0,4194304] 0 2024-04-16T14:35:41.514 INFO:tasks.workunit.client.1.smithi115.stdout:6/605: dwrite d13/d1d/d47/fab [0,4194304] 0 2024-04-16T14:35:41.514 INFO:tasks.workunit.client.1.smithi115.stdout:6/606: creat d13/d1d/d68/fc6 x:0 0 0 2024-04-16T14:35:41.514 INFO:tasks.workunit.client.1.smithi115.stdout:6/607: chown d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/fa4 3581376 1 2024-04-16T14:35:41.514 INFO:tasks.workunit.client.1.smithi115.stdout:6/608: creat d13/d1d/d52/d8c/fc7 x:0 0 0 2024-04-16T14:35:41.514 INFO:tasks.workunit.client.1.smithi115.stdout:6/609: chown d13/d1d/d2b/d5f/d30/d43/da6/faf 125651 1 2024-04-16T14:35:41.514 INFO:tasks.workunit.client.1.smithi115.stdout:8/648: dwrite d0/db/d10/d17/d2c/f60 [4194304,4194304] 0 2024-04-16T14:35:41.515 INFO:tasks.workunit.client.0.smithi005.stdout:1/985: dwrite d2/d1c/d15/f1d [0,4194304] 0 2024-04-16T14:35:41.515 INFO:tasks.workunit.client.0.smithi005.stdout:9/581: truncate d3/d12/d16/f51 5096664 0 2024-04-16T14:35:41.515 INFO:tasks.workunit.client.1.smithi115.stdout:5/539: dwrite dc/f34 [0,4194304] 0 2024-04-16T14:35:41.515 INFO:tasks.workunit.client.1.smithi115.stdout:2/692: dwrite d0/d1b/fc0 [0,4194304] 0 2024-04-16T14:35:41.515 INFO:tasks.workunit.client.1.smithi115.stdout:5/540: fsync dc/d5d/d8f/f92 0 2024-04-16T14:35:41.515 INFO:tasks.workunit.client.1.smithi115.stdout:4/576: dwrite d1/d15/d17/fa9 [0,4194304] 0 2024-04-16T14:35:41.515 INFO:tasks.workunit.client.1.smithi115.stdout:4/577: chown d1/d15/d24/c4f 24 1 2024-04-16T14:35:41.515 INFO:tasks.workunit.client.1.smithi115.stdout:3/673: dwrite dc/d24/d36/d60/fc8 [0,4194304] 0 2024-04-16T14:35:41.515 INFO:tasks.workunit.client.1.smithi115.stdout:3/674: write dc/d24/f6c [1417363,118364] 0 2024-04-16T14:35:41.516 INFO:tasks.workunit.client.1.smithi115.stdout:3/675: stat dc/d29/d4d/f59 0 2024-04-16T14:35:41.516 INFO:tasks.workunit.client.1.smithi115.stdout:1/593: dwrite df/d13/d4d/d3e/d75/f8c [0,4194304] 0 2024-04-16T14:35:41.516 INFO:tasks.workunit.client.1.smithi115.stdout:1/594: stat df/d35/d84/f91 0 2024-04-16T14:35:41.516 INFO:tasks.workunit.client.1.smithi115.stdout:1/595: readlink df/d13/d4d/d2c/d54/la3 0 2024-04-16T14:35:41.516 INFO:tasks.workunit.client.0.smithi005.stdout:1/986: dread d2/d74/dd7/d11f/d51/fc3 [0,4194304] 0 2024-04-16T14:35:41.516 INFO:tasks.workunit.client.0.smithi005.stdout:1/987: stat d2/lf2 0 2024-04-16T14:35:41.522 INFO:tasks.workunit.client.1.smithi115.stdout:6/610: link d13/d1d/d87/f79 d13/d1d/d47/fc8 0 2024-04-16T14:35:41.523 INFO:tasks.workunit.client.1.smithi115.stdout:9/610: truncate d1/d6/d2d/d4b/d6c/d20/fa6 993995 0 2024-04-16T14:35:41.523 INFO:tasks.workunit.client.0.smithi005.stdout:9/582: symlink d3/d49/d4b/la5 0 2024-04-16T14:35:41.523 INFO:tasks.workunit.client.0.smithi005.stdout:9/583: dread - d3/d77/f8f zero size 2024-04-16T14:35:41.527 INFO:tasks.workunit.client.1.smithi115.stdout:7/533: dwrite d0/d2/d3a/d30/f98 [0,4194304] 0 2024-04-16T14:35:41.527 INFO:tasks.workunit.client.1.smithi115.stdout:7/534: truncate d0/d24/da3/db1/d3f/db0/f89 960539 0 2024-04-16T14:35:41.527 INFO:tasks.workunit.client.1.smithi115.stdout:7/535: write d0/d2/d3a/d30/d6b/da2/d81/fa6 [33977,47344] 0 2024-04-16T14:35:41.527 INFO:tasks.workunit.client.1.smithi115.stdout:8/649: dread d0/db/d10/d17/d2c/d52/d74/f35 [4194304,4194304] 0 2024-04-16T14:35:41.528 INFO:tasks.workunit.client.1.smithi115.stdout:2/693: rename d0/d47/d65/dad/dc8/d24/fca to d0/d47/d65/dad/dbb/d11/d25/fda 0 2024-04-16T14:35:41.528 INFO:tasks.workunit.client.0.smithi005.stdout:2/637: rename d0/d4/d2b/d6b to d0/d2a/d3a/d46/dd8 0 2024-04-16T14:35:41.530 INFO:tasks.workunit.client.0.smithi005.stdout:1/988: rename d2/d74/dd7/d11f/d51/f6a to d2/d1c/d15/d2a/d19/dc9/de0/f154 0 2024-04-16T14:35:41.533 INFO:tasks.workunit.client.0.smithi005.stdout:2/638: rename d0/d1c/c4e to d0/d1c/d59/d67/cd9 0 2024-04-16T14:35:41.533 INFO:tasks.workunit.client.0.smithi005.stdout:2/639: stat d0/d1c/d59/d7a/d84 0 2024-04-16T14:35:41.533 INFO:tasks.workunit.client.0.smithi005.stdout:2/640: truncate d0/f2 5168908 0 2024-04-16T14:35:41.533 INFO:tasks.workunit.client.0.smithi005.stdout:2/641: fsync d0/d1c/d59/d67/fce 0 2024-04-16T14:35:41.533 INFO:tasks.workunit.client.0.smithi005.stdout:2/642: creat d0/d1c/d59/d7a/fda x:0 0 0 2024-04-16T14:35:41.533 INFO:tasks.workunit.client.0.smithi005.stdout:2/643: write d0/d1c/d59/d7a/fcf [642330,69438] 0 2024-04-16T14:35:41.533 INFO:tasks.workunit.client.0.smithi005.stdout:1/989: rmdir d2/d1c/d15/d2a/d1a 39 2024-04-16T14:35:41.537 INFO:tasks.workunit.client.1.smithi115.stdout:3/676: mkdir dc/d24/d33/d4b/da3/d69/de1 0 2024-04-16T14:35:41.538 INFO:tasks.workunit.client.0.smithi005.stdout:1/990: mkdir d2/d1c/d15/d2a/d19/d42/d71/dac/d99/d155 0 2024-04-16T14:35:41.539 INFO:tasks.workunit.client.0.smithi005.stdout:9/584: write d3/d12/d16/d46/d47/d60/f6a [256587,104419] 0 2024-04-16T14:35:41.539 INFO:tasks.workunit.client.1.smithi115.stdout:2/694: write d0/d47/d65/dad/dc8/d57/f67 [1333656,103789] 0 2024-04-16T14:35:41.540 INFO:tasks.workunit.client.0.smithi005.stdout:1/991: mknod d2/d1c/d15/d2a/c156 0 2024-04-16T14:35:41.551 INFO:tasks.workunit.client.1.smithi115.stdout:1/596: creat df/d36/d94/dbf/fc2 x:0 0 0 2024-04-16T14:35:41.552 INFO:tasks.workunit.client.0.smithi005.stdout:8/744: sync 2024-04-16T14:35:41.552 INFO:tasks.workunit.client.1.smithi115.stdout:6/611: symlink d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/dbc/lc9 0 2024-04-16T14:35:41.553 INFO:tasks.workunit.client.0.smithi005.stdout:8/745: creat d5/d7b/da8/db7/d8a/da1/d3d/dba/dcd/f106 x:0 0 0 2024-04-16T14:35:41.554 INFO:tasks.workunit.client.0.smithi005.stdout:8/746: link d5/d55/f6b d5/d40/d8e/dfe/f107 0 2024-04-16T14:35:41.555 INFO:tasks.workunit.client.0.smithi005.stdout:8/747: rmdir d5/d7b/da8/db7/d8a/da1/d68/dcb 39 2024-04-16T14:35:41.555 INFO:tasks.workunit.client.1.smithi115.stdout:5/541: dwrite dc/d15/f78 [0,4194304] 0 2024-04-16T14:35:41.555 INFO:tasks.workunit.client.1.smithi115.stdout:5/542: readlink dc/d3d/d68/d7b/l90 0 2024-04-16T14:35:41.556 INFO:tasks.workunit.client.0.smithi005.stdout:2/644: fsync d0/d1c/d59/d7a/fcf 0 2024-04-16T14:35:41.556 INFO:tasks.workunit.client.1.smithi115.stdout:7/536: symlink d0/d2/d3a/dac/lb2 0 2024-04-16T14:35:41.557 INFO:tasks.workunit.client.0.smithi005.stdout:2/645: symlink d0/d4/d2b/d5e/ldb 0 2024-04-16T14:35:41.558 INFO:tasks.workunit.client.0.smithi005.stdout:2/646: creat d0/d4/d2b/d5e/d9a/fdc x:0 0 0 2024-04-16T14:35:41.558 INFO:tasks.workunit.client.0.smithi005.stdout:8/748: dread d5/d40/f61 [0,4194304] 0 2024-04-16T14:35:41.558 INFO:tasks.workunit.client.0.smithi005.stdout:9/585: write d3/d49/d4b/d55/f5d [684786,30184] 0 2024-04-16T14:35:41.559 INFO:tasks.workunit.client.1.smithi115.stdout:8/650: mknod d0/db/d10/d17/d2c/d52/d6c/d71/cd5 0 2024-04-16T14:35:41.559 INFO:tasks.workunit.client.1.smithi115.stdout:8/651: write d0/db/d10/d17/d2c/d52/d84/f90 [255279,4647] 0 2024-04-16T14:35:41.559 INFO:tasks.workunit.client.1.smithi115.stdout:8/652: chown d0/db/d10/d17/d2c/d52/d6c/d71/cd5 1090 1 2024-04-16T14:35:41.559 INFO:tasks.workunit.client.1.smithi115.stdout:8/653: chown d0/db/d44/f93 6 1 2024-04-16T14:35:41.559 INFO:tasks.workunit.client.1.smithi115.stdout:8/654: chown d0/db/d10/d17/d2c/d52/d6c/db8/f76 100354 1 2024-04-16T14:35:41.559 INFO:tasks.workunit.client.1.smithi115.stdout:8/655: chown d0/db/l28 2 1 2024-04-16T14:35:41.559 INFO:tasks.workunit.client.1.smithi115.stdout:3/677: creat dc/d24/d33/dde/fe2 x:0 0 0 2024-04-16T14:35:41.561 INFO:tasks.workunit.client.1.smithi115.stdout:2/695: creat d0/d47/d65/dad/dc8/d4a/fdb x:0 0 0 2024-04-16T14:35:41.561 INFO:tasks.workunit.client.0.smithi005.stdout:8/749: link d5/d7b/da8/db7/f36 d5/d7b/da8/db7/d8a/da1/d3d/d7f/d8d/dd1/f108 0 2024-04-16T14:35:41.563 INFO:tasks.workunit.client.1.smithi115.stdout:1/597: mkdir df/d13/dc3 0 2024-04-16T14:35:41.568 INFO:tasks.workunit.client.1.smithi115.stdout:9/611: dwrite d1/d6/d2d/d4b/d90/fa0 [4194304,4194304] 0 2024-04-16T14:35:41.568 INFO:tasks.workunit.client.1.smithi115.stdout:6/612: link d13/d1d/d2b/d5f/d30/d43/da6/f7d d13/d1d/d2b/d5f/d30/d43/d2c/fca 0 2024-04-16T14:35:41.568 INFO:tasks.workunit.client.1.smithi115.stdout:4/578: dwrite d1/d15/d17/f74 [4194304,4194304] 0 2024-04-16T14:35:41.568 INFO:tasks.workunit.client.1.smithi115.stdout:4/579: creat d1/d15/d31/d42/d8b/faa x:0 0 0 2024-04-16T14:35:41.569 INFO:tasks.workunit.client.1.smithi115.stdout:8/656: dread d0/db/d10/d17/d2c/d52/d84/f9c [0,4194304] 0 2024-04-16T14:35:41.570 INFO:tasks.workunit.client.0.smithi005.stdout:5/793: dwrite d0/d6/d12/dc0/d8d/dd8/f9a [0,4194304] 0 2024-04-16T14:35:41.573 INFO:tasks.workunit.client.1.smithi115.stdout:5/543: mkdir dc/d3d/d68/dac 0 2024-04-16T14:35:41.573 INFO:tasks.workunit.client.1.smithi115.stdout:3/678: write dc/d24/d33/d4b/da3/d69/fbf [2247308,12350] 0 2024-04-16T14:35:41.573 INFO:tasks.workunit.client.1.smithi115.stdout:3/679: fsync dc/f64 0 2024-04-16T14:35:41.574 INFO:tasks.workunit.client.0.smithi005.stdout:8/750: dread d5/d7b/da8/db7/d8a/da1/d3d/f3f [0,4194304] 0 2024-04-16T14:35:41.575 INFO:tasks.workunit.client.1.smithi115.stdout:7/537: rename d0/d24/da3/db1/f4c to d0/d24/fb3 0 2024-04-16T14:35:41.578 INFO:tasks.workunit.client.1.smithi115.stdout:2/696: symlink d0/d47/d65/dad/dc8/d24/d23/d80/ldc 0 2024-04-16T14:35:41.578 INFO:tasks.workunit.client.1.smithi115.stdout:2/697: chown d0/d1b/c49 10417 1 2024-04-16T14:35:41.579 INFO:tasks.workunit.client.0.smithi005.stdout:2/647: getdents d0/d4/d2b 0 2024-04-16T14:35:41.583 INFO:tasks.workunit.client.0.smithi005.stdout:2/648: link d0/d2a/d3a/c82 d0/d1c/d59/cdd 0 2024-04-16T14:35:41.585 INFO:tasks.workunit.client.0.smithi005.stdout:2/649: creat d0/d1c/fde x:0 0 0 2024-04-16T14:35:41.587 INFO:tasks.workunit.client.1.smithi115.stdout:2/698: dread d0/d47/d65/dad/dc8/ff [0,4194304] 0 2024-04-16T14:35:41.587 INFO:tasks.workunit.client.1.smithi115.stdout:5/544: mkdir dc/d15/d35/d69/dad 0 2024-04-16T14:35:41.588 INFO:tasks.workunit.client.1.smithi115.stdout:8/657: dread d0/db/d10/d17/f7b [0,4194304] 0 2024-04-16T14:35:41.588 INFO:tasks.workunit.client.1.smithi115.stdout:8/658: stat d0/db/c36 0 2024-04-16T14:35:41.588 INFO:tasks.workunit.client.1.smithi115.stdout:3/680: read dc/d24/d33/d4b/f55 [2273967,23364] 0 2024-04-16T14:35:41.588 INFO:tasks.workunit.client.1.smithi115.stdout:3/681: fdatasync dc/d24/d36/d60/f7a 0 2024-04-16T14:35:41.589 INFO:tasks.workunit.client.0.smithi005.stdout:9/586: dwrite d3/d12/f3e [0,4194304] 0 2024-04-16T14:35:41.589 INFO:tasks.workunit.client.1.smithi115.stdout:9/612: dread d1/d6/f45 [0,4194304] 0 2024-04-16T14:35:41.591 INFO:tasks.workunit.client.1.smithi115.stdout:4/580: rename d1/d2/c91 to d1/d15/d17/cab 0 2024-04-16T14:35:41.591 INFO:tasks.workunit.client.1.smithi115.stdout:4/581: chown d1/d2/c10 3688289 1 2024-04-16T14:35:41.591 INFO:tasks.workunit.client.1.smithi115.stdout:4/582: fsync d1/d15/d31/d42/f70 0 2024-04-16T14:35:41.591 INFO:tasks.workunit.client.1.smithi115.stdout:4/583: chown d1/d15/d31 881909 1 2024-04-16T14:35:41.593 INFO:tasks.workunit.client.1.smithi115.stdout:6/613: getdents d13/d1d/d2b 0 2024-04-16T14:35:41.594 INFO:tasks.workunit.client.0.smithi005.stdout:6/942: sync 2024-04-16T14:35:41.594 INFO:tasks.workunit.client.0.smithi005.stdout:0/687: sync 2024-04-16T14:35:41.594 INFO:tasks.workunit.client.0.smithi005.stdout:3/738: sync 2024-04-16T14:35:41.594 INFO:tasks.workunit.client.0.smithi005.stdout:7/896: sync 2024-04-16T14:35:41.596 INFO:tasks.workunit.client.1.smithi115.stdout:2/699: link d0/c3c d0/d47/d65/dad/dc8/d24/dc7/cdd 0 2024-04-16T14:35:41.596 INFO:tasks.workunit.client.1.smithi115.stdout:2/700: write d0/d47/d65/dad/dc8/d24/d23/d83/fd7 [123570,122488] 0 2024-04-16T14:35:41.597 INFO:tasks.workunit.client.1.smithi115.stdout:2/701: dread d0/d47/d65/dad/dc8/d24/f44 [0,4194304] 0 2024-04-16T14:35:41.597 INFO:tasks.workunit.client.1.smithi115.stdout:2/702: write d0/d47/d65/dad/dbb/d11/f12 [2161998,14029] 0 2024-04-16T14:35:41.597 INFO:tasks.workunit.client.1.smithi115.stdout:2/703: chown d0/d1b 301904 1 2024-04-16T14:35:41.597 INFO:tasks.workunit.client.1.smithi115.stdout:2/704: chown d0/d47/d65/dad/dc8/f3a 73006469 1 2024-04-16T14:35:41.598 INFO:tasks.workunit.client.0.smithi005.stdout:6/943: rename d2/df/f32 to d2/d3f/d47/d84/da5/d11f/f13b 0 2024-04-16T14:35:41.598 INFO:tasks.workunit.client.0.smithi005.stdout:6/944: write d2/d3f/d47/d84/da5/d10a/fca [239322,119301] 0 2024-04-16T14:35:41.599 INFO:tasks.workunit.client.1.smithi115.stdout:3/682: mknod dc/d24/d33/d4b/da3/d69/de1/ce3 0 2024-04-16T14:35:41.599 INFO:tasks.workunit.client.0.smithi005.stdout:0/688: mknod da/df/d26/d39/d55/ce4 0 2024-04-16T14:35:41.600 INFO:tasks.workunit.client.0.smithi005.stdout:7/897: unlink d1/d49/d74/d77/d22/d27/d2e/ff9 0 2024-04-16T14:35:41.600 INFO:tasks.workunit.client.0.smithi005.stdout:7/898: getdents d1/d49/d74/d77/d57/d47/d8e 0 2024-04-16T14:35:41.602 INFO:tasks.workunit.client.1.smithi115.stdout:4/584: mknod d1/d15/d31/d42/da4/cac 0 2024-04-16T14:35:41.602 INFO:tasks.workunit.client.1.smithi115.stdout:4/585: chown d1/d15/d31/d42/d46/c7b 1 1 2024-04-16T14:35:41.602 INFO:tasks.workunit.client.1.smithi115.stdout:4/586: truncate d1/d15/d1e/f9d 444213 0 2024-04-16T14:35:41.603 INFO:tasks.workunit.client.0.smithi005.stdout:0/689: rename da/df/d1b/d3a/d53/d5a/d67/d79/cc1 to da/df/d1b/d24/ce5 0 2024-04-16T14:35:41.603 INFO:tasks.workunit.client.0.smithi005.stdout:0/690: chown da/cd 4966584 1 2024-04-16T14:35:41.603 INFO:tasks.workunit.client.0.smithi005.stdout:7/899: symlink d1/d49/d74/d77/d22/d27/d117/l12c 0 2024-04-16T14:35:41.603 INFO:tasks.workunit.client.0.smithi005.stdout:7/900: fsync d1/d49/d74/d77/d22/d27/d2e/f48 0 2024-04-16T14:35:41.603 INFO:tasks.workunit.client.0.smithi005.stdout:7/901: fsync d1/d49/d74/d77/d57/f7b 0 2024-04-16T14:35:41.604 INFO:tasks.workunit.client.1.smithi115.stdout:5/545: dread dc/f3b [0,4194304] 0 2024-04-16T14:35:41.604 INFO:tasks.workunit.client.0.smithi005.stdout:7/902: symlink d1/d49/d74/ddf/l12d 0 2024-04-16T14:35:41.607 INFO:tasks.workunit.client.1.smithi115.stdout:6/614: mkdir d13/d1d/d2b/d5f/d30/d43/da6/d5a/dcb 0 2024-04-16T14:35:41.607 INFO:tasks.workunit.client.0.smithi005.stdout:7/903: unlink d1/d49/d74/f97 0 2024-04-16T14:35:41.611 INFO:tasks.workunit.client.1.smithi115.stdout:8/659: mknod d0/db/dbb/dcd/dbd/cd6 0 2024-04-16T14:35:41.611 INFO:tasks.workunit.client.1.smithi115.stdout:8/660: stat d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/fc2 0 2024-04-16T14:35:41.611 INFO:tasks.workunit.client.1.smithi115.stdout:2/705: rename d0/d47/d65/dad/dbb/d11/f20 to d0/d47/d65/dad/dbb/d11/fde 0 2024-04-16T14:35:41.612 INFO:tasks.workunit.client.0.smithi005.stdout:9/587: write d3/d12/f6c [470695,63572] 0 2024-04-16T14:35:41.614 INFO:tasks.workunit.client.1.smithi115.stdout:8/661: link d0/db/d10/d17/fd0 d0/db/d10/d17/d2c/d52/d6c/db8/d64/d89/fd7 0 2024-04-16T14:35:41.616 INFO:tasks.workunit.client.0.smithi005.stdout:9/588: rename d3/d12/d16/d46/d47/c61 to d3/d12/d16/d46/d47/d60/ca6 0 2024-04-16T14:35:41.616 INFO:tasks.workunit.client.1.smithi115.stdout:2/706: rmdir d0/d47/d65/d61/d70 39 2024-04-16T14:35:41.618 INFO:tasks.workunit.client.0.smithi005.stdout:9/589: rmdir d3/d49/d4b/d5c/d65/d9a 39 2024-04-16T14:35:41.618 INFO:tasks.workunit.client.1.smithi115.stdout:5/546: dread dc/f1c [0,4194304] 0 2024-04-16T14:35:41.618 INFO:tasks.workunit.client.1.smithi115.stdout:5/547: write dc/d3d/d68/d7b/f89 [509468,108758] 0 2024-04-16T14:35:41.620 INFO:tasks.workunit.client.0.smithi005.stdout:9/590: creat d3/d12/d16/d46/fa7 x:0 0 0 2024-04-16T14:35:41.622 INFO:tasks.workunit.client.1.smithi115.stdout:5/548: mknod dc/d5d/d8f/cae 0 2024-04-16T14:35:41.622 INFO:tasks.workunit.client.1.smithi115.stdout:5/549: chown dc/d15/d35/d69/f72 70313110 1 2024-04-16T14:35:41.627 INFO:tasks.workunit.client.1.smithi115.stdout:4/587: dread d1/d15/d1e/f29 [0,4194304] 0 2024-04-16T14:35:41.629 INFO:tasks.workunit.client.1.smithi115.stdout:4/588: mkdir d1/d15/d78/dad 0 2024-04-16T14:35:41.630 INFO:tasks.workunit.client.1.smithi115.stdout:0/490: sync 2024-04-16T14:35:41.630 INFO:tasks.workunit.client.1.smithi115.stdout:4/589: rmdir d1/d15/d24 39 2024-04-16T14:35:41.632 INFO:tasks.workunit.client.1.smithi115.stdout:0/491: mkdir d6/dac 0 2024-04-16T14:35:41.632 INFO:tasks.workunit.client.1.smithi115.stdout:4/590: symlink d1/d15/d31/d42/d46/lae 0 2024-04-16T14:35:41.634 INFO:tasks.workunit.client.1.smithi115.stdout:0/492: creat d6/d10/d71/d88/fad x:0 0 0 2024-04-16T14:35:41.636 INFO:tasks.workunit.client.1.smithi115.stdout:0/493: mkdir d6/d10/dae 0 2024-04-16T14:35:41.638 INFO:tasks.workunit.client.0.smithi005.stdout:5/794: dwrite d0/d70/fe6 [0,4194304] 0 2024-04-16T14:35:41.638 INFO:tasks.workunit.client.1.smithi115.stdout:0/494: mknod d6/d10/d71/caf 0 2024-04-16T14:35:41.639 INFO:tasks.workunit.client.1.smithi115.stdout:0/495: creat d6/d10/d12/fb0 x:0 0 0 2024-04-16T14:35:41.640 INFO:tasks.workunit.client.0.smithi005.stdout:5/795: rmdir d0/d6/d12/dc0/d6d 39 2024-04-16T14:35:41.640 INFO:tasks.workunit.client.1.smithi115.stdout:0/496: rmdir d6/d10/d12/d31/d35/d44 39 2024-04-16T14:35:41.640 INFO:tasks.workunit.client.1.smithi115.stdout:0/497: creat d6/d10/d12/d1f/d36/d4b/d70/d8a/fb1 x:0 0 0 2024-04-16T14:35:41.641 INFO:tasks.workunit.client.1.smithi115.stdout:0/498: creat d6/d10/d12/d1f/d36/fb2 x:0 0 0 2024-04-16T14:35:41.642 INFO:tasks.workunit.client.1.smithi115.stdout:0/499: fsync d6/d10/f40 0 2024-04-16T14:35:41.642 INFO:tasks.workunit.client.1.smithi115.stdout:0/500: write d6/d10/d12/d31/f39 [8743801,86718] 0 2024-04-16T14:35:41.645 INFO:tasks.workunit.client.0.smithi005.stdout:8/751: dwrite d5/d7b/da8/da5/def/f8f [0,4194304] 0 2024-04-16T14:35:41.645 INFO:tasks.workunit.client.0.smithi005.stdout:8/752: creat d5/d9b/f109 x:0 0 0 2024-04-16T14:35:41.645 INFO:tasks.workunit.client.0.smithi005.stdout:8/753: chown d5/d7b/da8/db7/d8a/da1/d68/dcb/dd9/fea 9809 1 2024-04-16T14:35:41.645 INFO:tasks.workunit.client.0.smithi005.stdout:8/754: stat d5/d40/d8e/dfe 0 2024-04-16T14:35:41.651 INFO:tasks.workunit.client.0.smithi005.stdout:5/796: dread d0/f8 [0,4194304] 0 2024-04-16T14:35:41.651 INFO:tasks.workunit.client.0.smithi005.stdout:5/797: readlink d0/d6/d6e/d9e/lbe 0 2024-04-16T14:35:41.651 INFO:tasks.workunit.client.0.smithi005.stdout:5/798: getdents d0/d6/d12/d1c/d1e/d73 0 2024-04-16T14:35:41.653 INFO:tasks.workunit.client.1.smithi115.stdout:5/550: dread dc/d3d/f7e [0,4194304] 0 2024-04-16T14:35:41.653 INFO:tasks.workunit.client.1.smithi115.stdout:5/551: chown dc/d3d/d41/c4b 12508790 1 2024-04-16T14:35:41.653 INFO:tasks.workunit.client.1.smithi115.stdout:5/552: creat dc/d5d/d8f/faf x:0 0 0 2024-04-16T14:35:41.655 INFO:tasks.workunit.client.1.smithi115.stdout:5/553: mkdir dc/d15/d2d/db0 0 2024-04-16T14:35:41.656 INFO:tasks.workunit.client.1.smithi115.stdout:5/554: truncate dc/f26 296725 0 2024-04-16T14:35:41.658 INFO:tasks.workunit.client.1.smithi115.stdout:5/555: symlink dc/d3d/d68/d7b/lb1 0 2024-04-16T14:35:41.661 INFO:tasks.workunit.client.1.smithi115.stdout:0/501: dread d6/d10/d12/d1f/d36/d4b/f5c [0,4194304] 0 2024-04-16T14:35:41.662 INFO:tasks.workunit.client.1.smithi115.stdout:0/502: symlink d6/d10/d12/d31/d35/d9b/lb3 0 2024-04-16T14:35:41.666 INFO:tasks.workunit.client.1.smithi115.stdout:1/598: dwrite df/d35/f39 [0,4194304] 0 2024-04-16T14:35:41.666 INFO:tasks.workunit.client.1.smithi115.stdout:1/599: write df/d13/d4d/d3e/f62 [344051,130731] 0 2024-04-16T14:35:41.666 INFO:tasks.workunit.client.1.smithi115.stdout:7/538: dwrite d0/d24/f4a [0,4194304] 0 2024-04-16T14:35:41.666 INFO:tasks.workunit.client.1.smithi115.stdout:7/539: fsync d0/d24/da3/db1/d3f/db0/f5f 0 2024-04-16T14:35:41.667 INFO:tasks.workunit.client.0.smithi005.stdout:3/739: dwrite d2/d9/df/dbf/fdb [0,4194304] 0 2024-04-16T14:35:41.667 INFO:tasks.workunit.client.0.smithi005.stdout:3/740: stat d2/d9/df/fc8 0 2024-04-16T14:35:41.668 INFO:tasks.workunit.client.1.smithi115.stdout:1/600: mkdir df/d36/d94/dc4 0 2024-04-16T14:35:41.669 INFO:tasks.workunit.client.1.smithi115.stdout:1/601: mkdir df/d13/d4d/d6d/dc5 0 2024-04-16T14:35:41.670 INFO:tasks.workunit.client.1.smithi115.stdout:1/602: mknod df/d35/d84/cc6 0 2024-04-16T14:35:41.673 INFO:tasks.workunit.client.1.smithi115.stdout:0/503: write d6/d10/f20 [965200,28645] 0 2024-04-16T14:35:41.673 INFO:tasks.workunit.client.1.smithi115.stdout:8/662: dread d0/db/d10/d17/d2c/d52/d84/f90 [0,4194304] 0 2024-04-16T14:35:41.678 INFO:tasks.workunit.client.1.smithi115.stdout:0/504: unlink d6/d1b/f7f 0 2024-04-16T14:35:41.678 INFO:tasks.workunit.client.1.smithi115.stdout:0/505: write d6/d10/d12/d1f/d36/d4b/f69 [30924,74507] 0 2024-04-16T14:35:41.680 INFO:tasks.workunit.client.1.smithi115.stdout:3/683: dwrite dc/d29/fda [0,4194304] 0 2024-04-16T14:35:41.680 INFO:tasks.workunit.client.0.smithi005.stdout:0/691: dwrite da/df/d1b/d24/d75/fde [0,4194304] 0 2024-04-16T14:35:41.681 INFO:tasks.workunit.client.1.smithi115.stdout:2/707: dwrite d0/d47/d65/f7b [4194304,4194304] 0 2024-04-16T14:35:41.682 INFO:tasks.workunit.client.0.smithi005.stdout:3/741: dread d2/d17/d46/d75/d6d/f72 [0,4194304] 0 2024-04-16T14:35:41.682 INFO:tasks.workunit.client.0.smithi005.stdout:0/692: dread da/fe [0,4194304] 0 2024-04-16T14:35:41.682 INFO:tasks.workunit.client.0.smithi005.stdout:0/693: fsync da/f32 0 2024-04-16T14:35:41.684 INFO:tasks.workunit.client.0.smithi005.stdout:3/742: symlink d2/d9/d25/d39/lf7 0 2024-04-16T14:35:41.684 INFO:tasks.workunit.client.0.smithi005.stdout:3/743: chown d2/d9/df/cf6 2 1 2024-04-16T14:35:41.684 INFO:tasks.workunit.client.0.smithi005.stdout:3/744: write d2/d17/f8b [892559,95200] 0 2024-04-16T14:35:41.684 INFO:tasks.workunit.client.1.smithi115.stdout:3/684: mknod dc/d29/ce4 0 2024-04-16T14:35:41.688 INFO:tasks.workunit.client.1.smithi115.stdout:4/591: getdents d1/d2 0 2024-04-16T14:35:41.693 INFO:tasks.workunit.client.0.smithi005.stdout:3/745: dread d2/d9/d51/f58 [0,4194304] 0 2024-04-16T14:35:41.693 INFO:tasks.workunit.client.1.smithi115.stdout:9/613: dwrite d1/d6/d2d/d4b/d8f/fa4 [4194304,4194304] 0 2024-04-16T14:35:41.694 INFO:tasks.workunit.client.0.smithi005.stdout:7/904: dwrite d1/d49/d74/d77/d57/d47/d8d/fac [0,4194304] 0 2024-04-16T14:35:41.694 INFO:tasks.workunit.client.1.smithi115.stdout:6/615: getdents d13/d1d/d2b/d5f/d30/d43/da6/d5a 0 2024-04-16T14:35:41.696 INFO:tasks.workunit.client.0.smithi005.stdout:7/905: symlink d1/d85/d96/de1/d11b/l12e 0 2024-04-16T14:35:41.696 INFO:tasks.workunit.client.0.smithi005.stdout:7/906: fdatasync d1/d49/d74/d77/d57/d47/daa/f104 0 2024-04-16T14:35:41.698 INFO:tasks.workunit.client.1.smithi115.stdout:1/603: write df/f10 [2781526,113787] 0 2024-04-16T14:35:41.699 INFO:tasks.workunit.client.0.smithi005.stdout:3/746: rename d2/d9/d25/d39/d9c to d2/d9/df/dbf/df8 0 2024-04-16T14:35:41.700 INFO:tasks.workunit.client.0.smithi005.stdout:3/747: read d2/d9/df/dbf/df8/fb2 [155820,1683] 0 2024-04-16T14:35:41.703 INFO:tasks.workunit.client.1.smithi115.stdout:9/614: link d1/d6/d2d/d4b/d90/cb2 d1/d6/d2d/d4b/d6c/d20/cd0 0 2024-04-16T14:35:41.703 INFO:tasks.workunit.client.0.smithi005.stdout:3/748: rename d2/d9/d25/d39/d64/f70 to d2/d17/d46/d75/d6d/df3/ff9 0 2024-04-16T14:35:41.704 INFO:tasks.workunit.client.1.smithi115.stdout:2/708: write d0/d47/d65/dad/dc8/d24/da0/fd9 [391645,41092] 0 2024-04-16T14:35:41.704 INFO:tasks.workunit.client.1.smithi115.stdout:2/709: creat d0/d47/fdf x:0 0 0 2024-04-16T14:35:41.705 INFO:tasks.workunit.client.1.smithi115.stdout:9/615: mkdir d1/d6/d2d/d4b/d8f/d91/dd1 0 2024-04-16T14:35:41.706 INFO:tasks.workunit.client.0.smithi005.stdout:3/749: creat d2/d9/d25/d39/ffa x:0 0 0 2024-04-16T14:35:41.708 INFO:tasks.workunit.client.0.smithi005.stdout:5/799: dwrite d0/d70/ff3 [0,4194304] 0 2024-04-16T14:35:41.709 INFO:tasks.workunit.client.0.smithi005.stdout:3/750: rename d2/d9/d5e/f94 to d2/d6b/ffb 0 2024-04-16T14:35:41.709 INFO:tasks.workunit.client.0.smithi005.stdout:3/751: chown d2/d9/d7d/fa5 0 1 2024-04-16T14:35:41.709 INFO:tasks.workunit.client.1.smithi115.stdout:9/616: mkdir d1/d6/d2d/d4b/d8f/d91/dd1/dd2 0 2024-04-16T14:35:41.710 INFO:tasks.workunit.client.1.smithi115.stdout:9/617: link d1/d6/d2d/d4b/d8f/d91/f6a d1/d6/d2d/d4b/d60/d65/dc6/fd3 0 2024-04-16T14:35:41.711 INFO:tasks.workunit.client.0.smithi005.stdout:3/752: mkdir d2/d17/d46/d75/d6d/dd0/dda/dfc 0 2024-04-16T14:35:41.712 INFO:tasks.workunit.client.1.smithi115.stdout:9/618: creat d1/fd4 x:0 0 0 2024-04-16T14:35:41.717 INFO:tasks.workunit.client.1.smithi115.stdout:5/556: getdents dc/d15/d2d 0 2024-04-16T14:35:41.718 INFO:tasks.workunit.client.1.smithi115.stdout:5/557: mknod dc/d5d/d81/cb2 0 2024-04-16T14:35:41.718 INFO:tasks.workunit.client.1.smithi115.stdout:5/558: dread - dc/d8e/fab zero size 2024-04-16T14:35:41.718 INFO:tasks.workunit.client.1.smithi115.stdout:5/559: mknod dc/d15/d2d/db0/cb3 0 2024-04-16T14:35:41.721 INFO:tasks.workunit.client.1.smithi115.stdout:5/560: link dc/d5d/c66 dc/d3d/cb4 0 2024-04-16T14:35:41.721 INFO:tasks.workunit.client.1.smithi115.stdout:5/561: stat dc/d3d/d68/d7b/l90 0 2024-04-16T14:35:41.722 INFO:tasks.workunit.client.1.smithi115.stdout:5/562: mknod dc/d15/d2d/cb5 0 2024-04-16T14:35:41.722 INFO:tasks.workunit.client.1.smithi115.stdout:5/563: getdents dc/d15/d2d/d8c 0 2024-04-16T14:35:41.724 INFO:tasks.workunit.client.0.smithi005.stdout:7/907: write d1/d82/fcf [2063536,35428] 0 2024-04-16T14:35:41.725 INFO:tasks.workunit.client.0.smithi005.stdout:8/755: dwrite d5/d7b/da8/db7/d8a/da1/d3d/d7f/fb0 [0,4194304] 0 2024-04-16T14:35:41.727 INFO:tasks.workunit.client.0.smithi005.stdout:3/753: dwrite d2/d17/d46/f4b [0,4194304] 0 2024-04-16T14:35:41.727 INFO:tasks.workunit.client.0.smithi005.stdout:3/754: fdatasync d2/d17/d46/d75/d9b/fcb 0 2024-04-16T14:35:41.728 INFO:tasks.workunit.client.0.smithi005.stdout:7/908: rename d1/d85/fb4 to d1/d82/d128/f12f 0 2024-04-16T14:35:41.728 INFO:tasks.workunit.client.1.smithi115.stdout:1/604: dread df/d2d/f82 [0,4194304] 0 2024-04-16T14:35:41.729 INFO:tasks.workunit.client.0.smithi005.stdout:8/756: mkdir d5/d55/d5a/d10a 0 2024-04-16T14:35:41.730 INFO:tasks.workunit.client.1.smithi115.stdout:9/619: dread d1/d6/d2d/d4b/d90/fa0 [0,4194304] 0 2024-04-16T14:35:41.731 INFO:tasks.workunit.client.0.smithi005.stdout:3/755: truncate d2/d17/d46/d47/f78 646003 0 2024-04-16T14:35:41.731 INFO:tasks.workunit.client.0.smithi005.stdout:3/756: fsync d2/d9/df/dbf/df8/f85 0 2024-04-16T14:35:41.731 INFO:tasks.workunit.client.0.smithi005.stdout:3/757: chown d2/d17/d46/d75/d41/d79/fa4 219 1 2024-04-16T14:35:41.731 INFO:tasks.workunit.client.0.smithi005.stdout:3/758: dread - d2/d9/d7d/ff0 zero size 2024-04-16T14:35:41.732 INFO:tasks.workunit.client.0.smithi005.stdout:7/909: truncate d1/dc/d2f/dbd/fd3 1280057 0 2024-04-16T14:35:41.732 INFO:tasks.workunit.client.0.smithi005.stdout:7/910: write d1/f29 [488788,81289] 0 2024-04-16T14:35:41.733 INFO:tasks.workunit.client.0.smithi005.stdout:7/911: readlink d1/d82/l114 0 2024-04-16T14:35:41.733 INFO:tasks.workunit.client.1.smithi115.stdout:1/605: unlink df/d2d/c28 0 2024-04-16T14:35:41.735 INFO:tasks.workunit.client.0.smithi005.stdout:3/759: rename d2/d9/df/l26 to d2/d17/d46/d47/lfd 0 2024-04-16T14:35:41.736 INFO:tasks.workunit.client.1.smithi115.stdout:1/606: link df/d2d/ca8 df/d13/d4d/d3e/d75/da9/db7/cc7 0 2024-04-16T14:35:41.737 INFO:tasks.workunit.client.1.smithi115.stdout:1/607: symlink df/d35/d48/lc8 0 2024-04-16T14:35:41.737 INFO:tasks.workunit.client.1.smithi115.stdout:1/608: read - df/d13/d4d/d3e/d75/da9/db7/fc1 zero size 2024-04-16T14:35:41.739 INFO:tasks.workunit.client.1.smithi115.stdout:2/710: dread d0/d47/d65/dad/dbb/d11/f96 [0,4194304] 0 2024-04-16T14:35:41.740 INFO:tasks.workunit.client.1.smithi115.stdout:1/609: rename df/d36/d3c/f63 to df/d13/fc9 0 2024-04-16T14:35:41.744 INFO:tasks.workunit.client.1.smithi115.stdout:2/711: rmdir d0/d47/d65/dad/dc8/d4a 39 2024-04-16T14:35:41.750 INFO:tasks.workunit.client.1.smithi115.stdout:7/540: dwrite d0/d2/d3a/d30/d6b/f87 [0,4194304] 0 2024-04-16T14:35:41.750 INFO:tasks.workunit.client.1.smithi115.stdout:8/663: dwrite d0/db/d10/d17/d2c/d52/d74/d3b/fb2 [0,4194304] 0 2024-04-16T14:35:41.752 INFO:tasks.workunit.client.1.smithi115.stdout:7/541: link d0/d2/l22 d0/d24/da3/db1/d49/lb4 0 2024-04-16T14:35:41.754 INFO:tasks.workunit.client.1.smithi115.stdout:8/664: symlink d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/da4/ld8 0 2024-04-16T14:35:41.755 INFO:tasks.workunit.client.1.smithi115.stdout:7/542: mkdir d0/d24/da3/db1/d49/db5 0 2024-04-16T14:35:41.756 INFO:tasks.workunit.client.1.smithi115.stdout:8/665: mkdir d0/db/d10/d17/d2c/d52/d6c/dd9 0 2024-04-16T14:35:41.758 INFO:tasks.workunit.client.1.smithi115.stdout:7/543: getdents d0/d2/d3a/d30/d6b/da2 0 2024-04-16T14:35:41.759 INFO:tasks.workunit.client.1.smithi115.stdout:2/712: write d0/d47/d65/f77 [3494075,112957] 0 2024-04-16T14:35:41.763 INFO:tasks.workunit.client.1.smithi115.stdout:6/616: dwrite d13/d1d/d2b/d5f/d30/d43/da6/d5a/f48 [0,4194304] 0 2024-04-16T14:35:41.764 INFO:tasks.workunit.client.1.smithi115.stdout:7/544: dread d0/d24/da3/db1/d3f/fae [0,4194304] 0 2024-04-16T14:35:41.764 INFO:tasks.workunit.client.1.smithi115.stdout:7/545: fdatasync d0/d2/d3a/d30/d6b/da2/d81/f92 0 2024-04-16T14:35:41.775 INFO:tasks.workunit.client.0.smithi005.stdout:0/694: dwrite da/df/d1b/d3a/d53/d5a/d99/f9e [0,4194304] 0 2024-04-16T14:35:41.776 INFO:tasks.workunit.client.1.smithi115.stdout:0/506: dwrite d6/d54/f6b [0,4194304] 0 2024-04-16T14:35:41.776 INFO:tasks.workunit.client.0.smithi005.stdout:5/800: dwrite d0/fdc [0,4194304] 0 2024-04-16T14:35:41.778 INFO:tasks.workunit.client.0.smithi005.stdout:0/695: symlink da/df/d1b/le6 0 2024-04-16T14:35:41.778 INFO:tasks.workunit.client.1.smithi115.stdout:6/617: write d13/d1d/d49/f8b [1581094,58129] 0 2024-04-16T14:35:41.779 INFO:tasks.workunit.client.1.smithi115.stdout:6/618: chown d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/l42 165081091 1 2024-04-16T14:35:41.779 INFO:tasks.workunit.client.1.smithi115.stdout:6/619: chown d13/fb1 125648 1 2024-04-16T14:35:41.779 INFO:tasks.workunit.client.1.smithi115.stdout:6/620: write d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/f23 [4811142,100065] 0 2024-04-16T14:35:41.779 INFO:tasks.workunit.client.0.smithi005.stdout:3/760: dwrite d2/d17/d46/d47/f62 [4194304,4194304] 0 2024-04-16T14:35:41.779 INFO:tasks.workunit.client.0.smithi005.stdout:7/912: dwrite d1/d49/d74/d77/d57/f4a [4194304,4194304] 0 2024-04-16T14:35:41.779 INFO:tasks.workunit.client.0.smithi005.stdout:7/913: dread - d1/d49/d74/d77/d22/d27/df4/f124 zero size 2024-04-16T14:35:41.780 INFO:tasks.workunit.client.1.smithi115.stdout:1/610: dwrite df/d13/fa5 [0,4194304] 0 2024-04-16T14:35:41.780 INFO:tasks.workunit.client.1.smithi115.stdout:9/620: dwrite d1/d6/d2d/d4b/d6c/d20/d36/fcf [0,4194304] 0 2024-04-16T14:35:41.780 INFO:tasks.workunit.client.1.smithi115.stdout:1/611: chown df/d13/f30 29719620 1 2024-04-16T14:35:41.780 INFO:tasks.workunit.client.1.smithi115.stdout:7/546: write d0/d2/d3a/d30/d6b/f87 [929403,18494] 0 2024-04-16T14:35:41.781 INFO:tasks.workunit.client.1.smithi115.stdout:7/547: fdatasync d0/d2/d3a/d30/f98 0 2024-04-16T14:35:41.781 INFO:tasks.workunit.client.0.smithi005.stdout:5/801: symlink d0/d6/d12/de4/l112 0 2024-04-16T14:35:41.782 INFO:tasks.workunit.client.1.smithi115.stdout:2/713: dwrite d0/d47/d65/dad/dc8/d24/d23/f6c [0,4194304] 0 2024-04-16T14:35:41.782 INFO:tasks.workunit.client.1.smithi115.stdout:2/714: creat d0/d47/fe0 x:0 0 0 2024-04-16T14:35:41.782 INFO:tasks.workunit.client.1.smithi115.stdout:2/715: chown d0/d1b/fc0 12197289 1 2024-04-16T14:35:41.782 INFO:tasks.workunit.client.1.smithi115.stdout:2/716: write d0/d47/d65/dad/dc8/faa [546616,122856] 0 2024-04-16T14:35:41.788 INFO:tasks.workunit.client.0.smithi005.stdout:7/914: unlink d1/dc/d2f/d4f/f92 0 2024-04-16T14:35:41.789 INFO:tasks.workunit.client.0.smithi005.stdout:5/802: mknod d0/d6/d12/d1c/dd2/c113 0 2024-04-16T14:35:41.790 INFO:tasks.workunit.client.0.smithi005.stdout:5/803: write d0/d70/f90 [8352685,128894] 0 2024-04-16T14:35:41.791 INFO:tasks.workunit.client.1.smithi115.stdout:1/612: truncate df/f23 1054854 0 2024-04-16T14:35:41.793 INFO:tasks.workunit.client.1.smithi115.stdout:5/564: getdents dc/d5d/d81 0 2024-04-16T14:35:41.793 INFO:tasks.workunit.client.1.smithi115.stdout:5/565: dread - dc/d5d/d8f/faf zero size 2024-04-16T14:35:41.794 INFO:tasks.workunit.client.0.smithi005.stdout:3/761: read d2/d9/fe4 [1263785,118640] 0 2024-04-16T14:35:41.795 INFO:tasks.workunit.client.1.smithi115.stdout:9/621: symlink d1/d6/d2d/d4b/d6c/d20/ld5 0 2024-04-16T14:35:41.796 INFO:tasks.workunit.client.1.smithi115.stdout:7/548: symlink d0/d2/d3a/d30/d6b/lb6 0 2024-04-16T14:35:41.798 INFO:tasks.workunit.client.1.smithi115.stdout:0/507: rmdir d6/d10/d12/d31/d35/d9b 39 2024-04-16T14:35:41.798 INFO:tasks.workunit.client.1.smithi115.stdout:0/508: dread - d6/d54/f87 zero size 2024-04-16T14:35:41.799 INFO:tasks.workunit.client.0.smithi005.stdout:5/804: truncate d0/f76 2077275 0 2024-04-16T14:35:41.799 INFO:tasks.workunit.client.0.smithi005.stdout:5/805: creat d0/d6/f114 x:0 0 0 2024-04-16T14:35:41.800 INFO:tasks.workunit.client.0.smithi005.stdout:3/762: unlink d2/d9/d7d/f98 0 2024-04-16T14:35:41.802 INFO:tasks.workunit.client.1.smithi115.stdout:1/613: dread df/d36/f3d [0,4194304] 0 2024-04-16T14:35:41.803 INFO:tasks.workunit.client.0.smithi005.stdout:0/696: dwrite da/d7c/fa3 [0,4194304] 0 2024-04-16T14:35:41.804 INFO:tasks.workunit.client.1.smithi115.stdout:2/717: mknod d0/d47/d65/dad/dbb/ce1 0 2024-04-16T14:35:41.806 INFO:tasks.workunit.client.0.smithi005.stdout:5/806: symlink d0/d6/d12/d1c/d81/d82/dda/l115 0 2024-04-16T14:35:41.807 INFO:tasks.workunit.client.0.smithi005.stdout:3/763: creat d2/d17/d46/d75/d6d/ffe x:0 0 0 2024-04-16T14:35:41.812 INFO:tasks.workunit.client.0.smithi005.stdout:3/764: link d2/d9/d5e/fb6 d2/d17/d46/d75/d9b/fff 0 2024-04-16T14:35:41.814 INFO:tasks.workunit.client.1.smithi115.stdout:9/622: symlink d1/d6/d2d/d4b/d8f/d91/dd1/dd2/ld6 0 2024-04-16T14:35:41.814 INFO:tasks.workunit.client.0.smithi005.stdout:3/765: mknod d2/d9/d25/d39/c100 0 2024-04-16T14:35:41.815 INFO:tasks.workunit.client.0.smithi005.stdout:5/807: dread d0/d6/d12/dc0/d30/fd5 [0,4194304] 0 2024-04-16T14:35:41.815 INFO:tasks.workunit.client.0.smithi005.stdout:5/808: creat d0/d6/d12/de4/f116 x:0 0 0 2024-04-16T14:35:41.816 INFO:tasks.workunit.client.1.smithi115.stdout:7/549: creat d0/fb7 x:0 0 0 2024-04-16T14:35:41.816 INFO:tasks.workunit.client.0.smithi005.stdout:3/766: creat d2/d9/df/daa/f101 x:0 0 0 2024-04-16T14:35:41.817 INFO:tasks.workunit.client.1.smithi115.stdout:0/509: rmdir d6/d10 39 2024-04-16T14:35:41.818 INFO:tasks.workunit.client.1.smithi115.stdout:5/566: dwrite dc/d15/f3e [12582912,4194304] 0 2024-04-16T14:35:41.819 INFO:tasks.workunit.client.0.smithi005.stdout:5/809: link d0/d6/d12/d1c/d81/d82/f88 d0/d6/d6e/d9e/f117 0 2024-04-16T14:35:41.820 INFO:tasks.workunit.client.1.smithi115.stdout:1/614: mknod df/d36/d3c/cca 0 2024-04-16T14:35:41.820 INFO:tasks.workunit.client.1.smithi115.stdout:5/567: read dc/d15/f19 [4646229,71879] 0 2024-04-16T14:35:41.820 INFO:tasks.workunit.client.1.smithi115.stdout:5/568: chown dc/d3d 1292083 1 2024-04-16T14:35:41.820 INFO:tasks.workunit.client.1.smithi115.stdout:5/569: fsync dc/f3b 0 2024-04-16T14:35:41.820 INFO:tasks.workunit.client.1.smithi115.stdout:5/570: write dc/d79/f99 [934298,108375] 0 2024-04-16T14:35:41.820 INFO:tasks.workunit.client.0.smithi005.stdout:5/810: symlink d0/d6/d12/d1c/d81/dd7/l118 0 2024-04-16T14:35:41.821 INFO:tasks.workunit.client.1.smithi115.stdout:2/718: creat d0/d47/d65/dad/dc8/d24/dc7/fe2 x:0 0 0 2024-04-16T14:35:41.821 INFO:tasks.workunit.client.0.smithi005.stdout:5/811: rmdir d0/d6/d12/d1c/d1e/d73 39 2024-04-16T14:35:41.821 INFO:tasks.workunit.client.0.smithi005.stdout:5/812: fdatasync d0/d6/d12/f41 0 2024-04-16T14:35:41.822 INFO:tasks.workunit.client.0.smithi005.stdout:5/813: creat d0/d6/d12/d1c/d81/d82/d10e/f119 x:0 0 0 2024-04-16T14:35:41.822 INFO:tasks.workunit.client.0.smithi005.stdout:5/814: stat d0/dd1 0 2024-04-16T14:35:41.823 INFO:tasks.workunit.client.1.smithi115.stdout:2/719: dread d0/d47/f8e [0,4194304] 0 2024-04-16T14:35:41.823 INFO:tasks.workunit.client.1.smithi115.stdout:9/623: rename d1/d6/f45 to d1/d6/d2d/d3d/d49/d88/fd7 0 2024-04-16T14:35:41.824 INFO:tasks.workunit.client.0.smithi005.stdout:5/815: symlink d0/d6/d12/d1c/dd2/df7/l11a 0 2024-04-16T14:35:41.824 INFO:tasks.workunit.client.0.smithi005.stdout:5/816: write d0/d6/d12/dc0/d30/d97/fd4 [317450,17798] 0 2024-04-16T14:35:41.824 INFO:tasks.workunit.client.0.smithi005.stdout:5/817: truncate d0/d6/f114 656055 0 2024-04-16T14:35:41.824 INFO:tasks.workunit.client.0.smithi005.stdout:5/818: creat d0/d6/d12/de4/f11b x:0 0 0 2024-04-16T14:35:41.824 INFO:tasks.workunit.client.1.smithi115.stdout:1/615: creat df/d13/d4d/d2c/d54/d55/fcb x:0 0 0 2024-04-16T14:35:41.825 INFO:tasks.workunit.client.1.smithi115.stdout:5/571: stat dc/d3d/l58 0 2024-04-16T14:35:41.825 INFO:tasks.workunit.client.0.smithi005.stdout:5/819: rmdir d0/d6/d12/dc0/d8d 39 2024-04-16T14:35:41.826 INFO:tasks.workunit.client.0.smithi005.stdout:5/820: write d0/f52 [4305656,91244] 0 2024-04-16T14:35:41.826 INFO:tasks.workunit.client.0.smithi005.stdout:5/821: chown d0/d6/d12/d1c/d1e/cad 184 1 2024-04-16T14:35:41.827 INFO:tasks.workunit.client.1.smithi115.stdout:9/624: unlink d1/d6/cf 0 2024-04-16T14:35:41.829 INFO:tasks.workunit.client.1.smithi115.stdout:0/510: truncate d6/d10/d12/d31/d35/d9b/f5b 2239189 0 2024-04-16T14:35:41.831 INFO:tasks.workunit.client.1.smithi115.stdout:1/616: link df/d2d/d83/f60 df/d13/fcc 0 2024-04-16T14:35:41.831 INFO:tasks.workunit.client.0.smithi005.stdout:3/767: dread d2/d9/df/f1c [0,4194304] 0 2024-04-16T14:35:41.832 INFO:tasks.workunit.client.1.smithi115.stdout:2/720: dread d0/d47/d65/f77 [0,4194304] 0 2024-04-16T14:35:41.832 INFO:tasks.workunit.client.1.smithi115.stdout:2/721: chown d0/d47/dc9 87396 1 2024-04-16T14:35:41.832 INFO:tasks.workunit.client.1.smithi115.stdout:9/625: readlink d1/l5 0 2024-04-16T14:35:41.832 INFO:tasks.workunit.client.0.smithi005.stdout:0/697: dwrite da/df/d26/f4c [4194304,4194304] 0 2024-04-16T14:35:41.832 INFO:tasks.workunit.client.0.smithi005.stdout:3/768: mkdir d2/d17/d102 0 2024-04-16T14:35:41.838 INFO:tasks.workunit.client.1.smithi115.stdout:0/511: rename d6/d10/d71/la1 to d6/d1b/lb4 0 2024-04-16T14:35:41.839 INFO:tasks.workunit.client.1.smithi115.stdout:1/617: creat df/d13/d4d/fcd x:0 0 0 2024-04-16T14:35:41.844 INFO:tasks.workunit.client.1.smithi115.stdout:1/618: truncate df/f27 3096080 0 2024-04-16T14:35:41.846 INFO:tasks.workunit.client.1.smithi115.stdout:9/626: link d1/f92 d1/d6/d2d/fd8 0 2024-04-16T14:35:41.846 INFO:tasks.workunit.client.1.smithi115.stdout:9/627: write d1/d6/d2d/d3d/d49/d98/fbd [589191,28935] 0 2024-04-16T14:35:41.848 INFO:tasks.workunit.client.1.smithi115.stdout:0/512: mknod d6/d10/d12/d1f/d36/d4b/d6d/d7a/cb5 0 2024-04-16T14:35:41.848 INFO:tasks.workunit.client.1.smithi115.stdout:0/513: rename d6/d10/d12/d1f/d36 to d6/d10/d12/d1f/d36/d4b/d6d/d7a/db6 22 2024-04-16T14:35:41.849 INFO:tasks.workunit.client.1.smithi115.stdout:1/619: unlink df/d13/d4d/d2c/d54/c8b 0 2024-04-16T14:35:41.852 INFO:tasks.workunit.client.1.smithi115.stdout:0/514: mkdir d6/d10/d71/db7 0 2024-04-16T14:35:41.852 INFO:tasks.workunit.client.1.smithi115.stdout:0/515: write d6/d10/d12/d1f/d36/fb2 [434528,28899] 0 2024-04-16T14:35:41.852 INFO:tasks.workunit.client.0.smithi005.stdout:3/769: dwrite d2/d6b/ffb [0,4194304] 0 2024-04-16T14:35:41.853 INFO:tasks.workunit.client.0.smithi005.stdout:3/770: chown d2/d17/l81 18872801 1 2024-04-16T14:35:41.853 INFO:tasks.workunit.client.0.smithi005.stdout:3/771: dread - d2/d9/df/fbe zero size 2024-04-16T14:35:41.853 INFO:tasks.workunit.client.1.smithi115.stdout:1/620: creat df/d36/d3c/fce x:0 0 0 2024-04-16T14:35:41.853 INFO:tasks.workunit.client.1.smithi115.stdout:1/621: write df/d13/d4d/d3e/d75/da9/db7/fc1 [105915,53381] 0 2024-04-16T14:35:41.855 INFO:tasks.workunit.client.0.smithi005.stdout:5/822: dwrite d0/f26 [0,4194304] 0 2024-04-16T14:35:41.855 INFO:tasks.workunit.client.1.smithi115.stdout:2/722: dwrite d0/d47/d65/dad/dc8/d24/f34 [0,4194304] 0 2024-04-16T14:35:41.855 INFO:tasks.workunit.client.1.smithi115.stdout:9/628: rmdir d1/d6/d2d/d3d/d50 39 2024-04-16T14:35:41.857 INFO:tasks.workunit.client.1.smithi115.stdout:1/622: mknod df/d13/d4d/d6d/dc5/ccf 0 2024-04-16T14:35:41.859 INFO:tasks.workunit.client.1.smithi115.stdout:2/723: symlink d0/d47/d65/dad/dbb/d11/d6d/le3 0 2024-04-16T14:35:41.859 INFO:tasks.workunit.client.1.smithi115.stdout:2/724: getdents d0/d47/d65/dad/dc8/d57 0 2024-04-16T14:35:41.859 INFO:tasks.workunit.client.1.smithi115.stdout:2/725: dread - d0/d47/d65/dad/dc8/d24/d21/fd1 zero size 2024-04-16T14:35:41.861 INFO:tasks.workunit.client.1.smithi115.stdout:9/629: creat d1/d6/d2d/d4b/d90/fd9 x:0 0 0 2024-04-16T14:35:41.863 INFO:tasks.workunit.client.1.smithi115.stdout:2/726: creat d0/d47/d65/dad/dc8/d24/d10/fe4 x:0 0 0 2024-04-16T14:35:41.863 INFO:tasks.workunit.client.1.smithi115.stdout:2/727: readlink d0/d47/d65/dad/dbb/d11/d36/l5f 0 2024-04-16T14:35:41.863 INFO:tasks.workunit.client.1.smithi115.stdout:2/728: write d0/d47/d65/dad/dc8/d24/d23/f9c [1806781,112646] 0 2024-04-16T14:35:41.867 INFO:tasks.workunit.client.1.smithi115.stdout:1/623: dread df/d13/fa5 [0,4194304] 0 2024-04-16T14:35:41.867 INFO:tasks.workunit.client.1.smithi115.stdout:1/624: creat df/d2d/fd0 x:0 0 0 2024-04-16T14:35:41.867 INFO:tasks.workunit.client.1.smithi115.stdout:1/625: chown df/d2d/ca8 6 1 2024-04-16T14:35:41.867 INFO:tasks.workunit.client.1.smithi115.stdout:1/626: write df/d13/d4d/fcd [880754,84093] 0 2024-04-16T14:35:41.869 INFO:tasks.workunit.client.1.smithi115.stdout:9/630: mkdir d1/d6/d2d/d4b/d8f/d91/dda 0 2024-04-16T14:35:41.870 INFO:tasks.workunit.client.1.smithi115.stdout:9/631: write d1/f86 [508645,102791] 0 2024-04-16T14:35:41.874 INFO:tasks.workunit.client.0.smithi005.stdout:3/772: dwrite d2/d92/fc0 [0,4194304] 0 2024-04-16T14:35:41.875 INFO:tasks.workunit.client.0.smithi005.stdout:3/773: creat d2/d9/df/dbf/f103 x:0 0 0 2024-04-16T14:35:41.875 INFO:tasks.workunit.client.0.smithi005.stdout:5/823: dwrite d0/d6/f31 [0,4194304] 0 2024-04-16T14:35:41.875 INFO:tasks.workunit.client.0.smithi005.stdout:5/824: write d0/fdc [5135747,109072] 0 2024-04-16T14:35:41.876 INFO:tasks.workunit.client.0.smithi005.stdout:5/825: fsync d0/d6/d12/f45 0 2024-04-16T14:35:41.876 INFO:tasks.workunit.client.0.smithi005.stdout:5/826: chown d0/c3d 1048707638 1 2024-04-16T14:35:41.877 INFO:tasks.workunit.client.0.smithi005.stdout:3/774: mknod d2/d6b/c104 0 2024-04-16T14:35:41.882 INFO:tasks.workunit.client.1.smithi115.stdout:0/516: dwrite d6/d10/d12/d31/f39 [0,4194304] 0 2024-04-16T14:35:41.883 INFO:tasks.workunit.client.0.smithi005.stdout:5/827: mknod d0/d6/d12/d1c/d1e/d73/c11c 0 2024-04-16T14:35:41.883 INFO:tasks.workunit.client.0.smithi005.stdout:3/775: getdents d2/d9/df/dbf/df8 0 2024-04-16T14:35:41.883 INFO:tasks.workunit.client.0.smithi005.stdout:3/776: creat d2/d9/f105 x:0 0 0 2024-04-16T14:35:41.892 INFO:tasks.workunit.client.0.smithi005.stdout:3/777: creat d2/d9/df/daa/dc4/de1/f106 x:0 0 0 2024-04-16T14:35:41.895 INFO:tasks.workunit.client.0.smithi005.stdout:5/828: dwrite d0/d70/f107 [0,4194304] 0 2024-04-16T14:35:41.923 INFO:tasks.workunit.client.0.smithi005.stdout:5/829: dwrite d0/d6/d6e/d9e/fdf [4194304,4194304] 0 2024-04-16T14:35:41.924 INFO:tasks.workunit.client.0.smithi005.stdout:3/778: dwrite d2/d17/d46/d75/f60 [4194304,4194304] 0 2024-04-16T14:35:41.926 INFO:tasks.workunit.client.0.smithi005.stdout:5/830: rename d0/d6/d12/d1c/d81/d82/dda to d0/d6/d6e/d11d 0 2024-04-16T14:35:41.929 INFO:tasks.workunit.client.0.smithi005.stdout:3/779: rename d2/d9/df/daa/dc4/de1 to d2/d17/d46/d75/d6d/dd5/d107 0 2024-04-16T14:35:41.931 INFO:tasks.workunit.client.0.smithi005.stdout:5/831: rename d0/d6/d12/dc0/d30/l43 to d0/d6/d12/dc0/d6d/l11e 0 2024-04-16T14:35:41.931 INFO:tasks.workunit.client.0.smithi005.stdout:3/780: creat d2/d9/df/daa/dc4/dce/f108 x:0 0 0 2024-04-16T14:35:41.932 INFO:tasks.workunit.client.0.smithi005.stdout:5/832: mknod d0/d6/d12/d1c/d81/c11f 0 2024-04-16T14:35:41.932 INFO:tasks.workunit.client.0.smithi005.stdout:5/833: dread - d0/d6/d12/d1c/d1e/f7b zero size 2024-04-16T14:35:41.932 INFO:tasks.workunit.client.0.smithi005.stdout:5/834: chown d0/d6/d12/dc0/d30/c7f 392233256 1 2024-04-16T14:35:41.932 INFO:tasks.workunit.client.0.smithi005.stdout:5/835: fdatasync d0/d6/f36 0 2024-04-16T14:35:41.932 INFO:tasks.workunit.client.0.smithi005.stdout:3/781: mknod d2/d9/d51/c109 0 2024-04-16T14:35:41.933 INFO:tasks.workunit.client.0.smithi005.stdout:5/836: symlink d0/dfa/l120 0 2024-04-16T14:35:41.934 INFO:tasks.workunit.client.0.smithi005.stdout:3/782: creat d2/d17/d102/f10a x:0 0 0 2024-04-16T14:35:41.937 INFO:tasks.workunit.client.0.smithi005.stdout:3/783: mknod d2/d17/d46/c10b 0 2024-04-16T14:35:41.939 INFO:tasks.workunit.client.0.smithi005.stdout:3/784: dread d2/d17/d46/d75/d41/d79/fa4 [0,4194304] 0 2024-04-16T14:35:41.939 INFO:tasks.workunit.client.0.smithi005.stdout:3/785: chown d2/d17/d46/d75/d6d/dd0/dda/dfc 82595627 1 2024-04-16T14:35:41.941 INFO:tasks.workunit.client.0.smithi005.stdout:3/786: link d2/d9/df/dbf/df8/f85 d2/d92/f10c 0 2024-04-16T14:35:41.946 INFO:tasks.workunit.client.0.smithi005.stdout:5/837: dwrite d0/d6/d12/d1c/d1e/f7b [0,4194304] 0 2024-04-16T14:35:41.947 INFO:tasks.workunit.client.0.smithi005.stdout:5/838: fsync d0/d6/d12/d1c/f22 0 2024-04-16T14:35:41.950 INFO:tasks.workunit.client.0.smithi005.stdout:5/839: link d0/d6/d12/f41 d0/d6/d6e/f121 0 2024-04-16T14:35:41.951 INFO:tasks.workunit.client.0.smithi005.stdout:5/840: mkdir d0/d6/d12/d1c/d81/d82/d122 0 2024-04-16T14:35:41.951 INFO:tasks.workunit.client.0.smithi005.stdout:5/841: write d0/d6/d12/dc0/d8d/d5e/fbc [496384,83077] 0 2024-04-16T14:35:41.953 INFO:tasks.workunit.client.0.smithi005.stdout:5/842: truncate d0/d6/d12/d1c/d1e/f2b 2962043 0 2024-04-16T14:35:41.955 INFO:tasks.workunit.client.0.smithi005.stdout:3/787: dwrite d2/d6b/f99 [0,4194304] 0 2024-04-16T14:35:41.956 INFO:tasks.workunit.client.0.smithi005.stdout:5/843: rename d0/d6/d12/d1c/d1e/cad to d0/d6/d12/d1c/dd2/c123 0 2024-04-16T14:35:41.956 INFO:tasks.workunit.client.0.smithi005.stdout:5/844: fdatasync d0/d6/d12/d1c/f1f 0 2024-04-16T14:35:41.958 INFO:tasks.workunit.client.0.smithi005.stdout:3/788: getdents d2/d17/d46 0 2024-04-16T14:35:41.960 INFO:tasks.workunit.client.0.smithi005.stdout:5/845: symlink d0/d6/d12/d1c/l124 0 2024-04-16T14:35:41.960 INFO:tasks.workunit.client.0.smithi005.stdout:5/846: read - d0/faf zero size 2024-04-16T14:35:41.962 INFO:tasks.workunit.client.0.smithi005.stdout:3/789: rename d2/d17/d46/d75/d9b/dbd/fd6 to d2/d9/f10d 0 2024-04-16T14:35:41.967 INFO:tasks.workunit.client.0.smithi005.stdout:3/790: dread d2/d17/d46/d75/d9b/fb8 [0,4194304] 0 2024-04-16T14:35:41.967 INFO:tasks.workunit.client.0.smithi005.stdout:3/791: creat d2/d17/d46/d47/f10e x:0 0 0 2024-04-16T14:35:41.969 INFO:tasks.workunit.client.0.smithi005.stdout:3/792: mknod d2/d17/d46/d75/d9b/dbd/dee/c10f 0 2024-04-16T14:35:41.969 INFO:tasks.workunit.client.0.smithi005.stdout:3/793: fdatasync d2/d9/d25/d39/f3b 0 2024-04-16T14:35:41.969 INFO:tasks.workunit.client.0.smithi005.stdout:3/794: chown d2/d9/df/daa 129 1 2024-04-16T14:35:41.969 INFO:tasks.workunit.client.0.smithi005.stdout:3/795: truncate d2/d9/d25/d39/f3b 8599636 0 2024-04-16T14:35:41.970 INFO:tasks.workunit.client.0.smithi005.stdout:3/796: rmdir d2/d9/df/dbf 39 2024-04-16T14:35:41.970 INFO:tasks.workunit.client.0.smithi005.stdout:3/797: chown d2/d9/d7d/lec 16000256 1 2024-04-16T14:35:41.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:41 smithi005 ceph-mon[28964]: pgmap v25: 65 pgs: 65 active+clean; 2.1 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 241 MiB/s rd, 281 MiB/s wr, 664 op/s 2024-04-16T14:35:41.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:41 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:35:41.975 INFO:tasks.workunit.client.1.smithi115.stdout:2/729: symlink d0/d1b/le5 0 2024-04-16T14:35:41.978 INFO:tasks.workunit.client.0.smithi005.stdout:5/847: dwrite d0/d70/db3/fb1 [0,4194304] 0 2024-04-16T14:35:41.979 INFO:tasks.workunit.client.1.smithi115.stdout:1/627: rename ld to df/d35/d84/ld1 0 2024-04-16T14:35:41.981 INFO:tasks.workunit.client.0.smithi005.stdout:5/848: truncate d0/d6/fab 1090359 0 2024-04-16T14:35:41.983 INFO:tasks.workunit.client.1.smithi115.stdout:0/517: rmdir d6/d30/d8d 39 2024-04-16T14:35:41.983 INFO:tasks.workunit.client.1.smithi115.stdout:0/518: chown d6/d54/d57/d83 182 1 2024-04-16T14:35:41.985 INFO:tasks.workunit.client.1.smithi115.stdout:1/628: unlink df/f23 0 2024-04-16T14:35:41.988 INFO:tasks.workunit.client.1.smithi115.stdout:2/730: rename d0/d47/d65/d61/lcb to d0/d47/d65/dad/dc8/d24/d23/d80/le6 0 2024-04-16T14:35:41.988 INFO:tasks.workunit.client.1.smithi115.stdout:1/629: rename df to df/d36/dd2 22 2024-04-16T14:35:41.989 INFO:tasks.workunit.client.0.smithi005.stdout:3/798: dwrite d2/f44 [0,4194304] 0 2024-04-16T14:35:41.989 INFO:tasks.workunit.client.0.smithi005.stdout:3/799: fdatasync d2/d17/f6f 0 2024-04-16T14:35:41.991 INFO:tasks.workunit.client.1.smithi115.stdout:9/632: mkdir d1/ddb 0 2024-04-16T14:35:41.991 INFO:tasks.workunit.client.1.smithi115.stdout:9/633: creat d1/d6/d2d/d4b/d60/d65/fdc x:0 0 0 2024-04-16T14:35:41.991 INFO:tasks.workunit.client.1.smithi115.stdout:9/634: fsync d1/f92 0 2024-04-16T14:35:41.991 INFO:tasks.workunit.client.1.smithi115.stdout:9/635: chown d1/d6/d29 0 1 2024-04-16T14:35:41.991 INFO:tasks.workunit.client.1.smithi115.stdout:2/731: rmdir d0/d47/d65/dad/dbb/d11/d25 39 2024-04-16T14:35:41.992 INFO:tasks.workunit.client.0.smithi005.stdout:5/849: read d0/d6/f31 [3406726,39007] 0 2024-04-16T14:35:41.992 INFO:tasks.workunit.client.0.smithi005.stdout:3/800: unlink d2/d17/d46/d75/l3f 0 2024-04-16T14:35:41.992 INFO:tasks.workunit.client.1.smithi115.stdout:1/630: rename df/d13/d4d/fcd to df/d35/fd3 0 2024-04-16T14:35:41.993 INFO:tasks.workunit.client.1.smithi115.stdout:9/636: mkdir d1/d6/d2d/d4b/d8f/d91/dda/ddd 0 2024-04-16T14:35:41.995 INFO:tasks.workunit.client.1.smithi115.stdout:1/631: symlink df/d35/d48/ld4 0 2024-04-16T14:35:41.997 INFO:tasks.workunit.client.1.smithi115.stdout:9/637: creat d1/d6/d2d/d4b/d60/d65/dc6/fde x:0 0 0 2024-04-16T14:35:41.999 INFO:tasks.workunit.client.1.smithi115.stdout:2/732: mkdir d0/d47/d65/dad/dc8/d24/d23/d83/de7 0 2024-04-16T14:35:41.999 INFO:tasks.workunit.client.1.smithi115.stdout:0/519: dwrite d6/d10/d12/d1f/d36/d4b/f69 [0,4194304] 0 2024-04-16T14:35:41.999 INFO:tasks.workunit.client.0.smithi005.stdout:5/850: dread d0/d6/d12/dc0/d8d/f83 [0,4194304] 0 2024-04-16T14:35:42.000 INFO:tasks.workunit.client.1.smithi115.stdout:2/733: read d0/fa1 [78985,65201] 0 2024-04-16T14:35:42.000 INFO:tasks.workunit.client.1.smithi115.stdout:2/734: dread - d0/d47/d65/dad/dbb/d11/d25/fda zero size 2024-04-16T14:35:42.001 INFO:tasks.workunit.client.0.smithi005.stdout:5/851: getdents d0/d6/d6e/db8 0 2024-04-16T14:35:42.001 INFO:tasks.workunit.client.1.smithi115.stdout:1/632: creat df/d36/d94/fd5 x:0 0 0 2024-04-16T14:35:42.001 INFO:tasks.workunit.client.1.smithi115.stdout:1/633: write df/d13/d4d/d2c/fb4 [2701188,68214] 0 2024-04-16T14:35:42.001 INFO:tasks.workunit.client.0.smithi005.stdout:5/852: stat d0/d6/d12/d1c/d81/l91 0 2024-04-16T14:35:42.002 INFO:tasks.workunit.client.0.smithi005.stdout:5/853: write d0/d6/d12/dc0/d8d/fa8 [561961,76924] 0 2024-04-16T14:35:42.002 INFO:tasks.workunit.client.0.smithi005.stdout:5/854: truncate d0/f6a 4598924 0 2024-04-16T14:35:42.003 INFO:tasks.workunit.client.0.smithi005.stdout:5/855: mknod d0/d6/d103/c125 0 2024-04-16T14:35:42.003 INFO:tasks.workunit.client.0.smithi005.stdout:5/856: chown d0/d70/dea 57788 1 2024-04-16T14:35:42.003 INFO:tasks.workunit.client.0.smithi005.stdout:5/857: truncate d0/d6/d12/dc0/d42/fc3 1013104 0 2024-04-16T14:35:42.003 INFO:tasks.workunit.client.0.smithi005.stdout:5/858: truncate d0/d6/d12/d1c/dd2/df7/f109 662817 0 2024-04-16T14:35:42.004 INFO:tasks.workunit.client.0.smithi005.stdout:5/859: stat d0/d6/d12/dc0/d42/l69 0 2024-04-16T14:35:42.004 INFO:tasks.workunit.client.0.smithi005.stdout:5/860: mknod d0/d70/dea/c126 0 2024-04-16T14:35:42.005 INFO:tasks.workunit.client.1.smithi115.stdout:0/520: creat d6/d10/d71/db7/fb8 x:0 0 0 2024-04-16T14:35:42.005 INFO:tasks.workunit.client.1.smithi115.stdout:0/521: fdatasync d6/d10/f40 0 2024-04-16T14:35:42.005 INFO:tasks.workunit.client.1.smithi115.stdout:2/735: mknod d0/d47/d65/dad/dbb/d11/ce8 0 2024-04-16T14:35:42.005 INFO:tasks.workunit.client.1.smithi115.stdout:2/736: creat d0/d47/d65/dad/dbb/d11/d36/fe9 x:0 0 0 2024-04-16T14:35:42.005 INFO:tasks.workunit.client.0.smithi005.stdout:5/861: creat d0/d6/d12/d1c/f127 x:0 0 0 2024-04-16T14:35:42.007 INFO:tasks.workunit.client.0.smithi005.stdout:5/862: mkdir d0/d6/d12/dc0/d8d/d128 0 2024-04-16T14:35:42.007 INFO:tasks.workunit.client.0.smithi005.stdout:5/863: chown d0/d6/d12/dc0/d6d/fd6 2674726 1 2024-04-16T14:35:42.008 INFO:tasks.workunit.client.1.smithi115.stdout:2/737: mknod d0/d47/d65/dad/dbb/d11/d25/d95/cea 0 2024-04-16T14:35:42.010 INFO:tasks.workunit.client.1.smithi115.stdout:9/638: read d1/d6/d2d/d4b/d6c/d20/d36/fcf [138604,37117] 0 2024-04-16T14:35:42.010 INFO:tasks.workunit.client.1.smithi115.stdout:9/639: creat d1/d6/d2d/d4b/d8f/d91/fdf x:0 0 0 2024-04-16T14:35:42.011 INFO:tasks.workunit.client.1.smithi115.stdout:1/634: rmdir df/d2d 39 2024-04-16T14:35:42.014 INFO:tasks.workunit.client.1.smithi115.stdout:9/640: mkdir d1/d6/de0 0 2024-04-16T14:35:42.014 INFO:tasks.workunit.client.1.smithi115.stdout:9/641: dread - d1/d6/d2d/d4b/d8f/d91/f6a zero size 2024-04-16T14:35:42.015 INFO:tasks.workunit.client.1.smithi115.stdout:1/635: chown df/f64 286 1 2024-04-16T14:35:42.016 INFO:tasks.workunit.client.0.smithi005.stdout:3/801: dwrite d2/d17/d46/d75/d6d/f73 [0,4194304] 0 2024-04-16T14:35:42.017 INFO:tasks.workunit.client.1.smithi115.stdout:9/642: link d1/d6/d2d/d4b/d6c/d20/d36/c7d d1/d6/d2d/d4b/d8f/d91/ce1 0 2024-04-16T14:35:42.018 INFO:tasks.workunit.client.1.smithi115.stdout:1/636: link df/d35/d48/c4b df/d13/d4d/d68/cd6 0 2024-04-16T14:35:42.019 INFO:tasks.workunit.client.1.smithi115.stdout:1/637: write df/d13/d4d/d2c/f3b [511559,12997] 0 2024-04-16T14:35:42.020 INFO:tasks.workunit.client.1.smithi115.stdout:9/643: creat d1/d6/d2d/d4b/d8f/fe2 x:0 0 0 2024-04-16T14:35:42.021 INFO:tasks.workunit.client.1.smithi115.stdout:1/638: rename df/d13/d4d/d3e/d75/da9/db7/cc7 to df/d13/d4d/d3e/d75/da9/db7/cd7 0 2024-04-16T14:35:42.022 INFO:tasks.workunit.client.0.smithi005.stdout:5/864: dread d0/d6/d12/d1c/d1e/f7b [0,4194304] 0 2024-04-16T14:35:42.022 INFO:tasks.workunit.client.0.smithi005.stdout:5/865: chown d0/d70/ff3 28 1 2024-04-16T14:35:42.023 INFO:tasks.workunit.client.1.smithi115.stdout:1/639: getdents df/d36 0 2024-04-16T14:35:42.023 INFO:tasks.workunit.client.1.smithi115.stdout:1/640: write df/d13/d4d/d3e/d75/da9/db7/fc1 [811495,31622] 0 2024-04-16T14:35:42.024 INFO:tasks.workunit.client.0.smithi005.stdout:5/866: link d0/fdc d0/d6/d12/dc0/d42/f129 0 2024-04-16T14:35:42.024 INFO:tasks.workunit.client.0.smithi005.stdout:5/867: readlink d0/d6/d12/dc0/d8d/d5e/l93 0 2024-04-16T14:35:42.024 INFO:tasks.workunit.client.1.smithi115.stdout:2/738: dread d0/d47/d65/dad/dbb/d11/fde [0,4194304] 0 2024-04-16T14:35:42.024 INFO:tasks.workunit.client.1.smithi115.stdout:0/522: dwrite d6/f9f [4194304,4194304] 0 2024-04-16T14:35:42.025 INFO:tasks.workunit.client.0.smithi005.stdout:5/868: creat d0/d6/d12/d1c/d1e/d73/df0/f12a x:0 0 0 2024-04-16T14:35:42.026 INFO:tasks.workunit.client.1.smithi115.stdout:1/641: creat df/d13/d4d/d2c/fd8 x:0 0 0 2024-04-16T14:35:42.029 INFO:tasks.workunit.client.1.smithi115.stdout:1/642: fsync df/d13/d4d/d2c/f3b 0 2024-04-16T14:35:42.029 INFO:tasks.workunit.client.1.smithi115.stdout:1/643: write df/f7f [440782,25523] 0 2024-04-16T14:35:42.029 INFO:tasks.workunit.client.1.smithi115.stdout:1/644: write df/f27 [736000,96866] 0 2024-04-16T14:35:42.033 INFO:tasks.workunit.client.0.smithi005.stdout:1/992: sync 2024-04-16T14:35:42.033 INFO:tasks.workunit.client.0.smithi005.stdout:6/945: sync 2024-04-16T14:35:42.033 INFO:tasks.workunit.client.0.smithi005.stdout:2/650: sync 2024-04-16T14:35:42.033 INFO:tasks.workunit.client.0.smithi005.stdout:5/869: dread d0/d70/ff3 [0,4194304] 0 2024-04-16T14:35:42.033 INFO:tasks.workunit.client.0.smithi005.stdout:1/993: write d2/d1c/d15/d2a/d19/dc9/de0/f111 [19158,128791] 0 2024-04-16T14:35:42.033 INFO:tasks.workunit.client.0.smithi005.stdout:1/994: rename d2/d74/dd7/d11f/d51/d132/df4 to d2/d74/dd7/d11f/d51/d132/df4/d157 22 2024-04-16T14:35:42.033 INFO:tasks.workunit.client.0.smithi005.stdout:1/995: write d2/d1c/d15/d6f/f8d [5609188,104036] 0 2024-04-16T14:35:42.034 INFO:tasks.workunit.client.1.smithi115.stdout:2/739: mknod d0/d47/d65/dad/dbb/d11/dbc/ceb 0 2024-04-16T14:35:42.034 INFO:tasks.workunit.client.1.smithi115.stdout:2/740: dread - d0/d47/d65/dad/dc8/d24/d21/f74 zero size 2024-04-16T14:35:42.034 INFO:tasks.workunit.client.1.smithi115.stdout:0/523: getdents d6/d10/d94 0 2024-04-16T14:35:42.034 INFO:tasks.workunit.client.0.smithi005.stdout:5/870: mkdir d0/d6/d12/dc0/d42/d12b 0 2024-04-16T14:35:42.034 INFO:tasks.workunit.client.0.smithi005.stdout:5/871: write d0/d70/fa7 [1769454,44499] 0 2024-04-16T14:35:42.034 INFO:tasks.workunit.client.0.smithi005.stdout:5/872: stat d0/d6/f31 0 2024-04-16T14:35:42.035 INFO:tasks.workunit.client.1.smithi115.stdout:1/645: rename df/d13/fc9 to df/d13/d4d/d3e/d7d/fd9 0 2024-04-16T14:35:42.035 INFO:tasks.workunit.client.0.smithi005.stdout:6/946: read d2/d45/fe9 [13776,83904] 0 2024-04-16T14:35:42.035 INFO:tasks.workunit.client.0.smithi005.stdout:6/947: chown d2/d5 476954715 1 2024-04-16T14:35:42.036 INFO:tasks.workunit.client.1.smithi115.stdout:2/741: getdents d0/d47/d65/dad/dc8/d24/d23/d83 0 2024-04-16T14:35:42.036 INFO:tasks.workunit.client.0.smithi005.stdout:1/996: rename d2/d74/d7a/d100 to d2/d1c/d15/d2a/d1a/d144/d158 0 2024-04-16T14:35:42.037 INFO:tasks.workunit.client.0.smithi005.stdout:1/997: readlink d2/lf2 0 2024-04-16T14:35:42.037 INFO:tasks.workunit.client.0.smithi005.stdout:1/998: fsync d2/d74/dd7/d11f/d51/dc4/fe2 0 2024-04-16T14:35:42.037 INFO:tasks.workunit.client.0.smithi005.stdout:2/651: dread d0/d1c/d39/dcb/fd3 [0,4194304] 0 2024-04-16T14:35:42.037 INFO:tasks.workunit.client.0.smithi005.stdout:5/873: mkdir d0/d6/d12/dc0/d12c 0 2024-04-16T14:35:42.037 INFO:tasks.workunit.client.1.smithi115.stdout:0/524: mkdir d6/d1b/d4e/db9 0 2024-04-16T14:35:42.037 INFO:tasks.workunit.client.1.smithi115.stdout:0/525: read - d6/d10/d71/db7/fb8 zero size 2024-04-16T14:35:42.037 INFO:tasks.workunit.client.1.smithi115.stdout:2/742: rmdir d0/d47/d65/dad/dc8/d24/da0 39 2024-04-16T14:35:42.039 INFO:tasks.workunit.client.0.smithi005.stdout:6/948: rename d2/d5/d28/fd5 to d2/df/f13c 0 2024-04-16T14:35:42.039 INFO:tasks.workunit.client.0.smithi005.stdout:2/652: rename d0 to d0/d4/d2b/d5e/ddf 22 2024-04-16T14:35:42.039 INFO:tasks.workunit.client.0.smithi005.stdout:2/653: truncate d0/d2a/fbe 441063 0 2024-04-16T14:35:42.040 INFO:tasks.workunit.client.1.smithi115.stdout:2/743: rename d0/d47/d65/dad/dc8/d24/d23/d71/f93 to d0/d47/d65/fec 0 2024-04-16T14:35:42.040 INFO:tasks.workunit.client.1.smithi115.stdout:2/744: creat d0/d47/d65/dad/dc8/d24/d23/d71/fed x:0 0 0 2024-04-16T14:35:42.040 INFO:tasks.workunit.client.1.smithi115.stdout:2/745: write d0/d47/fdf [361215,72947] 0 2024-04-16T14:35:42.040 INFO:tasks.workunit.client.1.smithi115.stdout:2/746: truncate d0/d47/d65/dad/dc8/d24/d23/f8d 1183617 0 2024-04-16T14:35:42.040 INFO:tasks.workunit.client.0.smithi005.stdout:5/874: mknod d0/d6/d12/dc0/c12d 0 2024-04-16T14:35:42.041 INFO:tasks.workunit.client.0.smithi005.stdout:2/654: truncate d0/d1c/d39/d85/fa6 75484 0 2024-04-16T14:35:42.042 INFO:tasks.workunit.client.1.smithi115.stdout:1/646: dread df/d35/fd3 [0,4194304] 0 2024-04-16T14:35:42.042 INFO:tasks.workunit.client.1.smithi115.stdout:1/647: write df/d13/d4d/d3e/d75/da9/fba [1226764,116113] 0 2024-04-16T14:35:42.042 INFO:tasks.workunit.client.1.smithi115.stdout:1/648: dread - df/d13/d4d/d2c/d54/fbc zero size 2024-04-16T14:35:42.042 INFO:tasks.workunit.client.1.smithi115.stdout:1/649: stat df/d35/f67 0 2024-04-16T14:35:42.043 INFO:tasks.workunit.client.0.smithi005.stdout:5/875: creat d0/d6/d12/d1c/d1e/d73/f12e x:0 0 0 2024-04-16T14:35:42.051 INFO:tasks.workunit.client.1.smithi115.stdout:1/650: rename df/d36/d3c to df/d13/d4d/d3e/d75/dda 0 2024-04-16T14:35:42.051 INFO:tasks.workunit.client.1.smithi115.stdout:1/651: write df/d13/d4d/d6d/fa7 [206604,33695] 0 2024-04-16T14:35:42.052 INFO:tasks.workunit.client.1.smithi115.stdout:1/652: rename df/d13/c95 to df/d35/d48/cdb 0 2024-04-16T14:35:42.052 INFO:tasks.workunit.client.1.smithi115.stdout:1/653: dread - df/d13/d4d/d3e/d75/dda/fb6 zero size 2024-04-16T14:35:42.053 INFO:tasks.workunit.client.1.smithi115.stdout:1/654: mkdir df/d35/d84/ddc 0 2024-04-16T14:35:42.054 INFO:tasks.workunit.client.1.smithi115.stdout:2/747: dread d0/d47/d65/dad/dbb/d11/d6d/fbd [0,4194304] 0 2024-04-16T14:35:42.054 INFO:tasks.workunit.client.1.smithi115.stdout:2/748: fdatasync d0/d47/d65/dad/dc8/f3a 0 2024-04-16T14:35:42.054 INFO:tasks.workunit.client.1.smithi115.stdout:2/749: stat d0/d1b/fc0 0 2024-04-16T14:35:42.056 INFO:tasks.workunit.client.1.smithi115.stdout:2/750: mknod d0/d47/d65/dad/dbb/d11/d25/d95/cee 0 2024-04-16T14:35:42.057 INFO:tasks.workunit.client.1.smithi115.stdout:2/751: chown d0/d47/d65/dad/dc8/d4a/f81 12112 1 2024-04-16T14:35:42.060 INFO:tasks.workunit.client.0.smithi005.stdout:3/802: dwrite d2/d9/d5e/fdc [0,4194304] 0 2024-04-16T14:35:42.063 INFO:tasks.workunit.client.0.smithi005.stdout:3/803: mknod d2/d9/c110 0 2024-04-16T14:35:42.065 INFO:tasks.workunit.client.0.smithi005.stdout:2/655: write d0/d2a/d3a/f95 [3128248,48451] 0 2024-04-16T14:35:42.066 INFO:tasks.workunit.client.0.smithi005.stdout:3/804: rename d2/d9/d25/d39/fcd to d2/d9/d25/f111 0 2024-04-16T14:35:42.066 INFO:tasks.workunit.client.0.smithi005.stdout:3/805: getdents d2/d17/d46/d75/d6d/dd0/dda/dfc 0 2024-04-16T14:35:42.066 INFO:tasks.workunit.client.1.smithi115.stdout:2/752: dread d0/d47/d65/dad/dbb/f37 [0,4194304] 0 2024-04-16T14:35:42.068 INFO:tasks.workunit.client.0.smithi005.stdout:3/806: creat d2/d6b/f112 x:0 0 0 2024-04-16T14:35:42.069 INFO:tasks.workunit.client.1.smithi115.stdout:2/753: dread d0/d47/d65/dad/dc8/d24/d10/f89 [0,4194304] 0 2024-04-16T14:35:42.069 INFO:tasks.workunit.client.1.smithi115.stdout:2/754: write d0/d47/d65/dad/dc8/d4a/fdb [33063,57498] 0 2024-04-16T14:35:42.070 INFO:tasks.workunit.client.0.smithi005.stdout:3/807: link d2/d9/df/daa/dc4/dce/f108 d2/d17/d46/d75/d9b/f113 0 2024-04-16T14:35:42.070 INFO:tasks.workunit.client.1.smithi115.stdout:2/755: symlink d0/d47/d65/dad/dbb/lef 0 2024-04-16T14:35:42.071 INFO:tasks.workunit.client.0.smithi005.stdout:3/808: symlink d2/d6b/d7a/l114 0 2024-04-16T14:35:42.072 INFO:tasks.workunit.client.0.smithi005.stdout:3/809: creat d2/d17/d46/d75/d6d/dd0/dda/f115 x:0 0 0 2024-04-16T14:35:42.072 INFO:tasks.workunit.client.0.smithi005.stdout:3/810: creat d2/d17/d46/d75/d6d/dd0/dda/f116 x:0 0 0 2024-04-16T14:35:42.075 INFO:tasks.workunit.client.0.smithi005.stdout:3/811: creat d2/d17/d46/d47/de8/f117 x:0 0 0 2024-04-16T14:35:42.076 INFO:tasks.workunit.client.0.smithi005.stdout:3/812: creat d2/d17/d46/d75/d41/f118 x:0 0 0 2024-04-16T14:35:42.078 INFO:tasks.workunit.client.0.smithi005.stdout:3/813: getdents d2/d9/df/daa/dc4/dce 0 2024-04-16T14:35:42.086 INFO:tasks.workunit.client.0.smithi005.stdout:3/814: creat d2/d9/df/dbf/f119 x:0 0 0 2024-04-16T14:35:42.087 INFO:tasks.workunit.client.0.smithi005.stdout:3/815: rename d2/d9/d5e/ca6 to d2/d17/d46/d75/d9b/dbd/dee/c11a 0 2024-04-16T14:35:42.088 INFO:tasks.workunit.client.1.smithi115.stdout:2/756: dread d0/d47/d65/dad/dc8/d24/d23/f6c [0,4194304] 0 2024-04-16T14:35:42.088 INFO:tasks.workunit.client.0.smithi005.stdout:3/816: symlink d2/d17/d46/d75/d6d/dd0/l11b 0 2024-04-16T14:35:42.089 INFO:tasks.workunit.client.1.smithi115.stdout:2/757: unlink d0/d47/d65/dad/dc8/d24/d21/d59/lc2 0 2024-04-16T14:35:42.090 INFO:tasks.workunit.client.0.smithi005.stdout:3/817: creat d2/d92/f11c x:0 0 0 2024-04-16T14:35:42.091 INFO:tasks.workunit.client.1.smithi115.stdout:2/758: getdents d0/d1b 0 2024-04-16T14:35:42.091 INFO:tasks.workunit.client.1.smithi115.stdout:9/644: dwrite d1/d6/d2d/d4b/d6c/d20/d36/fcf [0,4194304] 0 2024-04-16T14:35:42.092 INFO:tasks.workunit.client.0.smithi005.stdout:3/818: rename d2/d17/f8b to d2/d9/d7d/f11d 0 2024-04-16T14:35:42.092 INFO:tasks.workunit.client.1.smithi115.stdout:0/526: dwrite d6/d10/d12/d1f/d36/fa2 [0,4194304] 0 2024-04-16T14:35:42.102 INFO:tasks.workunit.client.0.smithi005.stdout:5/876: dwrite d0/d70/dea/fee [0,4194304] 0 2024-04-16T14:35:42.102 INFO:tasks.workunit.client.0.smithi005.stdout:6/949: dwrite d2/d5/d28/f46 [0,4194304] 0 2024-04-16T14:35:42.103 INFO:tasks.workunit.client.0.smithi005.stdout:1/999: dwrite d2/d74/dd7/f81 [0,4194304] 0 2024-04-16T14:35:42.104 INFO:tasks.workunit.client.0.smithi005.stdout:5/877: mknod d0/d6/c12f 0 2024-04-16T14:35:42.104 INFO:tasks.workunit.client.1.smithi115.stdout:0/527: mkdir d6/d10/d12/dba 0 2024-04-16T14:35:42.105 INFO:tasks.workunit.client.0.smithi005.stdout:6/950: creat d2/d5/d10/dd6/d8e/f13d x:0 0 0 2024-04-16T14:35:42.105 INFO:tasks.workunit.client.0.smithi005.stdout:2/656: dwrite d0/f90 [0,4194304] 0 2024-04-16T14:35:42.106 INFO:tasks.workunit.client.1.smithi115.stdout:2/759: dread d0/d1b/fc0 [0,4194304] 0 2024-04-16T14:35:42.106 INFO:tasks.workunit.client.1.smithi115.stdout:2/760: chown d0/d47/d65/dad/dc8/d24/da0/fd9 1 1 2024-04-16T14:35:42.106 INFO:tasks.workunit.client.1.smithi115.stdout:2/761: creat d0/d47/d65/ff0 x:0 0 0 2024-04-16T14:35:42.106 INFO:tasks.workunit.client.1.smithi115.stdout:6/621: sync 2024-04-16T14:35:42.106 INFO:tasks.workunit.client.1.smithi115.stdout:8/666: sync 2024-04-16T14:35:42.106 INFO:tasks.workunit.client.1.smithi115.stdout:4/592: sync 2024-04-16T14:35:42.106 INFO:tasks.workunit.client.1.smithi115.stdout:3/685: sync 2024-04-16T14:35:42.107 INFO:tasks.workunit.client.0.smithi005.stdout:6/951: creat d2/d3f/d53/d54/db5/f13e x:0 0 0 2024-04-16T14:35:42.108 INFO:tasks.workunit.client.1.smithi115.stdout:9/645: dread d1/d6/d33/f85 [0,4194304] 0 2024-04-16T14:35:42.108 INFO:tasks.workunit.client.1.smithi115.stdout:1/655: dwrite df/d13/d4d/d68/f71 [0,4194304] 0 2024-04-16T14:35:42.108 INFO:tasks.workunit.client.0.smithi005.stdout:2/657: creat d0/d29/d3e/fe0 x:0 0 0 2024-04-16T14:35:42.110 INFO:tasks.workunit.client.1.smithi115.stdout:2/762: creat d0/d47/d65/d61/dae/ff1 x:0 0 0 2024-04-16T14:35:42.110 INFO:tasks.workunit.client.1.smithi115.stdout:2/763: dread - d0/d47/d65/d61/dae/ff1 zero size 2024-04-16T14:35:42.110 INFO:tasks.workunit.client.1.smithi115.stdout:2/764: dread - d0/d47/d65/dad/dbb/d11/d36/fd8 zero size 2024-04-16T14:35:42.111 INFO:tasks.workunit.client.0.smithi005.stdout:6/952: rmdir d2/d5/d10/dd6/d7a/d109 0 2024-04-16T14:35:42.113 INFO:tasks.workunit.client.0.smithi005.stdout:6/953: creat d2/de1/f13f x:0 0 0 2024-04-16T14:35:42.114 INFO:tasks.workunit.client.1.smithi115.stdout:6/622: creat d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/d55/fcc x:0 0 0 2024-04-16T14:35:42.115 INFO:tasks.workunit.client.0.smithi005.stdout:6/954: mknod d2/d3f/d53/dba/d111/c140 0 2024-04-16T14:35:42.115 INFO:tasks.workunit.client.1.smithi115.stdout:3/686: mknod dc/d29/d4d/ce5 0 2024-04-16T14:35:42.119 INFO:tasks.workunit.client.1.smithi115.stdout:8/667: dread d0/db/f12 [0,4194304] 0 2024-04-16T14:35:42.119 INFO:tasks.workunit.client.0.smithi005.stdout:2/658: dread d0/d1c/d39/d48/f7b [0,4194304] 0 2024-04-16T14:35:42.120 INFO:tasks.workunit.client.1.smithi115.stdout:4/593: dread d1/d15/d1e/f5d [0,4194304] 0 2024-04-16T14:35:42.120 INFO:tasks.workunit.client.1.smithi115.stdout:1/656: creat df/fdd x:0 0 0 2024-04-16T14:35:42.121 INFO:tasks.workunit.client.1.smithi115.stdout:9/646: truncate d1/d7f/f93 655225 0 2024-04-16T14:35:42.122 INFO:tasks.workunit.client.0.smithi005.stdout:2/659: mknod d0/d1c/d39/d85/da2/ce1 0 2024-04-16T14:35:42.124 INFO:tasks.workunit.client.0.smithi005.stdout:0/698: sync 2024-04-16T14:35:42.124 INFO:tasks.workunit.client.0.smithi005.stdout:0/699: stat da/cd 0 2024-04-16T14:35:42.124 INFO:tasks.workunit.client.0.smithi005.stdout:8/757: sync 2024-04-16T14:35:42.124 INFO:tasks.workunit.client.0.smithi005.stdout:9/591: sync 2024-04-16T14:35:42.125 INFO:tasks.workunit.client.1.smithi115.stdout:2/765: symlink d0/d1b/lf2 0 2024-04-16T14:35:42.125 INFO:tasks.workunit.client.1.smithi115.stdout:2/766: truncate d0/d47/d65/dad/dc8/d24/da0/fd9 4557453 0 2024-04-16T14:35:42.126 INFO:tasks.workunit.client.0.smithi005.stdout:0/700: rename da/d7c to da/df/d1b/d24/de7 0 2024-04-16T14:35:42.126 INFO:tasks.workunit.client.0.smithi005.stdout:7/915: sync 2024-04-16T14:35:42.127 INFO:tasks.workunit.client.0.smithi005.stdout:9/592: getdents d3/d12/d16/d46/d47 0 2024-04-16T14:35:42.128 INFO:tasks.workunit.client.1.smithi115.stdout:3/687: unlink dc/d24/d33/d4b/cd7 0 2024-04-16T14:35:42.128 INFO:tasks.workunit.client.1.smithi115.stdout:3/688: write dc/f1c [1527114,123815] 0 2024-04-16T14:35:42.130 INFO:tasks.workunit.client.0.smithi005.stdout:8/758: rename d5/d7b/da8/db7/d8a/da1/d68/f75 to d5/d40/d4b/f10b 0 2024-04-16T14:35:42.130 INFO:tasks.workunit.client.0.smithi005.stdout:8/759: truncate d5/d7b/da8/da5/def/d71/fb9 1065056 0 2024-04-16T14:35:42.130 INFO:tasks.workunit.client.1.smithi115.stdout:8/668: mknod d0/db/d10/d17/d2c/d52/d6c/db8/d6b/cda 0 2024-04-16T14:35:42.130 INFO:tasks.workunit.client.1.smithi115.stdout:8/669: readlink d0/l48 0 2024-04-16T14:35:42.131 INFO:tasks.workunit.client.1.smithi115.stdout:8/670: dread - d0/db/d44/fc1 zero size 2024-04-16T14:35:42.132 INFO:tasks.workunit.client.0.smithi005.stdout:0/701: creat da/df/d26/d39/d55/fe8 x:0 0 0 2024-04-16T14:35:42.134 INFO:tasks.workunit.client.0.smithi005.stdout:7/916: symlink d1/d8a/l130 0 2024-04-16T14:35:42.134 INFO:tasks.workunit.client.1.smithi115.stdout:8/671: read d0/db/d10/d17/f4c [8553661,51973] 0 2024-04-16T14:35:42.134 INFO:tasks.workunit.client.1.smithi115.stdout:4/594: creat d1/d15/d9c/faf x:0 0 0 2024-04-16T14:35:42.135 INFO:tasks.workunit.client.0.smithi005.stdout:9/593: mknod d3/d12/d16/d46/d47/d60/ca8 0 2024-04-16T14:35:42.135 INFO:tasks.workunit.client.1.smithi115.stdout:1/657: symlink df/d13/d4d/d3e/d75/dda/lde 0 2024-04-16T14:35:42.136 INFO:tasks.workunit.client.1.smithi115.stdout:9/647: symlink d1/d6/d2d/d3d/d49/d88/le3 0 2024-04-16T14:35:42.136 INFO:tasks.workunit.client.1.smithi115.stdout:9/648: write d1/d6/d2d/d4b/d8f/d91/f6e [425886,74010] 0 2024-04-16T14:35:42.136 INFO:tasks.workunit.client.0.smithi005.stdout:6/955: write d2/d5/d28/f46 [4126644,53940] 0 2024-04-16T14:35:42.137 INFO:tasks.workunit.client.1.smithi115.stdout:3/689: link dc/f27 dc/d29/fe6 0 2024-04-16T14:35:42.137 INFO:tasks.workunit.client.1.smithi115.stdout:3/690: chown dc/d29/d77/lce 618 1 2024-04-16T14:35:42.139 INFO:tasks.workunit.client.0.smithi005.stdout:8/760: mknod d5/d7b/da8/da5/def/c10c 0 2024-04-16T14:35:42.141 INFO:tasks.workunit.client.1.smithi115.stdout:1/658: rename df/d2d/f41 to df/d36/d94/dc4/fdf 0 2024-04-16T14:35:42.142 INFO:tasks.workunit.client.0.smithi005.stdout:7/917: mknod d1/d49/d74/ded/c131 0 2024-04-16T14:35:42.144 INFO:tasks.workunit.client.1.smithi115.stdout:4/595: mknod d1/d15/cb0 0 2024-04-16T14:35:42.144 INFO:tasks.workunit.client.1.smithi115.stdout:4/596: stat d1/d15/d1e/f81 0 2024-04-16T14:35:42.144 INFO:tasks.workunit.client.1.smithi115.stdout:4/597: chown d1/d2/c8f 228286081 1 2024-04-16T14:35:42.145 INFO:tasks.workunit.client.0.smithi005.stdout:9/594: mkdir d3/d49/d4b/d5c/d65/d9a/da9 0 2024-04-16T14:35:42.145 INFO:tasks.workunit.client.0.smithi005.stdout:9/595: truncate d3/f14 1433886 0 2024-04-16T14:35:42.146 INFO:tasks.workunit.client.1.smithi115.stdout:9/649: rename d1/d6/d33/laf to d1/d6/d2d/d4b/d60/d65/dc6/le4 0 2024-04-16T14:35:42.146 INFO:tasks.workunit.client.1.smithi115.stdout:9/650: fsync d1/d6/d2d/d3d/d49/d88/fd7 0 2024-04-16T14:35:42.147 INFO:tasks.workunit.client.0.smithi005.stdout:7/918: truncate d1/d49/d74/fdc 1348787 0 2024-04-16T14:35:42.147 INFO:tasks.workunit.client.1.smithi115.stdout:1/659: mkdir df/d35/d84/ddc/de0 0 2024-04-16T14:35:42.150 INFO:tasks.workunit.client.1.smithi115.stdout:8/672: rename d0/db/d10/d17/d2c/d52/d74/l81 to d0/db/dbb/dcd/dae/ldb 0 2024-04-16T14:35:42.150 INFO:tasks.workunit.client.0.smithi005.stdout:9/596: rename d3/l37 to d3/laa 0 2024-04-16T14:35:42.151 INFO:tasks.workunit.client.0.smithi005.stdout:9/597: fsync d3/d12/f30 0 2024-04-16T14:35:42.152 INFO:tasks.workunit.client.0.smithi005.stdout:7/919: mkdir d1/d49/d74/d77/d22/d27/df4/d132 0 2024-04-16T14:35:42.152 INFO:tasks.workunit.client.0.smithi005.stdout:9/598: rmdir d3/d12/d16/d46/d47/d60 39 2024-04-16T14:35:42.152 INFO:tasks.workunit.client.0.smithi005.stdout:9/599: write d3/fa2 [546332,2241] 0 2024-04-16T14:35:42.152 INFO:tasks.workunit.client.1.smithi115.stdout:9/651: link d1/d6/d2d/d3d/d50/f56 d1/d6/d2d/d3d/d49/d88/fe5 0 2024-04-16T14:35:42.152 INFO:tasks.workunit.client.1.smithi115.stdout:9/652: chown d1/d6/d2d/d4b/d8f/d91/l48 117055994 1 2024-04-16T14:35:42.153 INFO:tasks.workunit.client.1.smithi115.stdout:9/653: readlink d1/d6/d2d/d4b/d60/l81 0 2024-04-16T14:35:42.154 INFO:tasks.workunit.client.1.smithi115.stdout:1/660: rename df/d13/d4d/d2c/fb1 to df/d13/d4d/d2c/d54/d55/fe1 0 2024-04-16T14:35:42.154 INFO:tasks.workunit.client.1.smithi115.stdout:8/673: rename d0 to d0/db/d10/d25/d7c/ddc 22 2024-04-16T14:35:42.154 INFO:tasks.workunit.client.1.smithi115.stdout:1/661: read f0 [3740257,74895] 0 2024-04-16T14:35:42.155 INFO:tasks.workunit.client.1.smithi115.stdout:9/654: creat d1/d6/d2d/d3d/db7/fe6 x:0 0 0 2024-04-16T14:35:42.156 INFO:tasks.workunit.client.1.smithi115.stdout:8/674: rmdir d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f 39 2024-04-16T14:35:42.156 INFO:tasks.workunit.client.1.smithi115.stdout:8/675: chown d0/db/d10/d17/d2c/d52/ccb 46 1 2024-04-16T14:35:42.157 INFO:tasks.workunit.client.1.smithi115.stdout:0/528: dwrite d6/d10/d12/d31/d35/f3e [0,4194304] 0 2024-04-16T14:35:42.158 INFO:tasks.workunit.client.1.smithi115.stdout:1/662: mkdir df/d35/de2 0 2024-04-16T14:35:42.158 INFO:tasks.workunit.client.1.smithi115.stdout:1/663: write df/d13/d4d/d2c/d54/d55/fe1 [476785,89919] 0 2024-04-16T14:35:42.158 INFO:tasks.workunit.client.1.smithi115.stdout:1/664: readlink df/d35/l77 0 2024-04-16T14:35:42.159 INFO:tasks.workunit.client.1.smithi115.stdout:1/665: read df/d13/fcc [491270,58744] 0 2024-04-16T14:35:42.160 INFO:tasks.workunit.client.1.smithi115.stdout:9/655: link d1/d6/d2d/d3d/d49/d98/daa/fb0 d1/d6/d2d/d3d/d50/fe7 0 2024-04-16T14:35:42.162 INFO:tasks.workunit.client.0.smithi005.stdout:7/920: dread d1/d49/d74/d77/d57/d47/daa/fc8 [0,4194304] 0 2024-04-16T14:35:42.163 INFO:tasks.workunit.client.0.smithi005.stdout:7/921: getdents d1/d49/d74/d77/d22/d27/d117 0 2024-04-16T14:35:42.163 INFO:tasks.workunit.client.1.smithi115.stdout:5/572: sync 2024-04-16T14:35:42.164 INFO:tasks.workunit.client.1.smithi115.stdout:1/666: creat df/d35/fe3 x:0 0 0 2024-04-16T14:35:42.165 INFO:tasks.workunit.client.0.smithi005.stdout:7/922: creat d1/d49/d74/d77/d22/da0/f133 x:0 0 0 2024-04-16T14:35:42.165 INFO:tasks.workunit.client.0.smithi005.stdout:7/923: stat d1/d49/d74/d77/d22/d27/d2e/c69 0 2024-04-16T14:35:42.165 INFO:tasks.workunit.client.1.smithi115.stdout:9/656: chown d1/l8 10789 1 2024-04-16T14:35:42.165 INFO:tasks.workunit.client.1.smithi115.stdout:9/657: write d1/d6/d2d/d4b/d60/d65/dc6/fd3 [850032,30706] 0 2024-04-16T14:35:42.166 INFO:tasks.workunit.client.0.smithi005.stdout:7/924: mkdir d1/d49/d74/d77/d22/db0/dc6/d134 0 2024-04-16T14:35:42.167 INFO:tasks.workunit.client.0.smithi005.stdout:7/925: getdents d1/dc/d2f/d4f 0 2024-04-16T14:35:42.168 INFO:tasks.workunit.client.1.smithi115.stdout:1/667: getdents df/d13/d4d/d3e/d75 0 2024-04-16T14:35:42.168 INFO:tasks.workunit.client.1.smithi115.stdout:1/668: readlink df/d35/l77 0 2024-04-16T14:35:42.168 INFO:tasks.workunit.client.1.smithi115.stdout:1/669: dread - df/fdd zero size 2024-04-16T14:35:42.168 INFO:tasks.workunit.client.1.smithi115.stdout:1/670: creat df/d13/d4d/d2c/d54/fe4 x:0 0 0 2024-04-16T14:35:42.168 INFO:tasks.workunit.client.1.smithi115.stdout:9/658: mkdir d1/d6/d2d/d4b/d8f/d91/dda/ddd/de8 0 2024-04-16T14:35:42.169 INFO:tasks.workunit.client.0.smithi005.stdout:7/926: mknod d1/c135 0 2024-04-16T14:35:42.169 INFO:tasks.workunit.client.0.smithi005.stdout:7/927: creat d1/d49/d74/ddf/f136 x:0 0 0 2024-04-16T14:35:42.170 INFO:tasks.workunit.client.0.smithi005.stdout:6/956: dread d2/d3f/d53/d54/fc8 [0,4194304] 0 2024-04-16T14:35:42.170 INFO:tasks.workunit.client.0.smithi005.stdout:6/957: creat d2/d45/f141 x:0 0 0 2024-04-16T14:35:42.170 INFO:tasks.workunit.client.0.smithi005.stdout:6/958: readlink d2/d5/d10/d68/l103 0 2024-04-16T14:35:42.174 INFO:tasks.workunit.client.1.smithi115.stdout:9/659: dread d1/d6/d2d/d4b/d6c/d20/fa6 [0,4194304] 0 2024-04-16T14:35:42.174 INFO:tasks.workunit.client.1.smithi115.stdout:9/660: write d1/d6/d2d/d4b/d8f/fc4 [265649,54077] 0 2024-04-16T14:35:42.175 INFO:tasks.workunit.client.1.smithi115.stdout:9/661: dread d1/d6/d2d/f5b [0,4194304] 0 2024-04-16T14:35:42.178 INFO:tasks.workunit.client.1.smithi115.stdout:9/662: creat d1/d6/d29/fe9 x:0 0 0 2024-04-16T14:35:42.179 INFO:tasks.workunit.client.1.smithi115.stdout:9/663: creat d1/d6/d2d/d4b/d6c/d20/d36/dce/fea x:0 0 0 2024-04-16T14:35:42.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:41 smithi115 ceph-mon[37295]: pgmap v25: 65 pgs: 65 active+clean; 2.1 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 241 MiB/s rd, 281 MiB/s wr, 664 op/s 2024-04-16T14:35:42.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:41 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:35:42.182 INFO:tasks.workunit.client.1.smithi115.stdout:8/676: write d0/db/d10/d25/fc9 [7174893,15169] 0 2024-04-16T14:35:42.184 INFO:tasks.workunit.client.1.smithi115.stdout:8/677: rename d0/db/d10/d17/d2c/d52/d6c/f92 to d0/fdd 0 2024-04-16T14:35:42.184 INFO:tasks.workunit.client.1.smithi115.stdout:8/678: write d0/db/d10/d25/f67 [4193944,75898] 0 2024-04-16T14:35:42.185 INFO:tasks.workunit.client.1.smithi115.stdout:8/679: write d0/db/f26 [193070,81481] 0 2024-04-16T14:35:42.185 INFO:tasks.workunit.client.1.smithi115.stdout:7/550: sync 2024-04-16T14:35:42.186 INFO:tasks.workunit.client.1.smithi115.stdout:7/551: creat d0/d24/da3/db1/d3f/db0/fb8 x:0 0 0 2024-04-16T14:35:42.187 INFO:tasks.workunit.client.1.smithi115.stdout:7/552: mknod d0/d24/d2b/cb9 0 2024-04-16T14:35:42.188 INFO:tasks.workunit.client.1.smithi115.stdout:7/553: mkdir d0/d24/da3/db1/d3f/db0/dba 0 2024-04-16T14:35:42.189 INFO:tasks.workunit.client.1.smithi115.stdout:7/554: truncate d0/d2/d3a/d30/d6b/f75 2642103 0 2024-04-16T14:35:42.190 INFO:tasks.workunit.client.1.smithi115.stdout:7/555: getdents d0/d24 0 2024-04-16T14:35:42.191 INFO:tasks.workunit.client.1.smithi115.stdout:7/556: chown d0/d24/da3/db1/d3f/db0/dba 117 1 2024-04-16T14:35:42.191 INFO:tasks.workunit.client.1.smithi115.stdout:7/557: stat d0/d2/d3a/d30/f74 0 2024-04-16T14:35:42.191 INFO:tasks.workunit.client.1.smithi115.stdout:9/664: dread d1/d6/d2d/d4b/d6c/d20/f87 [0,4194304] 0 2024-04-16T14:35:42.208 INFO:tasks.workunit.client.1.smithi115.stdout:5/573: dread f5 [0,4194304] 0 2024-04-16T14:35:42.208 INFO:tasks.workunit.client.1.smithi115.stdout:5/574: fdatasync dc/d3d/f6a 0 2024-04-16T14:35:42.208 INFO:tasks.workunit.client.1.smithi115.stdout:5/575: write dc/d3d/f5e [3931206,107292] 0 2024-04-16T14:35:42.208 INFO:tasks.workunit.client.1.smithi115.stdout:5/576: truncate dc/d5d/d81/fa9 329565 0 2024-04-16T14:35:42.243 INFO:tasks.workunit.client.1.smithi115.stdout:6/623: dwrite d13/d1d/d2b/d5f/f4b [0,4194304] 0 2024-04-16T14:35:42.243 INFO:tasks.workunit.client.1.smithi115.stdout:8/680: write d0/f53 [2180289,75333] 0 2024-04-16T14:35:42.243 INFO:tasks.workunit.client.1.smithi115.stdout:8/681: chown d0/db/d10/d17/d2c/d52/l95 147843 1 2024-04-16T14:35:42.245 INFO:tasks.workunit.client.1.smithi115.stdout:6/624: creat d13/d1d/d87/fcd x:0 0 0 2024-04-16T14:35:42.253 INFO:tasks.workunit.client.0.smithi005.stdout:5/878: dwrite d0/d70/fa7 [0,4194304] 0 2024-04-16T14:35:42.257 INFO:tasks.workunit.client.0.smithi005.stdout:5/879: symlink d0/d6/d12/d1c/d81/dd7/l130 0 2024-04-16T14:35:42.258 INFO:tasks.workunit.client.0.smithi005.stdout:5/880: mkdir d0/d6/d12/dc0/d30/d131 0 2024-04-16T14:35:42.259 INFO:tasks.workunit.client.0.smithi005.stdout:5/881: getdents d0/d6/d12/dc0/d30/d131 0 2024-04-16T14:35:42.259 INFO:tasks.workunit.client.0.smithi005.stdout:5/882: chown d0/d6/d12/d1c/d1e/l8c 4995097 1 2024-04-16T14:35:42.259 INFO:tasks.workunit.client.1.smithi115.stdout:8/682: dread d0/db/d10/d17/f18 [0,4194304] 0 2024-04-16T14:35:42.275 INFO:tasks.workunit.client.1.smithi115.stdout:2/767: dwrite d0/d47/d65/dad/dbb/d11/d36/fc3 [0,4194304] 0 2024-04-16T14:35:42.276 INFO:tasks.workunit.client.0.smithi005.stdout:2/660: dwrite d0/d4/d2b/d5e/f6f [0,4194304] 0 2024-04-16T14:35:42.276 INFO:tasks.workunit.client.0.smithi005.stdout:0/702: dwrite da/df/d1b/d24/f3d [0,4194304] 0 2024-04-16T14:35:42.276 INFO:tasks.workunit.client.0.smithi005.stdout:0/703: creat da/df/d26/d39/d55/fe9 x:0 0 0 2024-04-16T14:35:42.276 INFO:tasks.workunit.client.1.smithi115.stdout:0/529: dwrite d6/d10/d71/db7/fb8 [0,4194304] 0 2024-04-16T14:35:42.277 INFO:tasks.workunit.client.0.smithi005.stdout:2/661: creat d0/d1c/d39/d85/da2/db0/fe2 x:0 0 0 2024-04-16T14:35:42.277 INFO:tasks.workunit.client.0.smithi005.stdout:2/662: fdatasync d0/d4/d2b/f1a 0 2024-04-16T14:35:42.278 INFO:tasks.workunit.client.1.smithi115.stdout:2/768: creat d0/d47/d65/dad/dbb/ff3 x:0 0 0 2024-04-16T14:35:42.278 INFO:tasks.workunit.client.0.smithi005.stdout:2/663: write d0/d1c/d39/dcb/fd3 [102941,123029] 0 2024-04-16T14:35:42.280 INFO:tasks.workunit.client.0.smithi005.stdout:0/704: mkdir da/df/d26/da9/dea 0 2024-04-16T14:35:42.280 INFO:tasks.workunit.client.0.smithi005.stdout:8/761: dwrite d5/d7b/da8/db7/d8a/da1/d3d/dba/dcd/ffd [0,4194304] 0 2024-04-16T14:35:42.280 INFO:tasks.workunit.client.0.smithi005.stdout:8/762: write d5/d7b/da8/db7/d8a/da1/d3d/dba/dcd/fd8 [77767,60378] 0 2024-04-16T14:35:42.280 INFO:tasks.workunit.client.0.smithi005.stdout:8/763: write d5/d11/f44 [4471877,24124] 0 2024-04-16T14:35:42.281 INFO:tasks.workunit.client.1.smithi115.stdout:4/598: dwrite d1/f6b [0,4194304] 0 2024-04-16T14:35:42.281 INFO:tasks.workunit.client.1.smithi115.stdout:4/599: readlink d1/d15/d24/l3d 0 2024-04-16T14:35:42.281 INFO:tasks.workunit.client.0.smithi005.stdout:7/928: dwrite d1/d49/d74/d77/d22/da0/dbb/dcb/f119 [0,4194304] 0 2024-04-16T14:35:42.281 INFO:tasks.workunit.client.0.smithi005.stdout:7/929: chown d1/dc/d2f/f60 858 1 2024-04-16T14:35:42.282 INFO:tasks.workunit.client.1.smithi115.stdout:3/691: dwrite dc/fdb [0,4194304] 0 2024-04-16T14:35:42.282 INFO:tasks.workunit.client.1.smithi115.stdout:7/558: dwrite d0/d2/f35 [0,4194304] 0 2024-04-16T14:35:42.282 INFO:tasks.workunit.client.1.smithi115.stdout:7/559: chown d0/d24/da3/db1/d3f/d7a/c8c 187 1 2024-04-16T14:35:42.282 INFO:tasks.workunit.client.0.smithi005.stdout:0/705: mknod da/df/d1b/d71/ceb 0 2024-04-16T14:35:42.284 INFO:tasks.workunit.client.1.smithi115.stdout:4/600: symlink d1/d15/d31/d42/d46/d7a/lb1 0 2024-04-16T14:35:42.289 INFO:tasks.workunit.client.0.smithi005.stdout:9/600: dwrite d3/d12/f6c [0,4194304] 0 2024-04-16T14:35:42.290 INFO:tasks.workunit.client.0.smithi005.stdout:8/764: mkdir d5/d7b/da8/da5/def/d10d 0 2024-04-16T14:35:42.290 INFO:tasks.workunit.client.1.smithi115.stdout:3/692: symlink dc/d29/d4d/d56/d98/dbe/le7 0 2024-04-16T14:35:42.291 INFO:tasks.workunit.client.1.smithi115.stdout:5/577: dwrite dc/d3d/d41/f95 [0,4194304] 0 2024-04-16T14:35:42.291 INFO:tasks.workunit.client.1.smithi115.stdout:5/578: fdatasync dc/d5d/d8f/faf 0 2024-04-16T14:35:42.291 INFO:tasks.workunit.client.1.smithi115.stdout:5/579: readlink dc/d15/d35/d71/l80 0 2024-04-16T14:35:42.291 INFO:tasks.workunit.client.1.smithi115.stdout:5/580: stat dc/d15/f3e 0 2024-04-16T14:35:42.291 INFO:tasks.workunit.client.1.smithi115.stdout:5/581: fsync dc/f2b 0 2024-04-16T14:35:42.291 INFO:tasks.workunit.client.1.smithi115.stdout:8/683: dwrite d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/f86 [0,4194304] 0 2024-04-16T14:35:42.291 INFO:tasks.workunit.client.0.smithi005.stdout:5/883: dwrite d0/d6/d12/d1c/d1e/fe9 [0,4194304] 0 2024-04-16T14:35:42.292 INFO:tasks.workunit.client.1.smithi115.stdout:9/665: dwrite d1/f3 [0,4194304] 0 2024-04-16T14:35:42.292 INFO:tasks.workunit.client.1.smithi115.stdout:9/666: write d1/d6/d2d/d4b/d6c/d20/d36/f52 [4829127,28852] 0 2024-04-16T14:35:42.294 INFO:tasks.workunit.client.1.smithi115.stdout:4/601: rename d1/d15/d17/l76 to d1/d15/d31/d42/d8b/lb2 0 2024-04-16T14:35:42.294 INFO:tasks.workunit.client.1.smithi115.stdout:4/602: readlink d1/d15/d31/d42/d46/l6a 0 2024-04-16T14:35:42.296 INFO:tasks.workunit.client.1.smithi115.stdout:7/560: dread d0/d24/d40/f44 [0,4194304] 0 2024-04-16T14:35:42.297 INFO:tasks.workunit.client.1.smithi115.stdout:7/561: chown d0/d24/da3/db1/d3f/db0/c66 649 1 2024-04-16T14:35:42.305 INFO:tasks.workunit.client.0.smithi005.stdout:7/930: mkdir d1/d49/d74/d77/d57/d137 0 2024-04-16T14:35:42.306 INFO:tasks.workunit.client.0.smithi005.stdout:0/706: rmdir da/df/d26/d39/d55/d5c/da8 39 2024-04-16T14:35:42.310 INFO:tasks.workunit.client.0.smithi005.stdout:9/601: creat d3/d12/d16/d46/d47/fab x:0 0 0 2024-04-16T14:35:42.312 INFO:tasks.workunit.client.0.smithi005.stdout:8/765: creat d5/d7b/da8/db7/d8a/da1/d3d/d7f/d8d/dd1/f10e x:0 0 0 2024-04-16T14:35:42.312 INFO:tasks.workunit.client.0.smithi005.stdout:8/766: chown d5/d7b/da8/db7/d8a/da1/d3d/f52 137 1 2024-04-16T14:35:42.312 INFO:tasks.workunit.client.0.smithi005.stdout:8/767: read d5/d7b/da8/db7/d8a/da1/f96 [190576,88740] 0 2024-04-16T14:35:42.314 INFO:tasks.workunit.client.1.smithi115.stdout:8/684: truncate d0/db/d10/f97 654196 0 2024-04-16T14:35:42.317 INFO:tasks.workunit.client.0.smithi005.stdout:5/884: rename d0/d6/d12/dc0/d8d/d5e/f99 to d0/d6/d12/d1c/d81/d82/d10e/f132 0 2024-04-16T14:35:42.317 INFO:tasks.workunit.client.0.smithi005.stdout:7/931: dread d1/d49/d74/d77/d22/d27/d2e/f48 [0,4194304] 0 2024-04-16T14:35:42.319 INFO:tasks.workunit.client.1.smithi115.stdout:9/667: mknod d1/d6/d2d/d4b/ceb 0 2024-04-16T14:35:42.320 INFO:tasks.workunit.client.0.smithi005.stdout:9/602: symlink d3/d49/d4b/d5c/d65/d9a/lac 0 2024-04-16T14:35:42.322 INFO:tasks.workunit.client.0.smithi005.stdout:8/768: unlink d5/d7b/l2e 0 2024-04-16T14:35:42.323 INFO:tasks.workunit.client.1.smithi115.stdout:7/562: mknod d0/d24/da3/db1/d49/cbb 0 2024-04-16T14:35:42.323 INFO:tasks.workunit.client.1.smithi115.stdout:7/563: stat d0/d24/da3/db1/d3f/f7b 0 2024-04-16T14:35:42.323 INFO:tasks.workunit.client.1.smithi115.stdout:7/564: readlink d0/d2/d3a/l67 0 2024-04-16T14:35:42.323 INFO:tasks.workunit.client.1.smithi115.stdout:7/565: fsync d0/d24/f61 0 2024-04-16T14:35:42.324 INFO:tasks.workunit.client.1.smithi115.stdout:1/671: getdents df/d35 0 2024-04-16T14:35:42.327 INFO:tasks.workunit.client.0.smithi005.stdout:0/707: rename da/df/f1d to da/df/d1b/d24/d75/d81/fec 0 2024-04-16T14:35:42.328 INFO:tasks.workunit.client.1.smithi115.stdout:3/693: getdents dc/d29/d4d/d56 0 2024-04-16T14:35:42.330 INFO:tasks.workunit.client.0.smithi005.stdout:5/885: rename d0/d6/d12/dc0/d30/c61 to d0/d70/c133 0 2024-04-16T14:35:42.330 INFO:tasks.workunit.client.1.smithi115.stdout:8/685: mkdir d0/db/dbb/dcd/dae/dde 0 2024-04-16T14:35:42.332 INFO:tasks.workunit.client.1.smithi115.stdout:3/694: read dc/d29/d4d/d56/f58 [318426,121904] 0 2024-04-16T14:35:42.332 INFO:tasks.workunit.client.1.smithi115.stdout:3/695: write dc/d24/f6c [1436186,93988] 0 2024-04-16T14:35:42.333 INFO:tasks.workunit.client.1.smithi115.stdout:1/672: link df/d13/d4d/d2c/d54/d55/fe1 df/d35/d84/ddc/de0/fe5 0 2024-04-16T14:35:42.333 INFO:tasks.workunit.client.1.smithi115.stdout:1/673: write df/d2d/f82 [1496939,26885] 0 2024-04-16T14:35:42.333 INFO:tasks.workunit.client.1.smithi115.stdout:1/674: chown df/d13/d4d/d2c/f24 3957 1 2024-04-16T14:35:42.334 INFO:tasks.workunit.client.0.smithi005.stdout:5/886: rename d0/d6/d12/d1c/c60 to d0/dd1/c134 0 2024-04-16T14:35:42.337 INFO:tasks.workunit.client.0.smithi005.stdout:5/887: mknod d0/d6/d12/dc0/d42/c135 0 2024-04-16T14:35:42.337 INFO:tasks.workunit.client.0.smithi005.stdout:5/888: readlink d0/d6/l7 0 2024-04-16T14:35:42.340 INFO:tasks.workunit.client.1.smithi115.stdout:1/675: symlink df/d13/d4d/d3e/d7d/le6 0 2024-04-16T14:35:42.341 INFO:tasks.workunit.client.1.smithi115.stdout:8/686: rmdir d0/db/d10/d17/d2c/d52/d6c/db8/d64/d83/da2 39 2024-04-16T14:35:42.345 INFO:tasks.workunit.client.1.smithi115.stdout:1/676: truncate df/d35/f65 2973638 0 2024-04-16T14:35:42.345 INFO:tasks.workunit.client.1.smithi115.stdout:8/687: symlink d0/db/d10/d17/d2c/d52/d6c/db8/d6b/ldf 0 2024-04-16T14:35:42.345 INFO:tasks.workunit.client.1.smithi115.stdout:8/688: fsync d0/db/d10/f6d 0 2024-04-16T14:35:42.346 INFO:tasks.workunit.client.1.smithi115.stdout:8/689: symlink d0/db/le0 0 2024-04-16T14:35:42.347 INFO:tasks.workunit.client.1.smithi115.stdout:8/690: creat d0/db/d10/d17/d2c/d52/d74/fe1 x:0 0 0 2024-04-16T14:35:42.347 INFO:tasks.workunit.client.1.smithi115.stdout:8/691: chown d0/db/f26 3 1 2024-04-16T14:35:42.366 INFO:tasks.workunit.client.1.smithi115.stdout:7/566: dread d0/d2/d3a/d73/f7d [0,4194304] 0 2024-04-16T14:35:42.374 INFO:tasks.workunit.client.1.smithi115.stdout:7/567: read d0/d2/d3a/d30/f98 [1260604,59801] 0 2024-04-16T14:35:42.375 INFO:tasks.workunit.client.1.smithi115.stdout:7/568: getdents d0/d24/d2b/d64 0 2024-04-16T14:35:42.376 INFO:tasks.workunit.client.1.smithi115.stdout:7/569: mkdir d0/d24/da3/db1/d49/dbc 0 2024-04-16T14:35:42.385 INFO:tasks.workunit.client.1.smithi115.stdout:3/696: rename dc/d29/d39/f76 to dc/d24/d36/d60/fe8 0 2024-04-16T14:35:42.386 INFO:tasks.workunit.client.1.smithi115.stdout:2/769: dwrite d0/d47/d65/dad/dc8/d24/f34 [0,4194304] 0 2024-04-16T14:35:42.387 INFO:tasks.workunit.client.1.smithi115.stdout:7/570: dread d0/d24/da3/db1/d3f/f7b [0,4194304] 0 2024-04-16T14:35:42.389 INFO:tasks.workunit.client.1.smithi115.stdout:2/770: getdents d0/d47/d65/dad/dc8/d24/d21 0 2024-04-16T14:35:42.389 INFO:tasks.workunit.client.1.smithi115.stdout:2/771: read d0/d47/d65/dad/dc8/d24/f19 [1600541,62599] 0 2024-04-16T14:35:42.407 INFO:tasks.workunit.client.1.smithi115.stdout:4/603: dwrite d1/d15/d1e/f6e [0,4194304] 0 2024-04-16T14:35:42.408 INFO:tasks.workunit.client.0.smithi005.stdout:2/664: dwrite d0/d2a/d3a/d46/fbf [0,4194304] 0 2024-04-16T14:35:42.408 INFO:tasks.workunit.client.0.smithi005.stdout:2/665: truncate d0/d1c/d59/f92 1019865 0 2024-04-16T14:35:42.408 INFO:tasks.workunit.client.1.smithi115.stdout:5/582: dwrite dc/d15/d4d/fa4 [0,4194304] 0 2024-04-16T14:35:42.409 INFO:tasks.workunit.client.1.smithi115.stdout:0/530: dwrite d6/d10/d12/f19 [8388608,4194304] 0 2024-04-16T14:35:42.409 INFO:tasks.workunit.client.1.smithi115.stdout:9/668: dwrite d1/d7f/fb5 [0,4194304] 0 2024-04-16T14:35:42.409 INFO:tasks.workunit.client.1.smithi115.stdout:9/669: truncate d1/fd4 631474 0 2024-04-16T14:35:42.410 INFO:tasks.workunit.client.1.smithi115.stdout:9/670: chown d1/d6/d2d/d4b/d90/lb1 1571438373 1 2024-04-16T14:35:42.410 INFO:tasks.workunit.client.1.smithi115.stdout:2/772: dwrite d0/fa1 [0,4194304] 0 2024-04-16T14:35:42.410 INFO:tasks.workunit.client.1.smithi115.stdout:2/773: readlink d0/d47/d65/dad/dbb/lba 0 2024-04-16T14:35:42.410 INFO:tasks.workunit.client.0.smithi005.stdout:8/769: dwrite d5/d40/d8e/fce [0,4194304] 0 2024-04-16T14:35:42.410 INFO:tasks.workunit.client.0.smithi005.stdout:8/770: chown d5/d7b/da8/da5/def 0 1 2024-04-16T14:35:42.410 INFO:tasks.workunit.client.0.smithi005.stdout:0/708: dwrite da/df/d1b/f7a [0,4194304] 0 2024-04-16T14:35:42.411 INFO:tasks.workunit.client.1.smithi115.stdout:4/604: mkdir d1/d15/d31/db3 0 2024-04-16T14:35:42.411 INFO:tasks.workunit.client.1.smithi115.stdout:4/605: dread - d1/f68 zero size 2024-04-16T14:35:42.411 INFO:tasks.workunit.client.1.smithi115.stdout:4/606: read d1/f22 [1282677,109410] 0 2024-04-16T14:35:42.411 INFO:tasks.workunit.client.1.smithi115.stdout:4/607: write d1/d15/d31/f98 [821318,122205] 0 2024-04-16T14:35:42.412 INFO:tasks.workunit.client.0.smithi005.stdout:8/771: symlink d5/d55/d5a/l10f 0 2024-04-16T14:35:42.412 INFO:tasks.workunit.client.0.smithi005.stdout:9/603: dwrite d3/d49/d4b/d55/f78 [0,4194304] 0 2024-04-16T14:35:42.414 INFO:tasks.workunit.client.1.smithi115.stdout:5/583: truncate dc/d3d/f5a 1983712 0 2024-04-16T14:35:42.415 INFO:tasks.workunit.client.1.smithi115.stdout:5/584: truncate dc/d15/d2d/f32 2454098 0 2024-04-16T14:35:42.423 INFO:tasks.workunit.client.1.smithi115.stdout:0/531: truncate d6/d10/d12/d1f/d36/fa2 4003834 0 2024-04-16T14:35:42.423 INFO:tasks.workunit.client.1.smithi115.stdout:0/532: fdatasync d6/d10/d12/d31/d35/d9b/f77 0 2024-04-16T14:35:42.423 INFO:tasks.workunit.client.1.smithi115.stdout:0/533: dread - d6/d54/f9a zero size 2024-04-16T14:35:42.423 INFO:tasks.workunit.client.1.smithi115.stdout:0/534: write d6/d10/d12/d1f/d36/fb2 [1185871,70636] 0 2024-04-16T14:35:42.423 INFO:tasks.workunit.client.1.smithi115.stdout:0/535: stat d6/d10/d12/d1f/d36/d4b/f69 0 2024-04-16T14:35:42.423 INFO:tasks.workunit.client.1.smithi115.stdout:0/536: write d6/d10/d12/d1f/d36/d4b/d70/d8a/fb1 [930843,25372] 0 2024-04-16T14:35:42.427 INFO:tasks.workunit.client.1.smithi115.stdout:9/671: truncate d1/d6/d2d/d4b/d6c/d20/d36/f9f 484548 0 2024-04-16T14:35:42.429 INFO:tasks.workunit.client.1.smithi115.stdout:2/774: stat d0/d1b/c54 0 2024-04-16T14:35:42.431 INFO:tasks.workunit.client.1.smithi115.stdout:4/608: mkdir d1/d15/d31/d42/db4 0 2024-04-16T14:35:42.434 INFO:tasks.workunit.client.0.smithi005.stdout:0/709: dwrite da/df/d1b/d3a/f4d [0,4194304] 0 2024-04-16T14:35:42.435 INFO:tasks.workunit.client.1.smithi115.stdout:5/585: truncate dc/d15/d4d/f6f 3872677 0 2024-04-16T14:35:42.435 INFO:tasks.workunit.client.1.smithi115.stdout:5/586: fsync dc/d15/f53 0 2024-04-16T14:35:42.436 INFO:tasks.workunit.client.1.smithi115.stdout:9/672: link d1/d6/d2d/d3d/fa5 d1/d6/d2d/d4b/d8f/fec 0 2024-04-16T14:35:42.437 INFO:tasks.workunit.client.1.smithi115.stdout:1/677: rename df/d13/d4d/d2c/d54 to df/d13/d4d/d68/de7 0 2024-04-16T14:35:42.438 INFO:tasks.workunit.client.1.smithi115.stdout:4/609: symlink d1/d15/d31/d42/da4/lb5 0 2024-04-16T14:35:42.442 INFO:tasks.workunit.client.1.smithi115.stdout:5/587: creat dc/d5d/d81/d9a/fb6 x:0 0 0 2024-04-16T14:35:42.443 INFO:tasks.workunit.client.1.smithi115.stdout:5/588: creat dc/d79/fb7 x:0 0 0 2024-04-16T14:35:42.443 INFO:tasks.workunit.client.1.smithi115.stdout:5/589: fsync f2 0 2024-04-16T14:35:42.443 INFO:tasks.workunit.client.1.smithi115.stdout:9/673: symlink d1/d6/d2d/d3d/d49/d98/led 0 2024-04-16T14:35:42.445 INFO:tasks.workunit.client.1.smithi115.stdout:7/571: rename d0/d2/d3a/d73/l7e to d0/d2/d3a/d30/d79/d95/lbd 0 2024-04-16T14:35:42.447 INFO:tasks.workunit.client.1.smithi115.stdout:4/610: write d1/d15/d31/d55/f56 [3473186,8587] 0 2024-04-16T14:35:42.447 INFO:tasks.workunit.client.1.smithi115.stdout:4/611: creat d1/d15/d17/fb6 x:0 0 0 2024-04-16T14:35:42.447 INFO:tasks.workunit.client.1.smithi115.stdout:4/612: write d1/d15/d31/d89/fa7 [914807,4941] 0 2024-04-16T14:35:42.448 INFO:tasks.workunit.client.1.smithi115.stdout:4/613: read d1/d15/d1e/f65 [279488,55400] 0 2024-04-16T14:35:42.448 INFO:tasks.workunit.client.1.smithi115.stdout:5/590: rmdir dc/d5d/d81 39 2024-04-16T14:35:42.448 INFO:tasks.workunit.client.1.smithi115.stdout:5/591: write dc/d79/f99 [1278649,127812] 0 2024-04-16T14:35:42.450 INFO:tasks.workunit.client.1.smithi115.stdout:9/674: truncate d1/d6/d2d/d3d/d49/d98/f9b 156737 0 2024-04-16T14:35:42.451 INFO:tasks.workunit.client.1.smithi115.stdout:1/678: rename df/d13/fa5 to df/d13/d4d/d3e/d75/dda/fe8 0 2024-04-16T14:35:42.454 INFO:tasks.workunit.client.1.smithi115.stdout:5/592: symlink dc/d15/d35/d69/dad/lb8 0 2024-04-16T14:35:42.457 INFO:tasks.workunit.client.1.smithi115.stdout:1/679: unlink df/f1d 0 2024-04-16T14:35:42.457 INFO:tasks.workunit.client.1.smithi115.stdout:7/572: write d0/d24/da3/db1/d3f/db0/f5f [3996205,59608] 0 2024-04-16T14:35:42.457 INFO:tasks.workunit.client.1.smithi115.stdout:7/573: write d0/fa5 [1050329,80334] 0 2024-04-16T14:35:42.460 INFO:tasks.workunit.client.1.smithi115.stdout:9/675: dread d1/d6/d2d/d3d/d50/f5e [0,4194304] 0 2024-04-16T14:35:42.460 INFO:tasks.workunit.client.1.smithi115.stdout:9/676: creat d1/d6/d2d/d4b/d60/d65/fee x:0 0 0 2024-04-16T14:35:42.461 INFO:tasks.workunit.client.1.smithi115.stdout:9/677: chown d1/d6/d2d/d4b/d60/d65/dc6/fde 18302 1 2024-04-16T14:35:42.478 INFO:tasks.workunit.client.1.smithi115.stdout:9/678: dwrite d1/d6/d2d/d3d/d50/dab/fc8 [0,4194304] 0 2024-04-16T14:35:42.480 INFO:tasks.workunit.client.0.smithi005.stdout:3/819: sync 2024-04-16T14:35:42.480 INFO:tasks.workunit.client.0.smithi005.stdout:9/604: rmdir d3/d12 39 2024-04-16T14:35:42.482 INFO:tasks.workunit.client.0.smithi005.stdout:0/710: link da/df/d1b/d3a/d53/d5a/d67/f8d da/df/d50/fed 0 2024-04-16T14:35:42.482 INFO:tasks.workunit.client.0.smithi005.stdout:0/711: rename da/df/d26/d39 to da/df/d26/d39/d55/d5c/dee 22 2024-04-16T14:35:42.483 INFO:tasks.workunit.client.0.smithi005.stdout:3/820: link d2/d9/d25/f91 d2/d17/d46/d75/d9b/dbd/dee/f11e 0 2024-04-16T14:35:42.483 INFO:tasks.workunit.client.0.smithi005.stdout:3/821: write d2/d17/d46/d47/fb1 [127902,77687] 0 2024-04-16T14:35:42.484 INFO:tasks.workunit.client.0.smithi005.stdout:9/605: mknod d3/d12/d2b/d8e/cad 0 2024-04-16T14:35:42.484 INFO:tasks.workunit.client.0.smithi005.stdout:9/606: chown d3/d12/d16/l20 28747 1 2024-04-16T14:35:42.487 INFO:tasks.workunit.client.0.smithi005.stdout:3/822: rename d2/c10 to d2/d9/d7d/c11f 0 2024-04-16T14:35:42.487 INFO:tasks.workunit.client.0.smithi005.stdout:3/823: write d2/d17/f38 [6112335,103008] 0 2024-04-16T14:35:42.487 INFO:tasks.workunit.client.0.smithi005.stdout:3/824: chown d2/d17/l81 70 1 2024-04-16T14:35:42.488 INFO:tasks.workunit.client.0.smithi005.stdout:9/607: dread d3/d12/d16/d46/d47/d60/f75 [0,4194304] 0 2024-04-16T14:35:42.488 INFO:tasks.workunit.client.0.smithi005.stdout:9/608: readlink d3/l29 0 2024-04-16T14:35:42.491 INFO:tasks.workunit.client.0.smithi005.stdout:6/959: sync 2024-04-16T14:35:42.491 INFO:tasks.workunit.client.0.smithi005.stdout:6/960: truncate d2/d3f/d47/d84/da5/d10a/f134 501494 0 2024-04-16T14:35:42.492 INFO:tasks.workunit.client.0.smithi005.stdout:6/961: fdatasync d2/d20/d3c/dcf/d6e/fab 0 2024-04-16T14:35:42.492 INFO:tasks.workunit.client.0.smithi005.stdout:9/609: mknod d3/d77/cae 0 2024-04-16T14:35:42.493 INFO:tasks.workunit.client.0.smithi005.stdout:5/889: write d0/d6/d12/dc0/d42/fc3 [535551,78961] 0 2024-04-16T14:35:42.493 INFO:tasks.workunit.client.0.smithi005.stdout:5/890: write d0/d6/d12/de4/f11b [1017375,117780] 0 2024-04-16T14:35:42.493 INFO:tasks.workunit.client.0.smithi005.stdout:3/825: rename d2/d9/d51 to d2/d17/d46/d75/d41/d120 0 2024-04-16T14:35:42.494 INFO:tasks.workunit.client.0.smithi005.stdout:3/826: stat d2/d9/df/c74 0 2024-04-16T14:35:42.494 INFO:tasks.workunit.client.0.smithi005.stdout:6/962: mkdir d2/d3f/d53/dba/d111/d142 0 2024-04-16T14:35:42.494 INFO:tasks.workunit.client.0.smithi005.stdout:6/963: stat d2/d20/d72/f9c 0 2024-04-16T14:35:42.495 INFO:tasks.workunit.client.0.smithi005.stdout:9/610: unlink d3/l83 0 2024-04-16T14:35:42.496 INFO:tasks.workunit.client.0.smithi005.stdout:9/611: write d3/d12/d16/d46/d47/fab [1029019,87190] 0 2024-04-16T14:35:42.496 INFO:tasks.workunit.client.0.smithi005.stdout:9/612: chown d3/d49/d4b/d55/f96 101855 1 2024-04-16T14:35:42.497 INFO:tasks.workunit.client.0.smithi005.stdout:5/891: getdents d0 0 2024-04-16T14:35:42.499 INFO:tasks.workunit.client.0.smithi005.stdout:6/964: unlink d2/d3f/d47/d84/dbf/c107 0 2024-04-16T14:35:42.499 INFO:tasks.workunit.client.0.smithi005.stdout:3/827: write d2/f71 [301966,18122] 0 2024-04-16T14:35:42.499 INFO:tasks.workunit.client.0.smithi005.stdout:3/828: creat d2/d9/f121 x:0 0 0 2024-04-16T14:35:42.499 INFO:tasks.workunit.client.0.smithi005.stdout:3/829: dread - d2/d9/d25/d39/ffa zero size 2024-04-16T14:35:42.500 INFO:tasks.workunit.client.0.smithi005.stdout:5/892: symlink d0/d6/d12/dc0/d12c/l136 0 2024-04-16T14:35:42.505 INFO:tasks.workunit.client.0.smithi005.stdout:5/893: creat d0/d6/d12/d1c/d1e/f137 x:0 0 0 2024-04-16T14:35:42.506 INFO:tasks.workunit.client.0.smithi005.stdout:3/830: mkdir d2/d17/d46/d75/d6d/d122 0 2024-04-16T14:35:42.506 INFO:tasks.workunit.client.1.smithi115.stdout:5/593: link dc/d15/d35/d69/f70 dc/d15/d2d/d8c/fb9 0 2024-04-16T14:35:42.509 INFO:tasks.workunit.client.0.smithi005.stdout:5/894: link d0/d6/d12/lb6 d0/d6/d6e/d9e/l138 0 2024-04-16T14:35:42.509 INFO:tasks.workunit.client.0.smithi005.stdout:5/895: chown d0/d6/c12f 1 1 2024-04-16T14:35:42.509 INFO:tasks.workunit.client.1.smithi115.stdout:1/680: mknod df/d13/d4d/d3e/d75/da9/db7/ce9 0 2024-04-16T14:35:42.511 INFO:tasks.workunit.client.0.smithi005.stdout:3/831: creat d2/d17/d46/d75/d6d/dd0/f123 x:0 0 0 2024-04-16T14:35:42.512 INFO:tasks.workunit.client.1.smithi115.stdout:7/574: symlink d0/d24/da3/lbe 0 2024-04-16T14:35:42.512 INFO:tasks.workunit.client.0.smithi005.stdout:5/896: mkdir d0/d6/d12/dc0/d30/d131/d139 0 2024-04-16T14:35:42.514 INFO:tasks.workunit.client.0.smithi005.stdout:5/897: dread d0/d6/d12/dc0/d6d/f8e [0,4194304] 0 2024-04-16T14:35:42.514 INFO:tasks.workunit.client.0.smithi005.stdout:5/898: write d0/d6/d12/dc0/f5a [4285535,25832] 0 2024-04-16T14:35:42.515 INFO:tasks.workunit.client.0.smithi005.stdout:5/899: getdents d0/d6/d12/d1c/d81/d82/d122 0 2024-04-16T14:35:42.516 INFO:tasks.workunit.client.0.smithi005.stdout:5/900: truncate d0/d6/d6e/f121 1365399 0 2024-04-16T14:35:42.516 INFO:tasks.workunit.client.0.smithi005.stdout:5/901: chown d0/d6/d12/d1c/dd2 242509217 1 2024-04-16T14:35:42.516 INFO:tasks.workunit.client.0.smithi005.stdout:5/902: dread - d0/d70/f96 zero size 2024-04-16T14:35:42.516 INFO:tasks.workunit.client.0.smithi005.stdout:5/903: creat d0/d6/d12/d1c/f13a x:0 0 0 2024-04-16T14:35:42.518 INFO:tasks.workunit.client.0.smithi005.stdout:5/904: symlink d0/d6/d12/dc0/d30/d97/l13b 0 2024-04-16T14:35:42.519 INFO:tasks.workunit.client.0.smithi005.stdout:5/905: getdents d0/d6/d6e/db8 0 2024-04-16T14:35:42.519 INFO:tasks.workunit.client.0.smithi005.stdout:5/906: fdatasync d0/d6/f4f 0 2024-04-16T14:35:42.519 INFO:tasks.workunit.client.1.smithi115.stdout:9/679: creat d1/d6/d2d/d4b/d60/fef x:0 0 0 2024-04-16T14:35:42.520 INFO:tasks.workunit.client.0.smithi005.stdout:5/907: mknod d0/d70/dea/c13c 0 2024-04-16T14:35:42.520 INFO:tasks.workunit.client.0.smithi005.stdout:3/832: dread d2/d17/d46/d75/d41/d120/f58 [0,4194304] 0 2024-04-16T14:35:42.522 INFO:tasks.workunit.client.0.smithi005.stdout:5/908: mknod d0/d6/d12/d108/c13d 0 2024-04-16T14:35:42.522 INFO:tasks.workunit.client.0.smithi005.stdout:5/909: write d0/d6/d12/d1c/dd2/df7/f100 [901439,95373] 0 2024-04-16T14:35:42.523 INFO:tasks.workunit.client.1.smithi115.stdout:5/594: mknod dc/d15/d2d/cba 0 2024-04-16T14:35:42.523 INFO:tasks.workunit.client.0.smithi005.stdout:3/833: rename d2/d17/d46/d75/d6d/dd5/d107 to d2/d17/d46/d75/d41/d124 0 2024-04-16T14:35:42.524 INFO:tasks.workunit.client.1.smithi115.stdout:9/680: mkdir d1/d6/d2d/d4b/d60/df0 0 2024-04-16T14:35:42.524 INFO:tasks.workunit.client.1.smithi115.stdout:9/681: creat d1/d6/d2d/d4b/d60/d65/ff1 x:0 0 0 2024-04-16T14:35:42.524 INFO:tasks.workunit.client.0.smithi005.stdout:3/834: getdents d2/d92 0 2024-04-16T14:35:42.525 INFO:tasks.workunit.client.0.smithi005.stdout:3/835: mkdir d2/d17/d102/d125 0 2024-04-16T14:35:42.525 INFO:tasks.workunit.client.0.smithi005.stdout:3/836: creat d2/d9/d25/f126 x:0 0 0 2024-04-16T14:35:42.526 INFO:tasks.workunit.client.0.smithi005.stdout:3/837: mkdir d2/d9/df/daa/d127 0 2024-04-16T14:35:42.526 INFO:tasks.workunit.client.0.smithi005.stdout:3/838: write d2/d17/d46/d75/d9b/fbc [670664,15663] 0 2024-04-16T14:35:42.527 INFO:tasks.workunit.client.0.smithi005.stdout:3/839: truncate d2/d17/d102/f10a 775865 0 2024-04-16T14:35:42.528 INFO:tasks.workunit.client.1.smithi115.stdout:5/595: truncate dc/d15/f3e 5654025 0 2024-04-16T14:35:42.529 INFO:tasks.workunit.client.0.smithi005.stdout:3/840: dread d2/d17/d46/d47/f78 [0,4194304] 0 2024-04-16T14:35:42.529 INFO:tasks.workunit.client.1.smithi115.stdout:9/682: creat d1/d6/d2d/d3d/d49/d98/ff2 x:0 0 0 2024-04-16T14:35:42.529 INFO:tasks.workunit.client.1.smithi115.stdout:9/683: symlink d1/d6/d2d/d3d/db7/lf3 0 2024-04-16T14:35:42.535 INFO:tasks.workunit.client.0.smithi005.stdout:3/841: dread d2/f2b [0,4194304] 0 2024-04-16T14:35:42.537 INFO:tasks.workunit.client.0.smithi005.stdout:3/842: unlink d2/f2b 0 2024-04-16T14:35:42.539 INFO:tasks.workunit.client.0.smithi005.stdout:3/843: creat d2/d17/d46/d47/deb/f128 x:0 0 0 2024-04-16T14:35:42.540 INFO:tasks.workunit.client.0.smithi005.stdout:3/844: write d2/d17/d46/d47/fb5 [862268,48409] 0 2024-04-16T14:35:42.541 INFO:tasks.workunit.client.0.smithi005.stdout:3/845: mkdir d2/d17/d102/d129 0 2024-04-16T14:35:42.541 INFO:tasks.workunit.client.0.smithi005.stdout:3/846: write d2/d17/d46/d75/d41/f118 [270603,56636] 0 2024-04-16T14:35:42.541 INFO:tasks.workunit.client.0.smithi005.stdout:3/847: write d2/d17/d46/d47/fb5 [878986,92288] 0 2024-04-16T14:35:42.550 INFO:tasks.workunit.client.1.smithi115.stdout:5/596: dread dc/d3d/d68/d7b/f89 [0,4194304] 0 2024-04-16T14:35:42.550 INFO:tasks.workunit.client.1.smithi115.stdout:5/597: truncate dc/d3d/d68/d7b/f89 1317185 0 2024-04-16T14:35:42.554 INFO:tasks.workunit.client.1.smithi115.stdout:5/598: dread dc/d15/d2d/f32 [0,4194304] 0 2024-04-16T14:35:42.554 INFO:tasks.workunit.client.1.smithi115.stdout:5/599: write dc/d15/f53 [1666337,2674] 0 2024-04-16T14:35:42.560 INFO:tasks.workunit.client.0.smithi005.stdout:5/910: dread d0/d70/f107 [0,4194304] 0 2024-04-16T14:35:42.560 INFO:tasks.workunit.client.0.smithi005.stdout:5/911: fsync d0/d6/d12/dc0/d42/f9c 0 2024-04-16T14:35:42.561 INFO:tasks.workunit.client.0.smithi005.stdout:5/912: truncate d0/d6/d12/d1c/d1e/fe5 1034305 0 2024-04-16T14:35:42.562 INFO:tasks.workunit.client.0.smithi005.stdout:5/913: rename d0/d6/d12/dc0/d42/f57 to d0/d6/d12/dcc/f13e 0 2024-04-16T14:35:42.574 INFO:tasks.workunit.client.1.smithi115.stdout:5/600: write dc/d15/d2d/d8c/fb9 [3648783,18142] 0 2024-04-16T14:35:42.575 INFO:tasks.workunit.client.1.smithi115.stdout:5/601: getdents dc/d5d 0 2024-04-16T14:35:42.575 INFO:tasks.workunit.client.1.smithi115.stdout:5/602: chown dc/d15/d35/d71/c8b 157 1 2024-04-16T14:35:42.576 INFO:tasks.workunit.client.1.smithi115.stdout:5/603: truncate dc/d3d/f7f 215903 0 2024-04-16T14:35:42.577 INFO:tasks.workunit.client.1.smithi115.stdout:5/604: readlink dc/d15/d35/d71/l80 0 2024-04-16T14:35:42.578 INFO:tasks.workunit.client.1.smithi115.stdout:5/605: unlink dc/d15/d4d/la1 0 2024-04-16T14:35:42.578 INFO:tasks.workunit.client.1.smithi115.stdout:5/606: creat dc/d3d/fbb x:0 0 0 2024-04-16T14:35:42.600 INFO:tasks.workunit.client.0.smithi005.stdout:9/613: dwrite d3/d12/d2b/f59 [0,4194304] 0 2024-04-16T14:35:42.600 INFO:tasks.workunit.client.0.smithi005.stdout:9/614: fsync d3/f8a 0 2024-04-16T14:35:42.602 INFO:tasks.workunit.client.1.smithi115.stdout:9/684: dwrite d1/d6/d2d/f1c [0,4194304] 0 2024-04-16T14:35:42.602 INFO:tasks.workunit.client.0.smithi005.stdout:3/848: dwrite d2/d9/d5e/fb6 [0,4194304] 0 2024-04-16T14:35:42.605 INFO:tasks.workunit.client.0.smithi005.stdout:3/849: mkdir d2/d9/df/daa/d127/d12a 0 2024-04-16T14:35:42.606 INFO:tasks.workunit.client.0.smithi005.stdout:3/850: creat d2/d17/d46/d75/d9b/dbd/dee/f12b x:0 0 0 2024-04-16T14:35:42.608 INFO:tasks.workunit.client.1.smithi115.stdout:7/575: dwrite d0/d24/d40/f44 [0,4194304] 0 2024-04-16T14:35:42.609 INFO:tasks.workunit.client.1.smithi115.stdout:1/681: dwrite df/d2d/fd0 [0,4194304] 0 2024-04-16T14:35:42.610 INFO:tasks.workunit.client.0.smithi005.stdout:6/965: dwrite d2/d20/d33/f4c [0,4194304] 0 2024-04-16T14:35:42.611 INFO:tasks.workunit.client.0.smithi005.stdout:5/914: dwrite d0/d70/fa7 [0,4194304] 0 2024-04-16T14:35:42.611 INFO:tasks.workunit.client.1.smithi115.stdout:5/607: dwrite dc/d5d/d8f/faf [0,4194304] 0 2024-04-16T14:35:42.611 INFO:tasks.workunit.client.1.smithi115.stdout:5/608: fdatasync dc/fa0 0 2024-04-16T14:35:42.623 INFO:tasks.workunit.client.1.smithi115.stdout:1/682: read df/d13/d4d/d68/f71 [3309467,54771] 0 2024-04-16T14:35:42.623 INFO:tasks.workunit.client.1.smithi115.stdout:1/683: fdatasync df/d13/d4d/d2c/f33 0 2024-04-16T14:35:42.623 INFO:tasks.workunit.client.1.smithi115.stdout:1/684: chown df/d13/d4d/d6d/fa7 2454 1 2024-04-16T14:35:42.623 INFO:tasks.workunit.client.1.smithi115.stdout:1/685: write df/f5b [854430,33708] 0 2024-04-16T14:35:42.624 INFO:tasks.workunit.client.0.smithi005.stdout:6/966: dread d2/d20/fc5 [4194304,4194304] 0 2024-04-16T14:35:42.625 INFO:tasks.workunit.client.0.smithi005.stdout:5/915: mknod d0/d6/d6e/d9e/da9/c13f 0 2024-04-16T14:35:42.625 INFO:tasks.workunit.client.0.smithi005.stdout:5/916: chown d0/d6/d12/d1c/d81/d82/f88 381 1 2024-04-16T14:35:42.625 INFO:tasks.workunit.client.0.smithi005.stdout:5/917: chown d0/fdc 63702 1 2024-04-16T14:35:42.625 INFO:tasks.workunit.client.0.smithi005.stdout:5/918: mknod d0/d6/d6e/d9e/da9/c140 0 2024-04-16T14:35:42.625 INFO:tasks.workunit.client.0.smithi005.stdout:5/919: creat d0/d6/d12/dc0/d30/d97/f141 x:0 0 0 2024-04-16T14:35:42.628 INFO:tasks.workunit.client.1.smithi115.stdout:1/686: dread df/d13/d4d/d68/f71 [0,4194304] 0 2024-04-16T14:35:42.628 INFO:tasks.workunit.client.1.smithi115.stdout:1/687: stat df/d13/d4d/d3e/d75/dda/ca1 0 2024-04-16T14:35:42.628 INFO:tasks.workunit.client.1.smithi115.stdout:1/688: fsync df/d2d/fd0 0 2024-04-16T14:35:42.628 INFO:tasks.workunit.client.1.smithi115.stdout:1/689: stat df/d13/d4d/d3e/d75/f8c 0 2024-04-16T14:35:42.628 INFO:tasks.workunit.client.1.smithi115.stdout:1/690: creat df/d36/d94/dbf/fea x:0 0 0 2024-04-16T14:35:42.632 INFO:tasks.workunit.client.0.smithi005.stdout:9/615: dwrite d3/d49/d4b/f70 [0,4194304] 0 2024-04-16T14:35:42.632 INFO:tasks.workunit.client.0.smithi005.stdout:9/616: stat d3/d49 0 2024-04-16T14:35:42.635 INFO:tasks.workunit.client.1.smithi115.stdout:7/576: dwrite d0/d24/da3/db1/d49/f91 [0,4194304] 0 2024-04-16T14:35:42.635 INFO:tasks.workunit.client.1.smithi115.stdout:7/577: fdatasync d0/d24/da3/db1/d3f/db0/fb8 0 2024-04-16T14:35:42.635 INFO:tasks.workunit.client.1.smithi115.stdout:7/578: creat d0/d2/d3a/d30/d79/d95/fbf x:0 0 0 2024-04-16T14:35:42.635 INFO:tasks.workunit.client.0.smithi005.stdout:9/617: truncate d3/d49/d4b/d55/f5d 2133289 0 2024-04-16T14:35:42.636 INFO:tasks.workunit.client.0.smithi005.stdout:9/618: mkdir d3/d49/d4b/d5c/d65/d9a/daf 0 2024-04-16T14:35:42.638 INFO:tasks.workunit.client.0.smithi005.stdout:9/619: rename d3/d12/d16/d46/d47/fab to d3/d49/d91/fb0 0 2024-04-16T14:35:42.639 INFO:tasks.workunit.client.0.smithi005.stdout:9/620: dread - d3/d77/f82 zero size 2024-04-16T14:35:42.639 INFO:tasks.workunit.client.0.smithi005.stdout:9/621: chown d3/f41 25854 1 2024-04-16T14:35:42.644 INFO:tasks.workunit.client.1.smithi115.stdout:6/625: sync 2024-04-16T14:35:42.653 INFO:tasks.workunit.client.0.smithi005.stdout:9/622: write d3/d49/f50 [4192115,4138] 0 2024-04-16T14:35:42.654 INFO:tasks.workunit.client.0.smithi005.stdout:9/623: mkdir d3/d12/d16/d46/d47/db1 0 2024-04-16T14:35:42.669 INFO:tasks.workunit.client.0.smithi005.stdout:5/920: dwrite d0/d70/f96 [0,4194304] 0 2024-04-16T14:35:42.670 INFO:tasks.workunit.client.0.smithi005.stdout:5/921: dread - d0/d6/d12/dc0/d42/f9c zero size 2024-04-16T14:35:42.670 INFO:tasks.workunit.client.0.smithi005.stdout:5/922: chown d0/f28 0 1 2024-04-16T14:35:42.670 INFO:tasks.workunit.client.0.smithi005.stdout:9/624: dread d3/d12/d16/d46/f9b [0,4194304] 0 2024-04-16T14:35:42.670 INFO:tasks.workunit.client.0.smithi005.stdout:6/967: dwrite d2/d20/d3c/dcf/d6e/f87 [0,4194304] 0 2024-04-16T14:35:42.673 INFO:tasks.workunit.client.0.smithi005.stdout:5/923: creat d0/d6/d12/dc0/d30/d131/d139/f142 x:0 0 0 2024-04-16T14:35:42.674 INFO:tasks.workunit.client.0.smithi005.stdout:9/625: mknod d3/d49/d4b/d55/d7b/cb2 0 2024-04-16T14:35:42.693 INFO:tasks.workunit.client.1.smithi115.stdout:5/609: mknod dc/d3d/d41/cbc 0 2024-04-16T14:35:42.693 INFO:tasks.workunit.client.1.smithi115.stdout:5/610: truncate dc/d15/d35/f3f 690189 0 2024-04-16T14:35:42.695 INFO:tasks.workunit.client.1.smithi115.stdout:1/691: creat df/d13/d4d/d68/feb x:0 0 0 2024-04-16T14:35:42.702 INFO:tasks.workunit.client.0.smithi005.stdout:5/924: dwrite d0/d6/d12/d1c/d1e/f137 [0,4194304] 0 2024-04-16T14:35:42.702 INFO:tasks.workunit.client.0.smithi005.stdout:5/925: link d0/d6/d12/f41 d0/d6/d12/dcc/f143 0 2024-04-16T14:35:42.702 INFO:tasks.workunit.client.1.smithi115.stdout:1/692: write df/d13/d4d/d3e/d75/dda/fe8 [2880495,20544] 0 2024-04-16T14:35:42.702 INFO:tasks.workunit.client.1.smithi115.stdout:1/693: write df/d13/d4d/d3e/d75/da9/fba [1056279,127264] 0 2024-04-16T14:35:42.704 INFO:tasks.workunit.client.1.smithi115.stdout:5/611: mknod dc/d15/d2d/cbd 0 2024-04-16T14:35:42.706 INFO:tasks.workunit.client.1.smithi115.stdout:5/612: getdents dc/d15/d2d/db0 0 2024-04-16T14:35:42.718 INFO:tasks.workunit.client.0.smithi005.stdout:5/926: write d0/d6/d12/dcc/f13e [3807159,915] 0 2024-04-16T14:35:42.721 INFO:tasks.workunit.client.1.smithi115.stdout:1/694: dwrite df/d13/d4d/d3e/d75/da9/fab [0,4194304] 0 2024-04-16T14:35:42.734 INFO:tasks.workunit.client.0.smithi005.stdout:7/932: sync 2024-04-16T14:35:42.735 INFO:tasks.workunit.client.1.smithi115.stdout:5/613: dwrite dc/d3d/d41/f54 [0,4194304] 0 2024-04-16T14:35:42.736 INFO:tasks.workunit.client.0.smithi005.stdout:5/927: dwrite d0/d6/d6e/d9e/fdf [0,4194304] 0 2024-04-16T14:35:42.737 INFO:tasks.workunit.client.1.smithi115.stdout:5/614: mknod dc/d5d/d8f/cbe 0 2024-04-16T14:35:42.738 INFO:tasks.workunit.client.0.smithi005.stdout:5/928: mknod d0/d6/c144 0 2024-04-16T14:35:42.738 INFO:tasks.workunit.client.0.smithi005.stdout:5/929: truncate d0/d6/d6e/d9e/da9/fe2 2174780 0 2024-04-16T14:35:42.739 INFO:tasks.workunit.client.1.smithi115.stdout:5/615: rmdir dc/d3d/d68/dac 0 2024-04-16T14:35:42.739 INFO:tasks.workunit.client.1.smithi115.stdout:5/616: stat dc/f21 0 2024-04-16T14:35:42.742 INFO:tasks.workunit.client.1.smithi115.stdout:1/695: rename df/d13/d4d/d2c/lb0 to df/d13/d4d/d68/de7/dbe/lec 0 2024-04-16T14:35:42.742 INFO:tasks.workunit.client.1.smithi115.stdout:1/696: write df/d13/d4d/d68/de7/fe4 [491746,130376] 0 2024-04-16T14:35:42.742 INFO:tasks.workunit.client.1.smithi115.stdout:1/697: chown df/d35/d84/ddc 0 1 2024-04-16T14:35:42.747 INFO:tasks.workunit.client.1.smithi115.stdout:1/698: dread df/f14 [0,4194304] 0 2024-04-16T14:35:42.750 INFO:tasks.workunit.client.1.smithi115.stdout:1/699: rmdir df/d13/d4d/d68/da0 39 2024-04-16T14:35:42.753 INFO:tasks.workunit.client.0.smithi005.stdout:7/933: dwrite d1/d49/d74/d77/d57/d47/daa/fc8 [0,4194304] 0 2024-04-16T14:35:42.753 INFO:tasks.workunit.client.0.smithi005.stdout:7/934: write d1/d82/fcf [5034114,67550] 0 2024-04-16T14:35:42.753 INFO:tasks.workunit.client.0.smithi005.stdout:7/935: dread - d1/d8a/f10c zero size 2024-04-16T14:35:42.753 INFO:tasks.workunit.client.0.smithi005.stdout:7/936: stat d1/dc/d2f/lc5 0 2024-04-16T14:35:42.753 INFO:tasks.workunit.client.0.smithi005.stdout:7/937: stat d1/d49/d74/d77/d22/d27/d3a/d5c 0 2024-04-16T14:35:42.754 INFO:tasks.workunit.client.1.smithi115.stdout:6/626: link fc d13/d1d/d2b/d5f/d30/d43/fce 0 2024-04-16T14:35:42.754 INFO:tasks.workunit.client.1.smithi115.stdout:6/627: fsync d13/d1d/d2b/d5f/f6a 0 2024-04-16T14:35:42.755 INFO:tasks.workunit.client.0.smithi005.stdout:7/938: rename d1/dc/d2f/f5d to d1/d49/d74/d77/d22/d27/df4/f138 0 2024-04-16T14:35:42.763 INFO:tasks.workunit.client.1.smithi115.stdout:1/700: rename df/d2d/c47 to df/d36/d94/dc4/ced 0 2024-04-16T14:35:42.763 INFO:tasks.workunit.client.1.smithi115.stdout:1/701: write df/d13/fcc [171077,119591] 0 2024-04-16T14:35:42.763 INFO:tasks.workunit.client.0.smithi005.stdout:5/930: write d0/f6a [3845554,93059] 0 2024-04-16T14:35:42.763 INFO:tasks.workunit.client.0.smithi005.stdout:5/931: fdatasync d0/d6/f36 0 2024-04-16T14:35:42.763 INFO:tasks.workunit.client.0.smithi005.stdout:5/932: write d0/d6/f4f [9115017,113437] 0 2024-04-16T14:35:42.764 INFO:tasks.workunit.client.0.smithi005.stdout:5/933: write d0/d6/d12/dc0/d42/fc3 [840669,16984] 0 2024-04-16T14:35:42.764 INFO:tasks.workunit.client.0.smithi005.stdout:5/934: fdatasync d0/d6/d12/f5b 0 2024-04-16T14:35:42.771 INFO:tasks.workunit.client.1.smithi115.stdout:1/702: rmdir df/d13/d4d 39 2024-04-16T14:35:42.776 INFO:tasks.workunit.client.1.smithi115.stdout:7/579: creat d0/d2/d3a/fc0 x:0 0 0 2024-04-16T14:35:42.777 INFO:tasks.workunit.client.0.smithi005.stdout:7/939: dwrite d1/d49/d74/d77/d22/db0/dc6/f105 [4194304,4194304] 0 2024-04-16T14:35:42.777 INFO:tasks.workunit.client.0.smithi005.stdout:7/940: stat d1/d49/d74/d77/fc0 0 2024-04-16T14:35:42.779 INFO:tasks.workunit.client.1.smithi115.stdout:9/685: mkdir d1/d6/d2d/d4b/d6c/d20/df4 0 2024-04-16T14:35:42.779 INFO:tasks.workunit.client.1.smithi115.stdout:9/686: chown d1/d6/d2d/d4b/d60/d65/fdc 26324929 1 2024-04-16T14:35:42.779 INFO:tasks.workunit.client.0.smithi005.stdout:7/941: unlink d1/d49/d74/d77/d22/da0/dbb/dcb/l11f 0 2024-04-16T14:35:42.780 INFO:tasks.workunit.client.1.smithi115.stdout:5/617: dwrite dc/f11 [0,4194304] 0 2024-04-16T14:35:42.780 INFO:tasks.workunit.client.1.smithi115.stdout:5/618: readlink dc/l45 0 2024-04-16T14:35:42.780 INFO:tasks.workunit.client.1.smithi115.stdout:5/619: getdents dc/d15/d2d/db0 0 2024-04-16T14:35:42.781 INFO:tasks.workunit.client.0.smithi005.stdout:7/942: rename d1/dc/d2f/d4f/f7a to d1/d49/d74/d77/d57/d47/d8d/f139 0 2024-04-16T14:35:42.782 INFO:tasks.workunit.client.0.smithi005.stdout:7/943: stat d1/d49/d74/d77/d22/c58 0 2024-04-16T14:35:42.783 INFO:tasks.workunit.client.1.smithi115.stdout:9/687: write d1/d6/d2d/d4b/d60/d65/dc6/fd3 [350439,54450] 0 2024-04-16T14:35:42.785 INFO:tasks.workunit.client.1.smithi115.stdout:9/688: unlink d1/d6/d2d/d4b/d8f/fa4 0 2024-04-16T14:35:42.785 INFO:tasks.workunit.client.1.smithi115.stdout:9/689: chown d1/d6/d2d/d4b/d6c 359 1 2024-04-16T14:35:42.787 INFO:tasks.workunit.client.1.smithi115.stdout:5/620: dread dc/d3d/f5a [0,4194304] 0 2024-04-16T14:35:42.787 INFO:tasks.workunit.client.1.smithi115.stdout:5/621: write dc/d5d/d81/fa9 [1262260,72038] 0 2024-04-16T14:35:42.787 INFO:tasks.workunit.client.1.smithi115.stdout:5/622: chown l7 803982 1 2024-04-16T14:35:42.789 INFO:tasks.workunit.client.1.smithi115.stdout:5/623: rename dc/d15/d35/l5b to dc/d5d/d81/d9a/lbf 0 2024-04-16T14:35:42.795 INFO:tasks.workunit.client.0.smithi005.stdout:7/944: dread d1/d49/d74/d77/d57/d47/fa2 [0,4194304] 0 2024-04-16T14:35:42.804 INFO:tasks.workunit.client.0.smithi005.stdout:7/945: dread d1/d49/d74/d77/d57/d47/d8d/fac [0,4194304] 0 2024-04-16T14:35:42.805 INFO:tasks.workunit.client.0.smithi005.stdout:7/946: rmdir d1/d49/d74/d77/d22/da9 39 2024-04-16T14:35:42.807 INFO:tasks.workunit.client.0.smithi005.stdout:7/947: unlink d1/d85/d96/de1/f10d 0 2024-04-16T14:35:42.807 INFO:tasks.workunit.client.0.smithi005.stdout:7/948: chown d1/d49/d74/l111 447883050 1 2024-04-16T14:35:42.807 INFO:tasks.workunit.client.0.smithi005.stdout:7/949: symlink d1/d49/d74/d77/d22/db0/dc6/l13a 0 2024-04-16T14:35:42.809 INFO:tasks.workunit.client.0.smithi005.stdout:5/935: dwrite d0/d6/d12/dcc/f13e [0,4194304] 0 2024-04-16T14:35:42.809 INFO:tasks.workunit.client.0.smithi005.stdout:5/936: write d0/d6/d12/d1c/f2a [264088,30422] 0 2024-04-16T14:35:42.809 INFO:tasks.workunit.client.0.smithi005.stdout:5/937: creat d0/dd1/f145 x:0 0 0 2024-04-16T14:35:42.821 INFO:tasks.workunit.client.1.smithi115.stdout:6/628: dwrite d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/f9f [0,4194304] 0 2024-04-16T14:35:42.822 INFO:tasks.workunit.client.1.smithi115.stdout:7/580: dwrite d0/d24/f4a [4194304,4194304] 0 2024-04-16T14:35:42.822 INFO:tasks.workunit.client.1.smithi115.stdout:9/690: dwrite d1/fa8 [0,4194304] 0 2024-04-16T14:35:42.823 INFO:tasks.workunit.client.1.smithi115.stdout:9/691: dread d1/d7f/f97 [0,4194304] 0 2024-04-16T14:35:42.824 INFO:tasks.workunit.client.1.smithi115.stdout:5/624: dwrite dc/d15/d2d/f67 [0,4194304] 0 2024-04-16T14:35:42.830 INFO:tasks.workunit.client.0.smithi005.stdout:7/950: dwrite d1/d49/d74/d77/d22/d27/f45 [0,4194304] 0 2024-04-16T14:35:42.830 INFO:tasks.workunit.client.0.smithi005.stdout:7/951: write d1/d49/d74/d77/d57/f125 [4640464,118696] 0 2024-04-16T14:35:42.834 INFO:tasks.workunit.client.0.smithi005.stdout:5/938: dread d0/d70/fbd [4194304,4194304] 0 2024-04-16T14:35:42.835 INFO:tasks.workunit.client.0.smithi005.stdout:7/952: getdents d1/d49/d74/d77/d22/da0/dbb/dcb 0 2024-04-16T14:35:42.837 INFO:tasks.workunit.client.1.smithi115.stdout:5/625: dread dc/d5d/d81/f9d [0,4194304] 0 2024-04-16T14:35:42.838 INFO:tasks.workunit.client.0.smithi005.stdout:5/939: getdents d0/d6/d12/dc0/d30/d131/d139 0 2024-04-16T14:35:42.839 INFO:tasks.workunit.client.0.smithi005.stdout:7/953: getdents d1/d49/d74/d77/d57/d47/daa 0 2024-04-16T14:35:42.840 INFO:tasks.workunit.client.0.smithi005.stdout:5/940: mkdir d0/d6/d12/dc0/d8d/d146 0 2024-04-16T14:35:42.841 INFO:tasks.workunit.client.0.smithi005.stdout:7/954: creat d1/d49/d74/ded/f13b x:0 0 0 2024-04-16T14:35:42.841 INFO:tasks.workunit.client.0.smithi005.stdout:7/955: dread - d1/d49/d74/ddf/fe5 zero size 2024-04-16T14:35:42.842 INFO:tasks.workunit.client.0.smithi005.stdout:5/941: truncate d0/d6/d12/dc0/d8d/dd8/f9a 1870454 0 2024-04-16T14:35:42.842 INFO:tasks.workunit.client.0.smithi005.stdout:5/942: write d0/d6/d12/dc0/d6d/f10b [375023,86626] 0 2024-04-16T14:35:42.843 INFO:tasks.workunit.client.0.smithi005.stdout:7/956: mkdir d1/d85/d96/de1/d13c 0 2024-04-16T14:35:42.846 INFO:tasks.workunit.client.0.smithi005.stdout:5/943: rename d0/f11 to d0/d6/d12/dc0/d12c/f147 0 2024-04-16T14:35:42.846 INFO:tasks.workunit.client.0.smithi005.stdout:5/944: creat d0/d6/f148 x:0 0 0 2024-04-16T14:35:42.846 INFO:tasks.workunit.client.0.smithi005.stdout:5/945: fsync d0/d6/d12/dc0/d6d/f8e 0 2024-04-16T14:35:42.846 INFO:tasks.workunit.client.0.smithi005.stdout:5/946: write d0/d6/d12/f5b [249400,83362] 0 2024-04-16T14:35:42.847 INFO:tasks.workunit.client.0.smithi005.stdout:2/666: sync 2024-04-16T14:35:42.847 INFO:tasks.workunit.client.0.smithi005.stdout:0/712: sync 2024-04-16T14:35:42.847 INFO:tasks.workunit.client.0.smithi005.stdout:8/772: sync 2024-04-16T14:35:42.848 INFO:tasks.workunit.client.0.smithi005.stdout:8/773: write d5/d40/d4b/f10b [545973,58310] 0 2024-04-16T14:35:42.848 INFO:tasks.workunit.client.0.smithi005.stdout:8/774: chown d5/d55/d5a/ldd 7 1 2024-04-16T14:35:42.850 INFO:tasks.workunit.client.0.smithi005.stdout:0/713: truncate da/f20 276929 0 2024-04-16T14:35:42.873 INFO:tasks.workunit.client.0.smithi005.stdout:5/947: dwrite d0/d6/d12/dc0/d6d/f8e [0,4194304] 0 2024-04-16T14:35:42.873 INFO:tasks.workunit.client.0.smithi005.stdout:5/948: fsync d0/d6/d6e/f7a 0 2024-04-16T14:35:42.873 INFO:tasks.workunit.client.0.smithi005.stdout:2/667: dwrite d0/d2a/d3a/d46/f56 [0,4194304] 0 2024-04-16T14:35:42.873 INFO:tasks.workunit.client.0.smithi005.stdout:2/668: chown d0/d4/d2b/c23 136618 1 2024-04-16T14:35:42.875 INFO:tasks.workunit.client.0.smithi005.stdout:5/949: symlink d0/d6/d12/dc0/d30/d97/l149 0 2024-04-16T14:35:42.875 INFO:tasks.workunit.client.0.smithi005.stdout:2/669: mkdir d0/d29/d89/de3 0 2024-04-16T14:35:42.885 INFO:tasks.workunit.client.0.smithi005.stdout:2/670: write d0/d1c/d59/d7a/d84/f9f [1225301,93215] 0 2024-04-16T14:35:42.885 INFO:tasks.workunit.client.0.smithi005.stdout:2/671: chown d0/c8f 272 1 2024-04-16T14:35:42.885 INFO:tasks.workunit.client.0.smithi005.stdout:2/672: stat d0/d4/d2b/d5e/lcc 0 2024-04-16T14:35:42.885 INFO:tasks.workunit.client.0.smithi005.stdout:2/673: creat d0/d1c/d59/d7a/d84/fe4 x:0 0 0 2024-04-16T14:35:42.885 INFO:tasks.workunit.client.0.smithi005.stdout:2/674: write d0/d1c/d39/d85/da2/fa7 [953106,81617] 0 2024-04-16T14:35:42.885 INFO:tasks.workunit.client.0.smithi005.stdout:8/775: dwrite d5/d7b/da8/da5/def/d71/fb9 [0,4194304] 0 2024-04-16T14:35:42.888 INFO:tasks.workunit.client.0.smithi005.stdout:5/950: dwrite d0/d6/d12/dc0/d6d/f10b [0,4194304] 0 2024-04-16T14:35:42.906 INFO:tasks.workunit.client.1.smithi115.stdout:6/629: link d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/d55/cc0 d13/d1d/d2b/d5f/d30/d43/da6/d63/ccf 0 2024-04-16T14:35:42.907 INFO:tasks.workunit.client.1.smithi115.stdout:7/581: truncate d0/d1/f1f 3024962 0 2024-04-16T14:35:42.909 INFO:tasks.workunit.client.1.smithi115.stdout:9/692: symlink d1/d6/d29/lf5 0 2024-04-16T14:35:42.910 INFO:tasks.workunit.client.1.smithi115.stdout:5/626: mknod dc/d15/d35/d71/cc0 0 2024-04-16T14:35:42.910 INFO:tasks.workunit.client.1.smithi115.stdout:5/627: chown dc/d3d/l51 0 1 2024-04-16T14:35:42.910 INFO:tasks.workunit.client.1.smithi115.stdout:5/628: write dc/d15/f3e [5749373,8086] 0 2024-04-16T14:35:42.911 INFO:tasks.workunit.client.1.smithi115.stdout:6/630: creat d13/d1d/d2b/d5f/d30/d43/d2c/fd0 x:0 0 0 2024-04-16T14:35:42.912 INFO:tasks.workunit.client.1.smithi115.stdout:3/697: sync 2024-04-16T14:35:42.912 INFO:tasks.workunit.client.1.smithi115.stdout:0/537: sync 2024-04-16T14:35:42.912 INFO:tasks.workunit.client.1.smithi115.stdout:8/692: sync 2024-04-16T14:35:42.912 INFO:tasks.workunit.client.1.smithi115.stdout:3/698: chown dc/d29/d4d/d56/d7e/f99 14483623 1 2024-04-16T14:35:42.913 INFO:tasks.workunit.client.1.smithi115.stdout:4/614: sync 2024-04-16T14:35:42.913 INFO:tasks.workunit.client.1.smithi115.stdout:4/615: write d1/d15/d31/d42/d8b/f9b [984472,14067] 0 2024-04-16T14:35:42.913 INFO:tasks.workunit.client.1.smithi115.stdout:2/775: sync 2024-04-16T14:35:42.913 INFO:tasks.workunit.client.1.smithi115.stdout:2/776: readlink d0/d47/d65/dad/dbb/d11/d36/d86/lbf 0 2024-04-16T14:35:42.913 INFO:tasks.workunit.client.1.smithi115.stdout:2/777: chown d0/d47/d65/dad/dbb/d11/d36/l5f 396053535 1 2024-04-16T14:35:42.913 INFO:tasks.workunit.client.1.smithi115.stdout:7/582: symlink d0/d24/d2b/d64/lc1 0 2024-04-16T14:35:42.915 INFO:tasks.workunit.client.1.smithi115.stdout:0/538: dread d6/d10/d12/d1f/d36/d4b/d70/d8a/fb1 [0,4194304] 0 2024-04-16T14:35:42.916 INFO:tasks.workunit.client.1.smithi115.stdout:3/699: link dc/d29/f34 dc/d29/d39/d86/fe9 0 2024-04-16T14:35:42.916 INFO:tasks.workunit.client.1.smithi115.stdout:3/700: chown dc/f11 562 1 2024-04-16T14:35:42.916 INFO:tasks.workunit.client.1.smithi115.stdout:3/701: getdents dc/d24/d33/d4b/dd3/dd9/de0 0 2024-04-16T14:35:42.920 INFO:tasks.workunit.client.1.smithi115.stdout:7/583: mknod d0/d2/d3a/dac/cc2 0 2024-04-16T14:35:42.922 INFO:tasks.workunit.client.1.smithi115.stdout:0/539: unlink l5 0 2024-04-16T14:35:42.924 INFO:tasks.workunit.client.1.smithi115.stdout:5/629: dread dc/d15/f19 [0,4194304] 0 2024-04-16T14:35:42.925 INFO:tasks.workunit.client.1.smithi115.stdout:7/584: stat d0/d24/da3/db1/d3f/d7a/c8c 0 2024-04-16T14:35:42.927 INFO:tasks.workunit.client.1.smithi115.stdout:6/631: dread d13/f1c [0,4194304] 0 2024-04-16T14:35:42.934 INFO:tasks.workunit.client.1.smithi115.stdout:7/585: read d0/d24/f37 [4526066,75634] 0 2024-04-16T14:35:42.935 INFO:tasks.workunit.client.1.smithi115.stdout:8/693: dread d0/fdd [0,4194304] 0 2024-04-16T14:35:42.938 INFO:tasks.workunit.client.1.smithi115.stdout:4/616: dwrite d1/d2/f5b [0,4194304] 0 2024-04-16T14:35:42.938 INFO:tasks.workunit.client.1.smithi115.stdout:4/617: chown d1/d2/f11 10709 1 2024-04-16T14:35:42.938 INFO:tasks.workunit.client.1.smithi115.stdout:4/618: truncate d1/d15/d31/d42/d8b/f9b 1011456 0 2024-04-16T14:35:42.939 INFO:tasks.workunit.client.1.smithi115.stdout:0/540: rename d6/f1e to d6/dac/fbb 0 2024-04-16T14:35:42.939 INFO:tasks.workunit.client.1.smithi115.stdout:5/630: symlink dc/d15/d35/d69/lc1 0 2024-04-16T14:35:42.942 INFO:tasks.workunit.client.1.smithi115.stdout:6/632: mknod d13/d1d/d47/cd1 0 2024-04-16T14:35:42.942 INFO:tasks.workunit.client.1.smithi115.stdout:6/633: dread - d13/d1d/f6f zero size 2024-04-16T14:35:42.942 INFO:tasks.workunit.client.1.smithi115.stdout:6/634: write d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/d55/fcc [718216,60382] 0 2024-04-16T14:35:42.943 INFO:tasks.workunit.client.1.smithi115.stdout:8/694: dread d0/db/d10/d17/d2c/d52/d74/f4d [0,4194304] 0 2024-04-16T14:35:42.944 INFO:tasks.workunit.client.1.smithi115.stdout:8/695: truncate d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/da4/fd2 204209 0 2024-04-16T14:35:42.944 INFO:tasks.workunit.client.1.smithi115.stdout:8/696: fsync d0/db/d10/d17/d2c/d52/d6c/db8/d64/d89/fd7 0 2024-04-16T14:35:42.944 INFO:tasks.workunit.client.1.smithi115.stdout:7/586: creat d0/fc3 x:0 0 0 2024-04-16T14:35:42.945 INFO:tasks.workunit.client.1.smithi115.stdout:2/778: dwrite d0/d47/d65/dad/dc8/d24/dc7/fe2 [0,4194304] 0 2024-04-16T14:35:42.945 INFO:tasks.workunit.client.1.smithi115.stdout:2/779: write d0/d47/d65/dad/dc8/d4a/fa9 [1467862,78961] 0 2024-04-16T14:35:42.950 INFO:tasks.workunit.client.1.smithi115.stdout:0/541: read d6/d30/d4d/f8b [1839507,4929] 0 2024-04-16T14:35:42.954 INFO:tasks.workunit.client.1.smithi115.stdout:5/631: unlink dc/d15/d35/f98 0 2024-04-16T14:35:42.954 INFO:tasks.workunit.client.1.smithi115.stdout:5/632: write dc/f26 [838760,16004] 0 2024-04-16T14:35:42.954 INFO:tasks.workunit.client.1.smithi115.stdout:5/633: fdatasync dc/f2c 0 2024-04-16T14:35:42.954 INFO:tasks.workunit.client.1.smithi115.stdout:5/634: chown dc/d15/d35/d87 199363326 1 2024-04-16T14:35:42.954 INFO:tasks.workunit.client.1.smithi115.stdout:6/635: truncate d13/d1d/d2b/d5f/d30/d43/f2d 2836241 0 2024-04-16T14:35:42.955 INFO:tasks.workunit.client.1.smithi115.stdout:8/697: mkdir d0/db/d10/d17/d2c/d52/d6c/db8/d7d/de2 0 2024-04-16T14:35:42.956 INFO:tasks.workunit.client.1.smithi115.stdout:7/587: creat d0/d2/d3a/d30/d79/fc4 x:0 0 0 2024-04-16T14:35:42.958 INFO:tasks.workunit.client.1.smithi115.stdout:2/780: rmdir d0/d47/d65/dad/dc8/d24 39 2024-04-16T14:35:42.960 INFO:tasks.workunit.client.1.smithi115.stdout:0/542: dread d6/d10/f40 [0,4194304] 0 2024-04-16T14:35:42.962 INFO:tasks.workunit.client.1.smithi115.stdout:5/635: mkdir dc/d5d/dc2 0 2024-04-16T14:35:42.964 INFO:tasks.workunit.client.1.smithi115.stdout:6/636: creat d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/fd2 x:0 0 0 2024-04-16T14:35:42.965 INFO:tasks.workunit.client.1.smithi115.stdout:7/588: read d0/d2/d3a/f33 [1394944,27565] 0 2024-04-16T14:35:42.966 INFO:tasks.workunit.client.1.smithi115.stdout:8/698: creat d0/db/d10/d17/d22/fe3 x:0 0 0 2024-04-16T14:35:42.966 INFO:tasks.workunit.client.1.smithi115.stdout:2/781: mkdir d0/d47/d65/dad/dbb/d11/d6d/df4 0 2024-04-16T14:35:42.966 INFO:tasks.workunit.client.1.smithi115.stdout:6/637: mknod d13/d1d/d2b/d5f/d30/d43/cd3 0 2024-04-16T14:35:42.968 INFO:tasks.workunit.client.1.smithi115.stdout:6/638: mknod d13/d1d/d2b/d5b/cd4 0 2024-04-16T14:35:42.968 INFO:tasks.workunit.client.1.smithi115.stdout:8/699: getdents d0/da5 0 2024-04-16T14:35:42.971 INFO:tasks.workunit.client.1.smithi115.stdout:6/639: mknod d13/d1d/d52/d8c/cd5 0 2024-04-16T14:35:42.971 INFO:tasks.workunit.client.1.smithi115.stdout:6/640: creat d13/d1d/d2b/d5f/d30/d43/d2c/fd6 x:0 0 0 2024-04-16T14:35:42.972 INFO:tasks.workunit.client.1.smithi115.stdout:8/700: unlink d0/db/d44/fac 0 2024-04-16T14:35:42.972 INFO:tasks.workunit.client.1.smithi115.stdout:8/701: stat d0/db/d10/d17/d2c/d52/d6c/db8/d6b 0 2024-04-16T14:35:42.972 INFO:tasks.workunit.client.1.smithi115.stdout:8/702: fsync d0/db/d10/d17/d2c/d52/d74/fe1 0 2024-04-16T14:35:42.975 INFO:tasks.workunit.client.1.smithi115.stdout:6/641: creat d13/d1d/fd7 x:0 0 0 2024-04-16T14:35:42.976 INFO:tasks.workunit.client.1.smithi115.stdout:8/703: mknod d0/db/dbb/dcd/ce4 0 2024-04-16T14:35:42.977 INFO:tasks.workunit.client.1.smithi115.stdout:8/704: mkdir d0/de5 0 2024-04-16T14:35:42.981 INFO:tasks.workunit.client.1.smithi115.stdout:7/589: dread d0/d24/f4a [4194304,4194304] 0 2024-04-16T14:35:42.982 INFO:tasks.workunit.client.1.smithi115.stdout:7/590: mknod d0/d2/d3a/cc5 0 2024-04-16T14:35:42.986 INFO:tasks.workunit.client.1.smithi115.stdout:2/782: dwrite d0/d47/d65/dad/dc8/d24/d23/d71/fed [0,4194304] 0 2024-04-16T14:35:42.990 INFO:tasks.workunit.client.1.smithi115.stdout:2/783: symlink d0/d47/d65/dad/dbb/d11/d25/lf5 0 2024-04-16T14:35:42.990 INFO:tasks.workunit.client.1.smithi115.stdout:2/784: write d0/d47/d65/dad/dbb/ff3 [610609,40453] 0 2024-04-16T14:35:42.990 INFO:tasks.workunit.client.1.smithi115.stdout:0/543: dwrite d6/d10/d12/d31/f91 [0,4194304] 0 2024-04-16T14:35:42.990 INFO:tasks.workunit.client.1.smithi115.stdout:5/636: dwrite dc/d5d/d8f/faf [0,4194304] 0 2024-04-16T14:35:42.991 INFO:tasks.workunit.client.1.smithi115.stdout:5/637: chown cb 3 1 2024-04-16T14:35:42.991 INFO:tasks.workunit.client.1.smithi115.stdout:2/785: mkdir d0/d47/d65/dad/dbb/d11/d6d/df4/df6 0 2024-04-16T14:35:42.993 INFO:tasks.workunit.client.1.smithi115.stdout:5/638: link dc/d15/d4d/fa4 dc/d5d/dc2/fc3 0 2024-04-16T14:35:42.994 INFO:tasks.workunit.client.1.smithi115.stdout:5/639: rmdir dc/d5d 39 2024-04-16T14:35:42.994 INFO:tasks.workunit.client.1.smithi115.stdout:5/640: readlink dc/d15/d35/l4e 0 2024-04-16T14:35:42.995 INFO:tasks.workunit.client.1.smithi115.stdout:6/642: dwrite d13/d1d/d52/d8c/fc7 [0,4194304] 0 2024-04-16T14:35:42.995 INFO:tasks.workunit.client.1.smithi115.stdout:6/643: truncate d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/d55/fcc 787462 0 2024-04-16T14:35:42.995 INFO:tasks.workunit.client.1.smithi115.stdout:5/641: mknod dc/d15/d2d/db0/cc4 0 2024-04-16T14:35:42.997 INFO:tasks.workunit.client.1.smithi115.stdout:6/644: creat d13/d1d/d2b/d5f/d30/d43/fd8 x:0 0 0 2024-04-16T14:35:42.997 INFO:tasks.workunit.client.1.smithi115.stdout:6/645: write d13/d1d/d47/fab [4454749,69606] 0 2024-04-16T14:35:43.001 INFO:tasks.workunit.client.1.smithi115.stdout:8/705: dwrite d0/db/f55 [0,4194304] 0 2024-04-16T14:35:43.001 INFO:tasks.workunit.client.1.smithi115.stdout:8/706: fsync d0/db/d10/d17/d2c/d52/d74/f45 0 2024-04-16T14:35:43.003 INFO:tasks.workunit.client.1.smithi115.stdout:2/786: write d0/d47/d65/dad/dbb/d11/d36/fc3 [757663,22106] 0 2024-04-16T14:35:43.004 INFO:tasks.workunit.client.1.smithi115.stdout:8/707: creat d0/db/d10/d17/d2c/d52/dcc/fe6 x:0 0 0 2024-04-16T14:35:43.006 INFO:tasks.workunit.client.1.smithi115.stdout:2/787: getdents d0/d1b 0 2024-04-16T14:35:43.012 INFO:tasks.workunit.client.1.smithi115.stdout:5/642: dread f1 [0,4194304] 0 2024-04-16T14:35:43.013 INFO:tasks.workunit.client.1.smithi115.stdout:6/646: read d13/d1d/d49/f70 [1103612,50763] 0 2024-04-16T14:35:43.013 INFO:tasks.workunit.client.1.smithi115.stdout:4/619: dwrite d1/d15/d31/f3a [0,4194304] 0 2024-04-16T14:35:43.018 INFO:tasks.workunit.client.1.smithi115.stdout:6/647: rename d13/d1d/d49/f6d to d13/d1d/d87/fd9 0 2024-04-16T14:35:43.021 INFO:tasks.workunit.client.1.smithi115.stdout:2/788: dread d0/d47/d65/dad/dc8/d24/f19 [0,4194304] 0 2024-04-16T14:35:43.030 INFO:tasks.workunit.client.1.smithi115.stdout:6/648: read d13/d1d/d2b/d5f/d30/d43/d2c/f39 [1877012,40959] 0 2024-04-16T14:35:43.030 INFO:tasks.workunit.client.1.smithi115.stdout:6/649: write d13/d1d/d2b/d5f/d30/d43/da6/faf [1235043,113776] 0 2024-04-16T14:35:43.030 INFO:tasks.workunit.client.1.smithi115.stdout:6/650: readlink d13/d1d/l1f 0 2024-04-16T14:35:43.030 INFO:tasks.workunit.client.1.smithi115.stdout:6/651: creat d13/d1d/d2b/d5f/d30/d43/fda x:0 0 0 2024-04-16T14:35:43.031 INFO:tasks.workunit.client.1.smithi115.stdout:6/652: fsync d13/d1d/f5c 0 2024-04-16T14:35:43.031 INFO:tasks.workunit.client.1.smithi115.stdout:6/653: truncate d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/f77 5190167 0 2024-04-16T14:35:43.031 INFO:tasks.workunit.client.1.smithi115.stdout:6/654: chown d13/d1d/f6f 15614460 1 2024-04-16T14:35:43.032 INFO:tasks.workunit.client.1.smithi115.stdout:2/789: read d0/d47/d65/dad/dbb/d11/f96 [690328,75143] 0 2024-04-16T14:35:43.033 INFO:tasks.workunit.client.1.smithi115.stdout:6/655: rename d13/d1d/d2b/d5f/d30/d43/da6/d5a/f48 to d13/d1d/d52/fdb 0 2024-04-16T14:35:43.033 INFO:tasks.workunit.client.1.smithi115.stdout:6/656: write d13/d1d/d49/f70 [4817819,7047] 0 2024-04-16T14:35:43.035 INFO:tasks.workunit.client.1.smithi115.stdout:6/657: mknod d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/d55/cdc 0 2024-04-16T14:35:43.035 INFO:tasks.workunit.client.1.smithi115.stdout:6/658: fdatasync d13/f1c 0 2024-04-16T14:35:43.037 INFO:tasks.workunit.client.1.smithi115.stdout:6/659: mknod d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/cdd 0 2024-04-16T14:35:43.037 INFO:tasks.workunit.client.1.smithi115.stdout:6/660: readlink d13/d1d/d2b/d5b/l85 0 2024-04-16T14:35:43.037 INFO:tasks.workunit.client.1.smithi115.stdout:6/661: chown d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/l95 218206576 1 2024-04-16T14:35:43.039 INFO:tasks.workunit.client.1.smithi115.stdout:6/662: rename f11 to d13/d1d/d2b/d5f/d30/d43/da6/d5a/dcb/fde 0 2024-04-16T14:35:43.051 INFO:tasks.workunit.client.1.smithi115.stdout:6/663: dread d13/d1d/d2b/d5f/d30/d43/da6/d5a/fba [0,4194304] 0 2024-04-16T14:35:43.052 INFO:tasks.workunit.client.1.smithi115.stdout:6/664: symlink d13/d1d/d2b/d5f/d30/d43/da6/d5a/dcb/ldf 0 2024-04-16T14:35:43.053 INFO:tasks.workunit.client.1.smithi115.stdout:6/665: creat d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/fe0 x:0 0 0 2024-04-16T14:35:43.056 INFO:tasks.workunit.client.1.smithi115.stdout:5/643: dwrite f2 [0,4194304] 0 2024-04-16T14:35:43.056 INFO:tasks.workunit.client.1.smithi115.stdout:5/644: chown dc/d15/d2d/c74 3849 1 2024-04-16T14:35:43.056 INFO:tasks.workunit.client.1.smithi115.stdout:2/790: dwrite d0/d47/d65/fec [0,4194304] 0 2024-04-16T14:35:43.060 INFO:tasks.workunit.client.1.smithi115.stdout:0/544: dwrite d6/d10/d12/d31/d35/d9b/fab [0,4194304] 0 2024-04-16T14:35:43.060 INFO:tasks.workunit.client.1.smithi115.stdout:2/791: symlink d0/d47/d65/dad/dbb/d11/dbc/lf7 0 2024-04-16T14:35:43.061 INFO:tasks.workunit.client.1.smithi115.stdout:4/620: dwrite d1/f22 [4194304,4194304] 0 2024-04-16T14:35:43.061 INFO:tasks.workunit.client.1.smithi115.stdout:4/621: getdents d1/d2 0 2024-04-16T14:35:43.064 INFO:tasks.workunit.client.1.smithi115.stdout:0/545: dread d6/d30/d4d/f8b [0,4194304] 0 2024-04-16T14:35:43.064 INFO:tasks.workunit.client.1.smithi115.stdout:4/622: write d1/d15/d31/f4b [270393,118417] 0 2024-04-16T14:35:43.071 INFO:tasks.workunit.client.1.smithi115.stdout:2/792: rename d0/d1b/f4b to d0/d47/d65/dad/dbb/d11/d25/ff8 0 2024-04-16T14:35:43.072 INFO:tasks.workunit.client.1.smithi115.stdout:4/623: symlink d1/d15/d31/d42/lb7 0 2024-04-16T14:35:43.074 INFO:tasks.workunit.client.1.smithi115.stdout:2/793: symlink d0/d47/d65/dad/dc8/d24/d21/lf9 0 2024-04-16T14:35:43.074 INFO:tasks.workunit.client.1.smithi115.stdout:2/794: fsync d0/d47/d65/dad/dbb/d11/d6d/fbd 0 2024-04-16T14:35:43.074 INFO:tasks.workunit.client.1.smithi115.stdout:2/795: chown d0/d47/d65/dad/dbb/d11/l1c 158278248 1 2024-04-16T14:35:43.076 INFO:tasks.workunit.client.1.smithi115.stdout:2/796: dread d0/d47/d65/dad/dc8/faa [0,4194304] 0 2024-04-16T14:35:43.077 INFO:tasks.workunit.client.1.smithi115.stdout:2/797: symlink d0/d47/d65/dad/dc8/d24/d23/d80/lfa 0 2024-04-16T14:35:43.078 INFO:tasks.workunit.client.1.smithi115.stdout:2/798: symlink d0/d47/d65/dad/dc8/d24/d23/lfb 0 2024-04-16T14:35:43.079 INFO:tasks.workunit.client.1.smithi115.stdout:2/799: creat d0/d47/d65/dad/dc8/d24/d10/ffc x:0 0 0 2024-04-16T14:35:43.080 INFO:tasks.workunit.client.1.smithi115.stdout:6/666: dwrite d13/fb1 [0,4194304] 0 2024-04-16T14:35:43.081 INFO:tasks.workunit.client.1.smithi115.stdout:5/645: dwrite dc/d5d/d8f/f92 [0,4194304] 0 2024-04-16T14:35:43.083 INFO:tasks.workunit.client.1.smithi115.stdout:2/800: rename d0/d47/d65/dad/dbb/d11/d36/fd8 to d0/d47/d65/d61/dae/ffd 0 2024-04-16T14:35:43.089 INFO:tasks.workunit.client.1.smithi115.stdout:5/646: unlink l7 0 2024-04-16T14:35:43.090 INFO:tasks.workunit.client.1.smithi115.stdout:2/801: creat d0/d47/d65/dad/dc8/d24/d23/ffe x:0 0 0 2024-04-16T14:35:43.091 INFO:tasks.workunit.client.1.smithi115.stdout:5/647: getdents dc/d3d/d68 0 2024-04-16T14:35:43.094 INFO:tasks.workunit.client.1.smithi115.stdout:2/802: link d0/d47/d65/dad/dbb/d11/d36/l5f d0/d47/d65/dad/dc8/d24/d23/d83/lff 0 2024-04-16T14:35:43.103 INFO:tasks.workunit.client.1.smithi115.stdout:6/667: dwrite d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/d55/f58 [0,4194304] 0 2024-04-16T14:35:43.116 INFO:tasks.workunit.client.1.smithi115.stdout:6/668: write d13/fb1 [1518323,42580] 0 2024-04-16T14:35:43.116 INFO:tasks.workunit.client.1.smithi115.stdout:6/669: dread - d13/d1d/d2b/d5b/fc2 zero size 2024-04-16T14:35:43.116 INFO:tasks.workunit.client.1.smithi115.stdout:2/803: dwrite d0/d47/d65/dad/dc8/d24/d21/d59/f68 [0,4194304] 0 2024-04-16T14:35:43.116 INFO:tasks.workunit.client.1.smithi115.stdout:5/648: dwrite dc/d3d/f5a [0,4194304] 0 2024-04-16T14:35:43.121 INFO:tasks.workunit.client.1.smithi115.stdout:5/649: creat dc/d3d/fc5 x:0 0 0 2024-04-16T14:35:43.121 INFO:tasks.workunit.client.1.smithi115.stdout:5/650: stat dc/d15/d2d/d8c/l9e 0 2024-04-16T14:35:43.122 INFO:tasks.workunit.client.1.smithi115.stdout:5/651: mknod dc/d3d/d68/d7b/cc6 0 2024-04-16T14:35:43.127 INFO:tasks.workunit.client.1.smithi115.stdout:6/670: dwrite d13/d1d/d2b/d5f/f6a [4194304,4194304] 0 2024-04-16T14:35:43.137 INFO:tasks.workunit.client.1.smithi115.stdout:9/693: sync 2024-04-16T14:35:43.137 INFO:tasks.workunit.client.1.smithi115.stdout:1/703: sync 2024-04-16T14:35:43.139 INFO:tasks.workunit.client.1.smithi115.stdout:9/694: rename d1/d6/d29/f8e to d1/d6/d2d/d4b/d8f/d91/dd1/dd2/ff6 0 2024-04-16T14:35:43.140 INFO:tasks.workunit.client.1.smithi115.stdout:9/695: creat d1/d6/d2d/d4b/d6c/d20/d36/ff7 x:0 0 0 2024-04-16T14:35:43.146 INFO:tasks.workunit.client.1.smithi115.stdout:5/652: dwrite dc/fa0 [0,4194304] 0 2024-04-16T14:35:43.148 INFO:tasks.workunit.client.1.smithi115.stdout:5/653: symlink dc/d15/d35/d87/lc7 0 2024-04-16T14:35:43.148 INFO:tasks.workunit.client.1.smithi115.stdout:5/654: chown dc/d5d/d8f/cae 64139973 1 2024-04-16T14:35:43.155 INFO:tasks.workunit.client.1.smithi115.stdout:1/704: dread df/d13/d4d/d2c/f24 [0,4194304] 0 2024-04-16T14:35:43.155 INFO:tasks.workunit.client.1.smithi115.stdout:6/671: dwrite d13/d1d/d2b/d5f/d30/d43/da6/d5a/f3c [0,4194304] 0 2024-04-16T14:35:43.156 INFO:tasks.workunit.client.0.smithi005.stdout:2/675: truncate d0/d2a/d3a/f76 1452578 0 2024-04-16T14:35:43.159 INFO:tasks.workunit.client.1.smithi115.stdout:9/696: dwrite d1/d6/fcb [0,4194304] 0 2024-04-16T14:35:43.160 INFO:tasks.workunit.client.0.smithi005.stdout:8/776: creat d5/d7b/da8/da5/def/f110 x:0 0 0 2024-04-16T14:35:43.160 INFO:tasks.workunit.client.0.smithi005.stdout:8/777: chown d5/d11/f6f 8980 1 2024-04-16T14:35:43.160 INFO:tasks.workunit.client.0.smithi005.stdout:8/778: readlink d5/l7 0 2024-04-16T14:35:43.165 INFO:tasks.workunit.client.1.smithi115.stdout:9/697: creat d1/d6/d2d/d4b/d8f/d91/dd1/dd2/ff8 x:0 0 0 2024-04-16T14:35:43.165 INFO:tasks.workunit.client.0.smithi005.stdout:2/676: dread d0/d4/d2b/f11 [0,4194304] 0 2024-04-16T14:35:43.165 INFO:tasks.workunit.client.0.smithi005.stdout:2/677: truncate d0/d29/d3e/f8e 935604 0 2024-04-16T14:35:43.165 INFO:tasks.workunit.client.0.smithi005.stdout:2/678: chown d0/d2a 1142997 1 2024-04-16T14:35:43.166 INFO:tasks.workunit.client.0.smithi005.stdout:2/679: truncate d0/d4/f66 526622 0 2024-04-16T14:35:43.167 INFO:tasks.workunit.client.1.smithi115.stdout:9/698: link d1/d6/d2d/d4b/d6c/c14 d1/d6/d2d/d3d/cf9 0 2024-04-16T14:35:43.167 INFO:tasks.workunit.client.1.smithi115.stdout:9/699: fsync d1/d6/d29/f57 0 2024-04-16T14:35:43.167 INFO:tasks.workunit.client.1.smithi115.stdout:9/700: chown d1/d6/d2d/d3d/d49/d88/fbc 4067954 1 2024-04-16T14:35:43.167 INFO:tasks.workunit.client.1.smithi115.stdout:9/701: creat d1/d6/d29/ffa x:0 0 0 2024-04-16T14:35:43.167 INFO:tasks.workunit.client.1.smithi115.stdout:9/702: stat d1/c11 0 2024-04-16T14:35:43.167 INFO:tasks.workunit.client.1.smithi115.stdout:9/703: write d1/d6/d2d/d3d/d50/f94 [453964,125407] 0 2024-04-16T14:35:43.168 INFO:tasks.workunit.client.1.smithi115.stdout:9/704: read d1/d6/d2d/d4b/d8f/d91/f58 [550026,71267] 0 2024-04-16T14:35:43.170 INFO:tasks.workunit.client.1.smithi115.stdout:9/705: mknod d1/d6/d2d/d3d/db7/cfb 0 2024-04-16T14:35:43.170 INFO:tasks.workunit.client.1.smithi115.stdout:9/706: write d1/d6/d2d/d4b/d8f/d91/dd1/dd2/ff6 [807475,8627] 0 2024-04-16T14:35:43.170 INFO:tasks.workunit.client.1.smithi115.stdout:9/707: chown d1/d6/d2d/d3d/d49/d98/f9b 0 1 2024-04-16T14:35:43.171 INFO:tasks.workunit.client.1.smithi115.stdout:9/708: stat d1/d6/d2d/d4b/d8f/lc5 0 2024-04-16T14:35:43.171 INFO:tasks.workunit.client.1.smithi115.stdout:9/709: unlink d1/d6/d2d/d4b/d6c/d20/d36/f9f 0 2024-04-16T14:35:43.171 INFO:tasks.workunit.client.1.smithi115.stdout:9/710: getdents d1/d6/de0 0 2024-04-16T14:35:43.172 INFO:tasks.workunit.client.1.smithi115.stdout:9/711: chown d1/d6/f17 74 1 2024-04-16T14:35:43.172 INFO:tasks.workunit.client.1.smithi115.stdout:9/712: mkdir d1/d6/d2d/d4b/d8f/d91/dda/ddd/dfc 0 2024-04-16T14:35:43.172 INFO:tasks.workunit.client.1.smithi115.stdout:9/713: write d1/d6/d2d/d4b/d8f/d91/fbf [221245,89268] 0 2024-04-16T14:35:43.173 INFO:tasks.workunit.client.1.smithi115.stdout:9/714: symlink d1/d6/de0/lfd 0 2024-04-16T14:35:43.180 INFO:tasks.workunit.client.1.smithi115.stdout:5/655: dwrite dc/f3b [0,4194304] 0 2024-04-16T14:35:43.181 INFO:tasks.workunit.client.1.smithi115.stdout:6/672: dwrite d13/d1d/f6f [0,4194304] 0 2024-04-16T14:35:43.181 INFO:tasks.workunit.client.1.smithi115.stdout:6/673: fsync d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/fd2 0 2024-04-16T14:35:43.181 INFO:tasks.workunit.client.1.smithi115.stdout:1/705: dwrite df/d35/f67 [0,4194304] 0 2024-04-16T14:35:43.181 INFO:tasks.workunit.client.1.smithi115.stdout:1/706: truncate df/d36/d94/fa4 774492 0 2024-04-16T14:35:43.189 INFO:tasks.workunit.client.1.smithi115.stdout:5/656: write dc/d3d/d41/f46 [2090460,47510] 0 2024-04-16T14:35:43.193 INFO:tasks.workunit.client.1.smithi115.stdout:9/715: dwrite d1/d6/d29/f32 [4194304,4194304] 0 2024-04-16T14:35:43.194 INFO:tasks.workunit.client.1.smithi115.stdout:9/716: read - d1/d6/d2d/d4b/d6c/f6b zero size 2024-04-16T14:35:43.194 INFO:tasks.workunit.client.1.smithi115.stdout:9/717: fdatasync d1/d6/d2d/d4b/d6c/d20/d36/dce/fea 0 2024-04-16T14:35:43.194 INFO:tasks.workunit.client.1.smithi115.stdout:9/718: chown d1/d6/d2d/d4b/d60 7213 1 2024-04-16T14:35:43.204 INFO:tasks.workunit.client.1.smithi115.stdout:5/657: write dc/d15/f3e [2747587,44473] 0 2024-04-16T14:35:43.207 INFO:tasks.workunit.client.0.smithi005.stdout:5/951: symlink d0/d6/d6e/d9e/da9/l14a 0 2024-04-16T14:35:43.207 INFO:tasks.workunit.client.0.smithi005.stdout:5/952: chown d0/d6/d6e/d9e/da9/c140 11 1 2024-04-16T14:35:43.209 INFO:tasks.workunit.client.1.smithi115.stdout:6/674: dwrite d13/d1d/d2b/fac [4194304,4194304] 0 2024-04-16T14:35:43.210 INFO:tasks.workunit.client.1.smithi115.stdout:6/675: read - d13/d1d/d52/d8c/fc3 zero size 2024-04-16T14:35:43.210 INFO:tasks.workunit.client.1.smithi115.stdout:6/676: truncate d13/f5e 4210275 0 2024-04-16T14:35:43.210 INFO:tasks.workunit.client.1.smithi115.stdout:6/677: write d13/d1d/d2b/d5f/d30/d43/da6/f7d [124,56345] 0 2024-04-16T14:35:43.210 INFO:tasks.workunit.client.1.smithi115.stdout:6/678: read d13/d1d/d49/f8d [352734,121605] 0 2024-04-16T14:35:43.215 INFO:tasks.workunit.client.1.smithi115.stdout:1/707: dwrite df/d35/f67 [0,4194304] 0 2024-04-16T14:35:43.217 INFO:tasks.workunit.client.1.smithi115.stdout:1/708: dread df/d13/d4d/d6d/fa7 [0,4194304] 0 2024-04-16T14:35:43.233 INFO:tasks.workunit.client.1.smithi115.stdout:6/679: dwrite d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/d55/f58 [0,4194304] 0 2024-04-16T14:35:43.234 INFO:tasks.workunit.client.1.smithi115.stdout:6/680: fsync d13/d1d/d87/fd9 0 2024-04-16T14:35:43.234 INFO:tasks.workunit.client.1.smithi115.stdout:6/681: read d13/d1d/d2b/d5f/d30/d43/da6/d5a/fad [416007,26197] 0 2024-04-16T14:35:43.234 INFO:tasks.workunit.client.1.smithi115.stdout:5/658: dwrite dc/d15/f53 [4194304,4194304] 0 2024-04-16T14:35:43.234 INFO:tasks.workunit.client.1.smithi115.stdout:5/659: chown dc/d8e/fab 15874887 1 2024-04-16T14:35:43.254 INFO:tasks.workunit.client.1.smithi115.stdout:6/682: dwrite d13/f2a [4194304,4194304] 0 2024-04-16T14:35:43.254 INFO:tasks.workunit.client.1.smithi115.stdout:6/683: readlink d13/d1d/d2b/d5b/l85 0 2024-04-16T14:35:43.254 INFO:tasks.workunit.client.1.smithi115.stdout:6/684: creat d13/fe1 x:0 0 0 2024-04-16T14:35:43.574 INFO:tasks.workunit.client.1.smithi115.stdout:5/660: unlink dc/f1c 0 2024-04-16T14:35:43.578 INFO:tasks.workunit.client.1.smithi115.stdout:6/685: mkdir d13/d1d/d2b/d5f/d30/d43/d2c/de2 0 2024-04-16T14:35:43.581 INFO:tasks.workunit.client.1.smithi115.stdout:3/702: sync 2024-04-16T14:35:43.582 INFO:tasks.workunit.client.1.smithi115.stdout:7/591: sync 2024-04-16T14:35:43.582 INFO:tasks.workunit.client.1.smithi115.stdout:2/804: sync 2024-04-16T14:35:43.582 INFO:tasks.workunit.client.1.smithi115.stdout:0/546: sync 2024-04-16T14:35:43.582 INFO:tasks.workunit.client.1.smithi115.stdout:9/719: sync 2024-04-16T14:35:43.582 INFO:tasks.workunit.client.1.smithi115.stdout:4/624: sync 2024-04-16T14:35:43.582 INFO:tasks.workunit.client.1.smithi115.stdout:8/708: sync 2024-04-16T14:35:43.582 INFO:tasks.workunit.client.1.smithi115.stdout:0/547: write d6/d1b/f21 [1417902,121813] 0 2024-04-16T14:35:43.583 INFO:tasks.workunit.client.1.smithi115.stdout:1/709: mknod df/cee 0 2024-04-16T14:35:43.585 INFO:tasks.workunit.client.1.smithi115.stdout:5/661: rename dc/d5d/c9b to dc/d15/d35/d69/dad/cc8 0 2024-04-16T14:35:43.595 INFO:tasks.workunit.client.1.smithi115.stdout:7/592: dwrite d0/d24/da3/db1/f60 [0,4194304] 0 2024-04-16T14:35:43.595 INFO:tasks.workunit.client.1.smithi115.stdout:7/593: write d0/d2/d3a/d30/f98 [1482319,18256] 0 2024-04-16T14:35:43.595 INFO:tasks.workunit.client.1.smithi115.stdout:2/805: creat d0/d47/d65/dad/dbb/d11/f100 x:0 0 0 2024-04-16T14:35:43.597 INFO:tasks.workunit.client.1.smithi115.stdout:9/720: mkdir d1/d6/d2d/d4b/d8f/d91/dda/ddd/de8/dfe 0 2024-04-16T14:35:43.597 INFO:tasks.workunit.client.1.smithi115.stdout:9/721: dread - d1/d6/d2d/d4b/d6c/d20/d36/dce/fea zero size 2024-04-16T14:35:43.597 INFO:tasks.workunit.client.1.smithi115.stdout:9/722: write d1/d6/f67 [172985,65581] 0 2024-04-16T14:35:43.599 INFO:tasks.workunit.client.0.smithi005.stdout:6/968: sync 2024-04-16T14:35:43.599 INFO:tasks.workunit.client.0.smithi005.stdout:9/626: sync 2024-04-16T14:35:43.600 INFO:tasks.workunit.client.1.smithi115.stdout:4/625: link d1/d15/d24/f66 d1/d15/d78/fb8 0 2024-04-16T14:35:43.600 INFO:tasks.workunit.client.1.smithi115.stdout:4/626: chown d1/d15/d17/f74 3 1 2024-04-16T14:35:43.600 INFO:tasks.workunit.client.1.smithi115.stdout:0/548: mknod d6/d30/cbc 0 2024-04-16T14:35:43.601 INFO:tasks.workunit.client.0.smithi005.stdout:7/957: sync 2024-04-16T14:35:43.601 INFO:tasks.workunit.client.0.smithi005.stdout:7/958: chown d1 2189 1 2024-04-16T14:35:43.601 INFO:tasks.workunit.client.0.smithi005.stdout:7/959: write d1/d49/d74/fdc [2076249,59636] 0 2024-04-16T14:35:43.601 INFO:tasks.workunit.client.0.smithi005.stdout:3/851: sync 2024-04-16T14:35:43.601 INFO:tasks.workunit.client.0.smithi005.stdout:0/714: sync 2024-04-16T14:35:43.601 INFO:tasks.workunit.client.0.smithi005.stdout:3/852: creat d2/d17/d102/f12c x:0 0 0 2024-04-16T14:35:43.601 INFO:tasks.workunit.client.0.smithi005.stdout:0/715: write da/df/d26/d39/d55/fe8 [210121,109152] 0 2024-04-16T14:35:43.601 INFO:tasks.workunit.client.0.smithi005.stdout:0/716: stat da/df/d1b/d3a/d53/d5a/d99/fc5 0 2024-04-16T14:35:43.601 INFO:tasks.workunit.client.1.smithi115.stdout:1/710: symlink df/d36/d94/dbf/lef 0 2024-04-16T14:35:43.610 INFO:tasks.workunit.client.1.smithi115.stdout:7/594: creat d0/d24/d2b/d64/fc6 x:0 0 0 2024-04-16T14:35:43.611 INFO:tasks.workunit.client.1.smithi115.stdout:2/806: write d0/d47/d65/dad/dc8/d24/dc7/fe2 [3166256,122214] 0 2024-04-16T14:35:43.611 INFO:tasks.workunit.client.1.smithi115.stdout:2/807: fdatasync d0/d47/d65/dad/dc8/d24/d23/f6c 0 2024-04-16T14:35:43.611 INFO:tasks.workunit.client.1.smithi115.stdout:4/627: truncate d1/d15/d31/d42/d46/f6c 3707962 0 2024-04-16T14:35:43.616 INFO:tasks.workunit.client.1.smithi115.stdout:2/808: link d0/d47/d65/dad/dc8/d24/d21/l9f d0/d47/d65/d61/dae/l101 0 2024-04-16T14:35:43.616 INFO:tasks.workunit.client.1.smithi115.stdout:0/549: dread d6/f4f [0,4194304] 0 2024-04-16T14:35:43.617 INFO:tasks.workunit.client.1.smithi115.stdout:4/628: mknod d1/d15/d31/d42/cb9 0 2024-04-16T14:35:43.623 INFO:tasks.workunit.client.1.smithi115.stdout:2/809: symlink d0/d47/d65/dad/dc8/d57/l102 0 2024-04-16T14:35:43.623 INFO:tasks.workunit.client.1.smithi115.stdout:0/550: symlink d6/d1b/d4e/db9/lbd 0 2024-04-16T14:35:43.623 INFO:tasks.workunit.client.1.smithi115.stdout:7/595: read d0/d24/da3/db1/f60 [2956458,92477] 0 2024-04-16T14:35:43.623 INFO:tasks.workunit.client.1.smithi115.stdout:1/711: dwrite df/d13/d4d/d3e/d75/dda/f56 [0,4194304] 0 2024-04-16T14:35:43.623 INFO:tasks.workunit.client.1.smithi115.stdout:4/629: creat d1/d15/d31/d42/d46/d7a/fba x:0 0 0 2024-04-16T14:35:43.623 INFO:tasks.workunit.client.1.smithi115.stdout:2/810: mknod d0/d47/d65/dad/dc8/d22/c103 0 2024-04-16T14:35:43.624 INFO:tasks.workunit.client.1.smithi115.stdout:2/811: write d0/d47/d65/dad/dbb/d11/d25/fda [190475,59491] 0 2024-04-16T14:35:43.624 INFO:tasks.workunit.client.0.smithi005.stdout:5/953: mknod d0/d6/d6e/d11d/c14b 0 2024-04-16T14:35:43.624 INFO:tasks.workunit.client.0.smithi005.stdout:5/954: readlink d0/l110 0 2024-04-16T14:35:43.625 INFO:tasks.workunit.client.0.smithi005.stdout:8/779: symlink d5/d7b/da8/db7/d8a/da1/l111 0 2024-04-16T14:35:43.625 INFO:tasks.workunit.client.0.smithi005.stdout:8/780: read - d5/d55/fb3 zero size 2024-04-16T14:35:43.626 INFO:tasks.workunit.client.0.smithi005.stdout:2/680: getdents d0/d1c/d39/d48 0 2024-04-16T14:35:43.629 INFO:tasks.workunit.client.0.smithi005.stdout:2/681: dread d0/d4/f66 [0,4194304] 0 2024-04-16T14:35:43.629 INFO:tasks.workunit.client.0.smithi005.stdout:2/682: readlink d0/d4/l2f 0 2024-04-16T14:35:43.629 INFO:tasks.workunit.client.0.smithi005.stdout:9/627: rename d3/d12/d16/d46/l4c to d3/d49/d4b/d55/lb3 0 2024-04-16T14:35:43.629 INFO:tasks.workunit.client.0.smithi005.stdout:9/628: getdents d3/d12/d16/d46/d47/db1 0 2024-04-16T14:35:43.630 INFO:tasks.workunit.client.1.smithi115.stdout:7/596: symlink d0/d24/d40/lc7 0 2024-04-16T14:35:43.630 INFO:tasks.workunit.client.1.smithi115.stdout:7/597: read - d0/d2/d3a/d30/d6b/da2/fa8 zero size 2024-04-16T14:35:43.633 INFO:tasks.workunit.client.0.smithi005.stdout:9/629: write d3/d12/d16/d46/d47/d60/f75 [72680,29874] 0 2024-04-16T14:35:43.633 INFO:tasks.workunit.client.0.smithi005.stdout:9/630: write d3/f81 [1033785,119731] 0 2024-04-16T14:35:43.633 INFO:tasks.workunit.client.0.smithi005.stdout:7/960: mkdir d1/d49/d74/d77/d22/d27/d3a/d5c/d9e/d13d 0 2024-04-16T14:35:43.637 INFO:tasks.workunit.client.0.smithi005.stdout:3/853: mkdir d2/d17/d46/d75/d9b/dbd/dee/d12d 0 2024-04-16T14:35:43.637 INFO:tasks.workunit.client.0.smithi005.stdout:6/969: dwrite d2/d5/d10/dd6/d7a/f120 [0,4194304] 0 2024-04-16T14:35:43.638 INFO:tasks.workunit.client.1.smithi115.stdout:7/598: symlink d0/d2/d3a/d30/d79/d95/lc8 0 2024-04-16T14:35:43.639 INFO:tasks.workunit.client.0.smithi005.stdout:0/717: creat da/df/d1b/d3a/d53/d5a/d99/fef x:0 0 0 2024-04-16T14:35:43.641 INFO:tasks.workunit.client.1.smithi115.stdout:0/551: rename d6/d10/d71/d88 to d6/d54/d57/dbe 0 2024-04-16T14:35:43.641 INFO:tasks.workunit.client.1.smithi115.stdout:0/552: write d6/d10/d12/d31/d35/d44/f50 [4625318,71755] 0 2024-04-16T14:35:43.641 INFO:tasks.workunit.client.0.smithi005.stdout:8/781: symlink d5/d55/l112 0 2024-04-16T14:35:43.642 INFO:tasks.workunit.client.1.smithi115.stdout:7/599: creat d0/d1/fc9 x:0 0 0 2024-04-16T14:35:43.643 INFO:tasks.workunit.client.1.smithi115.stdout:0/553: creat d6/dac/fbf x:0 0 0 2024-04-16T14:35:43.643 INFO:tasks.workunit.client.1.smithi115.stdout:0/554: stat d6/d54/f87 0 2024-04-16T14:35:43.643 INFO:tasks.workunit.client.1.smithi115.stdout:0/555: chown d6/d10/d12/d1f/d36/d4b/d70 45739 1 2024-04-16T14:35:43.645 INFO:tasks.workunit.client.0.smithi005.stdout:7/961: unlink d1/d8a/l130 0 2024-04-16T14:35:43.646 INFO:tasks.workunit.client.0.smithi005.stdout:3/854: creat d2/d17/d46/d75/f12e x:0 0 0 2024-04-16T14:35:43.648 INFO:tasks.workunit.client.0.smithi005.stdout:0/718: getdents da/df/d1b/d3a/d53 0 2024-04-16T14:35:43.653 INFO:tasks.workunit.client.0.smithi005.stdout:8/782: mknod d5/d7b/da8/db7/d8a/da1/d68/dcb/dd9/c113 0 2024-04-16T14:35:43.653 INFO:tasks.workunit.client.0.smithi005.stdout:8/783: chown d5/d11/f5f 131574 1 2024-04-16T14:35:43.653 INFO:tasks.workunit.client.0.smithi005.stdout:8/784: write d5/d7b/da8/da5/def/faa [318599,2888] 0 2024-04-16T14:35:43.653 INFO:tasks.workunit.client.0.smithi005.stdout:2/683: rmdir d0/d1c/d59/d67 39 2024-04-16T14:35:43.653 INFO:tasks.workunit.client.0.smithi005.stdout:7/962: symlink d1/d82/l13e 0 2024-04-16T14:35:43.655 INFO:tasks.workunit.client.0.smithi005.stdout:0/719: creat da/df/d26/d39/d55/d5c/da8/ff0 x:0 0 0 2024-04-16T14:35:43.657 INFO:tasks.workunit.client.0.smithi005.stdout:7/963: rmdir d1/d49/d74/d77/d22/da0/dbb 39 2024-04-16T14:35:43.657 INFO:tasks.workunit.client.0.smithi005.stdout:7/964: dread - d1/d49/d74/d77/d22/d27/fd7 zero size 2024-04-16T14:35:43.657 INFO:tasks.workunit.client.0.smithi005.stdout:7/965: fsync d1/d49/d74/d77/d57/d47/fa2 0 2024-04-16T14:35:43.658 INFO:tasks.workunit.client.0.smithi005.stdout:2/684: dread d0/d1c/d39/fd4 [0,4194304] 0 2024-04-16T14:35:43.659 INFO:tasks.workunit.client.0.smithi005.stdout:8/785: rename d5/d7b/da8/db7/f1d to d5/d7b/da8/db7/d8a/da1/f114 0 2024-04-16T14:35:43.660 INFO:tasks.workunit.client.0.smithi005.stdout:7/966: link d1/dc/d2f/c95 d1/c13f 0 2024-04-16T14:35:43.660 INFO:tasks.workunit.client.0.smithi005.stdout:7/967: stat d1/dc/d2f/dbd/f122 0 2024-04-16T14:35:43.662 INFO:tasks.workunit.client.0.smithi005.stdout:2/685: creat d0/d4/d2b/d5e/fe5 x:0 0 0 2024-04-16T14:35:43.662 INFO:tasks.workunit.client.0.smithi005.stdout:2/686: write d0/d1c/d59/d7a/d84/fe4 [313910,44767] 0 2024-04-16T14:35:43.663 INFO:tasks.workunit.client.0.smithi005.stdout:7/968: rename d1/f29 to d1/d85/f140 0 2024-04-16T14:35:43.663 INFO:tasks.workunit.client.0.smithi005.stdout:2/687: creat d0/d29/d3e/fe6 x:0 0 0 2024-04-16T14:35:43.664 INFO:tasks.workunit.client.0.smithi005.stdout:7/969: mknod d1/c141 0 2024-04-16T14:35:43.664 INFO:tasks.workunit.client.0.smithi005.stdout:7/970: chown d1/d49/d74/d77/d22/d27/d2e/c69 517158 1 2024-04-16T14:35:43.665 INFO:tasks.workunit.client.0.smithi005.stdout:2/688: symlink d0/d2a/d3a/d46/le7 0 2024-04-16T14:35:43.666 INFO:tasks.workunit.client.0.smithi005.stdout:7/971: creat d1/d49/d74/d77/d22/db0/dc6/f142 x:0 0 0 2024-04-16T14:35:43.666 INFO:tasks.workunit.client.0.smithi005.stdout:7/972: write d1/d49/d74/d77/d22/da0/dbb/dcb/f108 [596187,129422] 0 2024-04-16T14:35:43.666 INFO:tasks.workunit.client.0.smithi005.stdout:2/689: truncate d0/d4/fc0 3396821 0 2024-04-16T14:35:43.667 INFO:tasks.workunit.client.0.smithi005.stdout:2/690: stat d0/d1c/d59/c5c 0 2024-04-16T14:35:43.667 INFO:tasks.workunit.client.0.smithi005.stdout:2/691: readlink d0/d1c/d59/d67/l93 0 2024-04-16T14:35:43.667 INFO:tasks.workunit.client.0.smithi005.stdout:7/973: creat d1/d49/d74/d77/d22/da9/f143 x:0 0 0 2024-04-16T14:35:43.667 INFO:tasks.workunit.client.0.smithi005.stdout:7/974: dread - d1/d49/d74/d77/fe6 zero size 2024-04-16T14:35:43.667 INFO:tasks.workunit.client.0.smithi005.stdout:7/975: fdatasync d1/dc/d2f/dbd/f122 0 2024-04-16T14:35:43.668 INFO:tasks.workunit.client.0.smithi005.stdout:7/976: readlink d1/l41 0 2024-04-16T14:35:43.668 INFO:tasks.workunit.client.0.smithi005.stdout:2/692: unlink d0/d1c/fa5 0 2024-04-16T14:35:43.669 INFO:tasks.workunit.client.0.smithi005.stdout:7/977: mkdir d1/d82/d128/d144 0 2024-04-16T14:35:43.669 INFO:tasks.workunit.client.0.smithi005.stdout:7/978: stat d1/d49/d74/d77/fe6 0 2024-04-16T14:35:43.670 INFO:tasks.workunit.client.0.smithi005.stdout:7/979: creat d1/f145 x:0 0 0 2024-04-16T14:35:43.671 INFO:tasks.workunit.client.0.smithi005.stdout:7/980: creat d1/dc/d2f/d4f/f146 x:0 0 0 2024-04-16T14:35:43.671 INFO:tasks.workunit.client.0.smithi005.stdout:7/981: chown d1/d49/d74/l111 1 1 2024-04-16T14:35:43.672 INFO:tasks.workunit.client.0.smithi005.stdout:7/982: chown d1/d49/d74/d77/d22/c10e 455559144 1 2024-04-16T14:35:43.673 INFO:tasks.workunit.client.0.smithi005.stdout:0/720: dread da/df/f94 [0,4194304] 0 2024-04-16T14:35:43.674 INFO:tasks.workunit.client.0.smithi005.stdout:0/721: truncate da/df/d1b/d3a/d53/d5a/d99/fc6 996386 0 2024-04-16T14:35:43.674 INFO:tasks.workunit.client.0.smithi005.stdout:0/722: write da/df/d1b/f62 [1305348,28622] 0 2024-04-16T14:35:43.674 INFO:tasks.workunit.client.0.smithi005.stdout:0/723: write da/df/d26/fd1 [621393,116382] 0 2024-04-16T14:35:43.674 INFO:tasks.workunit.client.1.smithi115.stdout:4/630: dwrite d1/d15/f77 [0,4194304] 0 2024-04-16T14:35:43.674 INFO:tasks.workunit.client.1.smithi115.stdout:1/712: dwrite df/d13/d4d/d6d/f86 [4194304,4194304] 0 2024-04-16T14:35:43.675 INFO:tasks.workunit.client.0.smithi005.stdout:0/724: mknod da/df/d1b/d24/de7/cf1 0 2024-04-16T14:35:43.677 INFO:tasks.workunit.client.1.smithi115.stdout:4/631: rename d1/d15/d1e/f9d to d1/d15/d17/fbb 0 2024-04-16T14:35:43.677 INFO:tasks.workunit.client.1.smithi115.stdout:0/556: dread d6/d10/d12/d1f/d36/fa2 [0,4194304] 0 2024-04-16T14:35:43.679 INFO:tasks.workunit.client.1.smithi115.stdout:1/713: creat df/d2d/ff0 x:0 0 0 2024-04-16T14:35:43.679 INFO:tasks.workunit.client.0.smithi005.stdout:7/983: dread d1/d49/d74/d77/d22/da9/fab [0,4194304] 0 2024-04-16T14:35:43.680 INFO:tasks.workunit.client.0.smithi005.stdout:5/955: dwrite d0/d70/dea/fee [0,4194304] 0 2024-04-16T14:35:43.681 INFO:tasks.workunit.client.0.smithi005.stdout:0/725: dread da/f30 [0,4194304] 0 2024-04-16T14:35:43.681 INFO:tasks.workunit.client.0.smithi005.stdout:0/726: chown da/df/d26/d8e/f98 342 1 2024-04-16T14:35:43.681 INFO:tasks.workunit.client.0.smithi005.stdout:5/956: symlink d0/d6/d12/d108/l14c 0 2024-04-16T14:35:43.682 INFO:tasks.workunit.client.0.smithi005.stdout:5/957: creat d0/d6/f14d x:0 0 0 2024-04-16T14:35:43.682 INFO:tasks.workunit.client.0.smithi005.stdout:0/727: symlink da/df/d26/d39/lf2 0 2024-04-16T14:35:43.683 INFO:tasks.workunit.client.1.smithi115.stdout:0/557: rename d6/d10/f55 to d6/d10/d12/d1f/d36/d4b/fc0 0 2024-04-16T14:35:43.685 INFO:tasks.workunit.client.1.smithi115.stdout:1/714: creat df/d13/d4d/d68/da0/ff1 x:0 0 0 2024-04-16T14:35:43.686 INFO:tasks.workunit.client.1.smithi115.stdout:0/558: write d6/d10/d12/fb0 [122646,15358] 0 2024-04-16T14:35:43.688 INFO:tasks.workunit.client.0.smithi005.stdout:0/728: dread da/df/d1b/d3a/d53/f61 [0,4194304] 0 2024-04-16T14:35:43.689 INFO:tasks.workunit.client.1.smithi115.stdout:1/715: rename df/d36/d94/dc4 to df/d35/d84/ddc/de0/df2 0 2024-04-16T14:35:43.689 INFO:tasks.workunit.client.1.smithi115.stdout:1/716: write df/d35/d48/f4c [820089,6412] 0 2024-04-16T14:35:43.689 INFO:tasks.workunit.client.0.smithi005.stdout:0/729: mknod da/cf3 0 2024-04-16T14:35:43.689 INFO:tasks.workunit.client.0.smithi005.stdout:0/730: getdents da/df/d1b/d24/d75 0 2024-04-16T14:35:43.690 INFO:tasks.workunit.client.1.smithi115.stdout:0/559: creat d6/d10/dae/fc1 x:0 0 0 2024-04-16T14:35:43.690 INFO:tasks.workunit.client.0.smithi005.stdout:0/731: rename da/df to da/df/d26/df4 22 2024-04-16T14:35:43.692 INFO:tasks.workunit.client.0.smithi005.stdout:7/984: dwrite d1/dc/d2f/f83 [0,4194304] 0 2024-04-16T14:35:43.693 INFO:tasks.workunit.client.1.smithi115.stdout:1/717: rename df/d35/d48/lc8 to df/d13/d4d/d68/de7/dbe/lf3 0 2024-04-16T14:35:43.695 INFO:tasks.workunit.client.0.smithi005.stdout:5/958: write d0/d6/d12/dc0/d6d/f8e [2580264,44534] 0 2024-04-16T14:35:43.698 INFO:tasks.workunit.client.1.smithi115.stdout:2/812: dwrite d0/d47/d65/dad/dc8/d24/d23/ffe [0,4194304] 0 2024-04-16T14:35:43.699 INFO:tasks.workunit.client.0.smithi005.stdout:5/959: unlink d0/d6/d12/dc0/d30/d97/f141 0 2024-04-16T14:35:43.701 INFO:tasks.workunit.client.0.smithi005.stdout:5/960: truncate d0/d6/d12/fcf 4066063 0 2024-04-16T14:35:43.708 INFO:tasks.workunit.client.1.smithi115.stdout:2/813: link d0/d47/d65/dad/dbb/d11/dbc/ceb d0/d47/d65/dad/dbb/d11/d25/c104 0 2024-04-16T14:35:43.708 INFO:tasks.workunit.client.1.smithi115.stdout:2/814: chown d0/d47/d65 2095760151 1 2024-04-16T14:35:43.710 INFO:tasks.workunit.client.0.smithi005.stdout:9/631: dwrite d3/f25 [0,4194304] 0 2024-04-16T14:35:43.710 INFO:tasks.workunit.client.0.smithi005.stdout:9/632: stat d3/d49/d4b/la5 0 2024-04-16T14:35:43.713 INFO:tasks.workunit.client.0.smithi005.stdout:9/633: mkdir d3/d49/d4b/d5c/d65/d9a/da9/db4 0 2024-04-16T14:35:43.715 INFO:tasks.workunit.client.0.smithi005.stdout:9/634: creat d3/d12/d2b/fb5 x:0 0 0 2024-04-16T14:35:43.715 INFO:tasks.workunit.client.0.smithi005.stdout:3/855: dwrite d2/d17/d46/d75/d9b/dbd/dee/f12b [0,4194304] 0 2024-04-16T14:35:43.715 INFO:tasks.workunit.client.0.smithi005.stdout:3/856: creat d2/d9/d25/d39/f12f x:0 0 0 2024-04-16T14:35:43.716 INFO:tasks.workunit.client.0.smithi005.stdout:5/961: dread d0/d6/d12/dc0/d30/fd5 [0,4194304] 0 2024-04-16T14:35:43.716 INFO:tasks.workunit.client.0.smithi005.stdout:9/635: mknod d3/d12/d16/d46/d47/cb6 0 2024-04-16T14:35:43.721 INFO:tasks.workunit.client.0.smithi005.stdout:3/857: creat d2/d17/d102/d129/f130 x:0 0 0 2024-04-16T14:35:43.723 INFO:tasks.workunit.client.0.smithi005.stdout:5/962: mkdir d0/d6/d12/dc0/d42/d14e 0 2024-04-16T14:35:43.731 INFO:tasks.workunit.client.0.smithi005.stdout:9/636: unlink d3/d12/c97 0 2024-04-16T14:35:43.732 INFO:tasks.workunit.client.0.smithi005.stdout:9/637: dread - d3/d12/d16/d46/fa7 zero size 2024-04-16T14:35:43.732 INFO:tasks.workunit.client.1.smithi115.stdout:2/815: read d0/d47/d65/d61/f92 [942684,93062] 0 2024-04-16T14:35:43.732 INFO:tasks.workunit.client.1.smithi115.stdout:2/816: fsync d0/d47/d65/dad/dbb/d11/fde 0 2024-04-16T14:35:43.732 INFO:tasks.workunit.client.1.smithi115.stdout:2/817: read - d0/d47/d65/dad/dbb/d11/f88 zero size 2024-04-16T14:35:43.732 INFO:tasks.workunit.client.1.smithi115.stdout:2/818: readlink d0/d47/d65/dad/dc8/d24/d23/d80/le6 0 2024-04-16T14:35:43.733 INFO:tasks.workunit.client.1.smithi115.stdout:2/819: rename d0/l6 to d0/d47/d65/dad/dbb/d11/d25/d95/l105 0 2024-04-16T14:35:43.734 INFO:tasks.workunit.client.1.smithi115.stdout:2/820: readlink d0/d47/d65/dad/dc8/d24/d23/d80/ldc 0 2024-04-16T14:35:43.736 INFO:tasks.workunit.client.1.smithi115.stdout:2/821: mknod d0/d47/d65/dad/dbb/d11/c106 0 2024-04-16T14:35:43.736 INFO:tasks.workunit.client.1.smithi115.stdout:2/822: read d0/d47/d65/dad/dc8/f7 [1100012,58384] 0 2024-04-16T14:35:43.737 INFO:tasks.workunit.client.0.smithi005.stdout:2/693: dwrite d0/d1c/d39/d85/da2/db0/fe2 [0,4194304] 0 2024-04-16T14:35:43.737 INFO:tasks.workunit.client.1.smithi115.stdout:4/632: dwrite d1/d15/d17/f21 [0,4194304] 0 2024-04-16T14:35:43.737 INFO:tasks.workunit.client.1.smithi115.stdout:4/633: truncate d1/f96 779068 0 2024-04-16T14:35:43.737 INFO:tasks.workunit.client.1.smithi115.stdout:0/560: dwrite d6/d10/d12/d31/d35/d9b/f66 [0,4194304] 0 2024-04-16T14:35:43.740 INFO:tasks.workunit.client.0.smithi005.stdout:3/858: rmdir d2/d17/d46/d75/d6d/d122 0 2024-04-16T14:35:43.740 INFO:tasks.workunit.client.0.smithi005.stdout:3/859: creat d2/d17/f131 x:0 0 0 2024-04-16T14:35:43.740 INFO:tasks.workunit.client.0.smithi005.stdout:3/860: chown d2/d9/f105 1029256 1 2024-04-16T14:35:43.741 INFO:tasks.workunit.client.0.smithi005.stdout:3/861: read - d2/d17/d46/d75/d6d/ffe zero size 2024-04-16T14:35:43.741 INFO:tasks.workunit.client.0.smithi005.stdout:5/963: mknod d0/d6/d12/dc0/d6d/c14f 0 2024-04-16T14:35:43.741 INFO:tasks.workunit.client.0.smithi005.stdout:5/964: readlink d0/d6/d6e/d9e/lbe 0 2024-04-16T14:35:43.742 INFO:tasks.workunit.client.0.smithi005.stdout:9/638: creat d3/d49/d4b/d5c/d65/d9a/daf/fb7 x:0 0 0 2024-04-16T14:35:43.743 INFO:tasks.workunit.client.0.smithi005.stdout:9/639: stat d3/d12/d16/d46 0 2024-04-16T14:35:43.743 INFO:tasks.workunit.client.0.smithi005.stdout:0/732: dwrite da/df/d1b/fa5 [0,4194304] 0 2024-04-16T14:35:43.743 INFO:tasks.workunit.client.0.smithi005.stdout:0/733: chown da/df/d1b/d3a/d53/d5a/d99/ld6 1 1 2024-04-16T14:35:43.746 INFO:tasks.workunit.client.0.smithi005.stdout:7/985: dwrite d1/dc/d2f/d4f/f146 [0,4194304] 0 2024-04-16T14:35:43.746 INFO:tasks.workunit.client.0.smithi005.stdout:3/862: unlink d2/d17/f76 0 2024-04-16T14:35:43.746 INFO:tasks.workunit.client.0.smithi005.stdout:3/863: stat d2/d17/d46/d75/d9b/f113 0 2024-04-16T14:35:43.749 INFO:tasks.workunit.client.1.smithi115.stdout:2/823: dread d0/d1b/f99 [0,4194304] 0 2024-04-16T14:35:43.751 INFO:tasks.workunit.client.0.smithi005.stdout:9/640: dread d3/f3c [0,4194304] 0 2024-04-16T14:35:43.751 INFO:tasks.workunit.client.0.smithi005.stdout:9/641: readlink d3/d49/d4b/l74 0 2024-04-16T14:35:43.751 INFO:tasks.workunit.client.0.smithi005.stdout:9/642: stat d3/d12/d16/l20 0 2024-04-16T14:35:43.751 INFO:tasks.workunit.client.0.smithi005.stdout:9/643: write d3/d12/d16/d46/d47/d60/f6a [2750110,115149] 0 2024-04-16T14:35:43.752 INFO:tasks.workunit.client.1.smithi115.stdout:4/634: dread d1/d2/ff [0,4194304] 0 2024-04-16T14:35:43.752 INFO:tasks.workunit.client.1.smithi115.stdout:1/718: dwrite df/d13/d4d/d3e/d75/f7e [0,4194304] 0 2024-04-16T14:35:43.753 INFO:tasks.workunit.client.1.smithi115.stdout:2/824: rename d0/d47/d65/d61/d70/lb6 to d0/d47/d65/dad/dc8/d24/d23/d83/l107 0 2024-04-16T14:35:43.753 INFO:tasks.workunit.client.1.smithi115.stdout:2/825: write d0/d47/d65/d61/dae/ffd [1022738,109741] 0 2024-04-16T14:35:43.753 INFO:tasks.workunit.client.0.smithi005.stdout:7/986: truncate d1/d49/d74/d77/d57/d47/faf 22644 0 2024-04-16T14:35:43.754 INFO:tasks.workunit.client.0.smithi005.stdout:3/864: rmdir d2/d9/df/dbf/df8 39 2024-04-16T14:35:43.754 INFO:tasks.workunit.client.0.smithi005.stdout:7/987: dread d1/d49/d74/d77/d57/f7b [0,4194304] 0 2024-04-16T14:35:43.755 INFO:tasks.workunit.client.0.smithi005.stdout:9/644: creat d3/d49/d4b/d5c/fb8 x:0 0 0 2024-04-16T14:35:43.757 INFO:tasks.workunit.client.0.smithi005.stdout:7/988: creat d1/d49/d74/d77/d57/d47/d8e/f147 x:0 0 0 2024-04-16T14:35:43.758 INFO:tasks.workunit.client.1.smithi115.stdout:4/635: mknod d1/d15/d31/cbc 0 2024-04-16T14:35:43.759 INFO:tasks.workunit.client.0.smithi005.stdout:9/645: truncate d3/f3c 3398834 0 2024-04-16T14:35:43.760 INFO:tasks.workunit.client.0.smithi005.stdout:9/646: stat d3/d49/d4b/d55/d7b/cb2 0 2024-04-16T14:35:43.760 INFO:tasks.workunit.client.1.smithi115.stdout:1/719: symlink df/d35/d84/ddc/lf4 0 2024-04-16T14:35:43.761 INFO:tasks.workunit.client.0.smithi005.stdout:9/647: creat d3/d12/fb9 x:0 0 0 2024-04-16T14:35:43.763 INFO:tasks.workunit.client.1.smithi115.stdout:2/826: mknod d0/d47/d65/dad/dc8/d24/d23/c108 0 2024-04-16T14:35:43.765 INFO:tasks.workunit.client.0.smithi005.stdout:5/965: dwrite d0/d6/d12/d1c/d1e/d73/f12e [0,4194304] 0 2024-04-16T14:35:43.766 INFO:tasks.workunit.client.1.smithi115.stdout:1/720: mkdir df/d13/dc3/df5 0 2024-04-16T14:35:43.766 INFO:tasks.workunit.client.1.smithi115.stdout:1/721: write df/d13/f74 [2452428,22675] 0 2024-04-16T14:35:43.766 INFO:tasks.workunit.client.0.smithi005.stdout:9/648: write d3/fa2 [286393,37714] 0 2024-04-16T14:35:43.768 INFO:tasks.workunit.client.0.smithi005.stdout:7/989: read d1/f6f [2797280,81607] 0 2024-04-16T14:35:43.768 INFO:tasks.workunit.client.0.smithi005.stdout:7/990: dread - d1/d85/d96/f99 zero size 2024-04-16T14:35:43.769 INFO:tasks.workunit.client.1.smithi115.stdout:2/827: link d0/d47/d65/dad/dbb/f37 d0/d47/d65/dad/dc8/d24/d23/d80/f109 0 2024-04-16T14:35:43.771 INFO:tasks.workunit.client.0.smithi005.stdout:0/734: dwrite da/df/d1b/d24/d75/d81/fec [0,4194304] 0 2024-04-16T14:35:43.773 INFO:tasks.workunit.client.1.smithi115.stdout:2/828: symlink d0/d47/d65/dad/l10a 0 2024-04-16T14:35:43.775 INFO:tasks.workunit.client.0.smithi005.stdout:2/694: getdents d0/d2a/d3a/d46 0 2024-04-16T14:35:43.775 INFO:tasks.workunit.client.0.smithi005.stdout:2/695: chown d0/d1c/d59/d7a/d84/f9f 52 1 2024-04-16T14:35:43.777 INFO:tasks.workunit.client.0.smithi005.stdout:5/966: dread d0/d70/fa7 [0,4194304] 0 2024-04-16T14:35:43.781 INFO:tasks.workunit.client.0.smithi005.stdout:0/735: link da/f2d da/df/d1b/d24/ff5 0 2024-04-16T14:35:43.786 INFO:tasks.workunit.client.0.smithi005.stdout:0/736: creat da/df/d26/d39/ff6 x:0 0 0 2024-04-16T14:35:43.787 INFO:tasks.workunit.client.0.smithi005.stdout:0/737: getdents da/df/d26/da9/dcb/dd7 0 2024-04-16T14:35:43.788 INFO:tasks.workunit.client.0.smithi005.stdout:3/865: dwrite d2/d9/f53 [0,4194304] 0 2024-04-16T14:35:43.790 INFO:tasks.workunit.client.0.smithi005.stdout:3/866: creat d2/d17/d46/d75/d41/d124/f132 x:0 0 0 2024-04-16T14:35:43.792 INFO:tasks.workunit.client.0.smithi005.stdout:0/738: getdents da/df/d1b/d3a/d53/d5a/d99 0 2024-04-16T14:35:43.794 INFO:tasks.workunit.client.0.smithi005.stdout:3/867: symlink d2/d9/d25/l133 0 2024-04-16T14:35:43.795 INFO:tasks.workunit.client.0.smithi005.stdout:5/967: read d0/d70/fe6 [3259409,46564] 0 2024-04-16T14:35:43.796 INFO:tasks.workunit.client.0.smithi005.stdout:0/739: mkdir da/df/df7 0 2024-04-16T14:35:43.797 INFO:tasks.workunit.client.0.smithi005.stdout:0/740: chown da/df/d50 586813 1 2024-04-16T14:35:43.797 INFO:tasks.workunit.client.0.smithi005.stdout:0/741: readlink da/df/d1b/d24/de7/l8b 0 2024-04-16T14:35:43.797 INFO:tasks.workunit.client.0.smithi005.stdout:5/968: creat d0/d6/d103/f150 x:0 0 0 2024-04-16T14:35:43.798 INFO:tasks.workunit.client.0.smithi005.stdout:0/742: mkdir da/df/d26/d39/d55/df8 0 2024-04-16T14:35:43.800 INFO:tasks.workunit.client.0.smithi005.stdout:0/743: symlink da/df/df7/lf9 0 2024-04-16T14:35:43.804 INFO:tasks.workunit.client.0.smithi005.stdout:0/744: link da/df/d50/c51 da/df/d26/cfa 0 2024-04-16T14:35:43.806 INFO:tasks.workunit.client.0.smithi005.stdout:0/745: unlink da/df/l86 0 2024-04-16T14:35:43.806 INFO:tasks.workunit.client.1.smithi115.stdout:4/636: dwrite d1/d15/d24/f40 [0,4194304] 0 2024-04-16T14:35:43.808 INFO:tasks.workunit.client.1.smithi115.stdout:4/637: creat d1/d15/d24/d83/fbd x:0 0 0 2024-04-16T14:35:43.813 INFO:tasks.workunit.client.0.smithi005.stdout:3/868: write d2/d9/df/dbf/df8/f85 [1935190,86291] 0 2024-04-16T14:35:43.815 INFO:tasks.workunit.client.0.smithi005.stdout:3/869: creat d2/d17/d46/d75/d6d/df3/f134 x:0 0 0 2024-04-16T14:35:43.815 INFO:tasks.workunit.client.0.smithi005.stdout:3/870: write d2/d9/f10d [371289,77612] 0 2024-04-16T14:35:43.815 INFO:tasks.workunit.client.0.smithi005.stdout:3/871: chown d2/d9/df/l13 89 1 2024-04-16T14:35:43.816 INFO:tasks.workunit.client.1.smithi115.stdout:1/722: dwrite df/d36/d94/fa4 [0,4194304] 0 2024-04-16T14:35:43.816 INFO:tasks.workunit.client.1.smithi115.stdout:1/723: write df/d36/d94/dbf/fea [1044581,41141] 0 2024-04-16T14:35:43.816 INFO:tasks.workunit.client.1.smithi115.stdout:1/724: fsync df/d13/d4d/d2c/f3b 0 2024-04-16T14:35:43.816 INFO:tasks.workunit.client.1.smithi115.stdout:1/725: write df/f14 [270085,90671] 0 2024-04-16T14:35:43.817 INFO:tasks.workunit.client.0.smithi005.stdout:2/696: dwrite d0/d4/fc0 [0,4194304] 0 2024-04-16T14:35:43.818 INFO:tasks.workunit.client.1.smithi115.stdout:1/726: getdents df/d13/d72 0 2024-04-16T14:35:43.819 INFO:tasks.workunit.client.0.smithi005.stdout:2/697: mkdir d0/d29/d3e/dd2/de8 0 2024-04-16T14:35:43.819 INFO:tasks.workunit.client.0.smithi005.stdout:2/698: fsync d0/d2a/f63 0 2024-04-16T14:35:43.820 INFO:tasks.workunit.client.1.smithi115.stdout:4/638: dread d1/d15/d24/f66 [0,4194304] 0 2024-04-16T14:35:43.821 INFO:tasks.workunit.client.0.smithi005.stdout:7/991: dwrite d1/d49/d74/d77/d22/db0/dc6/f105 [0,4194304] 0 2024-04-16T14:35:43.821 INFO:tasks.workunit.client.0.smithi005.stdout:7/992: dread - d1/dc/d2f/dbd/f122 zero size 2024-04-16T14:35:43.821 INFO:tasks.workunit.client.0.smithi005.stdout:7/993: truncate d1/d49/d74/d77/d22/da0/fb2 115487 0 2024-04-16T14:35:43.821 INFO:tasks.workunit.client.0.smithi005.stdout:9/649: dwrite d3/d12/d16/d46/f9b [0,4194304] 0 2024-04-16T14:35:43.821 INFO:tasks.workunit.client.0.smithi005.stdout:9/650: chown d3/d12/d16/d46/d47/c7c 1 1 2024-04-16T14:35:43.822 INFO:tasks.workunit.client.0.smithi005.stdout:9/651: fdatasync d3/d49/d4b/d55/f9f 0 2024-04-16T14:35:43.822 INFO:tasks.workunit.client.0.smithi005.stdout:9/652: truncate d3/d49/d4b/d5c/fb8 22733 0 2024-04-16T14:35:43.823 INFO:tasks.workunit.client.0.smithi005.stdout:2/699: unlink d0/d1c/f83 0 2024-04-16T14:35:43.823 INFO:tasks.workunit.client.0.smithi005.stdout:2/700: chown d0/d2a/d3a/d46/cb8 54752069 1 2024-04-16T14:35:43.824 INFO:tasks.workunit.client.0.smithi005.stdout:5/969: dwrite d0/d6/d12/f45 [0,4194304] 0 2024-04-16T14:35:43.824 INFO:tasks.workunit.client.0.smithi005.stdout:5/970: write d0/d6/d12/f14 [1002652,7221] 0 2024-04-16T14:35:43.825 INFO:tasks.workunit.client.0.smithi005.stdout:9/653: dread d3/f81 [0,4194304] 0 2024-04-16T14:35:43.825 INFO:tasks.workunit.client.0.smithi005.stdout:2/701: dread d0/d1c/d59/f92 [0,4194304] 0 2024-04-16T14:35:43.826 INFO:tasks.workunit.client.0.smithi005.stdout:0/746: dwrite da/df/f65 [0,4194304] 0 2024-04-16T14:35:43.827 INFO:tasks.workunit.client.0.smithi005.stdout:7/994: unlink d1/d49/d74/d77/d22/db0/l107 0 2024-04-16T14:35:43.827 INFO:tasks.workunit.client.0.smithi005.stdout:7/995: fsync d1/dc/f7d 0 2024-04-16T14:35:43.827 INFO:tasks.workunit.client.0.smithi005.stdout:7/996: dread d1/d49/d74/d77/d22/da0/fb2 [0,4194304] 0 2024-04-16T14:35:43.827 INFO:tasks.workunit.client.0.smithi005.stdout:7/997: chown d1/d49/d74/d77/d57 3069881 1 2024-04-16T14:35:43.827 INFO:tasks.workunit.client.0.smithi005.stdout:7/998: dread - d1/d8a/f121 zero size 2024-04-16T14:35:43.828 INFO:tasks.workunit.client.1.smithi115.stdout:1/727: dread df/d13/d4d/d2c/f21 [0,4194304] 0 2024-04-16T14:35:43.832 INFO:tasks.workunit.client.0.smithi005.stdout:9/654: creat d3/d49/d4b/d55/d7b/fba x:0 0 0 2024-04-16T14:35:43.832 INFO:tasks.workunit.client.0.smithi005.stdout:9/655: write d3/f8a [612975,80080] 0 2024-04-16T14:35:43.832 INFO:tasks.workunit.client.1.smithi115.stdout:1/728: link df/d13/d4d/d3e/d75/da9/lbb df/d13/d72/lf6 0 2024-04-16T14:35:43.832 INFO:tasks.workunit.client.1.smithi115.stdout:1/729: chown df/d13/d4d/d6d 3 1 2024-04-16T14:35:43.833 INFO:tasks.workunit.client.0.smithi005.stdout:2/702: symlink d0/d29/d89/de3/le9 0 2024-04-16T14:35:43.835 INFO:tasks.workunit.client.0.smithi005.stdout:0/747: creat da/ffb x:0 0 0 2024-04-16T14:35:43.835 INFO:tasks.workunit.client.0.smithi005.stdout:5/971: dread d0/d6/d12/d1c/d81/d82/f88 [0,4194304] 0 2024-04-16T14:35:43.837 INFO:tasks.workunit.client.0.smithi005.stdout:9/656: rename d3/d12/d16/f19 to d3/d49/d4b/d5c/d65/d9a/fbb 0 2024-04-16T14:35:43.837 INFO:tasks.workunit.client.0.smithi005.stdout:9/657: chown d3/f81 619245 1 2024-04-16T14:35:43.839 INFO:tasks.workunit.client.0.smithi005.stdout:0/748: unlink da/f32 0 2024-04-16T14:35:43.841 INFO:tasks.workunit.client.0.smithi005.stdout:5/972: symlink d0/d70/dea/l151 0 2024-04-16T14:35:43.841 INFO:tasks.workunit.client.0.smithi005.stdout:5/973: write d0/d6/d12/dc0/d42/fc8 [3787391,38120] 0 2024-04-16T14:35:43.843 INFO:tasks.workunit.client.0.smithi005.stdout:9/658: mknod d3/d12/d9d/cbc 0 2024-04-16T14:35:43.843 INFO:tasks.workunit.client.0.smithi005.stdout:7/999: write d1/d49/d74/d77/d57/f4a [7806969,126485] 0 2024-04-16T14:35:43.847 INFO:tasks.workunit.client.0.smithi005.stdout:5/974: creat d0/d6/d12/dc0/d30/f152 x:0 0 0 2024-04-16T14:35:43.849 INFO:tasks.workunit.client.0.smithi005.stdout:2/703: write d0/d1c/d59/d67/fce [763743,112092] 0 2024-04-16T14:35:43.858 INFO:tasks.workunit.client.0.smithi005.stdout:2/704: truncate d0/f2 673354 0 2024-04-16T14:35:43.858 INFO:tasks.workunit.client.1.smithi115.stdout:4/639: dwrite d1/d15/d31/d42/d46/f8c [0,4194304] 0 2024-04-16T14:35:43.858 INFO:tasks.workunit.client.1.smithi115.stdout:4/640: dread - d1/d15/d17/f92 zero size 2024-04-16T14:35:43.859 INFO:tasks.workunit.client.0.smithi005.stdout:3/872: dwrite d2/d9/df/dbf/f103 [0,4194304] 0 2024-04-16T14:35:43.861 INFO:tasks.workunit.client.1.smithi115.stdout:1/730: dwrite df/d13/d4d/d6d/fb2 [4194304,4194304] 0 2024-04-16T14:35:43.862 INFO:tasks.workunit.client.0.smithi005.stdout:9/659: fdatasync d3/f8a 0 2024-04-16T14:35:43.862 INFO:tasks.workunit.client.0.smithi005.stdout:5/975: dwrite d0/d6/d6e/d9e/f117 [4194304,4194304] 0 2024-04-16T14:35:43.870 INFO:tasks.workunit.client.0.smithi005.stdout:3/873: dread d2/d17/d46/d75/d9b/dbd/dee/f11e [0,4194304] 0 2024-04-16T14:35:43.873 INFO:tasks.workunit.client.1.smithi115.stdout:4/641: dread d1/d15/d31/d42/d46/f63 [0,4194304] 0 2024-04-16T14:35:43.880 INFO:tasks.workunit.client.0.smithi005.stdout:9/660: dwrite d3/d49/f66 [0,4194304] 0 2024-04-16T14:35:43.882 INFO:tasks.workunit.client.0.smithi005.stdout:2/705: rename d0/d2a/d3a/f95 to d0/d29/d89/de3/fea 0 2024-04-16T14:35:43.882 INFO:tasks.workunit.client.0.smithi005.stdout:2/706: chown d0/d1c/d59/d7a/d84/fbc 0 1 2024-04-16T14:35:43.890 INFO:tasks.workunit.client.0.smithi005.stdout:9/661: dread d3/d49/d4b/d55/f78 [0,4194304] 0 2024-04-16T14:35:43.903 INFO:tasks.workunit.client.1.smithi115.stdout:3/703: rename dc/l9c to dc/d24/d36/lea 0 2024-04-16T14:35:43.909 INFO:tasks.workunit.client.1.smithi115.stdout:1/731: symlink df/d13/d4d/d6d/lf7 0 2024-04-16T14:35:43.909 INFO:tasks.workunit.client.0.smithi005.stdout:9/662: dwrite d3/d49/d4b/d55/f57 [4194304,4194304] 0 2024-04-16T14:35:43.910 INFO:tasks.workunit.client.1.smithi115.stdout:4/642: mkdir d1/d15/d17/d9e/dbe 0 2024-04-16T14:35:43.911 INFO:tasks.workunit.client.1.smithi115.stdout:1/732: rename df/d13/d4d/d3e/d75/dda/fa6 to df/d36/ff8 0 2024-04-16T14:35:43.912 INFO:tasks.workunit.client.1.smithi115.stdout:4/643: mknod d1/d15/d31/d42/d46/cbf 0 2024-04-16T14:35:43.912 INFO:tasks.workunit.client.1.smithi115.stdout:4/644: chown d1/f96 25002405 1 2024-04-16T14:35:43.912 INFO:tasks.workunit.client.1.smithi115.stdout:1/733: creat df/d13/ff9 x:0 0 0 2024-04-16T14:35:43.913 INFO:tasks.workunit.client.1.smithi115.stdout:4/645: mkdir d1/d15/d31/d42/da4/dc0 0 2024-04-16T14:35:43.913 INFO:tasks.workunit.client.1.smithi115.stdout:4/646: read - d1/d15/d17/f80 zero size 2024-04-16T14:35:43.914 INFO:tasks.workunit.client.1.smithi115.stdout:4/647: rename d1/d15/d1e/f65 to d1/d15/d31/d42/da4/dc0/fc1 0 2024-04-16T14:35:43.915 INFO:tasks.workunit.client.1.smithi115.stdout:4/648: mkdir d1/d15/d31/dc2 0 2024-04-16T14:35:43.916 INFO:tasks.workunit.client.1.smithi115.stdout:4/649: fdatasync d1/d15/d31/d55/f85 0 2024-04-16T14:35:43.916 INFO:tasks.workunit.client.1.smithi115.stdout:4/650: creat d1/d15/d17/d9e/dbe/fc3 x:0 0 0 2024-04-16T14:35:43.916 INFO:tasks.workunit.client.1.smithi115.stdout:4/651: chown d1/d15/d1e/l39 252 1 2024-04-16T14:35:43.917 INFO:tasks.workunit.client.1.smithi115.stdout:4/652: rmdir d1/d15/d31/db3 0 2024-04-16T14:35:43.918 INFO:tasks.workunit.client.1.smithi115.stdout:4/653: rmdir d1/d2 39 2024-04-16T14:35:43.918 INFO:tasks.workunit.client.1.smithi115.stdout:4/654: read - d1/d2/fa0 zero size 2024-04-16T14:35:43.918 INFO:tasks.workunit.client.1.smithi115.stdout:4/655: truncate d1/d15/d31/d42/f4a 443689 0 2024-04-16T14:35:43.921 INFO:tasks.workunit.client.1.smithi115.stdout:4/656: creat d1/d15/d17/d9e/fc4 x:0 0 0 2024-04-16T14:35:43.921 INFO:tasks.workunit.client.1.smithi115.stdout:3/704: creat dc/d24/d33/d4b/da3/d69/de1/feb x:0 0 0 2024-04-16T14:35:43.921 INFO:tasks.workunit.client.1.smithi115.stdout:3/705: write dc/d29/f48 [3991413,17744] 0 2024-04-16T14:35:43.923 INFO:tasks.workunit.client.1.smithi115.stdout:4/657: mknod d1/d15/d31/cc5 0 2024-04-16T14:35:43.924 INFO:tasks.workunit.client.1.smithi115.stdout:1/734: dread df/d13/d4d/d6d/f86 [4194304,4194304] 0 2024-04-16T14:35:43.925 INFO:tasks.workunit.client.1.smithi115.stdout:8/709: dwrite d0/db/f26 [0,4194304] 0 2024-04-16T14:35:43.925 INFO:tasks.workunit.client.0.smithi005.stdout:5/976: truncate d0/d6/d12/dc0/d8d/d5e/fbc 462558 0 2024-04-16T14:35:43.925 INFO:tasks.workunit.client.0.smithi005.stdout:5/977: write d0/d6/d12/d1c/f13a [919945,28015] 0 2024-04-16T14:35:43.925 INFO:tasks.workunit.client.0.smithi005.stdout:5/978: fsync d0/d70/db3/fed 0 2024-04-16T14:35:43.926 INFO:tasks.workunit.client.1.smithi115.stdout:3/706: creat dc/d29/d39/fec x:0 0 0 2024-04-16T14:35:43.926 INFO:tasks.workunit.client.1.smithi115.stdout:3/707: dread - dc/d29/d39/fec zero size 2024-04-16T14:35:43.927 INFO:tasks.workunit.client.0.smithi005.stdout:3/874: symlink d2/d17/d46/d75/d9b/dbd/dee/d12d/l135 0 2024-04-16T14:35:43.932 INFO:tasks.workunit.client.1.smithi115.stdout:8/710: creat d0/db/d10/d17/d2c/d52/d74/fe7 x:0 0 0 2024-04-16T14:35:43.934 INFO:tasks.workunit.client.1.smithi115.stdout:3/708: mknod dc/d24/d36/ced 0 2024-04-16T14:35:43.935 INFO:tasks.workunit.client.0.smithi005.stdout:5/979: dread d0/d70/db3/fb1 [0,4194304] 0 2024-04-16T14:35:43.938 INFO:tasks.workunit.client.1.smithi115.stdout:3/709: rename dc/d24/d33/d4b/dd3/dd9 to dc/d29/d39/d86/dd0/dee 0 2024-04-16T14:35:43.939 INFO:tasks.workunit.client.0.smithi005.stdout:9/663: mknod d3/d49/d4b/d5c/d65/d9a/da9/db4/cbd 0 2024-04-16T14:35:43.940 INFO:tasks.workunit.client.1.smithi115.stdout:3/710: creat dc/d29/d39/fef x:0 0 0 2024-04-16T14:35:43.940 INFO:tasks.workunit.client.1.smithi115.stdout:3/711: chown dc/d24/f82 50530961 1 2024-04-16T14:35:43.941 INFO:tasks.workunit.client.0.smithi005.stdout:2/707: getdents d0/d1c/d59/d7a 0 2024-04-16T14:35:43.941 INFO:tasks.workunit.client.0.smithi005.stdout:2/708: creat d0/d29/d89/feb x:0 0 0 2024-04-16T14:35:43.941 INFO:tasks.workunit.client.1.smithi115.stdout:8/711: write d0/db/d10/d17/d22/f32 [4736224,80012] 0 2024-04-16T14:35:43.942 INFO:tasks.workunit.client.0.smithi005.stdout:5/980: unlink d0/faf 0 2024-04-16T14:35:43.942 INFO:tasks.workunit.client.0.smithi005.stdout:5/981: chown d0/d6/d12/dc0/d30/d97 13174 1 2024-04-16T14:35:43.944 INFO:tasks.workunit.client.0.smithi005.stdout:9/664: rename d3/d77/l99 to d3/d49/d4b/d55/d7b/lbe 0 2024-04-16T14:35:43.947 INFO:tasks.workunit.client.1.smithi115.stdout:3/712: getdents dc/d24/d33/d4b/da3/d69/de1 0 2024-04-16T14:35:43.947 INFO:tasks.workunit.client.1.smithi115.stdout:3/713: fsync dc/d29/f7b 0 2024-04-16T14:35:43.949 INFO:tasks.workunit.client.1.smithi115.stdout:8/712: mkdir d0/db/d10/de8 0 2024-04-16T14:35:43.949 INFO:tasks.workunit.client.1.smithi115.stdout:8/713: chown d0/db/d10/d17/d2c/d52/d84/f90 138 1 2024-04-16T14:35:43.950 INFO:tasks.workunit.client.0.smithi005.stdout:5/982: getdents d0/d6/d6e/d9e/da9 0 2024-04-16T14:35:43.952 INFO:tasks.workunit.client.1.smithi115.stdout:8/714: mkdir d0/db/dbb/dcd/dae/dde/de9 0 2024-04-16T14:35:43.954 INFO:tasks.workunit.client.1.smithi115.stdout:3/714: dread dc/f1a [0,4194304] 0 2024-04-16T14:35:43.965 INFO:tasks.workunit.client.1.smithi115.stdout:3/715: dread dc/d29/f34 [0,4194304] 0 2024-04-16T14:35:43.966 INFO:tasks.workunit.client.1.smithi115.stdout:3/716: chown dc/d29/d4d/d56/f58 0 1 2024-04-16T14:35:43.968 INFO:tasks.workunit.client.0.smithi005.stdout:2/709: write d0/d29/d3e/f71 [3402979,83111] 0 2024-04-16T14:35:43.970 INFO:tasks.workunit.client.1.smithi115.stdout:3/717: dread dc/d29/d39/d86/fe9 [0,4194304] 0 2024-04-16T14:35:43.970 INFO:tasks.workunit.client.1.smithi115.stdout:3/718: dread - dc/d29/d4d/fc5 zero size 2024-04-16T14:35:43.970 INFO:tasks.workunit.client.1.smithi115.stdout:3/719: write f6 [2909678,87261] 0 2024-04-16T14:35:43.971 INFO:tasks.workunit.client.1.smithi115.stdout:3/720: dread - dc/d29/d4d/d56/d98/dbe/faa zero size 2024-04-16T14:35:43.972 INFO:tasks.workunit.client.1.smithi115.stdout:3/721: unlink dc/d24/d36/d60/dae/cc1 0 2024-04-16T14:35:43.973 INFO:tasks.workunit.client.1.smithi115.stdout:3/722: mknod dc/d29/cf0 0 2024-04-16T14:35:43.974 INFO:tasks.workunit.client.1.smithi115.stdout:3/723: creat dc/d24/d33/d4b/da3/d69/de1/ff1 x:0 0 0 2024-04-16T14:35:43.974 INFO:tasks.workunit.client.1.smithi115.stdout:3/724: creat dc/d29/d39/ff2 x:0 0 0 2024-04-16T14:35:43.976 INFO:tasks.workunit.client.1.smithi115.stdout:3/725: rename dc/d24/d33/d4b/d81/f92 to dc/d24/d36/d60/ff3 0 2024-04-16T14:35:43.976 INFO:tasks.workunit.client.1.smithi115.stdout:3/726: getdents dc/d24/d33/d4b/dd3 0 2024-04-16T14:35:43.976 INFO:tasks.workunit.client.1.smithi115.stdout:3/727: stat dc/f21 0 2024-04-16T14:35:43.983 INFO:tasks.workunit.client.0.smithi005.stdout:9/665: dwrite d3/d12/d16/f51 [0,4194304] 0 2024-04-16T14:35:43.984 INFO:tasks.workunit.client.0.smithi005.stdout:5/983: dwrite d0/f52 [0,4194304] 0 2024-04-16T14:35:43.984 INFO:tasks.workunit.client.0.smithi005.stdout:9/666: mkdir d3/d12/d16/d46/d47/db1/dbf 0 2024-04-16T14:35:43.985 INFO:tasks.workunit.client.0.smithi005.stdout:5/984: truncate d0/d6/d12/dc0/f5a 1209749 0 2024-04-16T14:35:43.985 INFO:tasks.workunit.client.0.smithi005.stdout:5/985: stat d0/d6/d12/de4/f102 0 2024-04-16T14:35:43.986 INFO:tasks.workunit.client.0.smithi005.stdout:9/667: rmdir d3/d12/d16/d86 39 2024-04-16T14:35:43.986 INFO:tasks.workunit.client.1.smithi115.stdout:8/715: dwrite d0/db/d10/d17/d2c/d52/d6c/db8/d6b/fb0 [0,4194304] 0 2024-04-16T14:35:43.986 INFO:tasks.workunit.client.1.smithi115.stdout:8/716: dread - d0/db/d10/d17/d2c/d52/d74/fe7 zero size 2024-04-16T14:35:43.986 INFO:tasks.workunit.client.0.smithi005.stdout:5/986: creat d0/dfa/f153 x:0 0 0 2024-04-16T14:35:43.987 INFO:tasks.workunit.client.1.smithi115.stdout:8/717: creat d0/db/dbb/dcd/dae/dde/de9/fea x:0 0 0 2024-04-16T14:35:43.988 INFO:tasks.workunit.client.1.smithi115.stdout:8/718: chown d0/db/d10/d17/f72 6586 1 2024-04-16T14:35:43.988 INFO:tasks.workunit.client.1.smithi115.stdout:8/719: dread - d0/db/d10/d17/fd0 zero size 2024-04-16T14:35:43.988 INFO:tasks.workunit.client.0.smithi005.stdout:9/668: creat d3/d49/d4b/d5c/d65/d9a/fc0 x:0 0 0 2024-04-16T14:35:43.992 INFO:tasks.workunit.client.0.smithi005.stdout:5/987: creat d0/d70/f154 x:0 0 0 2024-04-16T14:35:43.994 INFO:tasks.workunit.client.0.smithi005.stdout:5/988: truncate d0/d6/d12/dc0/d6d/f8e 4169353 0 2024-04-16T14:35:43.994 INFO:tasks.workunit.client.0.smithi005.stdout:5/989: write d0/d6/d12/f14 [3313927,129706] 0 2024-04-16T14:35:43.996 INFO:tasks.workunit.client.1.smithi115.stdout:8/720: rename d0/db/d10/d25 to d0/db/d10/d17/d22/deb 0 2024-04-16T14:35:43.996 INFO:tasks.workunit.client.0.smithi005.stdout:5/990: mkdir d0/d6/d6e/d11d/d155 0 2024-04-16T14:35:43.997 INFO:tasks.workunit.client.0.smithi005.stdout:5/991: chown d0/dfa/l120 543 1 2024-04-16T14:35:43.999 INFO:tasks.workunit.client.0.smithi005.stdout:5/992: mkdir d0/d156 0 2024-04-16T14:35:44.000 INFO:tasks.workunit.client.0.smithi005.stdout:5/993: mknod d0/d6/d12/dc0/d30/d97/c157 0 2024-04-16T14:35:44.001 INFO:tasks.workunit.client.0.smithi005.stdout:5/994: chown d0/dd1/f145 1 1 2024-04-16T14:35:44.010 INFO:tasks.workunit.client.1.smithi115.stdout:8/721: dwrite d0/db/d10/d17/d2c/d52/dcc/fe6 [0,4194304] 0 2024-04-16T14:35:44.014 INFO:tasks.workunit.client.1.smithi115.stdout:8/722: symlink d0/db/d10/d17/d2c/lec 0 2024-04-16T14:35:44.014 INFO:tasks.workunit.client.1.smithi115.stdout:8/723: chown d0/db/d10/c4a 733 1 2024-04-16T14:35:44.014 INFO:tasks.workunit.client.1.smithi115.stdout:8/724: write d0/db/d10/d17/d2c/f60 [8536346,90036] 0 2024-04-16T14:35:44.015 INFO:tasks.workunit.client.0.smithi005.stdout:5/995: write d0/d6/d6e/db8/fdd [1818811,63754] 0 2024-04-16T14:35:44.017 INFO:tasks.workunit.client.0.smithi005.stdout:5/996: link d0/d6/d12/f14 d0/d6/d103/d111/f158 0 2024-04-16T14:35:44.017 INFO:tasks.workunit.client.0.smithi005.stdout:5/997: chown d0/d6/d6e/db8 3 1 2024-04-16T14:35:44.018 INFO:tasks.workunit.client.0.smithi005.stdout:5/998: mkdir d0/d6/d12/d1c/d1e/d73/df0/d159 0 2024-04-16T14:35:44.019 INFO:tasks.workunit.client.0.smithi005.stdout:5/999: mknod d0/d6/d12/dc0/d8d/dd8/c15a 0 2024-04-16T14:35:44.025 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:43 smithi005 ceph-mon[28964]: pgmap v26: 65 pgs: 65 active+clean; 2.3 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 270 MiB/s rd, 317 MiB/s wr, 692 op/s 2024-04-16T14:35:44.025 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:43 smithi005 ceph-mon[28964]: fsmap cephfs:2 {0=cephfs.smithi005.wofqlz=up:active,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:35:44.028 INFO:tasks.workunit.client.1.smithi115.stdout:8/725: dwrite d0/db/d10/d17/d2c/d52/dcc/fe6 [0,4194304] 0 2024-04-16T14:35:44.029 INFO:tasks.workunit.client.1.smithi115.stdout:8/726: mknod d0/db/dbb/ced 0 2024-04-16T14:35:44.029 INFO:tasks.workunit.client.1.smithi115.stdout:8/727: chown d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/f86 1912523 1 2024-04-16T14:35:44.030 INFO:tasks.workunit.client.1.smithi115.stdout:8/728: chown d0/de5 73817 1 2024-04-16T14:35:44.030 INFO:tasks.workunit.client.1.smithi115.stdout:8/729: write d0/da5/fce [788047,99890] 0 2024-04-16T14:35:44.030 INFO:tasks.workunit.client.1.smithi115.stdout:8/730: mkdir d0/db/d10/d17/d2c/d52/d6c/d71/dee 0 2024-04-16T14:35:44.030 INFO:tasks.workunit.client.1.smithi115.stdout:8/731: creat d0/db/d10/d17/d2c/d52/d6c/db8/d7d/fef x:0 0 0 2024-04-16T14:35:44.033 INFO:tasks.workunit.client.1.smithi115.stdout:8/732: mkdir d0/db/d10/d17/d22/deb/d7c/dc0/df0 0 2024-04-16T14:35:44.033 INFO:tasks.workunit.client.1.smithi115.stdout:8/733: mknod d0/db/d10/d17/d2c/d85/cf1 0 2024-04-16T14:35:44.034 INFO:tasks.workunit.client.1.smithi115.stdout:8/734: mkdir d0/db/dbb/dcd/dc4/df2 0 2024-04-16T14:35:44.034 INFO:tasks.workunit.client.1.smithi115.stdout:8/735: read d0/db/d10/d17/d2c/d52/d84/f90 [110066,71113] 0 2024-04-16T14:35:44.035 INFO:tasks.workunit.client.1.smithi115.stdout:8/736: write d0/db/d10/d17/d2c/d52/d6c/db8/d64/f68 [605607,89773] 0 2024-04-16T14:35:44.036 INFO:tasks.workunit.client.1.smithi115.stdout:8/737: write d0/db/f24 [209441,121988] 0 2024-04-16T14:35:44.047 INFO:tasks.workunit.client.1.smithi115.stdout:4/658: dwrite d1/d15/f64 [0,4194304] 0 2024-04-16T14:35:44.048 INFO:tasks.workunit.client.0.smithi005.stdout:3/875: dwrite d2/d9/d5e/fb6 [0,4194304] 0 2024-04-16T14:35:44.050 INFO:tasks.workunit.client.0.smithi005.stdout:3/876: creat d2/d9/d7d/f136 x:0 0 0 2024-04-16T14:35:44.050 INFO:tasks.workunit.client.0.smithi005.stdout:3/877: fdatasync d2/d17/d46/d75/d9b/fbc 0 2024-04-16T14:35:44.052 INFO:tasks.workunit.client.1.smithi115.stdout:3/728: dwrite dc/f15 [0,4194304] 0 2024-04-16T14:35:44.053 INFO:tasks.workunit.client.0.smithi005.stdout:3/878: mkdir d2/d17/d46/d75/d6d/df3/d137 0 2024-04-16T14:35:44.053 INFO:tasks.workunit.client.1.smithi115.stdout:3/729: creat dc/d24/d33/ff4 x:0 0 0 2024-04-16T14:35:44.053 INFO:tasks.workunit.client.1.smithi115.stdout:3/730: truncate dc/d29/f7f 4269177 0 2024-04-16T14:35:44.054 INFO:tasks.workunit.client.0.smithi005.stdout:3/879: mknod d2/d17/d46/d47/deb/c138 0 2024-04-16T14:35:44.056 INFO:tasks.workunit.client.1.smithi115.stdout:3/731: readlink dc/d29/d39/l3c 0 2024-04-16T14:35:44.058 INFO:tasks.workunit.client.1.smithi115.stdout:8/738: dwrite d0/db/d10/d17/d22/f6f [0,4194304] 0 2024-04-16T14:35:44.058 INFO:tasks.workunit.client.1.smithi115.stdout:3/732: creat dc/d24/d33/d4b/da3/d69/ff5 x:0 0 0 2024-04-16T14:35:44.058 INFO:tasks.workunit.client.1.smithi115.stdout:4/659: write d1/d15/d17/fa9 [3798476,98690] 0 2024-04-16T14:35:44.060 INFO:tasks.workunit.client.1.smithi115.stdout:8/739: mknod d0/db/d10/d17/d2c/d85/cf3 0 2024-04-16T14:35:44.060 INFO:tasks.workunit.client.0.smithi005.stdout:2/710: dwrite d0/d1c/d59/d7a/fda [0,4194304] 0 2024-04-16T14:35:44.060 INFO:tasks.workunit.client.1.smithi115.stdout:4/660: mkdir d1/d15/d24/dc6 0 2024-04-16T14:35:44.061 INFO:tasks.workunit.client.1.smithi115.stdout:3/733: symlink dc/d29/d39/d86/dd0/lf6 0 2024-04-16T14:35:44.061 INFO:tasks.workunit.client.1.smithi115.stdout:3/734: chown dc/f16 5 1 2024-04-16T14:35:44.067 INFO:tasks.workunit.client.0.smithi005.stdout:2/711: creat d0/d29/d3e/fec x:0 0 0 2024-04-16T14:35:44.079 INFO:tasks.workunit.client.1.smithi115.stdout:8/740: creat d0/db/d10/d17/d2c/d52/d6c/db8/d6b/ff4 x:0 0 0 2024-04-16T14:35:44.081 INFO:tasks.workunit.client.1.smithi115.stdout:3/735: unlink dc/d24/fad 0 2024-04-16T14:35:44.084 INFO:tasks.workunit.client.1.smithi115.stdout:3/736: creat dc/d29/d4d/d56/d98/dbe/ff7 x:0 0 0 2024-04-16T14:35:44.084 INFO:tasks.workunit.client.1.smithi115.stdout:3/737: truncate dc/f3d 1571547 0 2024-04-16T14:35:44.084 INFO:tasks.workunit.client.1.smithi115.stdout:3/738: fsync dc/d29/f85 0 2024-04-16T14:35:44.089 INFO:tasks.workunit.client.1.smithi115.stdout:0/561: sync 2024-04-16T14:35:44.089 INFO:tasks.workunit.client.1.smithi115.stdout:5/662: sync 2024-04-16T14:35:44.089 INFO:tasks.workunit.client.1.smithi115.stdout:6/686: sync 2024-04-16T14:35:44.089 INFO:tasks.workunit.client.1.smithi115.stdout:9/723: sync 2024-04-16T14:35:44.089 INFO:tasks.workunit.client.1.smithi115.stdout:7/600: sync 2024-04-16T14:35:44.089 INFO:tasks.workunit.client.1.smithi115.stdout:2/829: sync 2024-04-16T14:35:44.089 INFO:tasks.workunit.client.1.smithi115.stdout:6/687: chown d13/d1d/d2b/d5f/d30/d43/da6/faf 1243 1 2024-04-16T14:35:44.089 INFO:tasks.workunit.client.1.smithi115.stdout:6/688: creat d13/d1d/d52/d8c/fe3 x:0 0 0 2024-04-16T14:35:44.090 INFO:tasks.workunit.client.0.smithi005.stdout:2/712: dwrite d0/d2a/f63 [0,4194304] 0 2024-04-16T14:35:44.090 INFO:tasks.workunit.client.1.smithi115.stdout:4/661: dwrite d1/d15/d31/d42/f93 [0,4194304] 0 2024-04-16T14:35:44.090 INFO:tasks.workunit.client.1.smithi115.stdout:0/562: mknod d6/d10/d12/d31/cc2 0 2024-04-16T14:35:44.092 INFO:tasks.workunit.client.1.smithi115.stdout:5/663: symlink dc/d15/d35/d69/lc9 0 2024-04-16T14:35:44.094 INFO:tasks.workunit.client.1.smithi115.stdout:4/662: write d1/d2/ff [4569352,45048] 0 2024-04-16T14:35:44.094 INFO:tasks.workunit.client.1.smithi115.stdout:4/663: chown d1/d15/d17/c52 77319246 1 2024-04-16T14:35:44.094 INFO:tasks.workunit.client.1.smithi115.stdout:4/664: chown d1/d15/d1e/f81 0 1 2024-04-16T14:35:44.094 INFO:tasks.workunit.client.1.smithi115.stdout:4/665: truncate d1/d15/d31/f99 465061 0 2024-04-16T14:35:44.095 INFO:tasks.workunit.client.1.smithi115.stdout:4/666: creat d1/d15/d17/fc7 x:0 0 0 2024-04-16T14:35:44.095 INFO:tasks.workunit.client.1.smithi115.stdout:4/667: chown d1/d15/d31/d42/d46/l59 5 1 2024-04-16T14:35:44.095 INFO:tasks.workunit.client.1.smithi115.stdout:9/724: rename d1/ca7 to d1/d6/d2d/d4b/d8f/d91/cff 0 2024-04-16T14:35:44.095 INFO:tasks.workunit.client.1.smithi115.stdout:9/725: readlink d1/d6/d2d/d3d/d49/l73 0 2024-04-16T14:35:44.097 INFO:tasks.workunit.client.1.smithi115.stdout:2/830: dread d0/d47/d65/dad/dc8/ff [0,4194304] 0 2024-04-16T14:35:44.100 INFO:tasks.workunit.client.1.smithi115.stdout:4/668: link d1/d15/d78/f7d d1/d15/d31/d42/d46/fc8 0 2024-04-16T14:35:44.102 INFO:tasks.workunit.client.1.smithi115.stdout:2/831: getdents d0/d47/d65/dad/dc8 0 2024-04-16T14:35:44.102 INFO:tasks.workunit.client.1.smithi115.stdout:2/832: chown d0/d47/d65/ff0 383 1 2024-04-16T14:35:44.103 INFO:tasks.workunit.client.1.smithi115.stdout:4/669: mknod d1/d15/d31/d42/da4/dc0/cc9 0 2024-04-16T14:35:44.105 INFO:tasks.workunit.client.1.smithi115.stdout:4/670: rename d1/d2/c10 to d1/d15/d31/d42/db4/cca 0 2024-04-16T14:35:44.105 INFO:tasks.workunit.client.1.smithi115.stdout:4/671: fdatasync d1/d2/fa0 0 2024-04-16T14:35:44.105 INFO:tasks.workunit.client.1.smithi115.stdout:4/672: symlink d1/d2/lcb 0 2024-04-16T14:35:44.106 INFO:tasks.workunit.client.1.smithi115.stdout:0/563: dread d6/d10/d12/d31/f39 [4194304,4194304] 0 2024-04-16T14:35:44.107 INFO:tasks.workunit.client.1.smithi115.stdout:4/673: mkdir d1/d15/d31/d42/d8b/dcc 0 2024-04-16T14:35:44.114 INFO:tasks.workunit.client.1.smithi115.stdout:9/726: dread d1/d6/d2d/f1c [0,4194304] 0 2024-04-16T14:35:44.115 INFO:tasks.workunit.client.0.smithi005.stdout:2/713: dwrite d0/d1c/d59/d7a/d84/fae [0,4194304] 0 2024-04-16T14:35:44.115 INFO:tasks.workunit.client.1.smithi115.stdout:7/601: dwrite d0/d24/da3/db1/d3f/db0/f89 [0,4194304] 0 2024-04-16T14:35:44.116 INFO:tasks.workunit.client.1.smithi115.stdout:9/727: mkdir d1/d6/de0/d100 0 2024-04-16T14:35:44.119 INFO:tasks.workunit.client.1.smithi115.stdout:2/833: write d0/d47/d65/fec [1941096,116647] 0 2024-04-16T14:35:44.119 INFO:tasks.workunit.client.1.smithi115.stdout:2/834: creat d0/d47/d65/dad/dbb/d11/f10b x:0 0 0 2024-04-16T14:35:44.119 INFO:tasks.workunit.client.1.smithi115.stdout:6/689: dwrite d13/d1d/d2b/d5f/d30/d43/da6/f6b [0,4194304] 0 2024-04-16T14:35:44.119 INFO:tasks.workunit.client.1.smithi115.stdout:6/690: read d13/fb1 [322561,32988] 0 2024-04-16T14:35:44.121 INFO:tasks.workunit.client.1.smithi115.stdout:7/602: creat d0/d2/d3a/d30/d6b/da2/fca x:0 0 0 2024-04-16T14:35:44.121 INFO:tasks.workunit.client.1.smithi115.stdout:7/603: creat d0/d2/d3a/d30/d6b/fcb x:0 0 0 2024-04-16T14:35:44.122 INFO:tasks.workunit.client.1.smithi115.stdout:7/604: truncate d0/d1/fc9 182437 0 2024-04-16T14:35:44.123 INFO:tasks.workunit.client.1.smithi115.stdout:1/735: sync 2024-04-16T14:35:44.124 INFO:tasks.workunit.client.1.smithi115.stdout:5/664: dwrite dc/d5d/d81/f9d [4194304,4194304] 0 2024-04-16T14:35:44.124 INFO:tasks.workunit.client.1.smithi115.stdout:5/665: write dc/d15/f17 [1564750,62830] 0 2024-04-16T14:35:44.124 INFO:tasks.workunit.client.1.smithi115.stdout:5/666: chown dc/f26 19164 1 2024-04-16T14:35:44.133 INFO:tasks.workunit.client.1.smithi115.stdout:1/736: write df/f12 [2210769,97679] 0 2024-04-16T14:35:44.135 INFO:tasks.workunit.client.1.smithi115.stdout:1/737: creat df/ffa x:0 0 0 2024-04-16T14:35:44.137 INFO:tasks.workunit.client.1.smithi115.stdout:1/738: symlink df/d13/d4d/d3e/d75/lfb 0 2024-04-16T14:35:44.137 INFO:tasks.workunit.client.1.smithi115.stdout:6/691: dread d13/d1d/d47/fa3 [0,4194304] 0 2024-04-16T14:35:44.137 INFO:tasks.workunit.client.1.smithi115.stdout:6/692: write d13/d1d/d2b/d5b/fc2 [405615,41129] 0 2024-04-16T14:35:44.138 INFO:tasks.workunit.client.1.smithi115.stdout:1/739: mkdir df/d13/d4d/d3e/d75/dfc 0 2024-04-16T14:35:44.138 INFO:tasks.workunit.client.1.smithi115.stdout:1/740: dread - df/d13/d4d/d68/da0/ff1 zero size 2024-04-16T14:35:44.141 INFO:tasks.workunit.client.1.smithi115.stdout:6/693: rename d13/d1d/d47/daa to d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/de4 0 2024-04-16T14:35:44.143 INFO:tasks.workunit.client.1.smithi115.stdout:1/741: rmdir df/d13/dc3/df5 0 2024-04-16T14:35:44.143 INFO:tasks.workunit.client.1.smithi115.stdout:1/742: fdatasync df/d13/d4d/d6d/f73 0 2024-04-16T14:35:44.143 INFO:tasks.workunit.client.1.smithi115.stdout:6/694: dread d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/fb6 [0,4194304] 0 2024-04-16T14:35:44.144 INFO:tasks.workunit.client.1.smithi115.stdout:6/695: dread - d13/d1d/d2b/d5f/d30/d43/fd8 zero size 2024-04-16T14:35:44.144 INFO:tasks.workunit.client.1.smithi115.stdout:6/696: write d13/d1d/d2b/d5f/d30/d43/da6/f6b [4623590,47690] 0 2024-04-16T14:35:44.145 INFO:tasks.workunit.client.1.smithi115.stdout:6/697: link d13/d1d/d52/d8c/fc7 d13/d1d/d2b/d5f/d30/d43/da6/d5a/fe5 0 2024-04-16T14:35:44.147 INFO:tasks.workunit.client.1.smithi115.stdout:6/698: symlink d13/d1d/d52/d8c/le6 0 2024-04-16T14:35:44.147 INFO:tasks.workunit.client.1.smithi115.stdout:6/699: write f8 [102752,26290] 0 2024-04-16T14:35:44.149 INFO:tasks.workunit.client.1.smithi115.stdout:6/700: creat d13/d1d/d47/fe7 x:0 0 0 2024-04-16T14:35:44.154 INFO:tasks.workunit.client.1.smithi115.stdout:6/701: read fc [361259,38839] 0 2024-04-16T14:35:44.155 INFO:tasks.workunit.client.1.smithi115.stdout:6/702: creat d13/d1d/fe8 x:0 0 0 2024-04-16T14:35:44.156 INFO:tasks.workunit.client.1.smithi115.stdout:6/703: link d13/d1d/d52/d8c/fc3 d13/d1d/d2b/d5f/d30/d43/da6/d5a/fe9 0 2024-04-16T14:35:44.157 INFO:tasks.workunit.client.1.smithi115.stdout:6/704: creat d13/d1d/d2b/d5f/d30/d43/da6/d5a/fea x:0 0 0 2024-04-16T14:35:44.157 INFO:tasks.workunit.client.1.smithi115.stdout:6/705: readlink d13/l38 0 2024-04-16T14:35:44.158 INFO:tasks.workunit.client.1.smithi115.stdout:6/706: creat d13/d1d/d52/feb x:0 0 0 2024-04-16T14:35:44.159 INFO:tasks.workunit.client.1.smithi115.stdout:6/707: unlink d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/f29 0 2024-04-16T14:35:44.160 INFO:tasks.workunit.client.1.smithi115.stdout:6/708: mknod d13/d1d/d2b/d5b/cec 0 2024-04-16T14:35:44.166 INFO:tasks.workunit.client.1.smithi115.stdout:5/667: dwrite dc/d3d/fc5 [0,4194304] 0 2024-04-16T14:35:44.166 INFO:tasks.workunit.client.1.smithi115.stdout:5/668: fsync dc/f12 0 2024-04-16T14:35:44.167 INFO:tasks.workunit.client.1.smithi115.stdout:0/564: dwrite d6/f4f [0,4194304] 0 2024-04-16T14:35:44.168 INFO:tasks.workunit.client.1.smithi115.stdout:0/565: chown d6/d10/d12/d1f/d36/c56 11298 1 2024-04-16T14:35:44.169 INFO:tasks.workunit.client.1.smithi115.stdout:4/674: dwrite d1/d15/d17/f26 [8388608,4194304] 0 2024-04-16T14:35:44.169 INFO:tasks.workunit.client.1.smithi115.stdout:5/669: rename dc/f3b to dc/d5d/d81/d9a/da3/fca 0 2024-04-16T14:35:44.178 INFO:tasks.workunit.client.1.smithi115.stdout:2/835: dwrite d0/d47/d65/dad/dbb/d11/f88 [0,4194304] 0 2024-04-16T14:35:44.181 INFO:tasks.workunit.client.1.smithi115.stdout:9/728: dwrite d1/d6/d29/f32 [8388608,4194304] 0 2024-04-16T14:35:44.181 INFO:tasks.workunit.client.1.smithi115.stdout:1/743: dwrite df/d35/f65 [0,4194304] 0 2024-04-16T14:35:44.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:43 smithi115 ceph-mon[37295]: pgmap v26: 65 pgs: 65 active+clean; 2.3 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 270 MiB/s rd, 317 MiB/s wr, 692 op/s 2024-04-16T14:35:44.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:43 smithi115 ceph-mon[37295]: fsmap cephfs:2 {0=cephfs.smithi005.wofqlz=up:active,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:35:44.182 INFO:tasks.workunit.client.1.smithi115.stdout:2/836: creat d0/d47/d65/dad/dc8/d24/f10c x:0 0 0 2024-04-16T14:35:44.182 INFO:tasks.workunit.client.1.smithi115.stdout:2/837: truncate d0/d47/d65/dad/dbb/d11/d25/fda 1059763 0 2024-04-16T14:35:44.182 INFO:tasks.workunit.client.1.smithi115.stdout:2/838: fsync d0/d47/f7f 0 2024-04-16T14:35:44.182 INFO:tasks.workunit.client.1.smithi115.stdout:2/839: write d0/d47/d65/dad/dbb/d11/d36/fc3 [2928810,95537] 0 2024-04-16T14:35:44.183 INFO:tasks.workunit.client.1.smithi115.stdout:1/744: read df/d35/d48/f4c [28217,117173] 0 2024-04-16T14:35:44.186 INFO:tasks.workunit.client.1.smithi115.stdout:2/840: creat d0/d47/d65/dad/dc8/d24/d23/d83/de7/f10d x:0 0 0 2024-04-16T14:35:44.186 INFO:tasks.workunit.client.1.smithi115.stdout:2/841: write d0/d47/d65/dad/f56 [4810624,70129] 0 2024-04-16T14:35:44.190 INFO:tasks.workunit.client.1.smithi115.stdout:6/709: dwrite d13/d1d/d52/d8c/f98 [0,4194304] 0 2024-04-16T14:35:44.190 INFO:tasks.workunit.client.1.smithi115.stdout:6/710: fsync d13/d1d/d68/f9a 0 2024-04-16T14:35:44.192 INFO:tasks.workunit.client.1.smithi115.stdout:0/566: dwrite d6/d10/dae/fc1 [0,4194304] 0 2024-04-16T14:35:44.192 INFO:tasks.workunit.client.1.smithi115.stdout:5/670: dwrite dc/d3d/f7e [0,4194304] 0 2024-04-16T14:35:44.192 INFO:tasks.workunit.client.1.smithi115.stdout:7/605: dwrite d0/d24/da3/db1/d3f/db0/fb8 [0,4194304] 0 2024-04-16T14:35:44.194 INFO:tasks.workunit.client.1.smithi115.stdout:9/729: dread d1/d6/d2d/fc7 [4194304,4194304] 0 2024-04-16T14:35:44.194 INFO:tasks.workunit.client.1.smithi115.stdout:2/842: creat d0/d47/dc9/f10e x:0 0 0 2024-04-16T14:35:44.195 INFO:tasks.workunit.client.1.smithi115.stdout:1/745: rename df/l5c to df/d13/d4d/d6d/dc5/lfd 0 2024-04-16T14:35:44.195 INFO:tasks.workunit.client.1.smithi115.stdout:7/606: rename d0/d24 to d0/d24/d2b/dcc 22 2024-04-16T14:35:44.196 INFO:tasks.workunit.client.1.smithi115.stdout:7/607: write d0/d2/d3a/d30/d6b/fcb [815537,67311] 0 2024-04-16T14:35:44.199 INFO:tasks.workunit.client.1.smithi115.stdout:6/711: mkdir d13/d1d/d49/ded 0 2024-04-16T14:35:44.199 INFO:tasks.workunit.client.1.smithi115.stdout:6/712: stat d13/d1d/d2b/d5f/d30/c61 0 2024-04-16T14:35:44.199 INFO:tasks.workunit.client.1.smithi115.stdout:6/713: chown d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/d55/fcc 13 1 2024-04-16T14:35:44.201 INFO:tasks.workunit.client.1.smithi115.stdout:0/567: write d6/d10/d94/fa5 [513486,95831] 0 2024-04-16T14:35:44.204 INFO:tasks.workunit.client.1.smithi115.stdout:1/746: dread df/f12 [0,4194304] 0 2024-04-16T14:35:44.209 INFO:tasks.workunit.client.1.smithi115.stdout:0/568: dread d6/d10/d12/d1f/d36/fa2 [0,4194304] 0 2024-04-16T14:35:44.209 INFO:tasks.workunit.client.1.smithi115.stdout:0/569: stat d6/d10/d12/d1f/d36/d4b/f5c 0 2024-04-16T14:35:44.210 INFO:tasks.workunit.client.1.smithi115.stdout:0/570: write d6/d10/d12/d1f/d36/fb2 [202264,12597] 0 2024-04-16T14:35:44.218 INFO:tasks.workunit.client.1.smithi115.stdout:6/714: dwrite d13/d1d/d2b/d5f/d30/d43/da6/d5a/fad [0,4194304] 0 2024-04-16T14:35:44.218 INFO:tasks.workunit.client.1.smithi115.stdout:7/608: dwrite d0/d2/d3a/f33 [0,4194304] 0 2024-04-16T14:35:44.218 INFO:tasks.workunit.client.1.smithi115.stdout:7/609: write d0/d2/d3a/fc0 [306865,24360] 0 2024-04-16T14:35:44.218 INFO:tasks.workunit.client.1.smithi115.stdout:7/610: write d0/d24/d2b/d9c/faa [1272157,885] 0 2024-04-16T14:35:44.218 INFO:tasks.workunit.client.1.smithi115.stdout:7/611: write d0/fa5 [1959996,103603] 0 2024-04-16T14:35:44.219 INFO:tasks.workunit.client.1.smithi115.stdout:9/730: mknod d1/d6/d2d/d4b/d6c/c101 0 2024-04-16T14:35:44.220 INFO:tasks.workunit.client.1.smithi115.stdout:2/843: mknod d0/d47/dc9/c10f 0 2024-04-16T14:35:44.222 INFO:tasks.workunit.client.1.smithi115.stdout:1/747: creat df/d13/d4d/d68/de7/dbe/ffe x:0 0 0 2024-04-16T14:35:44.223 INFO:tasks.workunit.client.1.smithi115.stdout:1/748: fdatasync df/d13/d4d/d3e/d75/dda/fce 0 2024-04-16T14:35:44.223 INFO:tasks.workunit.client.1.smithi115.stdout:0/571: rmdir d6/d10/d12/d1f/d36/d4b 39 2024-04-16T14:35:44.225 INFO:tasks.workunit.client.1.smithi115.stdout:5/671: link dc/d5d/d81/fa9 dc/d3d/d68/fcb 0 2024-04-16T14:35:44.226 INFO:tasks.workunit.client.1.smithi115.stdout:5/672: write dc/d3d/d68/fcb [1694938,51265] 0 2024-04-16T14:35:44.229 INFO:tasks.workunit.client.1.smithi115.stdout:6/715: creat d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/fee x:0 0 0 2024-04-16T14:35:44.234 INFO:tasks.workunit.client.1.smithi115.stdout:9/731: mknod d1/d6/d2d/d4b/d6c/d20/df4/c102 0 2024-04-16T14:35:44.235 INFO:tasks.workunit.client.1.smithi115.stdout:2/844: link d0/d47/d65/dad/dbb/d11/d36/l5f d0/d47/d65/dad/dc8/d24/d10/l110 0 2024-04-16T14:35:44.237 INFO:tasks.workunit.client.1.smithi115.stdout:1/749: mkdir df/d36/dff 0 2024-04-16T14:35:44.241 INFO:tasks.workunit.client.1.smithi115.stdout:9/732: truncate d1/fd4 273204 0 2024-04-16T14:35:44.242 INFO:tasks.workunit.client.1.smithi115.stdout:2/845: stat d0/d1b/c49 0 2024-04-16T14:35:44.243 INFO:tasks.workunit.client.1.smithi115.stdout:7/612: dwrite d0/d2/d3a/d30/f32 [0,4194304] 0 2024-04-16T14:35:44.243 INFO:tasks.workunit.client.1.smithi115.stdout:0/572: dwrite d6/d10/d12/d1f/d36/d4b/d6d/f3d [0,4194304] 0 2024-04-16T14:35:44.243 INFO:tasks.workunit.client.1.smithi115.stdout:1/750: creat df/d36/dff/f100 x:0 0 0 2024-04-16T14:35:44.243 INFO:tasks.workunit.client.1.smithi115.stdout:0/573: chown d6/d10/d12/d1f/d36/d4b/d6d/l9e 5179 1 2024-04-16T14:35:44.244 INFO:tasks.workunit.client.1.smithi115.stdout:5/673: mknod dc/d3d/d41/ccc 0 2024-04-16T14:35:44.245 INFO:tasks.workunit.client.1.smithi115.stdout:9/733: mknod d1/d6/d2d/d4b/d6c/d20/d36/dce/c103 0 2024-04-16T14:35:44.246 INFO:tasks.workunit.client.1.smithi115.stdout:2/846: symlink d0/d47/d65/dad/dc8/d24/d21/l111 0 2024-04-16T14:35:44.246 INFO:tasks.workunit.client.1.smithi115.stdout:2/847: read d0/d47/d65/dad/dc8/faa [569364,110370] 0 2024-04-16T14:35:44.246 INFO:tasks.workunit.client.1.smithi115.stdout:2/848: stat d0/d47/d65/dad/l10a 0 2024-04-16T14:35:44.249 INFO:tasks.workunit.client.1.smithi115.stdout:7/613: unlink d0/d24/da3/db1/l72 0 2024-04-16T14:35:44.249 INFO:tasks.workunit.client.1.smithi115.stdout:7/614: creat d0/d24/da3/db1/d3f/db0/fcd x:0 0 0 2024-04-16T14:35:44.252 INFO:tasks.workunit.client.1.smithi115.stdout:1/751: dread df/d35/f67 [0,4194304] 0 2024-04-16T14:35:44.252 INFO:tasks.workunit.client.1.smithi115.stdout:1/752: getdents df/d35 0 2024-04-16T14:35:44.254 INFO:tasks.workunit.client.1.smithi115.stdout:0/574: symlink d6/d10/d71/db7/lc3 0 2024-04-16T14:35:44.255 INFO:tasks.workunit.client.1.smithi115.stdout:5/674: write dc/d15/f27 [4742309,74895] 0 2024-04-16T14:35:44.255 INFO:tasks.workunit.client.1.smithi115.stdout:5/675: truncate dc/d3d/d41/f95 4568972 0 2024-04-16T14:35:44.257 INFO:tasks.workunit.client.1.smithi115.stdout:9/734: truncate d1/d6/d2d/d4b/d6c/f44 1670470 0 2024-04-16T14:35:44.259 INFO:tasks.workunit.client.1.smithi115.stdout:2/849: link d0/d47/d65/d61/c8a d0/d47/d65/dad/dc8/d24/c112 0 2024-04-16T14:35:44.259 INFO:tasks.workunit.client.1.smithi115.stdout:2/850: write d0/d47/d65/dad/dc8/d24/d10/f7e [756111,23564] 0 2024-04-16T14:35:44.261 INFO:tasks.workunit.client.1.smithi115.stdout:1/753: rename df/d35/f67 to df/d2d/f101 0 2024-04-16T14:35:44.262 INFO:tasks.workunit.client.1.smithi115.stdout:0/575: getdents d6/d10/d12/d1f/d36/d4b/d6d/d7a 0 2024-04-16T14:35:44.264 INFO:tasks.workunit.client.1.smithi115.stdout:9/735: rmdir d1/d6/de0 39 2024-04-16T14:35:44.264 INFO:tasks.workunit.client.1.smithi115.stdout:1/754: dread df/d13/d4d/d3e/d75/da9/db7/fc1 [0,4194304] 0 2024-04-16T14:35:44.265 INFO:tasks.workunit.client.1.smithi115.stdout:7/615: truncate d0/d24/d2b/d9c/faa 342072 0 2024-04-16T14:35:44.265 INFO:tasks.workunit.client.1.smithi115.stdout:7/616: fsync d0/d24/da3/db1/d3f/fae 0 2024-04-16T14:35:44.266 INFO:tasks.workunit.client.1.smithi115.stdout:9/736: mknod d1/d6/d2d/d4b/d8f/d91/dda/ddd/de8/dfe/c104 0 2024-04-16T14:35:44.267 INFO:tasks.workunit.client.1.smithi115.stdout:1/755: symlink df/d13/l102 0 2024-04-16T14:35:44.269 INFO:tasks.workunit.client.1.smithi115.stdout:7/617: truncate d0/d2/d3a/d30/d6b/f84 1594625 0 2024-04-16T14:35:44.269 INFO:tasks.workunit.client.1.smithi115.stdout:7/618: fdatasync d0/fb7 0 2024-04-16T14:35:44.269 INFO:tasks.workunit.client.1.smithi115.stdout:7/619: fdatasync d0/d24/fb3 0 2024-04-16T14:35:44.272 INFO:tasks.workunit.client.1.smithi115.stdout:0/576: dread d6/f4f [0,4194304] 0 2024-04-16T14:35:44.272 INFO:tasks.workunit.client.1.smithi115.stdout:0/577: chown d6/d54/f6b 2793041 1 2024-04-16T14:35:44.274 INFO:tasks.workunit.client.1.smithi115.stdout:5/676: dwrite dc/d15/d2d/f67 [4194304,4194304] 0 2024-04-16T14:35:44.275 INFO:tasks.workunit.client.1.smithi115.stdout:3/739: sync 2024-04-16T14:35:44.275 INFO:tasks.workunit.client.1.smithi115.stdout:8/741: sync 2024-04-16T14:35:44.276 INFO:tasks.workunit.client.1.smithi115.stdout:8/742: truncate d0/db/d10/d17/d2c/d52/d6c/db8/d64/d83/da2/fd1 700932 0 2024-04-16T14:35:44.276 INFO:tasks.workunit.client.1.smithi115.stdout:1/756: symlink df/d13/d4d/d68/l103 0 2024-04-16T14:35:44.278 INFO:tasks.workunit.client.1.smithi115.stdout:5/677: creat dc/d15/fcd x:0 0 0 2024-04-16T14:35:44.278 INFO:tasks.workunit.client.1.smithi115.stdout:3/740: symlink dc/d29/d4d/d56/d98/lf8 0 2024-04-16T14:35:44.279 INFO:tasks.workunit.client.1.smithi115.stdout:5/678: link dc/d5d/d8f/ca8 dc/d15/d35/d71/cce 0 2024-04-16T14:35:44.282 INFO:tasks.workunit.client.1.smithi115.stdout:8/743: link d0/db/d10/d17/d2c/lec d0/db/dbb/dcd/dc4/lf5 0 2024-04-16T14:35:44.283 INFO:tasks.workunit.client.1.smithi115.stdout:9/737: rename d1/d6/d2d/d4b/d60/fbb to d1/d6/de0/f105 0 2024-04-16T14:35:44.284 INFO:tasks.workunit.client.1.smithi115.stdout:3/741: symlink dc/d29/d4d/d56/d98/dbe/dd6/lf9 0 2024-04-16T14:35:44.284 INFO:tasks.workunit.client.1.smithi115.stdout:3/742: fdatasync dc/d29/d39/d86/f89 0 2024-04-16T14:35:44.286 INFO:tasks.workunit.client.1.smithi115.stdout:1/757: rename df/d2d/l1f to df/d13/d4d/d3e/d7d/l104 0 2024-04-16T14:35:44.286 INFO:tasks.workunit.client.1.smithi115.stdout:1/758: fsync df/d13/d4d/d68/f71 0 2024-04-16T14:35:44.288 INFO:tasks.workunit.client.1.smithi115.stdout:9/738: symlink d1/d6/d2d/d3d/d49/d98/l106 0 2024-04-16T14:35:44.288 INFO:tasks.workunit.client.1.smithi115.stdout:9/739: chown d1/d6/d2d/d4b/d8f/d91/l35 489858 1 2024-04-16T14:35:44.288 INFO:tasks.workunit.client.1.smithi115.stdout:9/740: write d1/d6/f41 [1239229,29178] 0 2024-04-16T14:35:44.288 INFO:tasks.workunit.client.1.smithi115.stdout:9/741: creat d1/d6/f107 x:0 0 0 2024-04-16T14:35:44.292 INFO:tasks.workunit.client.1.smithi115.stdout:5/679: dread dc/d5d/dc2/fc3 [0,4194304] 0 2024-04-16T14:35:44.292 INFO:tasks.workunit.client.1.smithi115.stdout:5/680: creat dc/d8e/fcf x:0 0 0 2024-04-16T14:35:44.294 INFO:tasks.workunit.client.1.smithi115.stdout:8/744: write d0/db/d10/d17/d2c/d52/d74/d3b/fb2 [535578,83195] 0 2024-04-16T14:35:44.294 INFO:tasks.workunit.client.1.smithi115.stdout:9/742: mknod d1/d6/d2d/d4b/d8f/d91/dda/ddd/de8/dfe/c108 0 2024-04-16T14:35:44.294 INFO:tasks.workunit.client.1.smithi115.stdout:9/743: chown d1/d6/d2d/d4b/d8f 168837922 1 2024-04-16T14:35:44.297 INFO:tasks.workunit.client.1.smithi115.stdout:5/681: truncate dc/d15/f78 1121571 0 2024-04-16T14:35:44.297 INFO:tasks.workunit.client.1.smithi115.stdout:8/745: unlink d0/db/d10/d17/d22/f75 0 2024-04-16T14:35:44.299 INFO:tasks.workunit.client.1.smithi115.stdout:5/682: creat dc/d3d/d68/fd0 x:0 0 0 2024-04-16T14:35:44.301 INFO:tasks.workunit.client.1.smithi115.stdout:5/683: rename dc/d15/l1b to dc/d15/d2d/db0/ld1 0 2024-04-16T14:35:44.305 INFO:tasks.workunit.client.1.smithi115.stdout:9/744: dread d1/d6/d2d/d4b/d6c/d20/d36/fcf [0,4194304] 0 2024-04-16T14:35:44.307 INFO:tasks.workunit.client.1.smithi115.stdout:9/745: rmdir d1/d6/d2d/d4b/d8f/d91/dd1/dd2 39 2024-04-16T14:35:44.307 INFO:tasks.workunit.client.1.smithi115.stdout:9/746: fdatasync d1/d6/d2d/d4b/d6c/fae 0 2024-04-16T14:35:44.309 INFO:tasks.workunit.client.1.smithi115.stdout:9/747: truncate d1/d6/d2d/d4b/d60/f99 1765967 0 2024-04-16T14:35:44.309 INFO:tasks.workunit.client.1.smithi115.stdout:9/748: chown d1/d6/d2d 125 1 2024-04-16T14:35:44.309 INFO:tasks.workunit.client.1.smithi115.stdout:7/620: dwrite d0/d24/d40/f85 [4194304,4194304] 0 2024-04-16T14:35:44.309 INFO:tasks.workunit.client.1.smithi115.stdout:9/749: creat d1/d6/d2d/d4b/d60/d65/f109 x:0 0 0 2024-04-16T14:35:44.310 INFO:tasks.workunit.client.1.smithi115.stdout:3/743: dwrite dc/d24/d36/f72 [4194304,4194304] 0 2024-04-16T14:35:44.310 INFO:tasks.workunit.client.1.smithi115.stdout:0/578: dwrite d6/d1b/f6c [0,4194304] 0 2024-04-16T14:35:44.310 INFO:tasks.workunit.client.1.smithi115.stdout:5/684: write dc/d3d/d41/f54 [3471554,13677] 0 2024-04-16T14:35:44.310 INFO:tasks.workunit.client.1.smithi115.stdout:5/685: stat dc/d3d/d41/f82 0 2024-04-16T14:35:44.315 INFO:tasks.workunit.client.1.smithi115.stdout:7/621: symlink d0/d2/d3a/d30/d79/lce 0 2024-04-16T14:35:44.316 INFO:tasks.workunit.client.1.smithi115.stdout:9/750: mkdir d1/d6/d2d/d4b/d6c/d10a 0 2024-04-16T14:35:44.317 INFO:tasks.workunit.client.1.smithi115.stdout:8/746: dwrite d0/db/d44/fc1 [0,4194304] 0 2024-04-16T14:35:44.318 INFO:tasks.workunit.client.1.smithi115.stdout:8/747: fsync d0/da5/fce 0 2024-04-16T14:35:44.318 INFO:tasks.workunit.client.1.smithi115.stdout:8/748: read - d0/db/d10/d17/d2c/d52/d74/fe1 zero size 2024-04-16T14:35:44.318 INFO:tasks.workunit.client.1.smithi115.stdout:8/749: getdents d0/dc8 0 2024-04-16T14:35:44.320 INFO:tasks.workunit.client.1.smithi115.stdout:8/750: getdents d0/db/d10/d17/d2c/d52/d84 0 2024-04-16T14:35:44.320 INFO:tasks.workunit.client.1.smithi115.stdout:8/751: readlink d0/l5c 0 2024-04-16T14:35:44.321 INFO:tasks.workunit.client.1.smithi115.stdout:8/752: getdents d0/db/d10/d17/d2c/d52/d6c/db8/d64/d83 0 2024-04-16T14:35:44.326 INFO:tasks.workunit.client.1.smithi115.stdout:0/579: symlink d6/lc4 0 2024-04-16T14:35:44.327 INFO:tasks.workunit.client.1.smithi115.stdout:7/622: truncate d0/d1/f1f 2795555 0 2024-04-16T14:35:44.329 INFO:tasks.workunit.client.1.smithi115.stdout:5/686: dwrite dc/f13 [0,4194304] 0 2024-04-16T14:35:44.330 INFO:tasks.workunit.client.1.smithi115.stdout:5/687: stat cb 0 2024-04-16T14:35:44.330 INFO:tasks.workunit.client.1.smithi115.stdout:5/688: dread - dc/d8e/fcf zero size 2024-04-16T14:35:44.330 INFO:tasks.workunit.client.1.smithi115.stdout:5/689: fdatasync dc/d5d/d8f/f92 0 2024-04-16T14:35:44.332 INFO:tasks.workunit.client.1.smithi115.stdout:9/751: rename d1/d7f/fb5 to d1/d6/d2d/d4b/d8f/d91/dd1/dd2/f10b 0 2024-04-16T14:35:44.332 INFO:tasks.workunit.client.1.smithi115.stdout:7/623: rename d0/d24/da3/db1/d3f/db0 to d0/d24/da3/db1/d3f/db0/dcf 22 2024-04-16T14:35:44.333 INFO:tasks.workunit.client.1.smithi115.stdout:8/753: rmdir d0/db/d10/d17/d22 39 2024-04-16T14:35:44.333 INFO:tasks.workunit.client.1.smithi115.stdout:8/754: stat d0/db/d10/d17/d2c/d52 0 2024-04-16T14:35:44.335 INFO:tasks.workunit.client.1.smithi115.stdout:0/580: unlink d6/d10/d12/d31/d35/d44/f50 0 2024-04-16T14:35:44.339 INFO:tasks.workunit.client.1.smithi115.stdout:4/675: sync 2024-04-16T14:35:44.341 INFO:tasks.workunit.client.1.smithi115.stdout:7/624: mkdir d0/d2/d3a/d30/d6b/da2/d81/dd0 0 2024-04-16T14:35:44.343 INFO:tasks.workunit.client.1.smithi115.stdout:0/581: creat d6/d30/d8d/fc5 x:0 0 0 2024-04-16T14:35:44.344 INFO:tasks.workunit.client.1.smithi115.stdout:5/690: dread dc/f12 [0,4194304] 0 2024-04-16T14:35:44.344 INFO:tasks.workunit.client.1.smithi115.stdout:7/625: mkdir d0/d24/da3/db1/d49/dbc/dd1 0 2024-04-16T14:35:44.350 INFO:tasks.workunit.client.1.smithi115.stdout:4/676: write d1/f2d [5036735,3261] 0 2024-04-16T14:35:44.354 INFO:tasks.workunit.client.1.smithi115.stdout:7/626: dread d0/fa5 [0,4194304] 0 2024-04-16T14:35:44.354 INFO:tasks.workunit.client.1.smithi115.stdout:4/677: symlink d1/d15/lcd 0 2024-04-16T14:35:44.354 INFO:tasks.workunit.client.1.smithi115.stdout:7/627: truncate d0/d24/d2b/fa1 1322125 0 2024-04-16T14:35:44.354 INFO:tasks.workunit.client.1.smithi115.stdout:7/628: stat d0/d24/da3/db1/d5a/l63 0 2024-04-16T14:35:44.357 INFO:tasks.workunit.client.1.smithi115.stdout:4/678: mknod d1/d15/d31/d42/cce 0 2024-04-16T14:35:44.357 INFO:tasks.workunit.client.1.smithi115.stdout:9/752: dwrite d1/d6/d2d/d3d/d49/fc3 [0,4194304] 0 2024-04-16T14:35:44.359 INFO:tasks.workunit.client.1.smithi115.stdout:7/629: rename d0/d24/d2b to d0/d2/d3a/d30/d79/dd2 0 2024-04-16T14:35:44.363 INFO:tasks.workunit.client.1.smithi115.stdout:9/753: creat d1/d6/d2d/d3d/d50/f10c x:0 0 0 2024-04-16T14:35:44.363 INFO:tasks.workunit.client.1.smithi115.stdout:9/754: fsync d1/d6/d2d/d4b/d6c/f77 0 2024-04-16T14:35:44.363 INFO:tasks.workunit.client.1.smithi115.stdout:4/679: getdents d1/d15/d31/d42/d46/d7a 0 2024-04-16T14:35:44.367 INFO:tasks.workunit.client.1.smithi115.stdout:4/680: getdents d1/d15/d17 0 2024-04-16T14:35:44.367 INFO:tasks.workunit.client.1.smithi115.stdout:4/681: readlink d1/d15/d1e/l27 0 2024-04-16T14:35:44.369 INFO:tasks.workunit.client.1.smithi115.stdout:8/755: dwrite d0/f53 [0,4194304] 0 2024-04-16T14:35:44.369 INFO:tasks.workunit.client.1.smithi115.stdout:5/691: dwrite dc/d3d/f42 [0,4194304] 0 2024-04-16T14:35:44.370 INFO:tasks.workunit.client.1.smithi115.stdout:8/756: symlink d0/db/d10/d17/d22/deb/d7c/dc0/lf6 0 2024-04-16T14:35:44.370 INFO:tasks.workunit.client.1.smithi115.stdout:4/682: creat d1/d15/fcf x:0 0 0 2024-04-16T14:35:44.372 INFO:tasks.workunit.client.1.smithi115.stdout:7/630: write d0/d24/d40/f44 [3298393,106972] 0 2024-04-16T14:35:44.373 INFO:tasks.workunit.client.1.smithi115.stdout:8/757: rename d0/db/d10/d17/d22/deb/caa to d0/db/d10/d17/d2c/cf7 0 2024-04-16T14:35:44.373 INFO:tasks.workunit.client.1.smithi115.stdout:4/683: mknod d1/d2/cd0 0 2024-04-16T14:35:44.373 INFO:tasks.workunit.client.1.smithi115.stdout:4/684: creat d1/d15/d1e/fd1 x:0 0 0 2024-04-16T14:35:44.374 INFO:tasks.workunit.client.1.smithi115.stdout:8/758: creat d0/db/dbb/dcd/dae/ff8 x:0 0 0 2024-04-16T14:35:44.374 INFO:tasks.workunit.client.1.smithi115.stdout:8/759: fdatasync d0/db/d10/d17/d2c/d52/dcc/fe6 0 2024-04-16T14:35:44.375 INFO:tasks.workunit.client.1.smithi115.stdout:4/685: creat d1/d15/d24/fd2 x:0 0 0 2024-04-16T14:35:44.375 INFO:tasks.workunit.client.1.smithi115.stdout:4/686: stat d1/d15/d24/f40 0 2024-04-16T14:35:44.381 INFO:tasks.workunit.client.1.smithi115.stdout:9/755: dwrite d1/d6/d2d/d4b/d8f/d91/dd1/dd2/f10b [4194304,4194304] 0 2024-04-16T14:35:44.381 INFO:tasks.workunit.client.1.smithi115.stdout:9/756: creat d1/d6/d29/f10d x:0 0 0 2024-04-16T14:35:44.381 INFO:tasks.workunit.client.1.smithi115.stdout:9/757: readlink d1/d6/d2d/d4b/d8f/d91/l48 0 2024-04-16T14:35:44.381 INFO:tasks.workunit.client.1.smithi115.stdout:9/758: write d1/d6/d2d/d3d/d49/fb6 [712983,52201] 0 2024-04-16T14:35:44.381 INFO:tasks.workunit.client.1.smithi115.stdout:9/759: write d1/d6/d2d/d3d/db7/fe6 [985662,48215] 0 2024-04-16T14:35:44.381 INFO:tasks.workunit.client.1.smithi115.stdout:9/760: creat d1/d6/d29/f10e x:0 0 0 2024-04-16T14:35:44.383 INFO:tasks.workunit.client.1.smithi115.stdout:5/692: read dc/f65 [65664,25348] 0 2024-04-16T14:35:44.387 INFO:tasks.workunit.client.1.smithi115.stdout:8/760: write d0/db/d10/f42 [8180885,80872] 0 2024-04-16T14:35:44.393 INFO:tasks.workunit.client.1.smithi115.stdout:5/693: dread f2 [4194304,4194304] 0 2024-04-16T14:35:44.393 INFO:tasks.workunit.client.1.smithi115.stdout:5/694: readlink dc/d5d/l77 0 2024-04-16T14:35:44.394 INFO:tasks.workunit.client.1.smithi115.stdout:8/761: rename d0/db/d10/f6d to d0/db/d10/d17/d2c/ff9 0 2024-04-16T14:35:44.394 INFO:tasks.workunit.client.1.smithi115.stdout:5/695: rmdir dc/d15/d2d 39 2024-04-16T14:35:44.395 INFO:tasks.workunit.client.1.smithi115.stdout:5/696: mknod dc/d15/d35/d71/cd2 0 2024-04-16T14:35:44.404 INFO:tasks.workunit.client.1.smithi115.stdout:4/687: dwrite d1/d15/d78/fb8 [4194304,4194304] 0 2024-04-16T14:35:44.408 INFO:tasks.workunit.client.1.smithi115.stdout:7/631: dwrite d0/d1/fc9 [0,4194304] 0 2024-04-16T14:35:44.410 INFO:tasks.workunit.client.1.smithi115.stdout:4/688: rmdir d1/d15/d31/d42/d46 39 2024-04-16T14:35:44.412 INFO:tasks.workunit.client.1.smithi115.stdout:6/716: sync 2024-04-16T14:35:44.412 INFO:tasks.workunit.client.1.smithi115.stdout:6/717: readlink d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/l1e 0 2024-04-16T14:35:44.412 INFO:tasks.workunit.client.0.smithi005.stdout:2/714: sync 2024-04-16T14:35:44.413 INFO:tasks.workunit.client.0.smithi005.stdout:2/715: chown d0/d1c/f33 13072 1 2024-04-16T14:35:44.414 INFO:tasks.workunit.client.0.smithi005.stdout:3/880: sync 2024-04-16T14:35:44.414 INFO:tasks.workunit.client.0.smithi005.stdout:6/970: sync 2024-04-16T14:35:44.414 INFO:tasks.workunit.client.0.smithi005.stdout:0/749: sync 2024-04-16T14:35:44.414 INFO:tasks.workunit.client.0.smithi005.stdout:0/750: readlink da/df/d26/d39/d55/d5c/le3 0 2024-04-16T14:35:44.414 INFO:tasks.workunit.client.0.smithi005.stdout:3/881: write d2/d9/f105 [641825,44288] 0 2024-04-16T14:35:44.415 INFO:tasks.workunit.client.0.smithi005.stdout:8/786: sync 2024-04-16T14:35:44.415 INFO:tasks.workunit.client.0.smithi005.stdout:9/669: sync 2024-04-16T14:35:44.415 INFO:tasks.workunit.client.1.smithi115.stdout:9/761: dwrite d1/d6/d2d/d4b/d6c/d20/d36/dce/fea [0,4194304] 0 2024-04-16T14:35:44.415 INFO:tasks.workunit.client.1.smithi115.stdout:9/762: readlink d1/l8 0 2024-04-16T14:35:44.415 INFO:tasks.workunit.client.0.smithi005.stdout:6/971: mkdir d2/d3f/d53/dba/d111/d143 0 2024-04-16T14:35:44.416 INFO:tasks.workunit.client.1.smithi115.stdout:7/632: rmdir d0/d24/da3/db1/d5a 39 2024-04-16T14:35:44.416 INFO:tasks.workunit.client.0.smithi005.stdout:0/751: creat da/df/d26/d39/d55/ddc/ffc x:0 0 0 2024-04-16T14:35:44.417 INFO:tasks.workunit.client.1.smithi115.stdout:6/718: truncate d13/d1d/d2b/d5f/d30/f80 233944 0 2024-04-16T14:35:44.418 INFO:tasks.workunit.client.0.smithi005.stdout:3/882: creat d2/d17/d46/d75/d41/d79/f139 x:0 0 0 2024-04-16T14:35:44.420 INFO:tasks.workunit.client.1.smithi115.stdout:9/763: mknod d1/d6/d2d/d4b/d90/c10f 0 2024-04-16T14:35:44.424 INFO:tasks.workunit.client.1.smithi115.stdout:7/633: unlink d0/d2/d3a/d30/d79/dd2/cb9 0 2024-04-16T14:35:44.426 INFO:tasks.workunit.client.0.smithi005.stdout:6/972: symlink d2/d20/d33/d115/l144 0 2024-04-16T14:35:44.426 INFO:tasks.workunit.client.0.smithi005.stdout:0/752: symlink da/df/d1b/d3a/lfd 0 2024-04-16T14:35:44.427 INFO:tasks.workunit.client.0.smithi005.stdout:3/883: mknod d2/d17/d46/d75/d6d/dd5/c13a 0 2024-04-16T14:35:44.427 INFO:tasks.workunit.client.0.smithi005.stdout:3/884: write d2/d17/d102/f12c [435854,27728] 0 2024-04-16T14:35:44.427 INFO:tasks.workunit.client.1.smithi115.stdout:9/764: creat d1/d6/d2d/d4b/d6c/d20/df4/f110 x:0 0 0 2024-04-16T14:35:44.427 INFO:tasks.workunit.client.1.smithi115.stdout:9/765: stat d1/d6/d2d/d4b/d8f/d91/f58 0 2024-04-16T14:35:44.428 INFO:tasks.workunit.client.0.smithi005.stdout:0/753: unlink da/df/d26/d39/d55/l5d 0 2024-04-16T14:35:44.428 INFO:tasks.workunit.client.0.smithi005.stdout:0/754: readlink da/df/d1b/d3a/d53/l8a 0 2024-04-16T14:35:44.428 INFO:tasks.workunit.client.0.smithi005.stdout:0/755: write da/df/d1b/d3a/d96/dab/fac [135658,71327] 0 2024-04-16T14:35:44.429 INFO:tasks.workunit.client.0.smithi005.stdout:0/756: creat da/df/d1b/d3a/ffe x:0 0 0 2024-04-16T14:35:44.429 INFO:tasks.workunit.client.1.smithi115.stdout:9/766: rename d1/d6/d2d/d4b/d8f/d91/l8c to d1/d6/d2d/d4b/d60/d65/l111 0 2024-04-16T14:35:44.431 INFO:tasks.workunit.client.0.smithi005.stdout:0/757: link da/df/d1b/f7a da/df/d26/d39/fff 0 2024-04-16T14:35:44.431 INFO:tasks.workunit.client.0.smithi005.stdout:0/758: chown da/df/d26/d8e/f98 2002618 1 2024-04-16T14:35:44.432 INFO:tasks.workunit.client.1.smithi115.stdout:9/767: mkdir d1/d6/d2d/d4b/d8f/d91/dda/ddd/de8/d112 0 2024-04-16T14:35:44.434 INFO:tasks.workunit.client.0.smithi005.stdout:0/759: creat da/df/d1b/d3a/d96/dab/f100 x:0 0 0 2024-04-16T14:35:44.442 INFO:tasks.workunit.client.1.smithi115.stdout:7/634: dread d0/d24/da3/db1/d3f/db0/f89 [0,4194304] 0 2024-04-16T14:35:44.442 INFO:tasks.workunit.client.1.smithi115.stdout:7/635: stat d0/d24/da3/db1/l99 0 2024-04-16T14:35:44.449 INFO:tasks.workunit.client.0.smithi005.stdout:3/885: write d2/d17/f38 [3753897,47353] 0 2024-04-16T14:35:44.451 INFO:tasks.workunit.client.1.smithi115.stdout:9/768: dread d1/d7f/f93 [0,4194304] 0 2024-04-16T14:35:44.451 INFO:tasks.workunit.client.1.smithi115.stdout:7/636: write d0/d24/da3/db1/d3f/db0/f89 [1633547,43689] 0 2024-04-16T14:35:44.451 INFO:tasks.workunit.client.1.smithi115.stdout:5/697: dwrite dc/d3d/fbb [0,4194304] 0 2024-04-16T14:35:44.452 INFO:tasks.workunit.client.0.smithi005.stdout:3/886: link d2/d17/d46/d47/l82 d2/d17/d46/d75/d9b/l13b 0 2024-04-16T14:35:44.452 INFO:tasks.workunit.client.0.smithi005.stdout:3/887: chown d2/d9/d25/d39/f3b 0 1 2024-04-16T14:35:44.452 INFO:tasks.workunit.client.0.smithi005.stdout:3/888: creat d2/d9/df/f13c x:0 0 0 2024-04-16T14:35:44.453 INFO:tasks.workunit.client.1.smithi115.stdout:9/769: dread d1/d6/d2d/d3d/d49/d98/fbd [0,4194304] 0 2024-04-16T14:35:44.454 INFO:tasks.workunit.client.1.smithi115.stdout:9/770: fsync d1/d6/d2d/d4b/d60/d65/fdc 0 2024-04-16T14:35:44.454 INFO:tasks.workunit.client.1.smithi115.stdout:9/771: chown d1/d6/d2d/d4b/d8f/d91/dda/ddd/de8/dfe/c108 0 1 2024-04-16T14:35:44.454 INFO:tasks.workunit.client.1.smithi115.stdout:5/698: mknod dc/d15/d4d/daa/cd3 0 2024-04-16T14:35:44.454 INFO:tasks.workunit.client.1.smithi115.stdout:5/699: readlink dc/d15/d2d/l50 0 2024-04-16T14:35:44.454 INFO:tasks.workunit.client.1.smithi115.stdout:5/700: write dc/d15/f5f [4686896,73663] 0 2024-04-16T14:35:44.455 INFO:tasks.workunit.client.0.smithi005.stdout:3/889: truncate d2/d9/d25/f111 3375594 0 2024-04-16T14:35:44.455 INFO:tasks.workunit.client.0.smithi005.stdout:3/890: truncate d2/d17/d46/d75/d41/d124/ff2 735229 0 2024-04-16T14:35:44.455 INFO:tasks.workunit.client.1.smithi115.stdout:9/772: creat d1/d6/d2d/d3d/d50/dab/f113 x:0 0 0 2024-04-16T14:35:44.455 INFO:tasks.workunit.client.1.smithi115.stdout:9/773: fdatasync d1/d6/d29/f10e 0 2024-04-16T14:35:44.455 INFO:tasks.workunit.client.1.smithi115.stdout:5/701: getdents dc/d3d/d68/d7b 0 2024-04-16T14:35:44.456 INFO:tasks.workunit.client.0.smithi005.stdout:3/891: getdents d2/d17/d46/d75/d6d 0 2024-04-16T14:35:44.456 INFO:tasks.workunit.client.0.smithi005.stdout:3/892: fsync d2/d9/df/fbe 0 2024-04-16T14:35:44.456 INFO:tasks.workunit.client.0.smithi005.stdout:3/893: stat d2/d9/df/c4e 0 2024-04-16T14:35:44.458 INFO:tasks.workunit.client.1.smithi115.stdout:5/702: unlink f1 0 2024-04-16T14:35:44.459 INFO:tasks.workunit.client.1.smithi115.stdout:5/703: rmdir dc/d3d 39 2024-04-16T14:35:44.460 INFO:tasks.workunit.client.1.smithi115.stdout:5/704: creat dc/d15/d35/d87/fd4 x:0 0 0 2024-04-16T14:35:44.460 INFO:tasks.workunit.client.1.smithi115.stdout:5/705: chown dc/f34 481 1 2024-04-16T14:35:44.461 INFO:tasks.workunit.client.1.smithi115.stdout:7/637: dread d0/d2/d3a/d73/f7d [0,4194304] 0 2024-04-16T14:35:44.462 INFO:tasks.workunit.client.1.smithi115.stdout:5/706: symlink dc/d15/ld5 0 2024-04-16T14:35:44.463 INFO:tasks.workunit.client.1.smithi115.stdout:8/762: dwrite d0/db/d10/d17/f7b [0,4194304] 0 2024-04-16T14:35:44.464 INFO:tasks.workunit.client.1.smithi115.stdout:7/638: link d0/d24/da3/db1/l99 d0/d24/da3/db1/d5a/ld3 0 2024-04-16T14:35:44.465 INFO:tasks.workunit.client.1.smithi115.stdout:7/639: truncate d0/d24/f61 462 0 2024-04-16T14:35:44.467 INFO:tasks.workunit.client.1.smithi115.stdout:7/640: creat d0/d24/fd4 x:0 0 0 2024-04-16T14:35:44.467 INFO:tasks.workunit.client.1.smithi115.stdout:7/641: write d0/d2/d3a/d30/d6b/da2/fca [178965,22022] 0 2024-04-16T14:35:44.471 INFO:tasks.workunit.client.0.smithi005.stdout:8/787: dwrite d5/d7b/da8/db7/d74/feb [0,4194304] 0 2024-04-16T14:35:44.471 INFO:tasks.workunit.client.0.smithi005.stdout:9/670: dwrite d3/d77/f8f [0,4194304] 0 2024-04-16T14:35:44.472 INFO:tasks.workunit.client.1.smithi115.stdout:6/719: write d13/d1d/d2b/d5f/d30/f80 [625107,61153] 0 2024-04-16T14:35:44.472 INFO:tasks.workunit.client.1.smithi115.stdout:6/720: creat d13/d1d/d68/fef x:0 0 0 2024-04-16T14:35:44.473 INFO:tasks.workunit.client.0.smithi005.stdout:3/894: dread d2/fe [0,4194304] 0 2024-04-16T14:35:44.473 INFO:tasks.workunit.client.0.smithi005.stdout:3/895: chown d2/d92 31 1 2024-04-16T14:35:44.473 INFO:tasks.workunit.client.0.smithi005.stdout:3/896: chown d2/d9/df/dbf/df8/f85 1022 1 2024-04-16T14:35:44.473 INFO:tasks.workunit.client.0.smithi005.stdout:3/897: chown d2/d17/d46/d75/d9b/dbd/dee/d12d/l135 5089 1 2024-04-16T14:35:44.474 INFO:tasks.workunit.client.1.smithi115.stdout:4/689: dwrite d1/d15/d1e/fd1 [0,4194304] 0 2024-04-16T14:35:44.475 INFO:tasks.workunit.client.0.smithi005.stdout:2/716: dwrite d0/d29/d3e/f57 [0,4194304] 0 2024-04-16T14:35:44.475 INFO:tasks.workunit.client.1.smithi115.stdout:8/763: write d0/db/d10/d17/d2c/d52/d74/f4d [1515121,89247] 0 2024-04-16T14:35:44.477 INFO:tasks.workunit.client.0.smithi005.stdout:8/788: mkdir d5/d11/d115 0 2024-04-16T14:35:44.478 INFO:tasks.workunit.client.1.smithi115.stdout:9/774: dwrite d1/d6/d2d/d4b/d8f/d91/dd1/dd2/f10b [0,4194304] 0 2024-04-16T14:35:44.478 INFO:tasks.workunit.client.1.smithi115.stdout:4/690: symlink d1/d15/d17/ld3 0 2024-04-16T14:35:44.478 INFO:tasks.workunit.client.0.smithi005.stdout:6/973: dwrite d2/d20/d72/fd9 [0,4194304] 0 2024-04-16T14:35:44.479 INFO:tasks.workunit.client.0.smithi005.stdout:0/760: dwrite da/df/d26/da9/dcb/dd8/fe1 [0,4194304] 0 2024-04-16T14:35:44.485 INFO:tasks.workunit.client.1.smithi115.stdout:9/775: rename d1/d6/d2d/d3d/d50/dab/f113 to d1/d6/d2d/d4b/d8f/f114 0 2024-04-16T14:35:44.485 INFO:tasks.workunit.client.0.smithi005.stdout:9/671: mkdir d3/d12/d2b/d8e/dc1 0 2024-04-16T14:35:44.486 INFO:tasks.workunit.client.0.smithi005.stdout:2/717: write d0/d29/d89/f8b [1049932,127981] 0 2024-04-16T14:35:44.487 INFO:tasks.workunit.client.1.smithi115.stdout:9/776: getdents d1/d6/d2d/d4b/d60/d65 0 2024-04-16T14:35:44.488 INFO:tasks.workunit.client.1.smithi115.stdout:8/764: creat d0/db/d10/d17/d2c/d52/d6c/db8/d64/d83/ffa x:0 0 0 2024-04-16T14:35:44.488 INFO:tasks.workunit.client.1.smithi115.stdout:8/765: readlink d0/db/d10/d17/d22/l4e 0 2024-04-16T14:35:44.491 INFO:tasks.workunit.client.0.smithi005.stdout:8/789: creat d5/d7b/da8/db7/d8a/da1/d3d/d7f/d8d/f116 x:0 0 0 2024-04-16T14:35:44.491 INFO:tasks.workunit.client.0.smithi005.stdout:8/790: fdatasync d5/d7b/da8/db7/d8a/fab 0 2024-04-16T14:35:44.493 INFO:tasks.workunit.client.0.smithi005.stdout:8/791: write d5/d40/f70 [276762,124356] 0 2024-04-16T14:35:44.494 INFO:tasks.workunit.client.1.smithi115.stdout:8/766: creat d0/ffb x:0 0 0 2024-04-16T14:35:44.494 INFO:tasks.workunit.client.1.smithi115.stdout:4/691: write d1/f4 [4049807,71969] 0 2024-04-16T14:35:44.497 INFO:tasks.workunit.client.1.smithi115.stdout:4/692: unlink d1/d2/f90 0 2024-04-16T14:35:44.497 INFO:tasks.workunit.client.1.smithi115.stdout:8/767: mkdir d0/db/d10/d17/d2c/d52/d74/d3b/d56/dfc 0 2024-04-16T14:35:44.497 INFO:tasks.workunit.client.1.smithi115.stdout:8/768: dread - d0/db/d10/d17/d2c/d52/d6c/db8/d64/f8c zero size 2024-04-16T14:35:44.499 INFO:tasks.workunit.client.1.smithi115.stdout:9/777: write d1/d6/d2d/d3d/d50/fe7 [402700,106242] 0 2024-04-16T14:35:44.499 INFO:tasks.workunit.client.1.smithi115.stdout:4/693: creat d1/d15/d31/d42/da4/dc0/fd4 x:0 0 0 2024-04-16T14:35:44.499 INFO:tasks.workunit.client.0.smithi005.stdout:6/974: creat d2/d5/d10/f145 x:0 0 0 2024-04-16T14:35:44.500 INFO:tasks.workunit.client.1.smithi115.stdout:9/778: link d1/d6/d2d/d4b/d6c/d20/d36/dce/c103 d1/d6/d2d/d4b/d8f/d91/dda/ddd/de8/dfe/c115 0 2024-04-16T14:35:44.500 INFO:tasks.workunit.client.1.smithi115.stdout:9/779: chown d1/d6/d2d/d4b/d6c/d10a 1 1 2024-04-16T14:35:44.500 INFO:tasks.workunit.client.1.smithi115.stdout:9/780: fdatasync d1/d6/d2d/d4b/d60/d65/f109 0 2024-04-16T14:35:44.500 INFO:tasks.workunit.client.0.smithi005.stdout:8/792: write d5/d55/f5e [2225698,126314] 0 2024-04-16T14:35:44.500 INFO:tasks.workunit.client.0.smithi005.stdout:8/793: read d5/d7b/da8/db7/f5b [1862121,97413] 0 2024-04-16T14:35:44.502 INFO:tasks.workunit.client.1.smithi115.stdout:8/769: truncate d0/db/d10/d17/d2c/f5e 5118920 0 2024-04-16T14:35:44.504 INFO:tasks.workunit.client.0.smithi005.stdout:9/672: mknod d3/d12/cc2 0 2024-04-16T14:35:44.504 INFO:tasks.workunit.client.1.smithi115.stdout:5/707: dwrite dc/d15/f19 [0,4194304] 0 2024-04-16T14:35:44.505 INFO:tasks.workunit.client.1.smithi115.stdout:5/708: chown dc/d15/d2d/cba 325 1 2024-04-16T14:35:44.508 INFO:tasks.workunit.client.0.smithi005.stdout:3/898: dwrite d2/d9/df/daa/dc4/dce/f108 [0,4194304] 0 2024-04-16T14:35:44.508 INFO:tasks.workunit.client.0.smithi005.stdout:3/899: creat d2/d6b/f13d x:0 0 0 2024-04-16T14:35:44.509 INFO:tasks.workunit.client.1.smithi115.stdout:4/694: dread d1/d15/d31/d55/f56 [0,4194304] 0 2024-04-16T14:35:44.509 INFO:tasks.workunit.client.1.smithi115.stdout:4/695: dread - d1/d15/d24/fd2 zero size 2024-04-16T14:35:44.509 INFO:tasks.workunit.client.1.smithi115.stdout:4/696: readlink d1/la1 0 2024-04-16T14:35:44.509 INFO:tasks.workunit.client.1.smithi115.stdout:4/697: write d1/d15/d31/d42/da4/dc0/fc1 [527488,26669] 0 2024-04-16T14:35:44.510 INFO:tasks.workunit.client.1.smithi115.stdout:8/770: link d0/db/d10/d17/d2c/l50 d0/db/dbb/dcd/dae/lfd 0 2024-04-16T14:35:44.510 INFO:tasks.workunit.client.0.smithi005.stdout:3/900: dread d2/d9/f105 [0,4194304] 0 2024-04-16T14:35:44.512 INFO:tasks.workunit.client.0.smithi005.stdout:0/761: dwrite da/df/d1b/d3a/d53/d5a/d67/d79/f82 [0,4194304] 0 2024-04-16T14:35:44.512 INFO:tasks.workunit.client.0.smithi005.stdout:8/794: creat d5/d40/d4b/f117 x:0 0 0 2024-04-16T14:35:44.514 INFO:tasks.workunit.client.1.smithi115.stdout:9/781: read d1/d6/d2d/d4b/d60/d65/fc1 [1555086,12899] 0 2024-04-16T14:35:44.514 INFO:tasks.workunit.client.0.smithi005.stdout:0/762: dread da/df/d1b/d3a/d96/dab/fac [0,4194304] 0 2024-04-16T14:35:44.515 INFO:tasks.workunit.client.0.smithi005.stdout:9/673: dread d3/d77/f8f [0,4194304] 0 2024-04-16T14:35:44.518 INFO:tasks.workunit.client.0.smithi005.stdout:8/795: dread d5/d7b/da8/db7/d8a/da1/d3d/d7f/f81 [0,4194304] 0 2024-04-16T14:35:44.520 INFO:tasks.workunit.client.1.smithi115.stdout:4/698: dread d1/d15/d1e/f23 [0,4194304] 0 2024-04-16T14:35:44.520 INFO:tasks.workunit.client.1.smithi115.stdout:4/699: readlink d1/d15/d31/d42/d46/l59 0 2024-04-16T14:35:44.520 INFO:tasks.workunit.client.1.smithi115.stdout:4/700: truncate d1/d15/d24/d83/fbd 423791 0 2024-04-16T14:35:44.521 INFO:tasks.workunit.client.1.smithi115.stdout:5/709: dwrite dc/f34 [0,4194304] 0 2024-04-16T14:35:44.522 INFO:tasks.workunit.client.0.smithi005.stdout:0/763: write f0 [590506,106576] 0 2024-04-16T14:35:44.523 INFO:tasks.workunit.client.0.smithi005.stdout:3/901: mkdir d2/d9/d13e 0 2024-04-16T14:35:44.523 INFO:tasks.workunit.client.0.smithi005.stdout:3/902: readlink d2/d9/d5e/l90 0 2024-04-16T14:35:44.533 INFO:tasks.workunit.client.0.smithi005.stdout:8/796: rename d5/d7b/fad to d5/d7b/da8/db7/f118 0 2024-04-16T14:35:44.533 INFO:tasks.workunit.client.0.smithi005.stdout:3/903: write d2/d17/d46/d75/d9b/f113 [901717,15073] 0 2024-04-16T14:35:44.533 INFO:tasks.workunit.client.0.smithi005.stdout:0/764: mknod da/df/d26/c101 0 2024-04-16T14:35:44.535 INFO:tasks.workunit.client.0.smithi005.stdout:8/797: unlink d5/d7b/da8/db7/d8a/fab 0 2024-04-16T14:35:44.536 INFO:tasks.workunit.client.1.smithi115.stdout:5/710: dwrite dc/d5d/d81/d9a/da3/fca [0,4194304] 0 2024-04-16T14:35:44.538 INFO:tasks.workunit.client.0.smithi005.stdout:3/904: symlink d2/d17/d46/d47/de8/l13f 0 2024-04-16T14:35:44.539 INFO:tasks.workunit.client.0.smithi005.stdout:8/798: mknod d5/d7b/da8/da5/def/d71/c119 0 2024-04-16T14:35:44.539 INFO:tasks.workunit.client.0.smithi005.stdout:8/799: truncate d5/d7b/da8/db7/d8a/da1/d3d/d7f/de7/fff 560841 0 2024-04-16T14:35:44.540 INFO:tasks.workunit.client.0.smithi005.stdout:3/905: dread d2/d17/d46/d75/d41/d120/fc1 [0,4194304] 0 2024-04-16T14:35:44.540 INFO:tasks.workunit.client.0.smithi005.stdout:8/800: write f4 [4110209,107625] 0 2024-04-16T14:35:44.543 INFO:tasks.workunit.client.0.smithi005.stdout:8/801: link d5/d7b/da8/db7/d8a/da1/d3d/dba/dcd/ffd d5/d7b/da8/da5/def/f11a 0 2024-04-16T14:35:44.544 INFO:tasks.workunit.client.1.smithi115.stdout:9/782: unlink d1/d6/d2d/d4b/d60/d65/ff1 0 2024-04-16T14:35:44.545 INFO:tasks.workunit.client.0.smithi005.stdout:3/906: rmdir d2/d17/d46/d75/d9b/dbd 39 2024-04-16T14:35:44.545 INFO:tasks.workunit.client.0.smithi005.stdout:3/907: dread - d2/d17/d46/d75/d6d/ffe zero size 2024-04-16T14:35:44.545 INFO:tasks.workunit.client.0.smithi005.stdout:3/908: fdatasync d2/f21 0 2024-04-16T14:35:44.546 INFO:tasks.workunit.client.0.smithi005.stdout:3/909: dread - d2/d17/d46/d75/d6d/dd0/dda/f116 zero size 2024-04-16T14:35:44.546 INFO:tasks.workunit.client.0.smithi005.stdout:3/910: creat d2/d9/df/dbf/f140 x:0 0 0 2024-04-16T14:35:44.551 INFO:tasks.workunit.client.1.smithi115.stdout:4/701: creat d1/d15/d24/dc6/fd5 x:0 0 0 2024-04-16T14:35:44.551 INFO:tasks.workunit.client.1.smithi115.stdout:4/702: write d1/d15/d31/d42/da4/dc0/fd4 [25357,125240] 0 2024-04-16T14:35:44.552 INFO:tasks.workunit.client.1.smithi115.stdout:4/703: creat d1/d15/d1e/fd6 x:0 0 0 2024-04-16T14:35:44.552 INFO:tasks.workunit.client.1.smithi115.stdout:2/851: sync 2024-04-16T14:35:44.552 INFO:tasks.workunit.client.1.smithi115.stdout:2/852: dread - d0/d47/fe0 zero size 2024-04-16T14:35:44.552 INFO:tasks.workunit.client.1.smithi115.stdout:2/853: creat d0/d47/d65/dad/dc8/d24/d23/d83/de7/f113 x:0 0 0 2024-04-16T14:35:44.553 INFO:tasks.workunit.client.1.smithi115.stdout:9/783: unlink d1/d6/d2d/d3d/fcd 0 2024-04-16T14:35:44.554 INFO:tasks.workunit.client.0.smithi005.stdout:8/802: symlink d5/d7b/da8/db7/d8a/l11b 0 2024-04-16T14:35:44.554 INFO:tasks.workunit.client.0.smithi005.stdout:8/803: write d5/d40/d4b/f117 [909674,63031] 0 2024-04-16T14:35:44.554 INFO:tasks.workunit.client.0.smithi005.stdout:3/911: link d2/d9/d25/d39/c100 d2/d17/d102/d125/c141 0 2024-04-16T14:35:44.555 INFO:tasks.workunit.client.0.smithi005.stdout:3/912: dread d2/d9/d25/d39/f3b [8388608,4194304] 0 2024-04-16T14:35:44.555 INFO:tasks.workunit.client.0.smithi005.stdout:3/913: truncate d2/d17/d46/d75/d9b/dbd/dee/f11e 4767331 0 2024-04-16T14:35:44.555 INFO:tasks.workunit.client.0.smithi005.stdout:8/804: mknod d5/d7b/da8/db7/d8a/da1/d3d/d7f/d8d/dd1/c11c 0 2024-04-16T14:35:44.555 INFO:tasks.workunit.client.0.smithi005.stdout:3/914: getdents d2/d17/d46/d75/d9b/dbd/dee 0 2024-04-16T14:35:44.555 INFO:tasks.workunit.client.0.smithi005.stdout:3/915: chown d2/d17/d46/d75/d9b/dbd/cf1 0 1 2024-04-16T14:35:44.555 INFO:tasks.workunit.client.0.smithi005.stdout:3/916: write d2/d9/d7d/f136 [445891,101333] 0 2024-04-16T14:35:44.555 INFO:tasks.workunit.client.1.smithi115.stdout:4/704: symlink d1/d15/d31/d42/da4/dc0/ld7 0 2024-04-16T14:35:44.555 INFO:tasks.workunit.client.1.smithi115.stdout:9/784: stat d1/d6/lcc 0 2024-04-16T14:35:44.556 INFO:tasks.workunit.client.0.smithi005.stdout:8/805: link d5/d7b/da8/fe1 d5/d7b/da8/db7/d74/f11d 0 2024-04-16T14:35:44.558 INFO:tasks.workunit.client.0.smithi005.stdout:3/917: unlink d2/d92/fac 0 2024-04-16T14:35:44.558 INFO:tasks.workunit.client.1.smithi115.stdout:9/785: rename d1/d6/l16 to d1/d6/d2d/d4b/d6c/d20/d36/l116 0 2024-04-16T14:35:44.559 INFO:tasks.workunit.client.0.smithi005.stdout:0/765: dwrite da/df/d1b/d24/ff5 [0,4194304] 0 2024-04-16T14:35:44.560 INFO:tasks.workunit.client.1.smithi115.stdout:5/711: dwrite dc/d3d/d41/f46 [0,4194304] 0 2024-04-16T14:35:44.560 INFO:tasks.workunit.client.1.smithi115.stdout:9/786: link d1/d6/d29/lf5 d1/d6/d2d/d4b/d60/d65/l117 0 2024-04-16T14:35:44.560 INFO:tasks.workunit.client.1.smithi115.stdout:9/787: creat d1/d6/f118 x:0 0 0 2024-04-16T14:35:44.560 INFO:tasks.workunit.client.1.smithi115.stdout:2/854: dread d0/d47/d65/fec [0,4194304] 0 2024-04-16T14:35:44.561 INFO:tasks.workunit.client.1.smithi115.stdout:5/712: creat dc/d3d/d41/fd6 x:0 0 0 2024-04-16T14:35:44.562 INFO:tasks.workunit.client.0.smithi005.stdout:8/806: symlink d5/d7b/l11e 0 2024-04-16T14:35:44.562 INFO:tasks.workunit.client.0.smithi005.stdout:8/807: write d5/d7b/da8/db7/d8a/da1/d3d/d7f/d8d/dd1/f108 [1498565,88488] 0 2024-04-16T14:35:44.562 INFO:tasks.workunit.client.0.smithi005.stdout:8/808: chown d5/d7b/da8/db7/d8a/da1/d3d/dba/dcd/ffd 349783284 1 2024-04-16T14:35:44.563 INFO:tasks.workunit.client.1.smithi115.stdout:9/788: creat d1/d6/d2d/d3d/d49/d98/daa/f119 x:0 0 0 2024-04-16T14:35:44.563 INFO:tasks.workunit.client.0.smithi005.stdout:3/918: symlink d2/d9/d25/d39/l142 0 2024-04-16T14:35:44.564 INFO:tasks.workunit.client.1.smithi115.stdout:2/855: rename d0/d47/d65/dad/dbb/d11/ce8 to d0/c114 0 2024-04-16T14:35:44.564 INFO:tasks.workunit.client.1.smithi115.stdout:2/856: readlink d0/d47/d65/dad/dc8/l4d 0 2024-04-16T14:35:44.564 INFO:tasks.workunit.client.1.smithi115.stdout:5/713: creat dc/d5d/d81/fd7 x:0 0 0 2024-04-16T14:35:44.565 INFO:tasks.workunit.client.0.smithi005.stdout:0/766: creat da/df/d1b/d3a/d53/dbc/f102 x:0 0 0 2024-04-16T14:35:44.566 INFO:tasks.workunit.client.1.smithi115.stdout:9/789: creat d1/d6/de0/f11a x:0 0 0 2024-04-16T14:35:44.566 INFO:tasks.workunit.client.1.smithi115.stdout:9/790: write d1/d7f/fa1 [1185755,78724] 0 2024-04-16T14:35:44.566 INFO:tasks.workunit.client.1.smithi115.stdout:9/791: fsync d1/d6/d2d/d4b/d60/d65/dc6/fde 0 2024-04-16T14:35:44.566 INFO:tasks.workunit.client.1.smithi115.stdout:9/792: readlink d1/d6/d2d/d4b/d90/lb1 0 2024-04-16T14:35:44.567 INFO:tasks.workunit.client.1.smithi115.stdout:2/857: link d0/d47/d65/dad/dc8/d24/da0/fd9 d0/d47/d65/dad/dc8/d24/d21/d59/f115 0 2024-04-16T14:35:44.567 INFO:tasks.workunit.client.1.smithi115.stdout:5/714: rmdir dc/d3d 39 2024-04-16T14:35:44.567 INFO:tasks.workunit.client.1.smithi115.stdout:5/715: fsync dc/f26 0 2024-04-16T14:35:44.567 INFO:tasks.workunit.client.1.smithi115.stdout:5/716: truncate dc/d79/fb7 263468 0 2024-04-16T14:35:44.567 INFO:tasks.workunit.client.1.smithi115.stdout:2/858: getdents d0/d47 0 2024-04-16T14:35:44.568 INFO:tasks.workunit.client.1.smithi115.stdout:5/717: getdents dc/d15/d35/d69 0 2024-04-16T14:35:44.569 INFO:tasks.workunit.client.0.smithi005.stdout:8/809: rename d5/d7b/da8/db7/ff3 to d5/d7b/da8/db7/d8a/da1/d3d/d7f/d8d/dd1/f11f 0 2024-04-16T14:35:44.569 INFO:tasks.workunit.client.1.smithi115.stdout:2/859: rename d0/d47/d65/dad/dbb/d11/d36/l5f to d0/d47/d65/dad/dc8/d24/d21/l116 0 2024-04-16T14:35:44.571 INFO:tasks.workunit.client.1.smithi115.stdout:5/718: unlink dc/d5d/d8f/ca8 0 2024-04-16T14:35:44.571 INFO:tasks.workunit.client.0.smithi005.stdout:8/810: truncate d5/d11/f5f 3159198 0 2024-04-16T14:35:44.571 INFO:tasks.workunit.client.1.smithi115.stdout:2/860: truncate d0/d1b/f99 3921791 0 2024-04-16T14:35:44.572 INFO:tasks.workunit.client.1.smithi115.stdout:5/719: mknod dc/d3d/d68/cd8 0 2024-04-16T14:35:44.573 INFO:tasks.workunit.client.1.smithi115.stdout:9/793: write d1/d6/d33/f85 [31030,58941] 0 2024-04-16T14:35:44.573 INFO:tasks.workunit.client.1.smithi115.stdout:9/794: truncate d1/d6/d2d/d4b/d8f/d91/f58 1985399 0 2024-04-16T14:35:44.574 INFO:tasks.workunit.client.1.smithi115.stdout:4/705: dwrite d1/d15/d31/f98 [0,4194304] 0 2024-04-16T14:35:44.574 INFO:tasks.workunit.client.1.smithi115.stdout:2/861: mkdir d0/d47/d65/dad/dc8/d57/d117 0 2024-04-16T14:35:44.575 INFO:tasks.workunit.client.0.smithi005.stdout:3/919: write d2/d17/d46/d75/d6d/df3/ff9 [1465444,98706] 0 2024-04-16T14:35:44.576 INFO:tasks.workunit.client.0.smithi005.stdout:3/920: chown d2/d6b 0 1 2024-04-16T14:35:44.576 INFO:tasks.workunit.client.0.smithi005.stdout:3/921: truncate d2/d17/d46/d75/f42 986324 0 2024-04-16T14:35:44.576 INFO:tasks.workunit.client.0.smithi005.stdout:3/922: dread d2/d17/d46/d75/f8f [0,4194304] 0 2024-04-16T14:35:44.578 INFO:tasks.workunit.client.0.smithi005.stdout:3/923: creat d2/d17/d46/f143 x:0 0 0 2024-04-16T14:35:44.578 INFO:tasks.workunit.client.0.smithi005.stdout:3/924: chown d2/d9/d25/d39/d64/fa9 127995 1 2024-04-16T14:35:44.578 INFO:tasks.workunit.client.0.smithi005.stdout:3/925: chown d2/f44 743319117 1 2024-04-16T14:35:44.579 INFO:tasks.workunit.client.1.smithi115.stdout:4/706: rmdir d1/d15/d17 39 2024-04-16T14:35:44.579 INFO:tasks.workunit.client.1.smithi115.stdout:2/862: symlink d0/d47/dc9/l118 0 2024-04-16T14:35:44.579 INFO:tasks.workunit.client.0.smithi005.stdout:3/926: creat d2/d17/d46/d75/d9b/dbd/dee/d12d/f144 x:0 0 0 2024-04-16T14:35:44.580 INFO:tasks.workunit.client.1.smithi115.stdout:4/707: mknod d1/d2/cd8 0 2024-04-16T14:35:44.580 INFO:tasks.workunit.client.1.smithi115.stdout:4/708: chown d1/d15/d24/c71 8855204 1 2024-04-16T14:35:44.580 INFO:tasks.workunit.client.1.smithi115.stdout:4/709: chown d1/d2/c36 1737850 1 2024-04-16T14:35:44.582 INFO:tasks.workunit.client.0.smithi005.stdout:3/927: rename d2/d17/d46/d75/d6d/f73 to d2/d9/df/daa/f145 0 2024-04-16T14:35:44.593 INFO:tasks.workunit.client.0.smithi005.stdout:0/767: dwrite da/df/d26/f4c [0,4194304] 0 2024-04-16T14:35:44.594 INFO:tasks.workunit.client.1.smithi115.stdout:2/863: write d0/d47/d65/dad/dbb/d11/d6d/fbd [2389001,63162] 0 2024-04-16T14:35:44.594 INFO:tasks.workunit.client.1.smithi115.stdout:2/864: write d0/d47/d65/dad/dc8/f7 [1075119,90031] 0 2024-04-16T14:35:44.595 INFO:tasks.workunit.client.1.smithi115.stdout:2/865: creat d0/d47/d65/dad/dc8/d57/f119 x:0 0 0 2024-04-16T14:35:44.595 INFO:tasks.workunit.client.1.smithi115.stdout:2/866: creat d0/d47/d65/dad/f11a x:0 0 0 2024-04-16T14:35:44.598 INFO:tasks.workunit.client.0.smithi005.stdout:3/928: write d2/d9/df/f1c [2240883,27772] 0 2024-04-16T14:35:44.599 INFO:tasks.workunit.client.0.smithi005.stdout:3/929: creat d2/d17/d46/d47/deb/f146 x:0 0 0 2024-04-16T14:35:44.599 INFO:tasks.workunit.client.1.smithi115.stdout:2/867: creat d0/d47/d65/dad/dbb/d11/d36/d86/f11b x:0 0 0 2024-04-16T14:35:44.600 INFO:tasks.workunit.client.1.smithi115.stdout:2/868: write d0/d47/d65/dad/dc8/d24/d23/d80/f109 [66999,67812] 0 2024-04-16T14:35:44.601 INFO:tasks.workunit.client.1.smithi115.stdout:2/869: dread d0/d47/d65/d61/dae/f6f [0,4194304] 0 2024-04-16T14:35:44.602 INFO:tasks.workunit.client.1.smithi115.stdout:2/870: mknod d0/d47/d65/dad/dc8/d24/da0/c11c 0 2024-04-16T14:35:44.603 INFO:tasks.workunit.client.1.smithi115.stdout:2/871: mknod d0/d47/d65/dad/dc8/c11d 0 2024-04-16T14:35:44.603 INFO:tasks.workunit.client.1.smithi115.stdout:2/872: symlink d0/d47/d65/dad/dc8/d24/dc7/l11e 0 2024-04-16T14:35:44.605 INFO:tasks.workunit.client.1.smithi115.stdout:2/873: mkdir d0/d47/d65/dad/dbb/d11/d6d/d11f 0 2024-04-16T14:35:44.605 INFO:tasks.workunit.client.1.smithi115.stdout:2/874: dread - d0/d47/d65/dad/dc8/d24/d21/d59/fd6 zero size 2024-04-16T14:35:44.605 INFO:tasks.workunit.client.1.smithi115.stdout:2/875: link d0/c28 d0/d47/dc9/c120 0 2024-04-16T14:35:44.607 INFO:tasks.workunit.client.0.smithi005.stdout:3/930: write d2/d92/fc0 [3404119,123763] 0 2024-04-16T14:35:44.607 INFO:tasks.workunit.client.0.smithi005.stdout:3/931: truncate d2/d17/d46/d75/d6d/df3/f134 157674 0 2024-04-16T14:35:44.607 INFO:tasks.workunit.client.0.smithi005.stdout:8/811: dwrite d5/d7b/da8/db7/d8a/da1/d3d/f3f [4194304,4194304] 0 2024-04-16T14:35:44.608 INFO:tasks.workunit.client.1.smithi115.stdout:9/795: dwrite d1/d6/d2d/d4b/d8f/fc4 [0,4194304] 0 2024-04-16T14:35:44.608 INFO:tasks.workunit.client.1.smithi115.stdout:9/796: readlink d1/d6/d2d/d3d/l7e 0 2024-04-16T14:35:44.608 INFO:tasks.workunit.client.1.smithi115.stdout:9/797: write d1/d6/d29/f57 [985260,81599] 0 2024-04-16T14:35:44.609 INFO:tasks.workunit.client.1.smithi115.stdout:5/720: dwrite dc/d3d/f6a [0,4194304] 0 2024-04-16T14:35:44.609 INFO:tasks.workunit.client.1.smithi115.stdout:5/721: chown dc/d15/d35/d69/lc9 1 1 2024-04-16T14:35:44.609 INFO:tasks.workunit.client.0.smithi005.stdout:3/932: symlink d2/d9/d25/d39/d64/l147 0 2024-04-16T14:35:44.611 INFO:tasks.workunit.client.0.smithi005.stdout:8/812: write d5/d7b/da8/db7/d8a/da1/f34 [553247,96277] 0 2024-04-16T14:35:44.611 INFO:tasks.workunit.client.0.smithi005.stdout:8/813: stat d5/d7b/da8/db7/f5b 0 2024-04-16T14:35:44.611 INFO:tasks.workunit.client.0.smithi005.stdout:8/814: write d5/d7b/da8/da5/def/f110 [273736,7210] 0 2024-04-16T14:35:44.612 INFO:tasks.workunit.client.1.smithi115.stdout:9/798: chown d1/d6/d2d/l2f 455736701 1 2024-04-16T14:35:44.615 INFO:tasks.workunit.client.1.smithi115.stdout:2/876: write d0/d47/f7f [3410215,128023] 0 2024-04-16T14:35:44.615 INFO:tasks.workunit.client.1.smithi115.stdout:2/877: write d0/d47/d65/dad/dc8/d24/f44 [755111,26005] 0 2024-04-16T14:35:44.621 INFO:tasks.workunit.client.1.smithi115.stdout:4/710: write d1/d15/d31/d42/d46/f6c [3433563,49768] 0 2024-04-16T14:35:44.621 INFO:tasks.workunit.client.1.smithi115.stdout:4/711: truncate d1/d15/d31/d42/d46/fc8 32856 0 2024-04-16T14:35:44.623 INFO:tasks.workunit.client.1.smithi115.stdout:9/799: unlink d1/d6/d2d/d4b/d90/lb3 0 2024-04-16T14:35:44.624 INFO:tasks.workunit.client.1.smithi115.stdout:2/878: symlink d0/d47/d65/d61/dae/l121 0 2024-04-16T14:35:44.626 INFO:tasks.workunit.client.1.smithi115.stdout:9/800: link d1/d6/d2d/d3d/d49/fb6 d1/d6/de0/d100/f11b 0 2024-04-16T14:35:44.626 INFO:tasks.workunit.client.1.smithi115.stdout:9/801: write d1/d6/d29/f54 [472622,75866] 0 2024-04-16T14:35:44.626 INFO:tasks.workunit.client.1.smithi115.stdout:9/802: dread - d1/d6/d2d/d4b/d6c/f77 zero size 2024-04-16T14:35:44.627 INFO:tasks.workunit.client.1.smithi115.stdout:2/879: mknod d0/d47/d65/dad/c122 0 2024-04-16T14:35:44.627 INFO:tasks.workunit.client.1.smithi115.stdout:5/722: dwrite dc/d15/d4d/f6f [0,4194304] 0 2024-04-16T14:35:44.627 INFO:tasks.workunit.client.1.smithi115.stdout:5/723: fsync dc/d15/f78 0 2024-04-16T14:35:44.627 INFO:tasks.workunit.client.1.smithi115.stdout:9/803: getdents d1/d6/d2d/d3d/d49/d88 0 2024-04-16T14:35:44.628 INFO:tasks.workunit.client.0.smithi005.stdout:3/933: mknod d2/d9/d5e/c148 0 2024-04-16T14:35:44.629 INFO:tasks.workunit.client.1.smithi115.stdout:2/880: unlink d0/d47/d65/dad/dc8/d24/d21/d59/f115 0 2024-04-16T14:35:44.631 INFO:tasks.workunit.client.0.smithi005.stdout:8/815: symlink d5/d55/d5a/l120 0 2024-04-16T14:35:44.632 INFO:tasks.workunit.client.1.smithi115.stdout:5/724: symlink dc/d3d/d68/ld9 0 2024-04-16T14:35:44.632 INFO:tasks.workunit.client.1.smithi115.stdout:4/712: dread d1/f6b [0,4194304] 0 2024-04-16T14:35:44.633 INFO:tasks.workunit.client.1.smithi115.stdout:4/713: fsync d1/d15/f4d 0 2024-04-16T14:35:44.633 INFO:tasks.workunit.client.0.smithi005.stdout:3/934: truncate d2/d6b/d7a/f8c 908351 0 2024-04-16T14:35:44.637 INFO:tasks.workunit.client.0.smithi005.stdout:3/935: mknod d2/d17/d46/d75/d41/d124/c149 0 2024-04-16T14:35:44.638 INFO:tasks.workunit.client.1.smithi115.stdout:1/759: sync 2024-04-16T14:35:44.638 INFO:tasks.workunit.client.1.smithi115.stdout:3/744: sync 2024-04-16T14:35:44.638 INFO:tasks.workunit.client.1.smithi115.stdout:9/804: unlink d1/d6/d2d/d4b/f5a 0 2024-04-16T14:35:44.639 INFO:tasks.workunit.client.1.smithi115.stdout:5/725: creat dc/d15/d35/d69/dad/fda x:0 0 0 2024-04-16T14:35:44.639 INFO:tasks.workunit.client.1.smithi115.stdout:5/726: stat dc/d5d/d81/cb2 0 2024-04-16T14:35:44.640 INFO:tasks.workunit.client.1.smithi115.stdout:3/745: creat dc/d29/d77/ffa x:0 0 0 2024-04-16T14:35:44.641 INFO:tasks.workunit.client.1.smithi115.stdout:1/760: creat df/d13/d4d/d6d/dc5/f105 x:0 0 0 2024-04-16T14:35:44.643 INFO:tasks.workunit.client.1.smithi115.stdout:3/746: creat dc/d29/d39/d86/dd0/dee/ffb x:0 0 0 2024-04-16T14:35:44.643 INFO:tasks.workunit.client.1.smithi115.stdout:9/805: rename d1/d6/d2d/d4b/l6d to d1/d6/d2d/d4b/d8f/d91/dda/ddd/de8/d112/l11c 0 2024-04-16T14:35:44.643 INFO:tasks.workunit.client.1.smithi115.stdout:9/806: dread - d1/d6/d2d/d3d/d49/d88/fbc zero size 2024-04-16T14:35:44.643 INFO:tasks.workunit.client.1.smithi115.stdout:9/807: chown d1/d6/de0 15220 1 2024-04-16T14:35:44.643 INFO:tasks.workunit.client.1.smithi115.stdout:9/808: dread - d1/d6/d2d/d4b/d60/d65/dc6/fde zero size 2024-04-16T14:35:44.646 INFO:tasks.workunit.client.1.smithi115.stdout:5/727: link dc/d5d/d81/fd7 dc/d15/d4d/fdb 0 2024-04-16T14:35:44.646 INFO:tasks.workunit.client.1.smithi115.stdout:5/728: stat dc/d3d/d68/d7b/f89 0 2024-04-16T14:35:44.646 INFO:tasks.workunit.client.1.smithi115.stdout:5/729: write dc/d3d/d41/f54 [1594211,84080] 0 2024-04-16T14:35:44.648 INFO:tasks.workunit.client.1.smithi115.stdout:9/809: unlink d1/d6/d2d/d4b/d6c/d20/d36/f8a 0 2024-04-16T14:35:44.649 INFO:tasks.workunit.client.1.smithi115.stdout:9/810: fdatasync d1/d6/d29/f10d 0 2024-04-16T14:35:44.649 INFO:tasks.workunit.client.1.smithi115.stdout:9/811: creat d1/d6/d2d/d4b/d6c/d20/d36/f11d x:0 0 0 2024-04-16T14:35:44.649 INFO:tasks.workunit.client.1.smithi115.stdout:9/812: fdatasync d1/d6/d29/f32 0 2024-04-16T14:35:44.650 INFO:tasks.workunit.client.1.smithi115.stdout:5/730: creat dc/d15/d35/d69/fdc x:0 0 0 2024-04-16T14:35:44.650 INFO:tasks.workunit.client.1.smithi115.stdout:5/731: chown dc/d3d/d68/ld9 13598 1 2024-04-16T14:35:44.650 INFO:tasks.workunit.client.1.smithi115.stdout:5/732: dread - dc/d3d/d41/fd6 zero size 2024-04-16T14:35:44.650 INFO:tasks.workunit.client.1.smithi115.stdout:5/733: write dc/d15/fcd [78684,4784] 0 2024-04-16T14:35:44.651 INFO:tasks.workunit.client.0.smithi005.stdout:3/936: dwrite d2/d17/d46/d75/f8f [0,4194304] 0 2024-04-16T14:35:44.651 INFO:tasks.workunit.client.1.smithi115.stdout:9/813: write d1/d6/d2d/d3d/d50/f94 [40176,52433] 0 2024-04-16T14:35:44.652 INFO:tasks.workunit.client.1.smithi115.stdout:3/747: dread dc/d24/d36/d60/dae/fb7 [0,4194304] 0 2024-04-16T14:35:44.653 INFO:tasks.workunit.client.1.smithi115.stdout:5/734: rename dc/d15/d35/d69/dad/lb8 to dc/d15/d2d/d8c/ldd 0 2024-04-16T14:35:44.654 INFO:tasks.workunit.client.0.smithi005.stdout:3/937: creat d2/d9/df/daa/d127/d12a/f14a x:0 0 0 2024-04-16T14:35:44.654 INFO:tasks.workunit.client.0.smithi005.stdout:3/938: read - d2/d17/d46/d75/d41/d79/fd2 zero size 2024-04-16T14:35:44.655 INFO:tasks.workunit.client.0.smithi005.stdout:3/939: symlink d2/d9/df/dbf/l14b 0 2024-04-16T14:35:44.655 INFO:tasks.workunit.client.1.smithi115.stdout:9/814: mknod d1/d6/d2d/d3d/db7/c11e 0 2024-04-16T14:35:44.655 INFO:tasks.workunit.client.1.smithi115.stdout:9/815: chown d1/d6/d2d/l2f 3733853 1 2024-04-16T14:35:44.656 INFO:tasks.workunit.client.1.smithi115.stdout:3/748: mkdir dc/d24/d80/dfc 0 2024-04-16T14:35:44.657 INFO:tasks.workunit.client.0.smithi005.stdout:3/940: mknod d2/d17/d46/d75/c14c 0 2024-04-16T14:35:44.658 INFO:tasks.workunit.client.1.smithi115.stdout:9/816: link d1/d6/d2d/d4b/d6c/d20/d36/l47 d1/d6/d2d/d4b/d60/l11f 0 2024-04-16T14:35:44.658 INFO:tasks.workunit.client.1.smithi115.stdout:0/582: sync 2024-04-16T14:35:44.659 INFO:tasks.workunit.client.1.smithi115.stdout:7/642: sync 2024-04-16T14:35:44.659 INFO:tasks.workunit.client.1.smithi115.stdout:0/583: chown d6/d10/d12/d1f/d36/d4b/d6d/l2b 1 1 2024-04-16T14:35:44.659 INFO:tasks.workunit.client.1.smithi115.stdout:3/749: link dc/d29/d39/d86/fe9 dc/ffd 0 2024-04-16T14:35:44.659 INFO:tasks.workunit.client.1.smithi115.stdout:3/750: write dc/f18 [2446406,11808] 0 2024-04-16T14:35:44.660 INFO:tasks.workunit.client.1.smithi115.stdout:7/643: symlink d0/d24/da3/db1/d49/dbc/dd1/ld5 0 2024-04-16T14:35:44.660 INFO:tasks.workunit.client.1.smithi115.stdout:3/751: mkdir dc/d24/dfe 0 2024-04-16T14:35:44.660 INFO:tasks.workunit.client.1.smithi115.stdout:7/644: link d0/d2/d3a/d73/c88 d0/d2/d3a/d30/d6b/da2/d81/dd0/cd6 0 2024-04-16T14:35:44.661 INFO:tasks.workunit.client.1.smithi115.stdout:3/752: creat dc/d24/d33/d4b/fff x:0 0 0 2024-04-16T14:35:44.661 INFO:tasks.workunit.client.1.smithi115.stdout:3/753: stat dc/d29/d4d/f59 0 2024-04-16T14:35:44.661 INFO:tasks.workunit.client.1.smithi115.stdout:3/754: write dc/d29/d4d/d56/d98/fb8 [660206,23548] 0 2024-04-16T14:35:44.662 INFO:tasks.workunit.client.1.smithi115.stdout:3/755: rmdir dc/d24/d33/dde 39 2024-04-16T14:35:44.664 INFO:tasks.workunit.client.1.smithi115.stdout:7/645: link d0/d24/da3/db1/d3f/fae d0/d2/d3a/d30/d79/dd2/fd7 0 2024-04-16T14:35:44.664 INFO:tasks.workunit.client.1.smithi115.stdout:7/646: write d0/d2/d3a/d30/d6b/f87 [3509226,29995] 0 2024-04-16T14:35:44.666 INFO:tasks.workunit.client.1.smithi115.stdout:9/817: dread d1/d6/d2d/d3d/d50/dab/fc8 [0,4194304] 0 2024-04-16T14:35:44.667 INFO:tasks.workunit.client.1.smithi115.stdout:1/761: dwrite df/d13/d4d/d68/de7/d55/f6f [0,4194304] 0 2024-04-16T14:35:44.668 INFO:tasks.workunit.client.1.smithi115.stdout:7/647: rename d0/d24/da3/db1/d3f/d7a to d0/d24/da3/db1/dd8 0 2024-04-16T14:35:44.671 INFO:tasks.workunit.client.1.smithi115.stdout:0/584: write d6/d10/d12/d1f/d36/d4b/f69 [3640813,92260] 0 2024-04-16T14:35:44.671 INFO:tasks.workunit.client.1.smithi115.stdout:5/735: dread dc/d15/f5f [0,4194304] 0 2024-04-16T14:35:44.671 INFO:tasks.workunit.client.1.smithi115.stdout:5/736: chown dc/d15/d35/f48 871 1 2024-04-16T14:35:44.672 INFO:tasks.workunit.client.1.smithi115.stdout:1/762: mknod df/d13/d4d/d6d/dc5/c106 0 2024-04-16T14:35:44.672 INFO:tasks.workunit.client.1.smithi115.stdout:1/763: dread - df/d13/d4d/d68/da0/ff1 zero size 2024-04-16T14:35:44.674 INFO:tasks.workunit.client.1.smithi115.stdout:7/648: creat d0/d2/d3a/d30/d79/dd2/d64/fd9 x:0 0 0 2024-04-16T14:35:44.676 INFO:tasks.workunit.client.1.smithi115.stdout:0/585: rename d6/d10/d12/d31/d35/f3c to d6/d10/d12/d31/d35/d44/d85/fc6 0 2024-04-16T14:35:44.676 INFO:tasks.workunit.client.1.smithi115.stdout:0/586: chown d6/d30/d8d 24 1 2024-04-16T14:35:44.678 INFO:tasks.workunit.client.1.smithi115.stdout:5/737: mkdir dc/d15/d4d/dde 0 2024-04-16T14:35:44.681 INFO:tasks.workunit.client.1.smithi115.stdout:7/649: rename d0/d24/da3/db1/d49/db5 to d0/d2/d3a/dda 0 2024-04-16T14:35:44.683 INFO:tasks.workunit.client.1.smithi115.stdout:5/738: chown dc/d15/l55 825 1 2024-04-16T14:35:44.685 INFO:tasks.workunit.client.1.smithi115.stdout:1/764: getdents df/d2d 0 2024-04-16T14:35:44.685 INFO:tasks.workunit.client.1.smithi115.stdout:1/765: write df/d35/d48/f8e [1354868,13625] 0 2024-04-16T14:35:44.687 INFO:tasks.workunit.client.1.smithi115.stdout:7/650: mknod d0/d24/cdb 0 2024-04-16T14:35:44.688 INFO:tasks.workunit.client.1.smithi115.stdout:9/818: dwrite d1/d6/d2d/d4b/d90/fa0 [8388608,4194304] 0 2024-04-16T14:35:44.691 INFO:tasks.workunit.client.1.smithi115.stdout:3/756: dwrite dc/d24/d36/f3b [0,4194304] 0 2024-04-16T14:35:44.691 INFO:tasks.workunit.client.1.smithi115.stdout:3/757: creat dc/d24/d33/d4b/da3/d69/de1/f100 x:0 0 0 2024-04-16T14:35:44.691 INFO:tasks.workunit.client.1.smithi115.stdout:3/758: chown f6 26963906 1 2024-04-16T14:35:44.695 INFO:tasks.workunit.client.1.smithi115.stdout:1/766: symlink df/d13/d4d/d3e/d75/da9/db7/l107 0 2024-04-16T14:35:44.698 INFO:tasks.workunit.client.1.smithi115.stdout:5/739: read dc/d15/f24 [1120242,96817] 0 2024-04-16T14:35:44.699 INFO:tasks.workunit.client.1.smithi115.stdout:7/651: symlink d0/d2/d3a/d30/d79/dd2/d64/ldc 0 2024-04-16T14:35:44.701 INFO:tasks.workunit.client.0.smithi005.stdout:3/941: dwrite d2/d17/d46/d47/f78 [0,4194304] 0 2024-04-16T14:35:44.703 INFO:tasks.workunit.client.1.smithi115.stdout:9/819: mkdir d1/d6/d2d/d4b/d8f/d91/dda/ddd/dfc/d120 0 2024-04-16T14:35:44.704 INFO:tasks.workunit.client.0.smithi005.stdout:3/942: getdents d2/d17/d46/d75/d6d/dd0 0 2024-04-16T14:35:44.707 INFO:tasks.workunit.client.0.smithi005.stdout:3/943: mkdir d2/d9/d14d 0 2024-04-16T14:35:44.708 INFO:tasks.workunit.client.1.smithi115.stdout:3/759: dwrite dc/ff [0,4194304] 0 2024-04-16T14:35:44.708 INFO:tasks.workunit.client.1.smithi115.stdout:1/767: mkdir df/d2d/d108 0 2024-04-16T14:35:44.709 INFO:tasks.workunit.client.0.smithi005.stdout:3/944: symlink d2/l14e 0 2024-04-16T14:35:44.709 INFO:tasks.workunit.client.0.smithi005.stdout:3/945: creat d2/d9/df/dbf/f14f x:0 0 0 2024-04-16T14:35:44.709 INFO:tasks.workunit.client.0.smithi005.stdout:3/946: write d2/d92/f11c [326973,119676] 0 2024-04-16T14:35:44.711 INFO:tasks.workunit.client.1.smithi115.stdout:5/740: symlink dc/d5d/d8f/ldf 0 2024-04-16T14:35:44.712 INFO:tasks.workunit.client.1.smithi115.stdout:9/820: mknod d1/d6/d2d/d3d/d49/d88/c121 0 2024-04-16T14:35:44.713 INFO:tasks.workunit.client.0.smithi005.stdout:3/947: creat d2/d17/d102/d125/f150 x:0 0 0 2024-04-16T14:35:44.713 INFO:tasks.workunit.client.0.smithi005.stdout:3/948: dread - d2/d17/d46/d47/deb/f128 zero size 2024-04-16T14:35:44.713 INFO:tasks.workunit.client.0.smithi005.stdout:3/949: fdatasync d2/d9/df/dbf/fdb 0 2024-04-16T14:35:44.713 INFO:tasks.workunit.client.1.smithi115.stdout:1/768: link df/d13/d72/lf6 df/d35/d84/ddc/de0/df2/l109 0 2024-04-16T14:35:44.715 INFO:tasks.workunit.client.1.smithi115.stdout:5/741: rename dc/d15/d4d/fa4 to dc/d15/d35/d69/dad/fe0 0 2024-04-16T14:35:44.717 INFO:tasks.workunit.client.1.smithi115.stdout:9/821: mknod d1/d6/d2d/d3d/d50/c122 0 2024-04-16T14:35:44.720 INFO:tasks.workunit.client.1.smithi115.stdout:9/822: symlink d1/d6/d2d/d3d/d49/d88/l123 0 2024-04-16T14:35:44.721 INFO:tasks.workunit.client.1.smithi115.stdout:9/823: write d1/d7f/f93 [1155193,95835] 0 2024-04-16T14:35:44.722 INFO:tasks.workunit.client.1.smithi115.stdout:7/652: dwrite d0/d2/d3a/d30/d6b/da2/d81/f92 [4194304,4194304] 0 2024-04-16T14:35:44.724 INFO:tasks.workunit.client.1.smithi115.stdout:7/653: mknod d0/d2/d3a/d30/d6b/da2/d81/cdd 0 2024-04-16T14:35:44.726 INFO:tasks.workunit.client.1.smithi115.stdout:9/824: getdents d1/d6/d33 0 2024-04-16T14:35:44.729 INFO:tasks.workunit.client.1.smithi115.stdout:9/825: unlink d1/d6/d2d/d3d/db7/c11e 0 2024-04-16T14:35:44.729 INFO:tasks.workunit.client.1.smithi115.stdout:6/721: sync 2024-04-16T14:35:44.729 INFO:tasks.workunit.client.1.smithi115.stdout:8/771: sync 2024-04-16T14:35:44.730 INFO:tasks.workunit.client.0.smithi005.stdout:3/950: dwrite d2/d17/d46/d75/d9b/dbd/dee/d12d/f144 [0,4194304] 0 2024-04-16T14:35:44.730 INFO:tasks.workunit.client.1.smithi115.stdout:9/826: creat d1/d6/de0/d100/f124 x:0 0 0 2024-04-16T14:35:44.731 INFO:tasks.workunit.client.1.smithi115.stdout:8/772: creat d0/db/d10/d17/ffe x:0 0 0 2024-04-16T14:35:44.732 INFO:tasks.workunit.client.1.smithi115.stdout:6/722: mknod d13/d1d/d2b/d5f/d30/d43/d2c/cf0 0 2024-04-16T14:35:44.732 INFO:tasks.workunit.client.1.smithi115.stdout:6/723: readlink d13/d1d/d52/lbb 0 2024-04-16T14:35:44.736 INFO:tasks.workunit.client.1.smithi115.stdout:8/773: link d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/d8a/fc3 d0/db/d10/d17/d2c/d52/d6c/db8/d64/d83/fff 0 2024-04-16T14:35:44.736 INFO:tasks.workunit.client.1.smithi115.stdout:9/827: link d1/d6/d2d/d4b/d6c/d20/ld5 d1/ddb/l125 0 2024-04-16T14:35:44.737 INFO:tasks.workunit.client.1.smithi115.stdout:6/724: rename d13/d1d/d2b/d5f/d30/d43/d2c/fb4 to d13/d1d/d87/ff1 0 2024-04-16T14:35:44.737 INFO:tasks.workunit.client.1.smithi115.stdout:7/654: dread d0/d1/f20 [0,4194304] 0 2024-04-16T14:35:44.737 INFO:tasks.workunit.client.1.smithi115.stdout:7/655: creat d0/d2/d3a/d30/d6b/fde x:0 0 0 2024-04-16T14:35:44.738 INFO:tasks.workunit.client.1.smithi115.stdout:7/656: chown d0/d24/da3/db1/d5a/l69 2784 1 2024-04-16T14:35:44.738 INFO:tasks.workunit.client.0.smithi005.stdout:3/951: link d2/d9/d7d/lec d2/d17/d102/d125/l151 0 2024-04-16T14:35:44.739 INFO:tasks.workunit.client.0.smithi005.stdout:3/952: mkdir d2/d9/d5e/d152 0 2024-04-16T14:35:44.741 INFO:tasks.workunit.client.0.smithi005.stdout:0/768: sync 2024-04-16T14:35:44.741 INFO:tasks.workunit.client.0.smithi005.stdout:6/975: sync 2024-04-16T14:35:44.741 INFO:tasks.workunit.client.0.smithi005.stdout:2/718: sync 2024-04-16T14:35:44.741 INFO:tasks.workunit.client.0.smithi005.stdout:0/769: chown da/df/d50/f63 5306 1 2024-04-16T14:35:44.742 INFO:tasks.workunit.client.0.smithi005.stdout:2/719: getdents d0/d2a/d3a/d46/dd8 0 2024-04-16T14:35:44.742 INFO:tasks.workunit.client.1.smithi115.stdout:9/828: creat d1/f126 x:0 0 0 2024-04-16T14:35:44.743 INFO:tasks.workunit.client.1.smithi115.stdout:9/829: dread - d1/d6/d2d/d3d/d50/f10c zero size 2024-04-16T14:35:44.743 INFO:tasks.workunit.client.1.smithi115.stdout:9/830: chown d1/d6/d2d/d3d/d49/d88/fe5 6 1 2024-04-16T14:35:44.745 INFO:tasks.workunit.client.0.smithi005.stdout:2/720: mkdir d0/d2a/d3a/d46/ded 0 2024-04-16T14:35:44.747 INFO:tasks.workunit.client.0.smithi005.stdout:0/770: link da/df/d26/c33 da/df/d1b/d24/d75/d81/c103 0 2024-04-16T14:35:44.749 INFO:tasks.workunit.client.1.smithi115.stdout:9/831: read d1/d6/d2d/d4b/d6c/f44 [562776,118909] 0 2024-04-16T14:35:44.750 INFO:tasks.workunit.client.0.smithi005.stdout:2/721: mknod d0/d1c/d39/dcb/cee 0 2024-04-16T14:35:44.751 INFO:tasks.workunit.client.1.smithi115.stdout:9/832: truncate d1/d6/d33/f6f 263129 0 2024-04-16T14:35:44.754 INFO:tasks.workunit.client.1.smithi115.stdout:1/769: dwrite df/d13/d4d/d68/de7/d55/fe1 [0,4194304] 0 2024-04-16T14:35:44.754 INFO:tasks.workunit.client.1.smithi115.stdout:3/760: dwrite dc/d24/d36/d60/fe8 [0,4194304] 0 2024-04-16T14:35:44.754 INFO:tasks.workunit.client.1.smithi115.stdout:9/833: creat d1/d6/d2d/d4b/d60/f127 x:0 0 0 2024-04-16T14:35:44.755 INFO:tasks.workunit.client.1.smithi115.stdout:6/725: write d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/f9f [1142279,51995] 0 2024-04-16T14:35:44.755 INFO:tasks.workunit.client.0.smithi005.stdout:0/771: getdents da/df/d26/d39/d55/ddc 0 2024-04-16T14:35:44.755 INFO:tasks.workunit.client.0.smithi005.stdout:0/772: write da/df/d1b/d3a/d53/dbc/f102 [742808,3078] 0 2024-04-16T14:35:44.755 INFO:tasks.workunit.client.0.smithi005.stdout:0/773: fdatasync da/df/d1b/d3a/d53/f8f 0 2024-04-16T14:35:44.755 INFO:tasks.workunit.client.0.smithi005.stdout:0/774: stat da/df/d1b/db6/le2 0 2024-04-16T14:35:44.756 INFO:tasks.workunit.client.1.smithi115.stdout:9/834: unlink d1/d6/d2d/d4b/d8f/d91/f58 0 2024-04-16T14:35:44.757 INFO:tasks.workunit.client.1.smithi115.stdout:6/726: symlink d13/d1d/d2b/d5f/lf2 0 2024-04-16T14:35:44.758 INFO:tasks.workunit.client.1.smithi115.stdout:6/727: dread - d13/d1d/d68/fbe zero size 2024-04-16T14:35:44.758 INFO:tasks.workunit.client.1.smithi115.stdout:3/761: dread dc/f3d [0,4194304] 0 2024-04-16T14:35:44.758 INFO:tasks.workunit.client.0.smithi005.stdout:0/775: unlink da/df/d1b/d3a/d53/d5a/l8c 0 2024-04-16T14:35:44.759 INFO:tasks.workunit.client.0.smithi005.stdout:8/816: sync 2024-04-16T14:35:44.759 INFO:tasks.workunit.client.0.smithi005.stdout:9/674: sync 2024-04-16T14:35:44.760 INFO:tasks.workunit.client.0.smithi005.stdout:9/675: write d3/d12/d16/d46/fa7 [275717,105124] 0 2024-04-16T14:35:44.760 INFO:tasks.workunit.client.1.smithi115.stdout:3/762: getdents dc/d24/d36 0 2024-04-16T14:35:44.760 INFO:tasks.workunit.client.1.smithi115.stdout:9/835: creat d1/d6/d2d/f128 x:0 0 0 2024-04-16T14:35:44.760 INFO:tasks.workunit.client.1.smithi115.stdout:9/836: write d1/d6/f3e [1242271,77526] 0 2024-04-16T14:35:44.762 INFO:tasks.workunit.client.0.smithi005.stdout:0/776: link da/df/d1b/d3a/d53/dbc/f102 da/df/d1b/d3a/d96/f104 0 2024-04-16T14:35:44.762 INFO:tasks.workunit.client.1.smithi115.stdout:6/728: symlink d13/d1d/lf3 0 2024-04-16T14:35:44.762 INFO:tasks.workunit.client.1.smithi115.stdout:6/729: chown d13/d1d/d2b/d5f/d30/d43/da6/d5a/c88 416943349 1 2024-04-16T14:35:44.762 INFO:tasks.workunit.client.1.smithi115.stdout:6/730: write d13/d1d/d2b/d5f/d30/d43/da6/d63/fb9 [971079,68019] 0 2024-04-16T14:35:44.763 INFO:tasks.workunit.client.0.smithi005.stdout:9/676: dread d3/d12/d16/d86/f8c [0,4194304] 0 2024-04-16T14:35:44.764 INFO:tasks.workunit.client.1.smithi115.stdout:9/837: symlink d1/d6/d2d/d3d/l129 0 2024-04-16T14:35:44.764 INFO:tasks.workunit.client.1.smithi115.stdout:9/838: write d1/d6/d2d/d3d/d50/f56 [1461181,31357] 0 2024-04-16T14:35:44.764 INFO:tasks.workunit.client.1.smithi115.stdout:9/839: stat d1/d6/de0 0 2024-04-16T14:35:44.765 INFO:tasks.workunit.client.1.smithi115.stdout:3/763: mknod dc/d29/d4d/d56/d98/dbe/c101 0 2024-04-16T14:35:44.765 INFO:tasks.workunit.client.1.smithi115.stdout:6/731: rmdir d13/d1d/d2b 39 2024-04-16T14:35:44.765 INFO:tasks.workunit.client.1.smithi115.stdout:6/732: read d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/f9f [1579837,40573] 0 2024-04-16T14:35:44.765 INFO:tasks.workunit.client.1.smithi115.stdout:6/733: stat d13/d1d/d2b/d5f/d30/d43/da6/f7d 0 2024-04-16T14:35:44.767 INFO:tasks.workunit.client.1.smithi115.stdout:3/764: dread dc/f1a [0,4194304] 0 2024-04-16T14:35:44.768 INFO:tasks.workunit.client.0.smithi005.stdout:8/817: mkdir d5/d7b/da8/db7/d121 0 2024-04-16T14:35:44.768 INFO:tasks.workunit.client.0.smithi005.stdout:8/818: truncate d5/d7b/da8/db7/d8a/da1/d3d/d7f/d8d/f98 236771 0 2024-04-16T14:35:44.768 INFO:tasks.workunit.client.1.smithi115.stdout:9/840: mknod d1/d6/d2d/d4b/d6c/d20/d36/dce/c12a 0 2024-04-16T14:35:44.768 INFO:tasks.workunit.client.1.smithi115.stdout:9/841: write d1/d6/d2d/d4b/d8f/d91/f6e [490509,53107] 0 2024-04-16T14:35:44.768 INFO:tasks.workunit.client.1.smithi115.stdout:9/842: creat d1/d6/d2d/d4b/d6c/d20/df4/f12b x:0 0 0 2024-04-16T14:35:44.770 INFO:tasks.workunit.client.0.smithi005.stdout:9/677: symlink d3/d12/d2b/lc3 0 2024-04-16T14:35:44.770 INFO:tasks.workunit.client.1.smithi115.stdout:6/734: mkdir d13/d1d/d2b/df4 0 2024-04-16T14:35:44.771 INFO:tasks.workunit.client.1.smithi115.stdout:3/765: mknod dc/d24/d33/dde/c102 0 2024-04-16T14:35:44.771 INFO:tasks.workunit.client.0.smithi005.stdout:3/953: dwrite d2/d6b/f99 [0,4194304] 0 2024-04-16T14:35:44.771 INFO:tasks.workunit.client.0.smithi005.stdout:3/954: chown d2/d9/d7d 1599833 1 2024-04-16T14:35:44.771 INFO:tasks.workunit.client.0.smithi005.stdout:3/955: chown d2/f2c 13 1 2024-04-16T14:35:44.772 INFO:tasks.workunit.client.0.smithi005.stdout:8/819: symlink d5/d55/d5a/d10a/l122 0 2024-04-16T14:35:44.772 INFO:tasks.workunit.client.0.smithi005.stdout:9/678: mknod d3/d12/d16/cc4 0 2024-04-16T14:35:44.773 INFO:tasks.workunit.client.0.smithi005.stdout:3/956: mknod d2/d9/c153 0 2024-04-16T14:35:44.774 INFO:tasks.workunit.client.0.smithi005.stdout:3/957: creat d2/d9/d25/d39/d64/f154 x:0 0 0 2024-04-16T14:35:44.774 INFO:tasks.workunit.client.0.smithi005.stdout:8/820: truncate d5/f43 3583249 0 2024-04-16T14:35:44.776 INFO:tasks.workunit.client.0.smithi005.stdout:3/958: creat d2/d9/d7d/f155 x:0 0 0 2024-04-16T14:35:44.776 INFO:tasks.workunit.client.0.smithi005.stdout:3/959: fdatasync d2/d17/d102/d125/f150 0 2024-04-16T14:35:44.777 INFO:tasks.workunit.client.0.smithi005.stdout:8/821: symlink d5/d7b/da8/db7/d121/l123 0 2024-04-16T14:35:44.777 INFO:tasks.workunit.client.1.smithi115.stdout:1/770: dwrite df/d36/ff8 [0,4194304] 0 2024-04-16T14:35:44.777 INFO:tasks.workunit.client.1.smithi115.stdout:1/771: creat df/d36/dff/f10a x:0 0 0 2024-04-16T14:35:44.777 INFO:tasks.workunit.client.1.smithi115.stdout:1/772: creat df/d36/d94/dbf/f10b x:0 0 0 2024-04-16T14:35:44.778 INFO:tasks.workunit.client.0.smithi005.stdout:6/976: dwrite d2/d5/f119 [0,4194304] 0 2024-04-16T14:35:44.778 INFO:tasks.workunit.client.0.smithi005.stdout:6/977: write d2/d5/f2f [9161351,4247] 0 2024-04-16T14:35:44.778 INFO:tasks.workunit.client.0.smithi005.stdout:6/978: truncate d2/d3f/d47/d84/da5/d10a/fca 499224 0 2024-04-16T14:35:44.782 INFO:tasks.workunit.client.1.smithi115.stdout:6/735: dread d13/d1d/d2b/d5f/f32 [0,4194304] 0 2024-04-16T14:35:44.782 INFO:tasks.workunit.client.1.smithi115.stdout:6/736: dread - d13/d1d/d2b/d5f/d30/d43/fd8 zero size 2024-04-16T14:35:44.782 INFO:tasks.workunit.client.1.smithi115.stdout:6/737: creat d13/ff5 x:0 0 0 2024-04-16T14:35:44.782 INFO:tasks.workunit.client.1.smithi115.stdout:6/738: readlink d13/d1d/d2b/l97 0 2024-04-16T14:35:44.782 INFO:tasks.workunit.client.1.smithi115.stdout:6/739: stat d13/d1d/d2b/d5f/d30/d43/da6/d63/f89 0 2024-04-16T14:35:44.783 INFO:tasks.workunit.client.1.smithi115.stdout:6/740: chown d13/d1d/d2b/d5f/d30/d43/da6/d5a/f3c 32500 1 2024-04-16T14:35:44.783 INFO:tasks.workunit.client.1.smithi115.stdout:3/766: dread dc/f64 [0,4194304] 0 2024-04-16T14:35:44.783 INFO:tasks.workunit.client.0.smithi005.stdout:2/722: dwrite d0/d1c/d8d/fad [0,4194304] 0 2024-04-16T14:35:44.783 INFO:tasks.workunit.client.1.smithi115.stdout:1/773: mkdir df/d36/d94/dbf/d10c 0 2024-04-16T14:35:44.791 INFO:tasks.workunit.client.0.smithi005.stdout:2/723: creat d0/d29/d3e/fef x:0 0 0 2024-04-16T14:35:44.792 INFO:tasks.workunit.client.0.smithi005.stdout:0/777: write da/df/d1b/d3a/d53/d5a/d99/fc6 [1642368,105528] 0 2024-04-16T14:35:44.792 INFO:tasks.workunit.client.0.smithi005.stdout:0/778: readlink da/df/d1b/d24/l52 0 2024-04-16T14:35:44.792 INFO:tasks.workunit.client.0.smithi005.stdout:3/960: dwrite d2/d9/d25/d39/f12f [0,4194304] 0 2024-04-16T14:35:44.794 INFO:tasks.workunit.client.0.smithi005.stdout:2/724: readlink d0/d2a/d3a/l50 0 2024-04-16T14:35:44.794 INFO:tasks.workunit.client.1.smithi115.stdout:1/774: write df/d13/d4d/d3e/d75/da9/fab [7033928,91288] 0 2024-04-16T14:35:44.794 INFO:tasks.workunit.client.1.smithi115.stdout:1/775: fsync df/d35/d84/f91 0 2024-04-16T14:35:44.795 INFO:tasks.workunit.client.0.smithi005.stdout:9/679: rmdir d3/d12/d2b 39 2024-04-16T14:35:44.796 INFO:tasks.workunit.client.1.smithi115.stdout:1/776: rmdir df/d13/d4d/d3e/d75/da9/db7 39 2024-04-16T14:35:44.797 INFO:tasks.workunit.client.0.smithi005.stdout:0/779: mkdir da/df/d26/d39/d55/ddc/d105 0 2024-04-16T14:35:44.799 INFO:tasks.workunit.client.1.smithi115.stdout:1/777: creat df/d36/f10d x:0 0 0 2024-04-16T14:35:44.800 INFO:tasks.workunit.client.1.smithi115.stdout:1/778: rename df/d13/d4d/d68/f71 to df/d2d/d83/f10e 0 2024-04-16T14:35:44.801 INFO:tasks.workunit.client.0.smithi005.stdout:3/961: mknod d2/d17/d46/d75/d9b/dbd/dee/d12d/c156 0 2024-04-16T14:35:44.801 INFO:tasks.workunit.client.1.smithi115.stdout:1/779: rmdir df/d35/d84/ddc/de0 39 2024-04-16T14:35:44.802 INFO:tasks.workunit.client.0.smithi005.stdout:2/725: rmdir d0/d2a/d3a/d94/dd7 0 2024-04-16T14:35:44.802 INFO:tasks.workunit.client.1.smithi115.stdout:1/780: creat df/f10f x:0 0 0 2024-04-16T14:35:44.804 INFO:tasks.workunit.client.0.smithi005.stdout:9/680: mknod d3/d12/d9d/cc5 0 2024-04-16T14:35:44.804 INFO:tasks.workunit.client.1.smithi115.stdout:1/781: creat df/d13/d4d/d3e/d75/da9/db7/f110 x:0 0 0 2024-04-16T14:35:44.804 INFO:tasks.workunit.client.1.smithi115.stdout:1/782: chown df/d13/d4d/d68/de7/c89 6821 1 2024-04-16T14:35:44.804 INFO:tasks.workunit.client.1.smithi115.stdout:1/783: truncate df/d36/d94/dbf/fea 1222752 0 2024-04-16T14:35:44.805 INFO:tasks.workunit.client.1.smithi115.stdout:1/784: fdatasync df/d35/d48/f4c 0 2024-04-16T14:35:44.805 INFO:tasks.workunit.client.1.smithi115.stdout:1/785: getdents df/d13/d4d/d3e/d75/da9 0 2024-04-16T14:35:44.805 INFO:tasks.workunit.client.0.smithi005.stdout:3/962: rename d2/d17/d46/d75/d41/d120/lb9 to d2/d9/df/daa/d127/d12a/l157 0 2024-04-16T14:35:44.806 INFO:tasks.workunit.client.1.smithi115.stdout:1/786: mknod df/d13/d4d/d6d/dc5/c111 0 2024-04-16T14:35:44.808 INFO:tasks.workunit.client.0.smithi005.stdout:2/726: link d0/d2a/f52 d0/d29/d3e/dd2/de8/ff0 0 2024-04-16T14:35:44.809 INFO:tasks.workunit.client.1.smithi115.stdout:1/787: dread df/d36/d94/dbf/fea [0,4194304] 0 2024-04-16T14:35:44.810 INFO:tasks.workunit.client.0.smithi005.stdout:9/681: mkdir d3/d12/d16/dc6 0 2024-04-16T14:35:44.810 INFO:tasks.workunit.client.0.smithi005.stdout:0/780: dread da/df/d1b/d3a/f4d [0,4194304] 0 2024-04-16T14:35:44.811 INFO:tasks.workunit.client.1.smithi115.stdout:1/788: rename df/d36/f8d to df/d36/dff/f112 0 2024-04-16T14:35:44.811 INFO:tasks.workunit.client.1.smithi115.stdout:1/789: chown df/d13/f74 4 1 2024-04-16T14:35:44.813 INFO:tasks.workunit.client.1.smithi115.stdout:3/767: dwrite dc/d29/d4d/d56/f9b [0,4194304] 0 2024-04-16T14:35:44.814 INFO:tasks.workunit.client.0.smithi005.stdout:2/727: mknod d0/d1c/d59/d7a/d84/cf1 0 2024-04-16T14:35:44.814 INFO:tasks.workunit.client.0.smithi005.stdout:6/979: dwrite d2/d20/d3c/dcf/d6e/fab [0,4194304] 0 2024-04-16T14:35:44.814 INFO:tasks.workunit.client.0.smithi005.stdout:2/728: write d0/d1c/d59/d7a/d84/fbc [1353789,84976] 0 2024-04-16T14:35:44.814 INFO:tasks.workunit.client.0.smithi005.stdout:6/980: write d2/d45/d7b/f82 [1424998,6799] 0 2024-04-16T14:35:44.814 INFO:tasks.workunit.client.0.smithi005.stdout:2/729: read d0/d1c/d39/d48/f7b [2251959,69381] 0 2024-04-16T14:35:44.814 INFO:tasks.workunit.client.1.smithi115.stdout:6/741: dwrite d13/d1d/d2b/d5f/d30/f80 [0,4194304] 0 2024-04-16T14:35:44.815 INFO:tasks.workunit.client.0.smithi005.stdout:0/781: symlink da/df/d1b/d3a/d53/l106 0 2024-04-16T14:35:44.816 INFO:tasks.workunit.client.1.smithi115.stdout:3/768: creat dc/d29/d4d/d56/d98/dbe/dd6/f103 x:0 0 0 2024-04-16T14:35:44.817 INFO:tasks.workunit.client.1.smithi115.stdout:3/769: write dc/d29/d4d/f59 [755371,58671] 0 2024-04-16T14:35:44.817 INFO:tasks.workunit.client.1.smithi115.stdout:3/770: chown dc/d24/d80/lc9 0 1 2024-04-16T14:35:44.817 INFO:tasks.workunit.client.1.smithi115.stdout:3/771: creat dc/d29/d4d/d56/d98/dbe/dd6/f104 x:0 0 0 2024-04-16T14:35:44.819 INFO:tasks.workunit.client.1.smithi115.stdout:6/742: rename d13/d1d/d2b/d5f/l93 to d13/d1d/d2b/d5f/d30/d43/d2c/lf6 0 2024-04-16T14:35:44.820 INFO:tasks.workunit.client.1.smithi115.stdout:6/743: mknod d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/d55/cf7 0 2024-04-16T14:35:44.821 INFO:tasks.workunit.client.1.smithi115.stdout:6/744: chown d13/d1d/d52/lbb 243 1 2024-04-16T14:35:44.821 INFO:tasks.workunit.client.1.smithi115.stdout:6/745: getdents d13/d1d/d2b/d5f/d30/d43/da6/d5a/dcb 0 2024-04-16T14:35:44.826 INFO:tasks.workunit.client.1.smithi115.stdout:6/746: rename d13/d1d/d2b/d5f/d30/d43/da6/d5a/fad to d13/d1d/d2b/d5f/d30/d43/ff8 0 2024-04-16T14:35:44.826 INFO:tasks.workunit.client.1.smithi115.stdout:1/790: write df/d13/d4d/d3e/d75/dda/f56 [1845287,11007] 0 2024-04-16T14:35:44.826 INFO:tasks.workunit.client.1.smithi115.stdout:1/791: truncate df/d36/fae 1668434 0 2024-04-16T14:35:44.827 INFO:tasks.workunit.client.1.smithi115.stdout:1/792: truncate df/d36/f10d 458739 0 2024-04-16T14:35:44.828 INFO:tasks.workunit.client.1.smithi115.stdout:6/747: mknod d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/de4/cf9 0 2024-04-16T14:35:44.829 INFO:tasks.workunit.client.1.smithi115.stdout:1/793: dread df/f25 [0,4194304] 0 2024-04-16T14:35:44.829 INFO:tasks.workunit.client.1.smithi115.stdout:1/794: chown df/d13/d4d/d68/de7/d55/cc0 49 1 2024-04-16T14:35:44.829 INFO:tasks.workunit.client.1.smithi115.stdout:1/795: chown df/d13/d4d/l66 189206926 1 2024-04-16T14:35:44.829 INFO:tasks.workunit.client.1.smithi115.stdout:1/796: write df/d35/fd3 [1414645,83933] 0 2024-04-16T14:35:44.831 INFO:tasks.workunit.client.1.smithi115.stdout:6/748: symlink d13/d1d/d2b/df4/lfa 0 2024-04-16T14:35:44.833 INFO:tasks.workunit.client.0.smithi005.stdout:9/682: dwrite d3/d12/d16/d86/f8c [0,4194304] 0 2024-04-16T14:35:44.838 INFO:tasks.workunit.client.0.smithi005.stdout:3/963: rmdir d2/d17 39 2024-04-16T14:35:44.839 INFO:tasks.workunit.client.1.smithi115.stdout:1/797: read f3 [3777796,41810] 0 2024-04-16T14:35:44.839 INFO:tasks.workunit.client.1.smithi115.stdout:1/798: chown df/d35/d84/ddc/de0/df2 59636 1 2024-04-16T14:35:44.840 INFO:tasks.workunit.client.0.smithi005.stdout:6/981: mknod d2/d20/d72/c146 0 2024-04-16T14:35:44.841 INFO:tasks.workunit.client.0.smithi005.stdout:6/982: read d2/d3f/d53/d54/fc8 [8635,84186] 0 2024-04-16T14:35:44.841 INFO:tasks.workunit.client.1.smithi115.stdout:1/799: unlink df/cee 0 2024-04-16T14:35:44.842 INFO:tasks.workunit.client.0.smithi005.stdout:2/730: dwrite d0/d1c/d8d/fad [4194304,4194304] 0 2024-04-16T14:35:44.843 INFO:tasks.workunit.client.1.smithi115.stdout:6/749: dread d13/f8e [0,4194304] 0 2024-04-16T14:35:44.843 INFO:tasks.workunit.client.1.smithi115.stdout:6/750: chown f12 777 1 2024-04-16T14:35:44.843 INFO:tasks.workunit.client.1.smithi115.stdout:3/772: dwrite dc/d24/d36/d60/fc8 [0,4194304] 0 2024-04-16T14:35:44.844 INFO:tasks.workunit.client.1.smithi115.stdout:6/751: creat d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/dbc/ffb x:0 0 0 2024-04-16T14:35:44.844 INFO:tasks.workunit.client.1.smithi115.stdout:6/752: stat d13/d1d/d2b/d5f/d30/c61 0 2024-04-16T14:35:44.847 INFO:tasks.workunit.client.1.smithi115.stdout:6/753: unlink d13/l15 0 2024-04-16T14:35:44.847 INFO:tasks.workunit.client.1.smithi115.stdout:6/754: chown d13/d1d/d52/d8c 9758214 1 2024-04-16T14:35:44.847 INFO:tasks.workunit.client.1.smithi115.stdout:6/755: write f0 [1837404,120306] 0 2024-04-16T14:35:44.851 INFO:tasks.workunit.client.0.smithi005.stdout:0/782: rename da/df/d26/d39/d55/fe8 to da/df/d26/d39/d55/ddc/f107 0 2024-04-16T14:35:44.856 INFO:tasks.workunit.client.0.smithi005.stdout:9/683: creat d3/d12/d16/fc7 x:0 0 0 2024-04-16T14:35:44.857 INFO:tasks.workunit.client.0.smithi005.stdout:3/964: rmdir d2/d17/d46/d75/d6d/dd0/dda 39 2024-04-16T14:35:44.858 INFO:tasks.workunit.client.1.smithi115.stdout:3/773: write f4 [2891793,88499] 0 2024-04-16T14:35:44.858 INFO:tasks.workunit.client.1.smithi115.stdout:3/774: fsync dc/f16 0 2024-04-16T14:35:44.858 INFO:tasks.workunit.client.1.smithi115.stdout:3/775: readlink dc/d29/d77/l9e 0 2024-04-16T14:35:44.858 INFO:tasks.workunit.client.1.smithi115.stdout:3/776: creat dc/d29/d4d/d56/d98/dbe/f105 x:0 0 0 2024-04-16T14:35:44.859 INFO:tasks.workunit.client.0.smithi005.stdout:6/983: mkdir d2/d3f/d9f/d147 0 2024-04-16T14:35:44.860 INFO:tasks.workunit.client.1.smithi115.stdout:6/756: dread f0 [0,4194304] 0 2024-04-16T14:35:44.861 INFO:tasks.workunit.client.1.smithi115.stdout:6/757: dread - d13/d1d/d2b/d5f/d30/d43/d2c/fd6 zero size 2024-04-16T14:35:44.862 INFO:tasks.workunit.client.0.smithi005.stdout:2/731: dwrite d0/d1c/d39/d85/fa6 [0,4194304] 0 2024-04-16T14:35:44.863 INFO:tasks.workunit.client.1.smithi115.stdout:6/758: getdents d13/d1d/d49 0 2024-04-16T14:35:44.863 INFO:tasks.workunit.client.1.smithi115.stdout:6/759: read d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/f9f [1847224,122274] 0 2024-04-16T14:35:44.863 INFO:tasks.workunit.client.1.smithi115.stdout:6/760: chown d13/d1d/d49/c8f 5 1 2024-04-16T14:35:44.897 INFO:tasks.workunit.client.0.smithi005.stdout:6/984: mknod d2/d5/d10/dd6/d8e/c148 0 2024-04-16T14:35:44.903 INFO:tasks.workunit.client.0.smithi005.stdout:2/732: truncate d0/d4/f3c 654900 0 2024-04-16T14:35:44.903 INFO:tasks.workunit.client.0.smithi005.stdout:2/733: fsync d0/d1c/d39/dcb/fd3 0 2024-04-16T14:35:44.906 INFO:tasks.workunit.client.0.smithi005.stdout:0/783: rename da/df/d1b/d24 to da/df/d26/da9/d108 0 2024-04-16T14:35:44.908 INFO:tasks.workunit.client.0.smithi005.stdout:3/965: rmdir d2/d9/d7d 39 2024-04-16T14:35:44.912 INFO:tasks.workunit.client.1.smithi115.stdout:3/777: rename dc/d29/d4d/d56/d98/dbe/dd6 to dc/d29/d39/d106 0 2024-04-16T14:35:44.913 INFO:tasks.workunit.client.0.smithi005.stdout:0/784: dread da/df/d26/f95 [0,4194304] 0 2024-04-16T14:35:44.914 INFO:tasks.workunit.client.0.smithi005.stdout:0/785: readlink da/df/d26/d8e/l92 0 2024-04-16T14:35:44.915 INFO:tasks.workunit.client.1.smithi115.stdout:6/761: rename d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62/d96/l6c to d13/d1d/lfc 0 2024-04-16T14:35:44.917 INFO:tasks.workunit.client.1.smithi115.stdout:3/778: creat dc/d29/d4d/f107 x:0 0 0 2024-04-16T14:35:44.917 INFO:tasks.workunit.client.1.smithi115.stdout:3/779: fdatasync dc/d29/d39/d86/f89 0 2024-04-16T14:35:44.917 INFO:tasks.workunit.client.1.smithi115.stdout:3/780: getdents dc/d24/d33/d4b/dd3 0 2024-04-16T14:35:44.918 INFO:tasks.workunit.client.0.smithi005.stdout:6/985: getdents d2/d3f/d47 0 2024-04-16T14:35:44.919 INFO:tasks.workunit.client.1.smithi115.stdout:3/781: mknod dc/d24/c108 0 2024-04-16T14:35:44.922 INFO:tasks.workunit.client.0.smithi005.stdout:0/786: link da/cdb da/df/d26/d39/d55/d5c/c109 0 2024-04-16T14:35:44.922 INFO:tasks.workunit.client.0.smithi005.stdout:0/787: creat da/f10a x:0 0 0 2024-04-16T14:35:44.923 INFO:tasks.workunit.client.0.smithi005.stdout:2/734: truncate d0/d1c/d39/d85/fa6 2835787 0 2024-04-16T14:35:44.925 INFO:tasks.workunit.client.1.smithi115.stdout:6/762: rename d13/d1d/d2b/d5f/d30/d43/da6/d5a/d62 to d13/d1d/d2b/d5f/d30/d43/da6/dfd 0 2024-04-16T14:35:44.926 INFO:tasks.workunit.client.1.smithi115.stdout:3/782: dread dc/f15 [0,4194304] 0 2024-04-16T14:35:44.927 INFO:tasks.workunit.client.1.smithi115.stdout:6/763: creat d13/d1d/d2b/ffe x:0 0 0 2024-04-16T14:35:44.927 INFO:tasks.workunit.client.0.smithi005.stdout:0/788: mkdir da/df/d1b/d3a/d53/d10b 0 2024-04-16T14:35:44.928 INFO:tasks.workunit.client.0.smithi005.stdout:6/986: write d2/d20/d33/f4c [1445769,96273] 0 2024-04-16T14:35:44.928 INFO:tasks.workunit.client.1.smithi115.stdout:3/783: dread dc/f31 [0,4194304] 0 2024-04-16T14:35:44.928 INFO:tasks.workunit.client.1.smithi115.stdout:6/764: read d13/d1d/d49/f6e [1043578,2575] 0 2024-04-16T14:35:44.929 INFO:tasks.workunit.client.0.smithi005.stdout:0/789: creat da/df/d26/d8e/f10c x:0 0 0 2024-04-16T14:35:44.929 INFO:tasks.workunit.client.0.smithi005.stdout:0/790: truncate da/df/d1b/d3a/d53/d5a/d99/fef 698981 0 2024-04-16T14:35:44.929 INFO:tasks.workunit.client.0.smithi005.stdout:0/791: chown da/df/d26/da9/d108/ff5 1008 1 2024-04-16T14:35:44.930 INFO:tasks.workunit.client.0.smithi005.stdout:2/735: rename d0/d4/f3b to d0/d29/d3e/ff2 0 2024-04-16T14:35:44.932 INFO:tasks.workunit.client.1.smithi115.stdout:3/784: creat dc/d24/d33/d4b/d81/f109 x:0 0 0 2024-04-16T14:35:44.934 INFO:tasks.workunit.client.0.smithi005.stdout:6/987: creat d2/d5/d10/d68/f149 x:0 0 0 2024-04-16T14:35:44.936 INFO:tasks.workunit.client.1.smithi115.stdout:6/765: dread d13/d1d/d2b/d5f/d30/d43/da6/dfd/d96/d55/fa5 [0,4194304] 0 2024-04-16T14:35:44.936 INFO:tasks.workunit.client.1.smithi115.stdout:6/766: dread - d13/fe1 zero size 2024-04-16T14:35:44.937 INFO:tasks.workunit.client.1.smithi115.stdout:3/785: creat dc/d24/d33/dde/f10a x:0 0 0 2024-04-16T14:35:44.937 INFO:tasks.workunit.client.1.smithi115.stdout:3/786: truncate dc/d24/d33/d4b/da3/d69/de1/feb 994406 0 2024-04-16T14:35:44.938 INFO:tasks.workunit.client.1.smithi115.stdout:6/767: link d13/d1d/d2b/d5f/d30/d43/d2c/lf6 d13/d1d/d2b/d5f/d30/d43/lff 0 2024-04-16T14:35:44.939 INFO:tasks.workunit.client.1.smithi115.stdout:6/768: write d13/d1d/d2b/ffe [755787,64772] 0 2024-04-16T14:35:44.939 INFO:tasks.workunit.client.1.smithi115.stdout:3/787: symlink dc/d24/d33/d4b/da3/d69/de1/l10b 0 2024-04-16T14:35:44.940 INFO:tasks.workunit.client.1.smithi115.stdout:6/769: creat d13/d1d/d49/ded/f100 x:0 0 0 2024-04-16T14:35:44.940 INFO:tasks.workunit.client.0.smithi005.stdout:6/988: mkdir d2/d5/d10/d14a 0 2024-04-16T14:35:44.940 INFO:tasks.workunit.client.0.smithi005.stdout:6/989: truncate d2/d3f/d53/d54/db5/f13e 639838 0 2024-04-16T14:35:44.953 INFO:tasks.workunit.client.0.smithi005.stdout:2/736: dwrite d0/d2a/d3a/f76 [0,4194304] 0 2024-04-16T14:35:44.962 INFO:tasks.workunit.client.0.smithi005.stdout:2/737: write d0/d4/d2b/d5e/f70 [3446205,78063] 0 2024-04-16T14:35:44.962 INFO:tasks.workunit.client.0.smithi005.stdout:2/738: truncate d0/d1c/d39/dcb/fd3 4006900 0 2024-04-16T14:35:44.963 INFO:tasks.workunit.client.0.smithi005.stdout:2/739: creat d0/d29/d3e/dd2/ff3 x:0 0 0 2024-04-16T14:35:44.966 INFO:tasks.workunit.client.0.smithi005.stdout:2/740: unlink d0/d4/d2b/c19 0 2024-04-16T14:35:44.966 INFO:tasks.workunit.client.0.smithi005.stdout:2/741: truncate d0/d4/d2b/d5e/d9a/fac 275530 0 2024-04-16T14:35:44.966 INFO:tasks.workunit.client.0.smithi005.stdout:2/742: write d0/d2a/d3a/fc2 [173260,88456] 0 2024-04-16T14:35:44.971 INFO:tasks.workunit.client.0.smithi005.stdout:6/990: dwrite d2/d5/d28/f46 [0,4194304] 0 2024-04-16T14:35:44.971 INFO:tasks.workunit.client.0.smithi005.stdout:6/991: write d2/d3f/d47/f31 [1945809,28987] 0 2024-04-16T14:35:44.972 INFO:tasks.workunit.client.1.smithi115.stdout:6/770: dwrite d13/d1d/d49/f6e [0,4194304] 0 2024-04-16T14:35:44.972 INFO:tasks.workunit.client.1.smithi115.stdout:3/788: dwrite dc/d29/d4d/f59 [0,4194304] 0 2024-04-16T14:35:44.972 INFO:tasks.workunit.client.1.smithi115.stdout:3/789: stat dc/d24/d33/fb5 0 2024-04-16T14:35:44.972 INFO:tasks.workunit.client.1.smithi115.stdout:3/790: getdents dc/d24/d80/dfc 0 2024-04-16T14:35:44.975 INFO:tasks.workunit.client.1.smithi115.stdout:6/771: rmdir d13/d1d/d49 39 2024-04-16T14:35:44.985 INFO:tasks.workunit.client.0.smithi005.stdout:2/743: dwrite d0/d4/d2b/d5e/f60 [0,4194304] 0 2024-04-16T14:35:44.985 INFO:tasks.workunit.client.0.smithi005.stdout:2/744: chown d0/d4/d2b 0 1 2024-04-16T14:35:44.989 INFO:tasks.workunit.client.0.smithi005.stdout:6/992: dread d2/d3f/d47/d84/da5/d11f/f13b [0,4194304] 0 2024-04-16T14:35:44.991 INFO:tasks.workunit.client.0.smithi005.stdout:6/993: symlink d2/d45/d7b/l14b 0 2024-04-16T14:35:44.992 INFO:tasks.workunit.client.1.smithi115.stdout:1/800: sync 2024-04-16T14:35:44.992 INFO:tasks.workunit.client.1.smithi115.stdout:0/587: sync 2024-04-16T14:35:44.992 INFO:tasks.workunit.client.1.smithi115.stdout:3/791: dwrite dc/d24/d33/d4b/da3/d69/ff5 [0,4194304] 0 2024-04-16T14:35:44.992 INFO:tasks.workunit.client.1.smithi115.stdout:9/843: sync 2024-04-16T14:35:44.992 INFO:tasks.workunit.client.1.smithi115.stdout:5/742: sync 2024-04-16T14:35:44.993 INFO:tasks.workunit.client.0.smithi005.stdout:6/994: getdents d2/d45 0 2024-04-16T14:35:44.993 INFO:tasks.workunit.client.0.smithi005.stdout:6/995: fsync d2/d20/d3c/dcf/f129 0 2024-04-16T14:35:44.994 INFO:tasks.workunit.client.1.smithi115.stdout:2/881: sync 2024-04-16T14:35:44.994 INFO:tasks.workunit.client.1.smithi115.stdout:8/774: sync 2024-04-16T14:35:44.994 INFO:tasks.workunit.client.1.smithi115.stdout:2/882: readlink d0/d47/dc9/l118 0 2024-04-16T14:35:44.994 INFO:tasks.workunit.client.1.smithi115.stdout:4/714: sync 2024-04-16T14:35:44.994 INFO:tasks.workunit.client.1.smithi115.stdout:7/657: sync 2024-04-16T14:35:44.995 INFO:tasks.workunit.client.1.smithi115.stdout:1/801: link df/d13/d4d/d3e/d7d/fd9 df/d36/dff/f113 0 2024-04-16T14:35:44.997 INFO:tasks.workunit.client.1.smithi115.stdout:2/883: dread d0/d47/f8e [0,4194304] 0 2024-04-16T14:35:44.997 INFO:tasks.workunit.client.0.smithi005.stdout:6/996: symlink d2/d45/d7b/db2/l14c 0 2024-04-16T14:35:44.999 INFO:tasks.workunit.client.1.smithi115.stdout:5/743: creat dc/d15/d2d/fe1 x:0 0 0 2024-04-16T14:35:44.999 INFO:tasks.workunit.client.1.smithi115.stdout:7/658: getdents d0/d24/da3/db1/d49/dbc 0 2024-04-16T14:35:44.999 INFO:tasks.workunit.client.1.smithi115.stdout:7/659: write d0/d24/f61 [381738,5427] 0 2024-04-16T14:35:45.001 INFO:tasks.workunit.client.1.smithi115.stdout:5/744: symlink dc/d15/d2d/db0/le2 0 2024-04-16T14:35:45.001 INFO:tasks.workunit.client.1.smithi115.stdout:3/792: symlink dc/d29/d39/d86/l10c 0 2024-04-16T14:35:45.001 INFO:tasks.workunit.client.1.smithi115.stdout:8/775: creat d0/db/d10/d17/d2c/d52/d74/d3b/d56/dfc/f100 x:0 0 0 2024-04-16T14:35:45.001 INFO:tasks.workunit.client.1.smithi115.stdout:3/793: write dc/d24/d33/d4b/fff [821836,55680] 0 2024-04-16T14:35:45.001 INFO:tasks.workunit.client.1.smithi115.stdout:8/776: write d0/db/d10/d17/d2c/d52/d74/f4d [594444,128782] 0 2024-04-16T14:35:45.002 INFO:tasks.workunit.client.1.smithi115.stdout:7/660: rename d0/d2/l1d to d0/d2/d3a/d30/d79/dd2/ldf 0 2024-04-16T14:35:45.003 INFO:tasks.workunit.client.1.smithi115.stdout:3/794: creat dc/d29/d4d/d56/d98/f10d x:0 0 0 2024-04-16T14:35:45.003 INFO:tasks.workunit.client.1.smithi115.stdout:1/802: rmdir df/d36/d94 39 2024-04-16T14:35:45.005 INFO:tasks.workunit.client.1.smithi115.stdout:7/661: creat d0/d2/d3a/dac/da7/fe0 x:0 0 0 2024-04-16T14:35:45.006 INFO:tasks.workunit.client.1.smithi115.stdout:7/662: truncate d0/d24/da3/db1/d3f/f8d 3100705 0 2024-04-16T14:35:45.006 INFO:tasks.workunit.client.1.smithi115.stdout:7/663: write d0/d2/d3a/d30/d79/d95/fbf [1019295,7595] 0 2024-04-16T14:35:45.006 INFO:tasks.workunit.client.1.smithi115.stdout:7/664: readlink d0/d2/d3a/d30/d79/dd2/d64/la4 0 2024-04-16T14:35:45.008 INFO:tasks.workunit.client.1.smithi115.stdout:1/803: creat df/d35/f114 x:0 0 0 2024-04-16T14:35:45.012 INFO:tasks.workunit.client.1.smithi115.stdout:4/715: dread d1/d15/d1e/f29 [0,4194304] 0 2024-04-16T14:35:45.012 INFO:tasks.workunit.client.1.smithi115.stdout:6/772: dwrite d13/d1d/d52/d8c/fc7 [0,4194304] 0 2024-04-16T14:35:45.012 INFO:tasks.workunit.client.1.smithi115.stdout:8/777: rename d0/db/d10/d17/d22/c57 to d0/db/dbb/dcd/c101 0 2024-04-16T14:35:45.012 INFO:tasks.workunit.client.1.smithi115.stdout:3/795: dread dc/ffd [0,4194304] 0 2024-04-16T14:35:45.012 INFO:tasks.workunit.client.1.smithi115.stdout:3/796: fdatasync dc/d29/d39/d86/f89 0 2024-04-16T14:35:45.013 INFO:tasks.workunit.client.1.smithi115.stdout:7/665: creat d0/d2/d3a/d30/fe1 x:0 0 0 2024-04-16T14:35:45.013 INFO:tasks.workunit.client.1.smithi115.stdout:4/716: fsync d1/d15/d17/f8a 0 2024-04-16T14:35:45.014 INFO:tasks.workunit.client.1.smithi115.stdout:6/773: dread fc [0,4194304] 0 2024-04-16T14:35:45.015 INFO:tasks.workunit.client.1.smithi115.stdout:8/778: unlink d0/db/d10/d17/d2c/d52/d6c/db8/d64/c91 0 2024-04-16T14:35:45.015 INFO:tasks.workunit.client.1.smithi115.stdout:8/779: chown d0/db/d10/d17 4570 1 2024-04-16T14:35:45.015 INFO:tasks.workunit.client.1.smithi115.stdout:8/780: fdatasync d0/db/d10/d17/d2c/d52/d6c/db8/d64/d83/fff 0 2024-04-16T14:35:45.017 INFO:tasks.workunit.client.1.smithi115.stdout:7/666: symlink d0/d2/d3a/d30/d79/dd2/d9c/le2 0 2024-04-16T14:35:45.017 INFO:tasks.workunit.client.1.smithi115.stdout:3/797: mkdir dc/d29/d39/d106/d10e 0 2024-04-16T14:35:45.019 INFO:tasks.workunit.client.1.smithi115.stdout:4/717: symlink d1/d15/d31/d42/d8b/ld9 0 2024-04-16T14:35:45.021 INFO:tasks.workunit.client.1.smithi115.stdout:4/718: mknod d1/d15/d31/d42/cda 0 2024-04-16T14:35:45.021 INFO:tasks.workunit.client.1.smithi115.stdout:4/719: chown d1/d15/d1e/c7e 648 1 2024-04-16T14:35:45.022 INFO:tasks.workunit.client.1.smithi115.stdout:3/798: creat dc/d29/d39/d106/f10f x:0 0 0 2024-04-16T14:35:45.022 INFO:tasks.workunit.client.1.smithi115.stdout:3/799: creat dc/d29/d4d/d56/d98/dbe/f110 x:0 0 0 2024-04-16T14:35:45.022 INFO:tasks.workunit.client.1.smithi115.stdout:3/800: fsync f4 0 2024-04-16T14:35:45.022 INFO:tasks.workunit.client.1.smithi115.stdout:3/801: read dc/d29/f85 [383119,103196] 0 2024-04-16T14:35:45.022 INFO:tasks.workunit.client.1.smithi115.stdout:3/802: readlink dc/d24/d33/d4b/da3/d69/lb3 0 2024-04-16T14:35:45.022 INFO:tasks.workunit.client.1.smithi115.stdout:3/803: truncate dc/d29/d4d/d56/f9b 4939883 0 2024-04-16T14:35:45.022 INFO:tasks.workunit.client.1.smithi115.stdout:3/804: write dc/d29/f85 [1553539,33941] 0 2024-04-16T14:35:45.023 INFO:tasks.workunit.client.1.smithi115.stdout:3/805: truncate dc/d29/d4d/d56/d8a/fc2 718710 0 2024-04-16T14:35:45.023 INFO:tasks.workunit.client.1.smithi115.stdout:4/720: symlink d1/d15/d31/ldb 0 2024-04-16T14:35:45.023 INFO:tasks.workunit.client.1.smithi115.stdout:4/721: write d1/d15/d17/f8a [970969,15406] 0 2024-04-16T14:35:45.026 INFO:tasks.workunit.client.1.smithi115.stdout:3/806: rename dc/d29/d4d/d56/d98/dbe/f105 to dc/d29/d4d/d56/d7e/f111 0 2024-04-16T14:35:45.026 INFO:tasks.workunit.client.1.smithi115.stdout:4/722: creat d1/d15/d31/d42/da4/fdc x:0 0 0 2024-04-16T14:35:45.028 INFO:tasks.workunit.client.1.smithi115.stdout:4/723: mknod d1/d15/d31/d42/d8b/cdd 0 2024-04-16T14:35:45.028 INFO:tasks.workunit.client.0.smithi005.stdout:6/997: dwrite d2/d3f/d47/d84/d8c/fcc [0,4194304] 0 2024-04-16T14:35:45.029 INFO:tasks.workunit.client.0.smithi005.stdout:6/998: dread - d2/d5/d10/f132 zero size 2024-04-16T14:35:45.030 INFO:tasks.workunit.client.1.smithi115.stdout:3/807: write dc/d24/d33/d4b/da3/d69/de1/feb [631515,100510] 0 2024-04-16T14:35:45.030 INFO:tasks.workunit.client.1.smithi115.stdout:4/724: mkdir d1/d2/dde 0 2024-04-16T14:35:45.033 INFO:tasks.workunit.client.1.smithi115.stdout:3/808: unlink dc/d29/d4d/d56/d8a/ld4 0 2024-04-16T14:35:45.033 INFO:tasks.workunit.client.1.smithi115.stdout:3/809: truncate dc/d29/d4d/d56/d98/dbe/f110 95281 0 2024-04-16T14:35:45.037 INFO:tasks.workunit.client.1.smithi115.stdout:3/810: mknod dc/d29/d39/d86/c112 0 2024-04-16T14:35:45.041 INFO:tasks.workunit.client.1.smithi115.stdout:3/811: unlink dc/d29/f48 0 2024-04-16T14:35:45.041 INFO:tasks.workunit.client.1.smithi115.stdout:3/812: write dc/d24/d33/fb5 [451798,14337] 0 2024-04-16T14:35:45.042 INFO:tasks.workunit.client.1.smithi115.stdout:3/813: rmdir dc 39 2024-04-16T14:35:45.056 INFO:tasks.workunit.client.1.smithi115.stdout:9/844: dwrite d1/d6/d33/f6f [0,4194304] 0 2024-04-16T14:35:45.056 INFO:tasks.workunit.client.1.smithi115.stdout:9/845: dread - d1/d6/d29/fe9 zero size 2024-04-16T14:35:45.058 INFO:tasks.workunit.client.1.smithi115.stdout:9/846: symlink d1/d7f/l12c 0 2024-04-16T14:35:45.064 INFO:tasks.workunit.client.1.smithi115.stdout:2/884: dwrite d0/d47/d65/dad/f11a [0,4194304] 0 2024-04-16T14:35:45.064 INFO:tasks.workunit.client.1.smithi115.stdout:5/745: dwrite f2 [4194304,4194304] 0 2024-04-16T14:35:45.065 INFO:tasks.workunit.client.1.smithi115.stdout:6/774: dwrite d13/d1d/f5c [0,4194304] 0 2024-04-16T14:35:45.065 INFO:tasks.workunit.client.1.smithi115.stdout:3/814: dwrite dc/d24/d36/f3b [4194304,4194304] 0 2024-04-16T14:35:45.066 INFO:tasks.workunit.client.1.smithi115.stdout:3/815: chown dc/d24/d33/d4b/da3/d69/de1/l10b 3 1 2024-04-16T14:35:45.066 INFO:tasks.workunit.client.1.smithi115.stdout:9/847: dread d1/d6/d2d/d3d/d49/d88/fd7 [0,4194304] 0 2024-04-16T14:35:45.066 INFO:tasks.workunit.client.1.smithi115.stdout:9/848: stat d1/d6/d2d/d4b 0 2024-04-16T14:35:45.066 INFO:tasks.workunit.client.1.smithi115.stdout:7/667: dwrite d0/d2/d3a/d30/d79/d95/fa0 [0,4194304] 0 2024-04-16T14:35:45.066 INFO:tasks.workunit.client.1.smithi115.stdout:1/804: dwrite df/d35/f39 [0,4194304] 0 2024-04-16T14:35:45.067 INFO:tasks.workunit.client.1.smithi115.stdout:1/805: chown df/d13/d4d/d6d/dc5/c106 119 1 2024-04-16T14:35:45.068 INFO:tasks.workunit.client.1.smithi115.stdout:4/725: dwrite d1/d15/d17/fa3 [0,4194304] 0 2024-04-16T14:35:45.068 INFO:tasks.workunit.client.1.smithi115.stdout:4/726: fsync d1/f2d 0 2024-04-16T14:35:45.068 INFO:tasks.workunit.client.1.smithi115.stdout:4/727: write d1/d15/d17/fa9 [1081777,37904] 0 2024-04-16T14:35:45.070 INFO:tasks.workunit.client.1.smithi115.stdout:8/781: getdents d0/db/dbb/dcd 0 2024-04-16T14:35:45.070 INFO:tasks.workunit.client.1.smithi115.stdout:8/782: chown d0/fca 3462 1 2024-04-16T14:35:45.070 INFO:tasks.workunit.client.1.smithi115.stdout:6/775: symlink d13/l101 0 2024-04-16T14:35:45.072 INFO:tasks.workunit.client.1.smithi115.stdout:1/806: write df/f5b [750038,92367] 0 2024-04-16T14:35:45.072 INFO:tasks.workunit.client.1.smithi115.stdout:9/849: symlink d1/d6/d33/l12d 0 2024-04-16T14:35:45.072 INFO:tasks.workunit.client.1.smithi115.stdout:9/850: chown d1/d6/d2d/d4b/d60/fef 245547 1 2024-04-16T14:35:45.074 INFO:tasks.workunit.client.1.smithi115.stdout:7/668: unlink d0/d2/d3a/d30/d79/dd2/d64/fd9 0 2024-04-16T14:35:45.075 INFO:tasks.workunit.client.1.smithi115.stdout:7/669: fdatasync d0/fe 0 2024-04-16T14:35:45.075 INFO:tasks.workunit.client.1.smithi115.stdout:7/670: write d0/d24/f4a [9188053,56083] 0 2024-04-16T14:35:45.075 INFO:tasks.workunit.client.1.smithi115.stdout:7/671: creat d0/d2/d3a/d30/fe3 x:0 0 0 2024-04-16T14:35:45.077 INFO:tasks.workunit.client.1.smithi115.stdout:5/746: getdents dc/d15/d4d 0 2024-04-16T14:35:45.081 INFO:tasks.workunit.client.1.smithi115.stdout:4/728: mkdir d1/d15/d17/d9e/ddf 0 2024-04-16T14:35:45.081 INFO:tasks.workunit.client.1.smithi115.stdout:4/729: chown d1/d15/f77 143 1 2024-04-16T14:35:45.082 INFO:tasks.workunit.client.1.smithi115.stdout:6/776: mknod d13/d1d/d49/c102 0 2024-04-16T14:35:45.084 INFO:tasks.workunit.client.1.smithi115.stdout:8/783: rename d0/db/d10/d17/d2c/d52/ld3 to d0/db/d10/d17/d2c/d52/l102 0 2024-04-16T14:35:45.084 INFO:tasks.workunit.client.1.smithi115.stdout:8/784: truncate d0/da5/fce 1694050 0 2024-04-16T14:35:45.084 INFO:tasks.workunit.client.1.smithi115.stdout:8/785: dread - d0/db/d10/d17/d2c/d52/d74/fe7 zero size 2024-04-16T14:35:45.085 INFO:tasks.workunit.client.1.smithi115.stdout:9/851: write d1/d6/d29/f32 [7290498,81012] 0 2024-04-16T14:35:45.085 INFO:tasks.workunit.client.1.smithi115.stdout:7/672: rename d0/d24/da3/db1/d3f/fae to d0/d24/da3/db1/fe4 0 2024-04-16T14:35:45.089 INFO:tasks.workunit.client.1.smithi115.stdout:7/673: rename d0/d2/d3a/d30/d6b/da2/fca to d0/d2/d3a/dac/da7/fe5 0 2024-04-16T14:35:45.092 INFO:tasks.workunit.client.1.smithi115.stdout:5/747: dread dc/d15/d35/d69/f70 [0,4194304] 0 2024-04-16T14:35:45.092 INFO:tasks.workunit.client.1.smithi115.stdout:2/885: dwrite d0/d47/d65/dad/dc8/faa [0,4194304] 0 2024-04-16T14:35:45.092 INFO:tasks.workunit.client.1.smithi115.stdout:5/748: write dc/d15/d2d/f32 [2577268,33026] 0 2024-04-16T14:35:45.092 INFO:tasks.workunit.client.1.smithi115.stdout:2/886: creat d0/d47/d65/dad/dc8/d24/d10/f123 x:0 0 0 2024-04-16T14:35:45.092 INFO:tasks.workunit.client.1.smithi115.stdout:2/887: fdatasync d0/d47/d65/dad/dc8/d24/d23/d83/fd7 0 2024-04-16T14:35:45.093 INFO:tasks.workunit.client.1.smithi115.stdout:8/786: write d0/db/d44/f93 [3023825,33343] 0 2024-04-16T14:35:45.095 INFO:tasks.workunit.client.1.smithi115.stdout:6/777: getdents d13/d1d/d47 0 2024-04-16T14:35:45.095 INFO:tasks.workunit.client.1.smithi115.stdout:8/787: getdents d0/db/d10 0 2024-04-16T14:35:45.095 INFO:tasks.workunit.client.1.smithi115.stdout:8/788: creat d0/db/d10/d17/d2c/d52/d6c/db8/d64/d83/f103 x:0 0 0 2024-04-16T14:35:45.097 INFO:tasks.workunit.client.1.smithi115.stdout:8/789: mknod d0/db/d10/d17/d2c/d52/d84/c104 0 2024-04-16T14:35:45.098 INFO:tasks.workunit.client.1.smithi115.stdout:4/730: dread d1/f2d [4194304,4194304] 0 2024-04-16T14:35:45.098 INFO:tasks.workunit.client.1.smithi115.stdout:8/790: creat d0/db/d10/d17/d2c/d52/d74/d73/f105 x:0 0 0 2024-04-16T14:35:45.099 INFO:tasks.workunit.client.1.smithi115.stdout:8/791: symlink d0/db/d10/de8/l106 0 2024-04-16T14:35:45.101 INFO:tasks.workunit.client.1.smithi115.stdout:7/674: dread d0/d24/da3/db1/d3f/db0/f5f [0,4194304] 0 2024-04-16T14:35:45.103 INFO:tasks.workunit.client.1.smithi115.stdout:5/749: link dc/d79/f99 dc/d15/d35/d69/dad/fe3 0 2024-04-16T14:35:45.104 INFO:tasks.workunit.client.1.smithi115.stdout:9/852: dwrite d1/d6/d2d/d4b/d60/d65/fdc [0,4194304] 0 2024-04-16T14:35:45.106 INFO:tasks.workunit.client.1.smithi115.stdout:9/853: fsync d1/d6/d2d/d4b/d6c/d20/f22 0 2024-04-16T14:35:45.113 INFO:tasks.workunit.client.1.smithi115.stdout:8/792: write d0/db/d10/d17/f2b [3400023,48121] 0 2024-04-16T14:35:45.113 INFO:tasks.workunit.client.1.smithi115.stdout:8/793: fdatasync d0/db/d10/d17/d2c/d52/d6c/db8/d64/d89/fd7 0 2024-04-16T14:35:45.113 INFO:tasks.workunit.client.1.smithi115.stdout:5/750: write dc/d5d/d8f/f92 [4107405,99496] 0 2024-04-16T14:35:45.115 INFO:tasks.workunit.client.1.smithi115.stdout:6/778: creat d13/d1d/d68/f103 x:0 0 0 2024-04-16T14:35:45.115 INFO:tasks.workunit.client.1.smithi115.stdout:6/779: readlink d13/d1d/d2b/d5f/lf2 0 2024-04-16T14:35:45.115 INFO:tasks.workunit.client.1.smithi115.stdout:6/780: truncate d13/d1d/d68/fa2 1128673 0 2024-04-16T14:35:45.116 INFO:tasks.workunit.client.1.smithi115.stdout:8/794: rmdir d0/db/d10/d17/d2c/d52/d6c/db8/d64 39 2024-04-16T14:35:45.117 INFO:tasks.workunit.client.1.smithi115.stdout:8/795: rmdir d0/db/d10/d17/d2c/d52/d6c/db8/d64 39 2024-04-16T14:35:45.117 INFO:tasks.workunit.client.1.smithi115.stdout:4/731: mknod d1/d15/d24/dc6/ce0 0 2024-04-16T14:35:45.118 INFO:tasks.workunit.client.1.smithi115.stdout:8/796: getdents d0/db/dbb/dcd/dae/dde 0 2024-04-16T14:35:45.118 INFO:tasks.workunit.client.1.smithi115.stdout:9/854: write d1/d6/fcb [1104222,78797] 0 2024-04-16T14:35:45.119 INFO:tasks.workunit.client.1.smithi115.stdout:8/797: getdents d0/db/dbb/dcd/dae/dde/de9 0 2024-04-16T14:35:45.121 INFO:tasks.workunit.client.0.smithi005.stdout:8/822: sync 2024-04-16T14:35:45.121 INFO:tasks.workunit.client.0.smithi005.stdout:8/823: fdatasync d5/d55/fb3 0 2024-04-16T14:35:45.121 INFO:tasks.workunit.client.0.smithi005.stdout:8/824: dread - d5/d7b/da8/db7/d8a/da1/d3d/d7f/d8d/dd1/f10e zero size 2024-04-16T14:35:45.121 INFO:tasks.workunit.client.0.smithi005.stdout:8/825: write d5/d7b/f24 [3387629,42468] 0 2024-04-16T14:35:45.122 INFO:tasks.workunit.client.0.smithi005.stdout:8/826: dread - d5/d7b/da8/db7/d74/fd6 zero size 2024-04-16T14:35:45.126 INFO:tasks.workunit.client.1.smithi115.stdout:8/798: rename d0/db/d44/f93 to d0/db/d10/d17/d2c/d52/f107 0 2024-04-16T14:35:45.129 INFO:tasks.workunit.client.1.smithi115.stdout:4/732: link d1/d15/d31/cbc d1/d2/ce1 0 2024-04-16T14:35:45.130 INFO:tasks.workunit.client.1.smithi115.stdout:5/751: getdents dc/d8e 0 2024-04-16T14:35:45.131 INFO:tasks.workunit.client.1.smithi115.stdout:4/733: rename d1/d15/d24/c7c to d1/d15/d78/ce2 0 2024-04-16T14:35:45.132 INFO:tasks.workunit.client.0.smithi005.stdout:8/827: dread d5/d7b/f83 [0,4194304] 0 2024-04-16T14:35:45.138 INFO:tasks.workunit.client.1.smithi115.stdout:2/888: dwrite d0/d47/d65/dad/dc8/d24/da0/fd9 [0,4194304] 0 2024-04-16T14:35:45.138 INFO:tasks.workunit.client.1.smithi115.stdout:2/889: fdatasync d0/fa1 0 2024-04-16T14:35:45.139 INFO:tasks.workunit.client.1.smithi115.stdout:2/890: mkdir d0/d47/d65/dad/dbb/d11/d25/d95/d124 0 2024-04-16T14:35:45.142 INFO:tasks.workunit.client.1.smithi115.stdout:6/781: dwrite d13/f1c [0,4194304] 0 2024-04-16T14:35:45.142 INFO:tasks.workunit.client.1.smithi115.stdout:6/782: stat d13/c34 0 2024-04-16T14:35:45.142 INFO:tasks.workunit.client.1.smithi115.stdout:6/783: readlink d13/d1d/d2b/d5f/l3e 0 2024-04-16T14:35:45.142 INFO:tasks.workunit.client.1.smithi115.stdout:2/891: link d0/d47/d65/dad/dc8/f7 d0/d47/d65/dad/f125 0 2024-04-16T14:35:45.144 INFO:tasks.workunit.client.1.smithi115.stdout:4/734: write d1/f6b [684284,60215] 0 2024-04-16T14:35:45.145 INFO:tasks.workunit.client.1.smithi115.stdout:2/892: rename d0/d47/d65/d61/dae/f9e to d0/d47/d65/dad/dc8/d24/d23/d71/f126 0 2024-04-16T14:35:45.145 INFO:tasks.workunit.client.1.smithi115.stdout:9/855: dwrite d1/d6/d2d/d3d/d49/d88/fe5 [0,4194304] 0 2024-04-16T14:35:45.145 INFO:tasks.workunit.client.1.smithi115.stdout:9/856: chown d1/fd4 8491 1 2024-04-16T14:35:45.149 INFO:tasks.workunit.client.1.smithi115.stdout:5/752: dread dc/d15/f3e [0,4194304] 0 2024-04-16T14:35:45.149 INFO:tasks.workunit.client.1.smithi115.stdout:7/675: dwrite d0/d2/d3a/d30/d6b/da2/fa8 [0,4194304] 0 2024-04-16T14:35:45.150 INFO:tasks.workunit.client.1.smithi115.stdout:4/735: symlink d1/d15/d17/le3 0 2024-04-16T14:35:45.151 INFO:tasks.workunit.client.1.smithi115.stdout:2/893: creat d0/d47/d65/dad/dbb/d11/d25/d95/f127 x:0 0 0 2024-04-16T14:35:45.152 INFO:tasks.workunit.client.1.smithi115.stdout:2/894: fdatasync d0/d47/d65/dad/dc8/d4a/fa9 0 2024-04-16T14:35:45.153 INFO:tasks.workunit.client.1.smithi115.stdout:9/857: creat d1/d6/d2d/d4b/f12e x:0 0 0 2024-04-16T14:35:45.154 INFO:tasks.workunit.client.1.smithi115.stdout:9/858: fdatasync d1/d6/fcb 0 2024-04-16T14:35:45.154 INFO:tasks.workunit.client.0.smithi005.stdout:8/828: dwrite d5/d7b/da8/db7/d8a/da1/d3d/d7f/d8d/dd1/f11f [0,4194304] 0 2024-04-16T14:35:45.156 INFO:tasks.workunit.client.1.smithi115.stdout:7/676: unlink d0/d2/d3a/d30/d79/dd2/d9c/le2 0 2024-04-16T14:35:45.157 INFO:tasks.workunit.client.1.smithi115.stdout:5/753: creat dc/d5d/dc2/fe4 x:0 0 0 2024-04-16T14:35:45.163 INFO:tasks.workunit.client.1.smithi115.stdout:2/895: truncate d0/d47/d65/dad/dc8/d24/dc7/fe2 3142185 0 2024-04-16T14:35:45.163 INFO:tasks.workunit.client.1.smithi115.stdout:9/859: write d1/d6/d2d/fd8 [849999,20541] 0 2024-04-16T14:35:45.163 INFO:tasks.workunit.client.1.smithi115.stdout:9/860: fdatasync d1/d6/d2d/d4b/d6c/f44 0 2024-04-16T14:35:45.163 INFO:tasks.workunit.client.1.smithi115.stdout:9/861: read - d1/d6/d29/f10d zero size 2024-04-16T14:35:45.163 INFO:tasks.workunit.client.1.smithi115.stdout:6/784: dwrite d13/d1d/d2b/d5f/d30/d43/fda [0,4194304] 0 2024-04-16T14:35:45.163 INFO:tasks.workunit.client.1.smithi115.stdout:7/677: mkdir d0/d2/d3a/d73/de6 0 2024-04-16T14:35:45.163 INFO:tasks.workunit.client.1.smithi115.stdout:7/678: readlink d0/d2/d3a/d30/d79/dd2/d64/ldc 0 2024-04-16T14:35:45.164 INFO:tasks.workunit.client.1.smithi115.stdout:7/679: write d0/d2/d3a/d73/f7d [4384566,7918] 0 2024-04-16T14:35:45.165 INFO:tasks.workunit.client.1.smithi115.stdout:8/799: dwrite d0/db/d10/d17/d2c/d52/d74/f4d [0,4194304] 0 2024-04-16T14:35:45.168 INFO:tasks.workunit.client.1.smithi115.stdout:4/736: rename d1/d15/d78 to d1/d15/d31/dc2/de4 0 2024-04-16T14:35:45.168 INFO:tasks.workunit.client.1.smithi115.stdout:4/737: creat d1/d15/d17/d9e/dbe/fe5 x:0 0 0 2024-04-16T14:35:45.169 INFO:tasks.workunit.client.1.smithi115.stdout:2/896: mknod d0/d47/d65/dad/dbb/d11/dbc/c128 0 2024-04-16T14:35:45.176 INFO:tasks.workunit.client.1.smithi115.stdout:6/785: creat d13/d1d/d47/f104 x:0 0 0 2024-04-16T14:35:45.177 INFO:tasks.workunit.client.1.smithi115.stdout:7/680: symlink d0/d2/d3a/dac/le7 0 2024-04-16T14:35:45.177 INFO:tasks.workunit.client.1.smithi115.stdout:9/862: dwrite d1/d6/d2d/d4b/d8f/fc4 [0,4194304] 0 2024-04-16T14:35:45.177 INFO:tasks.workunit.client.1.smithi115.stdout:9/863: chown d1/d6/d2d/d4b/d6c/d20/l66 14732211 1 2024-04-16T14:35:45.180 INFO:tasks.workunit.client.1.smithi115.stdout:8/800: write d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/f9e [1492832,94753] 0 2024-04-16T14:35:45.181 INFO:tasks.workunit.client.1.smithi115.stdout:4/738: mkdir d1/d15/d17/de6 0 2024-04-16T14:35:45.181 INFO:tasks.workunit.client.1.smithi115.stdout:4/739: chown d1/d15/d1e/f29 67160926 1 2024-04-16T14:35:45.182 INFO:tasks.workunit.client.1.smithi115.stdout:7/681: mkdir d0/d2/d3a/d30/d79/dd2/d64/de8 0 2024-04-16T14:35:45.182 INFO:tasks.workunit.client.1.smithi115.stdout:7/682: dread - d0/d2/d3a/d30/d6b/fde zero size 2024-04-16T14:35:45.183 INFO:tasks.workunit.client.1.smithi115.stdout:7/683: fsync d0/d24/da3/db1/d3f/db0/f5f 0 2024-04-16T14:35:45.183 INFO:tasks.workunit.client.1.smithi115.stdout:8/801: mkdir d0/db/d10/d17/d2c/d85/d108 0 2024-04-16T14:35:45.183 INFO:tasks.workunit.client.1.smithi115.stdout:8/802: truncate d0/db/d10/d17/d2c/d52/d74/f45 3336744 0 2024-04-16T14:35:45.186 INFO:tasks.workunit.client.1.smithi115.stdout:2/897: dwrite d0/d1b/f41 [0,4194304] 0 2024-04-16T14:35:45.189 INFO:tasks.workunit.client.1.smithi115.stdout:9/864: mknod d1/d6/d2d/d4b/d8f/d91/dda/ddd/de8/d112/c12f 0 2024-04-16T14:35:45.189 INFO:tasks.workunit.client.1.smithi115.stdout:7/684: write d0/d1/f1f [2499582,56918] 0 2024-04-16T14:35:45.192 INFO:tasks.workunit.client.1.smithi115.stdout:5/754: rename dc/d15/d35/l3a to dc/d15/d35/d71/le5 0 2024-04-16T14:35:45.192 INFO:tasks.workunit.client.1.smithi115.stdout:4/740: mkdir d1/d15/d31/dc2/de4/de7 0 2024-04-16T14:35:45.193 INFO:tasks.workunit.client.1.smithi115.stdout:4/741: dread - d1/d15/d31/d42/d46/d7a/fba zero size 2024-04-16T14:35:45.197 INFO:tasks.workunit.client.1.smithi115.stdout:9/865: unlink d1/d6/d2d/d3d/d49/d98/fbd 0 2024-04-16T14:35:45.201 INFO:tasks.workunit.client.1.smithi115.stdout:5/755: truncate dc/d3d/f7e 3966217 0 2024-04-16T14:35:45.201 INFO:tasks.workunit.client.1.smithi115.stdout:5/756: readlink dc/d5d/d8f/ldf 0 2024-04-16T14:35:45.203 INFO:tasks.workunit.client.1.smithi115.stdout:6/786: rename d13/d1d/d2b/d5f/d30/d43/da6 to d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105 0 2024-04-16T14:35:45.207 INFO:tasks.workunit.client.1.smithi115.stdout:5/757: getdents dc/d15/d35/d69 0 2024-04-16T14:35:45.207 INFO:tasks.workunit.client.1.smithi115.stdout:5/758: write dc/d15/d2d/d8c/fb9 [1112376,88942] 0 2024-04-16T14:35:45.207 INFO:tasks.workunit.client.1.smithi115.stdout:5/759: write dc/d5d/d8f/fa7 [1049101,30364] 0 2024-04-16T14:35:45.209 INFO:tasks.workunit.client.1.smithi115.stdout:2/898: dwrite d0/d47/d65/dad/dbb/d11/d25/ff8 [0,4194304] 0 2024-04-16T14:35:45.209 INFO:tasks.workunit.client.1.smithi115.stdout:0/588: sync 2024-04-16T14:35:45.210 INFO:tasks.workunit.client.1.smithi115.stdout:8/803: rename d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/d8a/c9b to d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/c109 0 2024-04-16T14:35:45.212 INFO:tasks.workunit.client.1.smithi115.stdout:1/807: sync 2024-04-16T14:35:45.212 INFO:tasks.workunit.client.1.smithi115.stdout:3/816: sync 2024-04-16T14:35:45.212 INFO:tasks.workunit.client.1.smithi115.stdout:3/817: stat dc/d29/f7f 0 2024-04-16T14:35:45.213 INFO:tasks.workunit.client.1.smithi115.stdout:3/818: mknod dc/d29/d4d/c113 0 2024-04-16T14:35:45.213 INFO:tasks.workunit.client.1.smithi115.stdout:3/819: write dc/d29/fe6 [4307155,15737] 0 2024-04-16T14:35:45.213 INFO:tasks.workunit.client.1.smithi115.stdout:9/866: dread d1/fa8 [4194304,4194304] 0 2024-04-16T14:35:45.213 INFO:tasks.workunit.client.1.smithi115.stdout:3/820: symlink dc/d24/d36/l114 0 2024-04-16T14:35:45.214 INFO:tasks.workunit.client.1.smithi115.stdout:3/821: mknod dc/d24/d33/d4b/d81/c115 0 2024-04-16T14:35:45.214 INFO:tasks.workunit.client.1.smithi115.stdout:3/822: readlink dc/d24/d80/lc0 0 2024-04-16T14:35:45.215 INFO:tasks.workunit.client.1.smithi115.stdout:2/899: mkdir d0/d47/d65/dad/dc8/d24/d23/d129 0 2024-04-16T14:35:45.215 INFO:tasks.workunit.client.1.smithi115.stdout:2/900: chown d0/d47/cc4 54460926 1 2024-04-16T14:35:45.217 INFO:tasks.workunit.client.1.smithi115.stdout:3/823: creat dc/d29/f116 x:0 0 0 2024-04-16T14:35:45.217 INFO:tasks.workunit.client.1.smithi115.stdout:6/787: dread d13/d1d/d49/f8b [0,4194304] 0 2024-04-16T14:35:45.217 INFO:tasks.workunit.client.1.smithi115.stdout:6/788: truncate d13/d1d/d68/fef 946758 0 2024-04-16T14:35:45.218 INFO:tasks.workunit.client.1.smithi115.stdout:9/867: dread d1/d6/d2d/d4b/d8f/d91/f6e [0,4194304] 0 2024-04-16T14:35:45.218 INFO:tasks.workunit.client.1.smithi115.stdout:9/868: write d1/d6/d2d/d4b/d8f/d91/fdf [487780,46638] 0 2024-04-16T14:35:45.218 INFO:tasks.workunit.client.1.smithi115.stdout:3/824: symlink dc/d24/d33/d4b/l117 0 2024-04-16T14:35:45.218 INFO:tasks.workunit.client.1.smithi115.stdout:7/685: dwrite d0/d24/fd4 [0,4194304] 0 2024-04-16T14:35:45.218 INFO:tasks.workunit.client.1.smithi115.stdout:5/760: write dc/d15/f19 [1417668,9136] 0 2024-04-16T14:35:45.219 INFO:tasks.workunit.client.1.smithi115.stdout:7/686: chown d0/d24/da3/db1/d49/cbb 122811965 1 2024-04-16T14:35:45.219 INFO:tasks.workunit.client.1.smithi115.stdout:4/742: dwrite d1/d15/d1e/f29 [4194304,4194304] 0 2024-04-16T14:35:45.219 INFO:tasks.workunit.client.1.smithi115.stdout:2/901: truncate d0/d47/d65/dad/dbb/d11/f96 3702031 0 2024-04-16T14:35:45.220 INFO:tasks.workunit.client.1.smithi115.stdout:0/589: symlink d6/d10/d12/dba/lc7 0 2024-04-16T14:35:45.222 INFO:tasks.workunit.client.1.smithi115.stdout:8/804: mknod d0/db/d10/d17/d22/c10a 0 2024-04-16T14:35:45.224 INFO:tasks.workunit.client.1.smithi115.stdout:1/808: dread df/d13/d4d/f2e [0,4194304] 0 2024-04-16T14:35:45.224 INFO:tasks.workunit.client.1.smithi115.stdout:1/809: fdatasync df/f10 0 2024-04-16T14:35:45.224 INFO:tasks.workunit.client.1.smithi115.stdout:8/805: unlink d0/db/d10/d17/d22/deb/f5f 0 2024-04-16T14:35:45.225 INFO:tasks.workunit.client.1.smithi115.stdout:8/806: readlink d0/db/le0 0 2024-04-16T14:35:45.226 INFO:tasks.workunit.client.0.smithi005.stdout:3/966: sync 2024-04-16T14:35:45.226 INFO:tasks.workunit.client.0.smithi005.stdout:9/684: sync 2024-04-16T14:35:45.226 INFO:tasks.workunit.client.0.smithi005.stdout:3/967: read - d2/d17/d46/d47/f10e zero size 2024-04-16T14:35:45.226 INFO:tasks.workunit.client.0.smithi005.stdout:9/685: chown d3/d12/d16/d46/f9b 8 1 2024-04-16T14:35:45.226 INFO:tasks.workunit.client.0.smithi005.stdout:3/968: truncate d2/d17/d46/d75/d9b/fcb 692438 0 2024-04-16T14:35:45.226 INFO:tasks.workunit.client.0.smithi005.stdout:3/969: chown d2/d9/df/c4e 98155 1 2024-04-16T14:35:45.227 INFO:tasks.workunit.client.0.smithi005.stdout:3/970: chown d2/d9/df/dbf/cde 19185 1 2024-04-16T14:35:45.228 INFO:tasks.workunit.client.1.smithi115.stdout:7/687: dread d0/d2/d3a/d30/f32 [0,4194304] 0 2024-04-16T14:35:45.228 INFO:tasks.workunit.client.0.smithi005.stdout:3/971: link d2/d9/f105 d2/d17/f158 0 2024-04-16T14:35:45.229 INFO:tasks.workunit.client.0.smithi005.stdout:9/686: rmdir d3/d49/d4b/d5c 39 2024-04-16T14:35:45.230 INFO:tasks.workunit.client.1.smithi115.stdout:5/761: getdents dc/d15/d2d/d8c 0 2024-04-16T14:35:45.234 INFO:tasks.workunit.client.0.smithi005.stdout:3/972: truncate d2/d92/fc0 2184366 0 2024-04-16T14:35:45.235 INFO:tasks.workunit.client.1.smithi115.stdout:4/743: stat d1/d15/d24/c2e 0 2024-04-16T14:35:45.235 INFO:tasks.workunit.client.1.smithi115.stdout:4/744: write d1/f68 [560796,35170] 0 2024-04-16T14:35:45.235 INFO:tasks.workunit.client.0.smithi005.stdout:3/973: dread d2/d9/df/dbf/df8/fb2 [0,4194304] 0 2024-04-16T14:35:45.236 INFO:tasks.workunit.client.1.smithi115.stdout:5/762: dread dc/d15/d2d/f32 [0,4194304] 0 2024-04-16T14:35:45.236 INFO:tasks.workunit.client.1.smithi115.stdout:0/590: truncate d6/d10/d12/d31/d35/d9b/f49 2771527 0 2024-04-16T14:35:45.236 INFO:tasks.workunit.client.0.smithi005.stdout:3/974: creat d2/d9/d14d/f159 x:0 0 0 2024-04-16T14:35:45.237 INFO:tasks.workunit.client.1.smithi115.stdout:4/745: dread d1/d15/d31/d55/f7f [0,4194304] 0 2024-04-16T14:35:45.238 INFO:tasks.workunit.client.1.smithi115.stdout:6/789: rename d13/d1d/l5d to d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96/dbc/l106 0 2024-04-16T14:35:45.239 INFO:tasks.workunit.client.0.smithi005.stdout:3/975: creat d2/d17/d46/d75/d9b/f15a x:0 0 0 2024-04-16T14:35:45.239 INFO:tasks.workunit.client.0.smithi005.stdout:3/976: readlink d2/d9/df/daa/d127/d12a/l157 0 2024-04-16T14:35:45.240 INFO:tasks.workunit.client.1.smithi115.stdout:1/810: creat df/d35/d48/f115 x:0 0 0 2024-04-16T14:35:45.240 INFO:tasks.workunit.client.1.smithi115.stdout:1/811: dread - df/d13/d4d/d68/de7/fbc zero size 2024-04-16T14:35:45.240 INFO:tasks.workunit.client.1.smithi115.stdout:1/812: chown df/d13/d4d/d3e/d7d/l104 2 1 2024-04-16T14:35:45.240 INFO:tasks.workunit.client.1.smithi115.stdout:1/813: readlink df/d13/d4d/d6d/lf7 0 2024-04-16T14:35:45.241 INFO:tasks.workunit.client.0.smithi005.stdout:9/687: write d3/f7 [1674035,48870] 0 2024-04-16T14:35:45.241 INFO:tasks.workunit.client.0.smithi005.stdout:3/977: mkdir d2/d17/d46/d75/d9b/dbd/d15b 0 2024-04-16T14:35:45.242 INFO:tasks.workunit.client.1.smithi115.stdout:0/591: mkdir d6/d10/dc8 0 2024-04-16T14:35:45.244 INFO:tasks.workunit.client.1.smithi115.stdout:6/790: chown d13/d1d/d87/lc1 1569037 1 2024-04-16T14:35:45.244 INFO:tasks.workunit.client.1.smithi115.stdout:6/791: write d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/d5a/fbd [832377,19086] 0 2024-04-16T14:35:45.245 INFO:tasks.workunit.client.0.smithi005.stdout:3/978: mkdir d2/d9/df/dbf/df8/d15c 0 2024-04-16T14:35:45.247 INFO:tasks.workunit.client.0.smithi005.stdout:3/979: mknod d2/d17/d102/d129/c15d 0 2024-04-16T14:35:45.247 INFO:tasks.workunit.client.1.smithi115.stdout:9/869: rename d1/d6/d2d/d3d/d49/fc3 to d1/d6/d2d/d4b/d6c/d20/d36/dce/f130 0 2024-04-16T14:35:45.249 INFO:tasks.workunit.client.1.smithi115.stdout:0/592: mkdir d6/d10/d12/d31/d35/d44/dc9 0 2024-04-16T14:35:45.249 INFO:tasks.workunit.client.1.smithi115.stdout:0/593: chown d6/d10/d12/d31/ca6 0 1 2024-04-16T14:35:45.249 INFO:tasks.workunit.client.1.smithi115.stdout:0/594: stat d6/d10/d12/d31/d35/d9b/f49 0 2024-04-16T14:35:45.249 INFO:tasks.workunit.client.0.smithi005.stdout:3/980: creat d2/d17/d46/d75/d9b/dbd/f15e x:0 0 0 2024-04-16T14:35:45.250 INFO:tasks.workunit.client.1.smithi115.stdout:5/763: dread dc/d15/d35/f48 [0,4194304] 0 2024-04-16T14:35:45.251 INFO:tasks.workunit.client.0.smithi005.stdout:3/981: creat d2/d9/d5e/d152/f15f x:0 0 0 2024-04-16T14:35:45.251 INFO:tasks.workunit.client.0.smithi005.stdout:3/982: readlink d2/d17/d46/d75/d41/l59 0 2024-04-16T14:35:45.252 INFO:tasks.workunit.client.1.smithi115.stdout:6/792: creat d13/d1d/d2b/df4/f107 x:0 0 0 2024-04-16T14:35:45.253 INFO:tasks.workunit.client.1.smithi115.stdout:4/746: write d1/d2/f5b [1509519,65681] 0 2024-04-16T14:35:45.253 INFO:tasks.workunit.client.1.smithi115.stdout:4/747: fdatasync d1/d15/d1e/f29 0 2024-04-16T14:35:45.253 INFO:tasks.workunit.client.1.smithi115.stdout:4/748: chown d1/d15/d17/f80 16 1 2024-04-16T14:35:45.253 INFO:tasks.workunit.client.1.smithi115.stdout:7/688: dwrite d0/d2/d3a/d30/d79/fc4 [0,4194304] 0 2024-04-16T14:35:45.253 INFO:tasks.workunit.client.1.smithi115.stdout:7/689: write d0/d24/da3/db1/d3f/db0/fb8 [4915250,68987] 0 2024-04-16T14:35:45.253 INFO:tasks.workunit.client.1.smithi115.stdout:9/870: symlink d1/d6/d2d/d3d/l131 0 2024-04-16T14:35:45.253 INFO:tasks.workunit.client.1.smithi115.stdout:1/814: read df/d13/d4d/d6d/fb2 [1709947,51818] 0 2024-04-16T14:35:45.254 INFO:tasks.workunit.client.0.smithi005.stdout:3/983: rename d2/d9/df/dbf/df8/fb2 to d2/d9/d25/d39/d64/f160 0 2024-04-16T14:35:45.254 INFO:tasks.workunit.client.1.smithi115.stdout:2/902: rename d0/d47/d65/dad/dc8/d24/d23/d83/l107 to d0/d47/d65/dad/dbb/l12a 0 2024-04-16T14:35:45.255 INFO:tasks.workunit.client.0.smithi005.stdout:3/984: truncate d2/d9/df/dbf/fdb 3052933 0 2024-04-16T14:35:45.255 INFO:tasks.workunit.client.1.smithi115.stdout:0/595: mkdir d6/d1b/d4e/db9/dca 0 2024-04-16T14:35:45.258 INFO:tasks.workunit.client.1.smithi115.stdout:8/807: rename d0/db/d10/d17/d2c/f5e to d0/db/d10/d17/d2c/d52/d74/d3b/d56/dfc/f10b 0 2024-04-16T14:35:45.258 INFO:tasks.workunit.client.1.smithi115.stdout:8/808: chown d0/db/d10/c39 729136 1 2024-04-16T14:35:45.258 INFO:tasks.workunit.client.1.smithi115.stdout:8/809: chown d0/fdd 38623554 1 2024-04-16T14:35:45.258 INFO:tasks.workunit.client.1.smithi115.stdout:8/810: read d0/db/d10/d17/d2c/d52/d74/d3b/fb2 [16803,128701] 0 2024-04-16T14:35:45.260 INFO:tasks.workunit.client.1.smithi115.stdout:3/825: dwrite dc/f3d [0,4194304] 0 2024-04-16T14:35:45.261 INFO:tasks.workunit.client.1.smithi115.stdout:3/826: dread dc/d29/d4d/d56/d98/dbe/f110 [0,4194304] 0 2024-04-16T14:35:45.261 INFO:tasks.workunit.client.1.smithi115.stdout:8/811: rename d0/db/d10/d17/d2c/ff9 to d0/db/d10/d17/d22/deb/d7c/dc0/f10c 0 2024-04-16T14:35:45.262 INFO:tasks.workunit.client.0.smithi005.stdout:9/688: dwrite d3/d12/d2b/f4e [0,4194304] 0 2024-04-16T14:35:45.263 INFO:tasks.workunit.client.1.smithi115.stdout:4/749: unlink d1/d15/d31/dc2/de4/ce2 0 2024-04-16T14:35:45.263 INFO:tasks.workunit.client.1.smithi115.stdout:4/750: creat d1/d15/d24/dc6/fe8 x:0 0 0 2024-04-16T14:35:45.263 INFO:tasks.workunit.client.1.smithi115.stdout:4/751: write d1/d15/d1e/f81 [7538,97653] 0 2024-04-16T14:35:45.263 INFO:tasks.workunit.client.1.smithi115.stdout:6/793: dread d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96/f23 [0,4194304] 0 2024-04-16T14:35:45.263 INFO:tasks.workunit.client.0.smithi005.stdout:3/985: write d2/d6b/ffb [3033679,83647] 0 2024-04-16T14:35:45.266 INFO:tasks.workunit.client.1.smithi115.stdout:8/812: truncate d0/db/d10/d17/d22/deb/f67 2108760 0 2024-04-16T14:35:45.266 INFO:tasks.workunit.client.1.smithi115.stdout:8/813: chown d0/db/d10/d17/d2c/d52/d6c/db8/d6b 76175 1 2024-04-16T14:35:45.267 INFO:tasks.workunit.client.1.smithi115.stdout:3/827: symlink dc/d29/d39/l118 0 2024-04-16T14:35:45.269 INFO:tasks.workunit.client.1.smithi115.stdout:3/828: creat dc/d24/f119 x:0 0 0 2024-04-16T14:35:45.269 INFO:tasks.workunit.client.1.smithi115.stdout:7/690: unlink d0/d2/d3a/d30/d6b/f75 0 2024-04-16T14:35:45.272 INFO:tasks.workunit.client.0.smithi005.stdout:3/986: unlink d2/d17/f54 0 2024-04-16T14:35:45.272 INFO:tasks.workunit.client.0.smithi005.stdout:3/987: write d2/d92/fc0 [2580951,31018] 0 2024-04-16T14:35:45.272 INFO:tasks.workunit.client.1.smithi115.stdout:8/814: dread d0/db/d44/f59 [0,4194304] 0 2024-04-16T14:35:45.274 INFO:tasks.workunit.client.1.smithi115.stdout:8/815: dread d0/da5/fce [0,4194304] 0 2024-04-16T14:35:45.274 INFO:tasks.workunit.client.1.smithi115.stdout:8/816: stat d0/db/d10/d17/d22/c10a 0 2024-04-16T14:35:45.274 INFO:tasks.workunit.client.1.smithi115.stdout:8/817: rename d0/db/d10/d17/d2c to d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d10d 22 2024-04-16T14:35:45.274 INFO:tasks.workunit.client.1.smithi115.stdout:1/815: truncate df/d35/f39 4113122 0 2024-04-16T14:35:45.275 INFO:tasks.workunit.client.1.smithi115.stdout:1/816: read df/d36/fae [1018199,63978] 0 2024-04-16T14:35:45.275 INFO:tasks.workunit.client.1.smithi115.stdout:1/817: dread - df/d36/dff/f10a zero size 2024-04-16T14:35:45.275 INFO:tasks.workunit.client.1.smithi115.stdout:2/903: symlink d0/d47/d65/dad/dbb/d11/d36/d86/l12b 0 2024-04-16T14:35:45.277 INFO:tasks.workunit.client.0.smithi005.stdout:3/988: mknod d2/d17/c161 0 2024-04-16T14:35:45.277 INFO:tasks.workunit.client.1.smithi115.stdout:0/596: mkdir d6/d10/d12/d1f/d36/d4b/d6d/dcb 0 2024-04-16T14:35:45.281 INFO:tasks.workunit.client.1.smithi115.stdout:5/764: rmdir dc/d5d/dc2 39 2024-04-16T14:35:45.281 INFO:tasks.workunit.client.0.smithi005.stdout:3/989: unlink d2/d17/d46/d75/d9b/fb8 0 2024-04-16T14:35:45.282 INFO:tasks.workunit.client.0.smithi005.stdout:3/990: symlink d2/d17/d46/d75/d6d/df3/l162 0 2024-04-16T14:35:45.284 INFO:tasks.workunit.client.1.smithi115.stdout:4/752: mkdir d1/d15/d17/de6/de9 0 2024-04-16T14:35:45.284 INFO:tasks.workunit.client.0.smithi005.stdout:2/745: sync 2024-04-16T14:35:45.284 INFO:tasks.workunit.client.0.smithi005.stdout:0/792: sync 2024-04-16T14:35:45.284 INFO:tasks.workunit.client.0.smithi005.stdout:6/999: sync 2024-04-16T14:35:45.285 INFO:tasks.workunit.client.1.smithi115.stdout:6/794: truncate d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/f8a 65896 0 2024-04-16T14:35:45.286 INFO:tasks.workunit.client.1.smithi115.stdout:7/691: mknod d0/d2/d3a/dac/ce9 0 2024-04-16T14:35:45.287 INFO:tasks.workunit.client.1.smithi115.stdout:2/904: write d0/d47/d65/dad/dc8/d24/d23/f9c [2037966,112067] 0 2024-04-16T14:35:45.289 INFO:tasks.workunit.client.0.smithi005.stdout:0/793: mkdir da/df/d26/da9/d10d 0 2024-04-16T14:35:45.290 INFO:tasks.workunit.client.1.smithi115.stdout:9/871: getdents d1/d6/d2d/d4b/d6c/d20/d36 0 2024-04-16T14:35:45.291 INFO:tasks.workunit.client.0.smithi005.stdout:2/746: getdents d0/d1c/d8d 0 2024-04-16T14:35:45.291 INFO:tasks.workunit.client.1.smithi115.stdout:5/765: dread dc/d15/d35/d69/dad/fe3 [0,4194304] 0 2024-04-16T14:35:45.291 INFO:tasks.workunit.client.1.smithi115.stdout:5/766: readlink dc/l45 0 2024-04-16T14:35:45.294 INFO:tasks.workunit.client.0.smithi005.stdout:9/689: dwrite d3/d49/d4b/d55/f5d [0,4194304] 0 2024-04-16T14:35:45.294 INFO:tasks.workunit.client.0.smithi005.stdout:0/794: mknod da/df/df7/c10e 0 2024-04-16T14:35:45.294 INFO:tasks.workunit.client.0.smithi005.stdout:9/690: chown d3/d49/d4b/d5c 809549 1 2024-04-16T14:35:45.294 INFO:tasks.workunit.client.0.smithi005.stdout:9/691: stat d3/d49/d4b/d5c 0 2024-04-16T14:35:45.294 INFO:tasks.workunit.client.0.smithi005.stdout:0/795: stat da/df/d26/da9/d108/d75/fde 0 2024-04-16T14:35:45.295 INFO:tasks.workunit.client.0.smithi005.stdout:2/747: truncate d0/d1c/d39/d85/da2/db0/fe2 4003111 0 2024-04-16T14:35:45.295 INFO:tasks.workunit.client.1.smithi115.stdout:1/818: unlink df/d13/d4d/d3e/d75/f7e 0 2024-04-16T14:35:45.295 INFO:tasks.workunit.client.1.smithi115.stdout:1/819: write df/d13/d4d/d3e/f62 [415656,69827] 0 2024-04-16T14:35:45.295 INFO:tasks.workunit.client.1.smithi115.stdout:1/820: creat df/d13/d4d/d6d/dc5/f116 x:0 0 0 2024-04-16T14:35:45.296 INFO:tasks.workunit.client.1.smithi115.stdout:0/597: creat d6/d54/d57/d83/fcc x:0 0 0 2024-04-16T14:35:45.297 INFO:tasks.workunit.client.1.smithi115.stdout:8/818: dwrite d0/db/d44/fc1 [4194304,4194304] 0 2024-04-16T14:35:45.298 INFO:tasks.workunit.client.1.smithi115.stdout:9/872: dread d1/d6/d2d/d4b/d8f/d91/fdf [0,4194304] 0 2024-04-16T14:35:45.298 INFO:tasks.workunit.client.0.smithi005.stdout:0/796: rmdir da/df/df7 39 2024-04-16T14:35:45.299 INFO:tasks.workunit.client.1.smithi115.stdout:6/795: rename d13/d1d/d47/fab to d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/f108 0 2024-04-16T14:35:45.299 INFO:tasks.workunit.client.1.smithi115.stdout:6/796: fdatasync d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/f6b 0 2024-04-16T14:35:45.300 INFO:tasks.workunit.client.1.smithi115.stdout:6/797: dread d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96/f77 [4194304,4194304] 0 2024-04-16T14:35:45.300 INFO:tasks.workunit.client.1.smithi115.stdout:2/905: creat d0/d47/d65/dad/dbb/d11/d25/f12c x:0 0 0 2024-04-16T14:35:45.301 INFO:tasks.workunit.client.0.smithi005.stdout:3/991: dread d2/d17/d46/f4b [0,4194304] 0 2024-04-16T14:35:45.301 INFO:tasks.workunit.client.0.smithi005.stdout:9/692: mkdir d3/d49/dc8 0 2024-04-16T14:35:45.302 INFO:tasks.workunit.client.1.smithi115.stdout:3/829: truncate dc/d24/d36/f4e 3757538 0 2024-04-16T14:35:45.302 INFO:tasks.workunit.client.1.smithi115.stdout:3/830: truncate dc/d29/d4d/d56/d7e/fa0 327844 0 2024-04-16T14:35:45.305 INFO:tasks.workunit.client.1.smithi115.stdout:1/821: mknod df/d13/d4d/d3e/d75/dfc/c117 0 2024-04-16T14:35:45.309 INFO:tasks.workunit.client.1.smithi115.stdout:8/819: link d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/d8a/fa0 d0/db/d10/d17/d22/deb/d7c/f10e 0 2024-04-16T14:35:45.311 INFO:tasks.workunit.client.1.smithi115.stdout:0/598: write d6/d10/d12/d31/d35/d9b/fab [130125,40392] 0 2024-04-16T14:35:45.313 INFO:tasks.workunit.client.1.smithi115.stdout:3/831: mkdir dc/d24/d80/dfc/d11a 0 2024-04-16T14:35:45.316 INFO:tasks.workunit.client.1.smithi115.stdout:9/873: symlink d1/d6/d2d/d4b/d8f/d91/dda/ddd/dfc/l132 0 2024-04-16T14:35:45.316 INFO:tasks.workunit.client.0.smithi005.stdout:3/992: rmdir d2/d17/d46 39 2024-04-16T14:35:45.316 INFO:tasks.workunit.client.0.smithi005.stdout:3/993: truncate d2/d9/df/fc8 252949 0 2024-04-16T14:35:45.317 INFO:tasks.workunit.client.0.smithi005.stdout:3/994: read d2/d9/f55 [57951,42573] 0 2024-04-16T14:35:45.318 INFO:tasks.workunit.client.1.smithi115.stdout:7/692: rename d0/d24/cdb to d0/d24/da3/db1/d5a/cea 0 2024-04-16T14:35:45.320 INFO:tasks.workunit.client.0.smithi005.stdout:9/693: truncate d3/d49/d4b/d55/f9f 3057517 0 2024-04-16T14:35:45.323 INFO:tasks.workunit.client.1.smithi115.stdout:9/874: symlink d1/d6/d2d/d4b/d90/l133 0 2024-04-16T14:35:45.323 INFO:tasks.workunit.client.1.smithi115.stdout:9/875: creat d1/d6/d2d/d4b/f134 x:0 0 0 2024-04-16T14:35:45.323 INFO:tasks.workunit.client.1.smithi115.stdout:9/876: write d1/d6/d2d/d4b/d6c/d20/d36/ff7 [413006,77157] 0 2024-04-16T14:35:45.325 INFO:tasks.workunit.client.0.smithi005.stdout:2/748: unlink d0/d2a/d3a/fb6 0 2024-04-16T14:35:45.325 INFO:tasks.workunit.client.0.smithi005.stdout:2/749: fdatasync d0/d29/d3e/f42 0 2024-04-16T14:35:45.326 INFO:tasks.workunit.client.0.smithi005.stdout:0/797: dwrite da/f20 [0,4194304] 0 2024-04-16T14:35:45.326 INFO:tasks.workunit.client.0.smithi005.stdout:3/995: write d2/d9/d7d/f11d [1117603,54269] 0 2024-04-16T14:35:45.326 INFO:tasks.workunit.client.1.smithi115.stdout:6/798: rename d13/d1d/d2b/d5f/f6a to d13/d1d/d2b/f109 0 2024-04-16T14:35:45.326 INFO:tasks.workunit.client.1.smithi115.stdout:6/799: read d13/d1d/d49/f70 [1255821,118104] 0 2024-04-16T14:35:45.327 INFO:tasks.workunit.client.1.smithi115.stdout:3/832: dread dc/d29/d4d/f59 [0,4194304] 0 2024-04-16T14:35:45.328 INFO:tasks.workunit.client.1.smithi115.stdout:1/822: read df/d13/d4d/d2c/f24 [2102110,22369] 0 2024-04-16T14:35:45.328 INFO:tasks.workunit.client.1.smithi115.stdout:5/767: dwrite dc/d15/d35/d69/f72 [4194304,4194304] 0 2024-04-16T14:35:45.329 INFO:tasks.workunit.client.0.smithi005.stdout:2/750: mknod d0/d29/d89/de3/cf4 0 2024-04-16T14:35:45.329 INFO:tasks.workunit.client.1.smithi115.stdout:7/693: rename d0/d24/fd4 to d0/d2/d3a/d30/d6b/da2/feb 0 2024-04-16T14:35:45.331 INFO:tasks.workunit.client.1.smithi115.stdout:6/800: link d13/d1d/d47/c94 d13/d1d/d47/c10a 0 2024-04-16T14:35:45.331 INFO:tasks.workunit.client.1.smithi115.stdout:6/801: chown d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/l95 8804 1 2024-04-16T14:35:45.331 INFO:tasks.workunit.client.1.smithi115.stdout:6/802: readlink d13/d1d/d2b/d5f/l3e 0 2024-04-16T14:35:45.332 INFO:tasks.workunit.client.0.smithi005.stdout:0/798: symlink da/df/d1b/d3a/d53/d5a/d67/dda/l10f 0 2024-04-16T14:35:45.333 INFO:tasks.workunit.client.0.smithi005.stdout:0/799: read - da/df/d26/d39/d55/ddc/ffc zero size 2024-04-16T14:35:45.333 INFO:tasks.workunit.client.0.smithi005.stdout:0/800: stat da/c13 0 2024-04-16T14:35:45.333 INFO:tasks.workunit.client.1.smithi115.stdout:8/820: dwrite d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/fc2 [0,4194304] 0 2024-04-16T14:35:45.333 INFO:tasks.workunit.client.1.smithi115.stdout:8/821: truncate d0/db/d10/d17/d2c/d52/d6c/db8/d64/d83/f103 629389 0 2024-04-16T14:35:45.335 INFO:tasks.workunit.client.1.smithi115.stdout:0/599: dread d6/d10/d12/d31/d35/d9b/f49 [0,4194304] 0 2024-04-16T14:35:45.335 INFO:tasks.workunit.client.1.smithi115.stdout:0/600: chown d6/d10/d12/d1f/d36/d4b/d70/d8a/fb1 258242718 1 2024-04-16T14:35:45.337 INFO:tasks.workunit.client.1.smithi115.stdout:7/694: mkdir d0/d2/d3a/d30/d79/d95/dec 0 2024-04-16T14:35:45.339 INFO:tasks.workunit.client.1.smithi115.stdout:6/803: creat d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/f10b x:0 0 0 2024-04-16T14:35:45.340 INFO:tasks.workunit.client.1.smithi115.stdout:6/804: creat d13/d1d/d2b/df4/f10c x:0 0 0 2024-04-16T14:35:45.341 INFO:tasks.workunit.client.1.smithi115.stdout:9/877: dread d1/d6/d2d/d4b/d8f/fc4 [0,4194304] 0 2024-04-16T14:35:45.341 INFO:tasks.workunit.client.1.smithi115.stdout:9/878: dread - d1/d6/f118 zero size 2024-04-16T14:35:45.341 INFO:tasks.workunit.client.1.smithi115.stdout:5/768: rmdir dc/d15/d2d 39 2024-04-16T14:35:45.341 INFO:tasks.workunit.client.1.smithi115.stdout:0/601: mknod d6/d10/d12/d31/ccd 0 2024-04-16T14:35:45.344 INFO:tasks.workunit.client.1.smithi115.stdout:2/906: dwrite d0/d47/d65/dad/dc8/d22/fce [0,4194304] 0 2024-04-16T14:35:45.345 INFO:tasks.workunit.client.1.smithi115.stdout:7/695: mkdir d0/d24/da3/ded 0 2024-04-16T14:35:45.345 INFO:tasks.workunit.client.1.smithi115.stdout:7/696: write d0/d24/da3/db1/d3f/db0/f54 [2657318,14683] 0 2024-04-16T14:35:45.346 INFO:tasks.workunit.client.1.smithi115.stdout:2/907: read d0/d47/d65/dad/dbb/d11/d25/fda [478127,83623] 0 2024-04-16T14:35:45.346 INFO:tasks.workunit.client.1.smithi115.stdout:2/908: write d0/d47/d65/dad/dc8/d24/d23/f8d [2220421,3963] 0 2024-04-16T14:35:45.346 INFO:tasks.workunit.client.1.smithi115.stdout:2/909: chown d0/d47/d65/dad/dbb/lef 1161 1 2024-04-16T14:35:45.350 INFO:tasks.workunit.client.1.smithi115.stdout:9/879: getdents d1/d6/d2d/d4b/d8f/d91/dda/ddd 0 2024-04-16T14:35:45.351 INFO:tasks.workunit.client.1.smithi115.stdout:9/880: truncate d1/d6/d2d/d4b/d90/fd9 310870 0 2024-04-16T14:35:45.352 INFO:tasks.workunit.client.1.smithi115.stdout:6/805: write d13/d1d/d2b/f109 [3504808,27669] 0 2024-04-16T14:35:45.352 INFO:tasks.workunit.client.1.smithi115.stdout:0/602: creat d6/d10/d12/d1f/d36/d4b/d6d/d7a/fce x:0 0 0 2024-04-16T14:35:45.355 INFO:tasks.workunit.client.1.smithi115.stdout:7/697: stat d0/d2/d3a/d30/d79/d95/c9f 0 2024-04-16T14:35:45.356 INFO:tasks.workunit.client.1.smithi115.stdout:6/806: dread d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96/fb6 [0,4194304] 0 2024-04-16T14:35:45.356 INFO:tasks.workunit.client.1.smithi115.stdout:6/807: chown d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/d63/db0 476 1 2024-04-16T14:35:45.356 INFO:tasks.workunit.client.1.smithi115.stdout:2/910: symlink d0/d47/d65/dad/dc8/d57/l12d 0 2024-04-16T14:35:45.358 INFO:tasks.workunit.client.1.smithi115.stdout:0/603: creat d6/d10/d12/d31/d35/d44/dc9/fcf x:0 0 0 2024-04-16T14:35:45.360 INFO:tasks.workunit.client.1.smithi115.stdout:0/604: mknod d6/d10/d12/d31/cd0 0 2024-04-16T14:35:45.360 INFO:tasks.workunit.client.1.smithi115.stdout:0/605: fdatasync d6/d10/d12/d31/d35/f59 0 2024-04-16T14:35:45.360 INFO:tasks.workunit.client.1.smithi115.stdout:0/606: fsync d6/d54/d57/dbe/fad 0 2024-04-16T14:35:45.361 INFO:tasks.workunit.client.1.smithi115.stdout:6/808: dread d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/d63/f89 [4194304,4194304] 0 2024-04-16T14:35:45.363 INFO:tasks.workunit.client.1.smithi115.stdout:0/607: mkdir d6/d10/dd1 0 2024-04-16T14:35:45.365 INFO:tasks.workunit.client.1.smithi115.stdout:6/809: rmdir d13/d1d/d49/ded 39 2024-04-16T14:35:45.365 INFO:tasks.workunit.client.1.smithi115.stdout:7/698: dread d0/d2/d3a/f33 [0,4194304] 0 2024-04-16T14:35:45.365 INFO:tasks.workunit.client.1.smithi115.stdout:7/699: fsync d0/d2/d3a/d30/d6b/da2/fa8 0 2024-04-16T14:35:45.365 INFO:tasks.workunit.client.1.smithi115.stdout:7/700: write d0/d2/d3a/d30/d79/dd2/d64/fc6 [22011,66120] 0 2024-04-16T14:35:45.366 INFO:tasks.workunit.client.1.smithi115.stdout:0/608: mkdir d6/d10/d12/d31/d35/d44/dd2 0 2024-04-16T14:35:45.366 INFO:tasks.workunit.client.1.smithi115.stdout:6/810: dread fc [0,4194304] 0 2024-04-16T14:35:45.368 INFO:tasks.workunit.client.1.smithi115.stdout:0/609: rename d6/d10/d12/d31/ca6 to d6/d30/cd3 0 2024-04-16T14:35:45.370 INFO:tasks.workunit.client.1.smithi115.stdout:0/610: mkdir d6/d10/d12/dd4 0 2024-04-16T14:35:45.373 INFO:tasks.workunit.client.1.smithi115.stdout:7/701: dread d0/d2/d3a/d30/f98 [0,4194304] 0 2024-04-16T14:35:45.374 INFO:tasks.workunit.client.1.smithi115.stdout:7/702: dread - d0/d24/da3/db1/d3f/db0/fcd zero size 2024-04-16T14:35:45.382 INFO:tasks.workunit.client.1.smithi115.stdout:9/881: read d1/d6/d2d/d4b/d6c/d20/d36/dce/f130 [835038,35910] 0 2024-04-16T14:35:45.382 INFO:tasks.workunit.client.1.smithi115.stdout:9/882: creat d1/d6/d29/f135 x:0 0 0 2024-04-16T14:35:45.383 INFO:tasks.workunit.client.1.smithi115.stdout:9/883: dread - d1/d6/d2d/d4b/d8f/d91/dd1/dd2/ff8 zero size 2024-04-16T14:35:45.383 INFO:tasks.workunit.client.1.smithi115.stdout:9/884: rename d1/d6/d2d/d4b/d8f to d1/d6/d2d/d4b/d8f/d91/dda/ddd/de8/dfe/d136 22 2024-04-16T14:35:45.385 INFO:tasks.workunit.client.1.smithi115.stdout:9/885: dread d1/f92 [0,4194304] 0 2024-04-16T14:35:45.385 INFO:tasks.workunit.client.1.smithi115.stdout:2/911: read d0/d47/d65/dad/dc8/d24/d23/ffe [1436960,23360] 0 2024-04-16T14:35:45.387 INFO:tasks.workunit.client.1.smithi115.stdout:9/886: creat d1/d6/d2d/d4b/d6c/d20/f137 x:0 0 0 2024-04-16T14:35:45.387 INFO:tasks.workunit.client.1.smithi115.stdout:9/887: fsync d1/d6/d2d/d4b/d8f/f95 0 2024-04-16T14:35:45.414 INFO:tasks.workunit.client.0.smithi005.stdout:3/996: dwrite d2/d9/d25/d39/d64/fa9 [0,4194304] 0 2024-04-16T14:35:45.415 INFO:tasks.workunit.client.1.smithi115.stdout:9/888: dread d1/d6/d2d/d3d/d50/f5e [0,4194304] 0 2024-04-16T14:35:45.416 INFO:tasks.workunit.client.0.smithi005.stdout:3/997: rename d2/d9/d7d/f155 to d2/d6b/f163 0 2024-04-16T14:35:45.420 INFO:tasks.workunit.client.1.smithi115.stdout:8/822: dwrite d0/f62 [4194304,4194304] 0 2024-04-16T14:35:45.421 INFO:tasks.workunit.client.1.smithi115.stdout:8/823: readlink d0/db/l28 0 2024-04-16T14:35:45.425 INFO:tasks.workunit.client.1.smithi115.stdout:3/833: dwrite dc/d24/d33/fb5 [0,4194304] 0 2024-04-16T14:35:45.426 INFO:tasks.workunit.client.0.smithi005.stdout:2/751: dwrite d0/d2a/d3a/fc2 [0,4194304] 0 2024-04-16T14:35:45.426 INFO:tasks.workunit.client.0.smithi005.stdout:2/752: fdatasync d0/d29/d3e/fe6 0 2024-04-16T14:35:45.426 INFO:tasks.workunit.client.0.smithi005.stdout:2/753: creat d0/d29/d3e/dd2/ff5 x:0 0 0 2024-04-16T14:35:45.427 INFO:tasks.workunit.client.1.smithi115.stdout:1/823: dwrite df/d13/f30 [0,4194304] 0 2024-04-16T14:35:45.427 INFO:tasks.workunit.client.1.smithi115.stdout:1/824: chown df/d36/f9b 5733480 1 2024-04-16T14:35:45.427 INFO:tasks.workunit.client.1.smithi115.stdout:1/825: chown df/d35/f39 1 1 2024-04-16T14:35:45.429 INFO:tasks.workunit.client.0.smithi005.stdout:2/754: creat d0/d2a/d3a/d46/dd8/ff6 x:0 0 0 2024-04-16T14:35:45.430 INFO:tasks.workunit.client.0.smithi005.stdout:2/755: symlink d0/d2a/d3a/d46/lf7 0 2024-04-16T14:35:45.430 INFO:tasks.workunit.client.0.smithi005.stdout:9/694: dwrite d3/d49/f50 [0,4194304] 0 2024-04-16T14:35:45.430 INFO:tasks.workunit.client.1.smithi115.stdout:6/811: dwrite d13/d1d/d68/fa0 [0,4194304] 0 2024-04-16T14:35:45.430 INFO:tasks.workunit.client.1.smithi115.stdout:6/812: fdatasync d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96/f9f 0 2024-04-16T14:35:45.431 INFO:tasks.workunit.client.1.smithi115.stdout:5/769: dwrite dc/d15/f78 [0,4194304] 0 2024-04-16T14:35:45.431 INFO:tasks.workunit.client.1.smithi115.stdout:1/826: mknod df/d36/d94/dbf/d10c/c118 0 2024-04-16T14:35:45.431 INFO:tasks.workunit.client.1.smithi115.stdout:1/827: readlink df/d13/d72/l9a 0 2024-04-16T14:35:45.432 INFO:tasks.workunit.client.1.smithi115.stdout:7/703: dwrite d0/fa5 [0,4194304] 0 2024-04-16T14:35:45.432 INFO:tasks.workunit.client.1.smithi115.stdout:7/704: readlink d0/d24/da3/db1/l99 0 2024-04-16T14:35:45.433 INFO:tasks.workunit.client.0.smithi005.stdout:0/801: rmdir da/df/d1b/d3a/d53/d5a 39 2024-04-16T14:35:45.436 INFO:tasks.workunit.client.1.smithi115.stdout:6/813: creat d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96/d55/f10d x:0 0 0 2024-04-16T14:35:45.438 INFO:tasks.workunit.client.1.smithi115.stdout:0/611: dwrite d6/d1b/f21 [0,4194304] 0 2024-04-16T14:35:45.439 INFO:tasks.workunit.client.1.smithi115.stdout:2/912: dwrite d0/d1b/f41 [0,4194304] 0 2024-04-16T14:35:45.439 INFO:tasks.workunit.client.0.smithi005.stdout:9/695: symlink d3/d49/d4b/d5c/lc9 0 2024-04-16T14:35:45.440 INFO:tasks.workunit.client.1.smithi115.stdout:2/913: read d0/d47/fdf [42267,93686] 0 2024-04-16T14:35:45.441 INFO:tasks.workunit.client.0.smithi005.stdout:0/802: truncate da/df/d26/da9/d108/f90 273474 0 2024-04-16T14:35:45.441 INFO:tasks.workunit.client.0.smithi005.stdout:0/803: chown da/df/d1b/d3a/d53/d5a/d67/d79/cc3 18 1 2024-04-16T14:35:45.441 INFO:tasks.workunit.client.1.smithi115.stdout:8/824: dwrite d0/db/d10/d17/d22/fe3 [0,4194304] 0 2024-04-16T14:35:45.444 INFO:tasks.workunit.client.1.smithi115.stdout:7/705: dread d0/d2/f35 [0,4194304] 0 2024-04-16T14:35:45.445 INFO:tasks.workunit.client.1.smithi115.stdout:7/706: write d0/d24/da3/db1/d3f/db0/f5f [278962,39200] 0 2024-04-16T14:35:45.445 INFO:tasks.workunit.client.1.smithi115.stdout:9/889: dwrite d1/d6/d2d/d4b/d8f/f95 [0,4194304] 0 2024-04-16T14:35:45.445 INFO:tasks.workunit.client.0.smithi005.stdout:2/756: dwrite d0/d29/d3e/ff2 [0,4194304] 0 2024-04-16T14:35:45.450 INFO:tasks.workunit.client.0.smithi005.stdout:8/829: sync 2024-04-16T14:35:45.450 INFO:tasks.workunit.client.0.smithi005.stdout:8/830: creat d5/d7b/da8/db7/d74/f124 x:0 0 0 2024-04-16T14:35:45.452 INFO:tasks.workunit.client.0.smithi005.stdout:8/831: creat d5/d55/f125 x:0 0 0 2024-04-16T14:35:45.452 INFO:tasks.workunit.client.0.smithi005.stdout:8/832: write d5/d7b/da8/db7/d8a/da1/fd0 [3117105,35289] 0 2024-04-16T14:35:45.452 INFO:tasks.workunit.client.0.smithi005.stdout:8/833: write d5/d7b/da8/da5/fd4 [177660,19699] 0 2024-04-16T14:35:45.453 INFO:tasks.workunit.client.0.smithi005.stdout:2/757: write d0/d1c/d59/d7a/fda [640890,75229] 0 2024-04-16T14:35:45.454 INFO:tasks.workunit.client.0.smithi005.stdout:8/834: getdents d5/d7b/da8/db7/d8a/da1/d68/dcb/dd9 0 2024-04-16T14:35:45.456 INFO:tasks.workunit.client.1.smithi115.stdout:6/814: rename d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96/dbc/ffb to d13/d1d/d2b/f10e 0 2024-04-16T14:35:45.458 INFO:tasks.workunit.client.0.smithi005.stdout:2/758: mkdir d0/d1c/d59/d7a/d84/df8 0 2024-04-16T14:35:45.459 INFO:tasks.workunit.client.0.smithi005.stdout:2/759: symlink d0/d1c/d39/d48/lf9 0 2024-04-16T14:35:45.464 INFO:tasks.workunit.client.1.smithi115.stdout:0/612: truncate d6/d10/d12/d1f/d36/d4b/d6d/f3d 2677610 0 2024-04-16T14:35:45.466 INFO:tasks.workunit.client.1.smithi115.stdout:5/770: mkdir dc/d15/de6 0 2024-04-16T14:35:45.468 INFO:tasks.workunit.client.1.smithi115.stdout:2/914: mkdir d0/d47/d65/dad/dc8/d24/d21/d12e 0 2024-04-16T14:35:45.468 INFO:tasks.workunit.client.1.smithi115.stdout:2/915: chown d0/d47/d65/dad/dc8/d22/l43 1961885 1 2024-04-16T14:35:45.470 INFO:tasks.workunit.client.1.smithi115.stdout:1/828: getdents df/d36/dff 0 2024-04-16T14:35:45.475 INFO:tasks.workunit.client.1.smithi115.stdout:9/890: mknod d1/d6/d2d/d3d/d49/d88/c138 0 2024-04-16T14:35:45.476 INFO:tasks.workunit.client.1.smithi115.stdout:0/613: truncate d6/d10/d12/d31/d35/d9b/f5b 2082416 0 2024-04-16T14:35:45.478 INFO:tasks.workunit.client.1.smithi115.stdout:5/771: rename dc/d15/f18 to dc/d5d/d81/d9a/da3/fe7 0 2024-04-16T14:35:45.480 INFO:tasks.workunit.client.1.smithi115.stdout:2/916: mknod d0/d47/d65/dad/dc8/d24/d21/c12f 0 2024-04-16T14:35:45.480 INFO:tasks.workunit.client.1.smithi115.stdout:2/917: fdatasync d0/d47/d65/dad/dbb/d11/d36/d86/f11b 0 2024-04-16T14:35:45.480 INFO:tasks.workunit.client.1.smithi115.stdout:2/918: dread - d0/d47/d65/dad/dc8/d24/d23/d71/fd3 zero size 2024-04-16T14:35:45.480 INFO:tasks.workunit.client.1.smithi115.stdout:2/919: write d0/d47/d65/dad/dc8/d24/d23/f7c [477004,130963] 0 2024-04-16T14:35:45.480 INFO:tasks.workunit.client.1.smithi115.stdout:2/920: truncate d0/d47/d65/dad/dc8/d4a/fdb 717738 0 2024-04-16T14:35:45.481 INFO:tasks.workunit.client.1.smithi115.stdout:9/891: creat d1/d6/d2d/d3d/f139 x:0 0 0 2024-04-16T14:35:45.481 INFO:tasks.workunit.client.1.smithi115.stdout:9/892: dread - d1/d6/d29/ffa zero size 2024-04-16T14:35:45.483 INFO:tasks.workunit.client.1.smithi115.stdout:5/772: mknod dc/d15/d2d/d8c/ce8 0 2024-04-16T14:35:45.483 INFO:tasks.workunit.client.1.smithi115.stdout:5/773: dread - dc/d8e/fab zero size 2024-04-16T14:35:45.484 INFO:tasks.workunit.client.1.smithi115.stdout:2/921: rmdir d0/d47/d65/dad/dc8/d22 39 2024-04-16T14:35:45.484 INFO:tasks.workunit.client.1.smithi115.stdout:2/922: write d0/d47/d65/dad/dc8/d24/d23/f8d [2647919,112576] 0 2024-04-16T14:35:45.484 INFO:tasks.workunit.client.1.smithi115.stdout:1/829: dread df/d13/d4d/d2c/fb4 [0,4194304] 0 2024-04-16T14:35:45.486 INFO:tasks.workunit.client.1.smithi115.stdout:5/774: creat dc/d15/de6/fe9 x:0 0 0 2024-04-16T14:35:45.487 INFO:tasks.workunit.client.1.smithi115.stdout:5/775: creat dc/d15/fea x:0 0 0 2024-04-16T14:35:45.487 INFO:tasks.workunit.client.1.smithi115.stdout:5/776: read - dc/d3d/f96 zero size 2024-04-16T14:35:45.503 INFO:tasks.workunit.client.1.smithi115.stdout:8/825: dwrite d0/db/d10/d17/d2c/d52/f99 [0,4194304] 0 2024-04-16T14:35:45.503 INFO:tasks.workunit.client.0.smithi005.stdout:9/696: dwrite d3/d12/d16/f4d [0,4194304] 0 2024-04-16T14:35:45.507 INFO:tasks.workunit.client.0.smithi005.stdout:9/697: unlink d3/d12/d2b/d8e/cad 0 2024-04-16T14:35:45.508 INFO:tasks.workunit.client.1.smithi115.stdout:8/826: creat d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/da4/f10f x:0 0 0 2024-04-16T14:35:45.509 INFO:tasks.workunit.client.0.smithi005.stdout:9/698: truncate d3/d49/f50 423195 0 2024-04-16T14:35:45.509 INFO:tasks.workunit.client.0.smithi005.stdout:9/699: dread - d3/d49/d4b/d5c/d65/f8d zero size 2024-04-16T14:35:45.510 INFO:tasks.workunit.client.0.smithi005.stdout:0/804: dwrite da/df/d1b/d3a/ffe [0,4194304] 0 2024-04-16T14:35:45.510 INFO:tasks.workunit.client.1.smithi115.stdout:7/707: dwrite d0/d24/da3/db1/d49/f91 [0,4194304] 0 2024-04-16T14:35:45.511 INFO:tasks.workunit.client.0.smithi005.stdout:2/760: dwrite d0/d2a/d3a/f76 [0,4194304] 0 2024-04-16T14:35:45.511 INFO:tasks.workunit.client.1.smithi115.stdout:7/708: symlink d0/d2/d3a/dac/da7/lee 0 2024-04-16T14:35:45.512 INFO:tasks.workunit.client.1.smithi115.stdout:8/827: rename d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/d8a/d8e to d0/db/d10/d17/d2c/d52/d74/d3b/d56/dfc/d110 0 2024-04-16T14:35:45.517 INFO:tasks.workunit.client.1.smithi115.stdout:7/709: dread d0/d2/d3a/d30/d6b/f84 [0,4194304] 0 2024-04-16T14:35:45.518 INFO:tasks.workunit.client.0.smithi005.stdout:0/805: rename da/df/d26/da9/d108/ff5 to da/df/f110 0 2024-04-16T14:35:45.519 INFO:tasks.workunit.client.1.smithi115.stdout:7/710: mknod d0/d2/d3a/d30/d6b/da2/d81/dd0/cef 0 2024-04-16T14:35:45.520 INFO:tasks.workunit.client.1.smithi115.stdout:0/614: dwrite d6/d10/d12/d31/d35/d44/dc9/fcf [0,4194304] 0 2024-04-16T14:35:45.520 INFO:tasks.workunit.client.1.smithi115.stdout:6/815: dwrite d13/d1d/d68/fa2 [0,4194304] 0 2024-04-16T14:35:45.520 INFO:tasks.workunit.client.1.smithi115.stdout:6/816: creat d13/d1d/d2b/df4/f10f x:0 0 0 2024-04-16T14:35:45.521 INFO:tasks.workunit.client.1.smithi115.stdout:9/893: dwrite d1/d6/d33/f85 [4194304,4194304] 0 2024-04-16T14:35:45.521 INFO:tasks.workunit.client.1.smithi115.stdout:8/828: rename d0/db/d10/d17/d2c/d52/d6c/db8/d64 to d0/db/d10/d17/d2c/d52/d6c/db8/d7d/de2/d111 0 2024-04-16T14:35:45.521 INFO:tasks.workunit.client.1.smithi115.stdout:1/830: dread df/d35/d84/ddc/de0/df2/fdf [4194304,4194304] 0 2024-04-16T14:35:45.521 INFO:tasks.workunit.client.1.smithi115.stdout:2/923: dwrite d0/d47/d65/dad/dc8/d24/d23/d80/fa6 [0,4194304] 0 2024-04-16T14:35:45.521 INFO:tasks.workunit.client.1.smithi115.stdout:2/924: write d0/d47/d65/d61/d70/f91 [994196,88105] 0 2024-04-16T14:35:45.522 INFO:tasks.workunit.client.0.smithi005.stdout:0/806: mknod da/df/d1b/d3a/d53/d5a/d67/dda/c111 0 2024-04-16T14:35:45.522 INFO:tasks.workunit.client.1.smithi115.stdout:7/711: dread d0/d2/d3a/d30/d79/dd2/d9c/faa [0,4194304] 0 2024-04-16T14:35:45.522 INFO:tasks.workunit.client.1.smithi115.stdout:7/712: truncate d0/d2/d3a/dac/da7/fe5 607676 0 2024-04-16T14:35:45.523 INFO:tasks.workunit.client.1.smithi115.stdout:0/615: unlink d6/l9 0 2024-04-16T14:35:45.523 INFO:tasks.workunit.client.1.smithi115.stdout:0/616: write d6/d1b/f21 [4412506,56852] 0 2024-04-16T14:35:45.523 INFO:tasks.workunit.client.1.smithi115.stdout:0/617: chown d6/d54/d57/c5d 2552 1 2024-04-16T14:35:45.523 INFO:tasks.workunit.client.1.smithi115.stdout:5/777: dwrite dc/d15/d2d/fe1 [0,4194304] 0 2024-04-16T14:35:45.523 INFO:tasks.workunit.client.1.smithi115.stdout:5/778: readlink dc/d15/d2d/d8c/ldd 0 2024-04-16T14:35:45.526 INFO:tasks.workunit.client.0.smithi005.stdout:0/807: rename da/df/dd0 to da/df/d26/d112 0 2024-04-16T14:35:45.527 INFO:tasks.workunit.client.1.smithi115.stdout:9/894: mkdir d1/d6/d2d/d3d/d13a 0 2024-04-16T14:35:45.529 INFO:tasks.workunit.client.1.smithi115.stdout:1/831: rename df/d13/f30 to df/d13/dc3/f119 0 2024-04-16T14:35:45.529 INFO:tasks.workunit.client.1.smithi115.stdout:1/832: readlink df/d13/d4d/d3e/d75/da9/lbb 0 2024-04-16T14:35:45.529 INFO:tasks.workunit.client.0.smithi005.stdout:0/808: symlink da/df/d1b/d3a/d53/d5a/d99/l113 0 2024-04-16T14:35:45.529 INFO:tasks.workunit.client.0.smithi005.stdout:0/809: stat da/df/d1b/f89 0 2024-04-16T14:35:45.530 INFO:tasks.workunit.client.0.smithi005.stdout:0/810: mknod da/df/d1b/d3a/c114 0 2024-04-16T14:35:45.535 INFO:tasks.workunit.client.1.smithi115.stdout:8/829: dread d0/db/f30 [0,4194304] 0 2024-04-16T14:35:45.535 INFO:tasks.workunit.client.1.smithi115.stdout:8/830: fdatasync d0/db/d10/d17/d2c/d52/d74/f45 0 2024-04-16T14:35:45.536 INFO:tasks.workunit.client.0.smithi005.stdout:9/700: dwrite d3/d12/d2b/f44 [0,4194304] 0 2024-04-16T14:35:45.539 INFO:tasks.workunit.client.1.smithi115.stdout:8/831: creat d0/db/d10/d17/d2c/d52/d6c/db8/d7d/de2/f112 x:0 0 0 2024-04-16T14:35:45.539 INFO:tasks.workunit.client.1.smithi115.stdout:8/832: write d0/db/d10/d17/d2c/d52/d6c/db8/d7d/de2/d111/d83/fff [841585,26834] 0 2024-04-16T14:35:45.540 INFO:tasks.workunit.client.0.smithi005.stdout:9/701: mknod d3/d12/d2b/d8e/cca 0 2024-04-16T14:35:45.541 INFO:tasks.workunit.client.0.smithi005.stdout:9/702: getdents d3/d49/dc8 0 2024-04-16T14:35:45.544 INFO:tasks.workunit.client.1.smithi115.stdout:8/833: symlink d0/db/d10/d17/d22/deb/d7c/l113 0 2024-04-16T14:35:45.545 INFO:tasks.workunit.client.1.smithi115.stdout:7/713: write d0/d24/d40/f6a [2274583,13179] 0 2024-04-16T14:35:45.546 INFO:tasks.workunit.client.0.smithi005.stdout:2/761: dwrite d0/d29/fc3 [0,4194304] 0 2024-04-16T14:35:45.546 INFO:tasks.workunit.client.0.smithi005.stdout:2/762: chown d0/d1c/d39/d48/f81 242 1 2024-04-16T14:35:45.548 INFO:tasks.workunit.client.0.smithi005.stdout:2/763: symlink d0/d29/d89/d99/lfa 0 2024-04-16T14:35:45.552 INFO:tasks.workunit.client.1.smithi115.stdout:5/779: creat dc/d15/d4d/daa/feb x:0 0 0 2024-04-16T14:35:45.554 INFO:tasks.workunit.client.1.smithi115.stdout:1/833: creat df/d13/d4d/d68/de7/d55/f11a x:0 0 0 2024-04-16T14:35:45.555 INFO:tasks.workunit.client.1.smithi115.stdout:2/925: rmdir d0/d47/d65/dad/dbb/d11/d25/d95 39 2024-04-16T14:35:45.555 INFO:tasks.workunit.client.0.smithi005.stdout:9/703: dread d3/d12/d16/d46/d47/d60/f6a [0,4194304] 0 2024-04-16T14:35:45.556 INFO:tasks.workunit.client.0.smithi005.stdout:9/704: symlink d3/d12/d16/lcb 0 2024-04-16T14:35:45.556 INFO:tasks.workunit.client.1.smithi115.stdout:0/618: getdents d6/d30/d8d 0 2024-04-16T14:35:45.557 INFO:tasks.workunit.client.0.smithi005.stdout:9/705: link d3/d12/d16/c3d d3/d49/d4b/d55/ccc 0 2024-04-16T14:35:45.557 INFO:tasks.workunit.client.0.smithi005.stdout:9/706: chown d3/d49/d4b/d55/f96 41041109 1 2024-04-16T14:35:45.557 INFO:tasks.workunit.client.0.smithi005.stdout:9/707: truncate d3/d77/f8f 3073036 0 2024-04-16T14:35:45.559 INFO:tasks.workunit.client.0.smithi005.stdout:9/708: rename d3/d12/d2b/fb5 to d3/d49/d4b/d5c/d65/d9a/fcd 0 2024-04-16T14:35:45.561 INFO:tasks.workunit.client.1.smithi115.stdout:9/895: dwrite d1/fd4 [0,4194304] 0 2024-04-16T14:35:45.561 INFO:tasks.workunit.client.1.smithi115.stdout:8/834: mkdir d0/db/d10/d17/d2c/d114 0 2024-04-16T14:35:45.561 INFO:tasks.workunit.client.1.smithi115.stdout:8/835: write d0/db/d10/d17/d2c/d52/d84/fb4 [467528,47777] 0 2024-04-16T14:35:45.561 INFO:tasks.workunit.client.1.smithi115.stdout:8/836: readlink d0/db/d10/d17/d22/deb/l49 0 2024-04-16T14:35:45.561 INFO:tasks.workunit.client.0.smithi005.stdout:9/709: rmdir d3/d12/d16/d46/d47 39 2024-04-16T14:35:45.562 INFO:tasks.workunit.client.1.smithi115.stdout:5/780: unlink dc/f2c 0 2024-04-16T14:35:45.562 INFO:tasks.workunit.client.1.smithi115.stdout:2/926: mknod d0/d47/d65/dad/dc8/d24/d23/d83/c130 0 2024-04-16T14:35:45.562 INFO:tasks.workunit.client.1.smithi115.stdout:2/927: dread - d0/d47/fe0 zero size 2024-04-16T14:35:45.563 INFO:tasks.workunit.client.1.smithi115.stdout:2/928: chown d0/d47/d65/dad/dc8/d22/fce 3 1 2024-04-16T14:35:45.563 INFO:tasks.workunit.client.1.smithi115.stdout:8/837: rmdir d0/db/dbb/dcd/dae/dde 39 2024-04-16T14:35:45.563 INFO:tasks.workunit.client.1.smithi115.stdout:1/834: dread df/d35/f8a [0,4194304] 0 2024-04-16T14:35:45.563 INFO:tasks.workunit.client.1.smithi115.stdout:1/835: dread - df/d2d/ff0 zero size 2024-04-16T14:35:45.563 INFO:tasks.workunit.client.1.smithi115.stdout:0/619: creat d6/d1b/d4e/db9/dca/fd5 x:0 0 0 2024-04-16T14:35:45.563 INFO:tasks.workunit.client.0.smithi005.stdout:0/811: dwrite da/df/d1b/d3a/d53/d5a/d99/fc5 [4194304,4194304] 0 2024-04-16T14:35:45.565 INFO:tasks.workunit.client.1.smithi115.stdout:9/896: mkdir d1/d6/d2d/d3d/db7/d13b 0 2024-04-16T14:35:45.566 INFO:tasks.workunit.client.1.smithi115.stdout:5/781: mknod dc/d15/d4d/cec 0 2024-04-16T14:35:45.567 INFO:tasks.workunit.client.0.smithi005.stdout:0/812: link da/df/d1b/d3a/d53/d5a/d67/d79/cc3 da/df/d26/d39/d55/d5c/da8/c115 0 2024-04-16T14:35:45.568 INFO:tasks.workunit.client.0.smithi005.stdout:2/764: dwrite d0/d1c/d39/d48/f81 [0,4194304] 0 2024-04-16T14:35:45.569 INFO:tasks.workunit.client.1.smithi115.stdout:2/929: link d0/d47/d65/dad/dc8/d24/d23/d83/c130 d0/d47/d65/dad/dc8/d24/d23/d83/de7/c131 0 2024-04-16T14:35:45.574 INFO:tasks.workunit.client.1.smithi115.stdout:0/620: symlink d6/d10/d12/d1f/ld6 0 2024-04-16T14:35:45.574 INFO:tasks.workunit.client.1.smithi115.stdout:0/621: readlink d6/d10/d71/db7/lc3 0 2024-04-16T14:35:45.574 INFO:tasks.workunit.client.1.smithi115.stdout:0/622: readlink d6/d10/d12/d1f/d36/d4b/d6d/d7a/l96 0 2024-04-16T14:35:45.574 INFO:tasks.workunit.client.1.smithi115.stdout:9/897: rmdir d1/d6/d2d/d4b/d8f/d91/dd1 39 2024-04-16T14:35:45.574 INFO:tasks.workunit.client.1.smithi115.stdout:9/898: chown d1/d6/d2d/d4b/d60/d65/fc1 16266 1 2024-04-16T14:35:45.575 INFO:tasks.workunit.client.1.smithi115.stdout:1/836: read df/d13/d4d/d3e/d75/f8c [3819861,58120] 0 2024-04-16T14:35:45.575 INFO:tasks.workunit.client.1.smithi115.stdout:1/837: read df/d13/d4d/d3e/d75/dda/f85 [270337,14247] 0 2024-04-16T14:35:45.575 INFO:tasks.workunit.client.0.smithi005.stdout:2/765: rename d0/d29/d89/d99/lfa to d0/d1c/d39/lfb 0 2024-04-16T14:35:45.577 INFO:tasks.workunit.client.1.smithi115.stdout:5/782: truncate dc/d15/d35/f3f 617512 0 2024-04-16T14:35:45.577 INFO:tasks.workunit.client.1.smithi115.stdout:5/783: truncate dc/f1f 1214788 0 2024-04-16T14:35:45.577 INFO:tasks.workunit.client.1.smithi115.stdout:5/784: write dc/d3d/d68/d7b/f89 [1690702,14627] 0 2024-04-16T14:35:45.577 INFO:tasks.workunit.client.1.smithi115.stdout:3/834: sync 2024-04-16T14:35:45.577 INFO:tasks.workunit.client.1.smithi115.stdout:4/753: sync 2024-04-16T14:35:45.577 INFO:tasks.workunit.client.1.smithi115.stdout:4/754: stat d1/d15/d17/fa9 0 2024-04-16T14:35:45.577 INFO:tasks.workunit.client.1.smithi115.stdout:8/838: link d0/db/d10/d17/d22/deb/d7c/dc0/f10c d0/db/d10/d17/d2c/f115 0 2024-04-16T14:35:45.577 INFO:tasks.workunit.client.1.smithi115.stdout:8/839: fsync d0/db/d10/d17/d2c/d52/d6c/db8/d7d/de2/d111/d89/fd7 0 2024-04-16T14:35:45.578 INFO:tasks.workunit.client.1.smithi115.stdout:8/840: stat d0/db/dbb/dcd/dc4/df2 0 2024-04-16T14:35:45.579 INFO:tasks.workunit.client.0.smithi005.stdout:0/813: write da/f93 [3449856,127892] 0 2024-04-16T14:35:45.579 INFO:tasks.workunit.client.0.smithi005.stdout:0/814: stat da/df/d26/d39/d55/d5c 0 2024-04-16T14:35:45.579 INFO:tasks.workunit.client.1.smithi115.stdout:3/835: unlink dc/d24/d80/lc0 0 2024-04-16T14:35:45.580 INFO:tasks.workunit.client.1.smithi115.stdout:2/930: rename d0/d47/d65/dad/dbb/d11/d36/d86/l12b to d0/l132 0 2024-04-16T14:35:45.580 INFO:tasks.workunit.client.1.smithi115.stdout:2/931: dread - d0/d47/d65/dad/fb8 zero size 2024-04-16T14:35:45.580 INFO:tasks.workunit.client.1.smithi115.stdout:8/841: symlink d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/d8a/l116 0 2024-04-16T14:35:45.580 INFO:tasks.workunit.client.1.smithi115.stdout:8/842: truncate d0/db/d10/d17/d2c/d52/d84/f90 469674 0 2024-04-16T14:35:45.581 INFO:tasks.workunit.client.1.smithi115.stdout:0/623: rmdir d6/d10/d12/d1f/d36/d4b/d6d/dcb 0 2024-04-16T14:35:45.583 INFO:tasks.workunit.client.0.smithi005.stdout:0/815: symlink da/df/d1b/d3a/d53/d5a/d67/d79/l116 0 2024-04-16T14:35:45.584 INFO:tasks.workunit.client.0.smithi005.stdout:0/816: mknod da/df/d26/da9/d108/c117 0 2024-04-16T14:35:45.584 INFO:tasks.workunit.client.0.smithi005.stdout:0/817: write da/df/d26/da9/d108/d75/d81/fd4 [1007473,126488] 0 2024-04-16T14:35:45.584 INFO:tasks.workunit.client.0.smithi005.stdout:0/818: write da/df/d50/f6d [1297723,63073] 0 2024-04-16T14:35:45.585 INFO:tasks.workunit.client.1.smithi115.stdout:3/836: mkdir dc/d29/d4d/d56/d7e/d11b 0 2024-04-16T14:35:45.585 INFO:tasks.workunit.client.1.smithi115.stdout:9/899: getdents d1/d6/d2d/d4b/d8f 0 2024-04-16T14:35:45.585 INFO:tasks.workunit.client.1.smithi115.stdout:5/785: read dc/d5d/d8f/faf [3889060,123864] 0 2024-04-16T14:35:45.587 INFO:tasks.workunit.client.1.smithi115.stdout:4/755: mknod d1/d15/d31/dc2/cea 0 2024-04-16T14:35:45.587 INFO:tasks.workunit.client.1.smithi115.stdout:4/756: creat d1/d15/d9c/feb x:0 0 0 2024-04-16T14:35:45.589 INFO:tasks.workunit.client.1.smithi115.stdout:1/838: rename df/d36/d94/dbf to df/d13/d4d/d3e/d75/d11b 0 2024-04-16T14:35:45.590 INFO:tasks.workunit.client.0.smithi005.stdout:9/710: dwrite d3/f3c [0,4194304] 0 2024-04-16T14:35:45.591 INFO:tasks.workunit.client.1.smithi115.stdout:2/932: symlink d0/d47/d65/dad/dc8/d57/l133 0 2024-04-16T14:35:45.593 INFO:tasks.workunit.client.1.smithi115.stdout:0/624: creat d6/fd7 x:0 0 0 2024-04-16T14:35:45.593 INFO:tasks.workunit.client.1.smithi115.stdout:3/837: rename dc/l28 to dc/d29/l11c 0 2024-04-16T14:35:45.595 INFO:tasks.workunit.client.1.smithi115.stdout:9/900: creat d1/d6/d2d/d4b/d8f/f13c x:0 0 0 2024-04-16T14:35:45.595 INFO:tasks.workunit.client.1.smithi115.stdout:0/625: dread d6/fb [8388608,4194304] 0 2024-04-16T14:35:45.597 INFO:tasks.workunit.client.0.smithi005.stdout:9/711: rename d3/d12/d16/f39 to d3/d12/d16/d46/fce 0 2024-04-16T14:35:45.597 INFO:tasks.workunit.client.0.smithi005.stdout:9/712: dread - d3/d12/d16/fc7 zero size 2024-04-16T14:35:45.598 INFO:tasks.workunit.client.0.smithi005.stdout:9/713: symlink d3/d49/d4b/d5c/lcf 0 2024-04-16T14:35:45.599 INFO:tasks.workunit.client.1.smithi115.stdout:4/757: symlink d1/d15/d31/d42/d8b/dcc/lec 0 2024-04-16T14:35:45.599 INFO:tasks.workunit.client.1.smithi115.stdout:4/758: chown d1/d15/l79 186024 1 2024-04-16T14:35:45.600 INFO:tasks.workunit.client.1.smithi115.stdout:5/786: write dc/f21 [3611786,26274] 0 2024-04-16T14:35:45.600 INFO:tasks.workunit.client.1.smithi115.stdout:8/843: dwrite d0/ffb [0,4194304] 0 2024-04-16T14:35:45.600 INFO:tasks.workunit.client.1.smithi115.stdout:1/839: dread df/d13/d72/fa2 [0,4194304] 0 2024-04-16T14:35:45.600 INFO:tasks.workunit.client.1.smithi115.stdout:3/838: link dc/f1c dc/f11d 0 2024-04-16T14:35:45.601 INFO:tasks.workunit.client.1.smithi115.stdout:9/901: unlink d1/d6/d29/ffa 0 2024-04-16T14:35:45.603 INFO:tasks.workunit.client.1.smithi115.stdout:3/839: mknod dc/d29/d39/d86/c11e 0 2024-04-16T14:35:45.604 INFO:tasks.workunit.client.1.smithi115.stdout:4/759: mknod d1/d2/dde/ced 0 2024-04-16T14:35:45.605 INFO:tasks.workunit.client.1.smithi115.stdout:1/840: symlink df/d35/l11c 0 2024-04-16T14:35:45.605 INFO:tasks.workunit.client.1.smithi115.stdout:1/841: write df/d13/d4d/d3e/d75/dda/fce [1010636,41128] 0 2024-04-16T14:35:45.606 INFO:tasks.workunit.client.0.smithi005.stdout:0/819: dwrite da/df/d1b/d3a/d53/d5a/d67/d79/f82 [0,4194304] 0 2024-04-16T14:35:45.606 INFO:tasks.workunit.client.1.smithi115.stdout:9/902: creat d1/d6/d2d/d4b/d60/df0/f13d x:0 0 0 2024-04-16T14:35:45.608 INFO:tasks.workunit.client.1.smithi115.stdout:4/760: dread d1/d15/f4d [0,4194304] 0 2024-04-16T14:35:45.610 INFO:tasks.workunit.client.1.smithi115.stdout:0/626: getdents d6/d10/d12/d1f/d36/d4b/d6d/d7a 0 2024-04-16T14:35:45.613 INFO:tasks.workunit.client.1.smithi115.stdout:1/842: link df/f9c df/d13/d4d/d68/de7/dbe/f11d 0 2024-04-16T14:35:45.614 INFO:tasks.workunit.client.0.smithi005.stdout:9/714: write d3/d12/d2b/f59 [1662298,47258] 0 2024-04-16T14:35:45.617 INFO:tasks.workunit.client.1.smithi115.stdout:9/903: mkdir d1/d6/d2d/d3d/d13a/d13e 0 2024-04-16T14:35:45.617 INFO:tasks.workunit.client.1.smithi115.stdout:9/904: chown d1/d6/d2d/d4b/d90/cb2 403736129 1 2024-04-16T14:35:45.618 INFO:tasks.workunit.client.1.smithi115.stdout:5/787: dread dc/d15/f27 [4194304,4194304] 0 2024-04-16T14:35:45.621 INFO:tasks.workunit.client.1.smithi115.stdout:0/627: symlink d6/d10/d71/db7/ld8 0 2024-04-16T14:35:45.621 INFO:tasks.workunit.client.1.smithi115.stdout:3/840: dread dc/d24/d33/d4b/d81/f95 [0,4194304] 0 2024-04-16T14:35:45.622 INFO:tasks.workunit.client.1.smithi115.stdout:9/905: link d1/d6/d2d/d4b/d60/d65/fee d1/d6/d2d/d4b/d60/df0/f13f 0 2024-04-16T14:35:45.623 INFO:tasks.workunit.client.0.smithi005.stdout:0/820: dread da/df/d1b/d3a/d53/d5a/d99/fd9 [0,4194304] 0 2024-04-16T14:35:45.625 INFO:tasks.workunit.client.0.smithi005.stdout:0/821: symlink da/df/d1b/d3a/d53/l118 0 2024-04-16T14:35:45.625 INFO:tasks.workunit.client.0.smithi005.stdout:0/822: write da/fe [1261041,53797] 0 2024-04-16T14:35:45.627 INFO:tasks.workunit.client.0.smithi005.stdout:0/823: mknod da/df/d1b/d3a/d53/d10b/c119 0 2024-04-16T14:35:45.627 INFO:tasks.workunit.client.0.smithi005.stdout:0/824: stat da/df/d1b/d3a/d53/d5a/d99/fc6 0 2024-04-16T14:35:45.627 INFO:tasks.workunit.client.1.smithi115.stdout:5/788: getdents dc/d15/d35 0 2024-04-16T14:35:45.629 INFO:tasks.workunit.client.1.smithi115.stdout:5/789: mknod dc/d5d/d81/ced 0 2024-04-16T14:35:45.629 INFO:tasks.workunit.client.0.smithi005.stdout:0/825: creat da/df/d26/f11a x:0 0 0 2024-04-16T14:35:45.631 INFO:tasks.workunit.client.1.smithi115.stdout:8/844: dwrite d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/d8a/fa0 [0,4194304] 0 2024-04-16T14:35:45.631 INFO:tasks.workunit.client.1.smithi115.stdout:8/845: stat d0/db/d10/d17/d2c/d52/d6c 0 2024-04-16T14:35:45.632 INFO:tasks.workunit.client.0.smithi005.stdout:9/715: write d3/d12/d2b/f4e [3865386,53636] 0 2024-04-16T14:35:45.633 INFO:tasks.workunit.client.1.smithi115.stdout:5/790: unlink dc/d3d/f7e 0 2024-04-16T14:35:45.633 INFO:tasks.workunit.client.1.smithi115.stdout:5/791: chown dc/d3d/d68/d7b/l94 0 1 2024-04-16T14:35:45.634 INFO:tasks.workunit.client.0.smithi005.stdout:0/826: dread da/df/d1b/d3a/d53/f61 [0,4194304] 0 2024-04-16T14:35:45.636 INFO:tasks.workunit.client.0.smithi005.stdout:9/716: mkdir d3/d49/d4b/d5c/dd0 0 2024-04-16T14:35:45.636 INFO:tasks.workunit.client.0.smithi005.stdout:9/717: stat d3/d12/d9d/cc5 0 2024-04-16T14:35:45.637 INFO:tasks.workunit.client.0.smithi005.stdout:0/827: mkdir da/df/d26/d39/d55/df8/d11b 0 2024-04-16T14:35:45.638 INFO:tasks.workunit.client.0.smithi005.stdout:9/718: creat d3/d12/d2b/fd1 x:0 0 0 2024-04-16T14:35:45.641 INFO:tasks.workunit.client.0.smithi005.stdout:0/828: rename da/df/d1b/d3a/d53/d5a/d67/c6c to da/df/d1b/c11c 0 2024-04-16T14:35:45.641 INFO:tasks.workunit.client.0.smithi005.stdout:0/829: creat da/df/d50/f11d x:0 0 0 2024-04-16T14:35:45.642 INFO:tasks.workunit.client.0.smithi005.stdout:9/719: mknod d3/d49/d4b/d55/d7b/cd2 0 2024-04-16T14:35:45.642 INFO:tasks.workunit.client.0.smithi005.stdout:9/720: chown d3/d12/d16/d46/d47/f92 197248 1 2024-04-16T14:35:45.642 INFO:tasks.workunit.client.0.smithi005.stdout:9/721: truncate d3/d12/d2b/f4e 5122508 0 2024-04-16T14:35:45.645 INFO:tasks.workunit.client.0.smithi005.stdout:0/830: getdents da/df/d1b/db6 0 2024-04-16T14:35:45.645 INFO:tasks.workunit.client.0.smithi005.stdout:0/831: chown da/df/d1b/f7a 98583 1 2024-04-16T14:35:45.646 INFO:tasks.workunit.client.1.smithi115.stdout:3/841: dread dc/d24/d33/d4b/f4c [0,4194304] 0 2024-04-16T14:35:45.646 INFO:tasks.workunit.client.1.smithi115.stdout:3/842: creat dc/d24/d33/d4b/d81/f11f x:0 0 0 2024-04-16T14:35:45.648 INFO:tasks.workunit.client.0.smithi005.stdout:9/722: rename d3/d12/l90 to d3/d12/d16/d86/ld3 0 2024-04-16T14:35:45.650 INFO:tasks.workunit.client.0.smithi005.stdout:9/723: symlink d3/d49/d4b/d55/ld4 0 2024-04-16T14:35:45.651 INFO:tasks.workunit.client.0.smithi005.stdout:9/724: chown d3/c22 153 1 2024-04-16T14:35:45.651 INFO:tasks.workunit.client.0.smithi005.stdout:9/725: write d3/d12/d2b/fd1 [297917,106427] 0 2024-04-16T14:35:45.651 INFO:tasks.workunit.client.1.smithi115.stdout:5/792: dread dc/d5d/d8f/faf [0,4194304] 0 2024-04-16T14:35:45.651 INFO:tasks.workunit.client.1.smithi115.stdout:5/793: write dc/f2b [1919665,28527] 0 2024-04-16T14:35:45.651 INFO:tasks.workunit.client.1.smithi115.stdout:5/794: readlink dc/d15/d35/d71/l80 0 2024-04-16T14:35:45.652 INFO:tasks.workunit.client.1.smithi115.stdout:5/795: fsync dc/d3d/d41/fd6 0 2024-04-16T14:35:45.652 INFO:tasks.workunit.client.1.smithi115.stdout:4/761: dwrite d1/d15/d31/d55/f7f [0,4194304] 0 2024-04-16T14:35:45.652 INFO:tasks.workunit.client.0.smithi005.stdout:9/726: mkdir d3/dd5 0 2024-04-16T14:35:45.653 INFO:tasks.workunit.client.0.smithi005.stdout:9/727: write d3/d12/d16/d46/fa7 [1416064,21325] 0 2024-04-16T14:35:45.653 INFO:tasks.workunit.client.0.smithi005.stdout:9/728: read d3/fa2 [443974,115524] 0 2024-04-16T14:35:45.653 INFO:tasks.workunit.client.0.smithi005.stdout:9/729: mkdir d3/d12/d16/d86/dd6 0 2024-04-16T14:35:45.655 INFO:tasks.workunit.client.1.smithi115.stdout:1/843: dwrite df/f7f [0,4194304] 0 2024-04-16T14:35:45.655 INFO:tasks.workunit.client.1.smithi115.stdout:9/906: dwrite d1/d6/d2d/d4b/d90/fd9 [0,4194304] 0 2024-04-16T14:35:45.655 INFO:tasks.workunit.client.1.smithi115.stdout:9/907: write d1/d6/d2d/d4b/d60/d65/f109 [591859,130565] 0 2024-04-16T14:35:45.655 INFO:tasks.workunit.client.1.smithi115.stdout:1/844: dread df/d13/d4d/d2c/f21 [0,4194304] 0 2024-04-16T14:35:45.655 INFO:tasks.workunit.client.1.smithi115.stdout:1/845: getdents df/d36/dff 0 2024-04-16T14:35:45.656 INFO:tasks.workunit.client.0.smithi005.stdout:9/730: rmdir d3/d49/dc8 0 2024-04-16T14:35:45.656 INFO:tasks.workunit.client.0.smithi005.stdout:9/731: stat d3/d49/d4b/d55/lb3 0 2024-04-16T14:35:45.657 INFO:tasks.workunit.client.1.smithi115.stdout:5/796: fdatasync dc/f2b 0 2024-04-16T14:35:45.658 INFO:tasks.workunit.client.1.smithi115.stdout:0/628: dwrite d6/d10/d12/d1f/d36/d4b/d6d/f8e [0,4194304] 0 2024-04-16T14:35:45.659 INFO:tasks.workunit.client.1.smithi115.stdout:1/846: mknod df/d13/d4d/d3e/c11e 0 2024-04-16T14:35:45.659 INFO:tasks.workunit.client.1.smithi115.stdout:8/846: dwrite d0/db/d10/d17/d2c/f115 [0,4194304] 0 2024-04-16T14:35:45.659 INFO:tasks.workunit.client.1.smithi115.stdout:8/847: creat d0/db/dbb/dcd/dae/f117 x:0 0 0 2024-04-16T14:35:45.660 INFO:tasks.workunit.client.1.smithi115.stdout:5/797: write dc/d79/f99 [702832,48102] 0 2024-04-16T14:35:45.663 INFO:tasks.workunit.client.1.smithi115.stdout:0/629: symlink d6/d1b/d4e/ld9 0 2024-04-16T14:35:45.665 INFO:tasks.workunit.client.1.smithi115.stdout:4/762: dread d1/d15/f77 [0,4194304] 0 2024-04-16T14:35:45.665 INFO:tasks.workunit.client.1.smithi115.stdout:1/847: symlink df/d13/d4d/d3e/d75/l11f 0 2024-04-16T14:35:45.667 INFO:tasks.workunit.client.1.smithi115.stdout:5/798: symlink dc/d5d/dc2/lee 0 2024-04-16T14:35:45.670 INFO:tasks.workunit.client.1.smithi115.stdout:0/630: rename d6/d10/d12/d1f/d36/d4b/d6d/l2b to d6/d1b/d4e/db9/dca/lda 0 2024-04-16T14:35:45.672 INFO:tasks.workunit.client.1.smithi115.stdout:5/799: symlink dc/d5d/lef 0 2024-04-16T14:35:45.673 INFO:tasks.workunit.client.1.smithi115.stdout:4/763: getdents d1/d15/d31/d42/da4/dc0 0 2024-04-16T14:35:45.673 INFO:tasks.workunit.client.1.smithi115.stdout:4/764: stat d1/d15/d31/l4e 0 2024-04-16T14:35:45.673 INFO:tasks.workunit.client.1.smithi115.stdout:4/765: readlink d1/d15/d17/l47 0 2024-04-16T14:35:45.673 INFO:tasks.workunit.client.1.smithi115.stdout:4/766: write d1/d15/d1e/f2b [1079546,70460] 0 2024-04-16T14:35:45.675 INFO:tasks.workunit.client.1.smithi115.stdout:5/800: mkdir dc/d15/d4d/dde/df0 0 2024-04-16T14:35:45.915 INFO:tasks.workunit.client.0.smithi005.stdout:8/835: sync 2024-04-16T14:35:45.915 INFO:tasks.workunit.client.0.smithi005.stdout:3/998: sync 2024-04-16T14:35:45.915 INFO:tasks.workunit.client.0.smithi005.stdout:8/836: truncate f3 3259888 0 2024-04-16T14:35:45.915 INFO:tasks.workunit.client.0.smithi005.stdout:3/999: creat d2/d17/d46/d75/d9b/f164 x:0 0 0 2024-04-16T14:35:45.915 INFO:tasks.workunit.client.0.smithi005.stdout:8/837: dwrite d5/d7b/da8/db7/d8a/da1/d3d/d7f/de7/fff [0,4194304] 0 2024-04-16T14:35:45.915 INFO:tasks.workunit.client.0.smithi005.stdout:8/838: dwrite d5/d7b/da8/db7/f19 [0,4194304] 0 2024-04-16T14:35:45.915 INFO:tasks.workunit.client.0.smithi005.stdout:8/839: dwrite d5/d40/d8e/fac [4194304,4194304] 0 2024-04-16T14:35:45.916 INFO:tasks.workunit.client.0.smithi005.stdout:8/840: dwrite d5/d7b/da8/db7/d8a/da1/f96 [0,4194304] 0 2024-04-16T14:35:45.916 INFO:tasks.workunit.client.0.smithi005.stdout:8/841: stat d5/d7b/da8/db7/d8a/da1/d3d 0 2024-04-16T14:35:45.916 INFO:tasks.workunit.client.0.smithi005.stdout:8/842: stat d5/d7b/da8/db7/d8a/da1/d3d/dba/dcd 0 2024-04-16T14:35:45.916 INFO:tasks.workunit.client.0.smithi005.stdout:8/843: creat d5/d9b/f126 x:0 0 0 2024-04-16T14:35:45.916 INFO:tasks.workunit.client.0.smithi005.stdout:8/844: dread d5/d7b/da8/db7/d8a/da1/d3d/d7f/d8d/dd1/f11f [0,4194304] 0 2024-04-16T14:35:45.916 INFO:tasks.workunit.client.0.smithi005.stdout:8/845: rename d5/d7b/da8/da5/f101 to d5/d7b/da8/db7/d8a/da1/d3d/d7f/d8d/f127 0 2024-04-16T14:35:45.916 INFO:tasks.workunit.client.0.smithi005.stdout:8/846: truncate d5/d55/f6b 5052341 0 2024-04-16T14:35:45.916 INFO:tasks.workunit.client.0.smithi005.stdout:8/847: creat d5/d55/f128 x:0 0 0 2024-04-16T14:35:45.916 INFO:tasks.workunit.client.0.smithi005.stdout:8/848: dread d5/d7b/da8/da5/def/f110 [0,4194304] 0 2024-04-16T14:35:45.925 INFO:tasks.workunit.client.0.smithi005.stdout:8/849: dwrite d5/f23 [0,4194304] 0 2024-04-16T14:35:45.925 INFO:tasks.workunit.client.0.smithi005.stdout:8/850: dread - d5/d55/f125 zero size 2024-04-16T14:35:45.931 INFO:tasks.workunit.client.0.smithi005.stdout:8/851: write d5/d7b/da8/da5/def/d71/fc5 [1243549,23577] 0 2024-04-16T14:35:45.933 INFO:tasks.workunit.client.1.smithi115.stdout:0/631: link d6/d10/d12/c16 d6/d54/d57/cdb 0 2024-04-16T14:35:45.933 INFO:tasks.workunit.client.1.smithi115.stdout:4/767: mkdir d1/d15/d31/d42/d8b/dcc/dee 0 2024-04-16T14:35:45.934 INFO:tasks.workunit.client.1.smithi115.stdout:5/801: mkdir dc/d15/d4d/dde/df1 0 2024-04-16T14:35:45.934 INFO:tasks.workunit.client.1.smithi115.stdout:1/848: dwrite df/d2d/d83/f60 [0,4194304] 0 2024-04-16T14:35:45.934 INFO:tasks.workunit.client.1.smithi115.stdout:5/802: link dc/d5d/d8f/cae dc/d5d/dc2/cf2 0 2024-04-16T14:35:45.934 INFO:tasks.workunit.client.1.smithi115.stdout:1/849: creat df/d36/d94/f120 x:0 0 0 2024-04-16T14:35:45.934 INFO:tasks.workunit.client.1.smithi115.stdout:1/850: fsync df/d35/f8a 0 2024-04-16T14:35:45.934 INFO:tasks.workunit.client.1.smithi115.stdout:4/768: dread d1/d15/d31/dc2/de4/fb8 [4194304,4194304] 0 2024-04-16T14:35:45.934 INFO:tasks.workunit.client.1.smithi115.stdout:1/851: mkdir df/d2d/d121 0 2024-04-16T14:35:45.934 INFO:tasks.workunit.client.1.smithi115.stdout:1/852: chown df/c29 3140491 1 2024-04-16T14:35:45.934 INFO:tasks.workunit.client.1.smithi115.stdout:4/769: link d1/d15/lcd d1/d15/d24/lef 0 2024-04-16T14:35:45.934 INFO:tasks.workunit.client.1.smithi115.stdout:0/632: dwrite d6/f25 [0,4194304] 0 2024-04-16T14:35:45.935 INFO:tasks.workunit.client.1.smithi115.stdout:0/633: creat d6/fdc x:0 0 0 2024-04-16T14:35:45.935 INFO:tasks.workunit.client.1.smithi115.stdout:4/770: symlink d1/d2/lf0 0 2024-04-16T14:35:45.935 INFO:tasks.workunit.client.1.smithi115.stdout:4/771: chown d1/d15/d31/d42/d46/l6a 30508668 1 2024-04-16T14:35:45.935 INFO:tasks.workunit.client.1.smithi115.stdout:0/634: mknod d6/d10/dd1/cdd 0 2024-04-16T14:35:45.935 INFO:tasks.workunit.client.1.smithi115.stdout:5/803: dwrite dc/d3d/f7f [0,4194304] 0 2024-04-16T14:35:45.935 INFO:tasks.workunit.client.1.smithi115.stdout:5/804: fsync dc/f65 0 2024-04-16T14:35:45.935 INFO:tasks.workunit.client.1.smithi115.stdout:0/635: rename d6/d10/d12/d31/d35/d44/c90 to d6/d10/d12/d31/d35/d44/cde 0 2024-04-16T14:35:45.935 INFO:tasks.workunit.client.1.smithi115.stdout:0/636: truncate d6/d10/f63 1578012 0 2024-04-16T14:35:45.935 INFO:tasks.workunit.client.1.smithi115.stdout:4/772: getdents d1/d15/d17/d9e 0 2024-04-16T14:35:45.935 INFO:tasks.workunit.client.1.smithi115.stdout:4/773: chown d1/d15/d1e/fd6 4911 1 2024-04-16T14:35:45.936 INFO:tasks.workunit.client.1.smithi115.stdout:0/637: getdents d6/d10/d12/d31/d35 0 2024-04-16T14:35:45.936 INFO:tasks.workunit.client.1.smithi115.stdout:0/638: mknod d6/d10/dae/cdf 0 2024-04-16T14:35:45.936 INFO:tasks.workunit.client.1.smithi115.stdout:0/639: truncate d6/d10/d12/d1f/d36/d4b/d70/fa8 145860 0 2024-04-16T14:35:45.936 INFO:tasks.workunit.client.1.smithi115.stdout:5/805: write dc/d15/d35/d69/f72 [7457965,63405] 0 2024-04-16T14:35:45.936 INFO:tasks.workunit.client.1.smithi115.stdout:0/640: dread d6/d10/d12/d1f/d36/d4b/f6a [0,4194304] 0 2024-04-16T14:35:45.936 INFO:tasks.workunit.client.1.smithi115.stdout:1/853: dwrite df/d13/d72/fa2 [0,4194304] 0 2024-04-16T14:35:45.936 INFO:tasks.workunit.client.1.smithi115.stdout:1/854: chown df/d35/l77 640 1 2024-04-16T14:35:45.936 INFO:tasks.workunit.client.1.smithi115.stdout:5/806: rename dc/d3d/d41/c5c to dc/d15/d35/d69/dad/cf3 0 2024-04-16T14:35:45.936 INFO:tasks.workunit.client.1.smithi115.stdout:5/807: rename dc to dc/d5d/dc2/df4 22 2024-04-16T14:35:45.936 INFO:tasks.workunit.client.1.smithi115.stdout:5/808: creat dc/d79/ff5 x:0 0 0 2024-04-16T14:35:45.936 INFO:tasks.workunit.client.1.smithi115.stdout:0/641: symlink d6/d54/le0 0 2024-04-16T14:35:45.936 INFO:tasks.workunit.client.1.smithi115.stdout:0/642: truncate d6/d10/f63 2432323 0 2024-04-16T14:35:45.937 INFO:tasks.workunit.client.1.smithi115.stdout:1/855: mknod df/d35/d84/ddc/de0/c122 0 2024-04-16T14:35:45.937 INFO:tasks.workunit.client.1.smithi115.stdout:5/809: mkdir dc/d15/df6 0 2024-04-16T14:35:45.937 INFO:tasks.workunit.client.1.smithi115.stdout:5/810: read dc/d15/f27 [3730737,104687] 0 2024-04-16T14:35:45.937 INFO:tasks.workunit.client.1.smithi115.stdout:5/811: stat dc/d5d/d8f 0 2024-04-16T14:35:45.937 INFO:tasks.workunit.client.1.smithi115.stdout:5/812: mkdir dc/d3d/d68/d7b/df7 0 2024-04-16T14:35:45.937 INFO:tasks.workunit.client.1.smithi115.stdout:0/643: link d6/d54/le0 d6/d10/d12/d5f/le1 0 2024-04-16T14:35:45.937 INFO:tasks.workunit.client.1.smithi115.stdout:0/644: chown d6/fb 0 1 2024-04-16T14:35:45.937 INFO:tasks.workunit.client.1.smithi115.stdout:5/813: truncate dc/d3d/d68/d7b/f89 41170 0 2024-04-16T14:35:45.937 INFO:tasks.workunit.client.1.smithi115.stdout:0/645: mkdir d6/d54/de2 0 2024-04-16T14:35:45.937 INFO:tasks.workunit.client.1.smithi115.stdout:4/774: dwrite d1/d15/d31/d42/f93 [0,4194304] 0 2024-04-16T14:35:45.937 INFO:tasks.workunit.client.1.smithi115.stdout:4/775: chown d1/d15/d31/f41 644970028 1 2024-04-16T14:35:45.937 INFO:tasks.workunit.client.1.smithi115.stdout:4/776: fdatasync d1/d15/d31/d42/f93 0 2024-04-16T14:35:45.938 INFO:tasks.workunit.client.1.smithi115.stdout:1/856: dread df/d13/d4d/d2c/f33 [0,4194304] 0 2024-04-16T14:35:45.938 INFO:tasks.workunit.client.1.smithi115.stdout:1/857: write df/d13/f74 [3132053,81107] 0 2024-04-16T14:35:45.938 INFO:tasks.workunit.client.1.smithi115.stdout:1/858: dread - df/f64 zero size 2024-04-16T14:35:45.938 INFO:tasks.workunit.client.1.smithi115.stdout:5/814: dread dc/d5d/dc2/fc3 [0,4194304] 0 2024-04-16T14:35:45.938 INFO:tasks.workunit.client.1.smithi115.stdout:5/815: readlink dc/d15/d35/l88 0 2024-04-16T14:35:45.938 INFO:tasks.workunit.client.1.smithi115.stdout:5/816: mknod dc/d5d/dc2/cf8 0 2024-04-16T14:35:45.938 INFO:tasks.workunit.client.1.smithi115.stdout:0/646: dread d6/d10/f20 [4194304,4194304] 0 2024-04-16T14:35:45.938 INFO:tasks.workunit.client.1.smithi115.stdout:5/817: truncate dc/d15/d35/f3f 1247919 0 2024-04-16T14:35:45.938 INFO:tasks.workunit.client.1.smithi115.stdout:5/818: chown dc/d5d/d81/d9a/da3 2689034 1 2024-04-16T14:35:45.938 INFO:tasks.workunit.client.1.smithi115.stdout:5/819: chown dc/l45 64 1 2024-04-16T14:35:45.938 INFO:tasks.workunit.client.1.smithi115.stdout:5/820: chown f5 7 1 2024-04-16T14:35:45.939 INFO:tasks.workunit.client.1.smithi115.stdout:5/821: stat dc/d5d/d81/cb2 0 2024-04-16T14:35:45.939 INFO:tasks.workunit.client.1.smithi115.stdout:5/822: stat dc/d15/d4d/daa/cd3 0 2024-04-16T14:35:45.939 INFO:tasks.workunit.client.1.smithi115.stdout:0/647: rmdir d6/d10 39 2024-04-16T14:35:45.939 INFO:tasks.workunit.client.1.smithi115.stdout:0/648: write d6/d54/d57/d83/f8f [1040544,114161] 0 2024-04-16T14:35:45.939 INFO:tasks.workunit.client.1.smithi115.stdout:0/649: fsync d6/d10/f63 0 2024-04-16T14:35:45.939 INFO:tasks.workunit.client.1.smithi115.stdout:5/823: getdents dc/d15/d35/d71 0 2024-04-16T14:35:45.939 INFO:tasks.workunit.client.1.smithi115.stdout:0/650: dread d6/d10/d94/fa5 [0,4194304] 0 2024-04-16T14:35:45.939 INFO:tasks.workunit.client.1.smithi115.stdout:5/824: write dc/d3d/d41/f95 [2590056,46736] 0 2024-04-16T14:35:45.939 INFO:tasks.workunit.client.1.smithi115.stdout:0/651: symlink d6/d54/d57/d83/le3 0 2024-04-16T14:35:45.939 INFO:tasks.workunit.client.1.smithi115.stdout:0/652: dread d6/d10/d12/d1f/d36/fb2 [0,4194304] 0 2024-04-16T14:35:45.939 INFO:tasks.workunit.client.1.smithi115.stdout:4/777: dwrite d1/d15/d24/dc6/fd5 [0,4194304] 0 2024-04-16T14:35:45.940 INFO:tasks.workunit.client.1.smithi115.stdout:4/778: dread - d1/d15/d31/f41 zero size 2024-04-16T14:35:45.940 INFO:tasks.workunit.client.1.smithi115.stdout:4/779: readlink d1/d15/d17/le3 0 2024-04-16T14:35:45.940 INFO:tasks.workunit.client.1.smithi115.stdout:4/780: fsync d1/d15/d31/d55/f7f 0 2024-04-16T14:35:45.940 INFO:tasks.workunit.client.1.smithi115.stdout:4/781: stat d1/d15/d31/d42/db4 0 2024-04-16T14:35:45.940 INFO:tasks.workunit.client.1.smithi115.stdout:0/653: mkdir d6/d30/d4d/de4 0 2024-04-16T14:35:45.940 INFO:tasks.workunit.client.1.smithi115.stdout:4/782: write d1/d15/f34 [298011,52419] 0 2024-04-16T14:35:45.940 INFO:tasks.workunit.client.1.smithi115.stdout:4/783: mkdir d1/d15/d31/dc2/df1 0 2024-04-16T14:35:45.940 INFO:tasks.workunit.client.1.smithi115.stdout:4/784: truncate d1/d15/d17/d9e/dbe/fe5 128970 0 2024-04-16T14:35:45.940 INFO:tasks.workunit.client.1.smithi115.stdout:0/654: mkdir d6/d30/d4d/de5 0 2024-04-16T14:35:45.940 INFO:tasks.workunit.client.1.smithi115.stdout:0/655: read d6/d10/d12/d1f/d36/d4b/d6d/f76 [33151,49337] 0 2024-04-16T14:35:45.940 INFO:tasks.workunit.client.1.smithi115.stdout:5/825: dwrite dc/d15/d35/d69/f70 [0,4194304] 0 2024-04-16T14:35:45.940 INFO:tasks.workunit.client.1.smithi115.stdout:1/859: dwrite df/d13/d4d/d6d/f73 [0,4194304] 0 2024-04-16T14:35:45.941 INFO:tasks.workunit.client.1.smithi115.stdout:0/656: write d6/d10/d12/d1f/d36/d4b/d6d/f8e [3888015,28741] 0 2024-04-16T14:35:45.941 INFO:tasks.workunit.client.1.smithi115.stdout:5/826: dread dc/d5d/dc2/fc3 [0,4194304] 0 2024-04-16T14:35:45.941 INFO:tasks.workunit.client.1.smithi115.stdout:1/860: write df/f10 [5294686,128084] 0 2024-04-16T14:35:45.941 INFO:tasks.workunit.client.1.smithi115.stdout:1/861: write df/d36/d94/f120 [1039610,72132] 0 2024-04-16T14:35:45.941 INFO:tasks.workunit.client.1.smithi115.stdout:5/827: creat dc/d5d/ff9 x:0 0 0 2024-04-16T14:35:45.941 INFO:tasks.workunit.client.1.smithi115.stdout:5/828: truncate dc/d15/de6/fe9 181140 0 2024-04-16T14:35:45.941 INFO:tasks.workunit.client.1.smithi115.stdout:1/862: rmdir df/d13/d4d/d3e/d75/d11b 39 2024-04-16T14:35:45.941 INFO:tasks.workunit.client.1.smithi115.stdout:1/863: readlink df/d13/d72/lf6 0 2024-04-16T14:35:45.941 INFO:tasks.workunit.client.1.smithi115.stdout:1/864: unlink df/d13/f74 0 2024-04-16T14:35:45.941 INFO:tasks.workunit.client.1.smithi115.stdout:1/865: mknod df/d13/d4d/d68/de7/c123 0 2024-04-16T14:35:45.941 INFO:tasks.workunit.client.1.smithi115.stdout:1/866: creat df/d13/dc3/f124 x:0 0 0 2024-04-16T14:35:45.941 INFO:tasks.workunit.client.1.smithi115.stdout:1/867: mkdir df/d13/d125 0 2024-04-16T14:35:45.942 INFO:tasks.workunit.client.1.smithi115.stdout:1/868: rmdir df/d13/d4d/d68/da0 39 2024-04-16T14:35:45.942 INFO:tasks.workunit.client.1.smithi115.stdout:6/817: sync 2024-04-16T14:35:45.942 INFO:tasks.workunit.client.1.smithi115.stdout:7/714: sync 2024-04-16T14:35:45.942 INFO:tasks.workunit.client.1.smithi115.stdout:6/818: rename d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96/l37 to d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/d63/l110 0 2024-04-16T14:35:45.942 INFO:tasks.workunit.client.1.smithi115.stdout:6/819: creat d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96/f111 x:0 0 0 2024-04-16T14:35:45.942 INFO:tasks.workunit.client.1.smithi115.stdout:5/829: dwrite dc/d15/d2d/f32 [0,4194304] 0 2024-04-16T14:35:45.942 INFO:tasks.workunit.client.1.smithi115.stdout:5/830: chown dc/d15/d35/d69/f70 7 1 2024-04-16T14:35:45.942 INFO:tasks.workunit.client.1.smithi115.stdout:5/831: creat dc/d15/d4d/dde/df1/ffa x:0 0 0 2024-04-16T14:35:45.942 INFO:tasks.workunit.client.1.smithi115.stdout:5/832: getdents dc/d15/d35/d71 0 2024-04-16T14:35:45.942 INFO:tasks.workunit.client.1.smithi115.stdout:5/833: rename dc/d3d/l51 to dc/d5d/d81/lfb 0 2024-04-16T14:35:45.943 INFO:tasks.workunit.client.1.smithi115.stdout:5/834: link dc/d15/d2d/d8c/ce8 dc/d15/d35/d69/cfc 0 2024-04-16T14:35:45.943 INFO:tasks.workunit.client.1.smithi115.stdout:5/835: creat dc/d15/d4d/dde/df0/ffd x:0 0 0 2024-04-16T14:35:45.943 INFO:tasks.workunit.client.1.smithi115.stdout:5/836: creat dc/d5d/d81/d9a/da3/ffe x:0 0 0 2024-04-16T14:35:45.943 INFO:tasks.workunit.client.1.smithi115.stdout:5/837: dread - dc/d3d/f96 zero size 2024-04-16T14:35:45.943 INFO:tasks.workunit.client.1.smithi115.stdout:1/869: dwrite df/d2d/d83/f10e [0,4194304] 0 2024-04-16T14:35:45.943 INFO:tasks.workunit.client.1.smithi115.stdout:1/870: mknod df/d13/d4d/d3e/d75/d11b/d10c/c126 0 2024-04-16T14:35:45.943 INFO:tasks.workunit.client.1.smithi115.stdout:1/871: creat df/d13/d125/f127 x:0 0 0 2024-04-16T14:35:45.943 INFO:tasks.workunit.client.1.smithi115.stdout:1/872: mkdir df/d13/d4d/d68/de7/dbe/d128 0 2024-04-16T14:35:45.943 INFO:tasks.workunit.client.1.smithi115.stdout:1/873: write df/d35/f114 [668778,112309] 0 2024-04-16T14:35:45.943 INFO:tasks.workunit.client.1.smithi115.stdout:1/874: creat df/d36/f129 x:0 0 0 2024-04-16T14:35:45.943 INFO:tasks.workunit.client.1.smithi115.stdout:7/715: dwrite d0/d2/d3a/d30/f32 [0,4194304] 0 2024-04-16T14:35:45.944 INFO:tasks.workunit.client.1.smithi115.stdout:7/716: stat d0/d2/d3a/d30/d79/dd2/d64/f71 0 2024-04-16T14:35:45.944 INFO:tasks.workunit.client.1.smithi115.stdout:7/717: dread - d0/d24/da3/db1/d3f/db0/fcd zero size 2024-04-16T14:35:45.944 INFO:tasks.workunit.client.1.smithi115.stdout:1/875: mknod df/d13/d72/c12a 0 2024-04-16T14:35:45.944 INFO:tasks.workunit.client.1.smithi115.stdout:1/876: creat df/d13/d4d/d3e/d75/da9/db7/f12b x:0 0 0 2024-04-16T14:35:45.944 INFO:tasks.workunit.client.1.smithi115.stdout:1/877: write df/f9c [1331252,15290] 0 2024-04-16T14:35:45.944 INFO:tasks.workunit.client.1.smithi115.stdout:5/838: dread dc/d15/f53 [4194304,4194304] 0 2024-04-16T14:35:45.944 INFO:tasks.workunit.client.1.smithi115.stdout:7/718: mkdir d0/d24/d40/df0 0 2024-04-16T14:35:45.944 INFO:tasks.workunit.client.1.smithi115.stdout:7/719: creat d0/d24/d40/df0/ff1 x:0 0 0 2024-04-16T14:35:45.944 INFO:tasks.workunit.client.1.smithi115.stdout:7/720: getdents d0/d2/d3a/dda 0 2024-04-16T14:35:45.944 INFO:tasks.workunit.client.1.smithi115.stdout:6/820: dwrite d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/d63/fc5 [0,4194304] 0 2024-04-16T14:35:45.944 INFO:tasks.workunit.client.1.smithi115.stdout:6/821: truncate d13/d1d/d47/fa3 4907381 0 2024-04-16T14:35:45.945 INFO:tasks.workunit.client.1.smithi115.stdout:6/822: chown d13/d1d/f5c 93199359 1 2024-04-16T14:35:45.945 INFO:tasks.workunit.client.1.smithi115.stdout:1/878: dread df/d13/d4d/d2c/f33 [0,4194304] 0 2024-04-16T14:35:45.945 INFO:tasks.workunit.client.1.smithi115.stdout:6/823: mkdir d13/d1d/d2b/df4/d112 0 2024-04-16T14:35:45.945 INFO:tasks.workunit.client.1.smithi115.stdout:1/879: write df/f5b [1409439,93604] 0 2024-04-16T14:35:45.945 INFO:tasks.workunit.client.1.smithi115.stdout:1/880: truncate df/d13/d72/fa2 1066420 0 2024-04-16T14:35:45.945 INFO:tasks.workunit.client.1.smithi115.stdout:6/824: dread d13/fb1 [0,4194304] 0 2024-04-16T14:35:45.945 INFO:tasks.workunit.client.1.smithi115.stdout:1/881: dread df/d2d/d83/f60 [0,4194304] 0 2024-04-16T14:35:45.945 INFO:tasks.workunit.client.1.smithi115.stdout:1/882: unlink df/d13/d4d/d2c/fd8 0 2024-04-16T14:35:45.945 INFO:tasks.workunit.client.1.smithi115.stdout:1/883: fdatasync df/fdd 0 2024-04-16T14:35:45.945 INFO:tasks.workunit.client.1.smithi115.stdout:1/884: rename df/d35/de2 to df/d13/d4d/d3e/d7d/d12c 0 2024-04-16T14:35:45.945 INFO:tasks.workunit.client.1.smithi115.stdout:7/721: dwrite d0/d1/fc9 [4194304,4194304] 0 2024-04-16T14:35:45.945 INFO:tasks.workunit.client.1.smithi115.stdout:7/722: write d0/d24/da3/db1/d3f/db0/f89 [1761146,104470] 0 2024-04-16T14:35:45.946 INFO:tasks.workunit.client.1.smithi115.stdout:7/723: readlink d0/d2/d3a/l67 0 2024-04-16T14:35:45.946 INFO:tasks.workunit.client.1.smithi115.stdout:7/724: creat d0/d2/d3a/ff2 x:0 0 0 2024-04-16T14:35:45.946 INFO:tasks.workunit.client.1.smithi115.stdout:1/885: mknod df/d13/d4d/d6d/dc5/c12d 0 2024-04-16T14:35:45.946 INFO:tasks.workunit.client.1.smithi115.stdout:1/886: creat df/d35/d48/f12e x:0 0 0 2024-04-16T14:35:45.946 INFO:tasks.workunit.client.1.smithi115.stdout:1/887: chown df/d36/dff/f10a 21 1 2024-04-16T14:35:45.946 INFO:tasks.workunit.client.1.smithi115.stdout:1/888: stat df/d35/d84/ld1 0 2024-04-16T14:35:45.946 INFO:tasks.workunit.client.1.smithi115.stdout:1/889: truncate df/d36/dff/f100 82506 0 2024-04-16T14:35:45.946 INFO:tasks.workunit.client.1.smithi115.stdout:1/890: dwrite df/f64 [0,4194304] 0 2024-04-16T14:35:45.946 INFO:tasks.workunit.client.1.smithi115.stdout:1/891: getdents df/d35 0 2024-04-16T14:35:45.946 INFO:tasks.workunit.client.1.smithi115.stdout:1/892: rename df/d13/d4d/d3e/d75/da9/db7/f110 to df/d13/d4d/d6d/dc5/f12f 0 2024-04-16T14:35:45.946 INFO:tasks.workunit.client.1.smithi115.stdout:1/893: mknod df/d13/d72/c130 0 2024-04-16T14:35:45.947 INFO:tasks.workunit.client.1.smithi115.stdout:1/894: dread - df/d13/d4d/d68/da0/ff1 zero size 2024-04-16T14:35:45.947 INFO:tasks.workunit.client.1.smithi115.stdout:1/895: chown df/d13/d4d/d3e/f96 12781742 1 2024-04-16T14:35:45.947 INFO:tasks.workunit.client.1.smithi115.stdout:1/896: truncate df/d2d/d83/fb8 272752 0 2024-04-16T14:35:45.947 INFO:tasks.workunit.client.1.smithi115.stdout:1/897: link df/d13/d4d/d6d/dc5/f105 df/d13/f131 0 2024-04-16T14:35:45.947 INFO:tasks.workunit.client.1.smithi115.stdout:1/898: write df/d13/d4d/d2c/f24 [2376960,44187] 0 2024-04-16T14:35:45.947 INFO:tasks.workunit.client.1.smithi115.stdout:1/899: stat df/d13/d4d/d68/de7/lac 0 2024-04-16T14:35:45.947 INFO:tasks.workunit.client.1.smithi115.stdout:1/900: write df/d35/d48/f4c [1050628,31769] 0 2024-04-16T14:35:45.947 INFO:tasks.workunit.client.1.smithi115.stdout:1/901: write df/d13/d4d/d2c/f21 [800893,62128] 0 2024-04-16T14:35:45.947 INFO:tasks.workunit.client.1.smithi115.stdout:1/902: dread df/d36/f9b [4194304,4194304] 0 2024-04-16T14:35:45.947 INFO:tasks.workunit.client.1.smithi115.stdout:1/903: creat df/d13/d4d/d3e/d75/da9/db7/f132 x:0 0 0 2024-04-16T14:35:45.947 INFO:tasks.workunit.client.1.smithi115.stdout:1/904: creat df/d13/d4d/d3e/d75/dfc/f133 x:0 0 0 2024-04-16T14:35:45.948 INFO:tasks.workunit.client.1.smithi115.stdout:1/905: creat df/d13/d4d/d68/de7/f134 x:0 0 0 2024-04-16T14:35:45.948 INFO:tasks.workunit.client.1.smithi115.stdout:1/906: rmdir df/d13/d4d/d68/de7 39 2024-04-16T14:35:45.948 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:45 smithi115 ceph-mon[37295]: pgmap v27: 65 pgs: 65 active+clean; 3.1 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 392 MiB/s rd, 455 MiB/s wr, 904 op/s 2024-04-16T14:35:45.948 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:45 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:45.949 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:45 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:45.949 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:45 smithi115 ceph-mon[37295]: Reconfiguring grafana.smithi005 (dependencies changed)... 2024-04-16T14:35:45.949 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:45 smithi115 ceph-mon[37295]: Reconfiguring daemon grafana.smithi005 on smithi005 2024-04-16T14:35:45.949 INFO:tasks.workunit.client.1.smithi115.stdout:1/907: dread df/d35/f88 [0,4194304] 0 2024-04-16T14:35:45.949 INFO:tasks.workunit.client.1.smithi115.stdout:1/908: dwrite df/d13/d4d/d68/da0/ff1 [0,4194304] 0 2024-04-16T14:35:45.951 INFO:tasks.workunit.client.0.smithi005.stdout:8/852: symlink d5/d7b/da8/db7/d8a/da1/d3d/d7f/l129 0 2024-04-16T14:35:45.951 INFO:tasks.workunit.client.0.smithi005.stdout:8/853: dread - d5/d7b/da8/db7/d8a/da1/d3d/d7f/d8d/f127 zero size 2024-04-16T14:35:45.951 INFO:tasks.workunit.client.0.smithi005.stdout:8/854: truncate d5/d11/f20 3050424 0 2024-04-16T14:35:45.951 INFO:tasks.workunit.client.0.smithi005.stdout:8/855: readlink d5/d7b/da8/db7/d8a/l8c 0 2024-04-16T14:35:45.951 INFO:tasks.workunit.client.0.smithi005.stdout:8/856: mknod d5/d9b/c12a 0 2024-04-16T14:35:45.951 INFO:tasks.workunit.client.0.smithi005.stdout:8/857: symlink d5/d7b/da8/db7/d8a/l12b 0 2024-04-16T14:35:45.951 INFO:tasks.workunit.client.0.smithi005.stdout:8/858: creat d5/d7b/da8/db7/d8a/da1/d3d/d7f/d8d/dd1/f12c x:0 0 0 2024-04-16T14:35:45.951 INFO:tasks.workunit.client.0.smithi005.stdout:8/859: chown d5/d7b/da8/db7/d121/l123 95363 1 2024-04-16T14:35:45.952 INFO:tasks.workunit.client.0.smithi005.stdout:8/860: read d5/d55/f5e [2318385,55531] 0 2024-04-16T14:35:45.952 INFO:tasks.workunit.client.0.smithi005.stdout:8/861: mknod d5/d7b/da8/da5/def/d71/c12d 0 2024-04-16T14:35:45.952 INFO:tasks.workunit.client.0.smithi005.stdout:2/766: sync 2024-04-16T14:35:45.953 INFO:tasks.workunit.client.0.smithi005.stdout:2/767: dread d0/d29/d89/f8b [0,4194304] 0 2024-04-16T14:35:45.954 INFO:tasks.workunit.client.0.smithi005.stdout:2/768: chown d0/d29/lb7 5581 1 2024-04-16T14:35:45.955 INFO:tasks.workunit.client.0.smithi005.stdout:2/769: creat d0/d1c/d39/d48/ffc x:0 0 0 2024-04-16T14:35:45.955 INFO:tasks.workunit.client.0.smithi005.stdout:2/770: fsync d0/d4/f78 0 2024-04-16T14:35:45.955 INFO:tasks.workunit.client.0.smithi005.stdout:2/771: creat d0/d2a/d3a/d46/dd8/ffd x:0 0 0 2024-04-16T14:35:45.955 INFO:tasks.workunit.client.0.smithi005.stdout:2/772: creat d0/d1c/d39/d48/ffe x:0 0 0 2024-04-16T14:35:45.956 INFO:tasks.workunit.client.1.smithi115.stdout:1/909: dwrite df/d13/d4d/d6d/dc5/f116 [0,4194304] 0 2024-04-16T14:35:45.957 INFO:tasks.workunit.client.0.smithi005.stdout:8/862: dwrite d5/d40/d8e/ff9 [4194304,4194304] 0 2024-04-16T14:35:45.958 INFO:tasks.workunit.client.1.smithi115.stdout:1/910: mkdir df/d36/d135 0 2024-04-16T14:35:45.960 INFO:tasks.workunit.client.1.smithi115.stdout:1/911: symlink df/d13/d4d/d3e/d7d/l136 0 2024-04-16T14:35:45.960 INFO:tasks.workunit.client.1.smithi115.stdout:1/912: chown df/d13/d4d/d3e/d75/da9/db7/f132 20647 1 2024-04-16T14:35:45.962 INFO:tasks.workunit.client.0.smithi005.stdout:2/773: write d0/d29/fc3 [3091502,18261] 0 2024-04-16T14:35:45.962 INFO:tasks.workunit.client.0.smithi005.stdout:2/774: write d0/d29/d3e/f42 [3924480,129273] 0 2024-04-16T14:35:45.962 INFO:tasks.workunit.client.0.smithi005.stdout:8/863: getdents d5/d7b/da8/db7/d8a 0 2024-04-16T14:35:45.964 INFO:tasks.workunit.client.0.smithi005.stdout:2/775: creat d0/d2a/fff x:0 0 0 2024-04-16T14:35:45.966 INFO:tasks.workunit.client.0.smithi005.stdout:2/776: symlink d0/d4/d2b/d5e/l100 0 2024-04-16T14:35:45.967 INFO:tasks.workunit.client.0.smithi005.stdout:2/777: chown d0/d29/d89/de3 253756851 1 2024-04-16T14:35:45.967 INFO:tasks.workunit.client.0.smithi005.stdout:2/778: fsync d0/d29/d89/feb 0 2024-04-16T14:35:45.967 INFO:tasks.workunit.client.0.smithi005.stdout:2/779: fdatasync d0/d4/f62 0 2024-04-16T14:35:45.969 INFO:tasks.workunit.client.1.smithi115.stdout:2/933: sync 2024-04-16T14:35:45.970 INFO:tasks.workunit.client.1.smithi115.stdout:2/934: symlink d0/d47/d65/d61/dae/l134 0 2024-04-16T14:35:45.970 INFO:tasks.workunit.client.1.smithi115.stdout:2/935: rmdir d0/d47/d65/d61 39 2024-04-16T14:35:45.971 INFO:tasks.workunit.client.1.smithi115.stdout:1/913: write df/d13/d4d/d68/da0/ff1 [1460733,59808] 0 2024-04-16T14:35:45.972 INFO:tasks.workunit.client.1.smithi115.stdout:2/936: symlink d0/d47/d65/dad/dbb/d11/d6d/d11f/l135 0 2024-04-16T14:35:45.972 INFO:tasks.workunit.client.1.smithi115.stdout:2/937: creat d0/d47/d65/dad/dbb/d11/d6d/f136 x:0 0 0 2024-04-16T14:35:45.972 INFO:tasks.workunit.client.1.smithi115.stdout:2/938: read - d0/d47/d65/dad/dc8/d24/d10/f123 zero size 2024-04-16T14:35:45.973 INFO:tasks.workunit.client.1.smithi115.stdout:1/914: symlink df/d35/d84/l137 0 2024-04-16T14:35:45.973 INFO:tasks.workunit.client.1.smithi115.stdout:1/915: truncate df/ffa 223974 0 2024-04-16T14:35:45.974 INFO:tasks.workunit.client.1.smithi115.stdout:2/939: link d0/d47/d65/dad/dbb/d11/d36/fc1 d0/d47/d65/dad/dbb/d11/d36/f137 0 2024-04-16T14:35:45.974 INFO:tasks.workunit.client.1.smithi115.stdout:2/940: fdatasync d0/d47/fe0 0 2024-04-16T14:35:45.974 INFO:tasks.workunit.client.1.smithi115.stdout:2/941: fdatasync d0/d1b/f41 0 2024-04-16T14:35:45.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:45 smithi005 ceph-mon[28964]: pgmap v27: 65 pgs: 65 active+clean; 3.1 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 392 MiB/s rd, 455 MiB/s wr, 904 op/s 2024-04-16T14:35:45.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:45 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:45.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:45 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:45.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:45 smithi005 ceph-mon[28964]: Reconfiguring grafana.smithi005 (dependencies changed)... 2024-04-16T14:35:45.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:45 smithi005 ceph-mon[28964]: Reconfiguring daemon grafana.smithi005 on smithi005 2024-04-16T14:35:45.975 INFO:tasks.workunit.client.0.smithi005.stdout:2/780: write d0/d4/d2b/d5e/f79 [4028940,38912] 0 2024-04-16T14:35:45.975 INFO:tasks.workunit.client.0.smithi005.stdout:2/781: truncate d0/d29/f49 5536784 0 2024-04-16T14:35:45.976 INFO:tasks.workunit.client.0.smithi005.stdout:2/782: mknod d0/d29/d3e/dd2/c101 0 2024-04-16T14:35:45.976 INFO:tasks.workunit.client.1.smithi115.stdout:1/916: unlink df/f1a 0 2024-04-16T14:35:45.976 INFO:tasks.workunit.client.0.smithi005.stdout:2/783: rename d0/d4/f62 to d0/d29/d89/de3/f102 0 2024-04-16T14:35:45.978 INFO:tasks.workunit.client.0.smithi005.stdout:8/864: dwrite d5/d7b/da8/da5/def/d71/fbc [0,4194304] 0 2024-04-16T14:35:45.978 INFO:tasks.workunit.client.0.smithi005.stdout:8/865: dread - d5/d7b/da8/db7/d8a/da1/d3d/d7f/d8d/f127 zero size 2024-04-16T14:35:45.979 INFO:tasks.workunit.client.0.smithi005.stdout:8/866: chown d5/d7b/da8/db7/f51 855 1 2024-04-16T14:35:45.979 INFO:tasks.workunit.client.0.smithi005.stdout:8/867: creat d5/d40/d8e/f12e x:0 0 0 2024-04-16T14:35:45.979 INFO:tasks.workunit.client.0.smithi005.stdout:8/868: creat d5/d7b/da8/db7/d8a/da1/d3d/d7f/d8d/f12f x:0 0 0 2024-04-16T14:35:45.987 INFO:tasks.workunit.client.0.smithi005.stdout:2/784: dread d0/d1c/d8d/fad [4194304,4194304] 0 2024-04-16T14:35:45.987 INFO:tasks.workunit.client.0.smithi005.stdout:2/785: fsync d0/d2a/fbe 0 2024-04-16T14:35:45.987 INFO:tasks.workunit.client.0.smithi005.stdout:2/786: dread - d0/d29/d3e/fe6 zero size 2024-04-16T14:35:45.988 INFO:tasks.workunit.client.0.smithi005.stdout:2/787: chown d0/c91 34662 1 2024-04-16T14:35:45.988 INFO:tasks.workunit.client.0.smithi005.stdout:2/788: stat d0/d29/d3e/dd2 0 2024-04-16T14:35:45.988 INFO:tasks.workunit.client.0.smithi005.stdout:2/789: mkdir d0/d1c/d59/d67/d103 0 2024-04-16T14:35:45.988 INFO:tasks.workunit.client.0.smithi005.stdout:2/790: creat d0/d1c/d39/d85/f104 x:0 0 0 2024-04-16T14:35:45.995 INFO:tasks.workunit.client.0.smithi005.stdout:2/791: rmdir d0/d1c/d59 39 2024-04-16T14:35:45.995 INFO:tasks.workunit.client.0.smithi005.stdout:2/792: fdatasync d0/d1c/d39/fd4 0 2024-04-16T14:35:45.995 INFO:tasks.workunit.client.0.smithi005.stdout:2/793: readlink d0/d4/d2b/d5e/l75 0 2024-04-16T14:35:45.996 INFO:tasks.workunit.client.0.smithi005.stdout:2/794: creat d0/d29/d89/f105 x:0 0 0 2024-04-16T14:35:45.997 INFO:tasks.workunit.client.0.smithi005.stdout:2/795: creat d0/d2a/d3a/d94/f106 x:0 0 0 2024-04-16T14:35:46.026 INFO:tasks.workunit.client.1.smithi115.stdout:1/917: mkdir df/d2d/d121/d138 0 2024-04-16T14:35:46.028 INFO:tasks.workunit.client.1.smithi115.stdout:1/918: getdents df/d13/d4d/d68/da0 0 2024-04-16T14:35:46.030 INFO:tasks.workunit.client.0.smithi005.stdout:9/732: sync 2024-04-16T14:35:46.030 INFO:tasks.workunit.client.0.smithi005.stdout:0/832: sync 2024-04-16T14:35:46.031 INFO:tasks.workunit.client.0.smithi005.stdout:0/833: link da/f1f da/f11e 0 2024-04-16T14:35:46.032 INFO:tasks.workunit.client.0.smithi005.stdout:0/834: unlink da/df/d26/da9/d108/c44 0 2024-04-16T14:35:46.033 INFO:tasks.workunit.client.0.smithi005.stdout:9/733: getdents d3/d12/d2b/d8e 0 2024-04-16T14:35:46.034 INFO:tasks.workunit.client.0.smithi005.stdout:0/835: dread da/df/d1b/d3a/d96/dab/fac [0,4194304] 0 2024-04-16T14:35:46.038 INFO:tasks.workunit.client.0.smithi005.stdout:9/734: dread d3/d77/f8f [0,4194304] 0 2024-04-16T14:35:46.039 INFO:tasks.workunit.client.0.smithi005.stdout:9/735: truncate d3/d12/d16/d46/d47/d60/f69 105688 0 2024-04-16T14:35:46.039 INFO:tasks.workunit.client.0.smithi005.stdout:9/736: dread - d3/d49/d4b/d5c/d65/fa3 zero size 2024-04-16T14:35:46.041 INFO:tasks.workunit.client.1.smithi115.stdout:1/919: dwrite df/d13/d4d/d3e/f62 [0,4194304] 0 2024-04-16T14:35:46.048 INFO:tasks.workunit.client.1.smithi115.stdout:1/920: write df/f64 [2913980,82906] 0 2024-04-16T14:35:46.055 INFO:tasks.workunit.client.1.smithi115.stdout:1/921: dread df/d2d/fd0 [0,4194304] 0 2024-04-16T14:35:46.055 INFO:tasks.workunit.client.1.smithi115.stdout:1/922: write df/d13/d4d/d2c/fb4 [3586593,121249] 0 2024-04-16T14:35:46.056 INFO:tasks.workunit.client.1.smithi115.stdout:3/843: sync 2024-04-16T14:35:46.057 INFO:tasks.workunit.client.1.smithi115.stdout:1/923: unlink df/d13/d4d/d3e/d75/d11b/lef 0 2024-04-16T14:35:46.059 INFO:tasks.workunit.client.1.smithi115.stdout:1/924: symlink df/d35/d84/ddc/de0/df2/l139 0 2024-04-16T14:35:46.059 INFO:tasks.workunit.client.1.smithi115.stdout:1/925: readlink df/d13/d4d/l66 0 2024-04-16T14:35:46.059 INFO:tasks.workunit.client.1.smithi115.stdout:1/926: fdatasync df/d13/d4d/d68/de7/dbe/ffe 0 2024-04-16T14:35:46.059 INFO:tasks.workunit.client.1.smithi115.stdout:1/927: write df/d13/ff9 [383040,85913] 0 2024-04-16T14:35:46.060 INFO:tasks.workunit.client.1.smithi115.stdout:1/928: symlink df/d13/d4d/d2c/l13a 0 2024-04-16T14:35:46.060 INFO:tasks.workunit.client.1.smithi115.stdout:1/929: symlink df/d13/d4d/l13b 0 2024-04-16T14:35:46.061 INFO:tasks.workunit.client.1.smithi115.stdout:1/930: symlink df/d13/d4d/d3e/d75/dda/l13c 0 2024-04-16T14:35:46.063 INFO:tasks.workunit.client.1.smithi115.stdout:1/931: rename df/d2d/f101 to df/d36/d94/f13d 0 2024-04-16T14:35:46.075 INFO:tasks.workunit.client.1.smithi115.stdout:1/932: dwrite df/d36/d94/f120 [0,4194304] 0 2024-04-16T14:35:46.075 INFO:tasks.workunit.client.1.smithi115.stdout:1/933: dread - df/d2d/ff0 zero size 2024-04-16T14:35:46.077 INFO:tasks.workunit.client.1.smithi115.stdout:1/934: mkdir df/d13/d4d/d3e/d75/da9/d13e 0 2024-04-16T14:35:46.084 INFO:tasks.workunit.client.1.smithi115.stdout:1/935: write df/d13/d4d/d6d/f86 [7797599,90087] 0 2024-04-16T14:35:46.084 INFO:tasks.workunit.client.1.smithi115.stdout:1/936: symlink df/d13/d4d/d3e/d75/d11b/l13f 0 2024-04-16T14:35:46.091 INFO:tasks.workunit.client.1.smithi115.stdout:1/937: dread df/f10 [0,4194304] 0 2024-04-16T14:35:46.108 INFO:tasks.workunit.client.1.smithi115.stdout:1/938: dwrite df/d36/d94/fd5 [0,4194304] 0 2024-04-16T14:35:46.108 INFO:tasks.workunit.client.1.smithi115.stdout:1/939: dread - df/d13/d4d/d68/de7/f134 zero size 2024-04-16T14:35:46.108 INFO:tasks.workunit.client.0.smithi005.stdout:9/737: unlink d3/d12/d2b/f4f 0 2024-04-16T14:35:46.110 INFO:tasks.workunit.client.1.smithi115.stdout:1/940: symlink df/d13/d4d/d68/de7/d55/l140 0 2024-04-16T14:35:46.111 INFO:tasks.workunit.client.1.smithi115.stdout:1/941: mknod df/d13/d4d/d3e/d75/da9/c141 0 2024-04-16T14:35:46.111 INFO:tasks.workunit.client.1.smithi115.stdout:1/942: readlink df/d13/d4d/d6d/lf7 0 2024-04-16T14:35:46.113 INFO:tasks.workunit.client.1.smithi115.stdout:1/943: creat df/d13/d4d/d6d/f142 x:0 0 0 2024-04-16T14:35:46.113 INFO:tasks.workunit.client.1.smithi115.stdout:1/944: creat df/d35/d48/f143 x:0 0 0 2024-04-16T14:35:46.113 INFO:tasks.workunit.client.1.smithi115.stdout:1/945: chown df/d13/d4d/d3e/d75/l11f 0 1 2024-04-16T14:35:46.142 INFO:tasks.workunit.client.1.smithi115.stdout:3/844: mkdir dc/d24/d33/dde/d120 0 2024-04-16T14:35:46.142 INFO:tasks.workunit.client.1.smithi115.stdout:3/845: dread - dc/d29/d4d/d56/d98/faf zero size 2024-04-16T14:35:46.145 INFO:tasks.workunit.client.0.smithi005.stdout:9/738: unlink d3/d12/d16/d46/d47/f92 0 2024-04-16T14:35:46.161 INFO:tasks.workunit.client.1.smithi115.stdout:3/846: rmdir dc/d24/d33/d4b/dd3 0 2024-04-16T14:35:46.162 INFO:tasks.workunit.client.1.smithi115.stdout:3/847: write dc/f21 [2162882,60949] 0 2024-04-16T14:35:46.162 INFO:tasks.workunit.client.1.smithi115.stdout:3/848: stat dc/f64 0 2024-04-16T14:35:46.186 INFO:tasks.workunit.client.1.smithi115.stdout:9/908: sync 2024-04-16T14:35:46.186 INFO:tasks.workunit.client.1.smithi115.stdout:8/848: sync 2024-04-16T14:35:46.188 INFO:tasks.workunit.client.1.smithi115.stdout:8/849: symlink d0/l118 0 2024-04-16T14:35:46.190 INFO:tasks.workunit.client.1.smithi115.stdout:3/849: dwrite dc/d24/fd2 [0,4194304] 0 2024-04-16T14:35:46.190 INFO:tasks.workunit.client.1.smithi115.stdout:3/850: truncate dc/d29/d4d/d56/d98/dbe/faa 570567 0 2024-04-16T14:35:46.190 INFO:tasks.workunit.client.1.smithi115.stdout:8/850: mkdir d0/db/dbb/dcd/dae/dde/de9/d119 0 2024-04-16T14:35:46.190 INFO:tasks.workunit.client.1.smithi115.stdout:8/851: chown d0/db/d10/c39 0 1 2024-04-16T14:35:46.191 INFO:tasks.workunit.client.1.smithi115.stdout:5/839: sync 2024-04-16T14:35:46.191 INFO:tasks.workunit.client.1.smithi115.stdout:6/825: sync 2024-04-16T14:35:46.191 INFO:tasks.workunit.client.1.smithi115.stdout:0/657: sync 2024-04-16T14:35:46.191 INFO:tasks.workunit.client.1.smithi115.stdout:4/785: sync 2024-04-16T14:35:46.191 INFO:tasks.workunit.client.1.smithi115.stdout:5/840: creat dc/d15/de6/fff x:0 0 0 2024-04-16T14:35:46.194 INFO:tasks.workunit.client.1.smithi115.stdout:6/826: rename d13/d1d/d49/f8d to d13/d1d/d87/f113 0 2024-04-16T14:35:46.194 INFO:tasks.workunit.client.1.smithi115.stdout:6/827: fdatasync d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/f10b 0 2024-04-16T14:35:46.194 INFO:tasks.workunit.client.1.smithi115.stdout:5/841: rmdir dc/d5d/dc2 39 2024-04-16T14:35:46.197 INFO:tasks.workunit.client.1.smithi115.stdout:0/658: rename d6/d10/d12/d1f/d36/d4b/d6d/d7a/l96 to d6/d10/dc8/le6 0 2024-04-16T14:35:46.198 INFO:tasks.workunit.client.1.smithi115.stdout:5/842: mknod dc/d5d/d81/d9a/da3/c100 0 2024-04-16T14:35:46.200 INFO:tasks.workunit.client.1.smithi115.stdout:5/843: mkdir dc/d15/d2d/d8c/d101 0 2024-04-16T14:35:46.200 INFO:tasks.workunit.client.1.smithi115.stdout:5/844: write dc/d8e/fab [802888,115130] 0 2024-04-16T14:35:46.200 INFO:tasks.workunit.client.1.smithi115.stdout:5/845: chown dc/d5d/d81/d9a/fb6 226955 1 2024-04-16T14:35:46.200 INFO:tasks.workunit.client.1.smithi115.stdout:5/846: chown dc/d5d/d81/d9a/fb6 1 1 2024-04-16T14:35:46.201 INFO:tasks.workunit.client.1.smithi115.stdout:5/847: stat dc/d15/d2d/cb5 0 2024-04-16T14:35:46.201 INFO:tasks.workunit.client.1.smithi115.stdout:5/848: chown dc/d3d/f5e 3027 1 2024-04-16T14:35:46.202 INFO:tasks.workunit.client.1.smithi115.stdout:9/909: dwrite d1/d6/d29/f10e [0,4194304] 0 2024-04-16T14:35:46.202 INFO:tasks.workunit.client.1.smithi115.stdout:9/910: chown d1/d6/d2d/d3d/fa5 20538 1 2024-04-16T14:35:46.202 INFO:tasks.workunit.client.1.smithi115.stdout:8/852: mknod d0/db/dbb/dcd/dae/dde/de9/d119/c11a 0 2024-04-16T14:35:46.203 INFO:tasks.workunit.client.1.smithi115.stdout:4/786: write d1/d15/d31/d42/f93 [3660090,94800] 0 2024-04-16T14:35:46.203 INFO:tasks.workunit.client.1.smithi115.stdout:4/787: creat d1/d15/d1e/ff2 x:0 0 0 2024-04-16T14:35:46.203 INFO:tasks.workunit.client.1.smithi115.stdout:5/849: getdents dc/d3d/d68 0 2024-04-16T14:35:46.205 INFO:tasks.workunit.client.1.smithi115.stdout:3/851: getdents dc/d29/d4d/d56/d98/dbe 0 2024-04-16T14:35:46.205 INFO:tasks.workunit.client.1.smithi115.stdout:3/852: dread - dc/d24/d33/d4b/da3/d69/fd5 zero size 2024-04-16T14:35:46.205 INFO:tasks.workunit.client.1.smithi115.stdout:3/853: creat dc/d29/d39/d86/dd0/dee/f121 x:0 0 0 2024-04-16T14:35:46.207 INFO:tasks.workunit.client.1.smithi115.stdout:4/788: symlink d1/d15/d17/lf3 0 2024-04-16T14:35:46.208 INFO:tasks.workunit.client.1.smithi115.stdout:0/659: dread d6/f25 [0,4194304] 0 2024-04-16T14:35:46.208 INFO:tasks.workunit.client.1.smithi115.stdout:0/660: truncate d6/d1b/f7d 578438 0 2024-04-16T14:35:46.209 INFO:tasks.workunit.client.1.smithi115.stdout:8/853: symlink d0/db/d10/d17/d2c/d52/d74/l11b 0 2024-04-16T14:35:46.210 INFO:tasks.workunit.client.1.smithi115.stdout:0/661: rename d6/f4f to d6/dac/fe7 0 2024-04-16T14:35:46.212 INFO:tasks.workunit.client.1.smithi115.stdout:0/662: unlink d6/d10/d12/d31/d35/c2d 0 2024-04-16T14:35:46.214 INFO:tasks.workunit.client.1.smithi115.stdout:3/854: creat dc/d24/d36/d60/f122 x:0 0 0 2024-04-16T14:35:46.214 INFO:tasks.workunit.client.1.smithi115.stdout:0/663: rename d6/d10/d12/d31/d35/d9b/c2e to d6/d10/d12/d1f/ce8 0 2024-04-16T14:35:46.215 INFO:tasks.workunit.client.1.smithi115.stdout:0/664: read d6/d10/d12/d1f/d36/d4b/d70/fa8 [30909,44809] 0 2024-04-16T14:35:46.215 INFO:tasks.workunit.client.1.smithi115.stdout:5/850: write dc/f34 [3941241,37149] 0 2024-04-16T14:35:46.217 INFO:tasks.workunit.client.1.smithi115.stdout:8/854: getdents d0/db/d10/d17/d2c/d85 0 2024-04-16T14:35:46.220 INFO:tasks.workunit.client.1.smithi115.stdout:6/828: dwrite d13/d1d/f5c [0,4194304] 0 2024-04-16T14:35:46.222 INFO:tasks.workunit.client.1.smithi115.stdout:4/789: write d1/d15/d17/f9f [1166922,55878] 0 2024-04-16T14:35:46.225 INFO:tasks.workunit.client.1.smithi115.stdout:3/855: symlink dc/d29/d39/l123 0 2024-04-16T14:35:46.226 INFO:tasks.workunit.client.1.smithi115.stdout:9/911: dwrite d1/d6/d2d/f1c [0,4194304] 0 2024-04-16T14:35:46.226 INFO:tasks.workunit.client.1.smithi115.stdout:5/851: dread dc/f11 [0,4194304] 0 2024-04-16T14:35:46.226 INFO:tasks.workunit.client.1.smithi115.stdout:4/790: dread d1/d15/d31/d42/d46/fc8 [0,4194304] 0 2024-04-16T14:35:46.226 INFO:tasks.workunit.client.1.smithi115.stdout:4/791: write d1/d15/d9c/faf [108338,79204] 0 2024-04-16T14:35:46.228 INFO:tasks.workunit.client.1.smithi115.stdout:4/792: rmdir d1/d15/d31 39 2024-04-16T14:35:46.228 INFO:tasks.workunit.client.1.smithi115.stdout:4/793: write d1/d2/fa0 [539346,73583] 0 2024-04-16T14:35:46.230 INFO:tasks.workunit.client.1.smithi115.stdout:3/856: rmdir dc/d24/d33/d4b/d81 39 2024-04-16T14:35:46.230 INFO:tasks.workunit.client.1.smithi115.stdout:9/912: creat d1/d6/d2d/d4b/d8f/d91/dda/ddd/f140 x:0 0 0 2024-04-16T14:35:46.232 INFO:tasks.workunit.client.1.smithi115.stdout:4/794: link d1/d15/d24/dc6/fe8 d1/d15/d31/d42/d46/ff4 0 2024-04-16T14:35:46.232 INFO:tasks.workunit.client.1.smithi115.stdout:4/795: chown d1/d15/d17/d9e/ddf 449964 1 2024-04-16T14:35:46.232 INFO:tasks.workunit.client.1.smithi115.stdout:9/913: mknod d1/d6/d2d/d3d/db7/d13b/c141 0 2024-04-16T14:35:46.233 INFO:tasks.workunit.client.1.smithi115.stdout:9/914: fdatasync d1/d6/d2d/d3d/d50/dab/fc8 0 2024-04-16T14:35:46.233 INFO:tasks.workunit.client.1.smithi115.stdout:9/915: fsync d1/d6/d2d/d4b/d6c/d20/fa6 0 2024-04-16T14:35:46.234 INFO:tasks.workunit.client.1.smithi115.stdout:9/916: symlink d1/l142 0 2024-04-16T14:35:46.235 INFO:tasks.workunit.client.1.smithi115.stdout:9/917: creat d1/d6/d2d/f143 x:0 0 0 2024-04-16T14:35:46.235 INFO:tasks.workunit.client.1.smithi115.stdout:9/918: getdents d1/d6/d2d/d4b/d8f/d91/dda/ddd/dfc/d120 0 2024-04-16T14:35:46.235 INFO:tasks.workunit.client.1.smithi115.stdout:9/919: creat d1/d6/d2d/d3d/d50/f144 x:0 0 0 2024-04-16T14:35:46.238 INFO:tasks.workunit.client.1.smithi115.stdout:6/829: write d13/d1d/d52/d8c/f98 [2936644,74026] 0 2024-04-16T14:35:46.238 INFO:tasks.workunit.client.1.smithi115.stdout:6/830: write d13/d1d/d2b/f10e [659781,104481] 0 2024-04-16T14:35:46.240 INFO:tasks.workunit.client.1.smithi115.stdout:5/852: read dc/d3d/f42 [3140224,33803] 0 2024-04-16T14:35:46.243 INFO:tasks.workunit.client.1.smithi115.stdout:5/853: link dc/d3d/f42 dc/d3d/d68/d7b/df7/f102 0 2024-04-16T14:35:46.243 INFO:tasks.workunit.client.0.smithi005.stdout:9/739: creat d3/d49/d4b/fd7 x:0 0 0 2024-04-16T14:35:46.245 INFO:tasks.workunit.client.0.smithi005.stdout:9/740: write d3/f81 [692779,48761] 0 2024-04-16T14:35:46.245 INFO:tasks.workunit.client.1.smithi115.stdout:4/796: dread d1/d2/f11 [0,4194304] 0 2024-04-16T14:35:46.246 INFO:tasks.workunit.client.1.smithi115.stdout:5/854: link dc/d5d/d81/d9a/da3/c100 dc/d5d/c103 0 2024-04-16T14:35:46.247 INFO:tasks.workunit.client.1.smithi115.stdout:5/855: fsync dc/d3d/d41/f95 0 2024-04-16T14:35:46.247 INFO:tasks.workunit.client.1.smithi115.stdout:8/855: dwrite d0/db/d10/d17/d2c/d52/d74/d3b/f54 [0,4194304] 0 2024-04-16T14:35:46.248 INFO:tasks.workunit.client.0.smithi005.stdout:9/741: read d3/d49/d91/fb0 [256942,27920] 0 2024-04-16T14:35:46.248 INFO:tasks.workunit.client.0.smithi005.stdout:9/742: write d3/d12/d16/d86/f87 [323895,11516] 0 2024-04-16T14:35:46.248 INFO:tasks.workunit.client.1.smithi115.stdout:4/797: link d1/d15/d31/d42/d46/fc8 d1/d15/d17/d9e/ddf/ff5 0 2024-04-16T14:35:46.256 INFO:tasks.workunit.client.1.smithi115.stdout:9/920: dread d1/d6/d2d/d4b/d6c/d20/d36/f52 [0,4194304] 0 2024-04-16T14:35:46.257 INFO:tasks.workunit.client.1.smithi115.stdout:4/798: dread d1/d15/d31/d42/d8b/f9b [0,4194304] 0 2024-04-16T14:35:46.257 INFO:tasks.workunit.client.1.smithi115.stdout:0/665: dwrite d6/d10/d12/d31/d35/d44/f6f [0,4194304] 0 2024-04-16T14:35:46.257 INFO:tasks.workunit.client.1.smithi115.stdout:4/799: stat d1/d15/f8e 0 2024-04-16T14:35:46.258 INFO:tasks.workunit.client.1.smithi115.stdout:0/666: chown d6/d10/d12/d31/d35/f59 28 1 2024-04-16T14:35:46.259 INFO:tasks.workunit.client.1.smithi115.stdout:9/921: mknod d1/d6/d2d/d3d/d49/d98/daa/c145 0 2024-04-16T14:35:46.259 INFO:tasks.workunit.client.1.smithi115.stdout:9/922: truncate d1/d6/d2d/d3d/f139 543167 0 2024-04-16T14:35:46.261 INFO:tasks.workunit.client.1.smithi115.stdout:0/667: creat d6/d1b/d4e/fe9 x:0 0 0 2024-04-16T14:35:46.267 INFO:tasks.workunit.client.1.smithi115.stdout:7/725: sync 2024-04-16T14:35:46.267 INFO:tasks.workunit.client.1.smithi115.stdout:7/726: truncate d0/d24/da3/db1/d3f/db0/f5f 4531323 0 2024-04-16T14:35:46.267 INFO:tasks.workunit.client.1.smithi115.stdout:3/857: dwrite dc/f15 [0,4194304] 0 2024-04-16T14:35:46.270 INFO:tasks.workunit.client.1.smithi115.stdout:2/942: sync 2024-04-16T14:35:46.273 INFO:tasks.workunit.client.1.smithi115.stdout:0/668: creat d6/d10/d12/d1f/d36/d4b/d6d/fea x:0 0 0 2024-04-16T14:35:46.273 INFO:tasks.workunit.client.1.smithi115.stdout:0/669: readlink d6/l46 0 2024-04-16T14:35:46.275 INFO:tasks.workunit.client.1.smithi115.stdout:7/727: rename d0/d24/f37 to d0/d2/d3a/d73/ff3 0 2024-04-16T14:35:46.276 INFO:tasks.workunit.client.1.smithi115.stdout:0/670: creat d6/d10/d12/d31/feb x:0 0 0 2024-04-16T14:35:46.278 INFO:tasks.workunit.client.1.smithi115.stdout:7/728: unlink d0/l12 0 2024-04-16T14:35:46.278 INFO:tasks.workunit.client.1.smithi115.stdout:7/729: fdatasync d0/fe 0 2024-04-16T14:35:46.278 INFO:tasks.workunit.client.1.smithi115.stdout:3/858: dread dc/d24/d33/d4b/da3/f9f [0,4194304] 0 2024-04-16T14:35:46.280 INFO:tasks.workunit.client.1.smithi115.stdout:7/730: rename d0/d24/da3/db1/d49/d5d to d0/d24/d40/df4 0 2024-04-16T14:35:46.285 INFO:tasks.workunit.client.1.smithi115.stdout:2/943: dread d0/f2d [0,4194304] 0 2024-04-16T14:35:46.285 INFO:tasks.workunit.client.1.smithi115.stdout:2/944: fsync d0/d47/d65/d61/d70/f91 0 2024-04-16T14:35:46.285 INFO:tasks.workunit.client.1.smithi115.stdout:2/945: readlink d0/d47/d65/dad/dc8/d24/d23/d80/ldc 0 2024-04-16T14:35:46.287 INFO:tasks.workunit.client.1.smithi115.stdout:6/831: dwrite f0 [0,4194304] 0 2024-04-16T14:35:46.289 INFO:tasks.workunit.client.1.smithi115.stdout:6/832: mkdir d13/d1d/d2b/df4/d112/d114 0 2024-04-16T14:35:46.290 INFO:tasks.workunit.client.1.smithi115.stdout:6/833: mknod d13/d1d/d2b/d5f/d30/c115 0 2024-04-16T14:35:46.295 INFO:tasks.workunit.client.1.smithi115.stdout:8/856: dwrite d0/db/d10/d17/d22/f32 [0,4194304] 0 2024-04-16T14:35:46.297 INFO:tasks.workunit.client.1.smithi115.stdout:3/859: dwrite dc/f18 [0,4194304] 0 2024-04-16T14:35:46.299 INFO:tasks.workunit.client.1.smithi115.stdout:8/857: mknod d0/db/d10/d17/d2c/d52/d74/d3b/d56/dfc/c11c 0 2024-04-16T14:35:46.301 INFO:tasks.workunit.client.1.smithi115.stdout:4/800: dwrite d1/d15/f8e [0,4194304] 0 2024-04-16T14:35:46.301 INFO:tasks.workunit.client.0.smithi005.stdout:9/743: dwrite d3/d12/d16/d86/f8c [4194304,4194304] 0 2024-04-16T14:35:46.302 INFO:tasks.workunit.client.1.smithi115.stdout:8/858: link d0/db/d10/d17/d2c/d52/d74/ca6 d0/da5/c11d 0 2024-04-16T14:35:46.302 INFO:tasks.workunit.client.1.smithi115.stdout:8/859: write d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/da4/fd2 [967619,59956] 0 2024-04-16T14:35:46.302 INFO:tasks.workunit.client.1.smithi115.stdout:9/923: dwrite d1/f86 [0,4194304] 0 2024-04-16T14:35:46.307 INFO:tasks.workunit.client.1.smithi115.stdout:8/860: truncate d0/db/f15 2856027 0 2024-04-16T14:35:46.310 INFO:tasks.workunit.client.1.smithi115.stdout:2/946: dwrite d0/d47/d65/dad/f56 [0,4194304] 0 2024-04-16T14:35:46.310 INFO:tasks.workunit.client.1.smithi115.stdout:2/947: fdatasync d0/d47/d65/dad/dc8/d24/da0/fd9 0 2024-04-16T14:35:46.310 INFO:tasks.workunit.client.1.smithi115.stdout:9/924: getdents d1/d6/d2d/d4b/d6c/d20/d36/dce 0 2024-04-16T14:35:46.311 INFO:tasks.workunit.client.0.smithi005.stdout:9/744: mknod d3/d12/d16/dc6/cd8 0 2024-04-16T14:35:46.311 INFO:tasks.workunit.client.1.smithi115.stdout:8/861: getdents d0/db/d10/d17/d2c/d52/d6c/db8/d7d/de2/d111/d89 0 2024-04-16T14:35:46.312 INFO:tasks.workunit.client.0.smithi005.stdout:9/745: creat d3/d12/d16/d86/dd6/fd9 x:0 0 0 2024-04-16T14:35:46.314 INFO:tasks.workunit.client.1.smithi115.stdout:4/801: dread d1/d15/d1e/f23 [0,4194304] 0 2024-04-16T14:35:46.315 INFO:tasks.workunit.client.1.smithi115.stdout:7/731: dwrite d0/d2/d3a/d30/d79/fc4 [0,4194304] 0 2024-04-16T14:35:46.315 INFO:tasks.workunit.client.1.smithi115.stdout:9/925: mknod d1/d6/d2d/d4b/d60/d65/c146 0 2024-04-16T14:35:46.317 INFO:tasks.workunit.client.1.smithi115.stdout:2/948: getdents d0/d47/d65/dad/dc8/d57 0 2024-04-16T14:35:46.319 INFO:tasks.workunit.client.1.smithi115.stdout:3/860: dwrite dc/d24/d33/d4b/da3/d69/de1/ff1 [0,4194304] 0 2024-04-16T14:35:46.319 INFO:tasks.workunit.client.1.smithi115.stdout:3/861: stat dc/d29/f7f 0 2024-04-16T14:35:46.319 INFO:tasks.workunit.client.1.smithi115.stdout:3/862: truncate dc/d29/d77/fdc 290564 0 2024-04-16T14:35:46.322 INFO:tasks.workunit.client.1.smithi115.stdout:7/732: unlink d0/d24/da3/db1/d49/c5b 0 2024-04-16T14:35:46.322 INFO:tasks.workunit.client.1.smithi115.stdout:7/733: dread - d0/fc3 zero size 2024-04-16T14:35:46.322 INFO:tasks.workunit.client.1.smithi115.stdout:7/734: creat d0/d2/d3a/ff5 x:0 0 0 2024-04-16T14:35:46.323 INFO:tasks.workunit.client.0.smithi005.stdout:9/746: write d3/d49/d4b/fa4 [1238742,31382] 0 2024-04-16T14:35:46.323 INFO:tasks.workunit.client.0.smithi005.stdout:9/747: readlink d3/d49/d4b/l7f 0 2024-04-16T14:35:46.323 INFO:tasks.workunit.client.1.smithi115.stdout:9/926: mknod d1/d6/d2d/d4b/c147 0 2024-04-16T14:35:46.324 INFO:tasks.workunit.client.0.smithi005.stdout:9/748: creat d3/d49/d4b/d5c/d65/d9a/da9/fda x:0 0 0 2024-04-16T14:35:46.325 INFO:tasks.workunit.client.0.smithi005.stdout:9/749: truncate d3/d12/d16/d46/d47/d60/f75 815101 0 2024-04-16T14:35:46.325 INFO:tasks.workunit.client.1.smithi115.stdout:6/834: dwrite d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/d5a/fea [0,4194304] 0 2024-04-16T14:35:46.325 INFO:tasks.workunit.client.1.smithi115.stdout:8/862: dread d0/db/d10/d17/d22/deb/d7c/f10e [0,4194304] 0 2024-04-16T14:35:46.326 INFO:tasks.workunit.client.1.smithi115.stdout:8/863: chown d0/db/d10/d17/d2c/d52/l95 2142324 1 2024-04-16T14:35:46.326 INFO:tasks.workunit.client.1.smithi115.stdout:8/864: write d0/db/d10/d17/f7b [1720780,57862] 0 2024-04-16T14:35:46.326 INFO:tasks.workunit.client.0.smithi005.stdout:9/750: creat d3/d12/d16/d86/fdb x:0 0 0 2024-04-16T14:35:46.328 INFO:tasks.workunit.client.0.smithi005.stdout:9/751: getdents d3/d49/d4b/d55 0 2024-04-16T14:35:46.328 INFO:tasks.workunit.client.0.smithi005.stdout:9/752: write d3/d12/d16/d86/f87 [1034841,103607] 0 2024-04-16T14:35:46.328 INFO:tasks.workunit.client.1.smithi115.stdout:2/949: write d0/d47/d65/dad/f3f [1224386,94182] 0 2024-04-16T14:35:46.329 INFO:tasks.workunit.client.0.smithi005.stdout:9/753: creat d3/d49/d4b/d55/fdc x:0 0 0 2024-04-16T14:35:46.329 INFO:tasks.workunit.client.0.smithi005.stdout:9/754: write d3/d12/f28 [3396152,104471] 0 2024-04-16T14:35:46.330 INFO:tasks.workunit.client.0.smithi005.stdout:9/755: rename d3/l29 to d3/d49/ldd 0 2024-04-16T14:35:46.332 INFO:tasks.workunit.client.0.smithi005.stdout:0/836: sync 2024-04-16T14:35:46.332 INFO:tasks.workunit.client.0.smithi005.stdout:2/796: sync 2024-04-16T14:35:46.332 INFO:tasks.workunit.client.0.smithi005.stdout:8/869: sync 2024-04-16T14:35:46.332 INFO:tasks.workunit.client.0.smithi005.stdout:0/837: chown da/df/d26/da9/dcb/dd8/fe1 6355298 1 2024-04-16T14:35:46.332 INFO:tasks.workunit.client.0.smithi005.stdout:9/756: fdatasync d3/d49/d4b/d55/f5d 0 2024-04-16T14:35:46.332 INFO:tasks.workunit.client.1.smithi115.stdout:4/802: link d1/l69 d1/d15/lf6 0 2024-04-16T14:35:46.335 INFO:tasks.workunit.client.1.smithi115.stdout:3/863: dread dc/d24/f6f [0,4194304] 0 2024-04-16T14:35:46.335 INFO:tasks.workunit.client.1.smithi115.stdout:3/864: fdatasync dc/ffd 0 2024-04-16T14:35:46.335 INFO:tasks.workunit.client.0.smithi005.stdout:8/870: mknod d5/d40/c130 0 2024-04-16T14:35:46.336 INFO:tasks.workunit.client.1.smithi115.stdout:7/735: link d0/d2/d3a/dac/da7/fe0 d0/d24/da3/db1/d3f/db0/ff6 0 2024-04-16T14:35:46.336 INFO:tasks.workunit.client.1.smithi115.stdout:7/736: chown d0/d2/d3a/d30/d79/dd2/d64/c78 7 1 2024-04-16T14:35:46.336 INFO:tasks.workunit.client.1.smithi115.stdout:8/865: rmdir d0/db/d10/d17/d2c/d52/d84 39 2024-04-16T14:35:46.336 INFO:tasks.workunit.client.1.smithi115.stdout:8/866: fsync d0/db/dbb/dcd/dae/ff8 0 2024-04-16T14:35:46.337 INFO:tasks.workunit.client.1.smithi115.stdout:9/927: mkdir d1/d6/db8/d148 0 2024-04-16T14:35:46.338 INFO:tasks.workunit.client.0.smithi005.stdout:0/838: creat da/df/d26/f11f x:0 0 0 2024-04-16T14:35:46.339 INFO:tasks.workunit.client.0.smithi005.stdout:9/757: write d3/d49/d4b/d55/f57 [8793432,86158] 0 2024-04-16T14:35:46.340 INFO:tasks.workunit.client.1.smithi115.stdout:3/865: truncate dc/d24/d33/d4b/f55 1491926 0 2024-04-16T14:35:46.341 INFO:tasks.workunit.client.0.smithi005.stdout:2/797: rmdir d0/d1c/d39/d48 39 2024-04-16T14:35:46.343 INFO:tasks.workunit.client.1.smithi115.stdout:4/803: link d1/d15/d31/f4b d1/d15/d31/d42/da4/dc0/ff7 0 2024-04-16T14:35:46.343 INFO:tasks.workunit.client.1.smithi115.stdout:4/804: stat d1/d15/d31/d42/d46/l6a 0 2024-04-16T14:35:46.343 INFO:tasks.workunit.client.1.smithi115.stdout:4/805: write d1/d15/d31/f99 [874706,92623] 0 2024-04-16T14:35:46.343 INFO:tasks.workunit.client.1.smithi115.stdout:8/867: creat d0/db/d10/d17/d2c/d52/d74/d3b/d56/f11e x:0 0 0 2024-04-16T14:35:46.343 INFO:tasks.workunit.client.1.smithi115.stdout:8/868: truncate d0/db/d10/d17/d2c/d52/d74/d3b/d56/dfc/f100 800972 0 2024-04-16T14:35:46.344 INFO:tasks.workunit.client.0.smithi005.stdout:8/871: creat d5/d7b/da8/da5/f131 x:0 0 0 2024-04-16T14:35:46.345 INFO:tasks.workunit.client.1.smithi115.stdout:9/928: rename d1/d6/d2d/d4b/d6c/d20/d36/l116 to d1/d6/d2d/d3d/d13a/d13e/l149 0 2024-04-16T14:35:46.345 INFO:tasks.workunit.client.1.smithi115.stdout:9/929: creat d1/d6/d2d/d4b/f14a x:0 0 0 2024-04-16T14:35:46.345 INFO:tasks.workunit.client.1.smithi115.stdout:1/946: sync 2024-04-16T14:35:46.345 INFO:tasks.workunit.client.0.smithi005.stdout:9/758: creat d3/d12/d16/dc6/fde x:0 0 0 2024-04-16T14:35:46.345 INFO:tasks.workunit.client.0.smithi005.stdout:9/759: write d3/d77/f82 [328672,90372] 0 2024-04-16T14:35:46.346 INFO:tasks.workunit.client.1.smithi115.stdout:2/950: dwrite d0/d47/d65/dad/dc8/d24/d23/f8d [0,4194304] 0 2024-04-16T14:35:46.348 INFO:tasks.workunit.client.1.smithi115.stdout:8/869: truncate d0/db/d10/d17/d2c/d52/d6c/db8/d7d/de2/d111/f68 376239 0 2024-04-16T14:35:46.348 INFO:tasks.workunit.client.1.smithi115.stdout:8/870: fdatasync d0/f53 0 2024-04-16T14:35:46.348 INFO:tasks.workunit.client.0.smithi005.stdout:9/760: symlink d3/d49/d4b/d5c/d65/ldf 0 2024-04-16T14:35:46.348 INFO:tasks.workunit.client.0.smithi005.stdout:9/761: fsync d3/d49/d4b/d5c/fb8 0 2024-04-16T14:35:46.349 INFO:tasks.workunit.client.1.smithi115.stdout:7/737: write d0/d2/d3a/d30/d79/d95/fa0 [3030948,74528] 0 2024-04-16T14:35:46.350 INFO:tasks.workunit.client.1.smithi115.stdout:4/806: rename d1/f22 to d1/d15/d24/ff8 0 2024-04-16T14:35:46.352 INFO:tasks.workunit.client.1.smithi115.stdout:3/866: dread dc/d24/f49 [0,4194304] 0 2024-04-16T14:35:46.352 INFO:tasks.workunit.client.0.smithi005.stdout:8/872: mkdir d5/d7b/da8/db7/d132 0 2024-04-16T14:35:46.353 INFO:tasks.workunit.client.0.smithi005.stdout:9/762: mkdir d3/d49/d4b/d5c/d65/d9a/daf/de0 0 2024-04-16T14:35:46.354 INFO:tasks.workunit.client.1.smithi115.stdout:9/930: chown d1/d6/d2d/d4b/d8f/lc5 52923026 1 2024-04-16T14:35:46.356 INFO:tasks.workunit.client.1.smithi115.stdout:3/867: mkdir dc/d24/d80/dfc/d11a/d124 0 2024-04-16T14:35:46.356 INFO:tasks.workunit.client.1.smithi115.stdout:3/868: readlink dc/d29/l2f 0 2024-04-16T14:35:46.356 INFO:tasks.workunit.client.1.smithi115.stdout:3/869: write dc/d24/d33/d4b/f4c [2803996,45179] 0 2024-04-16T14:35:46.356 INFO:tasks.workunit.client.0.smithi005.stdout:8/873: mknod d5/da0/c133 0 2024-04-16T14:35:46.358 INFO:tasks.workunit.client.1.smithi115.stdout:1/947: mkdir df/d13/d4d/d3e/d75/da9/d13e/d144 0 2024-04-16T14:35:46.358 INFO:tasks.workunit.client.1.smithi115.stdout:1/948: chown df/d35/d48/c4b 0 1 2024-04-16T14:35:46.358 INFO:tasks.workunit.client.1.smithi115.stdout:1/949: read - df/d13/d4d/d68/de7/f134 zero size 2024-04-16T14:35:46.360 INFO:tasks.workunit.client.1.smithi115.stdout:3/870: mkdir dc/d29/d4d/d56/d7e/d11b/d125 0 2024-04-16T14:35:46.362 INFO:tasks.workunit.client.1.smithi115.stdout:7/738: write d0/d24/da3/db1/d49/f91 [2024017,27562] 0 2024-04-16T14:35:46.362 INFO:tasks.workunit.client.1.smithi115.stdout:7/739: write d0/d2/d3a/d73/fad [445624,66875] 0 2024-04-16T14:35:46.364 INFO:tasks.workunit.client.1.smithi115.stdout:2/951: mkdir d0/d47/d65/dad/dbb/d11/d6d/d138 0 2024-04-16T14:35:46.365 INFO:tasks.workunit.client.0.smithi005.stdout:8/874: write d5/d7b/da8/db7/d74/feb [4189681,38207] 0 2024-04-16T14:35:46.365 INFO:tasks.workunit.client.0.smithi005.stdout:8/875: stat d5/d7b/da8/da5/def/d71/ce8 0 2024-04-16T14:35:46.365 INFO:tasks.workunit.client.0.smithi005.stdout:8/876: dread - d5/d7b/da8/da5/ff7 zero size 2024-04-16T14:35:46.367 INFO:tasks.workunit.client.1.smithi115.stdout:4/807: mknod d1/cf9 0 2024-04-16T14:35:46.368 INFO:tasks.workunit.client.1.smithi115.stdout:1/950: creat df/d13/d4d/d3e/d75/da9/f145 x:0 0 0 2024-04-16T14:35:46.368 INFO:tasks.workunit.client.0.smithi005.stdout:8/877: creat d5/d7b/da8/db7/d8a/da1/d68/dcb/f134 x:0 0 0 2024-04-16T14:35:46.372 INFO:tasks.workunit.client.1.smithi115.stdout:7/740: mknod d0/d24/da3/ded/cf7 0 2024-04-16T14:35:46.373 INFO:tasks.workunit.client.1.smithi115.stdout:3/871: write dc/d29/f7f [2744325,104937] 0 2024-04-16T14:35:46.375 INFO:tasks.workunit.client.1.smithi115.stdout:2/952: symlink d0/d47/d65/dad/l139 0 2024-04-16T14:35:46.375 INFO:tasks.workunit.client.1.smithi115.stdout:3/872: readlink dc/d29/d39/l75 0 2024-04-16T14:35:46.375 INFO:tasks.workunit.client.1.smithi115.stdout:3/873: truncate dc/f18 4875872 0 2024-04-16T14:35:46.378 INFO:tasks.workunit.client.1.smithi115.stdout:1/951: creat df/d13/d4d/d2c/f146 x:0 0 0 2024-04-16T14:35:46.379 INFO:tasks.workunit.client.1.smithi115.stdout:7/741: link d0/d2/d3a/l4e d0/d2/d3a/d30/d79/dd2/d64/de8/lf8 0 2024-04-16T14:35:46.381 INFO:tasks.workunit.client.1.smithi115.stdout:2/953: rename d0/d47/d65/dad/dbb/d11/d6d/fbd to d0/d47/d65/dad/f13a 0 2024-04-16T14:35:46.382 INFO:tasks.workunit.client.1.smithi115.stdout:4/808: getdents d1/d15/d9c 0 2024-04-16T14:35:46.382 INFO:tasks.workunit.client.1.smithi115.stdout:4/809: fsync d1/d15/f77 0 2024-04-16T14:35:46.382 INFO:tasks.workunit.client.1.smithi115.stdout:4/810: truncate d1/d15/d31/d42/da4/fdc 1012386 0 2024-04-16T14:35:46.382 INFO:tasks.workunit.client.1.smithi115.stdout:4/811: chown d1/d15/d1e 23 1 2024-04-16T14:35:46.383 INFO:tasks.workunit.client.1.smithi115.stdout:8/871: dwrite d0/db/d10/d17/d2c/d52/d74/f45 [0,4194304] 0 2024-04-16T14:35:46.383 INFO:tasks.workunit.client.1.smithi115.stdout:1/952: mknod df/d36/dff/c147 0 2024-04-16T14:35:46.385 INFO:tasks.workunit.client.1.smithi115.stdout:8/872: symlink d0/db/dbb/dcd/dc4/l11f 0 2024-04-16T14:35:46.385 INFO:tasks.workunit.client.1.smithi115.stdout:8/873: write d0/db/d10/d17/d2c/d52/d6c/db8/d6b/ff4 [697189,21063] 0 2024-04-16T14:35:46.386 INFO:tasks.workunit.client.1.smithi115.stdout:7/742: link d0/d2/d3a/d30/d79/d95/c9f d0/d2/d3a/d30/d6b/da2/d81/cf9 0 2024-04-16T14:35:46.386 INFO:tasks.workunit.client.1.smithi115.stdout:7/743: creat d0/ffa x:0 0 0 2024-04-16T14:35:46.386 INFO:tasks.workunit.client.1.smithi115.stdout:7/744: fsync d0/d2/d3a/d30/f32 0 2024-04-16T14:35:46.386 INFO:tasks.workunit.client.1.smithi115.stdout:8/874: mknod d0/dc8/c120 0 2024-04-16T14:35:46.387 INFO:tasks.workunit.client.1.smithi115.stdout:4/812: mknod d1/d15/d31/d42/d8b/dcc/dee/cfa 0 2024-04-16T14:35:46.388 INFO:tasks.workunit.client.1.smithi115.stdout:8/875: mknod d0/c121 0 2024-04-16T14:35:46.388 INFO:tasks.workunit.client.0.smithi005.stdout:8/878: dwrite d5/d7b/da8/db7/d8a/da1/d3d/f3f [0,4194304] 0 2024-04-16T14:35:46.394 INFO:tasks.workunit.client.1.smithi115.stdout:4/813: mknod d1/d15/d31/d42/d46/cfb 0 2024-04-16T14:35:46.394 INFO:tasks.workunit.client.1.smithi115.stdout:9/931: dwrite d1/d6/d2d/d4b/d60/df0/f13d [0,4194304] 0 2024-04-16T14:35:46.394 INFO:tasks.workunit.client.1.smithi115.stdout:9/932: fdatasync d1/d6/d2d/d3d/db7/fca 0 2024-04-16T14:35:46.394 INFO:tasks.workunit.client.1.smithi115.stdout:9/933: truncate d1/d6/d29/fe9 675763 0 2024-04-16T14:35:46.394 INFO:tasks.workunit.client.1.smithi115.stdout:9/934: fsync d1/d6/d2d/d3d/fa5 0 2024-04-16T14:35:46.394 INFO:tasks.workunit.client.1.smithi115.stdout:8/876: read d0/db/d10/d17/d2c/d52/d6c/db8/d7d/de2/d111/d83/fff [186939,87488] 0 2024-04-16T14:35:46.394 INFO:tasks.workunit.client.1.smithi115.stdout:8/877: fdatasync d0/db/f26 0 2024-04-16T14:35:46.395 INFO:tasks.workunit.client.0.smithi005.stdout:9/763: dwrite d3/d49/d4b/d5c/fb8 [0,4194304] 0 2024-04-16T14:35:46.395 INFO:tasks.workunit.client.0.smithi005.stdout:2/798: dwrite d0/d2a/d3a/d46/f4b [0,4194304] 0 2024-04-16T14:35:46.395 INFO:tasks.workunit.client.0.smithi005.stdout:2/799: read d0/d4/d2b/f1a [1971248,21075] 0 2024-04-16T14:35:46.396 INFO:tasks.workunit.client.1.smithi115.stdout:8/878: rename d0/l5c to d0/db/d10/d17/d2c/d52/d74/l122 0 2024-04-16T14:35:46.396 INFO:tasks.workunit.client.1.smithi115.stdout:8/879: chown d0/db/d10/d17/d22/deb/l65 8 1 2024-04-16T14:35:46.398 INFO:tasks.workunit.client.1.smithi115.stdout:7/745: dread d0/d2/d3a/d30/f98 [0,4194304] 0 2024-04-16T14:35:46.398 INFO:tasks.workunit.client.0.smithi005.stdout:8/879: rename d5/d7b/da8/db7/d8a/da1/d3d to d5/d55/d5a/d135 0 2024-04-16T14:35:46.401 INFO:tasks.workunit.client.1.smithi115.stdout:8/880: symlink d0/db/d10/d17/d2c/d52/d6c/db8/l123 0 2024-04-16T14:35:46.403 INFO:tasks.workunit.client.1.smithi115.stdout:7/746: creat d0/d2/d3a/d30/d79/dd2/ffb x:0 0 0 2024-04-16T14:35:46.403 INFO:tasks.workunit.client.1.smithi115.stdout:7/747: creat d0/d2/d3a/d30/d6b/ffc x:0 0 0 2024-04-16T14:35:46.406 INFO:tasks.workunit.client.1.smithi115.stdout:8/881: symlink d0/db/d10/d17/d2c/d52/d74/d73/l124 0 2024-04-16T14:35:46.406 INFO:tasks.workunit.client.1.smithi115.stdout:8/882: chown d0/db/d10/d17/d2c/d52/d6c/db8/d7d/de2 1057731507 1 2024-04-16T14:35:46.406 INFO:tasks.workunit.client.1.smithi115.stdout:1/953: dwrite df/d13/d4d/d6d/dc5/f105 [0,4194304] 0 2024-04-16T14:35:46.408 INFO:tasks.workunit.client.0.smithi005.stdout:9/764: dread - d3/d49/d4b/d55/f96 zero size 2024-04-16T14:35:46.408 INFO:tasks.workunit.client.0.smithi005.stdout:9/765: truncate d3/d77/f82 547970 0 2024-04-16T14:35:46.409 INFO:tasks.workunit.client.0.smithi005.stdout:2/800: creat d0/d1c/d59/d67/f107 x:0 0 0 2024-04-16T14:35:46.409 INFO:tasks.workunit.client.0.smithi005.stdout:2/801: chown d0/d29/d3e/dd2/ff3 381 1 2024-04-16T14:35:46.412 INFO:tasks.workunit.client.1.smithi115.stdout:8/883: mknod d0/db/d10/d17/d2c/c125 0 2024-04-16T14:35:46.412 INFO:tasks.workunit.client.1.smithi115.stdout:8/884: write d0/db/d10/d17/d2c/d52/d6c/db8/d7d/de2/d111/d83/da2/fd1 [876692,126022] 0 2024-04-16T14:35:46.415 INFO:tasks.workunit.client.1.smithi115.stdout:4/814: dwrite d1/d15/d17/f8a [0,4194304] 0 2024-04-16T14:35:46.425 INFO:tasks.workunit.client.1.smithi115.stdout:8/885: write d0/db/d10/d17/d2c/d52/d74/f45 [3480763,92509] 0 2024-04-16T14:35:46.426 INFO:tasks.workunit.client.1.smithi115.stdout:4/815: dread d1/d15/d31/d42/d46/f63 [0,4194304] 0 2024-04-16T14:35:46.436 INFO:tasks.workunit.client.1.smithi115.stdout:9/935: dwrite d1/d6/d2d/d4b/d6c/fae [0,4194304] 0 2024-04-16T14:35:46.442 INFO:tasks.workunit.client.1.smithi115.stdout:3/874: dwrite dc/d24/d33/d4b/f4c [0,4194304] 0 2024-04-16T14:35:46.442 INFO:tasks.workunit.client.1.smithi115.stdout:3/875: write dc/d29/d4d/d56/d7e/f111 [863139,105682] 0 2024-04-16T14:35:46.443 INFO:tasks.workunit.client.0.smithi005.stdout:9/766: dwrite d3/d49/f66 [0,4194304] 0 2024-04-16T14:35:46.443 INFO:tasks.workunit.client.0.smithi005.stdout:2/802: dwrite d0/d2a/fa8 [0,4194304] 0 2024-04-16T14:35:46.444 INFO:tasks.workunit.client.0.smithi005.stdout:2/803: write d0/d1c/d59/d67/fce [670232,9274] 0 2024-04-16T14:35:46.444 INFO:tasks.workunit.client.0.smithi005.stdout:9/767: symlink d3/d12/d16/le1 0 2024-04-16T14:35:46.445 INFO:tasks.workunit.client.0.smithi005.stdout:2/804: mknod d0/d1c/c108 0 2024-04-16T14:35:46.445 INFO:tasks.workunit.client.0.smithi005.stdout:9/768: symlink d3/d49/d4b/le2 0 2024-04-16T14:35:46.446 INFO:tasks.workunit.client.0.smithi005.stdout:2/805: link d0/d2a/c36 d0/d4/d2b/d5e/c109 0 2024-04-16T14:35:46.447 INFO:tasks.workunit.client.0.smithi005.stdout:9/769: readlink d3/d49/d4b/d55/lb3 0 2024-04-16T14:35:46.475 INFO:tasks.workunit.client.1.smithi115.stdout:3/876: dwrite dc/d24/d80/fa8 [0,4194304] 0 2024-04-16T14:35:46.475 INFO:tasks.workunit.client.1.smithi115.stdout:3/877: stat dc/d29/d39/d106/lf9 0 2024-04-16T14:35:46.475 INFO:tasks.workunit.client.0.smithi005.stdout:9/770: dwrite d3/d77/f8f [0,4194304] 0 2024-04-16T14:35:46.475 INFO:tasks.workunit.client.0.smithi005.stdout:9/771: write d3/f81 [122860,58965] 0 2024-04-16T14:35:46.476 INFO:tasks.workunit.client.1.smithi115.stdout:7/748: mkdir d0/d24/da3/db1/d49/dfd 0 2024-04-16T14:35:46.476 INFO:tasks.workunit.client.0.smithi005.stdout:9/772: rmdir d3/d49/d4b/d5c 39 2024-04-16T14:35:46.481 INFO:tasks.workunit.client.1.smithi115.stdout:1/954: symlink df/d13/d4d/d68/de7/dbe/l148 0 2024-04-16T14:35:46.481 INFO:tasks.workunit.client.1.smithi115.stdout:1/955: write df/d13/d4d/d3e/d75/dda/f85 [198849,128777] 0 2024-04-16T14:35:46.482 INFO:tasks.workunit.client.1.smithi115.stdout:3/878: read dc/d29/d4d/d56/f9b [3823365,62625] 0 2024-04-16T14:35:46.483 INFO:tasks.workunit.client.0.smithi005.stdout:9/773: write d3/d49/f66 [1232092,120949] 0 2024-04-16T14:35:46.486 INFO:tasks.workunit.client.1.smithi115.stdout:4/816: mkdir d1/d15/d31/dc2/de4/de7/dfc 0 2024-04-16T14:35:46.491 INFO:tasks.workunit.client.1.smithi115.stdout:9/936: mknod d1/d6/d2d/d3d/db7/d13b/c14b 0 2024-04-16T14:35:46.491 INFO:tasks.workunit.client.1.smithi115.stdout:1/956: read df/d36/d94/f13d [3499282,14257] 0 2024-04-16T14:35:46.493 INFO:tasks.workunit.client.1.smithi115.stdout:1/957: dread df/d13/d4d/d68/de7/fe4 [0,4194304] 0 2024-04-16T14:35:46.496 INFO:tasks.workunit.client.1.smithi115.stdout:7/749: creat d0/d24/da3/ffe x:0 0 0 2024-04-16T14:35:46.498 INFO:tasks.workunit.client.1.smithi115.stdout:4/817: link d1/d15/d31/d42/d46/f8c d1/d15/d17/d9e/dbe/ffd 0 2024-04-16T14:35:46.500 INFO:tasks.workunit.client.1.smithi115.stdout:9/937: creat d1/d6/d2d/f14c x:0 0 0 2024-04-16T14:35:46.500 INFO:tasks.workunit.client.1.smithi115.stdout:9/938: write d1/d6/d2d/d4b/d60/d65/fc1 [1452300,27078] 0 2024-04-16T14:35:46.500 INFO:tasks.workunit.client.1.smithi115.stdout:9/939: chown d1/d6/d2d/d3d/d50/f10c 1111 1 2024-04-16T14:35:46.501 INFO:tasks.workunit.client.0.smithi005.stdout:9/774: dwrite d3/d49/d4b/d5c/d65/f8d [0,4194304] 0 2024-04-16T14:35:46.501 INFO:tasks.workunit.client.0.smithi005.stdout:9/775: write d3/d77/f88 [1747388,70273] 0 2024-04-16T14:35:46.501 INFO:tasks.workunit.client.1.smithi115.stdout:1/958: rename df/d35/c5d to df/d13/d125/c149 0 2024-04-16T14:35:46.503 INFO:tasks.workunit.client.1.smithi115.stdout:9/940: creat d1/d6/d2d/d4b/d8f/d91/dda/ddd/de8/dfe/f14d x:0 0 0 2024-04-16T14:35:46.504 INFO:tasks.workunit.client.1.smithi115.stdout:9/941: fsync d1/d6/d2d/d4b/d8f/d91/dd1/dd2/f10b 0 2024-04-16T14:35:46.504 INFO:tasks.workunit.client.1.smithi115.stdout:9/942: chown d1/d6/d2d/d3d/d49/d98/led 0 1 2024-04-16T14:35:46.505 INFO:tasks.workunit.client.1.smithi115.stdout:9/943: symlink d1/d6/d2d/d4b/d6c/l14e 0 2024-04-16T14:35:46.507 INFO:tasks.workunit.client.1.smithi115.stdout:1/959: dread df/d36/f5f [0,4194304] 0 2024-04-16T14:35:46.508 INFO:tasks.workunit.client.1.smithi115.stdout:9/944: write d1/f92 [242737,130891] 0 2024-04-16T14:35:46.508 INFO:tasks.workunit.client.1.smithi115.stdout:9/945: dread - d1/d6/d2d/d3d/d49/d88/fbc zero size 2024-04-16T14:35:46.509 INFO:tasks.workunit.client.1.smithi115.stdout:1/960: unlink df/d13/d4d/d2c/f3b 0 2024-04-16T14:35:46.509 INFO:tasks.workunit.client.1.smithi115.stdout:1/961: write df/d13/d4d/d6d/f142 [580027,29833] 0 2024-04-16T14:35:46.509 INFO:tasks.workunit.client.1.smithi115.stdout:1/962: stat df/d13/d72/c12a 0 2024-04-16T14:35:46.509 INFO:tasks.workunit.client.1.smithi115.stdout:4/818: write d1/d15/d17/d9e/dbe/ffd [821858,7632] 0 2024-04-16T14:35:46.511 INFO:tasks.workunit.client.1.smithi115.stdout:1/963: creat df/f14a x:0 0 0 2024-04-16T14:35:46.511 INFO:tasks.workunit.client.1.smithi115.stdout:1/964: write df/d36/dff/f113 [3781253,113032] 0 2024-04-16T14:35:46.511 INFO:tasks.workunit.client.1.smithi115.stdout:4/819: creat d1/d15/d31/d42/d46/ffe x:0 0 0 2024-04-16T14:35:46.512 INFO:tasks.workunit.client.1.smithi115.stdout:1/965: symlink df/d13/d4d/d3e/d75/dda/l14b 0 2024-04-16T14:35:46.512 INFO:tasks.workunit.client.1.smithi115.stdout:1/966: dread - df/d13/d4d/d3e/d75/dda/faa zero size 2024-04-16T14:35:46.512 INFO:tasks.workunit.client.1.smithi115.stdout:1/967: creat df/d13/d125/f14c x:0 0 0 2024-04-16T14:35:46.513 INFO:tasks.workunit.client.1.smithi115.stdout:4/820: unlink d1/d15/d1e/l27 0 2024-04-16T14:35:46.516 INFO:tasks.workunit.client.1.smithi115.stdout:4/821: rmdir d1/d15/d17/d9e/ddf 39 2024-04-16T14:35:46.516 INFO:tasks.workunit.client.1.smithi115.stdout:4/822: symlink d1/d15/d17/lff 0 2024-04-16T14:35:46.517 INFO:tasks.workunit.client.1.smithi115.stdout:9/946: dread d1/d6/d29/f32 [0,4194304] 0 2024-04-16T14:35:46.517 INFO:tasks.workunit.client.1.smithi115.stdout:9/947: chown d1/d6/d2d/d4b/d60/d65/la9 1110 1 2024-04-16T14:35:46.517 INFO:tasks.workunit.client.1.smithi115.stdout:9/948: fdatasync d1/d6/fcb 0 2024-04-16T14:35:46.519 INFO:tasks.workunit.client.1.smithi115.stdout:9/949: truncate d1/d6/d2d/d4b/d6c/d20/f22 362809 0 2024-04-16T14:35:46.522 INFO:tasks.workunit.client.1.smithi115.stdout:9/950: rename d1/d6/d2d/d4b/d90/fd9 to d1/d6/d2d/d3d/d49/f14f 0 2024-04-16T14:35:46.527 INFO:tasks.workunit.client.1.smithi115.stdout:9/951: unlink d1/d6/d2d/d4b/d8f/fe2 0 2024-04-16T14:35:46.527 INFO:tasks.workunit.client.1.smithi115.stdout:9/952: fdatasync d1/d6/d29/f10d 0 2024-04-16T14:35:46.529 INFO:tasks.workunit.client.0.smithi005.stdout:9/776: dwrite d3/d12/f3e [0,4194304] 0 2024-04-16T14:35:46.529 INFO:tasks.workunit.client.1.smithi115.stdout:9/953: dread d1/d6/d2d/d4b/d6c/f6b [0,4194304] 0 2024-04-16T14:35:46.529 INFO:tasks.workunit.client.1.smithi115.stdout:9/954: chown d1/d6/d2d/d4b/d8f/d91/dda/ddd/de8 198896 1 2024-04-16T14:35:46.534 INFO:tasks.workunit.client.1.smithi115.stdout:4/823: dwrite d1/d15/d17/fb6 [0,4194304] 0 2024-04-16T14:35:46.539 INFO:tasks.workunit.client.1.smithi115.stdout:4/824: mknod d1/d15/d31/dc2/de4/c100 0 2024-04-16T14:35:46.539 INFO:tasks.workunit.client.1.smithi115.stdout:4/825: write d1/d15/d31/f41 [866768,83593] 0 2024-04-16T14:35:46.540 INFO:tasks.workunit.client.0.smithi005.stdout:9/777: dread d3/d49/d4b/d5c/d65/f8d [0,4194304] 0 2024-04-16T14:35:46.540 INFO:tasks.workunit.client.0.smithi005.stdout:9/778: readlink d3/d12/d2b/l73 0 2024-04-16T14:35:46.546 INFO:tasks.workunit.client.1.smithi115.stdout:9/955: dwrite d1/d6/d2d/d4b/d8f/d91/f6a [0,4194304] 0 2024-04-16T14:35:46.548 INFO:tasks.workunit.client.1.smithi115.stdout:9/956: dread d1/d6/d2d/d3d/d49/fb6 [0,4194304] 0 2024-04-16T14:35:46.549 INFO:tasks.workunit.client.1.smithi115.stdout:9/957: mknod d1/d6/d2d/d3d/c150 0 2024-04-16T14:35:46.551 INFO:tasks.workunit.client.1.smithi115.stdout:9/958: symlink d1/d6/d2d/d4b/d8f/d91/dda/ddd/dfc/d120/l151 0 2024-04-16T14:35:46.551 INFO:tasks.workunit.client.1.smithi115.stdout:9/959: fdatasync d1/d6/de0/f11a 0 2024-04-16T14:35:46.552 INFO:tasks.workunit.client.1.smithi115.stdout:3/879: rmdir dc/d29/d4d/dac 39 2024-04-16T14:35:46.552 INFO:tasks.workunit.client.1.smithi115.stdout:3/880: fdatasync dc/f23 0 2024-04-16T14:35:46.553 INFO:tasks.workunit.client.1.smithi115.stdout:9/960: link d1/d6/d2d/d4b/c4d d1/d6/d2d/d3d/d13a/d13e/c152 0 2024-04-16T14:35:46.555 INFO:tasks.workunit.client.1.smithi115.stdout:8/886: rmdir d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f 39 2024-04-16T14:35:46.555 INFO:tasks.workunit.client.1.smithi115.stdout:8/887: chown d0/db/d10/d17/d2c/d52/dcc 1549819 1 2024-04-16T14:35:46.555 INFO:tasks.workunit.client.1.smithi115.stdout:9/961: unlink d1/d6/d2d/f128 0 2024-04-16T14:35:46.556 INFO:tasks.workunit.client.1.smithi115.stdout:4/826: dwrite d1/d15/d31/d42/da4/fdc [0,4194304] 0 2024-04-16T14:35:46.556 INFO:tasks.workunit.client.1.smithi115.stdout:4/827: write d1/d15/d17/d9e/fc4 [50296,83572] 0 2024-04-16T14:35:46.556 INFO:tasks.workunit.client.1.smithi115.stdout:9/962: mkdir d1/d6/d2d/d4b/d8f/d91/dda/ddd/dfc/d153 0 2024-04-16T14:35:46.558 INFO:tasks.workunit.client.1.smithi115.stdout:8/888: creat d0/db/dbb/dcd/dbf/f126 x:0 0 0 2024-04-16T14:35:46.558 INFO:tasks.workunit.client.1.smithi115.stdout:4/828: rmdir d1/d15/d9c 39 2024-04-16T14:35:46.562 INFO:tasks.workunit.client.1.smithi115.stdout:0/671: sync 2024-04-16T14:35:46.563 INFO:tasks.workunit.client.1.smithi115.stdout:5/856: sync 2024-04-16T14:35:46.564 INFO:tasks.workunit.client.0.smithi005.stdout:9/779: dwrite d3/f41 [4194304,4194304] 0 2024-04-16T14:35:46.565 INFO:tasks.workunit.client.1.smithi115.stdout:0/672: link d6/f41 d6/fec 0 2024-04-16T14:35:46.565 INFO:tasks.workunit.client.1.smithi115.stdout:8/889: symlink d0/db/dbb/dcd/dbd/l127 0 2024-04-16T14:35:46.565 INFO:tasks.workunit.client.1.smithi115.stdout:8/890: chown d0/fca 699865 1 2024-04-16T14:35:46.566 INFO:tasks.workunit.client.1.smithi115.stdout:5/857: truncate dc/f11 3433139 0 2024-04-16T14:35:46.566 INFO:tasks.workunit.client.1.smithi115.stdout:5/858: readlink dc/d5d/dc2/lee 0 2024-04-16T14:35:46.566 INFO:tasks.workunit.client.1.smithi115.stdout:5/859: write dc/d3d/d41/f82 [60566,110494] 0 2024-04-16T14:35:46.567 INFO:tasks.workunit.client.1.smithi115.stdout:3/881: rename dc/d24/d33 to dc/d29/d4d/d56/d126 0 2024-04-16T14:35:46.567 INFO:tasks.workunit.client.1.smithi115.stdout:3/882: stat dc/d29/d4d/d56/d126/d4b/d81/f109 0 2024-04-16T14:35:46.567 INFO:tasks.workunit.client.1.smithi115.stdout:9/963: dread d1/d6/d2d/d3d/d50/f5e [0,4194304] 0 2024-04-16T14:35:46.567 INFO:tasks.workunit.client.1.smithi115.stdout:9/964: chown d1/d6/d2d/d4b/d60/fef 224 1 2024-04-16T14:35:46.568 INFO:tasks.workunit.client.1.smithi115.stdout:8/891: creat d0/f128 x:0 0 0 2024-04-16T14:35:46.568 INFO:tasks.workunit.client.1.smithi115.stdout:3/883: truncate dc/d29/d77/fdc 1107479 0 2024-04-16T14:35:46.569 INFO:tasks.workunit.client.1.smithi115.stdout:3/884: chown dc/d29/d4d/d56/d126/fb5 874 1 2024-04-16T14:35:46.569 INFO:tasks.workunit.client.1.smithi115.stdout:0/673: mkdir d6/d10/d12/d1f/ded 0 2024-04-16T14:35:46.569 INFO:tasks.workunit.client.1.smithi115.stdout:0/674: write d6/d10/d12/d31/d35/d9b/f66 [4399081,95396] 0 2024-04-16T14:35:46.569 INFO:tasks.workunit.client.1.smithi115.stdout:0/675: fdatasync d6/d10/d12/d1f/d36/d4b/d6d/f8e 0 2024-04-16T14:35:46.569 INFO:tasks.workunit.client.1.smithi115.stdout:0/676: fsync d6/d10/d12/d31/d35/f59 0 2024-04-16T14:35:46.570 INFO:tasks.workunit.client.1.smithi115.stdout:3/885: truncate dc/d29/f85 1139290 0 2024-04-16T14:35:46.571 INFO:tasks.workunit.client.1.smithi115.stdout:5/860: creat dc/d15/d35/f104 x:0 0 0 2024-04-16T14:35:46.572 INFO:tasks.workunit.client.1.smithi115.stdout:3/886: creat dc/d24/d80/dfc/d11a/f127 x:0 0 0 2024-04-16T14:35:46.573 INFO:tasks.workunit.client.1.smithi115.stdout:4/829: rename d1/d15/d31/d42/d46/fc8 to d1/d15/d9c/f101 0 2024-04-16T14:35:46.573 INFO:tasks.workunit.client.0.smithi005.stdout:9/780: dread d3/d12/d2b/f4e [0,4194304] 0 2024-04-16T14:35:46.575 INFO:tasks.workunit.client.1.smithi115.stdout:3/887: symlink dc/d24/d36/d60/l128 0 2024-04-16T14:35:46.575 INFO:tasks.workunit.client.1.smithi115.stdout:3/888: creat dc/d29/d4d/f129 x:0 0 0 2024-04-16T14:35:46.576 INFO:tasks.workunit.client.1.smithi115.stdout:3/889: chown dc/d29/d4d/d56/d126/fb5 3272 1 2024-04-16T14:35:46.577 INFO:tasks.workunit.client.0.smithi005.stdout:9/781: creat d3/d49/d4b/d5c/d65/fe3 x:0 0 0 2024-04-16T14:35:46.577 INFO:tasks.workunit.client.1.smithi115.stdout:8/892: dread d0/fdd [0,4194304] 0 2024-04-16T14:35:46.579 INFO:tasks.workunit.client.0.smithi005.stdout:9/782: creat d3/d49/d91/fe4 x:0 0 0 2024-04-16T14:35:46.580 INFO:tasks.workunit.client.0.smithi005.stdout:9/783: truncate d3/d49/f66 1532537 0 2024-04-16T14:35:46.582 INFO:tasks.workunit.client.0.smithi005.stdout:9/784: truncate d3/d12/d2b/f4e 1798359 0 2024-04-16T14:35:46.582 INFO:tasks.workunit.client.1.smithi115.stdout:4/830: write d1/d15/d17/f26 [12355669,47890] 0 2024-04-16T14:35:46.582 INFO:tasks.workunit.client.0.smithi005.stdout:9/785: creat d3/d77/fe5 x:0 0 0 2024-04-16T14:35:46.583 INFO:tasks.workunit.client.1.smithi115.stdout:5/861: rename dc/d3d/d41/f91 to dc/d15/d4d/dde/f105 0 2024-04-16T14:35:46.583 INFO:tasks.workunit.client.1.smithi115.stdout:5/862: dread - dc/d5d/d81/fd7 zero size 2024-04-16T14:35:46.585 INFO:tasks.workunit.client.1.smithi115.stdout:9/965: mkdir d1/d6/d2d/d4b/d8f/d154 0 2024-04-16T14:35:46.585 INFO:tasks.workunit.client.1.smithi115.stdout:9/966: write d1/d6/d2d/d4b/d8f/d91/dd1/dd2/ff6 [1548905,123593] 0 2024-04-16T14:35:46.585 INFO:tasks.workunit.client.1.smithi115.stdout:8/893: rename d0/db/d10/d17/d2c/d52/d6c/db8/d6b/cda to d0/db/dbb/dcd/c129 0 2024-04-16T14:35:46.587 INFO:tasks.workunit.client.1.smithi115.stdout:8/894: symlink d0/db/d10/d17/d22/deb/d7c/l12a 0 2024-04-16T14:35:46.587 INFO:tasks.workunit.client.1.smithi115.stdout:8/895: chown d0/fdd 8655 1 2024-04-16T14:35:46.588 INFO:tasks.workunit.client.1.smithi115.stdout:8/896: chown d0/db/d10/d17/d2c/d52/d84/f90 41 1 2024-04-16T14:35:46.588 INFO:tasks.workunit.client.1.smithi115.stdout:8/897: rename d0/db/d10/d17/d2c/d52 to d0/db/d10/d17/d2c/d52/d6c/db8/d7d/de2/d111/d83/d12b 22 2024-04-16T14:35:46.588 INFO:tasks.workunit.client.1.smithi115.stdout:0/677: rmdir d6/dac 39 2024-04-16T14:35:46.590 INFO:tasks.workunit.client.1.smithi115.stdout:8/898: creat d0/db/d10/d17/d2c/d52/d6c/db8/d7d/de2/d111/d89/f12c x:0 0 0 2024-04-16T14:35:46.591 INFO:tasks.workunit.client.1.smithi115.stdout:4/831: link d1/d15/d9c/feb d1/d15/d9c/f102 0 2024-04-16T14:35:46.591 INFO:tasks.workunit.client.1.smithi115.stdout:4/832: dread - d1/d15/d1e/ff2 zero size 2024-04-16T14:35:46.591 INFO:tasks.workunit.client.1.smithi115.stdout:4/833: chown d1/d15/d31/d42/d8b/ld9 3988617 1 2024-04-16T14:35:46.591 INFO:tasks.workunit.client.1.smithi115.stdout:4/834: write d1/d15/d17/d9e/dbe/ffd [3553951,16907] 0 2024-04-16T14:35:46.591 INFO:tasks.workunit.client.1.smithi115.stdout:4/835: read d1/d15/d17/d9e/dbe/ffd [2358150,82769] 0 2024-04-16T14:35:46.593 INFO:tasks.workunit.client.1.smithi115.stdout:8/899: mkdir d0/db/d10/d17/d2c/d52/d74/d3b/d56/dfc/d110/d12d 0 2024-04-16T14:35:46.593 INFO:tasks.workunit.client.1.smithi115.stdout:8/900: stat d0/db/dbb/dcd/dae/dde/de9/fea 0 2024-04-16T14:35:46.594 INFO:tasks.workunit.client.1.smithi115.stdout:8/901: fdatasync d0/db/dbb/dcd/fc6 0 2024-04-16T14:35:46.594 INFO:tasks.workunit.client.1.smithi115.stdout:5/863: rmdir dc/d15/d4d/dde 39 2024-04-16T14:35:46.596 INFO:tasks.workunit.client.1.smithi115.stdout:9/967: dread d1/d6/d2d/d4b/d6c/fae [0,4194304] 0 2024-04-16T14:35:46.596 INFO:tasks.workunit.client.1.smithi115.stdout:9/968: dread - d1/d6/d2d/d4b/d8f/d91/dd1/dd2/ff8 zero size 2024-04-16T14:35:46.596 INFO:tasks.workunit.client.1.smithi115.stdout:9/969: fdatasync d1/d6/d2d/d3d/db7/fe6 0 2024-04-16T14:35:46.596 INFO:tasks.workunit.client.1.smithi115.stdout:9/970: creat d1/d6/de0/f155 x:0 0 0 2024-04-16T14:35:46.600 INFO:tasks.workunit.client.1.smithi115.stdout:5/864: rename dc/d79/f99 to dc/d5d/dc2/f106 0 2024-04-16T14:35:46.604 INFO:tasks.workunit.client.0.smithi005.stdout:9/786: dwrite d3/d49/d4b/d5c/d65/fe3 [0,4194304] 0 2024-04-16T14:35:46.607 INFO:tasks.workunit.client.0.smithi005.stdout:9/787: rename d3/d49/d4b/d5c/l7d to d3/d12/d16/d46/le6 0 2024-04-16T14:35:46.608 INFO:tasks.workunit.client.0.smithi005.stdout:9/788: stat d3/d12/d16/d46/d47/d60/ca6 0 2024-04-16T14:35:46.609 INFO:tasks.workunit.client.1.smithi115.stdout:9/971: dread d1/d6/d2d/d4b/d6c/d20/d36/dce/fea [0,4194304] 0 2024-04-16T14:35:46.609 INFO:tasks.workunit.client.1.smithi115.stdout:9/972: chown d1/d6/de0/d100/f11b 42628735 1 2024-04-16T14:35:46.610 INFO:tasks.workunit.client.0.smithi005.stdout:9/789: rename d3/d49/d4b/d55/ccc to d3/d12/d2b/d8e/dc1/ce7 0 2024-04-16T14:35:46.610 INFO:tasks.workunit.client.0.smithi005.stdout:9/790: readlink d3/d12/l15 0 2024-04-16T14:35:46.610 INFO:tasks.workunit.client.0.smithi005.stdout:9/791: truncate d3/d49/d4b/d5c/d65/fa3 1034285 0 2024-04-16T14:35:46.610 INFO:tasks.workunit.client.0.smithi005.stdout:9/792: chown d3/d12/d9d/cc5 6062314 1 2024-04-16T14:35:46.612 INFO:tasks.workunit.client.1.smithi115.stdout:6/835: sync 2024-04-16T14:35:46.612 INFO:tasks.workunit.client.1.smithi115.stdout:2/954: sync 2024-04-16T14:35:46.615 INFO:tasks.workunit.client.0.smithi005.stdout:9/793: dread d3/d12/d16/d86/f87 [0,4194304] 0 2024-04-16T14:35:46.617 INFO:tasks.workunit.client.0.smithi005.stdout:9/794: rename d3/c22 to d3/d49/d91/ce8 0 2024-04-16T14:35:46.617 INFO:tasks.workunit.client.0.smithi005.stdout:9/795: write d3/d49/d4b/d55/f96 [834187,112252] 0 2024-04-16T14:35:46.617 INFO:tasks.workunit.client.0.smithi005.stdout:9/796: readlink d3/d12/d16/l27 0 2024-04-16T14:35:46.619 INFO:tasks.workunit.client.1.smithi115.stdout:8/902: dwrite d0/db/d10/d17/d2c/d52/f99 [0,4194304] 0 2024-04-16T14:35:46.619 INFO:tasks.workunit.client.1.smithi115.stdout:8/903: chown d0/db/d10/d17/d2c/d52/d74/d73/f105 207 1 2024-04-16T14:35:46.619 INFO:tasks.workunit.client.1.smithi115.stdout:0/678: dwrite d6/d54/d57/d83/f8f [0,4194304] 0 2024-04-16T14:35:46.621 INFO:tasks.workunit.client.1.smithi115.stdout:2/955: dread d0/d47/d65/dad/dc8/d22/fce [0,4194304] 0 2024-04-16T14:35:46.621 INFO:tasks.workunit.client.1.smithi115.stdout:2/956: fsync d0/f2d 0 2024-04-16T14:35:46.621 INFO:tasks.workunit.client.0.smithi005.stdout:9/797: rename d3/d12/d16/d86 to d3/d12/d16/d46/d47/d60/de9 0 2024-04-16T14:35:46.621 INFO:tasks.workunit.client.0.smithi005.stdout:9/798: chown d3/d49/d4b/d5c/d65 36 1 2024-04-16T14:35:46.622 INFO:tasks.workunit.client.1.smithi115.stdout:0/679: symlink d6/d10/d12/d31/d35/d44/lee 0 2024-04-16T14:35:46.625 INFO:tasks.workunit.client.1.smithi115.stdout:2/957: truncate d0/f2d 2728047 0 2024-04-16T14:35:46.625 INFO:tasks.workunit.client.1.smithi115.stdout:2/958: chown d0/d47/d65/dad/dc8/d24/d23/d129 28 1 2024-04-16T14:35:46.626 INFO:tasks.workunit.client.0.smithi005.stdout:9/799: rename d3/d12/d2b/fd1 to d3/d49/d4b/d55/fea 0 2024-04-16T14:35:46.626 INFO:tasks.workunit.client.1.smithi115.stdout:6/836: dread d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/d63/fc5 [0,4194304] 0 2024-04-16T14:35:46.626 INFO:tasks.workunit.client.1.smithi115.stdout:4/836: dwrite d1/d15/d9c/feb [0,4194304] 0 2024-04-16T14:35:46.626 INFO:tasks.workunit.client.1.smithi115.stdout:6/837: read - d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96/d55/f10d zero size 2024-04-16T14:35:46.640 INFO:tasks.workunit.client.1.smithi115.stdout:4/837: dread d1/f6b [0,4194304] 0 2024-04-16T14:35:46.640 INFO:tasks.workunit.client.1.smithi115.stdout:4/838: write d1/d15/d17/f92 [868395,91710] 0 2024-04-16T14:35:46.641 INFO:tasks.workunit.client.1.smithi115.stdout:4/839: symlink d1/d15/d31/dc2/de4/dad/l103 0 2024-04-16T14:35:46.641 INFO:tasks.workunit.client.1.smithi115.stdout:4/840: stat d1/f4 0 2024-04-16T14:35:46.641 INFO:tasks.workunit.client.1.smithi115.stdout:4/841: truncate d1/d15/d1e/f2b 1178853 0 2024-04-16T14:35:46.642 INFO:tasks.workunit.client.1.smithi115.stdout:4/842: creat d1/d15/d1e/f104 x:0 0 0 2024-04-16T14:35:46.642 INFO:tasks.workunit.client.1.smithi115.stdout:4/843: write d1/d15/d1e/f5d [6025321,74573] 0 2024-04-16T14:35:46.643 INFO:tasks.workunit.client.1.smithi115.stdout:4/844: mkdir d1/d15/d31/d42/d46/d7a/d105 0 2024-04-16T14:35:46.652 INFO:tasks.workunit.client.1.smithi115.stdout:6/838: dwrite d13/d1d/d87/fd9 [4194304,4194304] 0 2024-04-16T14:35:46.652 INFO:tasks.workunit.client.1.smithi115.stdout:6/839: chown d13/d1d/d49/f6e 476191927 1 2024-04-16T14:35:46.652 INFO:tasks.workunit.client.1.smithi115.stdout:4/845: dread d1/d15/d31/d42/f93 [0,4194304] 0 2024-04-16T14:35:46.654 INFO:tasks.workunit.client.1.smithi115.stdout:4/846: symlink d1/d15/d31/d42/db4/l106 0 2024-04-16T14:35:46.655 INFO:tasks.workunit.client.1.smithi115.stdout:4/847: link d1/d15/d1e/l61 d1/d15/d31/d42/d46/l107 0 2024-04-16T14:35:46.655 INFO:tasks.workunit.client.1.smithi115.stdout:4/848: stat d1/d15/d17/fa3 0 2024-04-16T14:35:46.656 INFO:tasks.workunit.client.1.smithi115.stdout:4/849: truncate d1/d15/d31/f3a 1286059 0 2024-04-16T14:35:46.656 INFO:tasks.workunit.client.1.smithi115.stdout:4/850: creat d1/f108 x:0 0 0 2024-04-16T14:35:46.658 INFO:tasks.workunit.client.1.smithi115.stdout:4/851: rename d1/d2/ce1 to d1/d15/d17/d9e/dbe/c109 0 2024-04-16T14:35:46.742 INFO:tasks.workunit.client.1.smithi115.stdout:8/904: dwrite d0/db/dbb/dcd/dae/f117 [0,4194304] 0 2024-04-16T14:35:46.743 INFO:tasks.workunit.client.1.smithi115.stdout:8/905: write d0/db/d10/d17/d2c/d52/d6c/db8/d7d/de2/f112 [660259,30927] 0 2024-04-16T14:35:46.743 INFO:tasks.workunit.client.1.smithi115.stdout:0/680: dwrite d6/d10/d12/d31/d35/d9b/f77 [0,4194304] 0 2024-04-16T14:35:46.743 INFO:tasks.workunit.client.1.smithi115.stdout:6/840: dwrite d13/d1d/d49/f74 [0,4194304] 0 2024-04-16T14:35:46.743 INFO:tasks.workunit.client.0.smithi005.stdout:9/800: dwrite d3/f41 [4194304,4194304] 0 2024-04-16T14:35:46.745 INFO:tasks.workunit.client.1.smithi115.stdout:8/906: mknod d0/db/d10/d17/d2c/d52/d6c/db8/c12e 0 2024-04-16T14:35:46.749 INFO:tasks.workunit.client.1.smithi115.stdout:0/681: dread d6/d10/d12/d1f/d36/d4b/d6d/f3d [0,4194304] 0 2024-04-16T14:35:46.750 INFO:tasks.workunit.client.1.smithi115.stdout:8/907: creat d0/db/d10/d17/d2c/d52/d6c/db8/d7d/de2/d111/f12f x:0 0 0 2024-04-16T14:35:46.750 INFO:tasks.workunit.client.1.smithi115.stdout:8/908: truncate d0/f53 5001594 0 2024-04-16T14:35:46.752 INFO:tasks.workunit.client.0.smithi005.stdout:9/801: rmdir d3/d49/d91 39 2024-04-16T14:35:46.757 INFO:tasks.workunit.client.0.smithi005.stdout:9/802: dread d3/d49/f50 [0,4194304] 0 2024-04-16T14:35:46.758 INFO:tasks.workunit.client.0.smithi005.stdout:9/803: mknod d3/d49/d4b/d55/ceb 0 2024-04-16T14:35:46.760 INFO:tasks.workunit.client.1.smithi115.stdout:8/909: dread d0/db/f26 [0,4194304] 0 2024-04-16T14:35:46.760 INFO:tasks.workunit.client.0.smithi005.stdout:9/804: rename d3/d77/f8f to d3/d77/fec 0 2024-04-16T14:35:46.761 INFO:tasks.workunit.client.1.smithi115.stdout:8/910: truncate d0/db/d10/d17/d2c/f115 2759088 0 2024-04-16T14:35:46.763 INFO:tasks.workunit.client.0.smithi005.stdout:9/805: creat d3/d49/fed x:0 0 0 2024-04-16T14:35:46.774 INFO:tasks.workunit.client.1.smithi115.stdout:0/682: dwrite d6/d10/d12/d1f/d36/d4b/f5c [0,4194304] 0 2024-04-16T14:35:46.774 INFO:tasks.workunit.client.1.smithi115.stdout:0/683: write d6/d10/d12/fb0 [167943,72458] 0 2024-04-16T14:35:46.774 INFO:tasks.workunit.client.1.smithi115.stdout:6/841: dwrite f8 [0,4194304] 0 2024-04-16T14:35:46.774 INFO:tasks.workunit.client.1.smithi115.stdout:6/842: chown d13/d1d/d2b/d5f/d30/d43 0 1 2024-04-16T14:35:46.774 INFO:tasks.workunit.client.1.smithi115.stdout:6/843: fsync d13/d1d/d2b/d5f/d30/d43/fda 0 2024-04-16T14:35:46.777 INFO:tasks.workunit.client.1.smithi115.stdout:0/684: dread f0 [0,4194304] 0 2024-04-16T14:35:46.778 INFO:tasks.workunit.client.1.smithi115.stdout:0/685: fsync d6/d10/d12/d31/f39 0 2024-04-16T14:35:46.779 INFO:tasks.workunit.client.1.smithi115.stdout:6/844: rename d13/d1d/d68/fef to d13/d1d/d2b/d5f/d30/d43/d2c/f116 0 2024-04-16T14:35:46.779 INFO:tasks.workunit.client.1.smithi115.stdout:6/845: truncate d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/d5a/fbd 1457962 0 2024-04-16T14:35:46.779 INFO:tasks.workunit.client.1.smithi115.stdout:6/846: creat d13/f117 x:0 0 0 2024-04-16T14:35:46.779 INFO:tasks.workunit.client.1.smithi115.stdout:0/686: rmdir d6/d10/dc8 39 2024-04-16T14:35:46.779 INFO:tasks.workunit.client.1.smithi115.stdout:0/687: fsync d6/f41 0 2024-04-16T14:35:46.780 INFO:tasks.workunit.client.1.smithi115.stdout:6/847: write d13/d1d/d2b/f10e [281771,110709] 0 2024-04-16T14:35:46.780 INFO:tasks.workunit.client.1.smithi115.stdout:6/848: rename d13/d1d to d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/d63/d118 22 2024-04-16T14:35:46.782 INFO:tasks.workunit.client.1.smithi115.stdout:6/849: link d13/l14 d13/d1d/d2b/l119 0 2024-04-16T14:35:46.783 INFO:tasks.workunit.client.1.smithi115.stdout:6/850: mkdir d13/d1d/d2b/df4/d112/d114/d11a 0 2024-04-16T14:35:46.785 INFO:tasks.workunit.client.1.smithi115.stdout:6/851: rename f12 to d13/d1d/d2b/df4/d112/d114/f11b 0 2024-04-16T14:35:46.785 INFO:tasks.workunit.client.1.smithi115.stdout:6/852: getdents d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96/dbc 0 2024-04-16T14:35:46.786 INFO:tasks.workunit.client.1.smithi115.stdout:7/750: sync 2024-04-16T14:35:46.787 INFO:tasks.workunit.client.1.smithi115.stdout:8/911: dwrite d0/db/d10/d17/d2c/d52/d74/f35 [4194304,4194304] 0 2024-04-16T14:35:46.787 INFO:tasks.workunit.client.0.smithi005.stdout:9/806: dwrite d3/d77/fec [0,4194304] 0 2024-04-16T14:35:46.788 INFO:tasks.workunit.client.1.smithi115.stdout:8/912: symlink d0/da5/l130 0 2024-04-16T14:35:46.788 INFO:tasks.workunit.client.1.smithi115.stdout:8/913: chown d0/db/d10/d17/d2c/d52/d74/d3b 59 1 2024-04-16T14:35:46.792 INFO:tasks.workunit.client.1.smithi115.stdout:3/890: sync 2024-04-16T14:35:46.793 INFO:tasks.workunit.client.1.smithi115.stdout:1/968: sync 2024-04-16T14:35:46.795 INFO:tasks.workunit.client.1.smithi115.stdout:3/891: symlink dc/d29/d39/d86/dd0/dee/l12a 0 2024-04-16T14:35:46.795 INFO:tasks.workunit.client.1.smithi115.stdout:3/892: chown dc/d29/d4d/d56/d126/d4b/da3/d69/fd5 72183 1 2024-04-16T14:35:46.795 INFO:tasks.workunit.client.1.smithi115.stdout:3/893: chown dc/d29/d4d/d56/d126/d4b/da3/d69/fd5 324 1 2024-04-16T14:35:46.798 INFO:tasks.workunit.client.1.smithi115.stdout:1/969: rmdir df/d2d/d121/d138 0 2024-04-16T14:35:46.806 INFO:tasks.workunit.client.1.smithi115.stdout:3/894: link dc/d29/d39/ff2 dc/d29/d4d/dac/f12b 0 2024-04-16T14:35:46.806 INFO:tasks.workunit.client.1.smithi115.stdout:0/688: write d6/d1b/f7d [807947,5047] 0 2024-04-16T14:35:46.806 INFO:tasks.workunit.client.1.smithi115.stdout:6/853: write d13/f2a [836499,54649] 0 2024-04-16T14:35:46.806 INFO:tasks.workunit.client.1.smithi115.stdout:6/854: chown d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96 153449760 1 2024-04-16T14:35:46.807 INFO:tasks.workunit.client.1.smithi115.stdout:1/970: link df/d36/d94/fa4 df/d13/d4d/d3e/d75/dfc/f14d 0 2024-04-16T14:35:46.807 INFO:tasks.workunit.client.1.smithi115.stdout:1/971: write df/d13/d4d/d68/de7/fe4 [329064,86682] 0 2024-04-16T14:35:46.807 INFO:tasks.workunit.client.1.smithi115.stdout:0/689: truncate d6/d30/f43 2633178 0 2024-04-16T14:35:46.807 INFO:tasks.workunit.client.1.smithi115.stdout:1/972: mknod df/d13/d4d/d3e/d7d/d12c/c14e 0 2024-04-16T14:35:46.808 INFO:tasks.workunit.client.1.smithi115.stdout:1/973: rmdir df/d13/d4d/d68/de7/d55 39 2024-04-16T14:35:46.808 INFO:tasks.workunit.client.1.smithi115.stdout:1/974: creat df/d35/d48/f14f x:0 0 0 2024-04-16T14:35:46.809 INFO:tasks.workunit.client.1.smithi115.stdout:1/975: creat df/d35/d84/ddc/f150 x:0 0 0 2024-04-16T14:35:46.810 INFO:tasks.workunit.client.1.smithi115.stdout:6/855: dread d13/d1d/d49/f8b [0,4194304] 0 2024-04-16T14:35:46.810 INFO:tasks.workunit.client.1.smithi115.stdout:6/856: fdatasync d13/f7f 0 2024-04-16T14:35:46.812 INFO:tasks.workunit.client.0.smithi005.stdout:9/807: dwrite d3/d49/d4b/d5c/d65/fe3 [0,4194304] 0 2024-04-16T14:35:46.812 INFO:tasks.workunit.client.1.smithi115.stdout:6/857: creat d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/f11c x:0 0 0 2024-04-16T14:35:46.812 INFO:tasks.workunit.client.1.smithi115.stdout:6/858: chown d13/d1d/lfc 815186 1 2024-04-16T14:35:46.813 INFO:tasks.workunit.client.1.smithi115.stdout:6/859: dread - d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/f7e zero size 2024-04-16T14:35:46.813 INFO:tasks.workunit.client.1.smithi115.stdout:6/860: symlink d13/d1d/d49/ded/l11d 0 2024-04-16T14:35:46.814 INFO:tasks.workunit.client.1.smithi115.stdout:0/690: write d6/fb [6073452,52648] 0 2024-04-16T14:35:46.814 INFO:tasks.workunit.client.1.smithi115.stdout:7/751: dwrite d0/d2/d3a/d30/d79/d95/fa0 [0,4194304] 0 2024-04-16T14:35:46.816 INFO:tasks.workunit.client.1.smithi115.stdout:6/861: rename d13/d1d/d49/f74 to d13/d1d/d2b/df4/f11e 0 2024-04-16T14:35:46.817 INFO:tasks.workunit.client.1.smithi115.stdout:0/691: creat d6/d30/d4d/fef x:0 0 0 2024-04-16T14:35:46.818 INFO:tasks.workunit.client.1.smithi115.stdout:7/752: unlink d0/d2/d3a/d73/c88 0 2024-04-16T14:35:46.820 INFO:tasks.workunit.client.1.smithi115.stdout:3/895: dwrite dc/d29/d4d/f129 [0,4194304] 0 2024-04-16T14:35:46.820 INFO:tasks.workunit.client.1.smithi115.stdout:3/896: truncate dc/d24/f119 513382 0 2024-04-16T14:35:46.820 INFO:tasks.workunit.client.1.smithi115.stdout:3/897: dread - dc/d29/d39/d106/f10f zero size 2024-04-16T14:35:46.821 INFO:tasks.workunit.client.1.smithi115.stdout:0/692: unlink d6/d10/d12/d1f/d36/d4b/d6d/d7a/fce 0 2024-04-16T14:35:46.821 INFO:tasks.workunit.client.1.smithi115.stdout:0/693: chown d6/fb 88 1 2024-04-16T14:35:46.824 INFO:tasks.workunit.client.1.smithi115.stdout:6/862: getdents d13/d1d/d47 0 2024-04-16T14:35:46.827 INFO:tasks.workunit.client.0.smithi005.stdout:9/808: dwrite d3/d49/d4b/d5c/d65/fa3 [0,4194304] 0 2024-04-16T14:35:46.828 INFO:tasks.workunit.client.1.smithi115.stdout:3/898: dread dc/d24/fd2 [0,4194304] 0 2024-04-16T14:35:46.829 INFO:tasks.workunit.client.0.smithi005.stdout:9/809: getdents d3/d49/d4b 0 2024-04-16T14:35:46.833 INFO:tasks.workunit.client.1.smithi115.stdout:7/753: rmdir d0/d2/d3a/d30/d79/dd2/d64 39 2024-04-16T14:35:46.836 INFO:tasks.workunit.client.1.smithi115.stdout:0/694: mkdir d6/d30/d4d/df0 0 2024-04-16T14:35:46.839 INFO:tasks.workunit.client.1.smithi115.stdout:7/754: creat d0/d2/d3a/dda/fff x:0 0 0 2024-04-16T14:35:46.839 INFO:tasks.workunit.client.1.smithi115.stdout:7/755: chown d0/d24/da3/lbe 291621956 1 2024-04-16T14:35:46.839 INFO:tasks.workunit.client.1.smithi115.stdout:3/899: write dc/f3d [3689787,70726] 0 2024-04-16T14:35:46.840 INFO:tasks.workunit.client.0.smithi005.stdout:0/839: sync 2024-04-16T14:35:46.840 INFO:tasks.workunit.client.0.smithi005.stdout:2/806: sync 2024-04-16T14:35:46.840 INFO:tasks.workunit.client.0.smithi005.stdout:8/880: sync 2024-04-16T14:35:46.841 INFO:tasks.workunit.client.1.smithi115.stdout:6/863: link d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/d63/fb9 d13/d1d/f11f 0 2024-04-16T14:35:46.841 INFO:tasks.workunit.client.1.smithi115.stdout:6/864: truncate d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/fd2 499454 0 2024-04-16T14:35:46.841 INFO:tasks.workunit.client.0.smithi005.stdout:9/810: dwrite d3/f3c [4194304,4194304] 0 2024-04-16T14:35:46.842 INFO:tasks.workunit.client.1.smithi115.stdout:3/900: unlink dc/d29/d4d/d56/d126/d4b/da3/d69/fb2 0 2024-04-16T14:35:46.842 INFO:tasks.workunit.client.0.smithi005.stdout:0/840: rmdir da/df/d1b/db6 39 2024-04-16T14:35:46.842 INFO:tasks.workunit.client.0.smithi005.stdout:0/841: stat da/df/d26/f45 0 2024-04-16T14:35:46.845 INFO:tasks.workunit.client.0.smithi005.stdout:2/807: rename d0/d2a/fbe to d0/d1c/d39/f10a 0 2024-04-16T14:35:46.845 INFO:tasks.workunit.client.0.smithi005.stdout:2/808: write d0/d29/fc3 [3854312,488] 0 2024-04-16T14:35:46.846 INFO:tasks.workunit.client.1.smithi115.stdout:3/901: symlink dc/d29/d4d/d56/d126/d4b/da3/d69/l12c 0 2024-04-16T14:35:46.847 INFO:tasks.workunit.client.0.smithi005.stdout:8/881: symlink d5/d55/d5a/d135/d7f/d8d/dd1/l136 0 2024-04-16T14:35:46.849 INFO:tasks.workunit.client.1.smithi115.stdout:3/902: creat dc/d29/d4d/d56/d7e/d11b/f12d x:0 0 0 2024-04-16T14:35:46.850 INFO:tasks.workunit.client.0.smithi005.stdout:9/811: symlink d3/d12/d16/lee 0 2024-04-16T14:35:46.850 INFO:tasks.workunit.client.0.smithi005.stdout:9/812: getdents d3/d49/d4b/d5c/dd0 0 2024-04-16T14:35:46.851 INFO:tasks.workunit.client.1.smithi115.stdout:6/865: dread d13/d1d/d2b/d5f/f4b [0,4194304] 0 2024-04-16T14:35:46.852 INFO:tasks.workunit.client.0.smithi005.stdout:0/842: creat da/df/d26/d39/d55/ddc/d105/f120 x:0 0 0 2024-04-16T14:35:46.852 INFO:tasks.workunit.client.0.smithi005.stdout:0/843: stat da/df/d1b/d3a/d53/d5a/d99 0 2024-04-16T14:35:46.852 INFO:tasks.workunit.client.1.smithi115.stdout:3/903: mknod dc/d29/d4d/d56/d98/c12e 0 2024-04-16T14:35:46.853 INFO:tasks.workunit.client.1.smithi115.stdout:3/904: chown dc/d29/d4d/d56/d98/lf8 21 1 2024-04-16T14:35:46.855 INFO:tasks.workunit.client.0.smithi005.stdout:2/809: write d0/d2a/d3a/f96 [693480,30835] 0 2024-04-16T14:35:46.856 INFO:tasks.workunit.client.0.smithi005.stdout:8/882: link d5/d11/f45 d5/d55/d5a/d135/dba/dcd/f137 0 2024-04-16T14:35:46.857 INFO:tasks.workunit.client.0.smithi005.stdout:0/844: symlink da/df/d1b/d3a/d53/dbc/l121 0 2024-04-16T14:35:46.857 INFO:tasks.workunit.client.0.smithi005.stdout:0/845: write da/df/d50/fc2 [992950,99120] 0 2024-04-16T14:35:46.858 INFO:tasks.workunit.client.0.smithi005.stdout:0/846: fdatasync da/df/d1b/d3a/d53/d5a/d99/fc5 0 2024-04-16T14:35:46.859 INFO:tasks.workunit.client.0.smithi005.stdout:2/810: creat d0/d1c/d39/dcb/f10b x:0 0 0 2024-04-16T14:35:46.860 INFO:tasks.workunit.client.0.smithi005.stdout:9/813: write d3/d49/d4b/d5c/d65/f85 [2850591,127536] 0 2024-04-16T14:35:46.860 INFO:tasks.workunit.client.0.smithi005.stdout:9/814: write d3/d49/d91/fe4 [76232,46780] 0 2024-04-16T14:35:46.860 INFO:tasks.workunit.client.0.smithi005.stdout:8/883: rmdir d5/d7b/da8/db7 39 2024-04-16T14:35:46.862 INFO:tasks.workunit.client.1.smithi115.stdout:0/695: dwrite d6/d10/d12/d31/f91 [0,4194304] 0 2024-04-16T14:35:46.862 INFO:tasks.workunit.client.1.smithi115.stdout:3/905: dread dc/d29/d4d/d56/d126/d4b/f4c [0,4194304] 0 2024-04-16T14:35:46.862 INFO:tasks.workunit.client.1.smithi115.stdout:0/696: readlink d6/l8 0 2024-04-16T14:35:46.862 INFO:tasks.workunit.client.1.smithi115.stdout:3/906: fdatasync dc/d24/d36/f72 0 2024-04-16T14:35:46.864 INFO:tasks.workunit.client.1.smithi115.stdout:0/697: mkdir d6/d10/df1 0 2024-04-16T14:35:46.864 INFO:tasks.workunit.client.1.smithi115.stdout:0/698: truncate d6/d10/d12/d1f/d36/d4b/d70/fa8 559188 0 2024-04-16T14:35:46.864 INFO:tasks.workunit.client.1.smithi115.stdout:6/866: write d13/d1d/f6f [2779070,39335] 0 2024-04-16T14:35:46.864 INFO:tasks.workunit.client.1.smithi115.stdout:6/867: chown d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96 1 1 2024-04-16T14:35:46.864 INFO:tasks.workunit.client.0.smithi005.stdout:0/847: rename da/df/d50/fed to da/df/d26/d39/f122 0 2024-04-16T14:35:46.865 INFO:tasks.workunit.client.0.smithi005.stdout:2/811: mknod d0/d1c/d39/d85/da2/db0/c10c 0 2024-04-16T14:35:46.866 INFO:tasks.workunit.client.1.smithi115.stdout:6/868: dread d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96/fb6 [0,4194304] 0 2024-04-16T14:35:46.867 INFO:tasks.workunit.client.1.smithi115.stdout:3/907: getdents dc/d29/d4d/d56/d126/d4b/da3 0 2024-04-16T14:35:46.867 INFO:tasks.workunit.client.0.smithi005.stdout:9/815: dread d3/d49/d4b/d5c/d65/fe3 [0,4194304] 0 2024-04-16T14:35:46.867 INFO:tasks.workunit.client.0.smithi005.stdout:9/816: stat d3/ce 0 2024-04-16T14:35:46.868 INFO:tasks.workunit.client.1.smithi115.stdout:6/869: rename d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/d63/f64 to d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96/de4/f120 0 2024-04-16T14:35:46.870 INFO:tasks.workunit.client.1.smithi115.stdout:3/908: truncate dc/d29/d39/d106/fdd 3923628 0 2024-04-16T14:35:46.871 INFO:tasks.workunit.client.0.smithi005.stdout:8/884: getdents d5/d55/d5a/d135/d7f/d8d/dd1 0 2024-04-16T14:35:46.872 INFO:tasks.workunit.client.0.smithi005.stdout:0/848: link da/l64 da/df/d1b/d3a/d53/d5a/l123 0 2024-04-16T14:35:46.872 INFO:tasks.workunit.client.0.smithi005.stdout:0/849: chown da/df/d1b/d3a/lfd 7616 1 2024-04-16T14:35:46.873 INFO:tasks.workunit.client.0.smithi005.stdout:2/812: symlink d0/d29/d89/l10d 0 2024-04-16T14:35:46.874 INFO:tasks.workunit.client.1.smithi115.stdout:0/699: write d6/d1b/f6c [4012973,110234] 0 2024-04-16T14:35:46.874 INFO:tasks.workunit.client.1.smithi115.stdout:0/700: write d6/d10/d94/fa5 [5121767,91799] 0 2024-04-16T14:35:46.874 INFO:tasks.workunit.client.0.smithi005.stdout:9/817: mknod d3/d12/d16/d46/d47/db1/cef 0 2024-04-16T14:35:46.876 INFO:tasks.workunit.client.1.smithi115.stdout:0/701: symlink d6/d30/lf2 0 2024-04-16T14:35:46.876 INFO:tasks.workunit.client.0.smithi005.stdout:2/813: mkdir d0/d29/d3e/dd2/d10e 0 2024-04-16T14:35:46.877 INFO:tasks.workunit.client.0.smithi005.stdout:9/818: unlink d3/laa 0 2024-04-16T14:35:46.877 INFO:tasks.workunit.client.1.smithi115.stdout:0/702: mkdir d6/d30/d8d/df3 0 2024-04-16T14:35:46.878 INFO:tasks.workunit.client.0.smithi005.stdout:2/814: creat d0/d2a/d3a/d46/ded/f10f x:0 0 0 2024-04-16T14:35:46.879 INFO:tasks.workunit.client.0.smithi005.stdout:9/819: symlink d3/d49/d4b/d5c/d65/d9a/lf0 0 2024-04-16T14:35:46.880 INFO:tasks.workunit.client.0.smithi005.stdout:2/815: symlink d0/d2a/d3a/d94/l110 0 2024-04-16T14:35:46.881 INFO:tasks.workunit.client.0.smithi005.stdout:2/816: chown d0/d4/f6 1346904 1 2024-04-16T14:35:46.881 INFO:tasks.workunit.client.0.smithi005.stdout:2/817: readlink d0/d2a/d3a/d46/l4a 0 2024-04-16T14:35:46.881 INFO:tasks.workunit.client.0.smithi005.stdout:2/818: chown d0/d1c/c30 8596 1 2024-04-16T14:35:46.881 INFO:tasks.workunit.client.0.smithi005.stdout:9/820: getdents d3/d49/d4b/d5c/d65/d9a/da9/db4 0 2024-04-16T14:35:46.882 INFO:tasks.workunit.client.1.smithi115.stdout:3/909: write dc/f23 [2557557,63881] 0 2024-04-16T14:35:46.882 INFO:tasks.workunit.client.1.smithi115.stdout:5/865: sync 2024-04-16T14:35:46.882 INFO:tasks.workunit.client.1.smithi115.stdout:9/973: sync 2024-04-16T14:35:46.882 INFO:tasks.workunit.client.1.smithi115.stdout:5/866: write dc/f2b [8100854,99250] 0 2024-04-16T14:35:46.883 INFO:tasks.workunit.client.1.smithi115.stdout:9/974: symlink d1/d6/d2d/d4b/d8f/d91/dda/ddd/dfc/d153/l156 0 2024-04-16T14:35:46.883 INFO:tasks.workunit.client.1.smithi115.stdout:9/975: chown d1/d6/d29/lf5 55 1 2024-04-16T14:35:46.883 INFO:tasks.workunit.client.1.smithi115.stdout:9/976: write d1/d7f/f97 [863853,61187] 0 2024-04-16T14:35:46.883 INFO:tasks.workunit.client.0.smithi005.stdout:2/819: creat d0/d1c/d59/d7a/f111 x:0 0 0 2024-04-16T14:35:46.885 INFO:tasks.workunit.client.1.smithi115.stdout:5/867: rename dc/d3d/d41/l75 to dc/d15/d2d/d8c/d101/l107 0 2024-04-16T14:35:46.887 INFO:tasks.workunit.client.1.smithi115.stdout:3/910: mkdir dc/d29/d77/d12f 0 2024-04-16T14:35:46.889 INFO:tasks.workunit.client.0.smithi005.stdout:9/821: creat d3/d49/d4b/d5c/d65/d9a/daf/de0/ff1 x:0 0 0 2024-04-16T14:35:46.889 INFO:tasks.workunit.client.0.smithi005.stdout:9/822: chown d3 420936457 1 2024-04-16T14:35:46.890 INFO:tasks.workunit.client.1.smithi115.stdout:3/911: mkdir dc/d29/d4d/d56/d130 0 2024-04-16T14:35:46.892 INFO:tasks.workunit.client.1.smithi115.stdout:0/703: dread d6/d10/d94/fa5 [0,4194304] 0 2024-04-16T14:35:46.893 INFO:tasks.workunit.client.1.smithi115.stdout:3/912: creat dc/d29/d4d/d56/d126/f131 x:0 0 0 2024-04-16T14:35:46.893 INFO:tasks.workunit.client.1.smithi115.stdout:3/913: creat dc/d29/d77/f132 x:0 0 0 2024-04-16T14:35:46.893 INFO:tasks.workunit.client.1.smithi115.stdout:0/704: creat d6/d54/ff4 x:0 0 0 2024-04-16T14:35:46.900 INFO:tasks.workunit.client.1.smithi115.stdout:5/868: write dc/d15/d35/f3f [54107,43619] 0 2024-04-16T14:35:46.901 INFO:tasks.workunit.client.1.smithi115.stdout:5/869: symlink dc/d15/d35/l108 0 2024-04-16T14:35:46.905 INFO:tasks.workunit.client.1.smithi115.stdout:5/870: rmdir dc/d5d 39 2024-04-16T14:35:46.906 INFO:tasks.workunit.client.1.smithi115.stdout:3/914: dread dc/d29/d4d/d56/d126/d4b/da3/d69/fa1 [0,4194304] 0 2024-04-16T14:35:46.906 INFO:tasks.workunit.client.1.smithi115.stdout:3/915: write dc/d29/d4d/d56/d7e/d11b/f12d [58746,79247] 0 2024-04-16T14:35:46.907 INFO:tasks.workunit.client.1.smithi115.stdout:3/916: mkdir dc/d29/d4d/d56/d126/d4b/da3/d69/de1/d133 0 2024-04-16T14:35:46.907 INFO:tasks.workunit.client.1.smithi115.stdout:0/705: write d6/d10/d12/d31/d35/d44/dc9/fcf [642866,97737] 0 2024-04-16T14:35:46.911 INFO:tasks.workunit.client.1.smithi115.stdout:3/917: write dc/d24/f6f [1585661,36333] 0 2024-04-16T14:35:46.911 INFO:tasks.workunit.client.1.smithi115.stdout:3/918: stat dc/d29/fda 0 2024-04-16T14:35:46.914 INFO:tasks.workunit.client.1.smithi115.stdout:3/919: symlink dc/d29/d39/d86/dd0/l134 0 2024-04-16T14:35:46.916 INFO:tasks.workunit.client.1.smithi115.stdout:3/920: link dc/ffd dc/d24/f135 0 2024-04-16T14:35:46.918 INFO:tasks.workunit.client.1.smithi115.stdout:3/921: rmdir dc/d29/d4d/d56/d126/dde 39 2024-04-16T14:35:46.921 INFO:tasks.workunit.client.0.smithi005.stdout:0/850: dwrite da/df/d26/d39/d55/f5e [0,4194304] 0 2024-04-16T14:35:46.922 INFO:tasks.workunit.client.0.smithi005.stdout:0/851: chown da/df/d26/d39/d55/d5c/le3 82 1 2024-04-16T14:35:46.923 INFO:tasks.workunit.client.0.smithi005.stdout:9/823: write d3/d12/d16/d46/fce [1552264,61357] 0 2024-04-16T14:35:46.923 INFO:tasks.workunit.client.1.smithi115.stdout:5/871: read f2 [5622456,125231] 0 2024-04-16T14:35:46.924 INFO:tasks.workunit.client.1.smithi115.stdout:3/922: write dc/d29/d4d/d56/d126/d4b/da3/d69/fa1 [1803971,50968] 0 2024-04-16T14:35:46.925 INFO:tasks.workunit.client.0.smithi005.stdout:9/824: creat d3/dd5/ff2 x:0 0 0 2024-04-16T14:35:46.925 INFO:tasks.workunit.client.0.smithi005.stdout:9/825: fdatasync d3/d12/d16/fc7 0 2024-04-16T14:35:46.925 INFO:tasks.workunit.client.0.smithi005.stdout:0/852: dread da/df/d26/d39/d55/ddc/f107 [0,4194304] 0 2024-04-16T14:35:46.925 INFO:tasks.workunit.client.0.smithi005.stdout:0/853: write da/df/d1b/d3a/d53/f61 [1011345,43455] 0 2024-04-16T14:35:46.925 INFO:tasks.workunit.client.0.smithi005.stdout:8/885: dwrite d5/d55/f6b [0,4194304] 0 2024-04-16T14:35:46.926 INFO:tasks.workunit.client.1.smithi115.stdout:5/872: rename dc/d5d/d81/d9a to dc/d3d/d109 0 2024-04-16T14:35:46.926 INFO:tasks.workunit.client.0.smithi005.stdout:9/826: symlink d3/d49/d4b/d5c/d65/d9a/daf/lf3 0 2024-04-16T14:35:46.927 INFO:tasks.workunit.client.0.smithi005.stdout:0/854: mkdir da/df/d26/da9/d108/d75/d124 0 2024-04-16T14:35:46.927 INFO:tasks.workunit.client.1.smithi115.stdout:5/873: chown dc/d3d/d68/d7b/lb1 4378573 1 2024-04-16T14:35:46.927 INFO:tasks.workunit.client.1.smithi115.stdout:5/874: chown dc/d15/d35/d71/l80 1 1 2024-04-16T14:35:46.927 INFO:tasks.workunit.client.1.smithi115.stdout:5/875: truncate dc/d3d/f5e 4228634 0 2024-04-16T14:35:46.927 INFO:tasks.workunit.client.1.smithi115.stdout:9/977: dwrite d1/d6/d2d/d4b/d60/d65/fc1 [0,4194304] 0 2024-04-16T14:35:46.928 INFO:tasks.workunit.client.0.smithi005.stdout:9/827: write d3/d49/d4b/d55/d7b/fba [529710,115075] 0 2024-04-16T14:35:46.928 INFO:tasks.workunit.client.0.smithi005.stdout:9/828: chown d3/d49/d4b/l7f 16 1 2024-04-16T14:35:46.928 INFO:tasks.workunit.client.0.smithi005.stdout:9/829: fsync d3/d12/f52 0 2024-04-16T14:35:46.928 INFO:tasks.workunit.client.0.smithi005.stdout:9/830: rmdir d3/d12/d16/d46/d47/d60/de9/dd6 39 2024-04-16T14:35:46.930 INFO:tasks.workunit.client.0.smithi005.stdout:9/831: creat d3/d49/d4b/d55/ff4 x:0 0 0 2024-04-16T14:35:46.930 INFO:tasks.workunit.client.0.smithi005.stdout:9/832: write d3/d49/d91/fe4 [617312,96795] 0 2024-04-16T14:35:46.934 INFO:tasks.workunit.client.0.smithi005.stdout:9/833: rename d3/c6d to d3/d49/d4b/cf5 0 2024-04-16T14:35:46.934 INFO:tasks.workunit.client.0.smithi005.stdout:9/834: write d3/f81 [1331159,79029] 0 2024-04-16T14:35:46.944 INFO:tasks.workunit.client.0.smithi005.stdout:8/886: dread d5/d55/d5a/fd5 [0,4194304] 0 2024-04-16T14:35:46.952 INFO:tasks.workunit.client.0.smithi005.stdout:0/855: dwrite da/f2d [4194304,4194304] 0 2024-04-16T14:35:46.953 INFO:tasks.workunit.client.1.smithi115.stdout:9/978: dwrite d1/d6/d2d/d4b/d6c/d20/df4/f12b [0,4194304] 0 2024-04-16T14:35:46.953 INFO:tasks.workunit.client.1.smithi115.stdout:3/923: dwrite dc/d29/d4d/d56/d126/d4b/d81/fb6 [0,4194304] 0 2024-04-16T14:35:46.953 INFO:tasks.workunit.client.0.smithi005.stdout:0/856: symlink da/df/d26/d39/d55/df8/d11b/l125 0 2024-04-16T14:35:46.956 INFO:tasks.workunit.client.0.smithi005.stdout:0/857: link da/df/d26/da9/d108/d75/d81/fb7 da/df/d1b/d3a/d53/dbc/f126 0 2024-04-16T14:35:46.956 INFO:tasks.workunit.client.1.smithi115.stdout:9/979: mknod d1/d6/d29/c157 0 2024-04-16T14:35:46.958 INFO:tasks.workunit.client.1.smithi115.stdout:3/924: creat dc/d29/d4d/d56/d126/dde/d120/f136 x:0 0 0 2024-04-16T14:35:46.958 INFO:tasks.workunit.client.1.smithi115.stdout:3/925: write dc/d29/d4d/d56/d7e/f111 [1782562,76269] 0 2024-04-16T14:35:46.962 INFO:tasks.workunit.client.1.smithi115.stdout:3/926: rmdir dc/d29/d4d/d56/d98 39 2024-04-16T14:35:46.962 INFO:tasks.workunit.client.1.smithi115.stdout:3/927: stat dc/d29/ce4 0 2024-04-16T14:35:46.964 INFO:tasks.workunit.client.1.smithi115.stdout:3/928: rmdir dc/d24/d80/dfc/d11a/d124 0 2024-04-16T14:35:46.968 INFO:tasks.workunit.client.1.smithi115.stdout:3/929: rename dc/d29/d4d/d56/d126/d4b/da3/d69 to dc/d29/d39/d86/dd0/dee/d137 0 2024-04-16T14:35:46.969 INFO:tasks.workunit.client.1.smithi115.stdout:3/930: truncate dc/d29/d39/d86/dd0/dee/d137/de1/feb 746501 0 2024-04-16T14:35:46.969 INFO:tasks.workunit.client.1.smithi115.stdout:9/980: dread d1/d6/d33/f85 [0,4194304] 0 2024-04-16T14:35:46.971 INFO:tasks.workunit.client.0.smithi005.stdout:9/835: rmdir d3/d49/d4b/d5c/d65 39 2024-04-16T14:35:46.971 INFO:tasks.workunit.client.0.smithi005.stdout:9/836: write d3/d49/d4b/d55/fdc [867898,103433] 0 2024-04-16T14:35:46.973 INFO:tasks.workunit.client.1.smithi115.stdout:9/981: dread d1/d6/d2d/d3d/d50/f5e [0,4194304] 0 2024-04-16T14:35:46.979 INFO:tasks.workunit.client.1.smithi115.stdout:5/876: dwrite dc/f1f [0,4194304] 0 2024-04-16T14:35:46.979 INFO:tasks.workunit.client.0.smithi005.stdout:8/887: dwrite d5/f43 [0,4194304] 0 2024-04-16T14:35:46.979 INFO:tasks.workunit.client.0.smithi005.stdout:8/888: dread - d5/d55/d5a/d135/d7f/d8d/f12f zero size 2024-04-16T14:35:46.979 INFO:tasks.workunit.client.0.smithi005.stdout:8/889: fsync d5/da0/f100 0 2024-04-16T14:35:46.980 INFO:tasks.workunit.client.1.smithi115.stdout:3/931: dread dc/d29/d4d/d56/d7e/f99 [0,4194304] 0 2024-04-16T14:35:46.980 INFO:tasks.workunit.client.0.smithi005.stdout:8/890: getdents d5/d7b/da8 0 2024-04-16T14:35:46.980 INFO:tasks.workunit.client.0.smithi005.stdout:8/891: write d5/d55/f125 [586105,105273] 0 2024-04-16T14:35:46.981 INFO:tasks.workunit.client.0.smithi005.stdout:8/892: truncate d5/d55/fe0 659642 0 2024-04-16T14:35:46.982 INFO:tasks.workunit.client.1.smithi115.stdout:3/932: mkdir dc/d24/d80/dfc/d138 0 2024-04-16T14:35:46.984 INFO:tasks.workunit.client.1.smithi115.stdout:3/933: symlink dc/d29/d4d/d56/d126/d4b/da3/l139 0 2024-04-16T14:35:46.984 INFO:tasks.workunit.client.1.smithi115.stdout:3/934: fsync dc/d29/d4d/f129 0 2024-04-16T14:35:46.984 INFO:tasks.workunit.client.1.smithi115.stdout:3/935: readlink dc/d29/l2c 0 2024-04-16T14:35:46.985 INFO:tasks.workunit.client.1.smithi115.stdout:3/936: mknod dc/d24/d36/d60/dae/c13a 0 2024-04-16T14:35:46.985 INFO:tasks.workunit.client.1.smithi115.stdout:3/937: dread - dc/d24/fcd zero size 2024-04-16T14:35:46.988 INFO:tasks.workunit.client.0.smithi005.stdout:9/837: dwrite d3/d12/f6c [0,4194304] 0 2024-04-16T14:35:46.988 INFO:tasks.workunit.client.1.smithi115.stdout:9/982: rmdir d1/d6/d2d 39 2024-04-16T14:35:46.989 INFO:tasks.workunit.client.1.smithi115.stdout:3/938: unlink dc/d29/fda 0 2024-04-16T14:35:46.989 INFO:tasks.workunit.client.1.smithi115.stdout:3/939: creat dc/d29/d39/d106/f13b x:0 0 0 2024-04-16T14:35:46.990 INFO:tasks.workunit.client.0.smithi005.stdout:9/838: write d3/d49/d4b/d55/f9f [3567864,23286] 0 2024-04-16T14:35:46.990 INFO:tasks.workunit.client.1.smithi115.stdout:5/877: mkdir dc/d15/df6/d10a 0 2024-04-16T14:35:46.991 INFO:tasks.workunit.client.1.smithi115.stdout:9/983: rmdir d1/d6/d2d/d3d/db7 39 2024-04-16T14:35:46.991 INFO:tasks.workunit.client.1.smithi115.stdout:9/984: fdatasync d1/d6/d2d/d3d/fa5 0 2024-04-16T14:35:46.992 INFO:tasks.workunit.client.1.smithi115.stdout:2/959: sync 2024-04-16T14:35:46.992 INFO:tasks.workunit.client.1.smithi115.stdout:4/852: sync 2024-04-16T14:35:46.993 INFO:tasks.workunit.client.1.smithi115.stdout:4/853: dread - d1/d15/d24/fd2 zero size 2024-04-16T14:35:46.993 INFO:tasks.workunit.client.1.smithi115.stdout:2/960: fdatasync d0/d47/d65/dad/dc8/d24/d23/d80/f109 0 2024-04-16T14:35:46.993 INFO:tasks.workunit.client.1.smithi115.stdout:9/985: mkdir d1/d6/d2d/d4b/d8f/d91/dd1/d158 0 2024-04-16T14:35:46.993 INFO:tasks.workunit.client.0.smithi005.stdout:0/858: write da/df/d26/da9/d108/f38 [112565,63147] 0 2024-04-16T14:35:46.994 INFO:tasks.workunit.client.1.smithi115.stdout:2/961: creat d0/d47/d65/dad/dc8/d57/d117/f13b x:0 0 0 2024-04-16T14:35:46.994 INFO:tasks.workunit.client.1.smithi115.stdout:2/962: dread - d0/d47/d65/dad/dbb/d11/d36/f137 zero size 2024-04-16T14:35:46.994 INFO:tasks.workunit.client.1.smithi115.stdout:2/963: stat d0/d47/d65/dad/dc8/d24/d10/ffc 0 2024-04-16T14:35:46.995 INFO:tasks.workunit.client.1.smithi115.stdout:9/986: mkdir d1/d6/db8/d159 0 2024-04-16T14:35:46.995 INFO:tasks.workunit.client.1.smithi115.stdout:2/964: dread d0/d47/d65/d61/dae/f6f [0,4194304] 0 2024-04-16T14:35:46.995 INFO:tasks.workunit.client.0.smithi005.stdout:0/859: creat da/df/d1b/d71/f127 x:0 0 0 2024-04-16T14:35:46.997 INFO:tasks.workunit.client.1.smithi115.stdout:2/965: truncate d0/d1b/f99 3884808 0 2024-04-16T14:35:46.998 INFO:tasks.workunit.client.1.smithi115.stdout:2/966: creat d0/d47/d65/d61/dae/f13c x:0 0 0 2024-04-16T14:35:47.000 INFO:tasks.workunit.client.1.smithi115.stdout:3/940: write dc/d24/d36/d60/dae/fb7 [4044492,1374] 0 2024-04-16T14:35:47.000 INFO:tasks.workunit.client.1.smithi115.stdout:5/878: read dc/d3d/d68/d7b/f89 [38115,28809] 0 2024-04-16T14:35:47.000 INFO:tasks.workunit.client.1.smithi115.stdout:3/941: write dc/d29/d4d/d56/d126/dde/fe2 [535869,67645] 0 2024-04-16T14:35:47.001 INFO:tasks.workunit.client.1.smithi115.stdout:2/967: unlink d0/d47/d65/dad/dbb/ff3 0 2024-04-16T14:35:47.001 INFO:tasks.workunit.client.1.smithi115.stdout:2/968: write d0/d47/d65/dad/dbb/d11/d36/fc1 [738441,8662] 0 2024-04-16T14:35:47.001 INFO:tasks.workunit.client.1.smithi115.stdout:2/969: dread - d0/d47/d65/dad/dc8/d57/f119 zero size 2024-04-16T14:35:47.001 INFO:tasks.workunit.client.1.smithi115.stdout:5/879: symlink dc/d3d/d109/l10b 0 2024-04-16T14:35:47.003 INFO:tasks.workunit.client.1.smithi115.stdout:5/880: creat dc/f10c x:0 0 0 2024-04-16T14:35:47.003 INFO:tasks.workunit.client.1.smithi115.stdout:5/881: dread - dc/d5d/dc2/fe4 zero size 2024-04-16T14:35:47.004 INFO:tasks.workunit.client.1.smithi115.stdout:2/970: getdents d0/d47/d65/dad/dc8/d24/d23/d71 0 2024-04-16T14:35:47.005 INFO:tasks.workunit.client.1.smithi115.stdout:2/971: fsync d0/d47/d65/dad/dc8/d24/d23/d71/f8c 0 2024-04-16T14:35:47.005 INFO:tasks.workunit.client.1.smithi115.stdout:4/854: dread d1/d15/d1e/f6e [0,4194304] 0 2024-04-16T14:35:47.009 INFO:tasks.workunit.client.1.smithi115.stdout:4/855: mknod d1/d15/c10a 0 2024-04-16T14:35:47.015 INFO:tasks.workunit.client.0.smithi005.stdout:0/860: read da/df/d1b/d3a/ffe [3036937,7572] 0 2024-04-16T14:35:47.015 INFO:tasks.workunit.client.0.smithi005.stdout:0/861: fdatasync da/df/d26/d39/fff 0 2024-04-16T14:35:47.015 INFO:tasks.workunit.client.0.smithi005.stdout:0/862: creat da/f128 x:0 0 0 2024-04-16T14:35:47.015 INFO:tasks.workunit.client.0.smithi005.stdout:0/863: dread - da/df/d26/d39/d55/ddc/ffc zero size 2024-04-16T14:35:47.016 INFO:tasks.workunit.client.0.smithi005.stdout:0/864: chown da/df 0 1 2024-04-16T14:35:47.016 INFO:tasks.workunit.client.0.smithi005.stdout:0/865: chown da/ffb 914516 1 2024-04-16T14:35:47.016 INFO:tasks.workunit.client.0.smithi005.stdout:0/866: creat da/df/d26/d39/d55/d5c/da8/f129 x:0 0 0 2024-04-16T14:35:47.016 INFO:tasks.workunit.client.0.smithi005.stdout:8/893: dwrite d5/d11/f44 [0,4194304] 0 2024-04-16T14:35:47.017 INFO:tasks.workunit.client.1.smithi115.stdout:9/987: dread d1/d6/d2d/d4b/d8f/f95 [0,4194304] 0 2024-04-16T14:35:47.017 INFO:tasks.workunit.client.1.smithi115.stdout:2/972: dread d0/f2d [0,4194304] 0 2024-04-16T14:35:47.017 INFO:tasks.workunit.client.1.smithi115.stdout:2/973: dread - d0/d47/d65/dad/dbb/d11/d25/d95/f127 zero size 2024-04-16T14:35:47.017 INFO:tasks.workunit.client.1.smithi115.stdout:2/974: write d0/d47/d65/d61/dae/ff1 [669126,126405] 0 2024-04-16T14:35:47.018 INFO:tasks.workunit.client.1.smithi115.stdout:9/988: creat d1/d6/d2d/d4b/d6c/d10a/f15a x:0 0 0 2024-04-16T14:35:47.020 INFO:tasks.workunit.client.0.smithi005.stdout:0/867: rename da/f20 to da/df/d26/d39/f12a 0 2024-04-16T14:35:47.020 INFO:tasks.workunit.client.1.smithi115.stdout:2/975: creat d0/d1b/f13d x:0 0 0 2024-04-16T14:35:47.022 INFO:tasks.workunit.client.0.smithi005.stdout:8/894: mknod d5/d7b/da8/db7/d8a/da1/d68/dcb/dd9/c138 0 2024-04-16T14:35:47.022 INFO:tasks.workunit.client.0.smithi005.stdout:8/895: chown d5/d7b/da8 66506 1 2024-04-16T14:35:47.022 INFO:tasks.workunit.client.0.smithi005.stdout:8/896: readlink d5/d7b/da8/db7/d8a/l11b 0 2024-04-16T14:35:47.023 INFO:tasks.workunit.client.0.smithi005.stdout:8/897: creat d5/d11/f139 x:0 0 0 2024-04-16T14:35:47.024 INFO:tasks.workunit.client.1.smithi115.stdout:2/976: creat d0/d47/d65/dad/dc8/d24/d21/f13e x:0 0 0 2024-04-16T14:35:47.024 INFO:tasks.workunit.client.1.smithi115.stdout:2/977: getdents d0/d47/d65/dad/dc8/d24/d23/d71 0 2024-04-16T14:35:47.026 INFO:tasks.workunit.client.0.smithi005.stdout:8/898: creat d5/d7b/da8/db7/f13a x:0 0 0 2024-04-16T14:35:47.026 INFO:tasks.workunit.client.1.smithi115.stdout:2/978: getdents d0/d47/d65/dad/dc8/d24/d23/d83 0 2024-04-16T14:35:47.026 INFO:tasks.workunit.client.0.smithi005.stdout:8/899: symlink d5/da0/l13b 0 2024-04-16T14:35:47.029 INFO:tasks.workunit.client.1.smithi115.stdout:2/979: mkdir d0/d47/d65/dad/dc8/d24/d23/d83/de7/d13f 0 2024-04-16T14:35:47.030 INFO:tasks.workunit.client.1.smithi115.stdout:2/980: stat d0/d1b/lf2 0 2024-04-16T14:35:47.030 INFO:tasks.workunit.client.1.smithi115.stdout:9/989: write d1/d6/d2d/d4b/d6c/d20/d36/dce/fea [108776,52342] 0 2024-04-16T14:35:47.030 INFO:tasks.workunit.client.1.smithi115.stdout:9/990: truncate d1/d6/f67 1059651 0 2024-04-16T14:35:47.039 INFO:tasks.workunit.client.0.smithi005.stdout:8/900: dread d5/d40/d4b/f10b [0,4194304] 0 2024-04-16T14:35:47.039 INFO:tasks.workunit.client.1.smithi115.stdout:9/991: dread d1/d6/d2d/d4b/d90/fa0 [0,4194304] 0 2024-04-16T14:35:47.040 INFO:tasks.workunit.client.0.smithi005.stdout:8/901: mkdir d5/d7b/d13c 0 2024-04-16T14:35:47.040 INFO:tasks.workunit.client.0.smithi005.stdout:8/902: chown d5/d55/d5a/d10a 181 1 2024-04-16T14:35:47.042 INFO:tasks.workunit.client.1.smithi115.stdout:3/942: dwrite dc/d29/d4d/f129 [0,4194304] 0 2024-04-16T14:35:47.042 INFO:tasks.workunit.client.1.smithi115.stdout:5/882: dwrite dc/d15/d4d/fdb [0,4194304] 0 2024-04-16T14:35:47.042 INFO:tasks.workunit.client.1.smithi115.stdout:5/883: chown dc/d79/fb7 4208 1 2024-04-16T14:35:47.042 INFO:tasks.workunit.client.1.smithi115.stdout:5/884: chown dc/d3d/f6a 903 1 2024-04-16T14:35:47.042 INFO:tasks.workunit.client.1.smithi115.stdout:5/885: fdatasync dc/d3d/d68/d7b/df7/f102 0 2024-04-16T14:35:47.042 INFO:tasks.workunit.client.1.smithi115.stdout:3/943: write dc/f21 [4885300,108769] 0 2024-04-16T14:35:47.042 INFO:tasks.workunit.client.0.smithi005.stdout:8/903: rename d5/d7b/da8/db7/d74/f11d to d5/d7b/d13c/f13d 0 2024-04-16T14:35:47.043 INFO:tasks.workunit.client.0.smithi005.stdout:8/904: unlink d5/d7b/da8/db7/d8a/c92 0 2024-04-16T14:35:47.043 INFO:tasks.workunit.client.0.smithi005.stdout:8/905: write d5/d55/d5a/d135/d7f/d8d/f127 [670921,27121] 0 2024-04-16T14:35:47.045 INFO:tasks.workunit.client.1.smithi115.stdout:3/944: symlink dc/d29/d4d/d56/d126/dde/d120/l13c 0 2024-04-16T14:35:47.047 INFO:tasks.workunit.client.0.smithi005.stdout:9/839: truncate d3/d49/d91/fe4 234141 0 2024-04-16T14:35:47.047 INFO:tasks.workunit.client.1.smithi115.stdout:4/856: dwrite d1/d15/d17/d9e/ddf/ff5 [0,4194304] 0 2024-04-16T14:35:47.052 INFO:tasks.workunit.client.0.smithi005.stdout:8/906: dread d5/d7b/da8/db7/d8a/da1/f114 [0,4194304] 0 2024-04-16T14:35:47.054 INFO:tasks.workunit.client.0.smithi005.stdout:0/868: dwrite da/df/d1b/d3a/f4d [8388608,4194304] 0 2024-04-16T14:35:47.054 INFO:tasks.workunit.client.1.smithi115.stdout:2/981: rmdir d0 39 2024-04-16T14:35:47.054 INFO:tasks.workunit.client.1.smithi115.stdout:2/982: fsync d0/d1b/f38 0 2024-04-16T14:35:47.058 INFO:tasks.workunit.client.0.smithi005.stdout:8/907: dread d5/d55/d5a/fd5 [0,4194304] 0 2024-04-16T14:35:47.058 INFO:tasks.workunit.client.0.smithi005.stdout:8/908: getdents d5/d7b/da8/db7/d132 0 2024-04-16T14:35:47.058 INFO:tasks.workunit.client.1.smithi115.stdout:4/857: mknod d1/d15/d31/d42/d46/d7a/d105/c10b 0 2024-04-16T14:35:47.061 INFO:tasks.workunit.client.1.smithi115.stdout:2/983: mkdir d0/d47/d65/dad/dc8/d24/d23/d140 0 2024-04-16T14:35:47.062 INFO:tasks.workunit.client.1.smithi115.stdout:4/858: symlink d1/d15/d24/dc6/l10c 0 2024-04-16T14:35:47.062 INFO:tasks.workunit.client.1.smithi115.stdout:2/984: rmdir d0/d47/d65/dad/dbb/d11/d36/d86 39 2024-04-16T14:35:47.062 INFO:tasks.workunit.client.1.smithi115.stdout:2/985: truncate d0/d47/d65/dad/dc8/d57/f119 943941 0 2024-04-16T14:35:47.063 INFO:tasks.workunit.client.1.smithi115.stdout:4/859: symlink d1/d15/d31/d55/l10d 0 2024-04-16T14:35:47.064 INFO:tasks.workunit.client.1.smithi115.stdout:4/860: truncate d1/d15/d24/dc6/fd5 348596 0 2024-04-16T14:35:47.065 INFO:tasks.workunit.client.0.smithi005.stdout:8/909: creat d5/d7b/da8/da5/def/d71/f13e x:0 0 0 2024-04-16T14:35:47.065 INFO:tasks.workunit.client.1.smithi115.stdout:4/861: truncate d1/d15/d24/f40 3593526 0 2024-04-16T14:35:47.066 INFO:tasks.workunit.client.1.smithi115.stdout:4/862: symlink d1/d15/d9c/l10e 0 2024-04-16T14:35:47.067 INFO:tasks.workunit.client.0.smithi005.stdout:8/910: rename d5/d7b/da8/da5/def/d71/ff2 to d5/d55/d5a/d135/dba/dcd/f13f 0 2024-04-16T14:35:47.069 INFO:tasks.workunit.client.0.smithi005.stdout:8/911: rename d5/d7b/da8/db7/f73 to d5/d11/f140 0 2024-04-16T14:35:47.070 INFO:tasks.workunit.client.0.smithi005.stdout:8/912: creat d5/da0/f141 x:0 0 0 2024-04-16T14:35:47.070 INFO:tasks.workunit.client.0.smithi005.stdout:8/913: fdatasync d5/d55/d5a/fc1 0 2024-04-16T14:35:47.076 INFO:tasks.workunit.client.0.smithi005.stdout:8/914: dread d5/d55/d5a/d135/d7f/d8d/dd1/f108 [4194304,4194304] 0 2024-04-16T14:35:47.079 INFO:tasks.workunit.client.1.smithi115.stdout:2/986: dread d0/d1b/fc0 [0,4194304] 0 2024-04-16T14:35:47.079 INFO:tasks.workunit.client.1.smithi115.stdout:4/863: write d1/d15/f34 [699816,124862] 0 2024-04-16T14:35:47.081 INFO:tasks.workunit.client.1.smithi115.stdout:2/987: mknod d0/d47/d65/dad/dc8/d57/d117/c141 0 2024-04-16T14:35:47.081 INFO:tasks.workunit.client.1.smithi115.stdout:2/988: chown d0/d47/d65/dad/dbb/d11/d25/f12c 12 1 2024-04-16T14:35:47.084 INFO:tasks.workunit.client.1.smithi115.stdout:4/864: rename d1/d15/d1e/f6e to d1/d15/d31/f10f 0 2024-04-16T14:35:47.084 INFO:tasks.workunit.client.1.smithi115.stdout:4/865: chown d1/d15/d31/d42/da4/fdc 0 1 2024-04-16T14:35:47.084 INFO:tasks.workunit.client.1.smithi115.stdout:4/866: readlink d1/d15/d17/ld3 0 2024-04-16T14:35:47.085 INFO:tasks.workunit.client.1.smithi115.stdout:4/867: read - d1/f108 zero size 2024-04-16T14:35:47.085 INFO:tasks.workunit.client.1.smithi115.stdout:4/868: creat d1/d15/d31/d89/f110 x:0 0 0 2024-04-16T14:35:47.085 INFO:tasks.workunit.client.0.smithi005.stdout:0/869: dwrite da/df/d26/da9/d108/f3d [0,4194304] 0 2024-04-16T14:35:47.086 INFO:tasks.workunit.client.0.smithi005.stdout:0/870: write da/df/d1b/d3a/d53/fad [1443104,69795] 0 2024-04-16T14:35:47.086 INFO:tasks.workunit.client.1.smithi115.stdout:9/992: dwrite d1/d6/d2d/d3d/d50/f5e [4194304,4194304] 0 2024-04-16T14:35:47.086 INFO:tasks.workunit.client.1.smithi115.stdout:9/993: write d1/d6/d2d/d4b/d60/fc2 [906165,57587] 0 2024-04-16T14:35:47.086 INFO:tasks.workunit.client.1.smithi115.stdout:5/886: dwrite dc/d15/d4d/f76 [0,4194304] 0 2024-04-16T14:35:47.086 INFO:tasks.workunit.client.1.smithi115.stdout:3/945: dwrite dc/d29/d4d/d56/d126/ff4 [0,4194304] 0 2024-04-16T14:35:47.087 INFO:tasks.workunit.client.0.smithi005.stdout:9/840: dwrite d3/d49/f66 [0,4194304] 0 2024-04-16T14:35:47.088 INFO:tasks.workunit.client.1.smithi115.stdout:4/869: creat d1/d15/f111 x:0 0 0 2024-04-16T14:35:47.089 INFO:tasks.workunit.client.1.smithi115.stdout:4/870: write d1/d15/d17/f92 [1219754,50312] 0 2024-04-16T14:35:47.089 INFO:tasks.workunit.client.1.smithi115.stdout:3/946: dread dc/d24/f119 [0,4194304] 0 2024-04-16T14:35:47.089 INFO:tasks.workunit.client.1.smithi115.stdout:9/994: symlink d1/d6/d2d/d4b/d8f/d91/dda/ddd/dfc/d120/l15b 0 2024-04-16T14:35:47.091 INFO:tasks.workunit.client.0.smithi005.stdout:9/841: mknod d3/d49/d4b/d5c/d65/d9a/da9/db4/cf6 0 2024-04-16T14:35:47.098 INFO:tasks.workunit.client.0.smithi005.stdout:8/915: dwrite d5/d40/d8e/f12e [0,4194304] 0 2024-04-16T14:35:47.099 INFO:tasks.workunit.client.1.smithi115.stdout:3/947: mknod dc/d29/d4d/d56/d98/dbe/c13d 0 2024-04-16T14:35:47.099 INFO:tasks.workunit.client.1.smithi115.stdout:3/948: write dc/d29/d39/d86/dd0/dee/d137/fa1 [1727600,29618] 0 2024-04-16T14:35:47.099 INFO:tasks.workunit.client.1.smithi115.stdout:5/887: unlink dc/d8e/fab 0 2024-04-16T14:35:47.099 INFO:tasks.workunit.client.1.smithi115.stdout:5/888: chown dc/d3d/d41 1598248 1 2024-04-16T14:35:47.099 INFO:tasks.workunit.client.1.smithi115.stdout:5/889: write dc/d3d/d41/f54 [5099155,118644] 0 2024-04-16T14:35:47.101 INFO:tasks.workunit.client.1.smithi115.stdout:4/871: mknod d1/d15/d31/d42/d46/d7a/c112 0 2024-04-16T14:35:47.105 INFO:tasks.workunit.client.1.smithi115.stdout:3/949: mkdir dc/d29/d4d/d56/d7e/d11b/d125/d13e 0 2024-04-16T14:35:47.107 INFO:tasks.workunit.client.1.smithi115.stdout:3/950: mkdir dc/d29/d39/d86/dd0/dee/d137/de1/d133/d13f 0 2024-04-16T14:35:47.107 INFO:tasks.workunit.client.1.smithi115.stdout:3/951: creat dc/d29/d77/f140 x:0 0 0 2024-04-16T14:35:47.107 INFO:tasks.workunit.client.1.smithi115.stdout:3/952: fdatasync dc/f16 0 2024-04-16T14:35:47.107 INFO:tasks.workunit.client.1.smithi115.stdout:8/914: sync 2024-04-16T14:35:47.107 INFO:tasks.workunit.client.1.smithi115.stdout:3/953: write dc/d24/d36/d60/ff3 [4718882,101643] 0 2024-04-16T14:35:47.107 INFO:tasks.workunit.client.1.smithi115.stdout:8/915: fdatasync d0/db/d10/d17/d2c/d52/d74/d3b/d56/dfc/f10b 0 2024-04-16T14:35:47.110 INFO:tasks.workunit.client.1.smithi115.stdout:4/872: rename d1/d15/d31/d42/f4a to d1/d15/d31/dc2/de4/f113 0 2024-04-16T14:35:47.113 INFO:tasks.workunit.client.1.smithi115.stdout:2/989: dwrite d0/f2d [0,4194304] 0 2024-04-16T14:35:47.115 INFO:tasks.workunit.client.1.smithi115.stdout:2/990: rmdir d0/d47/d65/dad/dc8/d57/d117 39 2024-04-16T14:35:47.115 INFO:tasks.workunit.client.1.smithi115.stdout:2/991: chown d0/d47/d65/dad/dbb/d11/d36/d86 67 1 2024-04-16T14:35:47.115 INFO:tasks.workunit.client.1.smithi115.stdout:2/992: dread - d0/d47/d65/dad/dbb/d11/d25/d95/f127 zero size 2024-04-16T14:35:47.115 INFO:tasks.workunit.client.1.smithi115.stdout:2/993: stat d0/d47/d65/dad/dbb/d11/d25/d95/d124 0 2024-04-16T14:35:47.115 INFO:tasks.workunit.client.1.smithi115.stdout:3/954: link dc/ff dc/d29/d77/f141 0 2024-04-16T14:35:47.116 INFO:tasks.workunit.client.0.smithi005.stdout:0/871: dwrite da/df/d26/da9/d108/f9c [0,4194304] 0 2024-04-16T14:35:47.116 INFO:tasks.workunit.client.1.smithi115.stdout:2/994: creat d0/d47/d65/dad/dc8/d24/d23/d129/f142 x:0 0 0 2024-04-16T14:35:47.117 INFO:tasks.workunit.client.1.smithi115.stdout:2/995: write d0/d47/d65/dad/dc8/d24/f44 [939185,72939] 0 2024-04-16T14:35:47.117 INFO:tasks.workunit.client.1.smithi115.stdout:8/916: link d0/db/dbb/dcd/fc6 d0/db/d10/d17/d2c/d52/d6c/dd9/f131 0 2024-04-16T14:35:47.119 INFO:tasks.workunit.client.1.smithi115.stdout:2/996: creat d0/d47/d65/dad/dc8/d24/da0/f143 x:0 0 0 2024-04-16T14:35:47.121 INFO:tasks.workunit.client.1.smithi115.stdout:4/873: dread d1/f88 [4194304,4194304] 0 2024-04-16T14:35:47.122 INFO:tasks.workunit.client.1.smithi115.stdout:8/917: rename d0/db/dbb/dcd/dae to d0/de5/d132 0 2024-04-16T14:35:47.123 INFO:tasks.workunit.client.1.smithi115.stdout:4/874: creat d1/d15/d9c/f114 x:0 0 0 2024-04-16T14:35:47.124 INFO:tasks.workunit.client.1.smithi115.stdout:2/997: rename d0/d47/d65/c98 to d0/d47/d65/dad/dbb/d11/c144 0 2024-04-16T14:35:47.124 INFO:tasks.workunit.client.0.smithi005.stdout:0/872: dread da/df/d26/da9/d108/f3d [0,4194304] 0 2024-04-16T14:35:47.125 INFO:tasks.workunit.client.1.smithi115.stdout:4/875: rmdir d1/d15/d31/d42/d46/d7a/d105 39 2024-04-16T14:35:47.125 INFO:tasks.workunit.client.1.smithi115.stdout:8/918: mknod d0/db/d10/d17/d22/deb/d7c/dc0/df0/c133 0 2024-04-16T14:35:47.125 INFO:tasks.workunit.client.1.smithi115.stdout:8/919: chown d0/db/d10/l2e 8069 1 2024-04-16T14:35:47.125 INFO:tasks.workunit.client.0.smithi005.stdout:0/873: truncate da/df/d26/f4c 3378883 0 2024-04-16T14:35:47.126 INFO:tasks.workunit.client.1.smithi115.stdout:2/998: getdents d0/d47/d65/dad/dc8 0 2024-04-16T14:35:47.126 INFO:tasks.workunit.client.1.smithi115.stdout:2/999: chown d0/d47/d65/dad/dc8/d24/d23/d83/fd7 29877 1 2024-04-16T14:35:47.126 INFO:tasks.workunit.client.1.smithi115.stdout:4/876: mkdir d1/d15/d31/d55/d115 0 2024-04-16T14:35:47.127 INFO:tasks.workunit.client.0.smithi005.stdout:0/874: dread da/f1f [4194304,4194304] 0 2024-04-16T14:35:47.127 INFO:tasks.workunit.client.0.smithi005.stdout:9/842: dwrite d3/f8a [0,4194304] 0 2024-04-16T14:35:47.128 INFO:tasks.workunit.client.1.smithi115.stdout:4/877: symlink d1/d15/d17/de6/l116 0 2024-04-16T14:35:47.130 INFO:tasks.workunit.client.1.smithi115.stdout:4/878: unlink d1/f88 0 2024-04-16T14:35:47.130 INFO:tasks.workunit.client.1.smithi115.stdout:4/879: chown d1/d15/d17/f21 956 1 2024-04-16T14:35:47.131 INFO:tasks.workunit.client.0.smithi005.stdout:0/875: symlink da/df/d26/l12b 0 2024-04-16T14:35:47.131 INFO:tasks.workunit.client.1.smithi115.stdout:4/880: truncate d1/f4 2144163 0 2024-04-16T14:35:47.132 INFO:tasks.workunit.client.1.smithi115.stdout:4/881: stat d1/d15/d17/fa9 0 2024-04-16T14:35:47.132 INFO:tasks.workunit.client.0.smithi005.stdout:9/843: getdents d3/d12/d2b 0 2024-04-16T14:35:47.133 INFO:tasks.workunit.client.1.smithi115.stdout:4/882: creat d1/d15/d17/f117 x:0 0 0 2024-04-16T14:35:47.133 INFO:tasks.workunit.client.0.smithi005.stdout:0/876: mknod da/df/d1b/d3a/c12c 0 2024-04-16T14:35:47.134 INFO:tasks.workunit.client.1.smithi115.stdout:4/883: mkdir d1/d15/d31/d42/da4/d118 0 2024-04-16T14:35:47.135 INFO:tasks.workunit.client.0.smithi005.stdout:0/877: creat da/df/d1b/d3a/d53/d10b/f12d x:0 0 0 2024-04-16T14:35:47.135 INFO:tasks.workunit.client.1.smithi115.stdout:4/884: mknod d1/d15/d31/d42/d46/c119 0 2024-04-16T14:35:47.135 INFO:tasks.workunit.client.1.smithi115.stdout:4/885: truncate d1/d15/d31/d42/d8b/f9b 2053416 0 2024-04-16T14:35:47.137 INFO:tasks.workunit.client.1.smithi115.stdout:4/886: getdents d1/d15/d1e 0 2024-04-16T14:35:47.148 INFO:tasks.workunit.client.0.smithi005.stdout:0/878: dread da/df/d26/f45 [0,4194304] 0 2024-04-16T14:35:47.148 INFO:tasks.workunit.client.0.smithi005.stdout:0/879: fsync da/df/d1b/d3a/d53/f61 0 2024-04-16T14:35:47.148 INFO:tasks.workunit.client.0.smithi005.stdout:0/880: fsync da/df/d26/d39/d55/d5c/da8/f129 0 2024-04-16T14:35:47.148 INFO:tasks.workunit.client.0.smithi005.stdout:0/881: readlink da/df/d26/d39/l66 0 2024-04-16T14:35:47.149 INFO:tasks.workunit.client.1.smithi115.stdout:4/887: write d1/d15/d1e/f5d [882402,130466] 0 2024-04-16T14:35:47.151 INFO:tasks.workunit.client.1.smithi115.stdout:4/888: link d1/f96 d1/d15/d31/d42/d46/d7a/d105/f11a 0 2024-04-16T14:35:47.152 INFO:tasks.workunit.client.1.smithi115.stdout:4/889: truncate d1/f6b 873263 0 2024-04-16T14:35:47.154 INFO:tasks.workunit.client.0.smithi005.stdout:8/916: dwrite d5/d55/d5a/d135/d7f/d8d/f116 [0,4194304] 0 2024-04-16T14:35:47.154 INFO:tasks.workunit.client.0.smithi005.stdout:8/917: readlink d5/d9b/l9c 0 2024-04-16T14:35:47.154 INFO:tasks.workunit.client.0.smithi005.stdout:8/918: chown d5/d55/d5a/d10a/l122 26629 1 2024-04-16T14:35:47.155 INFO:tasks.workunit.client.1.smithi115.stdout:4/890: creat d1/d15/d31/d42/d8b/dcc/dee/f11b x:0 0 0 2024-04-16T14:35:47.155 INFO:tasks.workunit.client.1.smithi115.stdout:4/891: write d1/d2/f11 [4764747,83469] 0 2024-04-16T14:35:47.155 INFO:tasks.workunit.client.1.smithi115.stdout:4/892: dread - d1/d15/d17/f117 zero size 2024-04-16T14:35:47.155 INFO:tasks.workunit.client.1.smithi115.stdout:3/955: getdents dc/d29/d4d/d56/d7e/d11b/d125 0 2024-04-16T14:35:47.155 INFO:tasks.workunit.client.1.smithi115.stdout:3/956: write dc/fe [866484,73501] 0 2024-04-16T14:35:47.155 INFO:tasks.workunit.client.1.smithi115.stdout:6/870: sync 2024-04-16T14:35:47.156 INFO:tasks.workunit.client.1.smithi115.stdout:6/871: chown d13/d1d/d49/ded/l11d 34 1 2024-04-16T14:35:47.156 INFO:tasks.workunit.client.1.smithi115.stdout:0/706: sync 2024-04-16T14:35:47.156 INFO:tasks.workunit.client.1.smithi115.stdout:7/756: sync 2024-04-16T14:35:47.156 INFO:tasks.workunit.client.1.smithi115.stdout:1/976: sync 2024-04-16T14:35:47.156 INFO:tasks.workunit.client.1.smithi115.stdout:1/977: dread - df/d13/d4d/d68/de7/f134 zero size 2024-04-16T14:35:47.157 INFO:tasks.workunit.client.1.smithi115.stdout:9/995: dwrite d1/d6/d2d/fa2 [0,4194304] 0 2024-04-16T14:35:47.159 INFO:tasks.workunit.client.0.smithi005.stdout:2/820: sync 2024-04-16T14:35:47.160 INFO:tasks.workunit.client.1.smithi115.stdout:8/920: dwrite d0/db/d10/d17/d2c/d52/d74/f45 [0,4194304] 0 2024-04-16T14:35:47.160 INFO:tasks.workunit.client.1.smithi115.stdout:8/921: fsync d0/ffb 0 2024-04-16T14:35:47.160 INFO:tasks.workunit.client.1.smithi115.stdout:9/996: creat d1/d6/d2d/d4b/d8f/d91/dd1/dd2/f15c x:0 0 0 2024-04-16T14:35:47.161 INFO:tasks.workunit.client.1.smithi115.stdout:9/997: chown d1/d6/d2d/d3d/d49/d98/daa/c145 45146539 1 2024-04-16T14:35:47.161 INFO:tasks.workunit.client.0.smithi005.stdout:2/821: link d0/d29/d89/f105 d0/d1c/d59/d7a/f112 0 2024-04-16T14:35:47.162 INFO:tasks.workunit.client.0.smithi005.stdout:2/822: read d0/d1c/d39/f10a [348148,48290] 0 2024-04-16T14:35:47.162 INFO:tasks.workunit.client.0.smithi005.stdout:0/882: write da/f2d [12312178,59677] 0 2024-04-16T14:35:47.162 INFO:tasks.workunit.client.0.smithi005.stdout:0/883: truncate da/df/d50/f11d 578152 0 2024-04-16T14:35:47.163 INFO:tasks.workunit.client.0.smithi005.stdout:8/919: write d5/d7b/f4e [2887614,44505] 0 2024-04-16T14:35:47.163 INFO:tasks.workunit.client.1.smithi115.stdout:1/978: write df/d2d/f82 [1271367,129889] 0 2024-04-16T14:35:47.164 INFO:tasks.workunit.client.0.smithi005.stdout:9/844: dwrite d3/d12/d16/f1d [4194304,4194304] 0 2024-04-16T14:35:47.164 INFO:tasks.workunit.client.1.smithi115.stdout:8/922: rename d0/db/d10/d17/d2c/d52/d6c/db8/d7d/de2/d111/d83 to d0/db/d134 0 2024-04-16T14:35:47.166 INFO:tasks.workunit.client.1.smithi115.stdout:7/757: dread d0/d2/d3a/d30/d6b/da2/d81/fa6 [0,4194304] 0 2024-04-16T14:35:47.167 INFO:tasks.workunit.client.1.smithi115.stdout:7/758: creat d0/d24/d40/df0/f100 x:0 0 0 2024-04-16T14:35:47.167 INFO:tasks.workunit.client.0.smithi005.stdout:2/823: symlink d0/d1c/d39/d85/l113 0 2024-04-16T14:35:47.167 INFO:tasks.workunit.client.0.smithi005.stdout:2/824: write d0/d1c/d39/fa4 [529002,5657] 0 2024-04-16T14:35:47.169 INFO:tasks.workunit.client.0.smithi005.stdout:2/825: dread d0/d1c/d39/d85/da2/fa7 [0,4194304] 0 2024-04-16T14:35:47.169 INFO:tasks.workunit.client.1.smithi115.stdout:0/707: dread d6/d10/d12/f14 [0,4194304] 0 2024-04-16T14:35:47.175 INFO:tasks.workunit.client.0.smithi005.stdout:0/884: creat da/df/d26/da9/d108/d75/d124/f12e x:0 0 0 2024-04-16T14:35:47.177 INFO:tasks.workunit.client.0.smithi005.stdout:2/826: dread d0/d1c/d39/fa4 [0,4194304] 0 2024-04-16T14:35:47.179 INFO:tasks.workunit.client.1.smithi115.stdout:6/872: rmdir d13 39 2024-04-16T14:35:47.180 INFO:tasks.workunit.client.0.smithi005.stdout:8/920: mknod d5/d7b/da8/da5/def/d10d/c142 0 2024-04-16T14:35:47.180 INFO:tasks.workunit.client.0.smithi005.stdout:8/921: dread - d5/d7b/da8/db7/d74/fb1 zero size 2024-04-16T14:35:47.182 INFO:tasks.workunit.client.1.smithi115.stdout:4/893: dwrite d1/d15/d31/d42/da4/dc0/fc1 [0,4194304] 0 2024-04-16T14:35:47.182 INFO:tasks.workunit.client.1.smithi115.stdout:4/894: chown d1/d15/d1e/l61 270098679 1 2024-04-16T14:35:47.185 INFO:tasks.workunit.client.1.smithi115.stdout:1/979: unlink df/d36/c70 0 2024-04-16T14:35:47.185 INFO:tasks.workunit.client.1.smithi115.stdout:1/980: stat df/d13/d4d/d6d/c98 0 2024-04-16T14:35:47.185 INFO:tasks.workunit.client.1.smithi115.stdout:1/981: write df/d36/dff/f113 [2500229,15305] 0 2024-04-16T14:35:47.185 INFO:tasks.workunit.client.0.smithi005.stdout:0/885: unlink da/f1f 0 2024-04-16T14:35:47.188 INFO:tasks.workunit.client.0.smithi005.stdout:0/886: rename da/df/d1b/d3a/d53/d5a/d67/d79/f82 to da/df/d26/da9/dcb/dd8/f12f 0 2024-04-16T14:35:47.188 INFO:tasks.workunit.client.0.smithi005.stdout:0/887: write da/f10a [683420,76243] 0 2024-04-16T14:35:47.188 INFO:tasks.workunit.client.0.smithi005.stdout:2/827: dread d0/d2a/f52 [0,4194304] 0 2024-04-16T14:35:47.189 INFO:tasks.workunit.client.0.smithi005.stdout:2/828: truncate d0/d29/d3e/dd2/ff5 1028142 0 2024-04-16T14:35:47.190 INFO:tasks.workunit.client.0.smithi005.stdout:0/888: rename da/df/d1b/d3a/d53/d5a/l123 to da/df/d1b/d3a/d53/d5a/l130 0 2024-04-16T14:35:47.191 INFO:tasks.workunit.client.0.smithi005.stdout:0/889: stat da/df/d26/da9/d108 0 2024-04-16T14:35:47.191 INFO:tasks.workunit.client.0.smithi005.stdout:0/890: chown da/df/d1b/f72 7 1 2024-04-16T14:35:47.193 INFO:tasks.workunit.client.0.smithi005.stdout:2/829: unlink d0/d1c/d59/d7a/f112 0 2024-04-16T14:35:47.194 INFO:tasks.workunit.client.0.smithi005.stdout:0/891: mkdir da/df/d26/da9/d108/d75/d81/d131 0 2024-04-16T14:35:47.196 INFO:tasks.workunit.client.0.smithi005.stdout:2/830: creat d0/d2a/d3a/d46/f114 x:0 0 0 2024-04-16T14:35:47.196 INFO:tasks.workunit.client.0.smithi005.stdout:2/831: truncate d0/d2a/d3a/d46/ded/f10f 601254 0 2024-04-16T14:35:47.197 INFO:tasks.workunit.client.1.smithi115.stdout:7/759: mknod d0/d2/d3a/dac/c101 0 2024-04-16T14:35:47.198 INFO:tasks.workunit.client.0.smithi005.stdout:2/832: mknod d0/d4/d2b/d5e/d9a/c115 0 2024-04-16T14:35:47.198 INFO:tasks.workunit.client.0.smithi005.stdout:2/833: creat d0/d1c/f116 x:0 0 0 2024-04-16T14:35:47.200 INFO:tasks.workunit.client.1.smithi115.stdout:0/708: link d6/d10/d12/d31/cd0 d6/d54/d57/dbe/cf5 0 2024-04-16T14:35:47.200 INFO:tasks.workunit.client.1.smithi115.stdout:6/873: rmdir d13/d1d/d87 39 2024-04-16T14:35:47.200 INFO:tasks.workunit.client.1.smithi115.stdout:6/874: write d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/d63/f89 [2255558,130932] 0 2024-04-16T14:35:47.201 INFO:tasks.workunit.client.1.smithi115.stdout:7/760: mkdir d0/d24/da3/d102 0 2024-04-16T14:35:47.202 INFO:tasks.workunit.client.1.smithi115.stdout:0/709: mkdir d6/d10/d12/d1f/ded/df6 0 2024-04-16T14:35:47.202 INFO:tasks.workunit.client.0.smithi005.stdout:2/834: symlink d0/d4/l117 0 2024-04-16T14:35:47.202 INFO:tasks.workunit.client.1.smithi115.stdout:6/875: write d13/d1d/f56 [5215661,99637] 0 2024-04-16T14:35:47.204 INFO:tasks.workunit.client.1.smithi115.stdout:7/761: mkdir d0/d24/da3/db1/d49/dbc/dd1/d103 0 2024-04-16T14:35:47.205 INFO:tasks.workunit.client.0.smithi005.stdout:2/835: symlink d0/d2a/d3a/d46/ded/l118 0 2024-04-16T14:35:47.205 INFO:tasks.workunit.client.0.smithi005.stdout:2/836: creat d0/d1c/f119 x:0 0 0 2024-04-16T14:35:47.205 INFO:tasks.workunit.client.0.smithi005.stdout:2/837: chown d0/d29/d3e/ff2 610 1 2024-04-16T14:35:47.205 INFO:tasks.workunit.client.1.smithi115.stdout:6/876: dread d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/fd2 [0,4194304] 0 2024-04-16T14:35:47.205 INFO:tasks.workunit.client.1.smithi115.stdout:6/877: dread - d13/d1d/d52/feb zero size 2024-04-16T14:35:47.206 INFO:tasks.workunit.client.1.smithi115.stdout:0/710: creat d6/d10/d12/dba/ff7 x:0 0 0 2024-04-16T14:35:47.210 INFO:tasks.workunit.client.1.smithi115.stdout:7/762: mkdir d0/d24/da3/ded/d104 0 2024-04-16T14:35:47.211 INFO:tasks.workunit.client.1.smithi115.stdout:7/763: chown d0/d2/d3a/dac 22 1 2024-04-16T14:35:47.211 INFO:tasks.workunit.client.1.smithi115.stdout:8/923: dwrite d0/db/d10/fad [0,4194304] 0 2024-04-16T14:35:47.211 INFO:tasks.workunit.client.1.smithi115.stdout:8/924: chown d0/db/dbb/dcd/dc4/lf5 1 1 2024-04-16T14:35:47.213 INFO:tasks.workunit.client.1.smithi115.stdout:7/764: creat d0/d24/da3/db1/f105 x:0 0 0 2024-04-16T14:35:47.213 INFO:tasks.workunit.client.1.smithi115.stdout:7/765: write d0/d24/da3/db1/d3f/db0/fcd [484428,7934] 0 2024-04-16T14:35:47.213 INFO:tasks.workunit.client.1.smithi115.stdout:9/998: dwrite d1/d6/d2d/d3d/d50/f94 [0,4194304] 0 2024-04-16T14:35:47.213 INFO:tasks.workunit.client.1.smithi115.stdout:9/999: write d1/f126 [516175,123684] 0 2024-04-16T14:35:47.214 INFO:tasks.workunit.client.1.smithi115.stdout:8/925: getdents d0/db/d10/d17/d2c/d52/d74 0 2024-04-16T14:35:47.214 INFO:tasks.workunit.client.1.smithi115.stdout:7/766: write d0/d1/f1f [3326876,93746] 0 2024-04-16T14:35:47.214 INFO:tasks.workunit.client.1.smithi115.stdout:7/767: chown d0/d2/d3a/l4e 65652593 1 2024-04-16T14:35:47.215 INFO:tasks.workunit.client.1.smithi115.stdout:1/982: dwrite df/d13/d4d/d3e/d75/dda/f85 [0,4194304] 0 2024-04-16T14:35:47.215 INFO:tasks.workunit.client.1.smithi115.stdout:4/895: dwrite d1/d15/d17/d9e/ddf/ff5 [0,4194304] 0 2024-04-16T14:35:47.216 INFO:tasks.workunit.client.1.smithi115.stdout:8/926: mkdir d0/dc8/d135 0 2024-04-16T14:35:47.218 INFO:tasks.workunit.client.1.smithi115.stdout:0/711: dread d6/d10/d12/d1f/d36/d4b/d6d/f8e [0,4194304] 0 2024-04-16T14:35:47.220 INFO:tasks.workunit.client.1.smithi115.stdout:7/768: creat d0/d24/da3/ded/d104/f106 x:0 0 0 2024-04-16T14:35:47.224 INFO:tasks.workunit.client.1.smithi115.stdout:1/983: mknod df/d36/dff/c151 0 2024-04-16T14:35:47.224 INFO:tasks.workunit.client.1.smithi115.stdout:1/984: chown df/d35/d84/ddc/de0/fe5 4690 1 2024-04-16T14:35:47.224 INFO:tasks.workunit.client.1.smithi115.stdout:7/769: mkdir d0/d2/d3a/d30/d79/d95/dec/d107 0 2024-04-16T14:35:47.227 INFO:tasks.workunit.client.1.smithi115.stdout:1/985: rename df/d13/d4d/d68/de7/la3 to df/d13/d4d/d3e/d75/da9/db7/l152 0 2024-04-16T14:35:47.228 INFO:tasks.workunit.client.1.smithi115.stdout:0/712: dread d6/dac/fe7 [0,4194304] 0 2024-04-16T14:35:47.228 INFO:tasks.workunit.client.1.smithi115.stdout:1/986: truncate df/d13/dc3/f119 3706542 0 2024-04-16T14:35:47.228 INFO:tasks.workunit.client.1.smithi115.stdout:0/713: readlink d6/d54/l99 0 2024-04-16T14:35:47.230 INFO:tasks.workunit.client.1.smithi115.stdout:0/714: creat d6/d10/ff8 x:0 0 0 2024-04-16T14:35:47.231 INFO:tasks.workunit.client.1.smithi115.stdout:1/987: read df/d13/d72/fa2 [762031,14524] 0 2024-04-16T14:35:47.232 INFO:tasks.workunit.client.1.smithi115.stdout:0/715: link d6/d10/dc8/le6 d6/d30/d4d/de4/lf9 0 2024-04-16T14:35:47.234 INFO:tasks.workunit.client.1.smithi115.stdout:1/988: mkdir df/d13/d4d/d3e/d75/da9/d13e/d153 0 2024-04-16T14:35:47.234 INFO:tasks.workunit.client.1.smithi115.stdout:1/989: chown df/d13/d4d/d3e/d75/dfc/f133 3 1 2024-04-16T14:35:47.234 INFO:tasks.workunit.client.1.smithi115.stdout:1/990: chown df/d2d/ff0 970536 1 2024-04-16T14:35:47.234 INFO:tasks.workunit.client.1.smithi115.stdout:8/927: dread d0/db/d10/d17/f18 [0,4194304] 0 2024-04-16T14:35:47.234 INFO:tasks.workunit.client.1.smithi115.stdout:8/928: readlink d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/l80 0 2024-04-16T14:35:47.235 INFO:tasks.workunit.client.0.smithi005.stdout:0/892: dwrite da/ffb [0,4194304] 0 2024-04-16T14:35:47.237 INFO:tasks.workunit.client.0.smithi005.stdout:0/893: dread da/df/d26/d39/d55/ddc/f107 [0,4194304] 0 2024-04-16T14:35:47.237 INFO:tasks.workunit.client.0.smithi005.stdout:0/894: creat da/df/d1b/d3a/d53/d10b/f132 x:0 0 0 2024-04-16T14:35:47.249 INFO:tasks.workunit.client.1.smithi115.stdout:0/716: write d6/d10/d12/f80 [257859,84920] 0 2024-04-16T14:35:47.251 INFO:tasks.workunit.client.1.smithi115.stdout:0/717: getdents d6/d10/d12/d1f 0 2024-04-16T14:35:47.253 INFO:tasks.workunit.client.1.smithi115.stdout:0/718: mknod d6/d30/d4d/de5/cfa 0 2024-04-16T14:35:47.253 INFO:tasks.workunit.client.1.smithi115.stdout:0/719: readlink d6/d10/d12/d31/d35/d9b/lb3 0 2024-04-16T14:35:47.253 INFO:tasks.workunit.client.1.smithi115.stdout:0/720: truncate d6/d10/d12/d31/feb 733792 0 2024-04-16T14:35:47.253 INFO:tasks.workunit.client.0.smithi005.stdout:0/895: dread da/df/d1b/d3a/d53/d5a/d99/fc5 [0,4194304] 0 2024-04-16T14:35:47.254 INFO:tasks.workunit.client.0.smithi005.stdout:0/896: creat da/f133 x:0 0 0 2024-04-16T14:35:47.254 INFO:tasks.workunit.client.1.smithi115.stdout:0/721: creat d6/d10/d12/d5f/ffb x:0 0 0 2024-04-16T14:35:47.256 INFO:tasks.workunit.client.1.smithi115.stdout:0/722: mkdir d6/dac/dfc 0 2024-04-16T14:35:47.257 INFO:tasks.workunit.client.1.smithi115.stdout:0/723: creat d6/d30/d4d/ffd x:0 0 0 2024-04-16T14:35:47.257 INFO:tasks.workunit.client.0.smithi005.stdout:0/897: rename da/df/d1b/d3a/d53/d5a/d99 to da/df/d26/d134 0 2024-04-16T14:35:47.258 INFO:tasks.workunit.client.1.smithi115.stdout:0/724: symlink d6/d10/d12/d1f/d36/lfe 0 2024-04-16T14:35:47.258 INFO:tasks.workunit.client.1.smithi115.stdout:0/725: fsync d6/d30/d4d/fef 0 2024-04-16T14:35:47.259 INFO:tasks.workunit.client.1.smithi115.stdout:0/726: write d6/d10/d12/d5f/f8c [888109,45847] 0 2024-04-16T14:35:47.259 INFO:tasks.workunit.client.1.smithi115.stdout:0/727: chown d6/dac/fbb 47 1 2024-04-16T14:35:47.260 INFO:tasks.workunit.client.0.smithi005.stdout:0/898: link da/df/d1b/d3a/d96/dab/f100 da/df/d26/d112/f135 0 2024-04-16T14:35:47.261 INFO:tasks.workunit.client.1.smithi115.stdout:4/896: dwrite d1/d15/d17/f92 [0,4194304] 0 2024-04-16T14:35:47.261 INFO:tasks.workunit.client.1.smithi115.stdout:0/728: rename d6/d10/d94 to d6/d10/d12/d1f/d36/d4b/dff 0 2024-04-16T14:35:47.261 INFO:tasks.workunit.client.1.smithi115.stdout:0/729: write d6/d10/d12/d31/d35/d44/d85/fc6 [2822475,27370] 0 2024-04-16T14:35:47.263 INFO:tasks.workunit.client.1.smithi115.stdout:4/897: symlink d1/d15/d17/de6/de9/l11c 0 2024-04-16T14:35:47.264 INFO:tasks.workunit.client.1.smithi115.stdout:0/730: mkdir d6/d10/d12/d1f/d36/d4b/dff/d100 0 2024-04-16T14:35:47.265 INFO:tasks.workunit.client.1.smithi115.stdout:4/898: unlink d1/d15/fcf 0 2024-04-16T14:35:47.266 INFO:tasks.workunit.client.1.smithi115.stdout:0/731: mkdir d6/d10/d12/d1f/d36/d4b/d101 0 2024-04-16T14:35:47.266 INFO:tasks.workunit.client.1.smithi115.stdout:0/732: dread - d6/d10/d12/d1f/d36/f7e zero size 2024-04-16T14:35:47.267 INFO:tasks.workunit.client.1.smithi115.stdout:4/899: rmdir d1/d15/d31/dc2/de4/de7 39 2024-04-16T14:35:47.267 INFO:tasks.workunit.client.1.smithi115.stdout:4/900: read - d1/d15/d17/f117 zero size 2024-04-16T14:35:47.267 INFO:tasks.workunit.client.1.smithi115.stdout:0/733: read d6/d10/d12/d31/d35/d9b/f5b [1345998,101040] 0 2024-04-16T14:35:47.269 INFO:tasks.workunit.client.1.smithi115.stdout:4/901: mknod d1/d15/d17/d9e/dbe/c11d 0 2024-04-16T14:35:47.269 INFO:tasks.workunit.client.1.smithi115.stdout:4/902: dread - d1/d15/d31/d89/f110 zero size 2024-04-16T14:35:47.269 INFO:tasks.workunit.client.0.smithi005.stdout:0/899: dread da/df/f94 [0,4194304] 0 2024-04-16T14:35:47.269 INFO:tasks.workunit.client.0.smithi005.stdout:0/900: fsync da/df/d1b/d71/f127 0 2024-04-16T14:35:47.269 INFO:tasks.workunit.client.0.smithi005.stdout:0/901: write da/df/d26/d39/f122 [387333,85437] 0 2024-04-16T14:35:47.270 INFO:tasks.workunit.client.0.smithi005.stdout:0/902: read da/df/d1b/d3a/d53/d5a/d67/f8d [769553,129862] 0 2024-04-16T14:35:47.270 INFO:tasks.workunit.client.0.smithi005.stdout:0/903: fdatasync da/df/d50/fc2 0 2024-04-16T14:35:47.270 INFO:tasks.workunit.client.0.smithi005.stdout:0/904: dread - da/df/d1b/d3a/d53/d10b/f132 zero size 2024-04-16T14:35:47.270 INFO:tasks.workunit.client.1.smithi115.stdout:0/734: truncate d6/d10/f20 1119365 0 2024-04-16T14:35:47.271 INFO:tasks.workunit.client.1.smithi115.stdout:0/735: stat d6/fec 0 2024-04-16T14:35:47.271 INFO:tasks.workunit.client.1.smithi115.stdout:0/736: truncate d6/d54/f9a 901230 0 2024-04-16T14:35:47.271 INFO:tasks.workunit.client.0.smithi005.stdout:0/905: rename da/cdb to da/df/d26/da9/dcb/dd8/c136 0 2024-04-16T14:35:47.272 INFO:tasks.workunit.client.1.smithi115.stdout:4/903: unlink d1/d15/d31/d42/da4/cac 0 2024-04-16T14:35:47.272 INFO:tasks.workunit.client.0.smithi005.stdout:0/906: truncate da/df/d26/da9/dcb/dd8/fe1 57442 0 2024-04-16T14:35:47.279 INFO:tasks.workunit.client.1.smithi115.stdout:8/929: dwrite d0/db/d10/d17/d22/f32 [4194304,4194304] 0 2024-04-16T14:35:47.279 INFO:tasks.workunit.client.1.smithi115.stdout:8/930: truncate d0/db/dbb/dcd/dbf/f126 354642 0 2024-04-16T14:35:47.279 INFO:tasks.workunit.client.1.smithi115.stdout:8/931: getdents d0/db/d10 0 2024-04-16T14:35:47.279 INFO:tasks.workunit.client.1.smithi115.stdout:7/770: dwrite d0/d24/da3/db1/d3f/db0/f5c [0,4194304] 0 2024-04-16T14:35:47.279 INFO:tasks.workunit.client.1.smithi115.stdout:7/771: readlink d0/d2/l97 0 2024-04-16T14:35:47.280 INFO:tasks.workunit.client.1.smithi115.stdout:1/991: dwrite df/d13/d4d/d6d/f73 [0,4194304] 0 2024-04-16T14:35:47.281 INFO:tasks.workunit.client.0.smithi005.stdout:0/907: dread da/df/d1b/d3a/fa4 [0,4194304] 0 2024-04-16T14:35:47.282 INFO:tasks.workunit.client.0.smithi005.stdout:2/838: dwrite d0/d2a/d3a/d46/ded/f10f [0,4194304] 0 2024-04-16T14:35:47.282 INFO:tasks.workunit.client.0.smithi005.stdout:2/839: chown d0/d29/d3e/f8e 3 1 2024-04-16T14:35:47.282 INFO:tasks.workunit.client.0.smithi005.stdout:2/840: creat d0/d2a/d3a/d46/dd8/f11a x:0 0 0 2024-04-16T14:35:47.282 INFO:tasks.workunit.client.0.smithi005.stdout:9/845: dwrite d3/d12/d16/d46/d47/d60/f69 [0,4194304] 0 2024-04-16T14:35:47.282 INFO:tasks.workunit.client.0.smithi005.stdout:9/846: truncate d3/d49/d4b/d5c/d65/d9a/fcd 220433 0 2024-04-16T14:35:47.282 INFO:tasks.workunit.client.0.smithi005.stdout:9/847: write d3/d12/d2b/f59 [4309564,27906] 0 2024-04-16T14:35:47.283 INFO:tasks.workunit.client.0.smithi005.stdout:9/848: dread - d3/d49/d4b/d5c/d65/d9a/daf/fb7 zero size 2024-04-16T14:35:47.283 INFO:tasks.workunit.client.1.smithi115.stdout:0/737: dread d6/d1b/f6c [0,4194304] 0 2024-04-16T14:35:47.288 INFO:tasks.workunit.client.0.smithi005.stdout:0/908: write da/f11e [919707,8072] 0 2024-04-16T14:35:47.289 INFO:tasks.workunit.client.1.smithi115.stdout:7/772: getdents d0/d2/d3a/d73 0 2024-04-16T14:35:47.290 INFO:tasks.workunit.client.0.smithi005.stdout:9/849: creat d3/d49/d4b/d5c/d65/ff7 x:0 0 0 2024-04-16T14:35:47.290 INFO:tasks.workunit.client.0.smithi005.stdout:2/841: write d0/d1c/d39/d85/da2/db0/fe2 [2670014,6981] 0 2024-04-16T14:35:47.292 INFO:tasks.workunit.client.1.smithi115.stdout:8/932: dread d0/db/d10/d17/d22/f32 [4194304,4194304] 0 2024-04-16T14:35:47.293 INFO:tasks.workunit.client.1.smithi115.stdout:0/738: mkdir d6/d10/d12/d31/d102 0 2024-04-16T14:35:47.293 INFO:tasks.workunit.client.1.smithi115.stdout:1/992: dread fb [0,4194304] 0 2024-04-16T14:35:47.293 INFO:tasks.workunit.client.1.smithi115.stdout:1/993: write df/d13/d4d/d68/de7/fe4 [625617,12451] 0 2024-04-16T14:35:47.295 INFO:tasks.workunit.client.1.smithi115.stdout:4/904: dwrite d1/d15/d31/d42/d8b/dcc/dee/f11b [0,4194304] 0 2024-04-16T14:35:47.295 INFO:tasks.workunit.client.1.smithi115.stdout:4/905: read d1/f6b [269540,49760] 0 2024-04-16T14:35:47.295 INFO:tasks.workunit.client.1.smithi115.stdout:4/906: write d1/d15/f4d [1004449,27659] 0 2024-04-16T14:35:47.295 INFO:tasks.workunit.client.1.smithi115.stdout:4/907: dread - d1/d15/d1e/fd6 zero size 2024-04-16T14:35:47.296 INFO:tasks.workunit.client.0.smithi005.stdout:0/909: creat da/df/d1b/d71/ddf/f137 x:0 0 0 2024-04-16T14:35:47.299 INFO:tasks.workunit.client.0.smithi005.stdout:2/842: mknod d0/d1c/d39/c11b 0 2024-04-16T14:35:47.304 INFO:tasks.workunit.client.1.smithi115.stdout:0/739: symlink d6/d10/dc8/l103 0 2024-04-16T14:35:47.305 INFO:tasks.workunit.client.1.smithi115.stdout:1/994: mkdir df/d36/d135/d154 0 2024-04-16T14:35:47.307 INFO:tasks.workunit.client.0.smithi005.stdout:9/850: dread d3/d12/d16/f51 [0,4194304] 0 2024-04-16T14:35:47.309 INFO:tasks.workunit.client.0.smithi005.stdout:2/843: rename d0/d1c/d59/d7a/f111 to d0/d2a/d3a/f11c 0 2024-04-16T14:35:47.312 INFO:tasks.workunit.client.0.smithi005.stdout:2/844: creat d0/f11d x:0 0 0 2024-04-16T14:35:47.312 INFO:tasks.workunit.client.1.smithi115.stdout:4/908: link d1/d15/l79 d1/d15/d31/d42/da4/d118/l11e 0 2024-04-16T14:35:47.313 INFO:tasks.workunit.client.0.smithi005.stdout:2/845: truncate d0/d2a/fab 385651 0 2024-04-16T14:35:47.314 INFO:tasks.workunit.client.0.smithi005.stdout:9/851: dread d3/d49/d4b/d5c/d65/f85 [0,4194304] 0 2024-04-16T14:35:47.314 INFO:tasks.workunit.client.0.smithi005.stdout:9/852: truncate d3/d49/d4b/d55/fdc 1724339 0 2024-04-16T14:35:47.314 INFO:tasks.workunit.client.0.smithi005.stdout:9/853: dread - d3/d49/d4b/d5c/d65/d9a/fc0 zero size 2024-04-16T14:35:47.315 INFO:tasks.workunit.client.1.smithi115.stdout:0/740: dread d6/d10/d12/d31/d35/d9b/f49 [0,4194304] 0 2024-04-16T14:35:47.315 INFO:tasks.workunit.client.1.smithi115.stdout:0/741: write d6/d30/d8d/fc5 [984900,43110] 0 2024-04-16T14:35:47.315 INFO:tasks.workunit.client.1.smithi115.stdout:0/742: stat d6/fdc 0 2024-04-16T14:35:47.315 INFO:tasks.workunit.client.1.smithi115.stdout:1/995: mkdir df/d13/d4d/d6d/d155 0 2024-04-16T14:35:47.316 INFO:tasks.workunit.client.0.smithi005.stdout:9/854: getdents d3/d49/d4b/d5c/d65/d9a 0 2024-04-16T14:35:47.316 INFO:tasks.workunit.client.0.smithi005.stdout:9/855: write d3/d12/d16/d46/d47/d60/de9/dd6/fd9 [298574,110836] 0 2024-04-16T14:35:47.317 INFO:tasks.workunit.client.1.smithi115.stdout:4/909: link d1/d15/d24/f40 d1/d15/d17/de6/f11f 0 2024-04-16T14:35:47.317 INFO:tasks.workunit.client.0.smithi005.stdout:2/846: getdents d0/d1c 0 2024-04-16T14:35:47.318 INFO:tasks.workunit.client.1.smithi115.stdout:0/743: truncate d6/d1b/f21 3635915 0 2024-04-16T14:35:47.319 INFO:tasks.workunit.client.0.smithi005.stdout:2/847: creat d0/d29/f11e x:0 0 0 2024-04-16T14:35:47.319 INFO:tasks.workunit.client.1.smithi115.stdout:4/910: symlink d1/d15/d31/d89/l120 0 2024-04-16T14:35:47.321 INFO:tasks.workunit.client.1.smithi115.stdout:0/744: symlink d6/d30/d4d/de5/l104 0 2024-04-16T14:35:47.322 INFO:tasks.workunit.client.1.smithi115.stdout:4/911: dread d1/d15/d31/d42/d46/d7a/d105/f11a [0,4194304] 0 2024-04-16T14:35:47.323 INFO:tasks.workunit.client.1.smithi115.stdout:0/745: unlink d6/d10/d12/d1f/d36/d4b/fc0 0 2024-04-16T14:35:47.324 INFO:tasks.workunit.client.1.smithi115.stdout:7/773: dwrite d0/d24/da3/db1/d3f/db0/fb8 [0,4194304] 0 2024-04-16T14:35:47.325 INFO:tasks.workunit.client.1.smithi115.stdout:8/933: dwrite d0/db/d10/d17/d2c/d52/d84/f90 [0,4194304] 0 2024-04-16T14:35:47.326 INFO:tasks.workunit.client.0.smithi005.stdout:0/910: dwrite da/df/d1b/d3a/fa4 [0,4194304] 0 2024-04-16T14:35:47.326 INFO:tasks.workunit.client.0.smithi005.stdout:0/911: creat da/df/d26/d8e/f138 x:0 0 0 2024-04-16T14:35:47.327 INFO:tasks.workunit.client.1.smithi115.stdout:4/912: creat d1/d15/f121 x:0 0 0 2024-04-16T14:35:47.327 INFO:tasks.workunit.client.0.smithi005.stdout:2/848: write d0/d29/d3e/ff2 [2776915,98252] 0 2024-04-16T14:35:47.328 INFO:tasks.workunit.client.1.smithi115.stdout:7/774: dread d0/d24/f61 [0,4194304] 0 2024-04-16T14:35:47.330 INFO:tasks.workunit.client.1.smithi115.stdout:8/934: creat d0/db/d10/d17/d2c/d52/d6c/dd9/f136 x:0 0 0 2024-04-16T14:35:47.335 INFO:tasks.workunit.client.0.smithi005.stdout:9/856: dread d3/d49/d4b/d55/f5d [0,4194304] 0 2024-04-16T14:35:47.338 INFO:tasks.workunit.client.1.smithi115.stdout:7/775: dread d0/d24/fb3 [0,4194304] 0 2024-04-16T14:35:47.339 INFO:tasks.workunit.client.1.smithi115.stdout:7/776: stat d0/d24/d40/f85 0 2024-04-16T14:35:47.339 INFO:tasks.workunit.client.1.smithi115.stdout:8/935: rename d0/db/d10/d17/d2c/d52/d6c/db8/d6b/c6e to d0/db/d10/d17/d2c/d52/d6c/db8/d6b/dab/c137 0 2024-04-16T14:35:47.339 INFO:tasks.workunit.client.1.smithi115.stdout:8/936: write d0/db/d134/da2/fbe [715888,108191] 0 2024-04-16T14:35:47.341 INFO:tasks.workunit.client.1.smithi115.stdout:1/996: dwrite df/d35/f39 [0,4194304] 0 2024-04-16T14:35:47.342 INFO:tasks.workunit.client.0.smithi005.stdout:2/849: creat d0/d1c/d39/f11f x:0 0 0 2024-04-16T14:35:47.342 INFO:tasks.workunit.client.0.smithi005.stdout:2/850: chown d0/d4/d2b/l44 2477 1 2024-04-16T14:35:47.342 INFO:tasks.workunit.client.0.smithi005.stdout:9/857: truncate d3/d49/d4b/d55/d7b/fba 522694 0 2024-04-16T14:35:47.343 INFO:tasks.workunit.client.1.smithi115.stdout:4/913: dread d1/d2/ff [0,4194304] 0 2024-04-16T14:35:47.345 INFO:tasks.workunit.client.1.smithi115.stdout:7/777: rename d0/d2/d3a/c9e to d0/d2/d3a/dac/da7/c108 0 2024-04-16T14:35:47.345 INFO:tasks.workunit.client.1.smithi115.stdout:4/914: dread d1/d15/d17/fbb [0,4194304] 0 2024-04-16T14:35:47.348 INFO:tasks.workunit.client.1.smithi115.stdout:1/997: creat df/d13/d4d/f156 x:0 0 0 2024-04-16T14:35:47.348 INFO:tasks.workunit.client.1.smithi115.stdout:1/998: stat df/d35/d48/cad 0 2024-04-16T14:35:47.348 INFO:tasks.workunit.client.1.smithi115.stdout:1/999: fsync df/d35/fd3 0 2024-04-16T14:35:47.350 INFO:tasks.workunit.client.0.smithi005.stdout:0/912: dwrite da/df/d26/d39/f12a [4194304,4194304] 0 2024-04-16T14:35:47.350 INFO:tasks.workunit.client.0.smithi005.stdout:0/913: chown da/df/d26/d8e 91 1 2024-04-16T14:35:47.350 INFO:tasks.workunit.client.0.smithi005.stdout:0/914: creat da/df/d26/d39/f139 x:0 0 0 2024-04-16T14:35:47.351 INFO:tasks.workunit.client.1.smithi115.stdout:0/746: dwrite d6/dac/fbf [0,4194304] 0 2024-04-16T14:35:47.351 INFO:tasks.workunit.client.1.smithi115.stdout:7/778: unlink d0/d2/d3a/d30/d79/dd2/d64/c78 0 2024-04-16T14:35:47.351 INFO:tasks.workunit.client.1.smithi115.stdout:7/779: chown d0/c3d 5891 1 2024-04-16T14:35:47.351 INFO:tasks.workunit.client.1.smithi115.stdout:7/780: chown d0/d2/d3a/d30/d79/dd2/d64 154 1 2024-04-16T14:35:47.358 INFO:tasks.workunit.client.0.smithi005.stdout:2/851: write d0/d4/f3c [1243930,9722] 0 2024-04-16T14:35:47.359 INFO:tasks.workunit.client.1.smithi115.stdout:4/915: dread d1/d2/f5b [0,4194304] 0 2024-04-16T14:35:47.360 INFO:tasks.workunit.client.0.smithi005.stdout:2/852: rmdir d0/d29/d89 39 2024-04-16T14:35:47.362 INFO:tasks.workunit.client.0.smithi005.stdout:2/853: creat d0/d1c/d59/d7a/d84/f120 x:0 0 0 2024-04-16T14:35:47.362 INFO:tasks.workunit.client.1.smithi115.stdout:0/747: symlink d6/dac/dfc/l105 0 2024-04-16T14:35:47.362 INFO:tasks.workunit.client.1.smithi115.stdout:0/748: stat d6/dac/fbb 0 2024-04-16T14:35:47.362 INFO:tasks.workunit.client.1.smithi115.stdout:7/781: unlink d0/d24/d40/f85 0 2024-04-16T14:35:47.365 INFO:tasks.workunit.client.1.smithi115.stdout:0/749: creat d6/d10/dc8/f106 x:0 0 0 2024-04-16T14:35:47.366 INFO:tasks.workunit.client.1.smithi115.stdout:7/782: unlink d0/d2/d3a/d30/d6b/c82 0 2024-04-16T14:35:47.368 INFO:tasks.workunit.client.1.smithi115.stdout:0/750: dread d6/d10/f63 [0,4194304] 0 2024-04-16T14:35:47.368 INFO:tasks.workunit.client.1.smithi115.stdout:7/783: mkdir d0/d2/d3a/d30/d79/dd2/d64/d109 0 2024-04-16T14:35:47.369 INFO:tasks.workunit.client.1.smithi115.stdout:0/751: mknod d6/d10/d12/c107 0 2024-04-16T14:35:47.369 INFO:tasks.workunit.client.1.smithi115.stdout:0/752: stat f0 0 2024-04-16T14:35:47.370 INFO:tasks.workunit.client.0.smithi005.stdout:2/854: read d0/d4/fc0 [2041578,14667] 0 2024-04-16T14:35:47.372 INFO:tasks.workunit.client.0.smithi005.stdout:2/855: mknod d0/d1c/d59/d67/d103/c121 0 2024-04-16T14:35:47.373 INFO:tasks.workunit.client.0.smithi005.stdout:2/856: symlink d0/d29/d89/d99/l122 0 2024-04-16T14:35:47.379 INFO:tasks.workunit.client.1.smithi115.stdout:0/753: dread d6/d10/d12/d31/d35/d9b/f5b [0,4194304] 0 2024-04-16T14:35:47.381 INFO:tasks.workunit.client.1.smithi115.stdout:0/754: mkdir d6/d1b/d4e/db9/d108 0 2024-04-16T14:35:47.382 INFO:tasks.workunit.client.1.smithi115.stdout:0/755: rename d6/d54/d57/c5d to d6/dac/c109 0 2024-04-16T14:35:47.383 INFO:tasks.workunit.client.1.smithi115.stdout:0/756: chown d6/d30/lf2 349 1 2024-04-16T14:35:47.383 INFO:tasks.workunit.client.1.smithi115.stdout:0/757: write d6/f95 [1217436,80134] 0 2024-04-16T14:35:47.384 INFO:tasks.workunit.client.1.smithi115.stdout:0/758: truncate d6/d54/f6b 3020102 0 2024-04-16T14:35:47.384 INFO:tasks.workunit.client.1.smithi115.stdout:0/759: dread - d6/d54/ff4 zero size 2024-04-16T14:35:47.384 INFO:tasks.workunit.client.1.smithi115.stdout:7/784: write d0/d24/da3/db1/d3f/f8d [3286990,111877] 0 2024-04-16T14:35:47.385 INFO:tasks.workunit.client.0.smithi005.stdout:9/858: dwrite d3/d49/d4b/d55/f5d [0,4194304] 0 2024-04-16T14:35:47.387 INFO:tasks.workunit.client.1.smithi115.stdout:7/785: link d0/d2/d3a/dac/da7/fe0 d0/d2/d3a/f10a 0 2024-04-16T14:35:47.387 INFO:tasks.workunit.client.0.smithi005.stdout:0/915: dwrite da/df/d26/da9/d108/f38 [0,4194304] 0 2024-04-16T14:35:47.387 INFO:tasks.workunit.client.0.smithi005.stdout:0/916: write da/df/d26/d39/d55/fe9 [323363,121608] 0 2024-04-16T14:35:47.388 INFO:tasks.workunit.client.1.smithi115.stdout:8/937: dwrite d0/db/d10/d17/d2c/d52/d6c/db8/d6b/ff4 [0,4194304] 0 2024-04-16T14:35:47.389 INFO:tasks.workunit.client.1.smithi115.stdout:7/786: symlink d0/d2/d3a/d30/d79/dd2/l10b 0 2024-04-16T14:35:47.395 INFO:tasks.workunit.client.0.smithi005.stdout:0/917: rename da/df/d1b/cd5 to da/df/d26/c13a 0 2024-04-16T14:35:47.396 INFO:tasks.workunit.client.1.smithi115.stdout:7/787: rename d0/d24/da3/db1/d49 to d0/d2/d3a/d30/d79/d95/d10c 0 2024-04-16T14:35:47.396 INFO:tasks.workunit.client.1.smithi115.stdout:7/788: chown d0/d24/da3/ded 27 1 2024-04-16T14:35:47.396 INFO:tasks.workunit.client.0.smithi005.stdout:0/918: symlink da/df/d26/da9/d10d/l13b 0 2024-04-16T14:35:47.397 INFO:tasks.workunit.client.0.smithi005.stdout:0/919: getdents da/df/d26/d39/d55 0 2024-04-16T14:35:47.398 INFO:tasks.workunit.client.0.smithi005.stdout:0/920: symlink da/df/d26/da9/d108/d75/d124/l13c 0 2024-04-16T14:35:47.399 INFO:tasks.workunit.client.0.smithi005.stdout:0/921: chown da/df/d26/d39/d55/ddc/d105/f120 31310 1 2024-04-16T14:35:47.399 INFO:tasks.workunit.client.0.smithi005.stdout:0/922: write da/df/d26/d39/d55/d5c/da8/f129 [992718,92564] 0 2024-04-16T14:35:47.399 INFO:tasks.workunit.client.1.smithi115.stdout:3/957: sync 2024-04-16T14:35:47.399 INFO:tasks.workunit.client.1.smithi115.stdout:6/878: sync 2024-04-16T14:35:47.399 INFO:tasks.workunit.client.1.smithi115.stdout:5/890: sync 2024-04-16T14:35:47.399 INFO:tasks.workunit.client.1.smithi115.stdout:5/891: write dc/d15/f24 [1543776,93230] 0 2024-04-16T14:35:47.400 INFO:tasks.workunit.client.0.smithi005.stdout:2/857: dwrite d0/d1c/d39/d48/f81 [0,4194304] 0 2024-04-16T14:35:47.400 INFO:tasks.workunit.client.0.smithi005.stdout:2/858: fdatasync d0/d1c/d59/d7a/d84/fbc 0 2024-04-16T14:35:47.400 INFO:tasks.workunit.client.0.smithi005.stdout:0/923: truncate da/df/d26/d134/fc5 4570597 0 2024-04-16T14:35:47.401 INFO:tasks.workunit.client.1.smithi115.stdout:3/958: symlink dc/d29/d4d/d56/d126/dde/d120/l142 0 2024-04-16T14:35:47.401 INFO:tasks.workunit.client.1.smithi115.stdout:5/892: getdents dc/d5d/d81 0 2024-04-16T14:35:47.401 INFO:tasks.workunit.client.1.smithi115.stdout:5/893: stat dc/d3d/f42 0 2024-04-16T14:35:47.402 INFO:tasks.workunit.client.1.smithi115.stdout:8/938: dread d0/db/d10/d17/d2c/d52/f99 [0,4194304] 0 2024-04-16T14:35:47.402 INFO:tasks.workunit.client.1.smithi115.stdout:8/939: chown d0/db/d10/d17/d2c/d52/d74/c88 20792879 1 2024-04-16T14:35:47.402 INFO:tasks.workunit.client.1.smithi115.stdout:5/894: creat dc/d15/f10d x:0 0 0 2024-04-16T14:35:47.402 INFO:tasks.workunit.client.1.smithi115.stdout:5/895: fsync dc/d3d/f7f 0 2024-04-16T14:35:47.402 INFO:tasks.workunit.client.1.smithi115.stdout:5/896: write dc/d79/ff5 [570768,40391] 0 2024-04-16T14:35:47.402 INFO:tasks.workunit.client.1.smithi115.stdout:5/897: read dc/d5d/d8f/faf [1613320,97296] 0 2024-04-16T14:35:47.402 INFO:tasks.workunit.client.1.smithi115.stdout:5/898: write dc/d15/f10d [643656,48865] 0 2024-04-16T14:35:47.403 INFO:tasks.workunit.client.0.smithi005.stdout:2/859: rename d0/d1c/d8d/fad to d0/d2a/d3a/d46/dd8/f123 0 2024-04-16T14:35:47.403 INFO:tasks.workunit.client.1.smithi115.stdout:6/879: dread d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/d5a/fbd [0,4194304] 0 2024-04-16T14:35:47.404 INFO:tasks.workunit.client.1.smithi115.stdout:3/959: mknod dc/d29/d77/d12f/c143 0 2024-04-16T14:35:47.404 INFO:tasks.workunit.client.1.smithi115.stdout:3/960: read - dc/d29/d39/fef zero size 2024-04-16T14:35:47.405 INFO:tasks.workunit.client.0.smithi005.stdout:2/860: mknod d0/d1c/c124 0 2024-04-16T14:35:47.406 INFO:tasks.workunit.client.1.smithi115.stdout:8/940: truncate d0/db/d10/d17/d2c/d52/d74/d3b/fb2 1816037 0 2024-04-16T14:35:47.407 INFO:tasks.workunit.client.0.smithi005.stdout:9/859: dwrite d3/d12/f28 [4194304,4194304] 0 2024-04-16T14:35:47.407 INFO:tasks.workunit.client.0.smithi005.stdout:9/860: write d3/d49/d4b/d55/fea [1434629,122567] 0 2024-04-16T14:35:47.408 INFO:tasks.workunit.client.0.smithi005.stdout:9/861: chown d3/d12/d2b/f4e 4099 1 2024-04-16T14:35:47.408 INFO:tasks.workunit.client.1.smithi115.stdout:8/941: truncate d0/db/d10/d17/d2c/d52/dcc/fe6 1988803 0 2024-04-16T14:35:47.408 INFO:tasks.workunit.client.1.smithi115.stdout:8/942: dread - d0/db/d10/d17/d22/deb/fba zero size 2024-04-16T14:35:47.409 INFO:tasks.workunit.client.1.smithi115.stdout:6/880: dread d13/d1d/d2b/ffe [0,4194304] 0 2024-04-16T14:35:47.410 INFO:tasks.workunit.client.1.smithi115.stdout:7/789: write d0/d2/d3a/d30/f32 [2806425,55108] 0 2024-04-16T14:35:47.410 INFO:tasks.workunit.client.1.smithi115.stdout:7/790: fdatasync d0/d1/f1f 0 2024-04-16T14:35:47.410 INFO:tasks.workunit.client.1.smithi115.stdout:8/943: symlink d0/db/dbb/dcd/dbd/l138 0 2024-04-16T14:35:47.411 INFO:tasks.workunit.client.1.smithi115.stdout:8/944: mknod d0/db/d10/d17/d2c/d85/c139 0 2024-04-16T14:35:47.414 INFO:tasks.workunit.client.1.smithi115.stdout:8/945: link d0/de5/d132/ldb d0/db/d10/d17/d2c/d52/d74/d73/l13a 0 2024-04-16T14:35:47.415 INFO:tasks.workunit.client.1.smithi115.stdout:6/881: creat d13/d1d/d2b/df4/d112/d114/d11a/f121 x:0 0 0 2024-04-16T14:35:47.419 INFO:tasks.workunit.client.1.smithi115.stdout:7/791: write d0/d2/d3a/d30/d6b/f84 [117214,105301] 0 2024-04-16T14:35:47.420 INFO:tasks.workunit.client.1.smithi115.stdout:8/946: getdents d0/db/d10/d17/d2c/d52/d6c/db8/d7d/de2 0 2024-04-16T14:35:47.422 INFO:tasks.workunit.client.1.smithi115.stdout:8/947: creat d0/db/d10/f13b x:0 0 0 2024-04-16T14:35:47.424 INFO:tasks.workunit.client.0.smithi005.stdout:9/862: dread d3/d49/d4b/d55/f5d [0,4194304] 0 2024-04-16T14:35:47.424 INFO:tasks.workunit.client.0.smithi005.stdout:9/863: fdatasync d3/d49/d4b/d5c/d65/ff7 0 2024-04-16T14:35:47.424 INFO:tasks.workunit.client.0.smithi005.stdout:8/922: sync 2024-04-16T14:35:47.425 INFO:tasks.workunit.client.0.smithi005.stdout:8/923: creat d5/d7b/da8/da5/def/d10d/f143 x:0 0 0 2024-04-16T14:35:47.427 INFO:tasks.workunit.client.1.smithi115.stdout:6/882: dread d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/d5a/fe5 [0,4194304] 0 2024-04-16T14:35:47.429 INFO:tasks.workunit.client.0.smithi005.stdout:0/924: dwrite da/df/d26/da9/d108/f7e [0,4194304] 0 2024-04-16T14:35:47.430 INFO:tasks.workunit.client.1.smithi115.stdout:7/792: rmdir d0/d2/d3a/d30/d79/d95/d10c/dfd 0 2024-04-16T14:35:47.432 INFO:tasks.workunit.client.1.smithi115.stdout:6/883: link d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/ca1 d13/d1d/d2b/d5f/d30/d43/d2c/de2/c122 0 2024-04-16T14:35:47.433 INFO:tasks.workunit.client.1.smithi115.stdout:6/884: dread - d13/d1d/d47/fc8 zero size 2024-04-16T14:35:47.433 INFO:tasks.workunit.client.1.smithi115.stdout:7/793: mknod d0/d24/d40/df0/c10d 0 2024-04-16T14:35:47.434 INFO:tasks.workunit.client.1.smithi115.stdout:6/885: creat d13/d1d/d52/f123 x:0 0 0 2024-04-16T14:35:47.435 INFO:tasks.workunit.client.1.smithi115.stdout:6/886: readlink d13/d1d/lf3 0 2024-04-16T14:35:47.437 INFO:tasks.workunit.client.0.smithi005.stdout:9/864: dread d3/d12/f6c [0,4194304] 0 2024-04-16T14:35:47.437 INFO:tasks.workunit.client.0.smithi005.stdout:9/865: chown d3/d49/d4b/d5c/d65 9600482 1 2024-04-16T14:35:47.442 INFO:tasks.workunit.client.1.smithi115.stdout:6/887: dread d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/d5a/dcb/fde [0,4194304] 0 2024-04-16T14:35:47.445 INFO:tasks.workunit.client.1.smithi115.stdout:6/888: unlink d13/d1d/d2b/df4/f11e 0 2024-04-16T14:35:47.445 INFO:tasks.workunit.client.1.smithi115.stdout:7/794: dread d0/d2/d3a/d73/f7d [0,4194304] 0 2024-04-16T14:35:47.447 INFO:tasks.workunit.client.1.smithi115.stdout:7/795: unlink d0/d2/cd 0 2024-04-16T14:35:47.454 INFO:tasks.workunit.client.1.smithi115.stdout:3/961: dwrite dc/fdb [4194304,4194304] 0 2024-04-16T14:35:47.459 INFO:tasks.workunit.client.0.smithi005.stdout:0/925: mkdir da/df/d1b/d3a/d53/d5a/d67/dda/d13d 0 2024-04-16T14:35:47.459 INFO:tasks.workunit.client.0.smithi005.stdout:0/926: fsync da/df/d1b/d3a/d53/dbc/f126 0 2024-04-16T14:35:47.459 INFO:tasks.workunit.client.0.smithi005.stdout:0/927: chown da/df/d26/l3c 3484278 1 2024-04-16T14:35:47.460 INFO:tasks.workunit.client.1.smithi115.stdout:8/948: dwrite d0/db/d10/d17/d2c/d52/d6c/db8/d7d/de2/d111/d89/f12c [0,4194304] 0 2024-04-16T14:35:47.463 INFO:tasks.workunit.client.0.smithi005.stdout:9/866: symlink d3/d12/d2b/d8e/dc1/lf8 0 2024-04-16T14:35:47.463 INFO:tasks.workunit.client.0.smithi005.stdout:9/867: truncate d3/d49/d4b/d5c/d65/d9a/da9/fda 1029778 0 2024-04-16T14:35:47.464 INFO:tasks.workunit.client.1.smithi115.stdout:6/889: getdents d13/d1d/d2b/df4 0 2024-04-16T14:35:47.465 INFO:tasks.workunit.client.1.smithi115.stdout:6/890: write d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/f10b [161271,123431] 0 2024-04-16T14:35:47.467 INFO:tasks.workunit.client.1.smithi115.stdout:6/891: rename d13/d1d/d52/d8c/la9 to d13/d1d/d2b/d5b/l124 0 2024-04-16T14:35:47.467 INFO:tasks.workunit.client.1.smithi115.stdout:6/892: readlink d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/d5a/dcb/ldf 0 2024-04-16T14:35:47.467 INFO:tasks.workunit.client.1.smithi115.stdout:6/893: fsync d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/d63/fb9 0 2024-04-16T14:35:47.468 INFO:tasks.workunit.client.0.smithi005.stdout:9/868: getdents d3/d12/d16/d46/d47/d60 0 2024-04-16T14:35:47.468 INFO:tasks.workunit.client.0.smithi005.stdout:9/869: getdents d3/d49/d4b/d5c/d65/d9a 0 2024-04-16T14:35:47.470 INFO:tasks.workunit.client.1.smithi115.stdout:7/796: dwrite d0/d2/d3a/d30/d79/dd2/d9c/faa [0,4194304] 0 2024-04-16T14:35:47.470 INFO:tasks.workunit.client.1.smithi115.stdout:7/797: readlink d0/d2/d3a/d30/d79/dd2/l3c 0 2024-04-16T14:35:47.471 INFO:tasks.workunit.client.0.smithi005.stdout:9/870: mknod d3/d49/d4b/d5c/d65/d9a/daf/cf9 0 2024-04-16T14:35:47.471 INFO:tasks.workunit.client.0.smithi005.stdout:9/871: chown d3/d49/d4b/d55/ff4 2237587 1 2024-04-16T14:35:47.473 INFO:tasks.workunit.client.0.smithi005.stdout:9/872: creat d3/d49/d4b/d5c/d65/d9a/daf/ffa x:0 0 0 2024-04-16T14:35:47.475 INFO:tasks.workunit.client.0.smithi005.stdout:9/873: mkdir d3/d12/d9d/dfb 0 2024-04-16T14:35:47.475 INFO:tasks.workunit.client.0.smithi005.stdout:9/874: truncate d3/d49/d4b/d55/ff4 415493 0 2024-04-16T14:35:47.480 INFO:tasks.workunit.client.0.smithi005.stdout:8/924: rename d5/d7b/da8/da5/def/d10d to d5/d40/d4b/d144 0 2024-04-16T14:35:47.492 INFO:tasks.workunit.client.0.smithi005.stdout:0/928: dwrite da/df/d26/da9/d108/d75/d81/fb7 [4194304,4194304] 0 2024-04-16T14:35:47.494 INFO:tasks.workunit.client.0.smithi005.stdout:0/929: creat da/df/d26/f13e x:0 0 0 2024-04-16T14:35:47.494 INFO:tasks.workunit.client.0.smithi005.stdout:0/930: stat da/df/d26/d134/fc0 0 2024-04-16T14:35:47.494 INFO:tasks.workunit.client.0.smithi005.stdout:0/931: chown da/df/d26/d39/d55/d5c/da8/lcd 174515 1 2024-04-16T14:35:47.494 INFO:tasks.workunit.client.0.smithi005.stdout:0/932: truncate da/f10a 968100 0 2024-04-16T14:35:47.495 INFO:tasks.workunit.client.0.smithi005.stdout:0/933: write da/df/d26/da9/d108/d75/d81/fd4 [599398,101161] 0 2024-04-16T14:35:47.496 INFO:tasks.workunit.client.1.smithi115.stdout:3/962: dwrite dc/d29/d39/d86/dd0/dee/d137/fd5 [0,4194304] 0 2024-04-16T14:35:47.497 INFO:tasks.workunit.client.0.smithi005.stdout:8/925: dread d5/d7b/da8/da5/def/f8f [0,4194304] 0 2024-04-16T14:35:47.497 INFO:tasks.workunit.client.0.smithi005.stdout:8/926: getdents d5/d7b/da8 0 2024-04-16T14:35:47.497 INFO:tasks.workunit.client.0.smithi005.stdout:8/927: stat d5/d55/d5a/d135/dba/dcd/fd8 0 2024-04-16T14:35:47.497 INFO:tasks.workunit.client.0.smithi005.stdout:9/875: dwrite d3/d49/d4b/fd7 [0,4194304] 0 2024-04-16T14:35:47.501 INFO:tasks.workunit.client.0.smithi005.stdout:9/876: mkdir d3/d12/d9d/dfc 0 2024-04-16T14:35:47.502 INFO:tasks.workunit.client.0.smithi005.stdout:8/928: getdents d5/d9b 0 2024-04-16T14:35:47.503 INFO:tasks.workunit.client.0.smithi005.stdout:8/929: chown d5/d55/d5a/d135/dba/dcd/f137 6274351 1 2024-04-16T14:35:47.503 INFO:tasks.workunit.client.0.smithi005.stdout:8/930: write d5/d7b/da8/da5/def/d71/fc5 [4907319,92761] 0 2024-04-16T14:35:47.503 INFO:tasks.workunit.client.0.smithi005.stdout:8/931: chown d5/d11/c1b 7177 1 2024-04-16T14:35:47.508 INFO:tasks.workunit.client.0.smithi005.stdout:9/877: mkdir d3/d49/d4b/d5c/d65/d9a/daf/de0/dfd 0 2024-04-16T14:35:47.514 INFO:tasks.workunit.client.1.smithi115.stdout:3/963: dwrite dc/d24/d36/d60/ff3 [0,4194304] 0 2024-04-16T14:35:47.515 INFO:tasks.workunit.client.0.smithi005.stdout:8/932: dwrite d5/d9b/fdb [0,4194304] 0 2024-04-16T14:35:47.515 INFO:tasks.workunit.client.0.smithi005.stdout:8/933: read - d5/d7b/da8/db7/d74/fb1 zero size 2024-04-16T14:35:47.517 INFO:tasks.workunit.client.0.smithi005.stdout:8/934: dread d5/d55/d5a/d135/dba/dcd/f137 [0,4194304] 0 2024-04-16T14:35:47.521 INFO:tasks.workunit.client.1.smithi115.stdout:6/894: creat d13/d1d/d47/f125 x:0 0 0 2024-04-16T14:35:47.521 INFO:tasks.workunit.client.1.smithi115.stdout:6/895: stat f8 0 2024-04-16T14:35:47.521 INFO:tasks.workunit.client.1.smithi115.stdout:6/896: truncate fc 804910 0 2024-04-16T14:35:47.522 INFO:tasks.workunit.client.1.smithi115.stdout:6/897: dread - d13/d1d/d47/fe7 zero size 2024-04-16T14:35:47.522 INFO:tasks.workunit.client.1.smithi115.stdout:3/964: rename dc/d24/d80 to dc/d29/d4d/d56/d126/d4b/da3/d144 0 2024-04-16T14:35:47.523 INFO:tasks.workunit.client.1.smithi115.stdout:3/965: chown dc/d29/d39/d106/f10f 89135 1 2024-04-16T14:35:47.523 INFO:tasks.workunit.client.1.smithi115.stdout:3/966: write dc/d29/d4d/d56/d126/f131 [374572,41982] 0 2024-04-16T14:35:47.523 INFO:tasks.workunit.client.1.smithi115.stdout:3/967: chown dc/d29/d77/f141 16 1 2024-04-16T14:35:47.525 INFO:tasks.workunit.client.1.smithi115.stdout:3/968: creat dc/d29/d4d/d56/d126/d4b/d81/f145 x:0 0 0 2024-04-16T14:35:47.526 INFO:tasks.workunit.client.0.smithi005.stdout:9/878: dwrite d3/d12/d16/dc6/fde [0,4194304] 0 2024-04-16T14:35:47.528 INFO:tasks.workunit.client.1.smithi115.stdout:3/969: rename dc/d29/d4d/f129 to dc/d24/d36/d60/f146 0 2024-04-16T14:35:47.530 INFO:tasks.workunit.client.1.smithi115.stdout:3/970: write dc/d24/f82 [1711785,64325] 0 2024-04-16T14:35:47.530 INFO:tasks.workunit.client.1.smithi115.stdout:3/971: read - dc/d24/fcd zero size 2024-04-16T14:35:47.530 INFO:tasks.workunit.client.1.smithi115.stdout:3/972: chown dc/d29/ce4 125206743 1 2024-04-16T14:35:47.530 INFO:tasks.workunit.client.1.smithi115.stdout:3/973: fsync dc/fdb 0 2024-04-16T14:35:47.532 INFO:tasks.workunit.client.0.smithi005.stdout:9/879: symlink d3/d49/d4b/lfe 0 2024-04-16T14:35:47.532 INFO:tasks.workunit.client.0.smithi005.stdout:9/880: chown d3/d12/d16/lcb 79110 1 2024-04-16T14:35:47.532 INFO:tasks.workunit.client.0.smithi005.stdout:9/881: read d3/d12/d2b/f4e [1138646,26949] 0 2024-04-16T14:35:47.532 INFO:tasks.workunit.client.0.smithi005.stdout:9/882: stat d3/d49 0 2024-04-16T14:35:47.535 INFO:tasks.workunit.client.0.smithi005.stdout:9/883: link d3/d49/d4b/d5c/d65/d9a/da9/db4/cbd d3/d12/d16/cff 0 2024-04-16T14:35:47.536 INFO:tasks.workunit.client.1.smithi115.stdout:3/974: getdents dc/d29/d4d/d56/d126/d4b/da3/d144/dfc 0 2024-04-16T14:35:47.537 INFO:tasks.workunit.client.0.smithi005.stdout:9/884: symlink d3/d12/d16/d46/d47/d60/l100 0 2024-04-16T14:35:47.538 INFO:tasks.workunit.client.1.smithi115.stdout:3/975: unlink dc/f1c 0 2024-04-16T14:35:47.540 INFO:tasks.workunit.client.0.smithi005.stdout:8/935: dwrite d5/d55/d5a/d135/d7f/d8d/f116 [0,4194304] 0 2024-04-16T14:35:47.540 INFO:tasks.workunit.client.0.smithi005.stdout:8/936: truncate d5/d7b/da8/da5/def/f110 414143 0 2024-04-16T14:35:47.540 INFO:tasks.workunit.client.0.smithi005.stdout:8/937: chown d5/d7b/da8/da5/def 61698834 1 2024-04-16T14:35:47.540 INFO:tasks.workunit.client.1.smithi115.stdout:6/898: dwrite d13/d1d/d68/fbe [0,4194304] 0 2024-04-16T14:35:47.541 INFO:tasks.workunit.client.0.smithi005.stdout:9/885: link d3/c9e d3/d12/d16/d46/d47/db1/c101 0 2024-04-16T14:35:47.542 INFO:tasks.workunit.client.1.smithi115.stdout:6/899: rename d13/d1d/d52/d8c/fc7 to d13/d1d/d87/f126 0 2024-04-16T14:35:47.544 INFO:tasks.workunit.client.0.smithi005.stdout:8/938: getdents d5/d55/d5a/d135 0 2024-04-16T14:35:47.546 INFO:tasks.workunit.client.0.smithi005.stdout:9/886: rename d3/d49/d4b/d55/fea to d3/d12/d2b/d8e/f102 0 2024-04-16T14:35:47.546 INFO:tasks.workunit.client.0.smithi005.stdout:9/887: write d3/d12/d16/fc7 [859311,19471] 0 2024-04-16T14:35:47.548 INFO:tasks.workunit.client.0.smithi005.stdout:9/888: creat d3/f103 x:0 0 0 2024-04-16T14:35:47.550 INFO:tasks.workunit.client.1.smithi115.stdout:6/900: dread d13/d1d/d2b/d5f/d30/d43/fda [0,4194304] 0 2024-04-16T14:35:47.551 INFO:tasks.workunit.client.1.smithi115.stdout:6/901: dread d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/fd2 [0,4194304] 0 2024-04-16T14:35:47.551 INFO:tasks.workunit.client.1.smithi115.stdout:6/902: getdents d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/d63/db0 0 2024-04-16T14:35:47.552 INFO:tasks.workunit.client.1.smithi115.stdout:6/903: creat d13/d1d/d2b/d5f/d30/d43/d2c/de2/f127 x:0 0 0 2024-04-16T14:35:47.552 INFO:tasks.workunit.client.1.smithi115.stdout:6/904: truncate d13/d1d/d68/f9a 823569 0 2024-04-16T14:35:47.553 INFO:tasks.workunit.client.1.smithi115.stdout:6/905: fsync d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96/de4/f120 0 2024-04-16T14:35:47.556 INFO:tasks.workunit.client.0.smithi005.stdout:9/889: write d3/d12/d16/f1d [3432663,27755] 0 2024-04-16T14:35:47.556 INFO:tasks.workunit.client.0.smithi005.stdout:9/890: chown d3/d49/d4b/d5c/d65/d9a/fcd 1291756 1 2024-04-16T14:35:47.556 INFO:tasks.workunit.client.0.smithi005.stdout:9/891: chown d3/d49/d4b/d55/d7b/cb2 3671188 1 2024-04-16T14:35:47.556 INFO:tasks.workunit.client.0.smithi005.stdout:9/892: readlink d3/d12/d2b/lc3 0 2024-04-16T14:35:47.557 INFO:tasks.workunit.client.0.smithi005.stdout:9/893: chown d3/d12/f6c 21536 1 2024-04-16T14:35:47.558 INFO:tasks.workunit.client.0.smithi005.stdout:9/894: rename d3/d12/d2b/f4e to d3/d12/d16/d46/d47/db1/f104 0 2024-04-16T14:35:47.558 INFO:tasks.workunit.client.0.smithi005.stdout:9/895: chown d3/d12/d16/c42 1519885 1 2024-04-16T14:35:47.559 INFO:tasks.workunit.client.0.smithi005.stdout:9/896: readlink d3/d49/d4b/d5c/d65/d9a/lac 0 2024-04-16T14:35:47.561 INFO:tasks.workunit.client.0.smithi005.stdout:9/897: rename d3/d49/d4b/d55/c56 to d3/d12/d2b/d8e/dc1/c105 0 2024-04-16T14:35:47.561 INFO:tasks.workunit.client.0.smithi005.stdout:9/898: readlink d3/d49/d4b/le2 0 2024-04-16T14:35:47.572 INFO:tasks.workunit.client.0.smithi005.stdout:8/939: dwrite d5/d55/d5a/d135/d7f/d8d/f98 [0,4194304] 0 2024-04-16T14:35:47.575 INFO:tasks.workunit.client.0.smithi005.stdout:8/940: rename d5/d55/c60 to d5/d55/d5a/d135/d7f/de7/c145 0 2024-04-16T14:35:47.577 INFO:tasks.workunit.client.0.smithi005.stdout:8/941: rmdir d5/d7b/da8/da5/def/d71 39 2024-04-16T14:35:47.578 INFO:tasks.workunit.client.0.smithi005.stdout:8/942: fsync d5/d7b/f24 0 2024-04-16T14:35:47.579 INFO:tasks.workunit.client.0.smithi005.stdout:8/943: link d5/d11/f45 d5/d40/d8e/f146 0 2024-04-16T14:35:47.585 INFO:tasks.workunit.client.0.smithi005.stdout:9/899: dwrite d3/f103 [0,4194304] 0 2024-04-16T14:35:47.588 INFO:tasks.workunit.client.0.smithi005.stdout:8/944: write d5/d55/d5a/d135/f87 [3361556,107491] 0 2024-04-16T14:35:47.588 INFO:tasks.workunit.client.0.smithi005.stdout:8/945: chown d5/d11/ff8 8 1 2024-04-16T14:35:47.588 INFO:tasks.workunit.client.0.smithi005.stdout:9/900: creat d3/d49/d4b/d5c/f106 x:0 0 0 2024-04-16T14:35:47.591 INFO:tasks.workunit.client.0.smithi005.stdout:8/946: rmdir d5/d55/d5a/d135/d7f 39 2024-04-16T14:35:47.591 INFO:tasks.workunit.client.0.smithi005.stdout:8/947: write d5/d7b/da8/db7/fb2 [1883731,84870] 0 2024-04-16T14:35:47.597 INFO:tasks.workunit.client.0.smithi005.stdout:8/948: link d5/da0/f141 d5/d55/f147 0 2024-04-16T14:35:47.597 INFO:tasks.workunit.client.0.smithi005.stdout:8/949: dread - d5/d7b/da8/db7/d74/f124 zero size 2024-04-16T14:35:47.597 INFO:tasks.workunit.client.0.smithi005.stdout:8/950: write d5/d55/d5a/d135/d7f/d8d/dd1/f12c [609583,79241] 0 2024-04-16T14:35:47.598 INFO:tasks.workunit.client.0.smithi005.stdout:8/951: dread d5/d7b/da8/fe1 [0,4194304] 0 2024-04-16T14:35:47.598 INFO:tasks.workunit.client.0.smithi005.stdout:8/952: chown d5/d40/d4b/f117 22 1 2024-04-16T14:35:47.598 INFO:tasks.workunit.client.0.smithi005.stdout:8/953: write d5/d55/f147 [213721,35072] 0 2024-04-16T14:35:47.598 INFO:tasks.workunit.client.0.smithi005.stdout:8/954: chown d5/d40/c41 1151138387 1 2024-04-16T14:35:47.598 INFO:tasks.workunit.client.0.smithi005.stdout:8/955: fsync d5/d40/d8e/f146 0 2024-04-16T14:35:47.605 INFO:tasks.workunit.client.0.smithi005.stdout:8/956: write d5/d7b/da8/db7/d8a/f91 [3363100,112805] 0 2024-04-16T14:35:47.606 INFO:tasks.workunit.client.0.smithi005.stdout:9/901: dwrite d3/d12/d16/d46/d47/d60/de9/dd6/fd9 [0,4194304] 0 2024-04-16T14:35:47.608 INFO:tasks.workunit.client.0.smithi005.stdout:8/957: truncate d5/d55/d5a/d135/d7f/d8d/f97 78307 0 2024-04-16T14:35:47.612 INFO:tasks.workunit.client.0.smithi005.stdout:9/902: unlink d3/c34 0 2024-04-16T14:35:47.612 INFO:tasks.workunit.client.0.smithi005.stdout:9/903: stat d3/c6 0 2024-04-16T14:35:47.612 INFO:tasks.workunit.client.0.smithi005.stdout:9/904: chown d3/d12/d16/c42 1141 1 2024-04-16T14:35:47.613 INFO:tasks.workunit.client.0.smithi005.stdout:8/958: mknod d5/d55/d5a/d135/dba/c148 0 2024-04-16T14:35:47.613 INFO:tasks.workunit.client.0.smithi005.stdout:9/905: creat d3/d49/d4b/d55/f107 x:0 0 0 2024-04-16T14:35:47.614 INFO:tasks.workunit.client.0.smithi005.stdout:8/959: rename d5/d7b/da8/db7/d8a/da1/f96 to d5/d7b/da8/da5/f149 0 2024-04-16T14:35:47.616 INFO:tasks.workunit.client.0.smithi005.stdout:9/906: symlink d3/d12/d16/d46/l108 0 2024-04-16T14:35:47.616 INFO:tasks.workunit.client.0.smithi005.stdout:9/907: truncate d3/d12/d16/d46/d47/d60/de9/f87 1818516 0 2024-04-16T14:35:47.616 INFO:tasks.workunit.client.0.smithi005.stdout:9/908: write d3/d49/d4b/d55/f107 [21374,64210] 0 2024-04-16T14:35:47.617 INFO:tasks.workunit.client.0.smithi005.stdout:9/909: truncate d3/d12/d16/f4d 2018312 0 2024-04-16T14:35:47.617 INFO:tasks.workunit.client.0.smithi005.stdout:8/960: dread d5/d40/f61 [0,4194304] 0 2024-04-16T14:35:47.619 INFO:tasks.workunit.client.0.smithi005.stdout:8/961: mkdir d5/d7b/da8/db7/d132/d14a 0 2024-04-16T14:35:47.619 INFO:tasks.workunit.client.0.smithi005.stdout:8/962: chown d5/d9b/ldf 3287342 1 2024-04-16T14:35:47.620 INFO:tasks.workunit.client.1.smithi115.stdout:0/760: sync 2024-04-16T14:35:47.620 INFO:tasks.workunit.client.1.smithi115.stdout:5/899: sync 2024-04-16T14:35:47.620 INFO:tasks.workunit.client.1.smithi115.stdout:4/916: sync 2024-04-16T14:35:47.621 INFO:tasks.workunit.client.1.smithi115.stdout:0/761: truncate d6/d10/d12/d31/feb 1630938 0 2024-04-16T14:35:47.621 INFO:tasks.workunit.client.1.smithi115.stdout:0/762: write d6/d10/d12/d31/d35/d44/fa7 [589372,122674] 0 2024-04-16T14:35:47.621 INFO:tasks.workunit.client.0.smithi005.stdout:8/963: mknod d5/d9b/c14b 0 2024-04-16T14:35:47.621 INFO:tasks.workunit.client.0.smithi005.stdout:8/964: mknod d5/d7b/da8/da5/def/c14c 0 2024-04-16T14:35:47.623 INFO:tasks.workunit.client.0.smithi005.stdout:8/965: creat d5/d7b/da8/db7/d132/d14a/f14d x:0 0 0 2024-04-16T14:35:47.623 INFO:tasks.workunit.client.0.smithi005.stdout:8/966: getdents d5/d7b/da8 0 2024-04-16T14:35:47.625 INFO:tasks.workunit.client.0.smithi005.stdout:8/967: unlink d5/d55/d5a/d135/dba/dcd/cfc 0 2024-04-16T14:35:47.631 INFO:tasks.workunit.client.1.smithi115.stdout:5/900: dread f2 [0,4194304] 0 2024-04-16T14:35:47.637 INFO:tasks.workunit.client.0.smithi005.stdout:9/910: dwrite d3/d12/f6c [0,4194304] 0 2024-04-16T14:35:47.644 INFO:tasks.workunit.client.0.smithi005.stdout:9/911: dread d3/d49/d4b/d5c/fb8 [0,4194304] 0 2024-04-16T14:35:47.644 INFO:tasks.workunit.client.0.smithi005.stdout:8/968: dwrite d5/d55/d5a/d135/fee [0,4194304] 0 2024-04-16T14:35:47.648 INFO:tasks.workunit.client.0.smithi005.stdout:9/912: link d3/d49/d4b/d55/l5f d3/d12/d2b/d8e/dc1/l109 0 2024-04-16T14:35:47.650 INFO:tasks.workunit.client.0.smithi005.stdout:8/969: mknod d5/d7b/da8/db7/c14e 0 2024-04-16T14:35:47.651 INFO:tasks.workunit.client.0.smithi005.stdout:8/970: getdents d5/d40/d4b/d144 0 2024-04-16T14:35:47.651 INFO:tasks.workunit.client.0.smithi005.stdout:8/971: chown d5/d40/d4b 7890 1 2024-04-16T14:35:47.652 INFO:tasks.workunit.client.0.smithi005.stdout:8/972: mkdir d5/d55/d5a/d135/d7f/d8d/dd1/d14f 0 2024-04-16T14:35:47.652 INFO:tasks.workunit.client.0.smithi005.stdout:8/973: truncate d5/d7b/da8/db7/d74/fb1 625438 0 2024-04-16T14:35:47.653 INFO:tasks.workunit.client.0.smithi005.stdout:8/974: getdents d5/d7b/da8/db7/d132/d14a 0 2024-04-16T14:35:47.653 INFO:tasks.workunit.client.0.smithi005.stdout:8/975: write d5/d55/d5a/d135/dba/dcd/f137 [1581296,128400] 0 2024-04-16T14:35:47.677 INFO:tasks.workunit.client.0.smithi005.stdout:9/913: dwrite d3/d49/d4b/d5c/d65/d9a/fcd [0,4194304] 0 2024-04-16T14:35:47.677 INFO:tasks.workunit.client.0.smithi005.stdout:9/914: dread - d3/d49/d4b/d5c/d65/d9a/daf/de0/ff1 zero size 2024-04-16T14:35:47.678 INFO:tasks.workunit.client.0.smithi005.stdout:8/976: dwrite d5/d7b/da8/db7/d8a/da1/fd0 [0,4194304] 0 2024-04-16T14:35:47.679 INFO:tasks.workunit.client.0.smithi005.stdout:8/977: write d5/da0/f141 [346120,45795] 0 2024-04-16T14:35:47.679 INFO:tasks.workunit.client.0.smithi005.stdout:8/978: read - d5/d55/fb3 zero size 2024-04-16T14:35:47.694 INFO:tasks.workunit.client.0.smithi005.stdout:2/861: sync 2024-04-16T14:35:47.694 INFO:tasks.workunit.client.0.smithi005.stdout:0/934: sync 2024-04-16T14:35:47.695 INFO:tasks.workunit.client.0.smithi005.stdout:2/862: dread d0/d29/d3e/fba [0,4194304] 0 2024-04-16T14:35:47.695 INFO:tasks.workunit.client.0.smithi005.stdout:0/935: mkdir da/df/d1b/d13f 0 2024-04-16T14:35:47.696 INFO:tasks.workunit.client.0.smithi005.stdout:2/863: unlink d0/d2a/d3a/d46/f4b 0 2024-04-16T14:35:47.698 INFO:tasks.workunit.client.0.smithi005.stdout:2/864: unlink d0/d2a/d3a/d46/dd8/l8c 0 2024-04-16T14:35:47.698 INFO:tasks.workunit.client.0.smithi005.stdout:0/936: rmdir da/df/d26/da9/d108/d75/d124 39 2024-04-16T14:35:47.698 INFO:tasks.workunit.client.0.smithi005.stdout:0/937: creat da/df/d26/d39/d55/ddc/d105/f140 x:0 0 0 2024-04-16T14:35:47.699 INFO:tasks.workunit.client.1.smithi115.stdout:4/917: creat d1/d15/d17/d9e/ddf/f122 x:0 0 0 2024-04-16T14:35:47.699 INFO:tasks.workunit.client.1.smithi115.stdout:4/918: dread - d1/d15/d31/d89/f110 zero size 2024-04-16T14:35:47.700 INFO:tasks.workunit.client.0.smithi005.stdout:8/979: dwrite d5/d55/f6b [0,4194304] 0 2024-04-16T14:35:47.700 INFO:tasks.workunit.client.1.smithi115.stdout:0/763: creat d6/d30/d8d/f10a x:0 0 0 2024-04-16T14:35:47.701 INFO:tasks.workunit.client.0.smithi005.stdout:9/915: dwrite d3/d49/d4b/d5c/f106 [0,4194304] 0 2024-04-16T14:35:47.701 INFO:tasks.workunit.client.0.smithi005.stdout:8/980: creat d5/d55/d5a/d135/d7f/de7/f150 x:0 0 0 2024-04-16T14:35:47.703 INFO:tasks.workunit.client.0.smithi005.stdout:0/938: dread da/df/d1b/d3a/d53/d5a/d67/f8d [0,4194304] 0 2024-04-16T14:35:47.703 INFO:tasks.workunit.client.1.smithi115.stdout:5/901: truncate dc/d15/f5f 521225 0 2024-04-16T14:35:47.704 INFO:tasks.workunit.client.1.smithi115.stdout:5/902: creat dc/d15/de6/f10e x:0 0 0 2024-04-16T14:35:47.704 INFO:tasks.workunit.client.0.smithi005.stdout:9/916: creat d3/d12/d16/d46/d47/d60/de9/dd6/f10a x:0 0 0 2024-04-16T14:35:47.704 INFO:tasks.workunit.client.0.smithi005.stdout:9/917: creat d3/f10b x:0 0 0 2024-04-16T14:35:47.704 INFO:tasks.workunit.client.0.smithi005.stdout:8/981: creat d5/d7b/da8/db7/f151 x:0 0 0 2024-04-16T14:35:47.706 INFO:tasks.workunit.client.1.smithi115.stdout:4/919: symlink d1/d15/d31/dc2/df1/l123 0 2024-04-16T14:35:47.706 INFO:tasks.workunit.client.1.smithi115.stdout:4/920: chown d1/d15/d31/dc2/de4/de7/dfc 9158 1 2024-04-16T14:35:47.707 INFO:tasks.workunit.client.1.smithi115.stdout:4/921: readlink d1/d15/d31/d42/l5c 0 2024-04-16T14:35:47.707 INFO:tasks.workunit.client.0.smithi005.stdout:0/939: truncate da/df/d1b/d3a/d53/f8f 3016124 0 2024-04-16T14:35:47.707 INFO:tasks.workunit.client.0.smithi005.stdout:0/940: stat da/df/d26/da9/d108/d75/d81/fb7 0 2024-04-16T14:35:47.708 INFO:tasks.workunit.client.1.smithi115.stdout:4/922: write d1/d2/fa0 [322260,38063] 0 2024-04-16T14:35:47.708 INFO:tasks.workunit.client.1.smithi115.stdout:4/923: fsync d1/d15/d31/d42/d8b/f9b 0 2024-04-16T14:35:47.708 INFO:tasks.workunit.client.1.smithi115.stdout:0/764: mkdir d6/d10/d12/d1f/d36/d4b/d101/d10b 0 2024-04-16T14:35:47.712 INFO:tasks.workunit.client.1.smithi115.stdout:5/903: truncate f5 1568691 0 2024-04-16T14:35:47.712 INFO:tasks.workunit.client.0.smithi005.stdout:9/918: rename d3/d49/d91/fe4 to d3/d12/d16/d46/d47/f10c 0 2024-04-16T14:35:47.713 INFO:tasks.workunit.client.0.smithi005.stdout:8/982: dread d5/d40/d8e/fce [0,4194304] 0 2024-04-16T14:35:47.714 INFO:tasks.workunit.client.0.smithi005.stdout:0/941: mkdir da/df/d26/d8e/d141 0 2024-04-16T14:35:47.715 INFO:tasks.workunit.client.0.smithi005.stdout:9/919: symlink d3/l10d 0 2024-04-16T14:35:47.715 INFO:tasks.workunit.client.0.smithi005.stdout:9/920: fdatasync d3/d12/f30 0 2024-04-16T14:35:47.716 INFO:tasks.workunit.client.1.smithi115.stdout:4/924: dread d1/d15/d31/d42/d46/f63 [0,4194304] 0 2024-04-16T14:35:47.716 INFO:tasks.workunit.client.1.smithi115.stdout:0/765: rename d6/d54/d57 to d6/d30/d4d/df0/d10c 0 2024-04-16T14:35:47.716 INFO:tasks.workunit.client.1.smithi115.stdout:4/925: stat d1/d15/d31/d42/d46/l6a 0 2024-04-16T14:35:47.716 INFO:tasks.workunit.client.1.smithi115.stdout:0/766: creat d6/d10/d71/db7/f10d x:0 0 0 2024-04-16T14:35:47.718 INFO:tasks.workunit.client.0.smithi005.stdout:8/983: rename d5/d11/c1b to d5/d55/d5a/d135/d7f/d8d/dd1/d14f/c152 0 2024-04-16T14:35:47.719 INFO:tasks.workunit.client.1.smithi115.stdout:4/926: truncate d1/d15/d31/d42/d46/d7a/d105/f11a 507747 0 2024-04-16T14:35:47.720 INFO:tasks.workunit.client.1.smithi115.stdout:4/927: write d1/d15/d31/f41 [1099477,42957] 0 2024-04-16T14:35:47.720 INFO:tasks.workunit.client.1.smithi115.stdout:4/928: creat d1/d15/d17/d9e/dbe/f124 x:0 0 0 2024-04-16T14:35:47.720 INFO:tasks.workunit.client.0.smithi005.stdout:9/921: symlink d3/d12/d9d/l10e 0 2024-04-16T14:35:47.721 INFO:tasks.workunit.client.0.smithi005.stdout:2/865: dwrite d0/d2a/d3a/d46/dd8/ff6 [0,4194304] 0 2024-04-16T14:35:47.721 INFO:tasks.workunit.client.0.smithi005.stdout:8/984: creat d5/d55/d5a/d135/d7f/d8d/f153 x:0 0 0 2024-04-16T14:35:47.722 INFO:tasks.workunit.client.1.smithi115.stdout:0/767: rmdir d6/d10/d12 39 2024-04-16T14:35:47.722 INFO:tasks.workunit.client.0.smithi005.stdout:9/922: dread d3/d12/d16/d46/fa7 [0,4194304] 0 2024-04-16T14:35:47.724 INFO:tasks.workunit.client.0.smithi005.stdout:2/866: dread d0/d1c/d59/d7a/fcf [0,4194304] 0 2024-04-16T14:35:47.724 INFO:tasks.workunit.client.0.smithi005.stdout:8/985: mkdir d5/d7b/da8/da5/d154 0 2024-04-16T14:35:47.725 INFO:tasks.workunit.client.0.smithi005.stdout:9/923: dread d3/f14 [0,4194304] 0 2024-04-16T14:35:47.725 INFO:tasks.workunit.client.0.smithi005.stdout:9/924: chown d3/c9e 965980 1 2024-04-16T14:35:47.725 INFO:tasks.workunit.client.0.smithi005.stdout:2/867: mkdir d0/d4/d2b/d5e/d125 0 2024-04-16T14:35:47.726 INFO:tasks.workunit.client.0.smithi005.stdout:9/925: mknod d3/d12/c10f 0 2024-04-16T14:35:47.727 INFO:tasks.workunit.client.1.smithi115.stdout:4/929: rename d1/d15/d24/dc6/ce0 to d1/d15/d31/d42/d46/d7a/c125 0 2024-04-16T14:35:47.727 INFO:tasks.workunit.client.0.smithi005.stdout:2/868: rmdir d0/d1c/d39/d85 39 2024-04-16T14:35:47.728 INFO:tasks.workunit.client.1.smithi115.stdout:5/904: dread dc/d3d/d109/da3/fe7 [0,4194304] 0 2024-04-16T14:35:47.728 INFO:tasks.workunit.client.1.smithi115.stdout:5/905: fdatasync dc/d15/f17 0 2024-04-16T14:35:47.731 INFO:tasks.workunit.client.1.smithi115.stdout:0/768: dread d6/d54/f6b [0,4194304] 0 2024-04-16T14:35:47.733 INFO:tasks.workunit.client.0.smithi005.stdout:2/869: rename d0/d4/d2b/d5e/l75 to d0/d29/d3e/l126 0 2024-04-16T14:35:47.736 INFO:tasks.workunit.client.1.smithi115.stdout:4/930: dread d1/d15/d1e/f81 [0,4194304] 0 2024-04-16T14:35:47.736 INFO:tasks.workunit.client.1.smithi115.stdout:4/931: stat d1/d15/d31/dc2/de4 0 2024-04-16T14:35:47.736 INFO:tasks.workunit.client.1.smithi115.stdout:4/932: dread - d1/d15/d17/f117 zero size 2024-04-16T14:35:47.737 INFO:tasks.workunit.client.1.smithi115.stdout:7/798: sync 2024-04-16T14:35:47.738 INFO:tasks.workunit.client.1.smithi115.stdout:8/949: sync 2024-04-16T14:35:47.738 INFO:tasks.workunit.client.1.smithi115.stdout:8/950: chown d0/db/d10/d17/d2c/d52/d74/d73/l124 367760058 1 2024-04-16T14:35:47.740 INFO:tasks.workunit.client.1.smithi115.stdout:8/951: creat d0/db/d10/d17/d2c/d52/d6c/d71/dee/f13c x:0 0 0 2024-04-16T14:35:47.740 INFO:tasks.workunit.client.1.smithi115.stdout:8/952: write d0/db/d10/d17/d2c/d52/d74/d73/f105 [337046,45727] 0 2024-04-16T14:35:47.741 INFO:tasks.workunit.client.1.smithi115.stdout:7/799: fsync d0/d1/f20 0 2024-04-16T14:35:47.741 INFO:tasks.workunit.client.1.smithi115.stdout:7/800: write d0/d2/d3a/d30/d79/dd2/ffb [667524,122544] 0 2024-04-16T14:35:47.742 INFO:tasks.workunit.client.1.smithi115.stdout:3/976: sync 2024-04-16T14:35:47.742 INFO:tasks.workunit.client.1.smithi115.stdout:6/906: sync 2024-04-16T14:35:47.742 INFO:tasks.workunit.client.1.smithi115.stdout:8/953: truncate d0/db/d10/d17/f18 3116608 0 2024-04-16T14:35:47.743 INFO:tasks.workunit.client.0.smithi005.stdout:0/942: dwrite da/df/d1b/d3a/d96/dab/f100 [0,4194304] 0 2024-04-16T14:35:47.743 INFO:tasks.workunit.client.0.smithi005.stdout:0/943: stat da/df/la7 0 2024-04-16T14:35:47.743 INFO:tasks.workunit.client.1.smithi115.stdout:3/977: read - dc/d29/d4d/d56/d126/d4b/d81/f145 zero size 2024-04-16T14:35:47.744 INFO:tasks.workunit.client.1.smithi115.stdout:6/907: mkdir d13/d1d/d49/d128 0 2024-04-16T14:35:47.744 INFO:tasks.workunit.client.1.smithi115.stdout:6/908: fsync d13/d1d/d87/fd9 0 2024-04-16T14:35:47.747 INFO:tasks.workunit.client.1.smithi115.stdout:5/906: getdents dc/d15/de6 0 2024-04-16T14:35:47.748 INFO:tasks.workunit.client.1.smithi115.stdout:8/954: rename d0/db/d10/d17/d22/deb/d7c to d0/de5/d132/d13d 0 2024-04-16T14:35:47.748 INFO:tasks.workunit.client.1.smithi115.stdout:8/955: chown d0/db/d134/fff 1777 1 2024-04-16T14:35:47.750 INFO:tasks.workunit.client.1.smithi115.stdout:3/978: chown dc/f27 1349884 1 2024-04-16T14:35:47.751 INFO:tasks.workunit.client.1.smithi115.stdout:8/956: creat d0/db/dbb/f13e x:0 0 0 2024-04-16T14:35:47.751 INFO:tasks.workunit.client.1.smithi115.stdout:8/957: chown d0/db/d10/d17/d2c/d52/d6c/db8/d6b 14184402 1 2024-04-16T14:35:47.752 INFO:tasks.workunit.client.1.smithi115.stdout:8/958: rmdir d0/db/dbb/dcd 39 2024-04-16T14:35:47.752 INFO:tasks.workunit.client.1.smithi115.stdout:7/801: mkdir d0/d2/d3a/d30/d6b/d10e 0 2024-04-16T14:35:47.752 INFO:tasks.workunit.client.1.smithi115.stdout:7/802: chown d0/d2/d3a/d30/d79/d95/d10c/dbc/dd1/d103 354459 1 2024-04-16T14:35:47.753 INFO:tasks.workunit.client.1.smithi115.stdout:7/803: write d0/d24/da3/ded/d104/f106 [327422,113619] 0 2024-04-16T14:35:47.755 INFO:tasks.workunit.client.1.smithi115.stdout:8/959: rename d0/de5/d132/d13d/dc0/lf6 to d0/l13f 0 2024-04-16T14:35:47.756 INFO:tasks.workunit.client.1.smithi115.stdout:8/960: creat d0/dc8/f140 x:0 0 0 2024-04-16T14:35:47.756 INFO:tasks.workunit.client.1.smithi115.stdout:5/907: write dc/d15/d35/d69/dad/fe0 [3846425,11078] 0 2024-04-16T14:35:47.756 INFO:tasks.workunit.client.1.smithi115.stdout:8/961: getdents d0/db/d134/da2 0 2024-04-16T14:35:47.757 INFO:tasks.workunit.client.0.smithi005.stdout:9/926: dwrite d3/d77/fe5 [0,4194304] 0 2024-04-16T14:35:47.758 INFO:tasks.workunit.client.1.smithi115.stdout:7/804: dread d0/d2/d3a/d30/d79/dd2/fd7 [0,4194304] 0 2024-04-16T14:35:47.758 INFO:tasks.workunit.client.1.smithi115.stdout:5/908: rmdir dc/d15/de6 39 2024-04-16T14:35:47.760 INFO:tasks.workunit.client.0.smithi005.stdout:8/986: write d5/d55/d5a/fd5 [2894825,7729] 0 2024-04-16T14:35:47.760 INFO:tasks.workunit.client.0.smithi005.stdout:8/987: write d5/d55/d5a/d135/d7f/d8d/dd1/f10e [648212,96617] 0 2024-04-16T14:35:47.761 INFO:tasks.workunit.client.1.smithi115.stdout:5/909: mkdir dc/d8e/d10f 0 2024-04-16T14:35:47.761 INFO:tasks.workunit.client.0.smithi005.stdout:9/927: dread d3/d49/d4b/d5c/fb8 [0,4194304] 0 2024-04-16T14:35:47.762 INFO:tasks.workunit.client.0.smithi005.stdout:8/988: symlink d5/l155 0 2024-04-16T14:35:47.762 INFO:tasks.workunit.client.0.smithi005.stdout:8/989: creat d5/d11/f156 x:0 0 0 2024-04-16T14:35:47.762 INFO:tasks.workunit.client.0.smithi005.stdout:8/990: truncate d5/d55/d5a/d135/dba/dcd/fd8 4776800 0 2024-04-16T14:35:47.762 INFO:tasks.workunit.client.1.smithi115.stdout:5/910: creat dc/d3d/d109/da3/f110 x:0 0 0 2024-04-16T14:35:47.762 INFO:tasks.workunit.client.1.smithi115.stdout:5/911: write dc/f21 [1507660,88070] 0 2024-04-16T14:35:47.763 INFO:tasks.workunit.client.1.smithi115.stdout:7/805: rename d0/d2/d3a/d30/d79/dd2/d9c to d0/d24/da3/d102/d10f 0 2024-04-16T14:35:47.763 INFO:tasks.workunit.client.0.smithi005.stdout:9/928: unlink d3/d12/d16/cc4 0 2024-04-16T14:35:47.763 INFO:tasks.workunit.client.1.smithi115.stdout:5/912: creat dc/d15/d35/d71/f111 x:0 0 0 2024-04-16T14:35:47.764 INFO:tasks.workunit.client.1.smithi115.stdout:7/806: rename d0/d2/d3a/d30/d6b/c8f to d0/d24/d40/df4/c110 0 2024-04-16T14:35:47.765 INFO:tasks.workunit.client.0.smithi005.stdout:9/929: symlink d3/d12/d16/d46/d47/l110 0 2024-04-16T14:35:47.765 INFO:tasks.workunit.client.0.smithi005.stdout:9/930: write d3/d49/d4b/d5c/d65/ff7 [137434,78788] 0 2024-04-16T14:35:47.765 INFO:tasks.workunit.client.0.smithi005.stdout:9/931: stat d3/d12/d16/d46/d47/d60/de9/dd6 0 2024-04-16T14:35:47.765 INFO:tasks.workunit.client.0.smithi005.stdout:9/932: creat d3/d12/d16/d46/d47/d60/f111 x:0 0 0 2024-04-16T14:35:47.766 INFO:tasks.workunit.client.1.smithi115.stdout:7/807: mkdir d0/d24/d111 0 2024-04-16T14:35:47.766 INFO:tasks.workunit.client.1.smithi115.stdout:7/808: write d0/d2/d3a/d30/d79/dd2/fa1 [424588,52367] 0 2024-04-16T14:35:47.767 INFO:tasks.workunit.client.0.smithi005.stdout:9/933: rename d3/d49/d4b/la5 to d3/d12/d16/l112 0 2024-04-16T14:35:47.767 INFO:tasks.workunit.client.1.smithi115.stdout:0/769: dwrite d6/d10/d12/d31/d35/d9b/fab [0,4194304] 0 2024-04-16T14:35:47.767 INFO:tasks.workunit.client.1.smithi115.stdout:4/933: dwrite d1/d15/d31/d42/d8b/f9b [0,4194304] 0 2024-04-16T14:35:47.767 INFO:tasks.workunit.client.0.smithi005.stdout:0/944: dwrite da/df/d26/d8e/f10c [0,4194304] 0 2024-04-16T14:35:47.768 INFO:tasks.workunit.client.1.smithi115.stdout:5/913: mknod dc/d3d/c112 0 2024-04-16T14:35:47.768 INFO:tasks.workunit.client.0.smithi005.stdout:9/934: symlink d3/d12/d16/d46/d47/db1/l113 0 2024-04-16T14:35:47.768 INFO:tasks.workunit.client.0.smithi005.stdout:9/935: write d3/d12/d16/fc7 [1631270,125655] 0 2024-04-16T14:35:47.769 INFO:tasks.workunit.client.1.smithi115.stdout:7/809: mknod d0/d24/da3/db1/d3f/c112 0 2024-04-16T14:35:47.771 INFO:tasks.workunit.client.0.smithi005.stdout:0/945: rmdir da/df/d26/d134 39 2024-04-16T14:35:47.772 INFO:tasks.workunit.client.0.smithi005.stdout:0/946: fdatasync da/df/d1b/d71/f127 0 2024-04-16T14:35:47.772 INFO:tasks.workunit.client.0.smithi005.stdout:9/936: truncate d3/d12/d16/d46/f9b 2517683 0 2024-04-16T14:35:47.775 INFO:tasks.workunit.client.0.smithi005.stdout:0/947: unlink da/df/d26/da9/d108/de7/faf 0 2024-04-16T14:35:47.775 INFO:tasks.workunit.client.0.smithi005.stdout:0/948: fsync da/df/f21 0 2024-04-16T14:35:47.777 INFO:tasks.workunit.client.0.smithi005.stdout:9/937: rename d3/d12/d16/d46/d47/d60/ca8 to d3/d12/d16/c114 0 2024-04-16T14:35:47.778 INFO:tasks.workunit.client.1.smithi115.stdout:4/934: truncate d1/d2/f8 6276194 0 2024-04-16T14:35:47.778 INFO:tasks.workunit.client.0.smithi005.stdout:0/949: mkdir da/df/d26/da9/d108/de7/d142 0 2024-04-16T14:35:47.779 INFO:tasks.workunit.client.1.smithi115.stdout:8/962: getdents d0/db/dbb 0 2024-04-16T14:35:47.779 INFO:tasks.workunit.client.1.smithi115.stdout:8/963: dread - d0/db/d10/d17/d22/deb/fba zero size 2024-04-16T14:35:47.780 INFO:tasks.workunit.client.1.smithi115.stdout:0/770: dread d6/f41 [0,4194304] 0 2024-04-16T14:35:47.781 INFO:tasks.workunit.client.0.smithi005.stdout:9/938: creat d3/d49/d4b/d55/f115 x:0 0 0 2024-04-16T14:35:47.781 INFO:tasks.workunit.client.1.smithi115.stdout:5/914: write dc/d15/d35/f48 [1270417,109876] 0 2024-04-16T14:35:47.783 INFO:tasks.workunit.client.0.smithi005.stdout:0/950: mknod da/df/d26/d39/d55/ddc/d105/c143 0 2024-04-16T14:35:47.783 INFO:tasks.workunit.client.1.smithi115.stdout:0/771: mknod d6/d10/d12/d1f/d36/d4b/dff/c10e 0 2024-04-16T14:35:47.783 INFO:tasks.workunit.client.1.smithi115.stdout:0/772: chown d6/d10/d12/d1f/f89 16 1 2024-04-16T14:35:47.784 INFO:tasks.workunit.client.1.smithi115.stdout:0/773: write d6/d10/d71/db7/f10d [1032931,68566] 0 2024-04-16T14:35:47.785 INFO:tasks.workunit.client.1.smithi115.stdout:8/964: symlink d0/db/d10/d17/d2c/d52/d6c/db8/d7d/de2/d111/l141 0 2024-04-16T14:35:47.785 INFO:tasks.workunit.client.1.smithi115.stdout:0/774: mknod d6/d1b/c10f 0 2024-04-16T14:35:47.786 INFO:tasks.workunit.client.1.smithi115.stdout:8/965: symlink d0/db/dbb/l142 0 2024-04-16T14:35:47.788 INFO:tasks.workunit.client.1.smithi115.stdout:0/775: dread d6/d10/f63 [0,4194304] 0 2024-04-16T14:35:47.789 INFO:tasks.workunit.client.0.smithi005.stdout:8/991: write d5/d11/f5f [3876914,73273] 0 2024-04-16T14:35:47.790 INFO:tasks.workunit.client.0.smithi005.stdout:0/951: dread da/df/d26/da9/d108/d75/d81/fb7 [0,4194304] 0 2024-04-16T14:35:47.790 INFO:tasks.workunit.client.0.smithi005.stdout:0/952: chown da/df/d26/c101 13422032 1 2024-04-16T14:35:47.790 INFO:tasks.workunit.client.0.smithi005.stdout:0/953: truncate da/df/d26/d39/d55/fe9 901375 0 2024-04-16T14:35:47.791 INFO:tasks.workunit.client.1.smithi115.stdout:4/935: dread d1/d15/d17/d9e/ddf/ff5 [0,4194304] 0 2024-04-16T14:35:47.794 INFO:tasks.workunit.client.0.smithi005.stdout:9/939: dread d3/d12/f6c [0,4194304] 0 2024-04-16T14:35:47.797 INFO:tasks.workunit.client.0.smithi005.stdout:8/992: read d5/d40/d8e/fce [3363735,77451] 0 2024-04-16T14:35:47.798 INFO:tasks.workunit.client.0.smithi005.stdout:8/993: getdents d5/d7b/da8/da5/def/d71 0 2024-04-16T14:35:47.798 INFO:tasks.workunit.client.0.smithi005.stdout:8/994: readlink d5/d55/d5a/d135/d7f/d8d/dd1/l136 0 2024-04-16T14:35:47.799 INFO:tasks.workunit.client.1.smithi115.stdout:8/966: write d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/f86 [573137,79307] 0 2024-04-16T14:35:47.799 INFO:tasks.workunit.client.1.smithi115.stdout:8/967: truncate d0/db/d10/d17/d2c/d52/dcc/fe6 2896644 0 2024-04-16T14:35:47.799 INFO:tasks.workunit.client.0.smithi005.stdout:9/940: dread d3/d12/f6c [0,4194304] 0 2024-04-16T14:35:47.799 INFO:tasks.workunit.client.0.smithi005.stdout:9/941: stat d3/d12/d16/d46/f9b 0 2024-04-16T14:35:47.804 INFO:tasks.workunit.client.1.smithi115.stdout:8/968: rename d0/de5/d132/dde/de9/fea to d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/f143 0 2024-04-16T14:35:47.807 INFO:tasks.workunit.client.1.smithi115.stdout:0/776: write d6/d10/d12/d31/d35/d9b/f77 [3087203,52600] 0 2024-04-16T14:35:47.811 INFO:tasks.workunit.client.1.smithi115.stdout:4/936: dread d1/d15/d31/d42/d46/f8c [0,4194304] 0 2024-04-16T14:35:47.811 INFO:tasks.workunit.client.1.smithi115.stdout:7/810: dwrite d0/d24/da3/db1/d3f/f7b [0,4194304] 0 2024-04-16T14:35:47.814 INFO:tasks.workunit.client.1.smithi115.stdout:7/811: write d0/d2/d3a/d30/d79/dd2/ffb [407555,126113] 0 2024-04-16T14:35:47.815 INFO:tasks.workunit.client.0.smithi005.stdout:8/995: dread d5/d11/f20 [0,4194304] 0 2024-04-16T14:35:47.817 INFO:tasks.workunit.client.0.smithi005.stdout:8/996: mknod d5/d55/d5a/d135/d7f/c157 0 2024-04-16T14:35:47.817 INFO:tasks.workunit.client.0.smithi005.stdout:8/997: dread - d5/d7b/da8/db7/f151 zero size 2024-04-16T14:35:47.819 INFO:tasks.workunit.client.0.smithi005.stdout:8/998: creat d5/d55/d5a/d135/d7f/d8d/dd1/d14f/f158 x:0 0 0 2024-04-16T14:35:47.822 INFO:tasks.workunit.client.0.smithi005.stdout:8/999: creat d5/d40/f159 x:0 0 0 2024-04-16T14:35:47.823 INFO:tasks.workunit.client.1.smithi115.stdout:0/777: dread d6/d10/dae/fc1 [0,4194304] 0 2024-04-16T14:35:47.826 INFO:tasks.workunit.client.1.smithi115.stdout:4/937: dread d1/d15/d31/d42/d8b/dcc/dee/f11b [0,4194304] 0 2024-04-16T14:35:47.826 INFO:tasks.workunit.client.1.smithi115.stdout:4/938: chown d1/d15/d17/fc7 2 1 2024-04-16T14:35:47.828 INFO:tasks.workunit.client.1.smithi115.stdout:4/939: symlink d1/d15/d31/d42/da4/l126 0 2024-04-16T14:35:47.828 INFO:tasks.workunit.client.1.smithi115.stdout:4/940: creat d1/d15/d24/dc6/f127 x:0 0 0 2024-04-16T14:35:47.841 INFO:tasks.workunit.client.1.smithi115.stdout:4/941: dread d1/d15/d1e/fd1 [0,4194304] 0 2024-04-16T14:35:47.842 INFO:tasks.workunit.client.1.smithi115.stdout:4/942: link d1/d15/d17/l6f d1/d15/d31/d89/l128 0 2024-04-16T14:35:47.848 INFO:tasks.workunit.client.0.smithi005.stdout:9/942: dwrite d3/d12/f3e [4194304,4194304] 0 2024-04-16T14:35:47.850 INFO:tasks.workunit.client.0.smithi005.stdout:9/943: creat d3/d12/d2b/f116 x:0 0 0 2024-04-16T14:35:47.852 INFO:tasks.workunit.client.0.smithi005.stdout:0/954: dwrite da/df/d1b/d3a/d96/f104 [0,4194304] 0 2024-04-16T14:35:47.852 INFO:tasks.workunit.client.0.smithi005.stdout:0/955: chown f0 18757866 1 2024-04-16T14:35:47.852 INFO:tasks.workunit.client.0.smithi005.stdout:0/956: fsync da/df/d26/d134/fc6 0 2024-04-16T14:35:47.853 INFO:tasks.workunit.client.0.smithi005.stdout:9/944: getdents d3/d49/d91 0 2024-04-16T14:35:47.853 INFO:tasks.workunit.client.0.smithi005.stdout:9/945: fsync d3/d12/d16/d46/fa7 0 2024-04-16T14:35:47.855 INFO:tasks.workunit.client.0.smithi005.stdout:9/946: dread d3/d49/d4b/d5c/d65/f79 [0,4194304] 0 2024-04-16T14:35:47.855 INFO:tasks.workunit.client.0.smithi005.stdout:9/947: truncate d3/f10b 110235 0 2024-04-16T14:35:47.856 INFO:tasks.workunit.client.0.smithi005.stdout:0/957: truncate da/df/d26/d134/fef 121802 0 2024-04-16T14:35:47.856 INFO:tasks.workunit.client.1.smithi115.stdout:8/969: dwrite d0/db/d10/d17/d2c/d52/d6c/db8/d6b/ff4 [0,4194304] 0 2024-04-16T14:35:47.857 INFO:tasks.workunit.client.1.smithi115.stdout:8/970: read - d0/db/d10/f13b zero size 2024-04-16T14:35:47.857 INFO:tasks.workunit.client.1.smithi115.stdout:0/778: dwrite d6/d10/d12/f80 [0,4194304] 0 2024-04-16T14:35:47.857 INFO:tasks.workunit.client.1.smithi115.stdout:0/779: read - d6/d30/d4d/df0/d10c/d83/fcc zero size 2024-04-16T14:35:47.857 INFO:tasks.workunit.client.0.smithi005.stdout:9/948: mkdir d3/d12/d16/d117 0 2024-04-16T14:35:47.857 INFO:tasks.workunit.client.1.smithi115.stdout:7/812: dwrite d0/d2/f35 [0,4194304] 0 2024-04-16T14:35:47.858 INFO:tasks.workunit.client.1.smithi115.stdout:4/943: dwrite d1/d15/d24/dc6/fd5 [0,4194304] 0 2024-04-16T14:35:47.858 INFO:tasks.workunit.client.1.smithi115.stdout:4/944: fdatasync d1/d15/d31/dc2/de4/fb8 0 2024-04-16T14:35:47.859 INFO:tasks.workunit.client.1.smithi115.stdout:7/813: symlink d0/d24/da3/ded/d104/l113 0 2024-04-16T14:35:47.859 INFO:tasks.workunit.client.1.smithi115.stdout:8/971: dread d0/db/d10/d17/d2c/d52/d74/d73/f105 [0,4194304] 0 2024-04-16T14:35:47.859 INFO:tasks.workunit.client.1.smithi115.stdout:0/780: dread d6/d10/d12/d1f/d36/d4b/d70/d8a/fb1 [0,4194304] 0 2024-04-16T14:35:47.859 INFO:tasks.workunit.client.1.smithi115.stdout:0/781: write d6/ff [3883660,97072] 0 2024-04-16T14:35:47.860 INFO:tasks.workunit.client.1.smithi115.stdout:0/782: dread - d6/d54/f87 zero size 2024-04-16T14:35:47.861 INFO:tasks.workunit.client.1.smithi115.stdout:0/783: rename d6/d10/d12/d1f/d36/c56 to d6/d1b/c110 0 2024-04-16T14:35:47.863 INFO:tasks.workunit.client.1.smithi115.stdout:8/972: mkdir d0/da5/d144 0 2024-04-16T14:35:47.866 INFO:tasks.workunit.client.1.smithi115.stdout:0/784: mknod d6/d10/d12/d1f/c111 0 2024-04-16T14:35:47.866 INFO:tasks.workunit.client.1.smithi115.stdout:0/785: stat d6/d10/dc8/l103 0 2024-04-16T14:35:47.866 INFO:tasks.workunit.client.1.smithi115.stdout:0/786: write d6/fb [4365878,108848] 0 2024-04-16T14:35:47.866 INFO:tasks.workunit.client.1.smithi115.stdout:0/787: stat d6/d10/d12/d1f/d36/d4b/d6d/fea 0 2024-04-16T14:35:47.868 INFO:tasks.workunit.client.1.smithi115.stdout:7/814: dread d0/d24/da3/db1/d3f/db0/f54 [0,4194304] 0 2024-04-16T14:35:47.869 INFO:tasks.workunit.client.0.smithi005.stdout:9/949: dread d3/d49/d4b/fa4 [0,4194304] 0 2024-04-16T14:35:47.870 INFO:tasks.workunit.client.1.smithi115.stdout:0/788: symlink d6/d30/d4d/df0/d10c/l112 0 2024-04-16T14:35:47.870 INFO:tasks.workunit.client.1.smithi115.stdout:0/789: chown d6/d10/d12/d5f/f8c 561 1 2024-04-16T14:35:47.870 INFO:tasks.workunit.client.1.smithi115.stdout:0/790: stat d6/d30/d8d/laa 0 2024-04-16T14:35:47.874 INFO:tasks.workunit.client.0.smithi005.stdout:9/950: dread d3/d49/d91/fb0 [0,4194304] 0 2024-04-16T14:35:47.875 INFO:tasks.workunit.client.0.smithi005.stdout:9/951: mknod d3/d49/d4b/d5c/d65/d9a/c118 0 2024-04-16T14:35:47.875 INFO:tasks.workunit.client.0.smithi005.stdout:9/952: chown d3/d12/d9d/cbc 5 1 2024-04-16T14:35:47.875 INFO:tasks.workunit.client.0.smithi005.stdout:9/953: dread - d3/d12/d2b/f116 zero size 2024-04-16T14:35:47.881 INFO:tasks.workunit.client.1.smithi115.stdout:0/791: write d6/f41 [3864409,123460] 0 2024-04-16T14:35:47.882 INFO:tasks.workunit.client.1.smithi115.stdout:0/792: mkdir d6/d10/d71/db7/d113 0 2024-04-16T14:35:47.882 INFO:tasks.workunit.client.1.smithi115.stdout:0/793: dread - d6/d30/d4d/df0/d10c/d83/fcc zero size 2024-04-16T14:35:47.883 INFO:tasks.workunit.client.1.smithi115.stdout:7/815: dread d0/d2/d3a/d30/d6b/da2/d81/f92 [0,4194304] 0 2024-04-16T14:35:47.886 INFO:tasks.workunit.client.1.smithi115.stdout:0/794: dread f0 [0,4194304] 0 2024-04-16T14:35:47.886 INFO:tasks.workunit.client.1.smithi115.stdout:0/795: creat d6/d30/d8d/f114 x:0 0 0 2024-04-16T14:35:47.886 INFO:tasks.workunit.client.1.smithi115.stdout:0/796: truncate d6/d30/d4d/df0/d10c/d83/fcc 494438 0 2024-04-16T14:35:47.887 INFO:tasks.workunit.client.1.smithi115.stdout:0/797: write d6/d1b/f7d [495232,28556] 0 2024-04-16T14:35:47.893 INFO:tasks.workunit.client.1.smithi115.stdout:0/798: dread d6/d30/d8d/fc5 [0,4194304] 0 2024-04-16T14:35:47.901 INFO:tasks.workunit.client.0.smithi005.stdout:0/958: dwrite da/df/d26/da9/d108/d75/d81/fec [0,4194304] 0 2024-04-16T14:35:47.901 INFO:tasks.workunit.client.1.smithi115.stdout:4/945: dwrite d1/d15/d17/f92 [4194304,4194304] 0 2024-04-16T14:35:47.902 INFO:tasks.workunit.client.1.smithi115.stdout:4/946: read - d1/d15/d31/d42/d8b/faa zero size 2024-04-16T14:35:47.903 INFO:tasks.workunit.client.1.smithi115.stdout:7/816: dwrite d0/d2/d3a/d30/d79/dd2/fd7 [0,4194304] 0 2024-04-16T14:35:47.904 INFO:tasks.workunit.client.1.smithi115.stdout:8/973: dwrite d0/db/d10/d17/d22/deb/fc9 [4194304,4194304] 0 2024-04-16T14:35:47.904 INFO:tasks.workunit.client.0.smithi005.stdout:0/959: rename da/l10 to da/df/d1b/d3a/d53/dbc/l144 0 2024-04-16T14:35:47.904 INFO:tasks.workunit.client.0.smithi005.stdout:0/960: fsync da/df/d26/da9/d108/d75/d124/f12e 0 2024-04-16T14:35:47.906 INFO:tasks.workunit.client.1.smithi115.stdout:8/974: unlink d0/db/d10/d17/d2c/d52/d6c/db8/d6b/fb0 0 2024-04-16T14:35:47.906 INFO:tasks.workunit.client.1.smithi115.stdout:8/975: write d0/db/f24 [170304,105864] 0 2024-04-16T14:35:47.907 INFO:tasks.workunit.client.1.smithi115.stdout:8/976: write d0/db/d44/f59 [375389,127564] 0 2024-04-16T14:35:47.907 INFO:tasks.workunit.client.0.smithi005.stdout:0/961: mkdir da/df/d26/d39/d55/d145 0 2024-04-16T14:35:47.910 INFO:tasks.workunit.client.0.smithi005.stdout:0/962: symlink da/df/l146 0 2024-04-16T14:35:47.912 INFO:tasks.workunit.client.1.smithi115.stdout:7/817: symlink d0/d24/da3/db1/l114 0 2024-04-16T14:35:47.912 INFO:tasks.workunit.client.1.smithi115.stdout:7/818: fsync d0/fa5 0 2024-04-16T14:35:47.922 INFO:tasks.workunit.client.1.smithi115.stdout:7/819: dread d0/d24/da3/d102/d10f/faa [0,4194304] 0 2024-04-16T14:35:47.924 INFO:tasks.workunit.client.1.smithi115.stdout:7/820: mkdir d0/d24/da3/db1/dd8/d115 0 2024-04-16T14:35:47.924 INFO:tasks.workunit.client.1.smithi115.stdout:7/821: write d0/d24/d40/f44 [3459595,1509] 0 2024-04-16T14:35:47.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:47 smithi115 ceph-mon[37295]: pgmap v28: 65 pgs: 65 active+clean; 3.1 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 310 MiB/s rd, 357 MiB/s wr, 493 op/s 2024-04-16T14:35:47.934 INFO:tasks.workunit.client.1.smithi115.stdout:8/977: dwrite d0/db/d10/d17/f72 [0,4194304] 0 2024-04-16T14:35:47.935 INFO:tasks.workunit.client.1.smithi115.stdout:8/978: truncate d0/db/d10/d17/d2c/d52/d74/d3b/d56/dfc/f100 579232 0 2024-04-16T14:35:47.937 INFO:tasks.workunit.client.1.smithi115.stdout:8/979: symlink d0/db/dbb/dcd/dbd/l145 0 2024-04-16T14:35:47.937 INFO:tasks.workunit.client.1.smithi115.stdout:8/980: chown d0/db/f15 0 1 2024-04-16T14:35:47.947 INFO:tasks.workunit.client.1.smithi115.stdout:4/947: dwrite d1/d15/d31/f3a [0,4194304] 0 2024-04-16T14:35:47.947 INFO:tasks.workunit.client.0.smithi005.stdout:0/963: dwrite da/df/d1b/d3a/d53/dbc/f102 [0,4194304] 0 2024-04-16T14:35:47.947 INFO:tasks.workunit.client.1.smithi115.stdout:7/822: dwrite d0/d2/d3a/d30/f98 [4194304,4194304] 0 2024-04-16T14:35:47.948 INFO:tasks.workunit.client.1.smithi115.stdout:7/823: creat d0/f116 x:0 0 0 2024-04-16T14:35:47.949 INFO:tasks.workunit.client.0.smithi005.stdout:0/964: link da/f93 da/df/d1b/d3a/d53/dbc/f147 0 2024-04-16T14:35:47.950 INFO:tasks.workunit.client.0.smithi005.stdout:0/965: read da/df/d26/d39/d55/fe9 [190685,10675] 0 2024-04-16T14:35:47.950 INFO:tasks.workunit.client.1.smithi115.stdout:4/948: rename d1/d15/d17/fb6 to d1/d15/d31/dc2/de4/de7/dfc/f129 0 2024-04-16T14:35:47.950 INFO:tasks.workunit.client.1.smithi115.stdout:4/949: chown d1/d15/d31/dc2/df1/l123 181744 1 2024-04-16T14:35:47.950 INFO:tasks.workunit.client.1.smithi115.stdout:8/981: dread d0/db/f30 [0,4194304] 0 2024-04-16T14:35:47.951 INFO:tasks.workunit.client.0.smithi005.stdout:0/966: rename da/df/c1c to da/df/d1b/d71/c148 0 2024-04-16T14:35:47.954 INFO:tasks.workunit.client.1.smithi115.stdout:7/824: chown d0/d2/d3a/d30/d6b/da2/d81/dd0/cef 7256 1 2024-04-16T14:35:47.954 INFO:tasks.workunit.client.1.smithi115.stdout:7/825: fdatasync d0/d24/d40/df0/f100 0 2024-04-16T14:35:47.955 INFO:tasks.workunit.client.1.smithi115.stdout:4/950: mkdir d1/d15/d24/dc6/d12a 0 2024-04-16T14:35:47.955 INFO:tasks.workunit.client.1.smithi115.stdout:7/826: getdents d0/d2/d3a/d30/d79/d95/dec 0 2024-04-16T14:35:47.956 INFO:tasks.workunit.client.1.smithi115.stdout:4/951: mkdir d1/d2/d12b 0 2024-04-16T14:35:47.957 INFO:tasks.workunit.client.1.smithi115.stdout:7/827: link d0/d2/d3a/d30/d79/d95/lc8 d0/d2/d3a/dda/l117 0 2024-04-16T14:35:47.957 INFO:tasks.workunit.client.1.smithi115.stdout:7/828: dread - d0/d2/d3a/d30/d6b/ffc zero size 2024-04-16T14:35:47.965 INFO:tasks.workunit.client.0.smithi005.stdout:0/967: write da/df/d1b/d3a/d53/d5a/d67/d79/f84 [3803486,88457] 0 2024-04-16T14:35:47.973 INFO:tasks.workunit.client.1.smithi115.stdout:7/829: dread d0/d24/f4a [4194304,4194304] 0 2024-04-16T14:35:47.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:47 smithi005 ceph-mon[28964]: pgmap v28: 65 pgs: 65 active+clean; 3.1 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 310 MiB/s rd, 357 MiB/s wr, 493 op/s 2024-04-16T14:35:47.974 INFO:tasks.workunit.client.1.smithi115.stdout:7/830: symlink d0/d2/d3a/d73/de6/l118 0 2024-04-16T14:35:47.993 INFO:tasks.workunit.client.1.smithi115.stdout:4/952: dwrite d1/d15/d1e/f43 [0,4194304] 0 2024-04-16T14:35:47.994 INFO:tasks.workunit.client.1.smithi115.stdout:7/831: dwrite d0/d2/d3a/d30/f74 [0,4194304] 0 2024-04-16T14:35:47.994 INFO:tasks.workunit.client.1.smithi115.stdout:7/832: chown d0/d24/da3/db1/d3f/f7b 2845 1 2024-04-16T14:35:47.994 INFO:tasks.workunit.client.1.smithi115.stdout:7/833: chown d0/d2/d3a/dda/l117 229198 1 2024-04-16T14:35:47.994 INFO:tasks.workunit.client.0.smithi005.stdout:0/968: dwrite da/df/d26/d39/f139 [0,4194304] 0 2024-04-16T14:35:47.995 INFO:tasks.workunit.client.0.smithi005.stdout:0/969: creat da/df/d26/d39/d55/df8/d11b/f149 x:0 0 0 2024-04-16T14:35:47.995 INFO:tasks.workunit.client.0.smithi005.stdout:0/970: creat da/df/d26/d39/d55/ddc/d105/f14a x:0 0 0 2024-04-16T14:35:47.996 INFO:tasks.workunit.client.1.smithi115.stdout:7/834: getdents d0/d2/d3a/d30/d79/d95/d10c/dbc/dd1 0 2024-04-16T14:35:47.996 INFO:tasks.workunit.client.1.smithi115.stdout:4/953: getdents d1/d15/d17/d9e/ddf 0 2024-04-16T14:35:47.997 INFO:tasks.workunit.client.1.smithi115.stdout:4/954: write d1/d15/d17/fbb [239671,14220] 0 2024-04-16T14:35:47.997 INFO:tasks.workunit.client.0.smithi005.stdout:0/971: creat da/df/d26/d8e/d141/f14b x:0 0 0 2024-04-16T14:35:47.997 INFO:tasks.workunit.client.0.smithi005.stdout:0/972: write da/df/d26/da9/d108/d75/d81/fd4 [127203,26225] 0 2024-04-16T14:35:47.998 INFO:tasks.workunit.client.1.smithi115.stdout:7/835: creat d0/d2/d3a/d30/d6b/f119 x:0 0 0 2024-04-16T14:35:47.999 INFO:tasks.workunit.client.0.smithi005.stdout:0/973: rename da/df/d1b/d3a/d53/dbc/f147 to da/df/d26/da9/d108/d75/f14c 0 2024-04-16T14:35:48.000 INFO:tasks.workunit.client.1.smithi115.stdout:4/955: mknod d1/d15/d31/d89/c12c 0 2024-04-16T14:35:48.002 INFO:tasks.workunit.client.1.smithi115.stdout:7/836: link d0/d24/da3/db1/d3f/c62 d0/d24/da3/db1/dd8/d115/c11a 0 2024-04-16T14:35:48.002 INFO:tasks.workunit.client.1.smithi115.stdout:7/837: chown d0/d2/d3a/dac/lb2 57689979 1 2024-04-16T14:35:48.002 INFO:tasks.workunit.client.1.smithi115.stdout:7/838: truncate d0/d24/da3/ded/d104/f106 449874 0 2024-04-16T14:35:48.003 INFO:tasks.workunit.client.1.smithi115.stdout:4/956: getdents d1/d15/d31/dc2/de4/de7 0 2024-04-16T14:35:48.003 INFO:tasks.workunit.client.1.smithi115.stdout:4/957: getdents d1/d15/d31/dc2/de4/de7 0 2024-04-16T14:35:48.004 INFO:tasks.workunit.client.0.smithi005.stdout:9/954: sync 2024-04-16T14:35:48.004 INFO:tasks.workunit.client.0.smithi005.stdout:2/870: sync 2024-04-16T14:35:48.004 INFO:tasks.workunit.client.0.smithi005.stdout:2/871: read - d0/d1c/f9e zero size 2024-04-16T14:35:48.004 INFO:tasks.workunit.client.0.smithi005.stdout:9/955: creat d3/dd5/f119 x:0 0 0 2024-04-16T14:35:48.004 INFO:tasks.workunit.client.0.smithi005.stdout:2/872: creat d0/d29/d3e/dd2/f127 x:0 0 0 2024-04-16T14:35:48.004 INFO:tasks.workunit.client.0.smithi005.stdout:2/873: dread - d0/d29/d3e/fe6 zero size 2024-04-16T14:35:48.006 INFO:tasks.workunit.client.0.smithi005.stdout:2/874: mknod d0/d29/d89/d99/c128 0 2024-04-16T14:35:48.006 INFO:tasks.workunit.client.0.smithi005.stdout:2/875: chown d0/d29/d3e/fef 1763 1 2024-04-16T14:35:48.006 INFO:tasks.workunit.client.0.smithi005.stdout:2/876: chown d0/d1c/f9e 154533 1 2024-04-16T14:35:48.007 INFO:tasks.workunit.client.1.smithi115.stdout:7/839: creat d0/d24/da3/f11b x:0 0 0 2024-04-16T14:35:48.008 INFO:tasks.workunit.client.1.smithi115.stdout:7/840: mkdir d0/d2/d3a/dac/d11c 0 2024-04-16T14:35:48.010 INFO:tasks.workunit.client.1.smithi115.stdout:7/841: truncate d0/d2/d3a/d30/d6b/da2/feb 2772427 0 2024-04-16T14:35:48.010 INFO:tasks.workunit.client.0.smithi005.stdout:9/956: write d3/d12/d16/fc7 [1259082,89350] 0 2024-04-16T14:35:48.013 INFO:tasks.workunit.client.0.smithi005.stdout:2/877: write d0/d2a/d3a/d46/dd8/f123 [1696802,99785] 0 2024-04-16T14:35:48.015 INFO:tasks.workunit.client.0.smithi005.stdout:2/878: mknod d0/d29/d89/d99/c129 0 2024-04-16T14:35:48.035 INFO:tasks.workunit.client.0.smithi005.stdout:0/974: dwrite da/df/d1b/d3a/d53/fcc [0,4194304] 0 2024-04-16T14:35:48.037 INFO:tasks.workunit.client.0.smithi005.stdout:0/975: mkdir da/df/d1b/d3a/d96/dab/d14d 0 2024-04-16T14:35:48.037 INFO:tasks.workunit.client.0.smithi005.stdout:0/976: chown da/df/d26/d8e/f138 764474 1 2024-04-16T14:35:48.037 INFO:tasks.workunit.client.0.smithi005.stdout:0/977: creat da/df/d1b/d71/ddf/f14e x:0 0 0 2024-04-16T14:35:48.041 INFO:tasks.workunit.client.1.smithi115.stdout:4/958: dwrite d1/d15/d24/dc6/fe8 [0,4194304] 0 2024-04-16T14:35:48.041 INFO:tasks.workunit.client.1.smithi115.stdout:7/842: dwrite d0/d2/d3a/ff5 [0,4194304] 0 2024-04-16T14:35:48.042 INFO:tasks.workunit.client.0.smithi005.stdout:2/879: dwrite d0/d1c/fde [0,4194304] 0 2024-04-16T14:35:48.043 INFO:tasks.workunit.client.0.smithi005.stdout:2/880: dread d0/d4/d2b/f17 [0,4194304] 0 2024-04-16T14:35:48.048 INFO:tasks.workunit.client.1.smithi115.stdout:7/843: rename d0/d2/d3a/d73 to d0/d24/d40/df0/d11d 0 2024-04-16T14:35:48.050 INFO:tasks.workunit.client.1.smithi115.stdout:7/844: creat d0/d24/da3/db1/d5a/f11e x:0 0 0 2024-04-16T14:35:48.053 INFO:tasks.workunit.client.1.smithi115.stdout:7/845: rmdir d0/d24/da3/ded/d104 39 2024-04-16T14:35:48.053 INFO:tasks.workunit.client.1.smithi115.stdout:7/846: creat d0/d24/da3/f11f x:0 0 0 2024-04-16T14:35:48.053 INFO:tasks.workunit.client.1.smithi115.stdout:7/847: chown d0/ffa 79014 1 2024-04-16T14:35:48.056 INFO:tasks.workunit.client.1.smithi115.stdout:7/848: truncate d0/d24/da3/db1/d3f/db0/f56 8125320 0 2024-04-16T14:35:48.057 INFO:tasks.workunit.client.1.smithi115.stdout:7/849: write d0/d24/da3/db1/d3f/f8d [549744,59070] 0 2024-04-16T14:35:48.063 INFO:tasks.workunit.client.0.smithi005.stdout:0/978: dwrite da/df/d26/da9/d108/f90 [0,4194304] 0 2024-04-16T14:35:48.063 INFO:tasks.workunit.client.0.smithi005.stdout:0/979: chown da/df/d1b/d3a/d53/d5a/cbb 3791 1 2024-04-16T14:35:48.069 INFO:tasks.workunit.client.1.smithi115.stdout:6/909: sync 2024-04-16T14:35:48.072 INFO:tasks.workunit.client.1.smithi115.stdout:6/910: rename d13/d1d/d52/lbb to d13/d1d/d2b/d5f/l129 0 2024-04-16T14:35:48.072 INFO:tasks.workunit.client.1.smithi115.stdout:6/911: readlink d13/l14 0 2024-04-16T14:35:48.072 INFO:tasks.workunit.client.1.smithi115.stdout:6/912: creat d13/d1d/d52/d8c/f12a x:0 0 0 2024-04-16T14:35:48.076 INFO:tasks.workunit.client.1.smithi115.stdout:7/850: dwrite d0/d24/f4a [4194304,4194304] 0 2024-04-16T14:35:48.077 INFO:tasks.workunit.client.1.smithi115.stdout:7/851: read - d0/d24/da3/db1/d3f/db0/ff6 zero size 2024-04-16T14:35:48.077 INFO:tasks.workunit.client.1.smithi115.stdout:7/852: creat d0/d2/d3a/d30/d79/d95/d10c/dbc/f120 x:0 0 0 2024-04-16T14:35:48.079 INFO:tasks.workunit.client.1.smithi115.stdout:7/853: rmdir d0/d2/d3a/d30/d79/dd2 39 2024-04-16T14:35:48.079 INFO:tasks.workunit.client.1.smithi115.stdout:7/854: dread - d0/d24/d40/df0/f100 zero size 2024-04-16T14:35:48.080 INFO:tasks.workunit.client.0.smithi005.stdout:0/980: dwrite da/df/d1b/d3a/d53/fad [0,4194304] 0 2024-04-16T14:35:48.089 INFO:tasks.workunit.client.1.smithi115.stdout:7/855: truncate d0/fa5 4140590 0 2024-04-16T14:35:48.089 INFO:tasks.workunit.client.1.smithi115.stdout:7/856: write d0/d24/da3/f11f [665481,74060] 0 2024-04-16T14:35:48.090 INFO:tasks.workunit.client.1.smithi115.stdout:6/913: dwrite d13/d1d/d52/d8c/f12a [0,4194304] 0 2024-04-16T14:35:48.091 INFO:tasks.workunit.client.1.smithi115.stdout:7/857: rename d0/d2/d3a/d30/f74 to d0/d2/d3a/d30/d79/d95/dec/d107/f121 0 2024-04-16T14:35:48.091 INFO:tasks.workunit.client.1.smithi115.stdout:7/858: creat d0/d24/da3/db1/d5a/f122 x:0 0 0 2024-04-16T14:35:48.091 INFO:tasks.workunit.client.1.smithi115.stdout:7/859: write d0/d24/da3/db1/d3f/db0/f54 [1181180,107360] 0 2024-04-16T14:35:48.094 INFO:tasks.workunit.client.1.smithi115.stdout:6/914: mknod d13/d1d/d2b/d5f/d30/c12b 0 2024-04-16T14:35:48.098 INFO:tasks.workunit.client.1.smithi115.stdout:6/915: creat d13/d1d/d52/f12c x:0 0 0 2024-04-16T14:35:48.098 INFO:tasks.workunit.client.1.smithi115.stdout:6/916: fsync d13/d1d/d2b/df4/f10c 0 2024-04-16T14:35:48.102 INFO:tasks.workunit.client.1.smithi115.stdout:6/917: dread d13/d1d/d2b/d5f/d30/d43/d2c/fca [0,4194304] 0 2024-04-16T14:35:48.103 INFO:tasks.workunit.client.1.smithi115.stdout:6/918: unlink d13/d1d/d52/fdb 0 2024-04-16T14:35:48.103 INFO:tasks.workunit.client.1.smithi115.stdout:6/919: fdatasync d13/d1d/d47/f104 0 2024-04-16T14:35:48.104 INFO:tasks.workunit.client.0.smithi005.stdout:0/981: dwrite da/df/d26/da9/d108/f7e [0,4194304] 0 2024-04-16T14:35:48.106 INFO:tasks.workunit.client.0.smithi005.stdout:0/982: mkdir da/df/d1b/d3a/d14f 0 2024-04-16T14:35:48.107 INFO:tasks.workunit.client.0.smithi005.stdout:0/983: rename da/df/d26/d39/f139 to da/df/d26/d39/d55/d5c/da8/f150 0 2024-04-16T14:35:48.108 INFO:tasks.workunit.client.1.smithi115.stdout:7/860: dwrite d0/fa5 [0,4194304] 0 2024-04-16T14:35:48.108 INFO:tasks.workunit.client.1.smithi115.stdout:7/861: creat d0/d2/d3a/d30/f123 x:0 0 0 2024-04-16T14:35:48.108 INFO:tasks.workunit.client.0.smithi005.stdout:0/984: symlink da/df/d26/d112/l151 0 2024-04-16T14:35:48.109 INFO:tasks.workunit.client.1.smithi115.stdout:7/862: mkdir d0/d24/d40/df0/d11d/de6/d124 0 2024-04-16T14:35:48.109 INFO:tasks.workunit.client.1.smithi115.stdout:7/863: chown d0/d24/d40/df0/d11d 55319691 1 2024-04-16T14:35:48.110 INFO:tasks.workunit.client.0.smithi005.stdout:0/985: truncate da/df/d26/da9/d108/d75/f14c 1590707 0 2024-04-16T14:35:48.110 INFO:tasks.workunit.client.0.smithi005.stdout:0/986: fdatasync da/df/d26/d39/d55/ddc/d105/f140 0 2024-04-16T14:35:48.111 INFO:tasks.workunit.client.1.smithi115.stdout:7/864: link d0/ffa d0/d2/d3a/d30/d6b/f125 0 2024-04-16T14:35:48.111 INFO:tasks.workunit.client.1.smithi115.stdout:7/865: fdatasync d0/d2/d3a/d30/f98 0 2024-04-16T14:35:48.112 INFO:tasks.workunit.client.0.smithi005.stdout:0/987: mkdir da/df/d50/d152 0 2024-04-16T14:35:48.112 INFO:tasks.workunit.client.1.smithi115.stdout:7/866: symlink d0/d24/d40/df0/l126 0 2024-04-16T14:35:48.113 INFO:tasks.workunit.client.1.smithi115.stdout:7/867: creat d0/d24/da3/d102/d10f/f127 x:0 0 0 2024-04-16T14:35:48.114 INFO:tasks.workunit.client.1.smithi115.stdout:7/868: getdents d0/d2/d3a 0 2024-04-16T14:35:48.114 INFO:tasks.workunit.client.1.smithi115.stdout:7/869: readlink d0/d2/d3a/d30/d6b/da2/la9 0 2024-04-16T14:35:48.116 INFO:tasks.workunit.client.1.smithi115.stdout:7/870: dread d0/d2/d3a/d30/d79/dd2/fa1 [0,4194304] 0 2024-04-16T14:35:48.116 INFO:tasks.workunit.client.1.smithi115.stdout:7/871: read - d0/ffa zero size 2024-04-16T14:35:48.117 INFO:tasks.workunit.client.1.smithi115.stdout:7/872: readlink d0/d2/d3a/d30/l55 0 2024-04-16T14:35:48.117 INFO:tasks.workunit.client.1.smithi115.stdout:7/873: fsync d0/d24/da3/db1/f60 0 2024-04-16T14:35:48.118 INFO:tasks.workunit.client.1.smithi115.stdout:6/920: dwrite d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/d63/fb9 [0,4194304] 0 2024-04-16T14:35:48.119 INFO:tasks.workunit.client.1.smithi115.stdout:7/874: write d0/d24/fb3 [2281334,24507] 0 2024-04-16T14:35:48.120 INFO:tasks.workunit.client.1.smithi115.stdout:7/875: getdents d0/d2/d3a/dac/d11c 0 2024-04-16T14:35:48.120 INFO:tasks.workunit.client.1.smithi115.stdout:7/876: truncate d0/d24/da3/ded/d104/f106 1453796 0 2024-04-16T14:35:48.120 INFO:tasks.workunit.client.0.smithi005.stdout:0/988: dread da/df/d1b/f7a [0,4194304] 0 2024-04-16T14:35:48.121 INFO:tasks.workunit.client.1.smithi115.stdout:7/877: dread d0/d24/da3/db1/d3f/db0/fcd [0,4194304] 0 2024-04-16T14:35:48.122 INFO:tasks.workunit.client.1.smithi115.stdout:7/878: dread - d0/d2/d3a/dda/fff zero size 2024-04-16T14:35:48.122 INFO:tasks.workunit.client.1.smithi115.stdout:7/879: dread - d0/d24/da3/ffe zero size 2024-04-16T14:35:48.122 INFO:tasks.workunit.client.1.smithi115.stdout:6/921: mknod d13/d1d/d2b/d5f/c12d 0 2024-04-16T14:35:48.122 INFO:tasks.workunit.client.1.smithi115.stdout:7/880: mknod d0/d24/d111/c128 0 2024-04-16T14:35:48.124 INFO:tasks.workunit.client.1.smithi115.stdout:6/922: rename d13/d1d/d2b/d5f/d30/d43/cd3 to d13/d1d/d87/c12e 0 2024-04-16T14:35:48.127 INFO:tasks.workunit.client.0.smithi005.stdout:0/989: write da/df/f65 [1322527,44647] 0 2024-04-16T14:35:48.128 INFO:tasks.workunit.client.1.smithi115.stdout:7/881: rename d0/d2/d3a/d30/d79/d95/d10c/dbc/dd1/ld5 to d0/d24/d40/df4/l129 0 2024-04-16T14:35:48.129 INFO:tasks.workunit.client.0.smithi005.stdout:0/990: rename da/df/d1b/d3a/d53/l118 to da/df/d26/d39/d55/d5c/da8/l153 0 2024-04-16T14:35:48.130 INFO:tasks.workunit.client.0.smithi005.stdout:0/991: link da/df/d1b/d3a/d96/cdd da/df/d1b/d3a/d14f/c154 0 2024-04-16T14:35:48.131 INFO:tasks.workunit.client.0.smithi005.stdout:0/992: mkdir da/df/d1b/d3a/d53/d155 0 2024-04-16T14:35:48.132 INFO:tasks.workunit.client.0.smithi005.stdout:0/993: mkdir da/df/d1b/db6/d156 0 2024-04-16T14:35:48.132 INFO:tasks.workunit.client.0.smithi005.stdout:0/994: readlink da/df/d26/d39/l5f 0 2024-04-16T14:35:48.137 INFO:tasks.workunit.client.1.smithi115.stdout:6/923: dwrite d13/d1d/d2b/d5f/fa8 [0,4194304] 0 2024-04-16T14:35:48.142 INFO:tasks.workunit.client.1.smithi115.stdout:7/882: write d0/d1/fc9 [6369020,75827] 0 2024-04-16T14:35:48.148 INFO:tasks.workunit.client.1.smithi115.stdout:7/883: dread d0/d2/d3a/d30/d6b/da2/feb [0,4194304] 0 2024-04-16T14:35:48.148 INFO:tasks.workunit.client.1.smithi115.stdout:7/884: creat d0/d2/d3a/dac/da7/f12a x:0 0 0 2024-04-16T14:35:48.149 INFO:tasks.workunit.client.1.smithi115.stdout:6/924: truncate d13/d1d/d52/d8c/f12a 1113677 0 2024-04-16T14:35:48.150 INFO:tasks.workunit.client.1.smithi115.stdout:3/979: sync 2024-04-16T14:35:48.150 INFO:tasks.workunit.client.1.smithi115.stdout:5/915: sync 2024-04-16T14:35:48.151 INFO:tasks.workunit.client.1.smithi115.stdout:3/980: creat dc/d29/d39/d86/dd0/dee/d137/de1/d133/f147 x:0 0 0 2024-04-16T14:35:48.151 INFO:tasks.workunit.client.1.smithi115.stdout:3/981: chown dc/d29/d77/ffa 45091133 1 2024-04-16T14:35:48.152 INFO:tasks.workunit.client.0.smithi005.stdout:0/995: dwrite da/df/d26/d8e/f10c [0,4194304] 0 2024-04-16T14:35:48.152 INFO:tasks.workunit.client.1.smithi115.stdout:3/982: fsync dc/fdb 0 2024-04-16T14:35:48.152 INFO:tasks.workunit.client.1.smithi115.stdout:6/925: mknod d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/c12f 0 2024-04-16T14:35:48.153 INFO:tasks.workunit.client.1.smithi115.stdout:6/926: readlink d13/d1d/lfc 0 2024-04-16T14:35:48.153 INFO:tasks.workunit.client.0.smithi005.stdout:0/996: symlink da/df/d26/da9/d108/de7/l157 0 2024-04-16T14:35:48.153 INFO:tasks.workunit.client.1.smithi115.stdout:6/927: creat d13/d1d/d2b/f130 x:0 0 0 2024-04-16T14:35:48.155 INFO:tasks.workunit.client.1.smithi115.stdout:6/928: symlink d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96/de4/l131 0 2024-04-16T14:35:48.155 INFO:tasks.workunit.client.1.smithi115.stdout:6/929: fsync d13/d1d/d2b/d5f/d30/d43/fb3 0 2024-04-16T14:35:48.155 INFO:tasks.workunit.client.0.smithi005.stdout:0/997: mknod da/df/d26/da9/dcb/dd7/c158 0 2024-04-16T14:35:48.155 INFO:tasks.workunit.client.1.smithi115.stdout:0/799: sync 2024-04-16T14:35:48.156 INFO:tasks.workunit.client.1.smithi115.stdout:4/959: sync 2024-04-16T14:35:48.156 INFO:tasks.workunit.client.1.smithi115.stdout:8/982: sync 2024-04-16T14:35:48.157 INFO:tasks.workunit.client.1.smithi115.stdout:3/983: truncate dc/f64 376298 0 2024-04-16T14:35:48.157 INFO:tasks.workunit.client.1.smithi115.stdout:3/984: creat dc/d29/d4d/d56/d126/d4b/d81/f148 x:0 0 0 2024-04-16T14:35:48.157 INFO:tasks.workunit.client.1.smithi115.stdout:7/885: read d0/d2/d3a/d30/d6b/da2/fa8 [2745102,78223] 0 2024-04-16T14:35:48.158 INFO:tasks.workunit.client.1.smithi115.stdout:8/983: unlink d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/da4/ld8 0 2024-04-16T14:35:48.159 INFO:tasks.workunit.client.1.smithi115.stdout:7/886: creat d0/d2/d3a/d30/d79/d95/d10c/dbc/dd1/d103/f12b x:0 0 0 2024-04-16T14:35:48.162 INFO:tasks.workunit.client.1.smithi115.stdout:5/916: dread dc/d3d/f6a [0,4194304] 0 2024-04-16T14:35:48.162 INFO:tasks.workunit.client.1.smithi115.stdout:5/917: stat dc/f1f 0 2024-04-16T14:35:48.163 INFO:tasks.workunit.client.1.smithi115.stdout:0/800: dread d6/d10/d12/d1f/d36/d4b/d6d/f3d [0,4194304] 0 2024-04-16T14:35:48.164 INFO:tasks.workunit.client.0.smithi005.stdout:0/998: read f0 [2986886,10235] 0 2024-04-16T14:35:48.164 INFO:tasks.workunit.client.1.smithi115.stdout:5/918: getdents dc/d8e 0 2024-04-16T14:35:48.166 INFO:tasks.workunit.client.1.smithi115.stdout:5/919: creat dc/d5d/f113 x:0 0 0 2024-04-16T14:35:48.167 INFO:tasks.workunit.client.0.smithi005.stdout:0/999: unlink da/df/f65 0 2024-04-16T14:35:48.167 INFO:tasks.workunit.client.1.smithi115.stdout:5/920: mknod dc/d15/d4d/dde/df1/c114 0 2024-04-16T14:35:48.168 INFO:tasks.workunit.client.1.smithi115.stdout:5/921: read - dc/d15/de6/fff zero size 2024-04-16T14:35:48.174 INFO:tasks.workunit.client.1.smithi115.stdout:3/985: write dc/f15 [403505,3097] 0 2024-04-16T14:35:48.182 INFO:tasks.workunit.client.1.smithi115.stdout:5/922: read dc/d15/d4d/f76 [2399901,7696] 0 2024-04-16T14:35:48.182 INFO:tasks.workunit.client.1.smithi115.stdout:5/923: write dc/d15/d4d/dde/f105 [367390,54577] 0 2024-04-16T14:35:48.182 INFO:tasks.workunit.client.1.smithi115.stdout:5/924: chown dc/d79/ca2 14273 1 2024-04-16T14:35:48.182 INFO:tasks.workunit.client.1.smithi115.stdout:3/986: link dc/ffd dc/d29/f149 0 2024-04-16T14:35:48.182 INFO:tasks.workunit.client.1.smithi115.stdout:3/987: chown dc/d29/d4d/c61 476948 1 2024-04-16T14:35:48.184 INFO:tasks.workunit.client.1.smithi115.stdout:5/925: getdents dc/d15/d35/d69/dad 0 2024-04-16T14:35:48.185 INFO:tasks.workunit.client.1.smithi115.stdout:3/988: unlink dc/d29/d4d/d56/d126/d4b/f97 0 2024-04-16T14:35:48.187 INFO:tasks.workunit.client.1.smithi115.stdout:6/930: dwrite d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/fd2 [0,4194304] 0 2024-04-16T14:35:48.188 INFO:tasks.workunit.client.1.smithi115.stdout:7/887: dwrite d0/d2/d3a/d30/d6b/f119 [0,4194304] 0 2024-04-16T14:35:48.192 INFO:tasks.workunit.client.1.smithi115.stdout:6/931: mknod d13/d1d/d68/c132 0 2024-04-16T14:35:48.193 INFO:tasks.workunit.client.1.smithi115.stdout:4/960: dwrite d1/d15/d17/fbb [0,4194304] 0 2024-04-16T14:35:48.194 INFO:tasks.workunit.client.1.smithi115.stdout:7/888: mkdir d0/d24/d40/df4/d12c 0 2024-04-16T14:35:48.194 INFO:tasks.workunit.client.1.smithi115.stdout:7/889: fdatasync d0/d2/d3a/dac/da7/fe5 0 2024-04-16T14:35:48.194 INFO:tasks.workunit.client.1.smithi115.stdout:7/890: write d0/d24/da3/db1/d3f/db0/f89 [3843386,119499] 0 2024-04-16T14:35:48.195 INFO:tasks.workunit.client.1.smithi115.stdout:6/932: creat d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/f133 x:0 0 0 2024-04-16T14:35:48.195 INFO:tasks.workunit.client.1.smithi115.stdout:6/933: chown d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/fe0 0 1 2024-04-16T14:35:48.197 INFO:tasks.workunit.client.1.smithi115.stdout:4/961: mknod d1/d2/dde/c12d 0 2024-04-16T14:35:48.199 INFO:tasks.workunit.client.1.smithi115.stdout:4/962: mknod d1/d2/dde/c12e 0 2024-04-16T14:35:48.201 INFO:tasks.workunit.client.1.smithi115.stdout:7/891: getdents d0/d24 0 2024-04-16T14:35:48.201 INFO:tasks.workunit.client.1.smithi115.stdout:7/892: write d0/d2/d3a/d30/d6b/f84 [1060620,22570] 0 2024-04-16T14:35:48.204 INFO:tasks.workunit.client.1.smithi115.stdout:7/893: creat d0/d2/f12d x:0 0 0 2024-04-16T14:35:48.204 INFO:tasks.workunit.client.1.smithi115.stdout:7/894: chown d0/d2/d3a/dac/le7 0 1 2024-04-16T14:35:48.204 INFO:tasks.workunit.client.1.smithi115.stdout:7/895: truncate d0/d2/d3a/d30/f123 595035 0 2024-04-16T14:35:48.205 INFO:tasks.workunit.client.0.smithi005.stdout:9/957: sync 2024-04-16T14:35:48.205 INFO:tasks.workunit.client.0.smithi005.stdout:2/881: sync 2024-04-16T14:35:48.206 INFO:tasks.workunit.client.0.smithi005.stdout:2/882: write d0/d29/d89/f105 [228804,5806] 0 2024-04-16T14:35:48.206 INFO:tasks.workunit.client.0.smithi005.stdout:2/883: chown d0/d1c/c30 1184074681 1 2024-04-16T14:35:48.206 INFO:tasks.workunit.client.0.smithi005.stdout:2/884: write d0/d4/d2b/d5e/d9a/fdc [158794,116609] 0 2024-04-16T14:35:48.206 INFO:tasks.workunit.client.1.smithi115.stdout:0/801: dwrite d6/d10/d12/dba/ff7 [0,4194304] 0 2024-04-16T14:35:48.207 INFO:tasks.workunit.client.1.smithi115.stdout:7/896: getdents d0/d2/d3a/dac/da7 0 2024-04-16T14:35:48.207 INFO:tasks.workunit.client.0.smithi005.stdout:9/958: symlink d3/d12/d16/d117/l11a 0 2024-04-16T14:35:48.207 INFO:tasks.workunit.client.0.smithi005.stdout:9/959: dread - d3/d12/d2b/f116 zero size 2024-04-16T14:35:48.207 INFO:tasks.workunit.client.0.smithi005.stdout:9/960: creat d3/d49/d4b/d5c/d65/d9a/daf/f11b x:0 0 0 2024-04-16T14:35:48.208 INFO:tasks.workunit.client.1.smithi115.stdout:4/963: dread d1/d15/d9c/f102 [0,4194304] 0 2024-04-16T14:35:48.208 INFO:tasks.workunit.client.1.smithi115.stdout:4/964: write d1/d15/d17/d9e/dbe/f124 [896226,129810] 0 2024-04-16T14:35:48.209 INFO:tasks.workunit.client.0.smithi005.stdout:9/961: mkdir d3/d49/d91/d11c 0 2024-04-16T14:35:48.210 INFO:tasks.workunit.client.1.smithi115.stdout:0/802: creat d6/d10/dd1/f115 x:0 0 0 2024-04-16T14:35:48.210 INFO:tasks.workunit.client.1.smithi115.stdout:0/803: fsync d6/d10/d12/d1f/f89 0 2024-04-16T14:35:48.210 INFO:tasks.workunit.client.1.smithi115.stdout:0/804: write d6/d10/d12/d1f/f89 [250623,71762] 0 2024-04-16T14:35:48.210 INFO:tasks.workunit.client.1.smithi115.stdout:7/897: mknod d0/d2/d3a/dac/da7/c12e 0 2024-04-16T14:35:48.210 INFO:tasks.workunit.client.0.smithi005.stdout:2/885: rmdir d0/d2a/d3a/d46/dd8 39 2024-04-16T14:35:48.211 INFO:tasks.workunit.client.1.smithi115.stdout:4/965: unlink d1/d15/d31/d55/f85 0 2024-04-16T14:35:48.211 INFO:tasks.workunit.client.1.smithi115.stdout:4/966: creat d1/d15/d31/d89/f12f x:0 0 0 2024-04-16T14:35:48.211 INFO:tasks.workunit.client.1.smithi115.stdout:4/967: creat d1/d15/d31/d42/da4/f130 x:0 0 0 2024-04-16T14:35:48.212 INFO:tasks.workunit.client.1.smithi115.stdout:7/898: creat d0/d2/d3a/dda/f12f x:0 0 0 2024-04-16T14:35:48.212 INFO:tasks.workunit.client.0.smithi005.stdout:9/962: unlink d3/d12/d2b/d8e/dc1/l109 0 2024-04-16T14:35:48.212 INFO:tasks.workunit.client.0.smithi005.stdout:9/963: dread - d3/d49/f89 zero size 2024-04-16T14:35:48.213 INFO:tasks.workunit.client.0.smithi005.stdout:9/964: symlink d3/dd5/l11d 0 2024-04-16T14:35:48.214 INFO:tasks.workunit.client.0.smithi005.stdout:9/965: unlink d3/d12/d9d/l10e 0 2024-04-16T14:35:48.215 INFO:tasks.workunit.client.1.smithi115.stdout:4/968: dread d1/d2/ff [0,4194304] 0 2024-04-16T14:35:48.215 INFO:tasks.workunit.client.1.smithi115.stdout:4/969: fdatasync d1/d15/d17/f8a 0 2024-04-16T14:35:48.217 INFO:tasks.workunit.client.1.smithi115.stdout:4/970: getdents d1/d15/d17 0 2024-04-16T14:35:48.217 INFO:tasks.workunit.client.1.smithi115.stdout:4/971: write d1/d2/f5b [4636954,11017] 0 2024-04-16T14:35:48.217 INFO:tasks.workunit.client.1.smithi115.stdout:4/972: truncate d1/d15/d17/d9e/ddf/f122 303585 0 2024-04-16T14:35:48.217 INFO:tasks.workunit.client.1.smithi115.stdout:5/926: dwrite dc/d3d/d109/fb6 [0,4194304] 0 2024-04-16T14:35:48.218 INFO:tasks.workunit.client.1.smithi115.stdout:5/927: chown dc/d15/f5f 477641482 1 2024-04-16T14:35:48.218 INFO:tasks.workunit.client.1.smithi115.stdout:5/928: chown dc/d3d/d41/c61 77393169 1 2024-04-16T14:35:48.221 INFO:tasks.workunit.client.1.smithi115.stdout:4/973: rmdir d1 39 2024-04-16T14:35:48.221 INFO:tasks.workunit.client.1.smithi115.stdout:4/974: stat d1/d15/d17/d9e/ddf/f122 0 2024-04-16T14:35:48.221 INFO:tasks.workunit.client.1.smithi115.stdout:4/975: getdents d1/d15/d17/d9e 0 2024-04-16T14:35:48.226 INFO:tasks.workunit.client.1.smithi115.stdout:4/976: creat d1/d15/d17/d9e/f131 x:0 0 0 2024-04-16T14:35:48.231 INFO:tasks.workunit.client.0.smithi005.stdout:2/886: dread d0/d1c/d39/d48/f81 [0,4194304] 0 2024-04-16T14:35:48.231 INFO:tasks.workunit.client.0.smithi005.stdout:2/887: write d0/d29/d89/f8b [1443841,124163] 0 2024-04-16T14:35:48.231 INFO:tasks.workunit.client.0.smithi005.stdout:2/888: write d0/d2a/fff [679401,25327] 0 2024-04-16T14:35:48.231 INFO:tasks.workunit.client.0.smithi005.stdout:2/889: creat d0/d1c/d39/d85/da2/db0/f12a x:0 0 0 2024-04-16T14:35:48.231 INFO:tasks.workunit.client.1.smithi115.stdout:4/977: symlink d1/d15/d24/dc6/d12a/l132 0 2024-04-16T14:35:48.232 INFO:tasks.workunit.client.1.smithi115.stdout:4/978: read d1/d15/f34 [194958,110816] 0 2024-04-16T14:35:48.232 INFO:tasks.workunit.client.1.smithi115.stdout:8/984: dwrite d0/f31 [0,4194304] 0 2024-04-16T14:35:48.232 INFO:tasks.workunit.client.1.smithi115.stdout:3/989: dwrite dc/d24/d36/d60/f122 [0,4194304] 0 2024-04-16T14:35:48.232 INFO:tasks.workunit.client.1.smithi115.stdout:8/985: write d0/db/d10/d17/d2c/d85/f8f [303051,36484] 0 2024-04-16T14:35:48.232 INFO:tasks.workunit.client.1.smithi115.stdout:8/986: fdatasync d0/db/d10/d17/d2c/d52/d6c/d71/fb9 0 2024-04-16T14:35:48.232 INFO:tasks.workunit.client.1.smithi115.stdout:8/987: fdatasync d0/db/d10/d17/d2c/d52/d84/f9c 0 2024-04-16T14:35:48.232 INFO:tasks.workunit.client.1.smithi115.stdout:8/988: creat d0/db/d10/d17/d2c/d52/d6c/db8/d7d/de2/d111/f146 x:0 0 0 2024-04-16T14:35:48.232 INFO:tasks.workunit.client.1.smithi115.stdout:8/989: chown d0/db/dbb/f13e 2185632 1 2024-04-16T14:35:48.233 INFO:tasks.workunit.client.0.smithi005.stdout:2/890: mkdir d0/d1c/d39/d85/da2/d12b 0 2024-04-16T14:35:48.233 INFO:tasks.workunit.client.0.smithi005.stdout:9/966: write d3/d49/d4b/d55/f57 [5085469,27118] 0 2024-04-16T14:35:48.233 INFO:tasks.workunit.client.0.smithi005.stdout:2/891: symlink d0/d29/d89/l12c 0 2024-04-16T14:35:48.235 INFO:tasks.workunit.client.0.smithi005.stdout:2/892: symlink d0/d2a/l12d 0 2024-04-16T14:35:48.235 INFO:tasks.workunit.client.0.smithi005.stdout:2/893: chown d0/c9c 0 1 2024-04-16T14:35:48.236 INFO:tasks.workunit.client.1.smithi115.stdout:8/990: link d0/db/c20 d0/db/d134/da2/c147 0 2024-04-16T14:35:48.236 INFO:tasks.workunit.client.1.smithi115.stdout:8/991: write d0/de5/d132/d13d/dc0/f10c [4198260,99364] 0 2024-04-16T14:35:48.236 INFO:tasks.workunit.client.1.smithi115.stdout:8/992: fsync d0/f62 0 2024-04-16T14:35:48.237 INFO:tasks.workunit.client.0.smithi005.stdout:9/967: link d3/d49/d4b/d55/f115 d3/d77/f11e 0 2024-04-16T14:35:48.237 INFO:tasks.workunit.client.1.smithi115.stdout:6/934: dwrite d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96/d55/fa5 [0,4194304] 0 2024-04-16T14:35:48.237 INFO:tasks.workunit.client.1.smithi115.stdout:0/805: dwrite f1 [8388608,4194304] 0 2024-04-16T14:35:48.237 INFO:tasks.workunit.client.1.smithi115.stdout:6/935: getdents d13 0 2024-04-16T14:35:48.238 INFO:tasks.workunit.client.1.smithi115.stdout:7/899: dwrite d0/d24/f4a [8388608,4194304] 0 2024-04-16T14:35:48.238 INFO:tasks.workunit.client.1.smithi115.stdout:8/993: creat d0/db/d10/d17/d2c/d52/d6c/dd9/f148 x:0 0 0 2024-04-16T14:35:48.239 INFO:tasks.workunit.client.1.smithi115.stdout:3/990: link dc/ff dc/d29/d39/f14a 0 2024-04-16T14:35:48.241 INFO:tasks.workunit.client.1.smithi115.stdout:0/806: creat d6/d10/d12/d1f/d36/d4b/dff/f116 x:0 0 0 2024-04-16T14:35:48.241 INFO:tasks.workunit.client.1.smithi115.stdout:0/807: fsync d6/d1b/f7d 0 2024-04-16T14:35:48.242 INFO:tasks.workunit.client.1.smithi115.stdout:8/994: mkdir d0/db/d10/d17/d2c/d52/d6c/db8/d6b/d149 0 2024-04-16T14:35:48.244 INFO:tasks.workunit.client.1.smithi115.stdout:3/991: stat dc/d29/d39/c5f 0 2024-04-16T14:35:48.245 INFO:tasks.workunit.client.1.smithi115.stdout:7/900: mkdir d0/d2/d3a/d30/d79/dd2/d64/d130 0 2024-04-16T14:35:48.246 INFO:tasks.workunit.client.1.smithi115.stdout:6/936: write d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96/d55/f58 [2140298,70673] 0 2024-04-16T14:35:48.248 INFO:tasks.workunit.client.1.smithi115.stdout:3/992: mkdir dc/d29/d39/d86/dd0/dee/de0/d14b 0 2024-04-16T14:35:48.250 INFO:tasks.workunit.client.1.smithi115.stdout:0/808: unlink d6/d1b/d4e/ld9 0 2024-04-16T14:35:48.250 INFO:tasks.workunit.client.1.smithi115.stdout:0/809: fsync d6/d30/d8d/f114 0 2024-04-16T14:35:48.251 INFO:tasks.workunit.client.1.smithi115.stdout:7/901: mknod d0/d24/c131 0 2024-04-16T14:35:48.251 INFO:tasks.workunit.client.1.smithi115.stdout:7/902: chown d0/d2/d3a/d30/d6b/da2/fa8 124 1 2024-04-16T14:35:48.252 INFO:tasks.workunit.client.1.smithi115.stdout:4/979: rmdir d1/d15/d31/d42/da4 39 2024-04-16T14:35:48.254 INFO:tasks.workunit.client.0.smithi005.stdout:2/894: rename d0/d2a to d0/d1c/d59/d67/d12e 0 2024-04-16T14:35:48.254 INFO:tasks.workunit.client.0.smithi005.stdout:2/895: readlink d0/d4/d2b/l44 0 2024-04-16T14:35:48.255 INFO:tasks.workunit.client.1.smithi115.stdout:6/937: link d13/d1d/d2b/df4/f107 d13/d1d/d2b/d5f/d30/d43/d2c/f134 0 2024-04-16T14:35:48.256 INFO:tasks.workunit.client.0.smithi005.stdout:9/968: dwrite d3/f8a [0,4194304] 0 2024-04-16T14:35:48.257 INFO:tasks.workunit.client.0.smithi005.stdout:9/969: chown d3/d12/d16/d46/fa7 750993223 1 2024-04-16T14:35:48.257 INFO:tasks.workunit.client.0.smithi005.stdout:9/970: truncate d3/dd5/f119 516499 0 2024-04-16T14:35:48.258 INFO:tasks.workunit.client.0.smithi005.stdout:2/896: mkdir d0/d1c/d39/d12f 0 2024-04-16T14:35:48.259 INFO:tasks.workunit.client.1.smithi115.stdout:0/810: rename d6/d10/d12/l18 to d6/d30/d4d/df0/d10c/dbe/l117 0 2024-04-16T14:35:48.261 INFO:tasks.workunit.client.1.smithi115.stdout:7/903: dread d0/d1/fc9 [0,4194304] 0 2024-04-16T14:35:48.263 INFO:tasks.workunit.client.0.smithi005.stdout:2/897: rmdir d0/d29 39 2024-04-16T14:35:48.263 INFO:tasks.workunit.client.1.smithi115.stdout:7/904: symlink d0/d24/da3/db1/d5a/l132 0 2024-04-16T14:35:48.263 INFO:tasks.workunit.client.0.smithi005.stdout:2/898: mknod d0/d4/d2b/d5e/d125/c130 0 2024-04-16T14:35:48.264 INFO:tasks.workunit.client.0.smithi005.stdout:2/899: write d0/d1c/d59/d67/d12e/d3a/d46/f5d [1493832,10892] 0 2024-04-16T14:35:48.265 INFO:tasks.workunit.client.0.smithi005.stdout:2/900: truncate d0/d29/d3e/f8e 858194 0 2024-04-16T14:35:48.268 INFO:tasks.workunit.client.0.smithi005.stdout:2/901: creat d0/d29/d3e/f131 x:0 0 0 2024-04-16T14:35:48.269 INFO:tasks.workunit.client.0.smithi005.stdout:2/902: mknod d0/d1c/d39/d85/da2/db0/c132 0 2024-04-16T14:35:48.271 INFO:tasks.workunit.client.0.smithi005.stdout:2/903: unlink d0/d29/d3e/f131 0 2024-04-16T14:35:48.271 INFO:tasks.workunit.client.0.smithi005.stdout:2/904: fsync d0/d29/d3e/f71 0 2024-04-16T14:35:48.272 INFO:tasks.workunit.client.1.smithi115.stdout:4/980: dwrite d1/d15/d31/d42/d46/f50 [4194304,4194304] 0 2024-04-16T14:35:48.272 INFO:tasks.workunit.client.0.smithi005.stdout:2/905: symlink d0/d1c/d59/d67/l133 0 2024-04-16T14:35:48.274 INFO:tasks.workunit.client.0.smithi005.stdout:2/906: creat d0/d29/d89/de3/f134 x:0 0 0 2024-04-16T14:35:48.274 INFO:tasks.workunit.client.1.smithi115.stdout:4/981: creat d1/d15/d24/f133 x:0 0 0 2024-04-16T14:35:48.275 INFO:tasks.workunit.client.0.smithi005.stdout:2/907: symlink d0/d1c/l135 0 2024-04-16T14:35:48.276 INFO:tasks.workunit.client.1.smithi115.stdout:4/982: rename d1/d15/d31/d55/l10d to d1/d15/d31/d42/d46/d7a/l134 0 2024-04-16T14:35:48.277 INFO:tasks.workunit.client.1.smithi115.stdout:8/995: rmdir d0/db/d10 39 2024-04-16T14:35:48.278 INFO:tasks.workunit.client.1.smithi115.stdout:8/996: creat d0/db/d10/d17/d2c/d52/d6c/db8/d6b/d149/f14a x:0 0 0 2024-04-16T14:35:48.280 INFO:tasks.workunit.client.1.smithi115.stdout:8/997: symlink d0/db/d10/d17/d2c/d85/d108/l14b 0 2024-04-16T14:35:48.282 INFO:tasks.workunit.client.1.smithi115.stdout:8/998: truncate d0/db/d10/d17/d2c/d52/d74/d3b/d56/d5b/d7f/d8a/fa0 1905743 0 2024-04-16T14:35:48.283 INFO:tasks.workunit.client.1.smithi115.stdout:8/999: mknod d0/db/d10/d17/d2c/d52/d6c/dd9/c14c 0 2024-04-16T14:35:48.302 INFO:tasks.workunit.client.0.smithi005.stdout:9/971: dwrite d3/d12/fb9 [0,4194304] 0 2024-04-16T14:35:48.303 INFO:tasks.workunit.client.0.smithi005.stdout:9/972: chown d3/d12/d16/le1 18 1 2024-04-16T14:35:48.303 INFO:tasks.workunit.client.1.smithi115.stdout:7/905: dwrite d0/d24/da3/db1/d5a/f11e [0,4194304] 0 2024-04-16T14:35:48.303 INFO:tasks.workunit.client.1.smithi115.stdout:0/811: dwrite d6/d10/d12/f6e [0,4194304] 0 2024-04-16T14:35:48.303 INFO:tasks.workunit.client.1.smithi115.stdout:4/983: dwrite d1/d15/d17/d9e/dbe/f124 [0,4194304] 0 2024-04-16T14:35:48.306 INFO:tasks.workunit.client.0.smithi005.stdout:9/973: rename d3/d12/d9d/cc5 to d3/d49/d4b/d55/d7b/c11f 0 2024-04-16T14:35:48.306 INFO:tasks.workunit.client.0.smithi005.stdout:9/974: write d3/d49/d4b/d55/f5d [4859206,107966] 0 2024-04-16T14:35:48.310 INFO:tasks.workunit.client.0.smithi005.stdout:9/975: symlink d3/dd5/l120 0 2024-04-16T14:35:48.311 INFO:tasks.workunit.client.0.smithi005.stdout:9/976: chown d3/d49/d91/ce8 51469515 1 2024-04-16T14:35:48.314 INFO:tasks.workunit.client.1.smithi115.stdout:0/812: dread d6/d10/d12/f14 [0,4194304] 0 2024-04-16T14:35:48.315 INFO:tasks.workunit.client.1.smithi115.stdout:0/813: creat d6/dac/f118 x:0 0 0 2024-04-16T14:35:48.316 INFO:tasks.workunit.client.1.smithi115.stdout:0/814: creat d6/d10/d12/d31/d35/d44/dd2/f119 x:0 0 0 2024-04-16T14:35:48.317 INFO:tasks.workunit.client.1.smithi115.stdout:0/815: write d6/d10/f63 [37275,53417] 0 2024-04-16T14:35:48.319 INFO:tasks.workunit.client.0.smithi005.stdout:2/908: dwrite d0/d29/d89/f8b [4194304,4194304] 0 2024-04-16T14:35:48.319 INFO:tasks.workunit.client.0.smithi005.stdout:2/909: stat d0/d1c/d59/d67/d12e/d3a/f55 0 2024-04-16T14:35:48.319 INFO:tasks.workunit.client.0.smithi005.stdout:2/910: creat d0/d1c/d39/dcb/f136 x:0 0 0 2024-04-16T14:35:48.320 INFO:tasks.workunit.client.1.smithi115.stdout:0/816: rename d6/d10/d12/d1f/d36/d4b/d6d/f8e to d6/d10/d12/d1f/d36/d4b/d101/d10b/f11a 0 2024-04-16T14:35:48.323 INFO:tasks.workunit.client.0.smithi005.stdout:2/911: rename d0/d1c/d59/d67/d12e/d3a/fc2 to d0/d4/f137 0 2024-04-16T14:35:48.323 INFO:tasks.workunit.client.0.smithi005.stdout:2/912: mkdir d0/d1c/d59/d7a/d84/df8/d138 0 2024-04-16T14:35:48.324 INFO:tasks.workunit.client.1.smithi115.stdout:0/817: creat d6/d10/d12/d1f/d36/f11b x:0 0 0 2024-04-16T14:35:48.324 INFO:tasks.workunit.client.1.smithi115.stdout:0/818: truncate d6/ff 636876 0 2024-04-16T14:35:48.324 INFO:tasks.workunit.client.1.smithi115.stdout:0/819: fsync d6/d10/d12/d1f/d36/d4b/f5c 0 2024-04-16T14:35:48.326 INFO:tasks.workunit.client.0.smithi005.stdout:2/913: write d0/d1c/d39/d85/fa6 [403405,53778] 0 2024-04-16T14:35:48.326 INFO:tasks.workunit.client.0.smithi005.stdout:2/914: creat d0/d1c/d39/f139 x:0 0 0 2024-04-16T14:35:48.346 INFO:tasks.workunit.client.1.smithi115.stdout:4/984: dwrite d1/d15/d31/d55/f56 [0,4194304] 0 2024-04-16T14:35:48.347 INFO:tasks.workunit.client.0.smithi005.stdout:9/977: dwrite d3/fa2 [0,4194304] 0 2024-04-16T14:35:48.348 INFO:tasks.workunit.client.1.smithi115.stdout:0/820: dwrite d6/d10/d12/d1f/d36/d4b/f69 [0,4194304] 0 2024-04-16T14:35:48.350 INFO:tasks.workunit.client.1.smithi115.stdout:0/821: creat d6/d30/d4d/df0/d10c/dbe/f11c x:0 0 0 2024-04-16T14:35:48.351 INFO:tasks.workunit.client.0.smithi005.stdout:9/978: rename d3/d12/c80 to d3/d49/d91/d11c/c121 0 2024-04-16T14:35:48.354 INFO:tasks.workunit.client.1.smithi115.stdout:4/985: dread d1/d15/d24/f40 [0,4194304] 0 2024-04-16T14:35:48.354 INFO:tasks.workunit.client.1.smithi115.stdout:4/986: fsync d1/d15/d31/f98 0 2024-04-16T14:35:48.354 INFO:tasks.workunit.client.0.smithi005.stdout:9/979: mkdir d3/d49/d4b/d5c/d65/d9a/daf/de0/d122 0 2024-04-16T14:35:48.358 INFO:tasks.workunit.client.1.smithi115.stdout:0/822: dread d6/d10/dae/fc1 [0,4194304] 0 2024-04-16T14:35:48.359 INFO:tasks.workunit.client.1.smithi115.stdout:0/823: chown d6/d10/d12/d31/d35/d44/dd2 21525215 1 2024-04-16T14:35:48.359 INFO:tasks.workunit.client.1.smithi115.stdout:0/824: readlink d6/lc4 0 2024-04-16T14:35:48.362 INFO:tasks.workunit.client.1.smithi115.stdout:4/987: read d1/d15/d17/de6/f11f [2249751,38288] 0 2024-04-16T14:35:48.364 INFO:tasks.workunit.client.1.smithi115.stdout:4/988: link d1/d15/d31/d42/d8b/lb2 d1/d15/d24/dc6/l135 0 2024-04-16T14:35:48.367 INFO:tasks.workunit.client.1.smithi115.stdout:0/825: dread d6/d10/d12/d1f/d36/d4b/f5c [0,4194304] 0 2024-04-16T14:35:48.369 INFO:tasks.workunit.client.1.smithi115.stdout:0/826: mknod d6/d10/d12/d31/d35/d44/dd2/c11d 0 2024-04-16T14:35:48.369 INFO:tasks.workunit.client.1.smithi115.stdout:0/827: chown d6/d10/d12/d31/d35/d9b/lb3 1 1 2024-04-16T14:35:48.369 INFO:tasks.workunit.client.1.smithi115.stdout:0/828: chown d6/d10/d12/d1f/d36/fa2 112 1 2024-04-16T14:35:48.369 INFO:tasks.workunit.client.1.smithi115.stdout:0/829: stat d6/d10/d71/db7/f10d 0 2024-04-16T14:35:48.370 INFO:tasks.workunit.client.1.smithi115.stdout:0/830: symlink d6/d10/d12/d31/d35/l11e 0 2024-04-16T14:35:48.370 INFO:tasks.workunit.client.1.smithi115.stdout:0/831: chown d6/d10/d12/d1f/d36/d4b/d70/d8a/fb1 141244195 1 2024-04-16T14:35:48.374 INFO:tasks.workunit.client.1.smithi115.stdout:0/832: dread d6/d10/d12/d1f/f89 [0,4194304] 0 2024-04-16T14:35:48.374 INFO:tasks.workunit.client.0.smithi005.stdout:9/980: dwrite d3/d12/f30 [0,4194304] 0 2024-04-16T14:35:48.375 INFO:tasks.workunit.client.1.smithi115.stdout:0/833: creat d6/d30/d4d/f11f x:0 0 0 2024-04-16T14:35:48.375 INFO:tasks.workunit.client.1.smithi115.stdout:0/834: write d6/d10/d12/d1f/d36/d4b/f69 [4262114,129752] 0 2024-04-16T14:35:48.376 INFO:tasks.workunit.client.1.smithi115.stdout:0/835: creat d6/d10/d12/d31/f120 x:0 0 0 2024-04-16T14:35:48.376 INFO:tasks.workunit.client.0.smithi005.stdout:9/981: unlink d3/d49/d4b/d55/d7b/lbe 0 2024-04-16T14:35:48.377 INFO:tasks.workunit.client.0.smithi005.stdout:9/982: symlink d3/d12/d16/d46/d47/db1/dbf/l123 0 2024-04-16T14:35:48.378 INFO:tasks.workunit.client.1.smithi115.stdout:0/836: mknod d6/d10/d12/d31/d35/d44/d85/c121 0 2024-04-16T14:35:48.378 INFO:tasks.workunit.client.0.smithi005.stdout:9/983: mknod d3/d12/d16/d46/d47/c124 0 2024-04-16T14:35:48.379 INFO:tasks.workunit.client.0.smithi005.stdout:9/984: creat d3/d12/d16/dc6/f125 x:0 0 0 2024-04-16T14:35:48.379 INFO:tasks.workunit.client.0.smithi005.stdout:9/985: creat d3/d12/d9d/dfc/f126 x:0 0 0 2024-04-16T14:35:48.386 INFO:tasks.workunit.client.1.smithi115.stdout:4/989: dwrite d1/d15/d17/f26 [8388608,4194304] 0 2024-04-16T14:35:48.386 INFO:tasks.workunit.client.1.smithi115.stdout:4/990: write d1/f2d [6932827,15622] 0 2024-04-16T14:35:48.387 INFO:tasks.workunit.client.1.smithi115.stdout:4/991: dread d1/d15/d17/d9e/dbe/fe5 [0,4194304] 0 2024-04-16T14:35:48.387 INFO:tasks.workunit.client.1.smithi115.stdout:4/992: write d1/d15/d24/f40 [1823449,4880] 0 2024-04-16T14:35:48.390 INFO:tasks.workunit.client.1.smithi115.stdout:5/929: sync 2024-04-16T14:35:48.390 INFO:tasks.workunit.client.1.smithi115.stdout:5/930: read - dc/d3d/f96 zero size 2024-04-16T14:35:48.392 INFO:tasks.workunit.client.1.smithi115.stdout:0/837: dread d6/dac/fbb [0,4194304] 0 2024-04-16T14:35:48.392 INFO:tasks.workunit.client.1.smithi115.stdout:0/838: stat d6/d10/d71/db7/f10d 0 2024-04-16T14:35:48.393 INFO:tasks.workunit.client.1.smithi115.stdout:0/839: creat d6/d10/d12/d1f/d36/d4b/d70/d8a/f122 x:0 0 0 2024-04-16T14:35:48.393 INFO:tasks.workunit.client.1.smithi115.stdout:0/840: stat d6/d10/d12/f6e 0 2024-04-16T14:35:48.393 INFO:tasks.workunit.client.1.smithi115.stdout:0/841: dread - d6/d30/d4d/df0/d10c/dbe/f11c zero size 2024-04-16T14:35:48.394 INFO:tasks.workunit.client.1.smithi115.stdout:0/842: creat d6/d30/d4d/de4/f123 x:0 0 0 2024-04-16T14:35:48.394 INFO:tasks.workunit.client.1.smithi115.stdout:0/843: fsync d6/d10/d12/d1f/d36/d4b/f6a 0 2024-04-16T14:35:48.396 INFO:tasks.workunit.client.1.smithi115.stdout:0/844: rename d6/d10/d12/d1f/d36/fa2 to d6/d30/d8d/f124 0 2024-04-16T14:35:48.397 INFO:tasks.workunit.client.1.smithi115.stdout:0/845: mkdir d6/d10/d12/d1f/d36/d4b/dff/d125 0 2024-04-16T14:35:48.397 INFO:tasks.workunit.client.1.smithi115.stdout:0/846: readlink d6/d10/d71/db7/lc3 0 2024-04-16T14:35:48.397 INFO:tasks.workunit.client.1.smithi115.stdout:0/847: fsync d6/dac/fe7 0 2024-04-16T14:35:48.400 INFO:tasks.workunit.client.1.smithi115.stdout:0/848: rename d6/dac to d6/d10/d12/d1f/ded/df6/d126 0 2024-04-16T14:35:48.404 INFO:tasks.workunit.client.1.smithi115.stdout:5/931: dwrite dc/d3d/f6a [4194304,4194304] 0 2024-04-16T14:35:48.406 INFO:tasks.workunit.client.1.smithi115.stdout:5/932: mkdir dc/d5d/d115 0 2024-04-16T14:35:48.406 INFO:tasks.workunit.client.1.smithi115.stdout:5/933: readlink dc/d15/d35/d87/lc7 0 2024-04-16T14:35:48.406 INFO:tasks.workunit.client.1.smithi115.stdout:5/934: read - dc/d15/d35/d87/fd4 zero size 2024-04-16T14:35:48.409 INFO:tasks.workunit.client.1.smithi115.stdout:0/849: dread d6/d1b/f6c [0,4194304] 0 2024-04-16T14:35:48.411 INFO:tasks.workunit.client.1.smithi115.stdout:0/850: mkdir d6/d10/dae/d127 0 2024-04-16T14:35:48.428 INFO:tasks.workunit.client.1.smithi115.stdout:5/935: dwrite dc/d15/f10d [0,4194304] 0 2024-04-16T14:35:48.428 INFO:tasks.workunit.client.1.smithi115.stdout:5/936: write dc/f11 [3850426,108406] 0 2024-04-16T14:35:48.428 INFO:tasks.workunit.client.1.smithi115.stdout:0/851: dwrite d6/d30/d4d/df0/d10c/dbe/fad [0,4194304] 0 2024-04-16T14:35:48.431 INFO:tasks.workunit.client.1.smithi115.stdout:0/852: truncate d6/fec 1873589 0 2024-04-16T14:35:48.431 INFO:tasks.workunit.client.1.smithi115.stdout:0/853: readlink d6/d1b/d4e/db9/dca/lda 0 2024-04-16T14:35:48.433 INFO:tasks.workunit.client.1.smithi115.stdout:0/854: rmdir d6/d10/d12/d1f/d36/d4b/dff/d125 0 2024-04-16T14:35:48.433 INFO:tasks.workunit.client.1.smithi115.stdout:0/855: chown d6/d10/d12/d1f/d36/d4b/f9d 3349 1 2024-04-16T14:35:48.446 INFO:tasks.workunit.client.1.smithi115.stdout:0/856: symlink d6/d30/d4d/df0/l128 0 2024-04-16T14:35:48.446 INFO:tasks.workunit.client.1.smithi115.stdout:0/857: creat d6/d10/dc8/f129 x:0 0 0 2024-04-16T14:35:48.446 INFO:tasks.workunit.client.1.smithi115.stdout:5/937: write dc/d3d/f7f [522210,91902] 0 2024-04-16T14:35:48.446 INFO:tasks.workunit.client.1.smithi115.stdout:5/938: write dc/d15/d4d/dde/df1/ffa [572240,103822] 0 2024-04-16T14:35:48.447 INFO:tasks.workunit.client.1.smithi115.stdout:5/939: stat dc/d5d/l77 0 2024-04-16T14:35:48.447 INFO:tasks.workunit.client.1.smithi115.stdout:5/940: dread - dc/d15/d35/d69/dad/fda zero size 2024-04-16T14:35:48.451 INFO:tasks.workunit.client.1.smithi115.stdout:0/858: dwrite d6/d10/d12/f80 [4194304,4194304] 0 2024-04-16T14:35:48.460 INFO:tasks.workunit.client.1.smithi115.stdout:0/859: rename d6/l8 to d6/l12a 0 2024-04-16T14:35:48.460 INFO:tasks.workunit.client.1.smithi115.stdout:3/993: sync 2024-04-16T14:35:48.460 INFO:tasks.workunit.client.1.smithi115.stdout:6/938: sync 2024-04-16T14:35:48.461 INFO:tasks.workunit.client.1.smithi115.stdout:3/994: truncate dc/d29/d4d/d56/d126/dde/fe2 299579 0 2024-04-16T14:35:48.461 INFO:tasks.workunit.client.1.smithi115.stdout:3/995: dread - dc/d29/d39/d86/dd0/dee/f121 zero size 2024-04-16T14:35:48.461 INFO:tasks.workunit.client.1.smithi115.stdout:3/996: write dc/d29/d4d/d56/d98/dbe/f110 [183932,25893] 0 2024-04-16T14:35:48.461 INFO:tasks.workunit.client.1.smithi115.stdout:3/997: truncate dc/d29/d4d/dac/f12b 119052 0 2024-04-16T14:35:48.461 INFO:tasks.workunit.client.1.smithi115.stdout:3/998: creat dc/d29/d39/d86/dd0/dee/de0/f14c x:0 0 0 2024-04-16T14:35:48.462 INFO:tasks.workunit.client.1.smithi115.stdout:6/939: rename d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/d5a/fbd to d13/d1d/d2b/d5f/d30/d43/f135 0 2024-04-16T14:35:48.462 INFO:tasks.workunit.client.1.smithi115.stdout:0/860: write d6/d10/d12/f14 [2351823,33610] 0 2024-04-16T14:35:48.462 INFO:tasks.workunit.client.1.smithi115.stdout:3/999: unlink dc/d29/d77/cc3 0 2024-04-16T14:35:48.462 INFO:tasks.workunit.client.1.smithi115.stdout:6/940: getdents d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96/de4 0 2024-04-16T14:35:48.464 INFO:tasks.workunit.client.1.smithi115.stdout:0/861: rename d6/d30/cd3 to d6/d10/d12/d31/d35/d9b/c12b 0 2024-04-16T14:35:48.464 INFO:tasks.workunit.client.1.smithi115.stdout:6/941: truncate d13/d1d/d87/f113 369681 0 2024-04-16T14:35:48.464 INFO:tasks.workunit.client.1.smithi115.stdout:6/942: readlink d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/lb2 0 2024-04-16T14:35:48.465 INFO:tasks.workunit.client.1.smithi115.stdout:0/862: mkdir d6/d30/d4d/df0/d10c/dbe/d12c 0 2024-04-16T14:35:48.465 INFO:tasks.workunit.client.1.smithi115.stdout:0/863: fdatasync d6/d10/d12/d31/feb 0 2024-04-16T14:35:48.465 INFO:tasks.workunit.client.1.smithi115.stdout:0/864: truncate d6/d10/d12/d31/d35/d44/fa7 961199 0 2024-04-16T14:35:48.465 INFO:tasks.workunit.client.1.smithi115.stdout:6/943: creat d13/d1d/d2b/df4/f136 x:0 0 0 2024-04-16T14:35:48.473 INFO:tasks.workunit.client.1.smithi115.stdout:6/944: dread d13/d1d/d49/f70 [0,4194304] 0 2024-04-16T14:35:48.475 INFO:tasks.workunit.client.1.smithi115.stdout:6/945: mkdir d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96/dbc/d137 0 2024-04-16T14:35:48.475 INFO:tasks.workunit.client.1.smithi115.stdout:6/946: truncate d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96/de4/f120 3261643 0 2024-04-16T14:35:48.484 INFO:tasks.workunit.client.1.smithi115.stdout:6/947: write d13/d1d/d68/fa0 [3484533,57114] 0 2024-04-16T14:35:48.485 INFO:tasks.workunit.client.1.smithi115.stdout:6/948: chown d13/d1d/d2b/d5f/c51 13007162 1 2024-04-16T14:35:48.485 INFO:tasks.workunit.client.1.smithi115.stdout:6/949: dread - d13/d1d/d52/feb zero size 2024-04-16T14:35:48.485 INFO:tasks.workunit.client.1.smithi115.stdout:6/950: fsync d13/d1d/d2b/d5f/d30/d43/f135 0 2024-04-16T14:35:48.486 INFO:tasks.workunit.client.1.smithi115.stdout:0/865: dwrite d6/d30/f43 [0,4194304] 0 2024-04-16T14:35:48.487 INFO:tasks.workunit.client.1.smithi115.stdout:0/866: symlink d6/d1b/l12d 0 2024-04-16T14:35:48.489 INFO:tasks.workunit.client.1.smithi115.stdout:0/867: getdents d6/d10/d12/d31/d35 0 2024-04-16T14:35:48.490 INFO:tasks.workunit.client.1.smithi115.stdout:0/868: chown d6/d10/c15 31928 1 2024-04-16T14:35:48.491 INFO:tasks.workunit.client.1.smithi115.stdout:0/869: mkdir d6/d12e 0 2024-04-16T14:35:48.499 INFO:tasks.workunit.client.1.smithi115.stdout:0/870: dread d6/d10/d12/d31/d35/d9b/f49 [0,4194304] 0 2024-04-16T14:35:48.499 INFO:tasks.workunit.client.1.smithi115.stdout:0/871: chown d6/d30/d4d/f11f 118 1 2024-04-16T14:35:48.501 INFO:tasks.workunit.client.1.smithi115.stdout:6/951: dwrite d13/d1d/d2b/df4/f107 [0,4194304] 0 2024-04-16T14:35:48.505 INFO:tasks.workunit.client.1.smithi115.stdout:6/952: symlink d13/d1d/d2b/df4/d112/l138 0 2024-04-16T14:35:48.506 INFO:tasks.workunit.client.1.smithi115.stdout:0/872: rename d6/d1b/d4e to d6/d30/d4d/de5/d12f 0 2024-04-16T14:35:48.508 INFO:tasks.workunit.client.1.smithi115.stdout:0/873: symlink d6/d10/d12/d31/d35/d44/l130 0 2024-04-16T14:35:48.508 INFO:tasks.workunit.client.1.smithi115.stdout:0/874: chown d6/d10/d12/f14 255 1 2024-04-16T14:35:48.510 INFO:tasks.workunit.client.1.smithi115.stdout:0/875: unlink d6/d30/cbc 0 2024-04-16T14:35:48.510 INFO:tasks.workunit.client.1.smithi115.stdout:0/876: chown d6/d30/d4d/df0/d10c/dbe/d12c 27081 1 2024-04-16T14:35:48.511 INFO:tasks.workunit.client.1.smithi115.stdout:6/953: dread d13/d1d/d87/f126 [0,4194304] 0 2024-04-16T14:35:48.512 INFO:tasks.workunit.client.1.smithi115.stdout:6/954: chown d13/d1d/d52/c92 1348997 1 2024-04-16T14:35:48.512 INFO:tasks.workunit.client.1.smithi115.stdout:0/877: rename d6/d10/d12/d1f/d36/lfe to d6/d10/dc8/l131 0 2024-04-16T14:35:48.513 INFO:tasks.workunit.client.1.smithi115.stdout:6/955: mknod d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/d5a/dcb/c139 0 2024-04-16T14:35:48.514 INFO:tasks.workunit.client.1.smithi115.stdout:6/956: rename d13/d1d/d49/d128 to d13/d1d/d49/d13a 0 2024-04-16T14:35:48.515 INFO:tasks.workunit.client.1.smithi115.stdout:6/957: getdents d13/d1d/d2b 0 2024-04-16T14:35:48.518 INFO:tasks.workunit.client.1.smithi115.stdout:4/993: sync 2024-04-16T14:35:48.518 INFO:tasks.workunit.client.1.smithi115.stdout:7/906: sync 2024-04-16T14:35:48.518 INFO:tasks.workunit.client.1.smithi115.stdout:4/994: fdatasync d1/f68 0 2024-04-16T14:35:48.518 INFO:tasks.workunit.client.1.smithi115.stdout:4/995: fsync d1/d15/f4d 0 2024-04-16T14:35:48.519 INFO:tasks.workunit.client.1.smithi115.stdout:4/996: unlink d1/d15/d31/d42/da4/f130 0 2024-04-16T14:35:48.521 INFO:tasks.workunit.client.1.smithi115.stdout:4/997: unlink d1/d15/d24/dc6/l10c 0 2024-04-16T14:35:48.522 INFO:tasks.workunit.client.1.smithi115.stdout:6/958: dread d13/d1d/d2b/d5f/f4b [0,4194304] 0 2024-04-16T14:35:48.522 INFO:tasks.workunit.client.1.smithi115.stdout:4/998: creat d1/d15/d31/d42/da4/f136 x:0 0 0 2024-04-16T14:35:48.523 INFO:tasks.workunit.client.1.smithi115.stdout:6/959: symlink d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/d63/l13b 0 2024-04-16T14:35:48.524 INFO:tasks.workunit.client.1.smithi115.stdout:4/999: creat d1/d15/f137 x:0 0 0 2024-04-16T14:35:48.526 INFO:tasks.workunit.client.1.smithi115.stdout:6/960: dread d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96/d55/fcc [0,4194304] 0 2024-04-16T14:35:48.527 INFO:tasks.workunit.client.1.smithi115.stdout:7/907: dread d0/d2/d3a/d30/f32 [0,4194304] 0 2024-04-16T14:35:48.527 INFO:tasks.workunit.client.1.smithi115.stdout:6/961: truncate d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/d63/fc5 4061475 0 2024-04-16T14:35:48.527 INFO:tasks.workunit.client.1.smithi115.stdout:6/962: write d13/d1d/d52/feb [277331,30629] 0 2024-04-16T14:35:48.528 INFO:tasks.workunit.client.1.smithi115.stdout:7/908: symlink d0/d2/d3a/d30/d79/l133 0 2024-04-16T14:35:48.528 INFO:tasks.workunit.client.1.smithi115.stdout:7/909: dread - d0/d24/d40/df0/ff1 zero size 2024-04-16T14:35:48.530 INFO:tasks.workunit.client.1.smithi115.stdout:6/963: creat d13/d1d/d2b/d5f/d30/d43/f13c x:0 0 0 2024-04-16T14:35:48.545 INFO:tasks.workunit.client.1.smithi115.stdout:7/910: dwrite d0/d2/d3a/fab [0,4194304] 0 2024-04-16T14:35:48.546 INFO:tasks.workunit.client.1.smithi115.stdout:7/911: fdatasync d0/d2/f35 0 2024-04-16T14:35:48.546 INFO:tasks.workunit.client.1.smithi115.stdout:7/912: dread - d0/d24/da3/db1/f105 zero size 2024-04-16T14:35:48.547 INFO:tasks.workunit.client.1.smithi115.stdout:7/913: link d0/d2/d3a/l52 d0/d2/d3a/d30/d79/d95/dec/d107/l134 0 2024-04-16T14:35:48.547 INFO:tasks.workunit.client.1.smithi115.stdout:7/914: fdatasync d0/d2/d3a/d30/d6b/da2/feb 0 2024-04-16T14:35:48.548 INFO:tasks.workunit.client.1.smithi115.stdout:7/915: truncate d0/d2/d3a/d30/d6b/f87 3187361 0 2024-04-16T14:35:48.553 INFO:tasks.workunit.client.1.smithi115.stdout:7/916: dread d0/d2/d3a/d30/d6b/da2/d81/fa6 [0,4194304] 0 2024-04-16T14:35:48.553 INFO:tasks.workunit.client.1.smithi115.stdout:7/917: write d0/d2/d3a/d30/d79/dd2/fa1 [331956,85411] 0 2024-04-16T14:35:48.570 INFO:tasks.workunit.client.1.smithi115.stdout:7/918: dwrite d0/d24/da3/db1/d5a/f11e [4194304,4194304] 0 2024-04-16T14:35:48.572 INFO:tasks.workunit.client.1.smithi115.stdout:7/919: unlink d0/d2/d3a/d30/d79/d95/c9f 0 2024-04-16T14:35:48.572 INFO:tasks.workunit.client.1.smithi115.stdout:7/920: creat d0/d2/d3a/d30/d79/d95/d10c/dbc/f135 x:0 0 0 2024-04-16T14:35:48.578 INFO:tasks.workunit.client.1.smithi115.stdout:7/921: rename d0/d2/d3a/d30/d79/d95/dec to d0/d2/d3a/d30/d79/dd2/d64/de8/d136 0 2024-04-16T14:35:48.579 INFO:tasks.workunit.client.0.smithi005.stdout:2/915: sync 2024-04-16T14:35:48.580 INFO:tasks.workunit.client.0.smithi005.stdout:2/916: symlink d0/d1c/d39/dcb/l13a 0 2024-04-16T14:35:48.581 INFO:tasks.workunit.client.1.smithi115.stdout:7/922: truncate d0/d2/d3a/f33 746375 0 2024-04-16T14:35:48.581 INFO:tasks.workunit.client.1.smithi115.stdout:6/964: dwrite d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96/f9f [0,4194304] 0 2024-04-16T14:35:48.582 INFO:tasks.workunit.client.1.smithi115.stdout:6/965: read d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/f10b [151810,95594] 0 2024-04-16T14:35:48.582 INFO:tasks.workunit.client.1.smithi115.stdout:6/966: creat d13/d1d/d2b/df4/d112/d114/d11a/f13d x:0 0 0 2024-04-16T14:35:48.582 INFO:tasks.workunit.client.1.smithi115.stdout:6/967: readlink d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/l7b 0 2024-04-16T14:35:48.583 INFO:tasks.workunit.client.0.smithi005.stdout:2/917: unlink d0/d1c/d59/d7a/d84/fe4 0 2024-04-16T14:35:48.583 INFO:tasks.workunit.client.0.smithi005.stdout:2/918: creat d0/d1c/d59/d67/d12e/f13b x:0 0 0 2024-04-16T14:35:48.584 INFO:tasks.workunit.client.1.smithi115.stdout:7/923: dread d0/d2/d3a/dac/da7/fe5 [0,4194304] 0 2024-04-16T14:35:48.584 INFO:tasks.workunit.client.1.smithi115.stdout:7/924: write d0/d24/d40/df0/d11d/f7d [3640454,23597] 0 2024-04-16T14:35:48.586 INFO:tasks.workunit.client.1.smithi115.stdout:7/925: unlink d0/d2/f35 0 2024-04-16T14:35:48.588 INFO:tasks.workunit.client.1.smithi115.stdout:5/941: sync 2024-04-16T14:35:48.590 INFO:tasks.workunit.client.0.smithi005.stdout:2/919: read d0/f27 [1420553,25269] 0 2024-04-16T14:35:48.592 INFO:tasks.workunit.client.1.smithi115.stdout:6/968: write d13/d1d/d2b/d5f/d30/f9e [1350472,44141] 0 2024-04-16T14:35:48.593 INFO:tasks.workunit.client.1.smithi115.stdout:6/969: readlink d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/d5a/dcb/ldf 0 2024-04-16T14:35:48.593 INFO:tasks.workunit.client.1.smithi115.stdout:6/970: creat d13/d1d/d52/f13e x:0 0 0 2024-04-16T14:35:48.610 INFO:tasks.workunit.client.1.smithi115.stdout:5/942: dwrite dc/d15/d35/d69/fdc [0,4194304] 0 2024-04-16T14:35:48.619 INFO:tasks.workunit.client.1.smithi115.stdout:6/971: dwrite d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/f108 [0,4194304] 0 2024-04-16T14:35:48.619 INFO:tasks.workunit.client.1.smithi115.stdout:7/926: dwrite d0/d24/f4a [4194304,4194304] 0 2024-04-16T14:35:48.621 INFO:tasks.workunit.client.1.smithi115.stdout:6/972: dread d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96/d55/fcc [0,4194304] 0 2024-04-16T14:35:48.622 INFO:tasks.workunit.client.1.smithi115.stdout:6/973: symlink d13/d1d/d2b/d5f/d30/d43/d2c/l13f 0 2024-04-16T14:35:48.626 INFO:tasks.workunit.client.0.smithi005.stdout:2/920: dwrite d0/d1c/d59/d7a/d84/f9f [0,4194304] 0 2024-04-16T14:35:48.629 INFO:tasks.workunit.client.1.smithi115.stdout:7/927: dread d0/d24/fb3 [0,4194304] 0 2024-04-16T14:35:48.629 INFO:tasks.workunit.client.1.smithi115.stdout:5/943: dwrite dc/d3d/f7f [0,4194304] 0 2024-04-16T14:35:48.631 INFO:tasks.workunit.client.1.smithi115.stdout:5/944: unlink dc/d3d/d68/d7b/lb1 0 2024-04-16T14:35:48.633 INFO:tasks.workunit.client.0.smithi005.stdout:2/921: rmdir d0/d1c/d59/d67/d12e 39 2024-04-16T14:35:48.634 INFO:tasks.workunit.client.1.smithi115.stdout:7/928: rename d0/d24/l8e to d0/d2/d3a/d30/d6b/da2/d81/dd0/l137 0 2024-04-16T14:35:48.635 INFO:tasks.workunit.client.1.smithi115.stdout:5/945: symlink dc/d15/d2d/d8c/d101/l116 0 2024-04-16T14:35:48.636 INFO:tasks.workunit.client.1.smithi115.stdout:7/929: creat d0/d2/d3a/d30/d6b/da2/f138 x:0 0 0 2024-04-16T14:35:48.637 INFO:tasks.workunit.client.1.smithi115.stdout:5/946: stat dc/d15/d2d/d8c/d101/l107 0 2024-04-16T14:35:48.639 INFO:tasks.workunit.client.1.smithi115.stdout:7/930: link d0/d2/d3a/dac/cc2 d0/d2/d3a/d30/d6b/c139 0 2024-04-16T14:35:48.642 INFO:tasks.workunit.client.1.smithi115.stdout:6/974: dwrite d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/d63/fb9 [0,4194304] 0 2024-04-16T14:35:48.643 INFO:tasks.workunit.client.0.smithi005.stdout:2/922: write d0/f9d [1424499,108778] 0 2024-04-16T14:35:48.646 INFO:tasks.workunit.client.0.smithi005.stdout:2/923: dread d0/d1c/d8d/fa9 [0,4194304] 0 2024-04-16T14:35:48.647 INFO:tasks.workunit.client.0.smithi005.stdout:2/924: symlink d0/d29/d89/l13c 0 2024-04-16T14:35:48.651 INFO:tasks.workunit.client.1.smithi115.stdout:6/975: unlink d13/d1d/d68/fa2 0 2024-04-16T14:35:48.652 INFO:tasks.workunit.client.1.smithi115.stdout:7/931: getdents d0/d2/d3a/d30/d6b/da2 0 2024-04-16T14:35:48.652 INFO:tasks.workunit.client.1.smithi115.stdout:7/932: chown d0/d2/d3a/d30 0 1 2024-04-16T14:35:48.653 INFO:tasks.workunit.client.1.smithi115.stdout:5/947: dwrite dc/d15/d4d/dde/df1/ffa [0,4194304] 0 2024-04-16T14:35:48.654 INFO:tasks.workunit.client.1.smithi115.stdout:6/976: creat d13/d1d/d49/d13a/f140 x:0 0 0 2024-04-16T14:35:48.655 INFO:tasks.workunit.client.0.smithi005.stdout:9/986: sync 2024-04-16T14:35:48.657 INFO:tasks.workunit.client.1.smithi115.stdout:5/948: mkdir dc/d15/d35/d69/dad/d117 0 2024-04-16T14:35:48.659 INFO:tasks.workunit.client.1.smithi115.stdout:6/977: mknod d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96/de4/c141 0 2024-04-16T14:35:48.659 INFO:tasks.workunit.client.1.smithi115.stdout:0/878: sync 2024-04-16T14:35:48.660 INFO:tasks.workunit.client.1.smithi115.stdout:5/949: symlink dc/d15/d35/l118 0 2024-04-16T14:35:48.661 INFO:tasks.workunit.client.1.smithi115.stdout:5/950: write dc/d15/d4d/dde/df0/ffd [943584,80913] 0 2024-04-16T14:35:48.663 INFO:tasks.workunit.client.1.smithi115.stdout:0/879: mkdir d6/d10/d12/d31/d35/d132 0 2024-04-16T14:35:48.673 INFO:tasks.workunit.client.1.smithi115.stdout:0/880: dread d6/fb [0,4194304] 0 2024-04-16T14:35:48.673 INFO:tasks.workunit.client.0.smithi005.stdout:9/987: write d3/d49/d4b/d5c/d65/f8d [2499929,7866] 0 2024-04-16T14:35:48.673 INFO:tasks.workunit.client.0.smithi005.stdout:9/988: chown d3/d49/d4b/d5c/d65/ldf 1 1 2024-04-16T14:35:48.674 INFO:tasks.workunit.client.0.smithi005.stdout:9/989: mknod d3/d49/d4b/d5c/d65/d9a/daf/c127 0 2024-04-16T14:35:48.674 INFO:tasks.workunit.client.1.smithi115.stdout:0/881: mkdir d6/d10/d12/d1f/ded/df6/d126/dfc/d133 0 2024-04-16T14:35:48.675 INFO:tasks.workunit.client.1.smithi115.stdout:5/951: dread dc/d15/f78 [0,4194304] 0 2024-04-16T14:35:48.675 INFO:tasks.workunit.client.1.smithi115.stdout:0/882: unlink d6/l12a 0 2024-04-16T14:35:48.676 INFO:tasks.workunit.client.0.smithi005.stdout:9/990: unlink d3/d12/d16/d117/l11a 0 2024-04-16T14:35:48.676 INFO:tasks.workunit.client.0.smithi005.stdout:9/991: symlink d3/dd5/l128 0 2024-04-16T14:35:48.677 INFO:tasks.workunit.client.0.smithi005.stdout:9/992: symlink d3/d12/d16/d46/l129 0 2024-04-16T14:35:48.678 INFO:tasks.workunit.client.1.smithi115.stdout:5/952: creat dc/d8e/d10f/f119 x:0 0 0 2024-04-16T14:35:48.678 INFO:tasks.workunit.client.1.smithi115.stdout:5/953: dread - dc/d8e/d10f/f119 zero size 2024-04-16T14:35:48.678 INFO:tasks.workunit.client.1.smithi115.stdout:5/954: dread - dc/d8e/fcf zero size 2024-04-16T14:35:48.678 INFO:tasks.workunit.client.1.smithi115.stdout:5/955: fsync dc/d5d/d81/f9d 0 2024-04-16T14:35:48.678 INFO:tasks.workunit.client.1.smithi115.stdout:5/956: chown dc/d3d/f6a 1445888695 1 2024-04-16T14:35:48.678 INFO:tasks.workunit.client.1.smithi115.stdout:5/957: write dc/d3d/d68/d7b/f84 [1574208,37106] 0 2024-04-16T14:35:48.678 INFO:tasks.workunit.client.1.smithi115.stdout:0/883: mknod d6/d10/d12/d1f/ded/c134 0 2024-04-16T14:35:48.678 INFO:tasks.workunit.client.1.smithi115.stdout:5/958: mkdir dc/d15/d2d/d8c/d11a 0 2024-04-16T14:35:48.678 INFO:tasks.workunit.client.1.smithi115.stdout:5/959: creat dc/d15/d35/f11b x:0 0 0 2024-04-16T14:35:48.679 INFO:tasks.workunit.client.1.smithi115.stdout:0/884: rename d6/d10/d12/d1f/d36/d4b/d6d/l9e to d6/d10/d12/d1f/ded/l135 0 2024-04-16T14:35:48.680 INFO:tasks.workunit.client.1.smithi115.stdout:0/885: fsync d6/d10/d12/d1f/d36/d4b/d70/d8a/f122 0 2024-04-16T14:35:48.680 INFO:tasks.workunit.client.1.smithi115.stdout:6/978: dwrite d13/d1d/d2b/d5f/f4b [0,4194304] 0 2024-04-16T14:35:48.680 INFO:tasks.workunit.client.1.smithi115.stdout:6/979: chown d13/d1d/d2b/d5f/d30/d43/d2c/fd0 1280559091 1 2024-04-16T14:35:48.680 INFO:tasks.workunit.client.1.smithi115.stdout:5/960: creat dc/d3d/f11c x:0 0 0 2024-04-16T14:35:48.683 INFO:tasks.workunit.client.1.smithi115.stdout:6/980: mknod d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/c142 0 2024-04-16T14:35:48.683 INFO:tasks.workunit.client.0.smithi005.stdout:9/993: dread d3/d12/f52 [0,4194304] 0 2024-04-16T14:35:48.683 INFO:tasks.workunit.client.0.smithi005.stdout:2/925: dwrite d0/d1c/d39/d85/da2/db0/fe2 [0,4194304] 0 2024-04-16T14:35:48.683 INFO:tasks.workunit.client.0.smithi005.stdout:2/926: dread - d0/d1c/d39/f11f zero size 2024-04-16T14:35:48.684 INFO:tasks.workunit.client.1.smithi115.stdout:5/961: mknod dc/d5d/d115/c11d 0 2024-04-16T14:35:48.685 INFO:tasks.workunit.client.0.smithi005.stdout:2/927: creat d0/d1c/d59/d67/d12e/d3a/d46/dd8/f13d x:0 0 0 2024-04-16T14:35:48.686 INFO:tasks.workunit.client.1.smithi115.stdout:0/886: rename d6/d10/d12/f19 to d6/d30/d4d/df0/d10c/dbe/f136 0 2024-04-16T14:35:48.687 INFO:tasks.workunit.client.0.smithi005.stdout:2/928: symlink d0/l13e 0 2024-04-16T14:35:48.691 INFO:tasks.workunit.client.1.smithi115.stdout:6/981: creat d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96/dbc/f143 x:0 0 0 2024-04-16T14:35:48.691 INFO:tasks.workunit.client.1.smithi115.stdout:6/982: fsync d13/d1d/d2b/d5f/d30/d43/d2c/f39 0 2024-04-16T14:35:48.691 INFO:tasks.workunit.client.1.smithi115.stdout:5/962: creat dc/d3d/d68/d7b/f11e x:0 0 0 2024-04-16T14:35:48.692 INFO:tasks.workunit.client.1.smithi115.stdout:6/983: chown d13/d1d/d2b/d5f/lf2 1 1 2024-04-16T14:35:48.692 INFO:tasks.workunit.client.0.smithi005.stdout:2/929: rename d0/d1c/d59/d67/d12e/d3a/f7e to d0/d29/f13f 0 2024-04-16T14:35:48.692 INFO:tasks.workunit.client.0.smithi005.stdout:2/930: rename d0/d4 to d0/d4/d140 22 2024-04-16T14:35:48.698 INFO:tasks.workunit.client.0.smithi005.stdout:9/994: dwrite d3/f7 [0,4194304] 0 2024-04-16T14:35:48.698 INFO:tasks.workunit.client.0.smithi005.stdout:9/995: stat d3/d49/d4b/d55/d7b/cb2 0 2024-04-16T14:35:48.700 INFO:tasks.workunit.client.1.smithi115.stdout:6/984: dread d13/f7f [4194304,4194304] 0 2024-04-16T14:35:48.701 INFO:tasks.workunit.client.1.smithi115.stdout:6/985: link d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/d63/l110 d13/d1d/d2b/d5f/d30/d43/l144 0 2024-04-16T14:35:48.715 INFO:tasks.workunit.client.1.smithi115.stdout:6/986: read d13/d1d/d2b/d5f/fa8 [4101779,44251] 0 2024-04-16T14:35:48.716 INFO:tasks.workunit.client.1.smithi115.stdout:6/987: stat d13/d1d/d2b/d5f/l3e 0 2024-04-16T14:35:48.717 INFO:tasks.workunit.client.0.smithi005.stdout:2/931: dwrite d0/d29/d89/de3/fea [0,4194304] 0 2024-04-16T14:35:48.717 INFO:tasks.workunit.client.0.smithi005.stdout:2/932: write d0/d29/d89/f105 [434195,79654] 0 2024-04-16T14:35:48.717 INFO:tasks.workunit.client.0.smithi005.stdout:9/996: dwrite d3/f3c [4194304,4194304] 0 2024-04-16T14:35:48.725 INFO:tasks.workunit.client.0.smithi005.stdout:2/933: dread d0/d29/d3e/dd2/de8/ff0 [0,4194304] 0 2024-04-16T14:35:48.725 INFO:tasks.workunit.client.0.smithi005.stdout:2/934: fdatasync d0/d29/f11e 0 2024-04-16T14:35:48.725 INFO:tasks.workunit.client.0.smithi005.stdout:2/935: write d0/d1c/d59/d67/d12e/f13b [1018990,29750] 0 2024-04-16T14:35:48.726 INFO:tasks.workunit.client.0.smithi005.stdout:2/936: symlink d0/d1c/d59/d7a/d84/df8/l141 0 2024-04-16T14:35:48.726 INFO:tasks.workunit.client.0.smithi005.stdout:2/937: fsync d0/d29/d89/feb 0 2024-04-16T14:35:48.726 INFO:tasks.workunit.client.0.smithi005.stdout:2/938: fdatasync d0/d4/f3c 0 2024-04-16T14:35:48.726 INFO:tasks.workunit.client.0.smithi005.stdout:2/939: creat d0/d1c/d39/d85/da2/db0/f142 x:0 0 0 2024-04-16T14:35:48.727 INFO:tasks.workunit.client.0.smithi005.stdout:2/940: creat d0/d1c/d59/f143 x:0 0 0 2024-04-16T14:35:48.727 INFO:tasks.workunit.client.0.smithi005.stdout:2/941: truncate d0/d1c/d39/d85/f104 13937 0 2024-04-16T14:35:48.727 INFO:tasks.workunit.client.0.smithi005.stdout:2/942: readlink d0/d1c/d39/d48/lf9 0 2024-04-16T14:35:48.727 INFO:tasks.workunit.client.0.smithi005.stdout:2/943: write d0/d1c/d59/d67/d12e/d3a/f11c [266400,122964] 0 2024-04-16T14:35:48.728 INFO:tasks.workunit.client.1.smithi115.stdout:6/988: write d13/f8e [737000,124505] 0 2024-04-16T14:35:48.728 INFO:tasks.workunit.client.0.smithi005.stdout:2/944: mknod d0/d1c/d59/d67/d103/c144 0 2024-04-16T14:35:48.728 INFO:tasks.workunit.client.1.smithi115.stdout:6/989: symlink d13/d1d/d2b/d5f/d30/d43/l145 0 2024-04-16T14:35:48.728 INFO:tasks.workunit.client.1.smithi115.stdout:6/990: readlink d13/d1d/d2b/d5f/d30/d43/d2c/l3d 0 2024-04-16T14:35:48.730 INFO:tasks.workunit.client.1.smithi115.stdout:6/991: rename d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/c31 to d13/d1d/d49/ded/c146 0 2024-04-16T14:35:48.730 INFO:tasks.workunit.client.1.smithi115.stdout:6/992: chown d13/d1d/d68/f9a 6497403 1 2024-04-16T14:35:48.730 INFO:tasks.workunit.client.1.smithi115.stdout:6/993: write d13/d1d/d68/fc6 [501384,67006] 0 2024-04-16T14:35:48.738 INFO:tasks.workunit.client.0.smithi005.stdout:2/945: dwrite d0/f11d [0,4194304] 0 2024-04-16T14:35:48.739 INFO:tasks.workunit.client.1.smithi115.stdout:6/994: read d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/d96/f23 [3211245,84382] 0 2024-04-16T14:35:48.739 INFO:tasks.workunit.client.1.smithi115.stdout:6/995: truncate d13/f5e 168250 0 2024-04-16T14:35:48.740 INFO:tasks.workunit.client.0.smithi005.stdout:2/946: creat d0/d29/d89/f145 x:0 0 0 2024-04-16T14:35:48.741 INFO:tasks.workunit.client.1.smithi115.stdout:6/996: symlink d13/d1d/d49/ded/l147 0 2024-04-16T14:35:48.763 INFO:tasks.workunit.client.0.smithi005.stdout:2/947: dwrite d0/d1c/d59/d67/d12e/fa8 [0,4194304] 0 2024-04-16T14:35:48.778 INFO:tasks.workunit.client.0.smithi005.stdout:2/948: dwrite d0/d1c/d59/d7a/d84/f120 [0,4194304] 0 2024-04-16T14:35:48.783 INFO:tasks.workunit.client.0.smithi005.stdout:2/949: mkdir d0/d1c/d59/d67/d12e/d3a/d146 0 2024-04-16T14:35:48.783 INFO:tasks.workunit.client.0.smithi005.stdout:2/950: truncate d0/d1c/f119 729547 0 2024-04-16T14:35:48.784 INFO:tasks.workunit.client.0.smithi005.stdout:2/951: stat d0/d4/d2b/d5e/d9a/fac 0 2024-04-16T14:35:48.791 INFO:tasks.workunit.client.0.smithi005.stdout:2/952: dwrite d0/d1c/d59/d67/d12e/fff [0,4194304] 0 2024-04-16T14:35:48.791 INFO:tasks.workunit.client.0.smithi005.stdout:2/953: dread - d0/d4/d2b/d5e/d9a/fcd zero size 2024-04-16T14:35:48.801 INFO:tasks.workunit.client.0.smithi005.stdout:2/954: creat d0/d1c/f147 x:0 0 0 2024-04-16T14:35:48.801 INFO:tasks.workunit.client.0.smithi005.stdout:2/955: rmdir d0/d4 39 2024-04-16T14:35:48.801 INFO:tasks.workunit.client.0.smithi005.stdout:2/956: fdatasync d0/d1c/d59/d67/d12e/f13b 0 2024-04-16T14:35:48.801 INFO:tasks.workunit.client.0.smithi005.stdout:2/957: stat d0/d1c/fde 0 2024-04-16T14:35:48.801 INFO:tasks.workunit.client.0.smithi005.stdout:2/958: write d0/f9d [2260841,28676] 0 2024-04-16T14:35:48.801 INFO:tasks.workunit.client.0.smithi005.stdout:2/959: rmdir d0/d4/d2b/d5e 39 2024-04-16T14:35:48.801 INFO:tasks.workunit.client.0.smithi005.stdout:2/960: symlink d0/d1c/d59/d7a/d84/df8/l148 0 2024-04-16T14:35:48.802 INFO:tasks.workunit.client.1.smithi115.stdout:7/933: sync 2024-04-16T14:35:48.803 INFO:tasks.workunit.client.1.smithi115.stdout:7/934: creat d0/d2/d3a/f13a x:0 0 0 2024-04-16T14:35:48.807 INFO:tasks.workunit.client.0.smithi005.stdout:2/961: dwrite d0/d4/f137 [0,4194304] 0 2024-04-16T14:35:48.811 INFO:tasks.workunit.client.0.smithi005.stdout:2/962: mkdir d0/d149 0 2024-04-16T14:35:48.811 INFO:tasks.workunit.client.0.smithi005.stdout:2/963: chown d0/d29/d89/de3 0 1 2024-04-16T14:35:48.817 INFO:tasks.workunit.client.1.smithi115.stdout:7/935: dwrite d0/d2/d3a/f10a [0,4194304] 0 2024-04-16T14:35:48.819 INFO:tasks.workunit.client.1.smithi115.stdout:7/936: symlink d0/d24/da3/db1/d3f/l13b 0 2024-04-16T14:35:48.819 INFO:tasks.workunit.client.1.smithi115.stdout:7/937: chown d0/d24/d40/df0/d11d/fad 752917 1 2024-04-16T14:35:48.820 INFO:tasks.workunit.client.1.smithi115.stdout:7/938: mkdir d0/d24/da3/ded/d13c 0 2024-04-16T14:35:48.823 INFO:tasks.workunit.client.1.smithi115.stdout:7/939: write d0/d24/d40/f6a [483911,84090] 0 2024-04-16T14:35:48.823 INFO:tasks.workunit.client.0.smithi005.stdout:2/964: dwrite d0/d1c/d59/f92 [0,4194304] 0 2024-04-16T14:35:48.831 INFO:tasks.workunit.client.0.smithi005.stdout:2/965: rmdir d0/d1c/d59/d67/d12e/d3a/d46/dd8 39 2024-04-16T14:35:48.835 INFO:tasks.workunit.client.0.smithi005.stdout:2/966: getdents d0/d4/d2b 0 2024-04-16T14:35:48.836 INFO:tasks.workunit.client.0.smithi005.stdout:2/967: write d0/d29/d3e/ff2 [4134276,98721] 0 2024-04-16T14:35:48.836 INFO:tasks.workunit.client.0.smithi005.stdout:2/968: symlink d0/d1c/d39/l14a 0 2024-04-16T14:35:48.836 INFO:tasks.workunit.client.0.smithi005.stdout:2/969: mkdir d0/d1c/d39/d85/da2/d12b/d14b 0 2024-04-16T14:35:48.837 INFO:tasks.workunit.client.0.smithi005.stdout:2/970: mkdir d0/d29/d14c 0 2024-04-16T14:35:48.837 INFO:tasks.workunit.client.0.smithi005.stdout:2/971: rename d0/d1c/d39/d85/da2/ce1 to d0/d1c/d59/d7a/c14d 0 2024-04-16T14:35:48.840 INFO:tasks.workunit.client.0.smithi005.stdout:9/997: sync 2024-04-16T14:35:48.840 INFO:tasks.workunit.client.0.smithi005.stdout:9/998: truncate d3/d49/d4b/d5c/d65/d9a/daf/ffa 979760 0 2024-04-16T14:35:48.846 INFO:tasks.workunit.client.0.smithi005.stdout:2/972: rmdir d0/d1c/d59 39 2024-04-16T14:35:48.847 INFO:tasks.workunit.client.0.smithi005.stdout:2/973: rmdir d0/d1c/d39/d85/da2/db0 39 2024-04-16T14:35:48.847 INFO:tasks.workunit.client.0.smithi005.stdout:2/974: write d0/d1c/d39/d48/ffc [756375,36790] 0 2024-04-16T14:35:48.857 INFO:tasks.workunit.client.1.smithi115.stdout:7/940: dwrite d0/d24/da3/db1/d3f/db0/f54 [0,4194304] 0 2024-04-16T14:35:48.861 INFO:tasks.workunit.client.1.smithi115.stdout:7/941: write d0/d24/da3/db1/d3f/f7b [1489014,105696] 0 2024-04-16T14:35:48.861 INFO:tasks.workunit.client.1.smithi115.stdout:7/942: mkdir d0/d24/d13d 0 2024-04-16T14:35:48.861 INFO:tasks.workunit.client.1.smithi115.stdout:7/943: getdents d0/d24/d40/df0/d11d 0 2024-04-16T14:35:48.862 INFO:tasks.workunit.client.1.smithi115.stdout:7/944: mkdir d0/d2/d3a/dda/d13e 0 2024-04-16T14:35:48.863 INFO:tasks.workunit.client.0.smithi005.stdout:2/975: dread d0/f9d [0,4194304] 0 2024-04-16T14:35:48.863 INFO:tasks.workunit.client.0.smithi005.stdout:2/976: link d0/d1c/d59/d67/d12e/d3a/d46/dd8/cc6 d0/d29/d89/de3/c14e 0 2024-04-16T14:35:48.863 INFO:tasks.workunit.client.0.smithi005.stdout:2/977: readlink d0/d1c/d59/d67/l133 0 2024-04-16T14:35:48.863 INFO:tasks.workunit.client.0.smithi005.stdout:2/978: fdatasync d0/f9d 0 2024-04-16T14:35:48.863 INFO:tasks.workunit.client.0.smithi005.stdout:2/979: rename d0/c8f to d0/d29/d89/de3/c14f 0 2024-04-16T14:35:48.863 INFO:tasks.workunit.client.0.smithi005.stdout:2/980: dread d0/d1c/d39/d85/da2/db0/fe2 [0,4194304] 0 2024-04-16T14:35:48.863 INFO:tasks.workunit.client.0.smithi005.stdout:2/981: getdents d0/d1c/d59/d7a/d84 0 2024-04-16T14:35:48.864 INFO:tasks.workunit.client.0.smithi005.stdout:2/982: dread d0/d4/d2b/d5e/d9a/fac [0,4194304] 0 2024-04-16T14:35:48.864 INFO:tasks.workunit.client.0.smithi005.stdout:2/983: creat d0/d1c/d59/d67/d12e/d3a/f150 x:0 0 0 2024-04-16T14:35:48.865 INFO:tasks.workunit.client.0.smithi005.stdout:2/984: write d0/d1c/d59/d67/d12e/f13b [519918,41050] 0 2024-04-16T14:35:48.865 INFO:tasks.workunit.client.0.smithi005.stdout:2/985: symlink d0/d4/d2b/d5e/d125/l151 0 2024-04-16T14:35:48.865 INFO:tasks.workunit.client.0.smithi005.stdout:2/986: read d0/d29/d89/de3/f102 [54860,59202] 0 2024-04-16T14:35:48.865 INFO:tasks.workunit.client.0.smithi005.stdout:2/987: fsync d0/d1c/d59/d7a/d84/f120 0 2024-04-16T14:35:48.866 INFO:tasks.workunit.client.0.smithi005.stdout:2/988: creat d0/d4/d2b/d5e/f152 x:0 0 0 2024-04-16T14:35:48.889 INFO:tasks.workunit.client.0.smithi005.stdout:2/989: dwrite d0/d29/d3e/dd2/de8/ff0 [0,4194304] 0 2024-04-16T14:35:48.916 INFO:tasks.workunit.client.0.smithi005.stdout:2/990: dwrite d0/d29/d3e/f57 [0,4194304] 0 2024-04-16T14:35:48.916 INFO:tasks.workunit.client.0.smithi005.stdout:2/991: dread - d0/d1c/f147 zero size 2024-04-16T14:35:48.917 INFO:tasks.workunit.client.0.smithi005.stdout:2/992: rename d0/d1c/d59/f143 to d0/d4/f153 0 2024-04-16T14:35:48.919 INFO:tasks.workunit.client.0.smithi005.stdout:2/993: symlink d0/d1c/d59/d67/l154 0 2024-04-16T14:35:48.920 INFO:tasks.workunit.client.0.smithi005.stdout:2/994: creat d0/d1c/d39/f155 x:0 0 0 2024-04-16T14:35:48.920 INFO:tasks.workunit.client.0.smithi005.stdout:2/995: dread d0/d4/d2b/d5e/d9a/fac [0,4194304] 0 2024-04-16T14:35:48.920 INFO:tasks.workunit.client.0.smithi005.stdout:2/996: rename d0/d1c/d59/d7a/c14d to d0/d29/d3e/dd2/d10e/c156 0 2024-04-16T14:35:48.920 INFO:tasks.workunit.client.0.smithi005.stdout:2/997: truncate d0/d29/d3e/ff2 4877251 0 2024-04-16T14:35:48.920 INFO:tasks.workunit.client.0.smithi005.stdout:2/998: creat d0/d1c/d59/d67/d12e/d3a/d46/f157 x:0 0 0 2024-04-16T14:35:48.925 INFO:tasks.workunit.client.1.smithi115.stdout:0/887: sync 2024-04-16T14:35:48.926 INFO:tasks.workunit.client.1.smithi115.stdout:0/888: truncate d6/d10/d12/d31/d35/f59 3953639 0 2024-04-16T14:35:48.926 INFO:tasks.workunit.client.1.smithi115.stdout:0/889: mkdir d6/d10/d12/d1f/d36/d4b/dff/d100/d137 0 2024-04-16T14:35:48.931 INFO:tasks.workunit.client.0.smithi005.stdout:2/999: dwrite d0/d4/d2b/f72 [0,4194304] 0 2024-04-16T14:35:48.949 INFO:tasks.workunit.client.1.smithi115.stdout:0/890: dwrite d6/f95 [0,4194304] 0 2024-04-16T14:35:48.950 INFO:tasks.workunit.client.1.smithi115.stdout:0/891: creat d6/d10/d12/d1f/ded/df6/d126/f138 x:0 0 0 2024-04-16T14:35:48.952 INFO:tasks.workunit.client.1.smithi115.stdout:0/892: unlink d6/d10/d12/d1f/ded/df6/d126/f138 0 2024-04-16T14:35:48.957 INFO:tasks.workunit.client.1.smithi115.stdout:5/963: sync 2024-04-16T14:35:48.957 INFO:tasks.workunit.client.1.smithi115.stdout:6/997: sync 2024-04-16T14:35:48.957 INFO:tasks.workunit.client.1.smithi115.stdout:7/945: sync 2024-04-16T14:35:48.957 INFO:tasks.workunit.client.1.smithi115.stdout:6/998: readlink d13/d1d/d2b/d5f/d30/d43/d2c/de2/d105/dfd/l9c 0 2024-04-16T14:35:48.957 INFO:tasks.workunit.client.1.smithi115.stdout:6/999: dread - d13/d1d/d2b/d5f/d30/d43/d2c/fd6 zero size 2024-04-16T14:35:48.957 INFO:tasks.workunit.client.1.smithi115.stdout:0/893: dread d6/d10/dae/fc1 [0,4194304] 0 2024-04-16T14:35:48.959 INFO:tasks.workunit.client.1.smithi115.stdout:5/964: read dc/d79/ff5 [543366,123540] 0 2024-04-16T14:35:48.959 INFO:tasks.workunit.client.1.smithi115.stdout:5/965: write dc/d3d/d41/f46 [4880810,28455] 0 2024-04-16T14:35:48.959 INFO:tasks.workunit.client.1.smithi115.stdout:0/894: creat d6/d10/d12/d1f/ded/f139 x:0 0 0 2024-04-16T14:35:48.961 INFO:tasks.workunit.client.1.smithi115.stdout:5/966: mknod dc/d5d/d115/c11f 0 2024-04-16T14:35:48.961 INFO:tasks.workunit.client.1.smithi115.stdout:5/967: write dc/d15/d35/f3f [1040659,71500] 0 2024-04-16T14:35:48.961 INFO:tasks.workunit.client.1.smithi115.stdout:5/968: write dc/d5d/dc2/fe4 [887175,70143] 0 2024-04-16T14:35:48.961 INFO:tasks.workunit.client.1.smithi115.stdout:5/969: readlink dc/l45 0 2024-04-16T14:35:48.961 INFO:tasks.workunit.client.1.smithi115.stdout:5/970: chown dc/d15/d2d/cba 82 1 2024-04-16T14:35:48.976 INFO:tasks.workunit.client.1.smithi115.stdout:5/971: dwrite dc/d15/d35/d71/f111 [0,4194304] 0 2024-04-16T14:35:48.977 INFO:tasks.workunit.client.1.smithi115.stdout:5/972: rename dc/d5d/d81/fa9 to dc/d15/d2d/f120 0 2024-04-16T14:35:48.982 INFO:tasks.workunit.client.1.smithi115.stdout:7/946: dwrite d0/d2/d3a/ff5 [0,4194304] 0 2024-04-16T14:35:48.982 INFO:tasks.workunit.client.1.smithi115.stdout:7/947: truncate d0/d2/d3a/dda/fff 687982 0 2024-04-16T14:35:48.982 INFO:tasks.workunit.client.1.smithi115.stdout:7/948: fdatasync d0/d24/da3/db1/d5a/f122 0 2024-04-16T14:35:48.982 INFO:tasks.workunit.client.1.smithi115.stdout:7/949: chown d0/d2/d3a/d30/d79/dd2/d64/de8/d136/d107/f121 257965622 1 2024-04-16T14:35:48.983 INFO:tasks.workunit.client.1.smithi115.stdout:7/950: fsync d0/d2/d3a/d30/d6b/fcb 0 2024-04-16T14:35:48.983 INFO:tasks.workunit.client.1.smithi115.stdout:7/951: creat d0/d24/d40/f13f x:0 0 0 2024-04-16T14:35:48.985 INFO:tasks.workunit.client.1.smithi115.stdout:7/952: link d0/d2/d3a/d30/d79/dd2/l3c d0/d24/d40/df4/l140 0 2024-04-16T14:35:49.002 INFO:tasks.workunit.client.1.smithi115.stdout:7/953: read d0/d2/d3a/ff5 [3697940,24996] 0 2024-04-16T14:35:49.003 INFO:tasks.workunit.client.1.smithi115.stdout:5/973: dwrite dc/d15/de6/fff [0,4194304] 0 2024-04-16T14:35:49.005 INFO:tasks.workunit.client.1.smithi115.stdout:7/954: write d0/d24/da3/db1/d3f/db0/f54 [3525491,24067] 0 2024-04-16T14:35:49.006 INFO:tasks.workunit.client.1.smithi115.stdout:7/955: mkdir d0/d24/da3/d102/d141 0 2024-04-16T14:35:49.006 INFO:tasks.workunit.client.1.smithi115.stdout:7/956: write d0/d2/d3a/d30/d79/fc4 [4536980,719] 0 2024-04-16T14:35:49.014 INFO:tasks.workunit.client.1.smithi115.stdout:5/974: dwrite dc/d3d/f42 [4194304,4194304] 0 2024-04-16T14:35:49.020 INFO:tasks.workunit.client.1.smithi115.stdout:7/957: dwrite d0/d2/d3a/d30/d79/dd2/ffb [0,4194304] 0 2024-04-16T14:35:49.032 INFO:tasks.workunit.client.1.smithi115.stdout:7/958: write d0/d24/da3/db1/d3f/f8d [801399,66857] 0 2024-04-16T14:35:49.032 INFO:tasks.workunit.client.1.smithi115.stdout:5/975: dwrite dc/d15/fea [0,4194304] 0 2024-04-16T14:35:49.033 INFO:tasks.workunit.client.1.smithi115.stdout:5/976: chown dc/d3d/d109/da3/c100 7245270 1 2024-04-16T14:35:49.035 INFO:tasks.workunit.client.1.smithi115.stdout:7/959: symlink d0/d24/da3/db1/d3f/db0/l142 0 2024-04-16T14:35:49.035 INFO:tasks.workunit.client.1.smithi115.stdout:7/960: dread - d0/d2/d3a/d30/d6b/ffc zero size 2024-04-16T14:35:49.036 INFO:tasks.workunit.client.1.smithi115.stdout:7/961: rmdir d0/d24/da3/d102/d141 0 2024-04-16T14:35:49.039 INFO:tasks.workunit.client.1.smithi115.stdout:7/962: mknod d0/d24/da3/db1/c143 0 2024-04-16T14:35:49.039 INFO:tasks.workunit.client.1.smithi115.stdout:7/963: mknod d0/d24/da3/db1/d3f/db0/c144 0 2024-04-16T14:35:49.042 INFO:tasks.workunit.client.1.smithi115.stdout:0/895: sync 2024-04-16T14:35:49.042 INFO:tasks.workunit.client.1.smithi115.stdout:0/896: rename d6/d10/c17 to d6/d10/d12/d1f/d36/d4b/dff/d100/c13a 0 2024-04-16T14:35:49.045 INFO:tasks.workunit.client.1.smithi115.stdout:0/897: creat d6/d10/d12/d31/d35/d44/d85/f13b x:0 0 0 2024-04-16T14:35:49.060 INFO:tasks.workunit.client.1.smithi115.stdout:0/898: symlink d6/d30/d4d/de5/d12f/db9/l13c 0 2024-04-16T14:35:49.061 INFO:tasks.workunit.client.1.smithi115.stdout:0/899: truncate d6/d30/d4d/df0/d10c/dbe/f136 3788870 0 2024-04-16T14:35:49.061 INFO:tasks.workunit.client.1.smithi115.stdout:0/900: creat d6/d10/d12/d31/d35/f13d x:0 0 0 2024-04-16T14:35:49.061 INFO:tasks.workunit.client.1.smithi115.stdout:5/977: dwrite dc/f65 [0,4194304] 0 2024-04-16T14:35:49.061 INFO:tasks.workunit.client.1.smithi115.stdout:5/978: unlink dc/d5d/lef 0 2024-04-16T14:35:49.061 INFO:tasks.workunit.client.1.smithi115.stdout:0/901: write d6/fb [1293279,60434] 0 2024-04-16T14:35:49.061 INFO:tasks.workunit.client.1.smithi115.stdout:0/902: mkdir d6/d30/d4d/de5/d13e 0 2024-04-16T14:35:49.061 INFO:tasks.workunit.client.1.smithi115.stdout:5/979: write dc/d15/d2d/f32 [2849736,105669] 0 2024-04-16T14:35:49.067 INFO:tasks.workunit.client.1.smithi115.stdout:7/964: dwrite d0/d2/d3a/ff2 [0,4194304] 0 2024-04-16T14:35:49.067 INFO:tasks.workunit.client.1.smithi115.stdout:7/965: creat d0/d2/d3a/d30/f145 x:0 0 0 2024-04-16T14:35:49.067 INFO:tasks.workunit.client.1.smithi115.stdout:7/966: creat d0/d2/d3a/dda/d13e/f146 x:0 0 0 2024-04-16T14:35:49.068 INFO:tasks.workunit.client.1.smithi115.stdout:7/967: truncate d0/d2/d3a/d30/d6b/fcb 124103 0 2024-04-16T14:35:49.068 INFO:tasks.workunit.client.1.smithi115.stdout:7/968: unlink d0/fa5 0 2024-04-16T14:35:49.068 INFO:tasks.workunit.client.1.smithi115.stdout:7/969: chown d0/d24/da3/d102/d10f 31 1 2024-04-16T14:35:49.068 INFO:tasks.workunit.client.1.smithi115.stdout:7/970: creat d0/d24/d40/df0/d11d/de6/f147 x:0 0 0 2024-04-16T14:35:49.074 INFO:tasks.workunit.client.1.smithi115.stdout:5/980: write dc/d15/d35/d69/f70 [3807279,107987] 0 2024-04-16T14:35:49.081 INFO:tasks.workunit.client.1.smithi115.stdout:7/971: rename d0/d2/d3a/dac/c101 to d0/d24/d40/df0/c148 0 2024-04-16T14:35:49.081 INFO:tasks.workunit.client.1.smithi115.stdout:5/981: symlink dc/d5d/l121 0 2024-04-16T14:35:49.081 INFO:tasks.workunit.client.1.smithi115.stdout:7/972: creat d0/d24/da3/db1/d3f/db0/dba/f149 x:0 0 0 2024-04-16T14:35:49.081 INFO:tasks.workunit.client.1.smithi115.stdout:5/982: mkdir dc/d15/d35/d69/dad/d117/d122 0 2024-04-16T14:35:49.081 INFO:tasks.workunit.client.1.smithi115.stdout:0/903: dwrite d6/d30/d4d/f11f [0,4194304] 0 2024-04-16T14:35:49.081 INFO:tasks.workunit.client.1.smithi115.stdout:7/973: dread d0/d2/d3a/d30/d6b/da2/fa8 [0,4194304] 0 2024-04-16T14:35:49.081 INFO:tasks.workunit.client.1.smithi115.stdout:7/974: creat d0/d2/f14a x:0 0 0 2024-04-16T14:35:49.086 INFO:tasks.workunit.client.1.smithi115.stdout:0/904: symlink d6/d10/d12/d31/d35/d44/dc9/l13f 0 2024-04-16T14:35:49.087 INFO:tasks.workunit.client.1.smithi115.stdout:7/975: rename d0/d24/d40/df0/ff1 to d0/f14b 0 2024-04-16T14:35:49.087 INFO:tasks.workunit.client.1.smithi115.stdout:7/976: mkdir d0/d1/d14c 0 2024-04-16T14:35:49.103 INFO:tasks.workunit.client.1.smithi115.stdout:7/977: dread d0/d24/da3/db1/d3f/db0/f5f [0,4194304] 0 2024-04-16T14:35:49.103 INFO:tasks.workunit.client.1.smithi115.stdout:5/983: dwrite dc/d3d/d109/fb6 [0,4194304] 0 2024-04-16T14:35:49.103 INFO:tasks.workunit.client.1.smithi115.stdout:0/905: dwrite d6/d10/d12/d1f/d36/d4b/f69 [0,4194304] 0 2024-04-16T14:35:49.104 INFO:tasks.workunit.client.1.smithi115.stdout:5/984: rmdir dc/d15/de6 39 2024-04-16T14:35:49.104 INFO:tasks.workunit.client.1.smithi115.stdout:7/978: creat d0/d2/d3a/d30/d79/dd2/d64/d109/f14d x:0 0 0 2024-04-16T14:35:49.105 INFO:tasks.workunit.client.1.smithi115.stdout:7/979: write d0/d2/d3a/f13a [171298,35721] 0 2024-04-16T14:35:49.105 INFO:tasks.workunit.client.1.smithi115.stdout:7/980: stat d0/d2/d3a/d30/d79/d95/fbf 0 2024-04-16T14:35:49.107 INFO:tasks.workunit.client.1.smithi115.stdout:5/985: creat dc/d15/d4d/f123 x:0 0 0 2024-04-16T14:35:49.107 INFO:tasks.workunit.client.1.smithi115.stdout:5/986: creat dc/d15/d4d/dde/df0/f124 x:0 0 0 2024-04-16T14:35:49.107 INFO:tasks.workunit.client.1.smithi115.stdout:5/987: creat dc/d15/d35/f125 x:0 0 0 2024-04-16T14:35:49.107 INFO:tasks.workunit.client.1.smithi115.stdout:0/906: rmdir d6/d10/d12/d1f/d36/d4b/d6d/d7a 39 2024-04-16T14:35:49.108 INFO:tasks.workunit.client.1.smithi115.stdout:0/907: write d6/d10/d12/d31/d35/f13d [193259,41861] 0 2024-04-16T14:35:49.108 INFO:tasks.workunit.client.1.smithi115.stdout:0/908: read - d6/d30/d8d/f114 zero size 2024-04-16T14:35:49.108 INFO:tasks.workunit.client.1.smithi115.stdout:0/909: readlink d6/d10/d12/d31/d35/d44/lee 0 2024-04-16T14:35:49.108 INFO:tasks.workunit.client.1.smithi115.stdout:7/981: dread d0/d2/d3a/fc0 [0,4194304] 0 2024-04-16T14:35:49.115 INFO:tasks.workunit.client.1.smithi115.stdout:5/988: symlink dc/d15/d2d/d8c/d101/l126 0 2024-04-16T14:35:49.115 INFO:tasks.workunit.client.1.smithi115.stdout:0/910: link d6/d10/d12/d31/cd0 d6/d1b/c140 0 2024-04-16T14:35:49.115 INFO:tasks.workunit.client.1.smithi115.stdout:0/911: truncate d6/d30/d4d/f11f 3761438 0 2024-04-16T14:35:49.115 INFO:tasks.workunit.client.1.smithi115.stdout:7/982: getdents d0/d2/d3a/d30/d6b/da2/d81 0 2024-04-16T14:35:49.115 INFO:tasks.workunit.client.1.smithi115.stdout:7/983: readlink d0/d2/d3a/d30/d6b/da2/d81/dd0/l137 0 2024-04-16T14:35:49.115 INFO:tasks.workunit.client.1.smithi115.stdout:7/984: symlink d0/d2/d3a/dac/d11c/l14e 0 2024-04-16T14:35:49.116 INFO:tasks.workunit.client.1.smithi115.stdout:7/985: creat d0/d2/d3a/d30/d79/dd2/f14f x:0 0 0 2024-04-16T14:35:49.116 INFO:tasks.workunit.client.1.smithi115.stdout:7/986: fdatasync d0/d2/d3a/dda/fff 0 2024-04-16T14:35:49.116 INFO:tasks.workunit.client.1.smithi115.stdout:7/987: fdatasync d0/d2/d3a/d30/d79/dd2/f14f 0 2024-04-16T14:35:49.119 INFO:tasks.workunit.client.1.smithi115.stdout:7/988: dread d0/d24/da3/f11f [0,4194304] 0 2024-04-16T14:35:49.122 INFO:tasks.workunit.client.1.smithi115.stdout:7/989: creat d0/d2/d3a/d30/d79/dd2/d64/de8/f150 x:0 0 0 2024-04-16T14:35:49.123 INFO:tasks.workunit.client.1.smithi115.stdout:7/990: mkdir d0/d24/da3/d102/d10f/d151 0 2024-04-16T14:35:49.123 INFO:tasks.workunit.client.1.smithi115.stdout:7/991: write d0/d24/da3/db1/f60 [4876925,27085] 0 2024-04-16T14:35:49.125 INFO:tasks.workunit.client.1.smithi115.stdout:7/992: mknod d0/d24/d13d/c152 0 2024-04-16T14:35:49.125 INFO:tasks.workunit.client.1.smithi115.stdout:5/989: dwrite dc/d5d/f113 [0,4194304] 0 2024-04-16T14:35:49.125 INFO:tasks.workunit.client.1.smithi115.stdout:5/990: write dc/d79/fb7 [907898,43974] 0 2024-04-16T14:35:49.128 INFO:tasks.workunit.client.0.smithi005.stdout:9/999: sync 2024-04-16T14:35:49.128 INFO:tasks.workunit.client.1.smithi115.stdout:5/991: stat dc/d15/d2d/db0/ld1 0 2024-04-16T14:35:49.133 INFO:tasks.workunit.client.0.smithi005.stderr:+ rm -rf -- ./tmp.0MRASCfz55 2024-04-16T14:35:49.153 INFO:tasks.workunit.client.1.smithi115.stdout:5/992: dwrite dc/f10c [0,4194304] 0 2024-04-16T14:35:49.153 INFO:tasks.workunit.client.1.smithi115.stdout:5/993: creat dc/d15/d35/d71/f127 x:0 0 0 2024-04-16T14:35:49.153 INFO:tasks.workunit.client.1.smithi115.stdout:5/994: creat dc/d15/d4d/daa/f128 x:0 0 0 2024-04-16T14:35:49.153 INFO:tasks.workunit.client.1.smithi115.stdout:5/995: write dc/d15/d35/f48 [967930,13779] 0 2024-04-16T14:35:49.153 INFO:tasks.workunit.client.1.smithi115.stdout:7/993: dwrite d0/d2/d3a/fab [0,4194304] 0 2024-04-16T14:35:49.153 INFO:tasks.workunit.client.1.smithi115.stdout:7/994: readlink d0/d2/d3a/d30/d79/dd2/d64/lc1 0 2024-04-16T14:35:49.158 INFO:tasks.workunit.client.1.smithi115.stdout:7/995: link d0/d24/da3/db1/f60 d0/d24/d13d/f153 0 2024-04-16T14:35:49.158 INFO:tasks.workunit.client.1.smithi115.stdout:7/996: read d0/d2/d3a/d30/d6b/da2/fa8 [3286720,11056] 0 2024-04-16T14:35:49.159 INFO:tasks.workunit.client.1.smithi115.stdout:7/997: unlink d0/d2/d3a/d30/d79/d95/d10c/cbb 0 2024-04-16T14:35:49.161 INFO:tasks.workunit.client.1.smithi115.stdout:7/998: mkdir d0/d2/d3a/d30/d6b/d10e/d154 0 2024-04-16T14:35:49.161 INFO:tasks.workunit.client.1.smithi115.stdout:5/996: dread dc/d15/d4d/dde/df1/ffa [0,4194304] 0 2024-04-16T14:35:49.162 INFO:tasks.workunit.client.1.smithi115.stdout:7/999: unlink d0/d24/da3/db1/d3f/db0/f89 0 2024-04-16T14:35:49.169 INFO:tasks.workunit.client.1.smithi115.stdout:5/997: write dc/d15/d4d/f6f [609552,96169] 0 2024-04-16T14:35:49.172 INFO:tasks.workunit.client.1.smithi115.stdout:5/998: rename dc/d15/d4d/dde/df1 to dc/d15/d35/d87/d129 0 2024-04-16T14:35:49.172 INFO:tasks.workunit.client.1.smithi115.stdout:5/999: fdatasync dc/f1f 0 2024-04-16T14:35:49.202 INFO:tasks.workunit.client.1.smithi115.stdout:0/912: sync 2024-04-16T14:35:49.202 INFO:tasks.workunit.client.1.smithi115.stdout:0/913: chown d6/d10/d12/d1f/d36/f11b 1 1 2024-04-16T14:35:49.202 INFO:tasks.workunit.client.1.smithi115.stdout:0/914: creat d6/d10/d12/d1f/d36/d4b/dff/f141 x:0 0 0 2024-04-16T14:35:49.202 INFO:tasks.workunit.client.1.smithi115.stdout:0/915: creat d6/d30/d8d/df3/f142 x:0 0 0 2024-04-16T14:35:49.203 INFO:tasks.workunit.client.1.smithi115.stdout:0/916: symlink d6/d10/l143 0 2024-04-16T14:35:49.203 INFO:tasks.workunit.client.1.smithi115.stdout:0/917: dread - d6/d10/d12/d1f/d36/d4b/f9d zero size 2024-04-16T14:35:49.204 INFO:tasks.workunit.client.1.smithi115.stdout:0/918: stat d6/fec 0 2024-04-16T14:35:49.204 INFO:tasks.workunit.client.1.smithi115.stdout:0/919: creat d6/d10/d12/f144 x:0 0 0 2024-04-16T14:35:49.205 INFO:tasks.workunit.client.1.smithi115.stdout:0/920: mkdir d6/d10/d12/d1f/ded/df6/d126/dfc/d145 0 2024-04-16T14:35:49.206 INFO:tasks.workunit.client.1.smithi115.stdout:0/921: link d6/d30/d4d/de5/l104 d6/d10/d12/d1f/d36/l146 0 2024-04-16T14:35:49.208 INFO:tasks.workunit.client.1.smithi115.stdout:0/922: rename d6/d30/d4d/de5/d12f/fe9 to d6/d10/d12/d1f/d36/d4b/f147 0 2024-04-16T14:35:49.210 INFO:tasks.workunit.client.1.smithi115.stdout:0/923: link d6/d54/le0 d6/d10/d12/d1f/ded/df6/d126/dfc/d133/l148 0 2024-04-16T14:35:49.212 INFO:tasks.workunit.client.1.smithi115.stdout:0/924: mkdir d6/d10/d12/d1f/d36/d4b/dff/d100/d137/d149 0 2024-04-16T14:35:49.213 INFO:tasks.workunit.client.1.smithi115.stdout:0/925: symlink d6/d10/d12/d1f/d36/d4b/l14a 0 2024-04-16T14:35:49.214 INFO:tasks.workunit.client.1.smithi115.stdout:0/926: creat d6/d30/f14b x:0 0 0 2024-04-16T14:35:49.214 INFO:tasks.workunit.client.1.smithi115.stdout:0/927: creat d6/d54/f14c x:0 0 0 2024-04-16T14:35:49.216 INFO:tasks.workunit.client.1.smithi115.stdout:0/928: dread d6/d1b/f7d [0,4194304] 0 2024-04-16T14:35:49.216 INFO:tasks.workunit.client.1.smithi115.stdout:0/929: write d6/d10/ff8 [175905,117394] 0 2024-04-16T14:35:49.240 INFO:tasks.workunit.client.1.smithi115.stdout:0/930: dwrite d6/d54/f87 [0,4194304] 0 2024-04-16T14:35:49.266 INFO:tasks.workunit.client.1.smithi115.stdout:0/931: dwrite d6/d30/d4d/f11f [0,4194304] 0 2024-04-16T14:35:49.266 INFO:tasks.workunit.client.1.smithi115.stdout:0/932: mkdir d6/d30/d4d/de5/d12f/db9/d14d 0 2024-04-16T14:35:49.267 INFO:tasks.workunit.client.1.smithi115.stdout:0/933: mkdir d6/d10/dd1/d14e 0 2024-04-16T14:35:49.283 INFO:tasks.workunit.client.1.smithi115.stdout:0/934: dwrite d6/d10/d12/d31/d35/d9b/fa4 [0,4194304] 0 2024-04-16T14:35:49.286 INFO:tasks.workunit.client.1.smithi115.stdout:0/935: symlink d6/d30/d4d/de5/d12f/l14f 0 2024-04-16T14:35:49.286 INFO:tasks.workunit.client.1.smithi115.stdout:0/936: read d6/d10/d12/d1f/d36/d4b/d101/d10b/f11a [2555695,106914] 0 2024-04-16T14:35:49.286 INFO:tasks.workunit.client.1.smithi115.stdout:0/937: truncate d6/d10/d12/f144 467603 0 2024-04-16T14:35:49.286 INFO:tasks.workunit.client.1.smithi115.stdout:0/938: write d6/d10/d12/d1f/d36/f7e [635154,93329] 0 2024-04-16T14:35:49.286 INFO:tasks.workunit.client.1.smithi115.stdout:0/939: mknod d6/d30/d4d/de5/d12f/db9/d108/c150 0 2024-04-16T14:35:49.287 INFO:tasks.workunit.client.1.smithi115.stdout:0/940: chown d6/d10/d12/d1f/d36/d4b/d101/d10b 126 1 2024-04-16T14:35:49.303 INFO:tasks.workunit.client.1.smithi115.stdout:0/941: dwrite d6/d30/d4d/df0/d10c/dbe/fad [0,4194304] 0 2024-04-16T14:35:49.303 INFO:tasks.workunit.client.1.smithi115.stdout:0/942: fsync d6/d10/d12/d1f/ded/f139 0 2024-04-16T14:35:49.308 INFO:tasks.workunit.client.1.smithi115.stdout:0/943: dread d6/d10/d12/d31/d35/d9b/f49 [0,4194304] 0 2024-04-16T14:35:49.309 INFO:tasks.workunit.client.1.smithi115.stdout:0/944: link d6/d10/d12/d31/d35/d44/fa7 d6/d30/d4d/df0/d10c/dbe/d12c/f151 0 2024-04-16T14:35:49.310 INFO:tasks.workunit.client.1.smithi115.stdout:0/945: link d6/d10/d12/d1f/ded/f139 d6/d10/d12/d31/d35/d44/d85/f152 0 2024-04-16T14:35:49.311 INFO:tasks.workunit.client.1.smithi115.stdout:0/946: link d6/d10/d12/d1f/d36/c5e d6/d30/d4d/df0/d10c/d83/c153 0 2024-04-16T14:35:49.312 INFO:tasks.workunit.client.1.smithi115.stdout:0/947: rename d6/d10/d12/d31/d35/d44/d85/c121 to d6/d30/d4d/de4/c154 0 2024-04-16T14:35:49.314 INFO:tasks.workunit.client.1.smithi115.stdout:0/948: rename d6/c23 to d6/d30/d8d/c155 0 2024-04-16T14:35:49.314 INFO:tasks.workunit.client.1.smithi115.stdout:0/949: fdatasync d6/d10/d12/d1f/d36/d4b/d6d/f3d 0 2024-04-16T14:35:49.314 INFO:tasks.workunit.client.1.smithi115.stdout:0/950: readlink d6/d10/dc8/le6 0 2024-04-16T14:35:49.314 INFO:tasks.workunit.client.1.smithi115.stdout:0/951: fdatasync f1 0 2024-04-16T14:35:49.322 INFO:tasks.workunit.client.1.smithi115.stdout:0/952: dread d6/d10/d12/d31/d35/f3e [0,4194304] 0 2024-04-16T14:35:49.322 INFO:tasks.workunit.client.1.smithi115.stdout:0/953: truncate d6/d30/d4d/de4/f123 224169 0 2024-04-16T14:35:49.323 INFO:tasks.workunit.client.1.smithi115.stdout:0/954: creat d6/d30/d4d/de5/d12f/f156 x:0 0 0 2024-04-16T14:35:49.323 INFO:tasks.workunit.client.1.smithi115.stdout:0/955: fdatasync d6/d10/d12/d1f/d36/f11b 0 2024-04-16T14:35:49.323 INFO:tasks.workunit.client.1.smithi115.stdout:0/956: mkdir d6/d30/d157 0 2024-04-16T14:35:49.323 INFO:tasks.workunit.client.1.smithi115.stdout:0/957: chown d6/d10/d12/d31/d35/d9b/fa4 76 1 2024-04-16T14:35:49.323 INFO:tasks.workunit.client.1.smithi115.stdout:0/958: readlink d6/lc4 0 2024-04-16T14:35:49.323 INFO:tasks.workunit.client.1.smithi115.stdout:0/959: chown d6/d10/d12/d1f/d36/d4b/d6d/fea 551 1 2024-04-16T14:35:49.324 INFO:tasks.workunit.client.1.smithi115.stdout:0/960: creat d6/d10/d12/d31/d35/f158 x:0 0 0 2024-04-16T14:35:49.324 INFO:tasks.workunit.client.1.smithi115.stdout:0/961: mknod d6/d10/d12/d31/d35/d132/c159 0 2024-04-16T14:35:49.325 INFO:tasks.workunit.client.1.smithi115.stdout:0/962: rename d6/d10/d12/d1f/d36/d4b/d70/d8a/c92 to d6/d10/d71/db7/d113/c15a 0 2024-04-16T14:35:49.328 INFO:tasks.workunit.client.1.smithi115.stdout:0/963: dread d6/d10/d12/d31/d35/f3e [0,4194304] 0 2024-04-16T14:35:49.329 INFO:tasks.workunit.client.1.smithi115.stdout:0/964: write d6/d10/d12/d1f/d36/d4b/f147 [845542,91369] 0 2024-04-16T14:35:49.329 INFO:tasks.workunit.client.1.smithi115.stdout:0/965: mknod d6/d54/de2/c15b 0 2024-04-16T14:35:49.330 INFO:tasks.workunit.client.1.smithi115.stdout:0/966: mkdir d6/d10/dae/d127/d15c 0 2024-04-16T14:35:49.333 INFO:tasks.workunit.client.1.smithi115.stdout:0/967: rename d6/d30/d4d/de5/d12f/db9/lbd to d6/d10/d71/l15d 0 2024-04-16T14:35:49.333 INFO:tasks.workunit.client.1.smithi115.stdout:0/968: link d6/l79 d6/d10/d12/d31/l15e 0 2024-04-16T14:35:49.333 INFO:tasks.workunit.client.1.smithi115.stdout:0/969: mkdir d6/d10/dc8/d15f 0 2024-04-16T14:35:49.334 INFO:tasks.workunit.client.1.smithi115.stdout:0/970: rename d6/d10/d12/d1f/d36/d4b/f147 to d6/d30/d4d/df0/d10c/d83/f160 0 2024-04-16T14:35:49.335 INFO:tasks.workunit.client.1.smithi115.stdout:0/971: write d6/d10/dc8/f129 [886716,59890] 0 2024-04-16T14:35:49.340 INFO:tasks.workunit.client.1.smithi115.stdout:0/972: symlink d6/d10/d12/d1f/d36/d4b/d70/d8a/l161 0 2024-04-16T14:35:49.343 INFO:tasks.workunit.client.1.smithi115.stdout:0/973: symlink d6/d10/dae/l162 0 2024-04-16T14:35:49.343 INFO:tasks.workunit.client.1.smithi115.stdout:0/974: fdatasync d6/d10/d12/f144 0 2024-04-16T14:35:49.343 INFO:tasks.workunit.client.1.smithi115.stdout:0/975: dread - d6/d10/d12/d31/d35/d44/d85/f152 zero size 2024-04-16T14:35:49.343 INFO:tasks.workunit.client.1.smithi115.stdout:0/976: stat d6/d10/dd1/f115 0 2024-04-16T14:35:49.418 INFO:tasks.workunit.client.1.smithi115.stdout:0/977: sync 2024-04-16T14:35:49.420 INFO:tasks.workunit.client.1.smithi115.stdout:0/978: dread d6/d10/d12/d1f/d36/d4b/d6d/f76 [0,4194304] 0 2024-04-16T14:35:49.421 INFO:tasks.workunit.client.1.smithi115.stdout:0/979: truncate d6/d10/d12/d31/d35/d9b/f77 5009663 0 2024-04-16T14:35:49.429 INFO:tasks.workunit.client.1.smithi115.stdout:0/980: dread d6/d10/d12/d31/d35/d44/f6f [0,4194304] 0 2024-04-16T14:35:49.431 INFO:tasks.workunit.client.1.smithi115.stdout:0/981: dread d6/ff [0,4194304] 0 2024-04-16T14:35:49.433 INFO:tasks.workunit.client.1.smithi115.stdout:0/982: dread d6/d10/d12/d1f/d36/d4b/d70/d8a/fb1 [0,4194304] 0 2024-04-16T14:35:49.441 INFO:tasks.workunit.client.1.smithi115.stdout:0/983: dread d6/f95 [0,4194304] 0 2024-04-16T14:35:49.445 INFO:tasks.workunit.client.1.smithi115.stdout:0/984: dread d6/fec [0,4194304] 0 2024-04-16T14:35:49.445 INFO:tasks.workunit.client.1.smithi115.stdout:0/985: dread - d6/d30/d4d/ffd zero size 2024-04-16T14:35:49.445 INFO:tasks.workunit.client.1.smithi115.stdout:0/986: read - d6/d54/ff4 zero size 2024-04-16T14:35:49.445 INFO:tasks.workunit.client.1.smithi115.stdout:0/987: fsync d6/d10/d12/d31/d35/d44/dc9/fcf 0 2024-04-16T14:35:49.447 INFO:tasks.workunit.client.1.smithi115.stdout:0/988: rename d6/d10/d12/d31/d35/d44/lee to d6/d10/d71/db7/l163 0 2024-04-16T14:35:49.448 INFO:tasks.workunit.client.1.smithi115.stdout:0/989: dread d6/d30/d4d/de4/f123 [0,4194304] 0 2024-04-16T14:35:49.448 INFO:tasks.workunit.client.1.smithi115.stdout:0/990: truncate d6/d30/d4d/df0/d10c/dbe/f11c 633270 0 2024-04-16T14:35:49.449 INFO:tasks.workunit.client.1.smithi115.stdout:0/991: creat d6/d10/d12/d1f/f164 x:0 0 0 2024-04-16T14:35:49.450 INFO:tasks.workunit.client.1.smithi115.stdout:0/992: mknod d6/d30/d4d/df0/d10c/c165 0 2024-04-16T14:35:49.459 INFO:tasks.workunit.client.1.smithi115.stdout:0/993: read d6/d30/f43 [190316,128249] 0 2024-04-16T14:35:49.461 INFO:tasks.workunit.client.1.smithi115.stdout:0/994: creat d6/d30/d4d/de5/d13e/f166 x:0 0 0 2024-04-16T14:35:49.465 INFO:tasks.workunit.client.1.smithi115.stdout:0/995: rename d6/d30/d4d/df0/d10c to d6/d10/d12/d1f/ded/d167 0 2024-04-16T14:35:49.465 INFO:tasks.workunit.client.1.smithi115.stdout:0/996: dread - d6/d10/d12/d1f/d36/d4b/d6d/fea zero size 2024-04-16T14:35:49.466 INFO:tasks.workunit.client.1.smithi115.stdout:0/997: dread d6/d10/f40 [4194304,4194304] 0 2024-04-16T14:35:49.469 INFO:tasks.workunit.client.1.smithi115.stdout:0/998: getdents d6/d30/d4d/df0 0 2024-04-16T14:35:49.469 INFO:tasks.workunit.client.1.smithi115.stdout:0/999: readlink d6/d1b/l97 0 2024-04-16T14:35:49.471 INFO:tasks.workunit.client.1.smithi115.stderr:+ rm -rf -- ./tmp.FxWnJ36DUi 2024-04-16T14:35:49.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.519+0000 7f912f2af700 1 -- 172.21.15.5:0/1644453932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91281002a0 msgr2=0x7f9128100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:49.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.519+0000 7f912f2af700 1 --2- 172.21.15.5:0/1644453932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91281002a0 0x7f9128100710 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9118004940 tx=0x7f9118009e30 comp rx=0 tx=0).stop 2024-04-16T14:35:49.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.519+0000 7f912f2af700 1 -- 172.21.15.5:0/1644453932 shutdown_connections 2024-04-16T14:35:49.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.519+0000 7f912f2af700 1 --2- 172.21.15.5:0/1644453932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91281002a0 0x7f9128100710 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:49.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.519+0000 7f912f2af700 1 --2- 172.21.15.5:0/1644453932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91280feff0 0x7f91280ff400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:49.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.519+0000 7f912f2af700 1 -- 172.21.15.5:0/1644453932 >> 172.21.15.5:0/1644453932 conn(0x7f91280fa790 msgr2=0x7f91280fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:49.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.520+0000 7f912f2af700 1 -- 172.21.15.5:0/1644453932 shutdown_connections 2024-04-16T14:35:49.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.520+0000 7f912f2af700 1 -- 172.21.15.5:0/1644453932 wait complete. 2024-04-16T14:35:49.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.520+0000 7f912f2af700 1 Processor -- start 2024-04-16T14:35:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.520+0000 7f912f2af700 1 -- start start 2024-04-16T14:35:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.520+0000 7f912f2af700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91280feff0 0x7f912810faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.520+0000 7f912f2af700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91281002a0 0x7f912810ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.520+0000 7f912f2af700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91281105e0 con 0x7f91280feff0 2024-04-16T14:35:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.521+0000 7f912d04b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91280feff0 0x7f912810faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.521+0000 7f912d04b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91280feff0 0x7f912810faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32870/0 (socket says 172.21.15.5:32870) 2024-04-16T14:35:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.521+0000 7f912d04b700 1 -- 172.21.15.5:0/3462900317 learned_addr learned my addr 172.21.15.5:0/3462900317 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:35:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.521+0000 7f912f2af700 1 -- 172.21.15.5:0/3462900317 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9128110750 con 0x7f91281002a0 2024-04-16T14:35:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.521+0000 7f912c84a700 1 --2- 172.21.15.5:0/3462900317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91281002a0 0x7f912810ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.521+0000 7f912d04b700 1 -- 172.21.15.5:0/3462900317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91281002a0 msgr2=0x7f912810ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.521+0000 7f912d04b700 1 --2- 172.21.15.5:0/3462900317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91281002a0 0x7f912810ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.521+0000 7f912d04b700 1 -- 172.21.15.5:0/3462900317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9124005040 con 0x7f91280feff0 2024-04-16T14:35:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.521+0000 7f912d04b700 1 --2- 172.21.15.5:0/3462900317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91280feff0 0x7f912810faa0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f91240096d0 tx=0x7f9124009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:49.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.521+0000 7f911dffb700 1 -- 172.21.15.5:0/3462900317 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f912400e840 con 0x7f91280feff0 2024-04-16T14:35:49.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.521+0000 7f912f2af700 1 -- 172.21.15.5:0/3462900317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9118005040 con 0x7f91280feff0 2024-04-16T14:35:49.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.521+0000 7f911dffb700 1 -- 172.21.15.5:0/3462900317 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f912400f040 con 0x7f91280feff0 2024-04-16T14:35:49.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.521+0000 7f911dffb700 1 -- 172.21.15.5:0/3462900317 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9124013dc0 con 0x7f91280feff0 2024-04-16T14:35:49.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.522+0000 7f912f2af700 1 -- 172.21.15.5:0/3462900317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9128115500 con 0x7f91280feff0 2024-04-16T14:35:49.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.523+0000 7f912f2af700 1 -- 172.21.15.5:0/3462900317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f912804c710 con 0x7f91280feff0 2024-04-16T14:35:49.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.523+0000 7f911dffb700 1 -- 172.21.15.5:0/3462900317 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 89381+0+0 (secure 0 0 0) 0x7f912400e9a0 con 0x7f91280feff0 2024-04-16T14:35:49.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.524+0000 7f911dffb700 1 --2- 172.21.15.5:0/3462900317 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f911406b7a0 0x7f911406dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:49.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.524+0000 7f911dffb700 1 -- 172.21.15.5:0/3462900317 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f912408a220 con 0x7f91280feff0 2024-04-16T14:35:49.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.524+0000 7f912c84a700 1 --2- 172.21.15.5:0/3462900317 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f911406b7a0 0x7f911406dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:49.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.525+0000 7f912c84a700 1 --2- 172.21.15.5:0/3462900317 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f911406b7a0 0x7f911406dc50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9118009b30 tx=0x7f9118009e30 comp rx=0 tx=0).ready entity=mgr.14616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:49.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.530+0000 7f911dffb700 1 -- 172.21.15.5:0/3462900317 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f9124057810 con 0x7f91280feff0 2024-04-16T14:35:49.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:49 smithi005 ceph-mon[28964]: pgmap v29: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 420 MiB/s rd, 489 MiB/s wr, 687 op/s 2024-04-16T14:35:49.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.863+0000 7f912f2af700 1 -- 172.21.15.5:0/3462900317 --> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9128104540 con 0x7f911406b7a0 2024-04-16T14:35:49.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.865+0000 7f911dffb700 1 -- 172.21.15.5:0/3462900317 <== mgr.14616 v2:172.21.15.115:6828/460631486 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f9128104540 con 0x7f911406b7a0 2024-04-16T14:35:49.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.867+0000 7f912f2af700 1 -- 172.21.15.5:0/3462900317 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f911406b7a0 msgr2=0x7f911406dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:49.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.867+0000 7f912f2af700 1 --2- 172.21.15.5:0/3462900317 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f911406b7a0 0x7f911406dc50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9118009b30 tx=0x7f9118009e30 comp rx=0 tx=0).stop 2024-04-16T14:35:49.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.867+0000 7f912f2af700 1 -- 172.21.15.5:0/3462900317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91280feff0 msgr2=0x7f912810faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:49.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.867+0000 7f912f2af700 1 --2- 172.21.15.5:0/3462900317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91280feff0 0x7f912810faa0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f91240096d0 tx=0x7f9124009e30 comp rx=0 tx=0).stop 2024-04-16T14:35:49.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.867+0000 7f912f2af700 1 -- 172.21.15.5:0/3462900317 shutdown_connections 2024-04-16T14:35:49.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.867+0000 7f912f2af700 1 --2- 172.21.15.5:0/3462900317 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f911406b7a0 0x7f911406dc50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:49.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.867+0000 7f912f2af700 1 --2- 172.21.15.5:0/3462900317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91280feff0 0x7f912810faa0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:49.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.867+0000 7f912f2af700 1 --2- 172.21.15.5:0/3462900317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91281002a0 0x7f912810ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:49.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.867+0000 7f912f2af700 1 -- 172.21.15.5:0/3462900317 >> 172.21.15.5:0/3462900317 conn(0x7f91280fa790 msgr2=0x7f91280fbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:49.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.867+0000 7f912f2af700 1 -- 172.21.15.5:0/3462900317 shutdown_connections 2024-04-16T14:35:49.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.867+0000 7f912f2af700 1 -- 172.21.15.5:0/3462900317 wait complete. 2024-04-16T14:35:49.879 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-04-16T14:35:49.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:49 smithi115 ceph-mon[37295]: pgmap v29: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 420 MiB/s rd, 489 MiB/s wr, 687 op/s 2024-04-16T14:35:49.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.984+0000 7f979c380700 1 -- 172.21.15.5:0/2251369371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97940fe040 msgr2=0x7f97940fe4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:49.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.984+0000 7f979c380700 1 --2- 172.21.15.5:0/2251369371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97940fe040 0x7f97940fe4b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9784004940 tx=0x7f9784009e30 comp rx=0 tx=0).stop 2024-04-16T14:35:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.984+0000 7f979c380700 1 -- 172.21.15.5:0/2251369371 shutdown_connections 2024-04-16T14:35:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.984+0000 7f979c380700 1 --2- 172.21.15.5:0/2251369371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97940fe040 0x7f97940fe4b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.985+0000 7f979c380700 1 --2- 172.21.15.5:0/2251369371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97940fce40 0x7f97940fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.985+0000 7f979c380700 1 -- 172.21.15.5:0/2251369371 >> 172.21.15.5:0/2251369371 conn(0x7f97940f8570 msgr2=0x7f97940fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.985+0000 7f979c380700 1 -- 172.21.15.5:0/2251369371 shutdown_connections 2024-04-16T14:35:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.985+0000 7f979c380700 1 -- 172.21.15.5:0/2251369371 wait complete. 2024-04-16T14:35:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.985+0000 7f979c380700 1 Processor -- start 2024-04-16T14:35:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.985+0000 7f979c380700 1 -- start start 2024-04-16T14:35:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.985+0000 7f979c380700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97940fce40 0x7f9794071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.985+0000 7f979c380700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97940fe040 0x7f9794070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.985+0000 7f979c380700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97940708c0 con 0x7f97940fce40 2024-04-16T14:35:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.985+0000 7f979c380700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9794070a30 con 0x7f97940fe040 2024-04-16T14:35:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.985+0000 7f979a11c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97940fce40 0x7f9794071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.986+0000 7f979a11c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97940fce40 0x7f9794071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32882/0 (socket says 172.21.15.5:32882) 2024-04-16T14:35:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.986+0000 7f979a11c700 1 -- 172.21.15.5:0/951922924 learned_addr learned my addr 172.21.15.5:0/951922924 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:35:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.986+0000 7f979991b700 1 --2- 172.21.15.5:0/951922924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97940fe040 0x7f9794070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:49.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.986+0000 7f979991b700 1 -- 172.21.15.5:0/951922924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97940fce40 msgr2=0x7f9794071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.986+0000 7f979991b700 1 --2- 172.21.15.5:0/951922924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97940fce40 0x7f9794071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.986+0000 7f979991b700 1 -- 172.21.15.5:0/951922924 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9784005040 con 0x7f97940fe040 2024-04-16T14:35:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.986+0000 7f979a11c700 1 --2- 172.21.15.5:0/951922924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97940fce40 0x7f9794071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T14:35:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.986+0000 7f979991b700 1 --2- 172.21.15.5:0/951922924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97940fe040 0x7f9794070310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9784000c00 tx=0x7f9784009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.986+0000 7f978affd700 1 -- 172.21.15.5:0/951922924 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f978400e030 con 0x7f97940fe040 2024-04-16T14:35:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.986+0000 7f979c380700 1 -- 172.21.15.5:0/951922924 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9794070cb0 con 0x7f97940fe040 2024-04-16T14:35:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.986+0000 7f978affd700 1 -- 172.21.15.5:0/951922924 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f978401c400 con 0x7f97940fe040 2024-04-16T14:35:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.986+0000 7f978affd700 1 -- 172.21.15.5:0/951922924 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f978400b650 con 0x7f97940fe040 2024-04-16T14:35:49.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.987+0000 7f979c380700 1 -- 172.21.15.5:0/951922924 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97941159e0 con 0x7f97940fe040 2024-04-16T14:35:49.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.988+0000 7f979c380700 1 -- 172.21.15.5:0/951922924 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f979405f5f0 con 0x7f97940fe040 2024-04-16T14:35:49.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.988+0000 7f978affd700 1 -- 172.21.15.5:0/951922924 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 24) v1 ==== 89381+0+0 (secure 0 0 0) 0x7f978401ca90 con 0x7f97940fe040 2024-04-16T14:35:49.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.989+0000 7f978affd700 1 --2- 172.21.15.5:0/951922924 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f978006b790 0x7f978006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:49.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.989+0000 7f978affd700 1 -- 172.21.15.5:0/951922924 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f978408b600 con 0x7f97940fe040 2024-04-16T14:35:49.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.989+0000 7f979a11c700 1 --2- 172.21.15.5:0/951922924 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f978006b790 0x7f978006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:49.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.990+0000 7f979a11c700 1 --2- 172.21.15.5:0/951922924 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f978006b790 0x7f978006dc40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9794071bd0 tx=0x7f979000b040 comp rx=0 tx=0).ready entity=mgr.14616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:49.994+0000 7f978affd700 1 -- 172.21.15.5:0/951922924 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f97840553e0 con 0x7f97940fe040 2024-04-16T14:35:50.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.290+0000 7f979c380700 1 -- 172.21.15.5:0/951922924 --> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9794102310 con 0x7f978006b790 2024-04-16T14:35:50.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.292+0000 7f978affd700 1 -- 172.21.15.5:0/951922924 <== mgr.14616 v2:172.21.15.115:6828/460631486 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f9794102310 con 0x7f978006b790 2024-04-16T14:35:50.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.296+0000 7f979c380700 1 -- 172.21.15.5:0/951922924 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f978006b790 msgr2=0x7f978006dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:50.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.296+0000 7f979c380700 1 --2- 172.21.15.5:0/951922924 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f978006b790 0x7f978006dc40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9794071bd0 tx=0x7f979000b040 comp rx=0 tx=0).stop 2024-04-16T14:35:50.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.296+0000 7f979c380700 1 -- 172.21.15.5:0/951922924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97940fe040 msgr2=0x7f9794070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:50.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.296+0000 7f979c380700 1 --2- 172.21.15.5:0/951922924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97940fe040 0x7f9794070310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9784000c00 tx=0x7f9784009e30 comp rx=0 tx=0).stop 2024-04-16T14:35:50.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.297+0000 7f979c380700 1 -- 172.21.15.5:0/951922924 shutdown_connections 2024-04-16T14:35:50.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.297+0000 7f979c380700 1 --2- 172.21.15.5:0/951922924 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f978006b790 0x7f978006dc40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:50.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.297+0000 7f979c380700 1 --2- 172.21.15.5:0/951922924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97940fce40 0x7f9794071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:50.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.297+0000 7f979c380700 1 --2- 172.21.15.5:0/951922924 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f97940fe040 0x7f9794070310 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:50.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.297+0000 7f979c380700 1 -- 172.21.15.5:0/951922924 >> 172.21.15.5:0/951922924 conn(0x7f97940f8570 msgr2=0x7f97940f9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:50.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.297+0000 7f979c380700 1 -- 172.21.15.5:0/951922924 shutdown_connections 2024-04-16T14:35:50.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.297+0000 7f979c380700 1 -- 172.21.15.5:0/951922924 wait complete. 2024-04-16T14:35:50.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.464+0000 7fbe1451e700 1 -- 172.21.15.5:0/493731991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe0c0fbcf0 msgr2=0x7fbe0c0fc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:50.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.464+0000 7fbe1451e700 1 --2- 172.21.15.5:0/493731991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe0c0fbcf0 0x7fbe0c0fc100 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbe08004940 tx=0x7fbe08009e30 comp rx=0 tx=0).stop 2024-04-16T14:35:50.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.464+0000 7fbe1451e700 1 -- 172.21.15.5:0/493731991 shutdown_connections 2024-04-16T14:35:50.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.465+0000 7fbe1451e700 1 --2- 172.21.15.5:0/493731991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe0c0fcfa0 0x7fbe0c0fd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:50.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.465+0000 7fbe1451e700 1 --2- 172.21.15.5:0/493731991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe0c0fbcf0 0x7fbe0c0fc100 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:50.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.465+0000 7fbe1451e700 1 -- 172.21.15.5:0/493731991 >> 172.21.15.5:0/493731991 conn(0x7fbe0c0f7450 msgr2=0x7fbe0c0f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:50.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.465+0000 7fbe1451e700 1 -- 172.21.15.5:0/493731991 shutdown_connections 2024-04-16T14:35:50.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.465+0000 7fbe1451e700 1 -- 172.21.15.5:0/493731991 wait complete. 2024-04-16T14:35:50.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.466+0000 7fbe1451e700 1 Processor -- start 2024-04-16T14:35:50.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.466+0000 7fbe1451e700 1 -- start start 2024-04-16T14:35:50.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.466+0000 7fbe1451e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe0c0fbcf0 0x7fbe0c10d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:50.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.466+0000 7fbe1451e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe0c0fcfa0 0x7fbe0c10def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:50.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.466+0000 7fbe1451e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c10e4f0 con 0x7fbe0c0fbcf0 2024-04-16T14:35:50.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.466+0000 7fbe1451e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0c10ed40 con 0x7fbe0c0fcfa0 2024-04-16T14:35:50.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.466+0000 7fbe122ba700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe0c0fbcf0 0x7fbe0c10d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:50.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.467+0000 7fbe122ba700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe0c0fbcf0 0x7fbe0c10d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32904/0 (socket says 172.21.15.5:32904) 2024-04-16T14:35:50.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.467+0000 7fbe122ba700 1 -- 172.21.15.5:0/2919554783 learned_addr learned my addr 172.21.15.5:0/2919554783 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:35:50.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.467+0000 7fbe11ab9700 1 --2- 172.21.15.5:0/2919554783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe0c0fcfa0 0x7fbe0c10def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:50.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.467+0000 7fbe122ba700 1 -- 172.21.15.5:0/2919554783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe0c0fcfa0 msgr2=0x7fbe0c10def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:50.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.467+0000 7fbe122ba700 1 --2- 172.21.15.5:0/2919554783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe0c0fcfa0 0x7fbe0c10def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:50.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.467+0000 7fbe122ba700 1 -- 172.21.15.5:0/2919554783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe08005040 con 0x7fbe0c0fbcf0 2024-04-16T14:35:50.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.467+0000 7fbe122ba700 1 --2- 172.21.15.5:0/2919554783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe0c0fbcf0 0x7fbe0c10d9b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbe08013870 tx=0x7fbe08009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:50.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.468+0000 7fbe02ffd700 1 -- 172.21.15.5:0/2919554783 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe08021070 con 0x7fbe0c0fbcf0 2024-04-16T14:35:50.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.468+0000 7fbe1451e700 1 -- 172.21.15.5:0/2919554783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe0c10efc0 con 0x7fbe0c0fbcf0 2024-04-16T14:35:50.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.468+0000 7fbe1451e700 1 -- 172.21.15.5:0/2919554783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0c10f500 con 0x7fbe0c0fbcf0 2024-04-16T14:35:50.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.468+0000 7fbe02ffd700 1 -- 172.21.15.5:0/2919554783 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbe08009430 con 0x7fbe0c0fbcf0 2024-04-16T14:35:50.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.468+0000 7fbe02ffd700 1 -- 172.21.15.5:0/2919554783 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe0800e070 con 0x7fbe0c0fbcf0 2024-04-16T14:35:50.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.469+0000 7fbe1451e700 1 -- 172.21.15.5:0/2919554783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf00052e0 con 0x7fbe0c0fbcf0 2024-04-16T14:35:50.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.470+0000 7fbe02ffd700 1 -- 172.21.15.5:0/2919554783 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 89381+0+0 (secure 0 0 0) 0x7fbe0801c750 con 0x7fbe0c0fbcf0 2024-04-16T14:35:50.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.471+0000 7fbe02ffd700 1 --2- 172.21.15.5:0/2919554783 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fbdf806b790 0x7fbdf806dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:50.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.471+0000 7fbe02ffd700 1 -- 172.21.15.5:0/2919554783 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fbe0808b470 con 0x7fbe0c0fbcf0 2024-04-16T14:35:50.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.471+0000 7fbe11ab9700 1 --2- 172.21.15.5:0/2919554783 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fbdf806b790 0x7fbdf806dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:50.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.472+0000 7fbe11ab9700 1 --2- 172.21.15.5:0/2919554783 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fbdf806b790 0x7fbdf806dc40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009b80 tx=0x7fbdfc00b040 comp rx=0 tx=0).ready entity=mgr.14616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:50.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.476+0000 7fbe02ffd700 1 -- 172.21.15.5:0/2919554783 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7fbe08058cc0 con 0x7fbe0c0fbcf0 2024-04-16T14:35:50.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.801+0000 7fbe1451e700 1 -- 172.21.15.5:0/2919554783 --> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbdf0000bf0 con 0x7fbdf806b790 2024-04-16T14:35:50.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.812+0000 7fbe02ffd700 1 -- 172.21.15.5:0/2919554783 <== mgr.14616 v2:172.21.15.115:6828/460631486 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7fbdf0000bf0 con 0x7fbdf806b790 2024-04-16T14:35:50.811 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-16T14:35:50.811 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.smithi005 smithi005 *:9093,9094 starting - - - - 2024-04-16T14:35:50.811 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi005 smithi005 running (8m) 41s ago 8m 6669k - 17.2.7-868-g412a5526 b04d96489b7c 6a380d6ec070 2024-04-16T14:35:50.811 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi115 smithi115 running (7m) 45s ago 7m 6665k - 17.2.7-868-g412a5526 b04d96489b7c df7cb0bfe65b 2024-04-16T14:35:50.811 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.smithi005 smithi005 *:3000 running (6m) 41s ago 8m 90.4M - 9.4.7 954c08fa6188 e6011313e3be 2024-04-16T14:35:50.811 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.vzoqdl smithi005 running (3m) 41s ago 3m 11.5M - 17.2.7-868-g412a5526 b04d96489b7c 84a74a406a1d 2024-04-16T14:35:50.811 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.wofqlz smithi005 running (2m) 41s ago 2m 138M - 17.2.7-868-g412a5526 b04d96489b7c d0e053ab2f72 2024-04-16T14:35:50.811 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.byfytg smithi115 running (2m) 45s ago 2m 19.3M - 17.2.7-868-g412a5526 b04d96489b7c 595cd0892f66 2024-04-16T14:35:50.811 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.trkaqh smithi115 running (2m) 45s ago 2m 12.2M - 17.2.7-868-g412a5526 b04d96489b7c 5b60cd2ad79b 2024-04-16T14:35:50.811 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi005.ipwdkc smithi005 *:9283 running (9m) 41s ago 9m 343M - 17.2.7-868-g412a5526 b04d96489b7c 53fb89eec045 2024-04-16T14:35:50.811 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi115.brjkpo smithi115 *:8443,9283 running (72s) 45s ago 7m 487M - 19.0.0-2204-g36befe5d b1a78730e0db 5f0019fe08af 2024-04-16T14:35:50.811 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi005 smithi005 running (9m) 41s ago 10m 48.3M 2048M 17.2.7-868-g412a5526 b04d96489b7c 764b6a128874 2024-04-16T14:35:50.811 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi115 smithi115 running (7m) 45s ago 7m 37.9M 2048M 17.2.7-868-g412a5526 b04d96489b7c feb5354cdbe9 2024-04-16T14:35:50.811 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi005 smithi005 *:9100 starting - - - - 2024-04-16T14:35:50.812 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi115 smithi115 *:9100 running (7m) 45s ago 7m 16.4M - 1.5.0 0da6a335fe13 38c140c04a1e 2024-04-16T14:35:50.812 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (6m) 41s ago 6m 87.7M 1559M 17.2.7-868-g412a5526 b04d96489b7c ed7aa0542d96 2024-04-16T14:35:50.812 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (6m) 41s ago 6m 95.0M 1559M 17.2.7-868-g412a5526 b04d96489b7c 1868cc6c89f4 2024-04-16T14:35:50.812 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (5m) 41s ago 5m 80.6M 1559M 17.2.7-868-g412a5526 b04d96489b7c b12745ae7d18 2024-04-16T14:35:50.812 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi115 running (5m) 45s ago 5m 100M 2581M 17.2.7-868-g412a5526 b04d96489b7c 59f81301ebcf 2024-04-16T14:35:50.812 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi115 running (4m) 45s ago 4m 82.8M 2581M 17.2.7-868-g412a5526 b04d96489b7c e3ea96b7edd9 2024-04-16T14:35:50.812 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi115 running (4m) 45s ago 4m 89.7M 2581M 17.2.7-868-g412a5526 b04d96489b7c 456fa074e453 2024-04-16T14:35:50.812 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.smithi005 smithi005 *:9095 running (6m) 41s ago 7m 56.3M - 2.43.0 a07b618ecd1d 813f7bfd1439 2024-04-16T14:35:50.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.814+0000 7fbe1451e700 1 -- 172.21.15.5:0/2919554783 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fbdf806b790 msgr2=0x7fbdf806dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:50.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.814+0000 7fbe1451e700 1 --2- 172.21.15.5:0/2919554783 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fbdf806b790 0x7fbdf806dc40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009b80 tx=0x7fbdfc00b040 comp rx=0 tx=0).stop 2024-04-16T14:35:50.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.814+0000 7fbe1451e700 1 -- 172.21.15.5:0/2919554783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe0c0fbcf0 msgr2=0x7fbe0c10d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:50.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.814+0000 7fbe1451e700 1 --2- 172.21.15.5:0/2919554783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe0c0fbcf0 0x7fbe0c10d9b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbe08013870 tx=0x7fbe08009e30 comp rx=0 tx=0).stop 2024-04-16T14:35:50.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.814+0000 7fbe1451e700 1 -- 172.21.15.5:0/2919554783 shutdown_connections 2024-04-16T14:35:50.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.814+0000 7fbe1451e700 1 --2- 172.21.15.5:0/2919554783 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fbdf806b790 0x7fbdf806dc40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:50.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.814+0000 7fbe1451e700 1 --2- 172.21.15.5:0/2919554783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbe0c0fbcf0 0x7fbe0c10d9b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:50.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.814+0000 7fbe1451e700 1 --2- 172.21.15.5:0/2919554783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe0c0fcfa0 0x7fbe0c10def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:50.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.814+0000 7fbe1451e700 1 -- 172.21.15.5:0/2919554783 >> 172.21.15.5:0/2919554783 conn(0x7fbe0c0f7450 msgr2=0x7fbe0c0f8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:50.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.815+0000 7fbe1451e700 1 -- 172.21.15.5:0/2919554783 shutdown_connections 2024-04-16T14:35:50.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.815+0000 7fbe1451e700 1 -- 172.21.15.5:0/2919554783 wait complete. 2024-04-16T14:35:50.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.925+0000 7ff179128700 1 -- 172.21.15.5:0/3980496083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff174070890 msgr2=0x7ff174070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:50.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.925+0000 7ff179128700 1 --2- 172.21.15.5:0/3980496083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff174070890 0x7ff174070d00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff168004940 tx=0x7ff168009e30 comp rx=0 tx=0).stop 2024-04-16T14:35:50.924 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:50 smithi005 ceph-mon[28964]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:35:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.925+0000 7ff179128700 1 -- 172.21.15.5:0/3980496083 shutdown_connections 2024-04-16T14:35:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.925+0000 7ff179128700 1 --2- 172.21.15.5:0/3980496083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff174070890 0x7ff174070d00 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.925+0000 7ff179128700 1 --2- 172.21.15.5:0/3980496083 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff174071e40 0x7ff174070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.925+0000 7ff179128700 1 -- 172.21.15.5:0/3980496083 >> 172.21.15.5:0/3980496083 conn(0x7ff1740f85e0 msgr2=0x7ff1740fa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.925+0000 7ff179128700 1 -- 172.21.15.5:0/3980496083 shutdown_connections 2024-04-16T14:35:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.925+0000 7ff179128700 1 -- 172.21.15.5:0/3980496083 wait complete. 2024-04-16T14:35:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.926+0000 7ff179128700 1 Processor -- start 2024-04-16T14:35:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.926+0000 7ff179128700 1 -- start start 2024-04-16T14:35:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.927+0000 7ff179128700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff174070890 0x7ff17410fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.927+0000 7ff179128700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff174071e40 0x7ff174110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.927+0000 7ff179128700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff174110770 con 0x7ff174070890 2024-04-16T14:35:50.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.927+0000 7ff179128700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff174110fc0 con 0x7ff174071e40 2024-04-16T14:35:50.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.927+0000 7ff172d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff174070890 0x7ff17410fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:50.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.927+0000 7ff172d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff174070890 0x7ff17410fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32916/0 (socket says 172.21.15.5:32916) 2024-04-16T14:35:50.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.927+0000 7ff172d9d700 1 -- 172.21.15.5:0/2580411137 learned_addr learned my addr 172.21.15.5:0/2580411137 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:35:50.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.927+0000 7ff17259c700 1 --2- 172.21.15.5:0/2580411137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff174071e40 0x7ff174110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:50.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.927+0000 7ff172d9d700 1 -- 172.21.15.5:0/2580411137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff174071e40 msgr2=0x7ff174110170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:50.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.927+0000 7ff172d9d700 1 --2- 172.21.15.5:0/2580411137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff174071e40 0x7ff174110170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:50.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.927+0000 7ff172d9d700 1 -- 172.21.15.5:0/2580411137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff168005040 con 0x7ff174070890 2024-04-16T14:35:50.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.927+0000 7ff172d9d700 1 --2- 172.21.15.5:0/2580411137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff174070890 0x7ff17410fc30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff164002a80 tx=0x7ff164004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:50.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.927+0000 7ff15b7fe700 1 -- 172.21.15.5:0/2580411137 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff164007cc0 con 0x7ff174070890 2024-04-16T14:35:50.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.928+0000 7ff179128700 1 -- 172.21.15.5:0/2580411137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1741112a0 con 0x7ff174070890 2024-04-16T14:35:50.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.928+0000 7ff15b7fe700 1 -- 172.21.15.5:0/2580411137 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff16400f040 con 0x7ff174070890 2024-04-16T14:35:50.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.928+0000 7ff15b7fe700 1 -- 172.21.15.5:0/2580411137 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff16400da30 con 0x7ff174070890 2024-04-16T14:35:50.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.928+0000 7ff179128700 1 -- 172.21.15.5:0/2580411137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1741117e0 con 0x7ff174070890 2024-04-16T14:35:50.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.929+0000 7ff179128700 1 -- 172.21.15.5:0/2580411137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff17405f5f0 con 0x7ff174070890 2024-04-16T14:35:50.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.930+0000 7ff15b7fe700 1 -- 172.21.15.5:0/2580411137 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 89381+0+0 (secure 0 0 0) 0x7ff16400db90 con 0x7ff174070890 2024-04-16T14:35:50.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.930+0000 7ff15b7fe700 1 --2- 172.21.15.5:0/2580411137 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7ff15c06b790 0x7ff15c06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:50.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.930+0000 7ff15b7fe700 1 -- 172.21.15.5:0/2580411137 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7ff16408a830 con 0x7ff174070890 2024-04-16T14:35:50.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.931+0000 7ff17259c700 1 --2- 172.21.15.5:0/2580411137 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7ff15c06b790 0x7ff15c06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:50.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.931+0000 7ff17259c700 1 --2- 172.21.15.5:0/2580411137 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7ff15c06b790 0x7ff15c06dc40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff16800b3b0 tx=0x7ff168009e30 comp rx=0 tx=0).ready entity=mgr.14616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:50.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:50 smithi115 ceph-mon[37295]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:35:50.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:50.937+0000 7ff15b7fe700 1 -- 172.21.15.5:0/2580411137 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7ff164057f50 con 0x7ff174070890 2024-04-16T14:35:51.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.334+0000 7ff179128700 1 -- 172.21.15.5:0/2580411137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff174107af0 con 0x7ff174070890 2024-04-16T14:35:51.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.336+0000 7ff15b7fe700 1 -- 172.21.15.5:0/2580411137 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7ff164057ae0 con 0x7ff174070890 2024-04-16T14:35:51.334 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:35:51.334 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-04-16T14:35:51.335 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 2 2024-04-16T14:35:51.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:35:51.335 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-04-16T14:35:51.335 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 1, 2024-04-16T14:35:51.335 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 1 2024-04-16T14:35:51.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:35:51.335 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-04-16T14:35:51.335 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 6 2024-04-16T14:35:51.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:35:51.335 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-04-16T14:35:51.335 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 4 2024-04-16T14:35:51.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:35:51.335 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-04-16T14:35:51.335 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 13, 2024-04-16T14:35:51.336 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 1 2024-04-16T14:35:51.336 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-16T14:35:51.336 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:35:51.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.340+0000 7ff179128700 1 -- 172.21.15.5:0/2580411137 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7ff15c06b790 msgr2=0x7ff15c06dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:51.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.340+0000 7ff179128700 1 --2- 172.21.15.5:0/2580411137 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7ff15c06b790 0x7ff15c06dc40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff16800b3b0 tx=0x7ff168009e30 comp rx=0 tx=0).stop 2024-04-16T14:35:51.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.340+0000 7ff179128700 1 -- 172.21.15.5:0/2580411137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff174070890 msgr2=0x7ff17410fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:51.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.340+0000 7ff179128700 1 --2- 172.21.15.5:0/2580411137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff174070890 0x7ff17410fc30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff164002a80 tx=0x7ff164004600 comp rx=0 tx=0).stop 2024-04-16T14:35:51.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.342+0000 7ff179128700 1 -- 172.21.15.5:0/2580411137 shutdown_connections 2024-04-16T14:35:51.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.342+0000 7ff179128700 1 --2- 172.21.15.5:0/2580411137 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7ff15c06b790 0x7ff15c06dc40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:51.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.342+0000 7ff179128700 1 --2- 172.21.15.5:0/2580411137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff174070890 0x7ff17410fc30 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:51.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.342+0000 7ff179128700 1 --2- 172.21.15.5:0/2580411137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff174071e40 0x7ff174110170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:51.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.342+0000 7ff179128700 1 -- 172.21.15.5:0/2580411137 >> 172.21.15.5:0/2580411137 conn(0x7ff1740f85e0 msgr2=0x7ff1740f9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:51.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.342+0000 7ff179128700 1 -- 172.21.15.5:0/2580411137 shutdown_connections 2024-04-16T14:35:51.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.342+0000 7ff179128700 1 -- 172.21.15.5:0/2580411137 wait complete. 2024-04-16T14:35:51.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.474+0000 7fd901044700 1 -- 172.21.15.5:0/177409837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8fc066b80 msgr2=0x7fd8fc0ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:51.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.474+0000 7fd901044700 1 --2- 172.21.15.5:0/177409837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8fc066b80 0x7fd8fc0ff9e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec004940 tx=0x7fd8ec009e30 comp rx=0 tx=0).stop 2024-04-16T14:35:51.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.474+0000 7fd901044700 1 -- 172.21.15.5:0/177409837 shutdown_connections 2024-04-16T14:35:51.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.474+0000 7fd901044700 1 --2- 172.21.15.5:0/177409837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8fc0fff20 0x7fd8fc102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:51.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.474+0000 7fd901044700 1 --2- 172.21.15.5:0/177409837 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8fc066b80 0x7fd8fc0ff9e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:51.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.474+0000 7fd901044700 1 -- 172.21.15.5:0/177409837 >> 172.21.15.5:0/177409837 conn(0x7fd8fc0f7450 msgr2=0x7fd8fc0f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:51.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.474+0000 7fd901044700 1 -- 172.21.15.5:0/177409837 shutdown_connections 2024-04-16T14:35:51.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.475+0000 7fd901044700 1 -- 172.21.15.5:0/177409837 wait complete. 2024-04-16T14:35:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.475+0000 7fd901044700 1 Processor -- start 2024-04-16T14:35:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.475+0000 7fd901044700 1 -- start start 2024-04-16T14:35:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.476+0000 7fd901044700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8fc066b80 0x7fd8fc10da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.476+0000 7fd901044700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8fc0fff20 0x7fd8fc10df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.476+0000 7fd901044700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc10e570 con 0x7fd8fc0fff20 2024-04-16T14:35:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.476+0000 7fd901044700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc10ed70 con 0x7fd8fc066b80 2024-04-16T14:35:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.476+0000 7fd8fa59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8fc0fff20 0x7fd8fc10df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.476+0000 7fd8fa59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8fc0fff20 0x7fd8fc10df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32926/0 (socket says 172.21.15.5:32926) 2024-04-16T14:35:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.476+0000 7fd8fa59c700 1 -- 172.21.15.5:0/3297982308 learned_addr learned my addr 172.21.15.5:0/3297982308 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:35:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.476+0000 7fd8fad9d700 1 --2- 172.21.15.5:0/3297982308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8fc066b80 0x7fd8fc10da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.476+0000 7fd8fa59c700 1 -- 172.21.15.5:0/3297982308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8fc066b80 msgr2=0x7fd8fc10da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.476+0000 7fd8fa59c700 1 --2- 172.21.15.5:0/3297982308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8fc066b80 0x7fd8fc10da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.476+0000 7fd8fa59c700 1 -- 172.21.15.5:0/3297982308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ec005040 con 0x7fd8fc0fff20 2024-04-16T14:35:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.476+0000 7fd8fa59c700 1 --2- 172.21.15.5:0/3297982308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8fc0fff20 0x7fd8fc10df70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000eb40 tx=0x7fd8f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.477+0000 7fd8e37fe700 1 -- 172.21.15.5:0/3297982308 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8f0007cc0 con 0x7fd8fc0fff20 2024-04-16T14:35:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.477+0000 7fd901044700 1 -- 172.21.15.5:0/3297982308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8fc10eff0 con 0x7fd8fc0fff20 2024-04-16T14:35:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.477+0000 7fd8e37fe700 1 -- 172.21.15.5:0/3297982308 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd8f000f040 con 0x7fd8fc0fff20 2024-04-16T14:35:51.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.477+0000 7fd901044700 1 -- 172.21.15.5:0/3297982308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8fc10f530 con 0x7fd8fc0fff20 2024-04-16T14:35:51.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.477+0000 7fd8e37fe700 1 -- 172.21.15.5:0/3297982308 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8f000c9b0 con 0x7fd8fc0fff20 2024-04-16T14:35:51.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.478+0000 7fd901044700 1 -- 172.21.15.5:0/3297982308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8fc05f5f0 con 0x7fd8fc0fff20 2024-04-16T14:35:51.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.479+0000 7fd8e37fe700 1 -- 172.21.15.5:0/3297982308 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 89381+0+0 (secure 0 0 0) 0x7fd8f000cbf0 con 0x7fd8fc0fff20 2024-04-16T14:35:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.479+0000 7fd8e37fe700 1 --2- 172.21.15.5:0/3297982308 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fd8e406b7e0 0x7fd8e406dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.479+0000 7fd8e37fe700 1 -- 172.21.15.5:0/3297982308 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fd8f008a080 con 0x7fd8fc0fff20 2024-04-16T14:35:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.480+0000 7fd8fad9d700 1 --2- 172.21.15.5:0/3297982308 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fd8e406b7e0 0x7fd8e406dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:51.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.480+0000 7fd8fad9d700 1 --2- 172.21.15.5:0/3297982308 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fd8e406b7e0 0x7fd8e406dc90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec004890 tx=0x7fd8ec009e30 comp rx=0 tx=0).ready entity=mgr.14616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:51.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.487+0000 7fd8e37fe700 1 -- 172.21.15.5:0/3297982308 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7fd8f0050100 con 0x7fd8fc0fff20 2024-04-16T14:35:51.713 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:51 smithi005 ceph-mon[28964]: pgmap v30: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 260 MiB/s rd, 307 MiB/s wr, 434 op/s 2024-04-16T14:35:51.713 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:51 smithi005 ceph-mon[28964]: from='client.24459 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:35:51.713 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:51 smithi005 ceph-mon[28964]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:35:51.714 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:51 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/2580411137' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:35:51.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.846+0000 7fd901044700 1 -- 172.21.15.5:0/3297982308 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd8fc04bed0 con 0x7fd8fc0fff20 2024-04-16T14:35:51.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.846+0000 7fd8e37fe700 1 -- 172.21.15.5:0/3297982308 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1846 (secure 0 0 0) 0x7fd8f00576a0 con 0x7fd8fc0fff20 2024-04-16T14:35:51.845 INFO:teuthology.orchestra.run.smithi005.stdout:e20 2024-04-16T14:35:51.845 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:35:51.845 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:35:51.845 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2024-04-16T14:35:51.845 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:35:51.845 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2024-04-16T14:35:51.845 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2024-04-16T14:35:51.845 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 20 2024-04-16T14:35:51.845 INFO:teuthology.orchestra.run.smithi005.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-16T14:35:51.845 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-16T14:32:45.270024+0000 2024-04-16T14:35:51.845 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-04-16T14:35:42.742829+0000 2024-04-16T14:35:51.846 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2024-04-16T14:35:51.846 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2024-04-16T14:35:51.846 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 60 2024-04-16T14:35:51.846 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2024-04-16T14:35:51.846 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2024-04-16T14:35:51.846 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2024-04-16T14:35:51.846 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2024-04-16T14:35:51.846 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 47 2024-04-16T14:35:51.846 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:35:51.846 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 2 2024-04-16T14:35:51.846 INFO:teuthology.orchestra.run.smithi005.stdout:in 0,1 2024-04-16T14:35:51.846 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=14484,1=24269} 2024-04-16T14:35:51.846 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2024-04-16T14:35:51.846 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2024-04-16T14:35:51.847 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 2024-04-16T14:35:51.847 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3] 2024-04-16T14:35:51.847 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2024-04-16T14:35:51.847 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2024-04-16T14:35:51.847 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2024-04-16T14:35:51.847 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 1 2024-04-16T14:35:51.847 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.wofqlz{0:14484} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:35:51.847 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.byfytg{1:24269} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.115:6824/1662994117,v1:172.21.15.115:6825/1662994117] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:35:51.847 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:35:51.847 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:35:51.847 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2024-04-16T14:35:51.847 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:35:51.847 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.vzoqdl{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.5:6826/187766809,v1:172.21.15.5:6827/187766809] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:35:51.847 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.trkaqh{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:35:51.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.848+0000 7fd901044700 1 -- 172.21.15.5:0/3297982308 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fd8e406b7e0 msgr2=0x7fd8e406dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:51.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.848+0000 7fd901044700 1 --2- 172.21.15.5:0/3297982308 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fd8e406b7e0 0x7fd8e406dc90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec004890 tx=0x7fd8ec009e30 comp rx=0 tx=0).stop 2024-04-16T14:35:51.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.848+0000 7fd901044700 1 -- 172.21.15.5:0/3297982308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8fc0fff20 msgr2=0x7fd8fc10df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:51.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.848+0000 7fd901044700 1 --2- 172.21.15.5:0/3297982308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8fc0fff20 0x7fd8fc10df70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000eb40 tx=0x7fd8f000b040 comp rx=0 tx=0).stop 2024-04-16T14:35:51.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.849+0000 7fd901044700 1 -- 172.21.15.5:0/3297982308 shutdown_connections 2024-04-16T14:35:51.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.849+0000 7fd901044700 1 --2- 172.21.15.5:0/3297982308 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fd8e406b7e0 0x7fd8e406dc90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:51.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.849+0000 7fd901044700 1 --2- 172.21.15.5:0/3297982308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8fc066b80 0x7fd8fc10da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:51.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.849+0000 7fd901044700 1 --2- 172.21.15.5:0/3297982308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd8fc0fff20 0x7fd8fc10df70 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:51.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.849+0000 7fd901044700 1 -- 172.21.15.5:0/3297982308 >> 172.21.15.5:0/3297982308 conn(0x7fd8fc0f7450 msgr2=0x7fd8fc0f7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:51.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.849+0000 7fd901044700 1 -- 172.21.15.5:0/3297982308 shutdown_connections 2024-04-16T14:35:51.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.849+0000 7fd901044700 1 -- 172.21.15.5:0/3297982308 wait complete. 2024-04-16T14:35:51.849 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 20 2024-04-16T14:35:51.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:51 smithi115 ceph-mon[37295]: pgmap v30: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 260 MiB/s rd, 307 MiB/s wr, 434 op/s 2024-04-16T14:35:51.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:51 smithi115 ceph-mon[37295]: from='client.24459 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:35:51.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:51 smithi115 ceph-mon[37295]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:35:51.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:51 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/2580411137' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:35:51.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.966+0000 7fd8a0cf5700 1 -- 172.21.15.5:0/1954646804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd89c0fe050 msgr2=0x7fd89c0fe4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:51.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.966+0000 7fd8a0cf5700 1 --2- 172.21.15.5:0/1954646804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd89c0fe050 0x7fd89c0fe4c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd890004940 tx=0x7fd890009e30 comp rx=0 tx=0).stop 2024-04-16T14:35:51.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.967+0000 7fd8a0cf5700 1 -- 172.21.15.5:0/1954646804 shutdown_connections 2024-04-16T14:35:51.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.967+0000 7fd8a0cf5700 1 --2- 172.21.15.5:0/1954646804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd89c0fe050 0x7fd89c0fe4c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:51.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.967+0000 7fd8a0cf5700 1 --2- 172.21.15.5:0/1954646804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd89c0fce50 0x7fd89c0fd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:51.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.967+0000 7fd8a0cf5700 1 -- 172.21.15.5:0/1954646804 >> 172.21.15.5:0/1954646804 conn(0x7fd89c0f8580 msgr2=0x7fd89c0fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:51.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.967+0000 7fd8a0cf5700 1 -- 172.21.15.5:0/1954646804 shutdown_connections 2024-04-16T14:35:51.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.967+0000 7fd8a0cf5700 1 -- 172.21.15.5:0/1954646804 wait complete. 2024-04-16T14:35:51.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.967+0000 7fd8a0cf5700 1 Processor -- start 2024-04-16T14:35:51.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.967+0000 7fd8a0cf5700 1 -- start start 2024-04-16T14:35:51.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.967+0000 7fd8a0cf5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd89c0fce50 0x7fd89c10d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:51.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.967+0000 7fd8a0cf5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd89c0fe050 0x7fd89c10df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:51.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.967+0000 7fd8a0cf5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c10e500 con 0x7fd89c0fe050 2024-04-16T14:35:51.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.967+0000 7fd8a0cf5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c10ed50 con 0x7fd89c0fce50 2024-04-16T14:35:51.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.968+0000 7fd89a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd89c0fce50 0x7fd89c10d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:51.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.968+0000 7fd89a59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd89c0fce50 0x7fd89c10d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.5:38364/0 (socket says 172.21.15.5:38364) 2024-04-16T14:35:51.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.968+0000 7fd89a59c700 1 -- 172.21.15.5:0/1363571922 learned_addr learned my addr 172.21.15.5:0/1363571922 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:35:51.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.968+0000 7fd899d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd89c0fe050 0x7fd89c10df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:51.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.968+0000 7fd899d9b700 1 -- 172.21.15.5:0/1363571922 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd89c0fce50 msgr2=0x7fd89c10d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:51.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.968+0000 7fd899d9b700 1 --2- 172.21.15.5:0/1363571922 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd89c0fce50 0x7fd89c10d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:51.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.968+0000 7fd899d9b700 1 -- 172.21.15.5:0/1363571922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd890005040 con 0x7fd89c0fe050 2024-04-16T14:35:51.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.968+0000 7fd89a59c700 1 --2- 172.21.15.5:0/1363571922 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd89c0fce50 0x7fd89c10d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T14:35:51.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.968+0000 7fd899d9b700 1 --2- 172.21.15.5:0/1363571922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd89c0fe050 0x7fd89c10df00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd8900043d0 tx=0x7fd890009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:51.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.968+0000 7fd88affd700 1 -- 172.21.15.5:0/1363571922 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd890020070 con 0x7fd89c0fe050 2024-04-16T14:35:51.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.969+0000 7fd8a0cf5700 1 -- 172.21.15.5:0/1363571922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89c10efd0 con 0x7fd89c0fe050 2024-04-16T14:35:51.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.969+0000 7fd88affd700 1 -- 172.21.15.5:0/1363571922 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd89001c400 con 0x7fd89c0fe050 2024-04-16T14:35:51.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.969+0000 7fd8a0cf5700 1 -- 172.21.15.5:0/1363571922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd89c10f4b0 con 0x7fd89c0fe050 2024-04-16T14:35:51.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.969+0000 7fd88affd700 1 -- 172.21.15.5:0/1363571922 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd89000e070 con 0x7fd89c0fe050 2024-04-16T14:35:51.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.970+0000 7fd8a0cf5700 1 -- 172.21.15.5:0/1363571922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd89c05f5f0 con 0x7fd89c0fe050 2024-04-16T14:35:51.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.971+0000 7fd88affd700 1 -- 172.21.15.5:0/1363571922 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 89381+0+0 (secure 0 0 0) 0x7fd89001ca90 con 0x7fd89c0fe050 2024-04-16T14:35:51.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.971+0000 7fd88affd700 1 --2- 172.21.15.5:0/1363571922 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fd88406b830 0x7fd88406dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:51.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.971+0000 7fd88affd700 1 -- 172.21.15.5:0/1363571922 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fd89008bfd0 con 0x7fd89c0fe050 2024-04-16T14:35:51.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.972+0000 7fd89a59c700 1 --2- 172.21.15.5:0/1363571922 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fd88406b830 0x7fd88406dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:51.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.972+0000 7fd89a59c700 1 --2- 172.21.15.5:0/1363571922 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fd88406b830 0x7fd88406dce0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd88c004bd0 tx=0x7fd88c00b040 comp rx=0 tx=0).ready entity=mgr.14616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:51.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:51.977+0000 7fd88affd700 1 -- 172.21.15.5:0/1363571922 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7fd890059700 con 0x7fd89c0fe050 2024-04-16T14:35:52.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.326+0000 7fd8a0cf5700 1 -- 172.21.15.5:0/1363571922 --> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd89c10f7d0 con 0x7fd88406b830 2024-04-16T14:35:52.327 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:35:52.327 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91", 2024-04-16T14:35:52.327 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-04-16T14:35:52.327 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-16T14:35:52.327 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [], 2024-04-16T14:35:52.327 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "1/21 daemons upgraded", 2024-04-16T14:35:52.327 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "", 2024-04-16T14:35:52.327 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-04-16T14:35:52.327 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:35:52.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.328+0000 7fd88affd700 1 -- 172.21.15.5:0/1363571922 <== mgr.14616 v2:172.21.15.115:6828/460631486 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fd89c10f7d0 con 0x7fd88406b830 2024-04-16T14:35:52.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.333+0000 7fd8a0cf5700 1 -- 172.21.15.5:0/1363571922 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fd88406b830 msgr2=0x7fd88406dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:52.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.333+0000 7fd8a0cf5700 1 --2- 172.21.15.5:0/1363571922 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fd88406b830 0x7fd88406dce0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd88c004bd0 tx=0x7fd88c00b040 comp rx=0 tx=0).stop 2024-04-16T14:35:52.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.333+0000 7fd8a0cf5700 1 -- 172.21.15.5:0/1363571922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd89c0fe050 msgr2=0x7fd89c10df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:52.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.333+0000 7fd8a0cf5700 1 --2- 172.21.15.5:0/1363571922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd89c0fe050 0x7fd89c10df00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd8900043d0 tx=0x7fd890009e30 comp rx=0 tx=0).stop 2024-04-16T14:35:52.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.333+0000 7fd8a0cf5700 1 -- 172.21.15.5:0/1363571922 shutdown_connections 2024-04-16T14:35:52.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.333+0000 7fd8a0cf5700 1 --2- 172.21.15.5:0/1363571922 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fd88406b830 0x7fd88406dce0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:52.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.333+0000 7fd8a0cf5700 1 --2- 172.21.15.5:0/1363571922 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd89c0fce50 0x7fd89c10d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:52.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.333+0000 7fd8a0cf5700 1 --2- 172.21.15.5:0/1363571922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd89c0fe050 0x7fd89c10df00 secure :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd8900043d0 tx=0x7fd890009e30 comp rx=0 tx=0).stop 2024-04-16T14:35:52.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.333+0000 7fd8a0cf5700 1 -- 172.21.15.5:0/1363571922 >> 172.21.15.5:0/1363571922 conn(0x7fd89c0f8580 msgr2=0x7fd89c0f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:52.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.334+0000 7fd8a0cf5700 1 -- 172.21.15.5:0/1363571922 shutdown_connections 2024-04-16T14:35:52.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.334+0000 7fd8a0cf5700 1 -- 172.21.15.5:0/1363571922 wait complete. 2024-04-16T14:35:52.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.496+0000 7f2bb06a2700 1 -- 172.21.15.5:0/129982004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ba80fbd40 msgr2=0x7f2ba80fc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:52.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.496+0000 7f2bb06a2700 1 --2- 172.21.15.5:0/129982004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ba80fbd40 0x7f2ba80fc150 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4004940 tx=0x7f2ba4009e30 comp rx=0 tx=0).stop 2024-04-16T14:35:52.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.496+0000 7f2bb06a2700 1 -- 172.21.15.5:0/129982004 shutdown_connections 2024-04-16T14:35:52.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.496+0000 7f2bb06a2700 1 --2- 172.21.15.5:0/129982004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ba80fcff0 0x7f2ba80fd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:52.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.496+0000 7f2bb06a2700 1 --2- 172.21.15.5:0/129982004 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ba80fbd40 0x7f2ba80fc150 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:52.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.496+0000 7f2bb06a2700 1 -- 172.21.15.5:0/129982004 >> 172.21.15.5:0/129982004 conn(0x7f2ba80f74c0 msgr2=0x7f2ba80f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:52.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.496+0000 7f2bb06a2700 1 -- 172.21.15.5:0/129982004 shutdown_connections 2024-04-16T14:35:52.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.496+0000 7f2bb06a2700 1 -- 172.21.15.5:0/129982004 wait complete. 2024-04-16T14:35:52.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.497+0000 7f2bb06a2700 1 Processor -- start 2024-04-16T14:35:52.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.497+0000 7f2bb06a2700 1 -- start start 2024-04-16T14:35:52.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.497+0000 7f2bb06a2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ba80fbd40 0x7f2ba810d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:52.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.497+0000 7f2bb06a2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ba80fcff0 0x7f2ba810df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:52.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.497+0000 7f2bb06a2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba810e520 con 0x7f2ba80fbd40 2024-04-16T14:35:52.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.497+0000 7f2bb06a2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba810ed20 con 0x7f2ba80fcff0 2024-04-16T14:35:52.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.497+0000 7f2bae43e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ba80fbd40 0x7f2ba810d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:52.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.497+0000 7f2bae43e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ba80fbd40 0x7f2ba810d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32952/0 (socket says 172.21.15.5:32952) 2024-04-16T14:35:52.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.497+0000 7f2bae43e700 1 -- 172.21.15.5:0/1558291886 learned_addr learned my addr 172.21.15.5:0/1558291886 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:35:52.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.497+0000 7f2badc3d700 1 --2- 172.21.15.5:0/1558291886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ba80fcff0 0x7f2ba810df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:52.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.498+0000 7f2bae43e700 1 -- 172.21.15.5:0/1558291886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ba80fcff0 msgr2=0x7f2ba810df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:52.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.498+0000 7f2bae43e700 1 --2- 172.21.15.5:0/1558291886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ba80fcff0 0x7f2ba810df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:52.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.498+0000 7f2bae43e700 1 -- 172.21.15.5:0/1558291886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba4005040 con 0x7f2ba80fbd40 2024-04-16T14:35:52.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.498+0000 7f2badc3d700 1 --2- 172.21.15.5:0/1558291886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ba80fcff0 0x7f2ba810df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T14:35:52.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.498+0000 7f2bae43e700 1 --2- 172.21.15.5:0/1558291886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ba80fbd40 0x7f2ba810d9e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400b0d0 tx=0x7f2ba4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:52.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.498+0000 7f2b9affd700 1 -- 172.21.15.5:0/1558291886 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ba400e030 con 0x7f2ba80fbd40 2024-04-16T14:35:52.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.498+0000 7f2b9affd700 1 -- 172.21.15.5:0/1558291886 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2ba401c400 con 0x7f2ba80fbd40 2024-04-16T14:35:52.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.498+0000 7f2b9affd700 1 -- 172.21.15.5:0/1558291886 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ba400b630 con 0x7f2ba80fbd40 2024-04-16T14:35:52.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.498+0000 7f2bb06a2700 1 -- 172.21.15.5:0/1558291886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba810efa0 con 0x7f2ba80fbd40 2024-04-16T14:35:52.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.498+0000 7f2bb06a2700 1 -- 172.21.15.5:0/1558291886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba810f4e0 con 0x7f2ba80fbd40 2024-04-16T14:35:52.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.499+0000 7f2bb06a2700 1 -- 172.21.15.5:0/1558291886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba8101b80 con 0x7f2ba80fbd40 2024-04-16T14:35:52.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.500+0000 7f2b9affd700 1 -- 172.21.15.5:0/1558291886 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 24) v1 ==== 89381+0+0 (secure 0 0 0) 0x7f2ba401c570 con 0x7f2ba80fbd40 2024-04-16T14:35:52.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.501+0000 7f2b9affd700 1 --2- 172.21.15.5:0/1558291886 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f2b9406b860 0x7f2b9406dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:35:52.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.501+0000 7f2b9affd700 1 -- 172.21.15.5:0/1558291886 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f2ba408bbc0 con 0x7f2ba80fbd40 2024-04-16T14:35:52.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.502+0000 7f2badc3d700 1 --2- 172.21.15.5:0/1558291886 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f2b9406b860 0x7f2b9406dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:35:52.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.502+0000 7f2badc3d700 1 --2- 172.21.15.5:0/1558291886 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f2b9406b860 0x7f2b9406dd10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c009b80 tx=0x7f2b9c00b040 comp rx=0 tx=0).ready entity=mgr.14616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:35:52.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.506+0000 7f2b9affd700 1 -- 172.21.15.5:0/1558291886 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f2ba4059410 con 0x7f2ba80fbd40 2024-04-16T14:35:52.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:52 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/3297982308' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:35:52.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:52 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:52.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:52 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:52.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.974+0000 7f2bb06a2700 1 -- 172.21.15.5:0/1558291886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2ba8104950 con 0x7f2ba80fbd40 2024-04-16T14:35:52.973 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:52 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/3297982308' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:35:52.973 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:52 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:52.973 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:52 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:52.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.974+0000 7f2b9affd700 1 -- 172.21.15.5:0/1558291886 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f2ba8104950 con 0x7f2ba80fbd40 2024-04-16T14:35:52.973 INFO:teuthology.orchestra.run.smithi005.stdout:HEALTH_OK 2024-04-16T14:35:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.977+0000 7f2bb06a2700 1 -- 172.21.15.5:0/1558291886 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f2b9406b860 msgr2=0x7f2b9406dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.977+0000 7f2bb06a2700 1 --2- 172.21.15.5:0/1558291886 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f2b9406b860 0x7f2b9406dd10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c009b80 tx=0x7f2b9c00b040 comp rx=0 tx=0).stop 2024-04-16T14:35:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.977+0000 7f2bb06a2700 1 -- 172.21.15.5:0/1558291886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ba80fbd40 msgr2=0x7f2ba810d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:35:52.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.977+0000 7f2bb06a2700 1 --2- 172.21.15.5:0/1558291886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ba80fbd40 0x7f2ba810d9e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400b0d0 tx=0x7f2ba4009e30 comp rx=0 tx=0).stop 2024-04-16T14:35:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.977+0000 7f2bb06a2700 1 -- 172.21.15.5:0/1558291886 shutdown_connections 2024-04-16T14:35:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.977+0000 7f2bb06a2700 1 --2- 172.21.15.5:0/1558291886 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f2b9406b860 0x7f2b9406dd10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.977+0000 7f2bb06a2700 1 --2- 172.21.15.5:0/1558291886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2ba80fbd40 0x7f2ba810d9e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.977+0000 7f2bb06a2700 1 --2- 172.21.15.5:0/1558291886 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ba80fcff0 0x7f2ba810df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:35:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.977+0000 7f2bb06a2700 1 -- 172.21.15.5:0/1558291886 >> 172.21.15.5:0/1558291886 conn(0x7f2ba80f74c0 msgr2=0x7f2ba8065b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:35:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.977+0000 7f2bb06a2700 1 -- 172.21.15.5:0/1558291886 shutdown_connections 2024-04-16T14:35:52.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:35:52.977+0000 7f2bb06a2700 1 -- 172.21.15.5:0/1558291886 wait complete. 2024-04-16T14:35:53.837 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:53 smithi005 ceph-mon[28964]: pgmap v31: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 270 MiB/s rd, 321 MiB/s wr, 448 op/s 2024-04-16T14:35:53.837 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:53 smithi005 ceph-mon[28964]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:35:53.837 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:53 smithi005 ceph-mon[28964]: Reconfiguring prometheus.smithi005 (dependencies changed)... 2024-04-16T14:35:53.838 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:53 smithi005 ceph-mon[28964]: Reconfiguring daemon prometheus.smithi005 on smithi005 2024-04-16T14:35:53.838 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:53 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/1558291886' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:35:53.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:53 smithi115 ceph-mon[37295]: pgmap v31: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 270 MiB/s rd, 321 MiB/s wr, 448 op/s 2024-04-16T14:35:53.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:53 smithi115 ceph-mon[37295]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:35:53.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:53 smithi115 ceph-mon[37295]: Reconfiguring prometheus.smithi005 (dependencies changed)... 2024-04-16T14:35:53.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:53 smithi115 ceph-mon[37295]: Reconfiguring daemon prometheus.smithi005 on smithi005 2024-04-16T14:35:53.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:53 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/1558291886' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:35:55.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:55 smithi115 ceph-mon[37295]: pgmap v32: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 282 MiB/s rd, 331 MiB/s wr, 545 op/s 2024-04-16T14:35:55.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:55 smithi005 ceph-mon[28964]: pgmap v32: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 282 MiB/s rd, 331 MiB/s wr, 545 op/s 2024-04-16T14:35:56.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:56 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:35:56.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:56 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:35:57.895 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:57 smithi005 ceph-mon[28964]: pgmap v33: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 161 MiB/s rd, 192 MiB/s wr, 332 op/s 2024-04-16T14:35:57.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:57 smithi115 ceph-mon[37295]: pgmap v33: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 161 MiB/s rd, 192 MiB/s wr, 332 op/s 2024-04-16T14:35:59.594 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:59 smithi115 ceph-mon[37295]: pgmap v34: 65 pgs: 65 active+clean; 2.2 GiB data, 8.4 GiB used, 528 GiB / 536 GiB avail; 161 MiB/s rd, 193 MiB/s wr, 450 op/s 2024-04-16T14:35:59.595 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:59 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:59.595 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:59 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:59.595 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:59 smithi115 ceph-mon[37295]: Reconfiguring node-exporter.smithi115 (dependencies changed)... 2024-04-16T14:35:59.595 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:35:59 smithi115 ceph-mon[37295]: Reconfiguring daemon node-exporter.smithi115 on smithi115 2024-04-16T14:35:59.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:59 smithi005 ceph-mon[28964]: pgmap v34: 65 pgs: 65 active+clean; 2.2 GiB data, 8.4 GiB used, 528 GiB / 536 GiB avail; 161 MiB/s rd, 193 MiB/s wr, 450 op/s 2024-04-16T14:35:59.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:59 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:59.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:59 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:35:59.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:59 smithi005 ceph-mon[28964]: Reconfiguring node-exporter.smithi115 (dependencies changed)... 2024-04-16T14:35:59.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:35:59 smithi005 ceph-mon[28964]: Reconfiguring daemon node-exporter.smithi115 on smithi115 2024-04-16T14:36:00.606 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-16T14:36:00.606 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-04-16T14:36:00.617 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-16T14:36:00.618 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-16T14:36:01.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:01 smithi115 ceph-mon[37295]: pgmap v35: 65 pgs: 65 active+clean; 2.2 GiB data, 8.4 GiB used, 528 GiB / 536 GiB avail; 51 MiB/s rd, 61 MiB/s wr, 256 op/s 2024-04-16T14:36:01.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:01 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:01.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:01 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:01.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:01 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-16T14:36:01.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:01 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-16T14:36:01.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:01 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-16T14:36:01.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:01 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:36:01.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:01 smithi005 ceph-mon[28964]: pgmap v35: 65 pgs: 65 active+clean; 2.2 GiB data, 8.4 GiB used, 528 GiB / 536 GiB avail; 51 MiB/s rd, 61 MiB/s wr, 256 op/s 2024-04-16T14:36:01.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:01 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:01.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:01 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:01.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:01 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-16T14:36:01.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:01 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-16T14:36:01.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:01 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-16T14:36:01.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:01 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:36:02.882 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:02 smithi005 ceph-mon[28964]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-16T14:36:02.882 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:02 smithi005 ceph-mon[28964]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-16T14:36:02.882 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:02 smithi005 ceph-mon[28964]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-16T14:36:02.882 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:02 smithi005 ceph-mon[28964]: Upgrade: Need to upgrade myself (mgr.smithi115.brjkpo) 2024-04-16T14:36:02.882 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:02 smithi005 ceph-mon[28964]: Upgrade: Need to upgrade myself (mgr.smithi115.brjkpo) 2024-04-16T14:36:02.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:02 smithi115 ceph-mon[37295]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-16T14:36:02.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:02 smithi115 ceph-mon[37295]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-16T14:36:02.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:02 smithi115 ceph-mon[37295]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-16T14:36:02.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:02 smithi115 ceph-mon[37295]: Upgrade: Need to upgrade myself (mgr.smithi115.brjkpo) 2024-04-16T14:36:02.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:02 smithi115 ceph-mon[37295]: Upgrade: Need to upgrade myself (mgr.smithi115.brjkpo) 2024-04-16T14:36:03.861 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:03 smithi005 ceph-mon[28964]: pgmap v36: 65 pgs: 65 active+clean; 1.9 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 51 MiB/s rd, 61 MiB/s wr, 274 op/s 2024-04-16T14:36:03.861 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:03 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:03.861 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:03 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi005.ipwdkc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-16T14:36:03.861 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:03 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-16T14:36:03.861 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:03 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:36:03.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:03 smithi115 ceph-mon[37295]: pgmap v36: 65 pgs: 65 active+clean; 1.9 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 51 MiB/s rd, 61 MiB/s wr, 274 op/s 2024-04-16T14:36:03.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:03 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:03.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:03 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi005.ipwdkc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-16T14:36:03.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:03 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-16T14:36:03.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:03 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:36:04.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:04 smithi005 ceph-mon[28964]: Upgrade: Updating mgr.smithi005.ipwdkc 2024-04-16T14:36:04.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:04 smithi005 ceph-mon[28964]: Deploying daemon mgr.smithi005.ipwdkc on smithi005 2024-04-16T14:36:04.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:04 smithi115 ceph-mon[37295]: Upgrade: Updating mgr.smithi005.ipwdkc 2024-04-16T14:36:04.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:04 smithi115 ceph-mon[37295]: Deploying daemon mgr.smithi005.ipwdkc on smithi005 2024-04-16T14:36:05.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:05 smithi005 ceph-mon[28964]: pgmap v37: 65 pgs: 65 active+clean; 284 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 41 MiB/s rd, 47 MiB/s wr, 390 op/s 2024-04-16T14:36:05.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:05 smithi115 ceph-mon[37295]: pgmap v37: 65 pgs: 65 active+clean; 284 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 41 MiB/s rd, 47 MiB/s wr, 390 op/s 2024-04-16T14:36:07.668 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:07 smithi005 ceph-mon[28964]: pgmap v38: 65 pgs: 65 active+clean; 284 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 41 KiB/s rd, 1.9 MiB/s wr, 265 op/s 2024-04-16T14:36:07.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:07 smithi115 ceph-mon[37295]: pgmap v38: 65 pgs: 65 active+clean; 284 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 41 KiB/s rd, 1.9 MiB/s wr, 265 op/s 2024-04-16T14:36:08.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:08 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:08.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:08 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:08.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:08 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:36:09.096 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:08 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:09.097 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:08 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:09.097 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:08 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:36:09.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:09 smithi115 ceph-mon[37295]: pgmap v39: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 58 KiB/s rd, 2.7 MiB/s wr, 433 op/s 2024-04-16T14:36:09.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:09 smithi005 ceph-mon[28964]: pgmap v39: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 58 KiB/s rd, 2.7 MiB/s wr, 433 op/s 2024-04-16T14:36:12.179 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:11 smithi005 ceph-mon[28964]: pgmap v40: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 1.8 MiB/s wr, 315 op/s 2024-04-16T14:36:12.180 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:11 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:36:12.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:11 smithi115 ceph-mon[37295]: pgmap v40: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 1.8 MiB/s wr, 315 op/s 2024-04-16T14:36:12.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:11 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:36:13.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:13 smithi115 ceph-mon[37295]: pgmap v41: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.8 MiB/s wr, 355 op/s 2024-04-16T14:36:14.115 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:13 smithi005 ceph-mon[28964]: pgmap v41: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.8 MiB/s wr, 355 op/s 2024-04-16T14:36:15.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:15 smithi115 ceph-mon[37295]: pgmap v42: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 2.5 MiB/s wr, 455 op/s 2024-04-16T14:36:16.217 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:15 smithi005 ceph-mon[28964]: pgmap v42: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 2.5 MiB/s wr, 455 op/s 2024-04-16T14:36:17.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:16 smithi115 ceph-mon[37295]: Standby manager daemon smithi005.ipwdkc restarted 2024-04-16T14:36:17.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:16 smithi115 ceph-mon[37295]: Standby manager daemon smithi005.ipwdkc started 2024-04-16T14:36:17.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:16 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi005.ipwdkc/crt"}]: dispatch 2024-04-16T14:36:17.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:16 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-16T14:36:17.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:16 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi005.ipwdkc/key"}]: dispatch 2024-04-16T14:36:17.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:16 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-16T14:36:17.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:16 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:17.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:16 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:17.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:16 smithi005 ceph-mon[28964]: Standby manager daemon smithi005.ipwdkc restarted 2024-04-16T14:36:17.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:16 smithi005 ceph-mon[28964]: Standby manager daemon smithi005.ipwdkc started 2024-04-16T14:36:17.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:16 smithi005 ceph-mon[28964]: from='mgr.? 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi005.ipwdkc/crt"}]: dispatch 2024-04-16T14:36:17.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:16 smithi005 ceph-mon[28964]: from='mgr.? 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-16T14:36:17.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:16 smithi005 ceph-mon[28964]: from='mgr.? 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi005.ipwdkc/key"}]: dispatch 2024-04-16T14:36:17.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:16 smithi005 ceph-mon[28964]: from='mgr.? 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-16T14:36:17.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:16 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:17.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:16 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:18.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:17 smithi115 ceph-mon[37295]: pgmap v43: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.5 MiB/s wr, 326 op/s 2024-04-16T14:36:18.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:17 smithi115 ceph-mon[37295]: mgrmap e25: smithi115.brjkpo(active, since 80s), standbys: smithi005.ipwdkc 2024-04-16T14:36:18.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:17 smithi005 ceph-mon[28964]: pgmap v43: 65 pgs: 65 active+clean; 294 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.5 MiB/s wr, 326 op/s 2024-04-16T14:36:18.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:17 smithi005 ceph-mon[28964]: mgrmap e25: smithi115.brjkpo(active, since 80s), standbys: smithi005.ipwdkc 2024-04-16T14:36:20.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:19 smithi115 ceph-mon[37295]: pgmap v44: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 2.3 MiB/s wr, 483 op/s 2024-04-16T14:36:20.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:19 smithi005 ceph-mon[28964]: pgmap v44: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 2.3 MiB/s wr, 483 op/s 2024-04-16T14:36:22.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:21 smithi115 ceph-mon[37295]: pgmap v45: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.5 MiB/s wr, 315 op/s 2024-04-16T14:36:22.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:21 smithi005 ceph-mon[28964]: pgmap v45: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.5 MiB/s wr, 315 op/s 2024-04-16T14:36:23.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.096+0000 7fb04c4d8700 1 -- 172.21.15.5:0/2097170119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0440fbcf0 msgr2=0x7fb0440fc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:23.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.096+0000 7fb04c4d8700 1 --2- 172.21.15.5:0/2097170119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0440fbcf0 0x7fb0440fc100 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb040004940 tx=0x7fb040009e30 comp rx=0 tx=0).stop 2024-04-16T14:36:23.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.096+0000 7fb04c4d8700 1 -- 172.21.15.5:0/2097170119 shutdown_connections 2024-04-16T14:36:23.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.096+0000 7fb04c4d8700 1 --2- 172.21.15.5:0/2097170119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0440fcfa0 0x7fb0440fd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:23.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.096+0000 7fb04c4d8700 1 --2- 172.21.15.5:0/2097170119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0440fbcf0 0x7fb0440fc100 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:23.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.096+0000 7fb04c4d8700 1 -- 172.21.15.5:0/2097170119 >> 172.21.15.5:0/2097170119 conn(0x7fb0440f7450 msgr2=0x7fb0440f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:23.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.096+0000 7fb04c4d8700 1 -- 172.21.15.5:0/2097170119 shutdown_connections 2024-04-16T14:36:23.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.096+0000 7fb04c4d8700 1 -- 172.21.15.5:0/2097170119 wait complete. 2024-04-16T14:36:23.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.097+0000 7fb04c4d8700 1 Processor -- start 2024-04-16T14:36:23.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.097+0000 7fb04c4d8700 1 -- start start 2024-04-16T14:36:23.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.097+0000 7fb04c4d8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0440fbcf0 0x7fb044066d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:23.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.097+0000 7fb04c4d8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0440fcfa0 0x7fb044112980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:23.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.097+0000 7fb04c4d8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb044112ec0 con 0x7fb0440fcfa0 2024-04-16T14:36:23.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.097+0000 7fb04c4d8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb044113000 con 0x7fb0440fbcf0 2024-04-16T14:36:23.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.097+0000 7fb049a73700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0440fcfa0 0x7fb044112980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:23.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.097+0000 7fb049a73700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0440fcfa0 0x7fb044112980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50224/0 (socket says 172.21.15.5:50224) 2024-04-16T14:36:23.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.097+0000 7fb04a274700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0440fbcf0 0x7fb044066d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:23.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.097+0000 7fb049a73700 1 -- 172.21.15.5:0/2428184119 learned_addr learned my addr 172.21.15.5:0/2428184119 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:36:23.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.098+0000 7fb04a274700 1 -- 172.21.15.5:0/2428184119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0440fcfa0 msgr2=0x7fb044112980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:23.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.098+0000 7fb04a274700 1 --2- 172.21.15.5:0/2428184119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0440fcfa0 0x7fb044112980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:23.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.098+0000 7fb04a274700 1 -- 172.21.15.5:0/2428184119 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb040005040 con 0x7fb0440fbcf0 2024-04-16T14:36:23.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.098+0000 7fb04a274700 1 --2- 172.21.15.5:0/2428184119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0440fbcf0 0x7fb044066d40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb040000c00 tx=0x7fb040009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:23.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.098+0000 7fb03affd700 1 -- 172.21.15.5:0/2428184119 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb04000e030 con 0x7fb0440fbcf0 2024-04-16T14:36:23.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.098+0000 7fb04c4d8700 1 -- 172.21.15.5:0/2428184119 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb044113280 con 0x7fb0440fbcf0 2024-04-16T14:36:23.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.098+0000 7fb03affd700 1 -- 172.21.15.5:0/2428184119 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb040013de0 con 0x7fb0440fbcf0 2024-04-16T14:36:23.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.098+0000 7fb03affd700 1 -- 172.21.15.5:0/2428184119 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb04001ce50 con 0x7fb0440fbcf0 2024-04-16T14:36:23.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.098+0000 7fb04c4d8700 1 -- 172.21.15.5:0/2428184119 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0441137c0 con 0x7fb0440fbcf0 2024-04-16T14:36:23.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.099+0000 7fb04c4d8700 1 -- 172.21.15.5:0/2428184119 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04404c710 con 0x7fb0440fbcf0 2024-04-16T14:36:23.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.100+0000 7fb03affd700 1 -- 172.21.15.5:0/2428184119 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 25) v1 ==== 92029+0+0 (secure 0 0 0) 0x7fb04001c400 con 0x7fb0440fbcf0 2024-04-16T14:36:23.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.100+0000 7fb03affd700 1 --2- 172.21.15.5:0/2428184119 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fb03006db00 0x7fb03006ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:23.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.101+0000 7fb03affd700 1 -- 172.21.15.5:0/2428184119 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb04008ec30 con 0x7fb0440fbcf0 2024-04-16T14:36:23.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.101+0000 7fb049a73700 1 --2- 172.21.15.5:0/2428184119 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fb03006db00 0x7fb03006ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:23.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.101+0000 7fb049a73700 1 --2- 172.21.15.5:0/2428184119 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fb03006db00 0x7fb03006ffb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb034008fd0 tx=0x7fb03400b040 comp rx=0 tx=0).ready entity=mgr.14616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:23.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.105+0000 7fb03affd700 1 -- 172.21.15.5:0/2428184119 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7fb04005c1a0 con 0x7fb0440fbcf0 2024-04-16T14:36:23.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.405+0000 7fb04c4d8700 1 -- 172.21.15.5:0/2428184119 --> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb044101240 con 0x7fb03006db00 2024-04-16T14:36:23.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.407+0000 7fb03affd700 1 -- 172.21.15.5:0/2428184119 <== mgr.14616 v2:172.21.15.115:6828/460631486 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fb044101240 con 0x7fb03006db00 2024-04-16T14:36:23.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.409+0000 7fb04c4d8700 1 -- 172.21.15.5:0/2428184119 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fb03006db00 msgr2=0x7fb03006ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:23.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.409+0000 7fb04c4d8700 1 --2- 172.21.15.5:0/2428184119 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fb03006db00 0x7fb03006ffb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb034008fd0 tx=0x7fb03400b040 comp rx=0 tx=0).stop 2024-04-16T14:36:23.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.409+0000 7fb04c4d8700 1 -- 172.21.15.5:0/2428184119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0440fbcf0 msgr2=0x7fb044066d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:23.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.409+0000 7fb04c4d8700 1 --2- 172.21.15.5:0/2428184119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0440fbcf0 0x7fb044066d40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb040000c00 tx=0x7fb040009e30 comp rx=0 tx=0).stop 2024-04-16T14:36:23.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.410+0000 7fb04c4d8700 1 -- 172.21.15.5:0/2428184119 shutdown_connections 2024-04-16T14:36:23.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.410+0000 7fb04c4d8700 1 --2- 172.21.15.5:0/2428184119 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fb03006db00 0x7fb03006ffb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:23.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.410+0000 7fb04c4d8700 1 --2- 172.21.15.5:0/2428184119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0440fbcf0 0x7fb044066d40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:23.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.410+0000 7fb04c4d8700 1 --2- 172.21.15.5:0/2428184119 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0440fcfa0 0x7fb044112980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:23.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.410+0000 7fb04c4d8700 1 -- 172.21.15.5:0/2428184119 >> 172.21.15.5:0/2428184119 conn(0x7fb0440f7450 msgr2=0x7fb0440f8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:23.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.410+0000 7fb04c4d8700 1 -- 172.21.15.5:0/2428184119 shutdown_connections 2024-04-16T14:36:23.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.410+0000 7fb04c4d8700 1 -- 172.21.15.5:0/2428184119 wait complete. 2024-04-16T14:36:23.425 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-04-16T14:36:23.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.541+0000 7f575b0ac700 1 -- 172.21.15.5:0/1006379453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57540fe040 msgr2=0x7f57540fe4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:23.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.541+0000 7f575b0ac700 1 --2- 172.21.15.5:0/1006379453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57540fe040 0x7f57540fe4b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5740004940 tx=0x7f5740009e30 comp rx=0 tx=0).stop 2024-04-16T14:36:23.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.541+0000 7f575b0ac700 1 -- 172.21.15.5:0/1006379453 shutdown_connections 2024-04-16T14:36:23.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.541+0000 7f575b0ac700 1 --2- 172.21.15.5:0/1006379453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57540fe040 0x7f57540fe4b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:23.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.541+0000 7f575b0ac700 1 --2- 172.21.15.5:0/1006379453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57540fce40 0x7f57540fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:23.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.541+0000 7f575b0ac700 1 -- 172.21.15.5:0/1006379453 >> 172.21.15.5:0/1006379453 conn(0x7f57540f8530 msgr2=0x7f57540fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:23.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.541+0000 7f575b0ac700 1 -- 172.21.15.5:0/1006379453 shutdown_connections 2024-04-16T14:36:23.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.541+0000 7f575b0ac700 1 -- 172.21.15.5:0/1006379453 wait complete. 2024-04-16T14:36:23.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.542+0000 7f575b0ac700 1 Processor -- start 2024-04-16T14:36:23.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.542+0000 7f575b0ac700 1 -- start start 2024-04-16T14:36:23.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.542+0000 7f575b0ac700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57540fce40 0x7f575410d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:23.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.542+0000 7f575b0ac700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57540fe040 0x7f575410def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.542+0000 7f575b0ac700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575410e4f0 con 0x7f57540fce40 2024-04-16T14:36:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.542+0000 7f575b0ac700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575410ed40 con 0x7f57540fe040 2024-04-16T14:36:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.542+0000 7f5758e48700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57540fce40 0x7f575410d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.542+0000 7f5758e48700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57540fce40 0x7f575410d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50232/0 (socket says 172.21.15.5:50232) 2024-04-16T14:36:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.542+0000 7f5753fff700 1 --2- 172.21.15.5:0/2220666453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57540fe040 0x7f575410def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.542+0000 7f5758e48700 1 -- 172.21.15.5:0/2220666453 learned_addr learned my addr 172.21.15.5:0/2220666453 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:36:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.543+0000 7f5758e48700 1 -- 172.21.15.5:0/2220666453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57540fe040 msgr2=0x7f575410def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.543+0000 7f5758e48700 1 --2- 172.21.15.5:0/2220666453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57540fe040 0x7f575410def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.543+0000 7f5758e48700 1 -- 172.21.15.5:0/2220666453 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5740005040 con 0x7f57540fce40 2024-04-16T14:36:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.543+0000 7f5753fff700 1 --2- 172.21.15.5:0/2220666453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57540fe040 0x7f575410def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T14:36:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.543+0000 7f5758e48700 1 --2- 172.21.15.5:0/2220666453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57540fce40 0x7f575410d9b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f574800eb70 tx=0x7f574800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.543+0000 7f57517fa700 1 -- 172.21.15.5:0/2220666453 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5748007cc0 con 0x7f57540fce40 2024-04-16T14:36:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.543+0000 7f57517fa700 1 -- 172.21.15.5:0/2220666453 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f574800f040 con 0x7f57540fce40 2024-04-16T14:36:23.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.543+0000 7f57517fa700 1 -- 172.21.15.5:0/2220666453 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f574800cb20 con 0x7f57540fce40 2024-04-16T14:36:23.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.543+0000 7f575b0ac700 1 -- 172.21.15.5:0/2220666453 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575410efc0 con 0x7f57540fce40 2024-04-16T14:36:23.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.543+0000 7f575b0ac700 1 -- 172.21.15.5:0/2220666453 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575410f4b0 con 0x7f57540fce40 2024-04-16T14:36:23.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.544+0000 7f575b0ac700 1 -- 172.21.15.5:0/2220666453 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f575405f5f0 con 0x7f57540fce40 2024-04-16T14:36:23.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.545+0000 7f57517fa700 1 -- 172.21.15.5:0/2220666453 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 25) v1 ==== 92029+0+0 (secure 0 0 0) 0x7f574800cc80 con 0x7f57540fce40 2024-04-16T14:36:23.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.545+0000 7f57517fa700 1 --2- 172.21.15.5:0/2220666453 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f574406db60 0x7f5744070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:23.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.545+0000 7f57517fa700 1 -- 172.21.15.5:0/2220666453 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f574808cd60 con 0x7f57540fce40 2024-04-16T14:36:23.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.545+0000 7f5753fff700 1 --2- 172.21.15.5:0/2220666453 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f574406db60 0x7f5744070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:23.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.546+0000 7f5753fff700 1 --2- 172.21.15.5:0/2220666453 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f574406db60 0x7f5744070010 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5740009b30 tx=0x7f5740009e30 comp rx=0 tx=0).ready entity=mgr.14616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:23.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.550+0000 7f57517fa700 1 -- 172.21.15.5:0/2220666453 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f574805a400 con 0x7f57540fce40 2024-04-16T14:36:23.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.844+0000 7f575b0ac700 1 -- 172.21.15.5:0/2220666453 --> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f575410f7e0 con 0x7f574406db60 2024-04-16T14:36:23.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.845+0000 7f57517fa700 1 -- 172.21.15.5:0/2220666453 <== mgr.14616 v2:172.21.15.115:6828/460631486 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f575410f7e0 con 0x7f574406db60 2024-04-16T14:36:23.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.847+0000 7f575b0ac700 1 -- 172.21.15.5:0/2220666453 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f574406db60 msgr2=0x7f5744070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:23.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.847+0000 7f575b0ac700 1 --2- 172.21.15.5:0/2220666453 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f574406db60 0x7f5744070010 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5740009b30 tx=0x7f5740009e30 comp rx=0 tx=0).stop 2024-04-16T14:36:23.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.847+0000 7f575b0ac700 1 -- 172.21.15.5:0/2220666453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57540fce40 msgr2=0x7f575410d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:23.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.847+0000 7f575b0ac700 1 --2- 172.21.15.5:0/2220666453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57540fce40 0x7f575410d9b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f574800eb70 tx=0x7f574800b040 comp rx=0 tx=0).stop 2024-04-16T14:36:23.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.847+0000 7f575b0ac700 1 -- 172.21.15.5:0/2220666453 shutdown_connections 2024-04-16T14:36:23.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.847+0000 7f575b0ac700 1 --2- 172.21.15.5:0/2220666453 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f574406db60 0x7f5744070010 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:23.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.847+0000 7f575b0ac700 1 --2- 172.21.15.5:0/2220666453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57540fce40 0x7f575410d9b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:23.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.847+0000 7f575b0ac700 1 --2- 172.21.15.5:0/2220666453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57540fe040 0x7f575410def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:23.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.847+0000 7f575b0ac700 1 -- 172.21.15.5:0/2220666453 >> 172.21.15.5:0/2220666453 conn(0x7f57540f8530 msgr2=0x7f57540f9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:23.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.847+0000 7f575b0ac700 1 -- 172.21.15.5:0/2220666453 shutdown_connections 2024-04-16T14:36:23.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.847+0000 7f575b0ac700 1 -- 172.21.15.5:0/2220666453 wait complete. 2024-04-16T14:36:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.957+0000 7f1baf310700 1 -- 172.21.15.5:0/3085623836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba80fdff0 msgr2=0x7f1ba80fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.957+0000 7f1baf310700 1 --2- 172.21.15.5:0/3085623836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba80fdff0 0x7f1ba80fe460 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1b98004940 tx=0x7f1b98009e30 comp rx=0 tx=0).stop 2024-04-16T14:36:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.957+0000 7f1baf310700 1 -- 172.21.15.5:0/3085623836 shutdown_connections 2024-04-16T14:36:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.957+0000 7f1baf310700 1 --2- 172.21.15.5:0/3085623836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba80fdff0 0x7f1ba80fe460 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.957+0000 7f1baf310700 1 --2- 172.21.15.5:0/3085623836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ba80fce80 0x7f1ba80fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.957+0000 7f1baf310700 1 -- 172.21.15.5:0/3085623836 >> 172.21.15.5:0/3085623836 conn(0x7f1ba80f8580 msgr2=0x7f1ba80fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.957+0000 7f1baf310700 1 -- 172.21.15.5:0/3085623836 shutdown_connections 2024-04-16T14:36:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.957+0000 7f1baf310700 1 -- 172.21.15.5:0/3085623836 wait complete. 2024-04-16T14:36:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.958+0000 7f1baf310700 1 Processor -- start 2024-04-16T14:36:23.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.958+0000 7f1baf310700 1 -- start start 2024-04-16T14:36:23.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.958+0000 7f1baf310700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba80fce80 0x7f1ba810d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:23.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.958+0000 7f1baf310700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ba80fdff0 0x7f1ba810dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:23.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.958+0000 7f1baf310700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba810e3e0 con 0x7f1ba80fce80 2024-04-16T14:36:23.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.958+0000 7f1baf310700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba810e550 con 0x7f1ba80fdff0 2024-04-16T14:36:23.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.958+0000 7f1bad0ac700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba80fce80 0x7f1ba810d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:23.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.958+0000 7f1bad0ac700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba80fce80 0x7f1ba810d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50250/0 (socket says 172.21.15.5:50250) 2024-04-16T14:36:23.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.958+0000 7f1bad0ac700 1 -- 172.21.15.5:0/3499109226 learned_addr learned my addr 172.21.15.5:0/3499109226 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:36:23.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.958+0000 7f1bac8ab700 1 --2- 172.21.15.5:0/3499109226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ba80fdff0 0x7f1ba810dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:23.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.958+0000 7f1bad0ac700 1 -- 172.21.15.5:0/3499109226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ba80fdff0 msgr2=0x7f1ba810dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:23.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.958+0000 7f1bad0ac700 1 --2- 172.21.15.5:0/3499109226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ba80fdff0 0x7f1ba810dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:23.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.958+0000 7f1bad0ac700 1 -- 172.21.15.5:0/3499109226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b98005040 con 0x7f1ba80fce80 2024-04-16T14:36:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.959+0000 7f1bad0ac700 1 --2- 172.21.15.5:0/3499109226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba80fce80 0x7f1ba810d8a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1ba400eb40 tx=0x7f1ba400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.959+0000 7f1b9dffb700 1 -- 172.21.15.5:0/3499109226 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ba4007cc0 con 0x7f1ba80fce80 2024-04-16T14:36:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.959+0000 7f1b9dffb700 1 -- 172.21.15.5:0/3499109226 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1ba400f040 con 0x7f1ba80fce80 2024-04-16T14:36:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.959+0000 7f1baf310700 1 -- 172.21.15.5:0/3499109226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba8112f50 con 0x7f1ba80fce80 2024-04-16T14:36:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.959+0000 7f1b9dffb700 1 -- 172.21.15.5:0/3499109226 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ba400ca10 con 0x7f1ba80fce80 2024-04-16T14:36:23.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.959+0000 7f1baf310700 1 -- 172.21.15.5:0/3499109226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba8113480 con 0x7f1ba80fce80 2024-04-16T14:36:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.960+0000 7f1baf310700 1 -- 172.21.15.5:0/3499109226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba804c710 con 0x7f1ba80fce80 2024-04-16T14:36:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.960+0000 7f1b9dffb700 1 -- 172.21.15.5:0/3499109226 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 25) v1 ==== 92029+0+0 (secure 0 0 0) 0x7f1ba400cc80 con 0x7f1ba80fce80 2024-04-16T14:36:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.961+0000 7f1b9dffb700 1 --2- 172.21.15.5:0/3499109226 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f1b9406db70 0x7f1b94070020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.961+0000 7f1b9dffb700 1 -- 172.21.15.5:0/3499109226 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f1ba408ceb0 con 0x7f1ba80fce80 2024-04-16T14:36:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.961+0000 7f1bac8ab700 1 --2- 172.21.15.5:0/3499109226 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f1b9406db70 0x7f1b94070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:23.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.961+0000 7f1bac8ab700 1 --2- 172.21.15.5:0/3499109226 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f1b9406db70 0x7f1b94070020 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1b9800b0d0 tx=0x7f1b98009e30 comp rx=0 tx=0).ready entity=mgr.14616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:23.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:23.966+0000 7f1b9dffb700 1 -- 172.21.15.5:0/3499109226 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f1ba405a550 con 0x7f1ba80fce80 2024-04-16T14:36:24.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:23 smithi115 ceph-mon[37295]: pgmap v46: 65 pgs: 65 active+clean; 293 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 1.5 MiB/s wr, 352 op/s 2024-04-16T14:36:24.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:23 smithi005 ceph-mon[28964]: pgmap v46: 65 pgs: 65 active+clean; 293 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 1.5 MiB/s wr, 352 op/s 2024-04-16T14:36:24.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.237+0000 7f1baf310700 1 -- 172.21.15.5:0/3499109226 --> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ba8113670 con 0x7f1b9406db70 2024-04-16T14:36:24.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.249+0000 7f1b9dffb700 1 -- 172.21.15.5:0/3499109226 <== mgr.14616 v2:172.21.15.115:6828/460631486 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f1ba8113670 con 0x7f1b9406db70 2024-04-16T14:36:24.247 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-16T14:36:24.248 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.smithi005 smithi005 *:9093,9094 starting - - - - 2024-04-16T14:36:24.248 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi005 smithi005 running (9m) 75s ago 9m 6669k - 17.2.7-868-g412a5526 b04d96489b7c 6a380d6ec070 2024-04-16T14:36:24.248 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi115 smithi115 running (8m) 7s ago 8m 6665k - 17.2.7-868-g412a5526 b04d96489b7c df7cb0bfe65b 2024-04-16T14:36:24.248 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.smithi005 smithi005 *:3000 starting - - - - 2024-04-16T14:36:24.248 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.vzoqdl smithi005 running (3m) 75s ago 3m 11.5M - 17.2.7-868-g412a5526 b04d96489b7c 84a74a406a1d 2024-04-16T14:36:24.248 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.wofqlz smithi005 running (3m) 75s ago 3m 138M - 17.2.7-868-g412a5526 b04d96489b7c d0e053ab2f72 2024-04-16T14:36:24.248 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.byfytg smithi115 running (3m) 7s ago 3m 154M - 17.2.7-868-g412a5526 b04d96489b7c 595cd0892f66 2024-04-16T14:36:24.248 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.trkaqh smithi115 running (3m) 7s ago 3m 12.6M - 17.2.7-868-g412a5526 b04d96489b7c 5b60cd2ad79b 2024-04-16T14:36:24.248 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi005.ipwdkc smithi005 *:8443,9283,8765 starting - - - - 2024-04-16T14:36:24.248 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi115.brjkpo smithi115 *:8443,9283 running (105s) 7s ago 8m 505M - 19.0.0-2204-g36befe5d b1a78730e0db 5f0019fe08af 2024-04-16T14:36:24.248 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi005 smithi005 running (10m) 75s ago 10m 48.3M 2048M 17.2.7-868-g412a5526 b04d96489b7c 764b6a128874 2024-04-16T14:36:24.248 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi115 smithi115 running (7m) 7s ago 7m 35.7M 2048M 17.2.7-868-g412a5526 b04d96489b7c feb5354cdbe9 2024-04-16T14:36:24.248 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi005 smithi005 *:9100 starting - - - - 2024-04-16T14:36:24.248 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi115 smithi115 *:9100 running (23s) 7s ago 8m 3598k - 1.5.0 0da6a335fe13 78cc9cc150c0 2024-04-16T14:36:24.249 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (7m) 75s ago 7m 87.7M 1559M 17.2.7-868-g412a5526 b04d96489b7c ed7aa0542d96 2024-04-16T14:36:24.249 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (6m) 75s ago 6m 95.0M 1559M 17.2.7-868-g412a5526 b04d96489b7c 1868cc6c89f4 2024-04-16T14:36:24.249 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (6m) 75s ago 6m 80.6M 1559M 17.2.7-868-g412a5526 b04d96489b7c b12745ae7d18 2024-04-16T14:36:24.249 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi115 running (5m) 7s ago 5m 240M 2581M 17.2.7-868-g412a5526 b04d96489b7c 59f81301ebcf 2024-04-16T14:36:24.249 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi115 running (5m) 7s ago 5m 212M 2581M 17.2.7-868-g412a5526 b04d96489b7c e3ea96b7edd9 2024-04-16T14:36:24.249 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi115 running (5m) 7s ago 5m 212M 2581M 17.2.7-868-g412a5526 b04d96489b7c 456fa074e453 2024-04-16T14:36:24.249 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.smithi005 smithi005 *:9095 starting - - - - 2024-04-16T14:36:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.251+0000 7f1baf310700 1 -- 172.21.15.5:0/3499109226 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f1b9406db70 msgr2=0x7f1b94070020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.251+0000 7f1baf310700 1 --2- 172.21.15.5:0/3499109226 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f1b9406db70 0x7f1b94070020 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1b9800b0d0 tx=0x7f1b98009e30 comp rx=0 tx=0).stop 2024-04-16T14:36:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.251+0000 7f1baf310700 1 -- 172.21.15.5:0/3499109226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba80fce80 msgr2=0x7f1ba810d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.251+0000 7f1baf310700 1 --2- 172.21.15.5:0/3499109226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba80fce80 0x7f1ba810d8a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1ba400eb40 tx=0x7f1ba400b040 comp rx=0 tx=0).stop 2024-04-16T14:36:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.251+0000 7f1baf310700 1 -- 172.21.15.5:0/3499109226 shutdown_connections 2024-04-16T14:36:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.251+0000 7f1baf310700 1 --2- 172.21.15.5:0/3499109226 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f1b9406db70 0x7f1b94070020 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:24.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.251+0000 7f1baf310700 1 --2- 172.21.15.5:0/3499109226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1ba80fce80 0x7f1ba810d8a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:24.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.251+0000 7f1baf310700 1 --2- 172.21.15.5:0/3499109226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ba80fdff0 0x7f1ba810dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:24.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.251+0000 7f1baf310700 1 -- 172.21.15.5:0/3499109226 >> 172.21.15.5:0/3499109226 conn(0x7f1ba80f8580 msgr2=0x7f1ba80f9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:24.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.252+0000 7f1baf310700 1 -- 172.21.15.5:0/3499109226 shutdown_connections 2024-04-16T14:36:24.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.252+0000 7f1baf310700 1 -- 172.21.15.5:0/3499109226 wait complete. 2024-04-16T14:36:24.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.358+0000 7f5dd02de700 1 -- 172.21.15.5:0/2698184295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dc80fbd40 msgr2=0x7f5dc80fc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:24.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.358+0000 7f5dd02de700 1 --2- 172.21.15.5:0/2698184295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dc80fbd40 0x7f5dc80fc150 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4004940 tx=0x7f5dc4009e30 comp rx=0 tx=0).stop 2024-04-16T14:36:24.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.358+0000 7f5dd02de700 1 -- 172.21.15.5:0/2698184295 shutdown_connections 2024-04-16T14:36:24.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.358+0000 7f5dd02de700 1 --2- 172.21.15.5:0/2698184295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5dc80fcff0 0x7f5dc80fd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:24.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.358+0000 7f5dd02de700 1 --2- 172.21.15.5:0/2698184295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dc80fbd40 0x7f5dc80fc150 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:24.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.358+0000 7f5dd02de700 1 -- 172.21.15.5:0/2698184295 >> 172.21.15.5:0/2698184295 conn(0x7f5dc80f74c0 msgr2=0x7f5dc80f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:24.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.358+0000 7f5dd02de700 1 -- 172.21.15.5:0/2698184295 shutdown_connections 2024-04-16T14:36:24.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.358+0000 7f5dd02de700 1 -- 172.21.15.5:0/2698184295 wait complete. 2024-04-16T14:36:24.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.358+0000 7f5dd02de700 1 Processor -- start 2024-04-16T14:36:24.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.358+0000 7f5dd02de700 1 -- start start 2024-04-16T14:36:24.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.359+0000 7f5dd02de700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5dc80fbd40 0x7f5dc810d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:24.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.359+0000 7f5dd02de700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dc80fcff0 0x7f5dc810ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:24.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.359+0000 7f5dd02de700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc810e4d0 con 0x7f5dc80fcff0 2024-04-16T14:36:24.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.359+0000 7f5dd02de700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc810ed20 con 0x7f5dc80fbd40 2024-04-16T14:36:24.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.359+0000 7f5dcd879700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dc80fcff0 0x7f5dc810ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:24.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.359+0000 7f5dcd879700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dc80fcff0 0x7f5dc810ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50270/0 (socket says 172.21.15.5:50270) 2024-04-16T14:36:24.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.359+0000 7f5dcd879700 1 -- 172.21.15.5:0/2691645355 learned_addr learned my addr 172.21.15.5:0/2691645355 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:36:24.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.359+0000 7f5dce07a700 1 --2- 172.21.15.5:0/2691645355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5dc80fbd40 0x7f5dc810d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:24.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.359+0000 7f5dcd879700 1 -- 172.21.15.5:0/2691645355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5dc80fbd40 msgr2=0x7f5dc810d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:24.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.359+0000 7f5dcd879700 1 --2- 172.21.15.5:0/2691645355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5dc80fbd40 0x7f5dc810d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:24.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.359+0000 7f5dcd879700 1 -- 172.21.15.5:0/2691645355 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc4005040 con 0x7f5dc80fcff0 2024-04-16T14:36:24.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.359+0000 7f5dce07a700 1 --2- 172.21.15.5:0/2691645355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5dc80fbd40 0x7f5dc810d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T14:36:24.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.359+0000 7f5dcd879700 1 --2- 172.21.15.5:0/2691645355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dc80fcff0 0x7f5dc810ded0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5db800eb40 tx=0x7f5db800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:24.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.360+0000 7f5dbeffd700 1 -- 172.21.15.5:0/2691645355 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5db8007cc0 con 0x7f5dc80fcff0 2024-04-16T14:36:24.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.360+0000 7f5dd02de700 1 -- 172.21.15.5:0/2691645355 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc810efa0 con 0x7f5dc80fcff0 2024-04-16T14:36:24.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.360+0000 7f5dbeffd700 1 -- 172.21.15.5:0/2691645355 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5db800f040 con 0x7f5dc80fcff0 2024-04-16T14:36:24.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.360+0000 7f5dbeffd700 1 -- 172.21.15.5:0/2691645355 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5db800ca10 con 0x7f5dc80fcff0 2024-04-16T14:36:24.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.360+0000 7f5dd02de700 1 -- 172.21.15.5:0/2691645355 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc810f4e0 con 0x7f5dc80fcff0 2024-04-16T14:36:24.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.361+0000 7f5dd02de700 1 -- 172.21.15.5:0/2691645355 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc8101b80 con 0x7f5dc80fcff0 2024-04-16T14:36:24.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.361+0000 7f5dbeffd700 1 -- 172.21.15.5:0/2691645355 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 25) v1 ==== 92029+0+0 (secure 0 0 0) 0x7f5db800cc80 con 0x7f5dc80fcff0 2024-04-16T14:36:24.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.362+0000 7f5dbeffd700 1 --2- 172.21.15.5:0/2691645355 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f5db406db60 0x7f5db4070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:24.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.362+0000 7f5dbeffd700 1 -- 172.21.15.5:0/2691645355 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f5db808cf00 con 0x7f5dc80fcff0 2024-04-16T14:36:24.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.362+0000 7f5dce07a700 1 --2- 172.21.15.5:0/2691645355 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f5db406db60 0x7f5db4070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:24.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.362+0000 7f5dce07a700 1 --2- 172.21.15.5:0/2691645355 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f5db406db60 0x7f5db4070010 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009b30 tx=0x7f5dc4009e30 comp rx=0 tx=0).ready entity=mgr.14616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:24.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.367+0000 7f5dbeffd700 1 -- 172.21.15.5:0/2691645355 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f5db805a5a0 con 0x7f5dc80fcff0 2024-04-16T14:36:24.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.689+0000 7f5dd02de700 1 -- 172.21.15.5:0/2691645355 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5dc805f5f0 con 0x7f5dc80fcff0 2024-04-16T14:36:24.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.689+0000 7f5dbeffd700 1 -- 172.21.15.5:0/2691645355 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f5db805a130 con 0x7f5dc80fcff0 2024-04-16T14:36:24.688 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:36:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-04-16T14:36:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 2 2024-04-16T14:36:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:36:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-04-16T14:36:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:36:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:36:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-04-16T14:36:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 6 2024-04-16T14:36:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:36:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-04-16T14:36:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 4 2024-04-16T14:36:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:36:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-04-16T14:36:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 12, 2024-04-16T14:36:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:36:24.689 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-16T14:36:24.689 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:36:24.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.691+0000 7f5dd02de700 1 -- 172.21.15.5:0/2691645355 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f5db406db60 msgr2=0x7f5db4070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:24.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.691+0000 7f5dd02de700 1 --2- 172.21.15.5:0/2691645355 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f5db406db60 0x7f5db4070010 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009b30 tx=0x7f5dc4009e30 comp rx=0 tx=0).stop 2024-04-16T14:36:24.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.691+0000 7f5dd02de700 1 -- 172.21.15.5:0/2691645355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dc80fcff0 msgr2=0x7f5dc810ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:24.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.691+0000 7f5dd02de700 1 --2- 172.21.15.5:0/2691645355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dc80fcff0 0x7f5dc810ded0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5db800eb40 tx=0x7f5db800b040 comp rx=0 tx=0).stop 2024-04-16T14:36:24.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.691+0000 7f5dd02de700 1 -- 172.21.15.5:0/2691645355 shutdown_connections 2024-04-16T14:36:24.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.691+0000 7f5dd02de700 1 --2- 172.21.15.5:0/2691645355 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f5db406db60 0x7f5db4070010 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:24.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.691+0000 7f5dd02de700 1 --2- 172.21.15.5:0/2691645355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5dc80fbd40 0x7f5dc810d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:24.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.691+0000 7f5dd02de700 1 --2- 172.21.15.5:0/2691645355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5dc80fcff0 0x7f5dc810ded0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:24.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.691+0000 7f5dd02de700 1 -- 172.21.15.5:0/2691645355 >> 172.21.15.5:0/2691645355 conn(0x7f5dc80f74c0 msgr2=0x7f5dc8065b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:24.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.691+0000 7f5dd02de700 1 -- 172.21.15.5:0/2691645355 shutdown_connections 2024-04-16T14:36:24.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.691+0000 7f5dd02de700 1 -- 172.21.15.5:0/2691645355 wait complete. 2024-04-16T14:36:24.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.799+0000 7f4ed71a3700 1 -- 172.21.15.5:0/2017317818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ed00fbd40 msgr2=0x7f4ed00fc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:24.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.799+0000 7f4ed71a3700 1 --2- 172.21.15.5:0/2017317818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ed00fbd40 0x7f4ed00fc150 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8004940 tx=0x7f4eb8009e30 comp rx=0 tx=0).stop 2024-04-16T14:36:24.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.799+0000 7f4ed71a3700 1 -- 172.21.15.5:0/2017317818 shutdown_connections 2024-04-16T14:36:24.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.799+0000 7f4ed71a3700 1 --2- 172.21.15.5:0/2017317818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ed00fcff0 0x7f4ed00fd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.799+0000 7f4ed71a3700 1 --2- 172.21.15.5:0/2017317818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ed00fbd40 0x7f4ed00fc150 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.799+0000 7f4ed71a3700 1 -- 172.21.15.5:0/2017317818 >> 172.21.15.5:0/2017317818 conn(0x7f4ed00f74c0 msgr2=0x7f4ed00f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.799+0000 7f4ed71a3700 1 -- 172.21.15.5:0/2017317818 shutdown_connections 2024-04-16T14:36:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.799+0000 7f4ed71a3700 1 -- 172.21.15.5:0/2017317818 wait complete. 2024-04-16T14:36:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.799+0000 7f4ed71a3700 1 Processor -- start 2024-04-16T14:36:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.799+0000 7f4ed71a3700 1 -- start start 2024-04-16T14:36:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.800+0000 7f4ed71a3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ed00fbd40 0x7f4ed010d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:24.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.800+0000 7f4ed71a3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ed00fcff0 0x7f4ed010df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:24.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.800+0000 7f4ed71a3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed010e520 con 0x7f4ed00fbd40 2024-04-16T14:36:24.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.800+0000 7f4ed71a3700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed010ed20 con 0x7f4ed00fcff0 2024-04-16T14:36:24.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.800+0000 7f4ed4f3f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ed00fbd40 0x7f4ed010d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:24.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.800+0000 7f4ed4f3f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ed00fbd40 0x7f4ed010d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50286/0 (socket says 172.21.15.5:50286) 2024-04-16T14:36:24.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.800+0000 7f4ed4f3f700 1 -- 172.21.15.5:0/2231715476 learned_addr learned my addr 172.21.15.5:0/2231715476 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:36:24.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.800+0000 7f4ecffff700 1 --2- 172.21.15.5:0/2231715476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ed00fcff0 0x7f4ed010df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:24.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.800+0000 7f4ed4f3f700 1 -- 172.21.15.5:0/2231715476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ed00fcff0 msgr2=0x7f4ed010df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:24.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.800+0000 7f4ed4f3f700 1 --2- 172.21.15.5:0/2231715476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ed00fcff0 0x7f4ed010df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:24.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.800+0000 7f4ed4f3f700 1 -- 172.21.15.5:0/2231715476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb8005040 con 0x7f4ed00fbd40 2024-04-16T14:36:24.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.800+0000 7f4ed4f3f700 1 --2- 172.21.15.5:0/2231715476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ed00fbd40 0x7f4ed010d9e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4eb800b3b0 tx=0x7f4eb8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:24.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.800+0000 7f4ecd7fa700 1 -- 172.21.15.5:0/2231715476 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4eb800e040 con 0x7f4ed00fbd40 2024-04-16T14:36:24.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.801+0000 7f4ed71a3700 1 -- 172.21.15.5:0/2231715476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed010efa0 con 0x7f4ed00fbd40 2024-04-16T14:36:24.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.801+0000 7f4ecd7fa700 1 -- 172.21.15.5:0/2231715476 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4eb8004290 con 0x7f4ed00fbd40 2024-04-16T14:36:24.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.801+0000 7f4ed71a3700 1 -- 172.21.15.5:0/2231715476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed010f4e0 con 0x7f4ed00fbd40 2024-04-16T14:36:24.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.801+0000 7f4ecd7fa700 1 -- 172.21.15.5:0/2231715476 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4eb801c3f0 con 0x7f4ed00fbd40 2024-04-16T14:36:24.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.802+0000 7f4ed71a3700 1 -- 172.21.15.5:0/2231715476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed0101b80 con 0x7f4ed00fbd40 2024-04-16T14:36:24.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.802+0000 7f4ecd7fa700 1 -- 172.21.15.5:0/2231715476 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 25) v1 ==== 92029+0+0 (secure 0 0 0) 0x7f4eb800bbf0 con 0x7f4ed00fbd40 2024-04-16T14:36:24.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.803+0000 7f4ecd7fa700 1 --2- 172.21.15.5:0/2231715476 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f4ebc06db60 0x7f4ebc070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:24.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.803+0000 7f4ecd7fa700 1 -- 172.21.15.5:0/2231715476 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f4eb808e620 con 0x7f4ed00fbd40 2024-04-16T14:36:24.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.803+0000 7f4ecffff700 1 --2- 172.21.15.5:0/2231715476 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f4ebc06db60 0x7f4ebc070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:24.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.803+0000 7f4ecffff700 1 --2- 172.21.15.5:0/2231715476 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f4ebc06db60 0x7f4ebc070010 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0007b20 tx=0x7f4ec0009e20 comp rx=0 tx=0).ready entity=mgr.14616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:24.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:24.807+0000 7f4ecd7fa700 1 -- 172.21.15.5:0/2231715476 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f4eb805bc90 con 0x7f4ed00fbd40 2024-04-16T14:36:24.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:24 smithi005 ceph-mon[28964]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:36:24.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:24 smithi005 ceph-mon[28964]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:36:24.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:24 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/2691645355' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:36:25.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.075+0000 7f4ed71a3700 1 -- 172.21.15.5:0/2231715476 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4ed004bed0 con 0x7f4ed00fbd40 2024-04-16T14:36:25.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.075+0000 7f4ecd7fa700 1 -- 172.21.15.5:0/2231715476 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1846 (secure 0 0 0) 0x7f4eb805b820 con 0x7f4ed00fbd40 2024-04-16T14:36:25.074 INFO:teuthology.orchestra.run.smithi005.stdout:e20 2024-04-16T14:36:25.074 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:36:25.074 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:36:25.074 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2024-04-16T14:36:25.074 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:36:25.074 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2024-04-16T14:36:25.075 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2024-04-16T14:36:25.075 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 20 2024-04-16T14:36:25.075 INFO:teuthology.orchestra.run.smithi005.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-16T14:36:25.075 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-16T14:32:45.270024+0000 2024-04-16T14:36:25.075 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-04-16T14:35:42.742829+0000 2024-04-16T14:36:25.075 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2024-04-16T14:36:25.075 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2024-04-16T14:36:25.075 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 60 2024-04-16T14:36:25.075 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2024-04-16T14:36:25.075 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2024-04-16T14:36:25.075 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2024-04-16T14:36:25.076 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2024-04-16T14:36:25.076 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 47 2024-04-16T14:36:25.076 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:36:25.076 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 2 2024-04-16T14:36:25.076 INFO:teuthology.orchestra.run.smithi005.stdout:in 0,1 2024-04-16T14:36:25.076 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=14484,1=24269} 2024-04-16T14:36:25.076 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2024-04-16T14:36:25.076 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2024-04-16T14:36:25.076 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 2024-04-16T14:36:25.076 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3] 2024-04-16T14:36:25.076 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2024-04-16T14:36:25.077 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2024-04-16T14:36:25.077 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2024-04-16T14:36:25.077 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 1 2024-04-16T14:36:25.077 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.wofqlz{0:14484} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:36:25.077 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.byfytg{1:24269} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.115:6824/1662994117,v1:172.21.15.115:6825/1662994117] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:36:25.077 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:36:25.077 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:36:25.077 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2024-04-16T14:36:25.077 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:36:25.077 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.vzoqdl{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.5:6826/187766809,v1:172.21.15.5:6827/187766809] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:36:25.078 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.trkaqh{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:36:25.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.078+0000 7f4ed71a3700 1 -- 172.21.15.5:0/2231715476 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f4ebc06db60 msgr2=0x7f4ebc070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:25.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.078+0000 7f4ed71a3700 1 --2- 172.21.15.5:0/2231715476 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f4ebc06db60 0x7f4ebc070010 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0007b20 tx=0x7f4ec0009e20 comp rx=0 tx=0).stop 2024-04-16T14:36:25.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.078+0000 7f4ed71a3700 1 -- 172.21.15.5:0/2231715476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ed00fbd40 msgr2=0x7f4ed010d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:25.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.078+0000 7f4ed71a3700 1 --2- 172.21.15.5:0/2231715476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ed00fbd40 0x7f4ed010d9e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4eb800b3b0 tx=0x7f4eb8009e30 comp rx=0 tx=0).stop 2024-04-16T14:36:25.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.078+0000 7f4ed71a3700 1 -- 172.21.15.5:0/2231715476 shutdown_connections 2024-04-16T14:36:25.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.078+0000 7f4ed71a3700 1 --2- 172.21.15.5:0/2231715476 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f4ebc06db60 0x7f4ebc070010 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:25.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.078+0000 7f4ed71a3700 1 --2- 172.21.15.5:0/2231715476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ed00fbd40 0x7f4ed010d9e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:25.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.078+0000 7f4ed71a3700 1 --2- 172.21.15.5:0/2231715476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ed00fcff0 0x7f4ed010df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:25.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.078+0000 7f4ed71a3700 1 -- 172.21.15.5:0/2231715476 >> 172.21.15.5:0/2231715476 conn(0x7f4ed00f74c0 msgr2=0x7f4ed0065b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:25.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.079+0000 7f4ed71a3700 1 -- 172.21.15.5:0/2231715476 shutdown_connections 2024-04-16T14:36:25.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.079+0000 7f4ed71a3700 1 -- 172.21.15.5:0/2231715476 wait complete. 2024-04-16T14:36:25.079 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 20 2024-04-16T14:36:25.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:24 smithi115 ceph-mon[37295]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:36:25.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:24 smithi115 ceph-mon[37295]: from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:36:25.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:24 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/2691645355' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:36:25.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.188+0000 7fb244a66700 1 -- 172.21.15.5:0/503857731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2400fe040 msgr2=0x7fb2400fe4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:25.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.188+0000 7fb244a66700 1 --2- 172.21.15.5:0/503857731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2400fe040 0x7fb2400fe4b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb228004940 tx=0x7fb228009e30 comp rx=0 tx=0).stop 2024-04-16T14:36:25.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.188+0000 7fb244a66700 1 -- 172.21.15.5:0/503857731 shutdown_connections 2024-04-16T14:36:25.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.188+0000 7fb244a66700 1 --2- 172.21.15.5:0/503857731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2400fe040 0x7fb2400fe4b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:25.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.188+0000 7fb244a66700 1 --2- 172.21.15.5:0/503857731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2400fce40 0x7fb2400fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:25.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.188+0000 7fb244a66700 1 -- 172.21.15.5:0/503857731 >> 172.21.15.5:0/503857731 conn(0x7fb2400f8570 msgr2=0x7fb2400fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:25.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.188+0000 7fb244a66700 1 -- 172.21.15.5:0/503857731 shutdown_connections 2024-04-16T14:36:25.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.188+0000 7fb244a66700 1 -- 172.21.15.5:0/503857731 wait complete. 2024-04-16T14:36:25.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.188+0000 7fb244a66700 1 Processor -- start 2024-04-16T14:36:25.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.189+0000 7fb244a66700 1 -- start start 2024-04-16T14:36:25.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.189+0000 7fb244a66700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2400fce40 0x7fb240071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:25.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.189+0000 7fb244a66700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2400fe040 0x7fb240070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:25.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.189+0000 7fb244a66700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2400708c0 con 0x7fb2400fe040 2024-04-16T14:36:25.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.189+0000 7fb244a66700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb240070a30 con 0x7fb2400fce40 2024-04-16T14:36:25.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.189+0000 7fb23dd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2400fe040 0x7fb240070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:25.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.189+0000 7fb23e59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2400fce40 0x7fb240071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:25.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.189+0000 7fb23dd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2400fe040 0x7fb240070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50314/0 (socket says 172.21.15.5:50314) 2024-04-16T14:36:25.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.189+0000 7fb23dd9b700 1 -- 172.21.15.5:0/3043216386 learned_addr learned my addr 172.21.15.5:0/3043216386 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:36:25.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.189+0000 7fb23e59c700 1 --2- 172.21.15.5:0/3043216386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2400fce40 0x7fb240071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.5:43824/0 (socket says 172.21.15.5:43824) 2024-04-16T14:36:25.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.189+0000 7fb23dd9b700 1 -- 172.21.15.5:0/3043216386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2400fce40 msgr2=0x7fb240071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:25.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.189+0000 7fb23dd9b700 1 --2- 172.21.15.5:0/3043216386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2400fce40 0x7fb240071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:25.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.189+0000 7fb23dd9b700 1 -- 172.21.15.5:0/3043216386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb228005040 con 0x7fb2400fe040 2024-04-16T14:36:25.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.190+0000 7fb23dd9b700 1 --2- 172.21.15.5:0/3043216386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2400fe040 0x7fb240070310 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb228009150 tx=0x7fb228009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:25.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.190+0000 7fb236ffd700 1 -- 172.21.15.5:0/3043216386 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb22800e040 con 0x7fb2400fe040 2024-04-16T14:36:25.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.190+0000 7fb244a66700 1 -- 172.21.15.5:0/3043216386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb240070cb0 con 0x7fb2400fe040 2024-04-16T14:36:25.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.190+0000 7fb236ffd700 1 -- 172.21.15.5:0/3043216386 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb228004290 con 0x7fb2400fe040 2024-04-16T14:36:25.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.190+0000 7fb236ffd700 1 -- 172.21.15.5:0/3043216386 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb22801c630 con 0x7fb2400fe040 2024-04-16T14:36:25.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.190+0000 7fb244a66700 1 -- 172.21.15.5:0/3043216386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb240115a70 con 0x7fb2400fe040 2024-04-16T14:36:25.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.191+0000 7fb244a66700 1 -- 172.21.15.5:0/3043216386 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb24005f5f0 con 0x7fb2400fe040 2024-04-16T14:36:25.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.191+0000 7fb236ffd700 1 -- 172.21.15.5:0/3043216386 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 25) v1 ==== 92029+0+0 (secure 0 0 0) 0x7fb22800bbf0 con 0x7fb2400fe040 2024-04-16T14:36:25.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.192+0000 7fb236ffd700 1 --2- 172.21.15.5:0/3043216386 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fb22c06db60 0x7fb22c070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:25.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.192+0000 7fb236ffd700 1 -- 172.21.15.5:0/3043216386 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb22808df10 con 0x7fb2400fe040 2024-04-16T14:36:25.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.192+0000 7fb23e59c700 1 --2- 172.21.15.5:0/3043216386 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fb22c06db60 0x7fb22c070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:25.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.193+0000 7fb23e59c700 1 --2- 172.21.15.5:0/3043216386 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fb22c06db60 0x7fb22c070010 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb240071bd0 tx=0x7fb23000b040 comp rx=0 tx=0).ready entity=mgr.14616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:25.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.197+0000 7fb236ffd700 1 -- 172.21.15.5:0/3043216386 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7fb228057a50 con 0x7fb2400fe040 2024-04-16T14:36:25.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.542+0000 7fb244a66700 1 -- 172.21.15.5:0/3043216386 --> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb240102340 con 0x7fb22c06db60 2024-04-16T14:36:25.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.543+0000 7fb236ffd700 1 -- 172.21.15.5:0/3043216386 <== mgr.14616 v2:172.21.15.115:6828/460631486 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fb240102340 con 0x7fb22c06db60 2024-04-16T14:36:25.542 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:36:25.542 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91", 2024-04-16T14:36:25.542 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-04-16T14:36:25.542 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-16T14:36:25.542 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [], 2024-04-16T14:36:25.542 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "", 2024-04-16T14:36:25.542 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading mgr daemons", 2024-04-16T14:36:25.543 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-04-16T14:36:25.543 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:36:25.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.546+0000 7fb244a66700 1 -- 172.21.15.5:0/3043216386 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fb22c06db60 msgr2=0x7fb22c070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:25.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.546+0000 7fb244a66700 1 --2- 172.21.15.5:0/3043216386 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fb22c06db60 0x7fb22c070010 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb240071bd0 tx=0x7fb23000b040 comp rx=0 tx=0).stop 2024-04-16T14:36:25.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.546+0000 7fb244a66700 1 -- 172.21.15.5:0/3043216386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2400fe040 msgr2=0x7fb240070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:25.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.546+0000 7fb244a66700 1 --2- 172.21.15.5:0/3043216386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2400fe040 0x7fb240070310 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb228009150 tx=0x7fb228009e30 comp rx=0 tx=0).stop 2024-04-16T14:36:25.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.546+0000 7fb244a66700 1 -- 172.21.15.5:0/3043216386 shutdown_connections 2024-04-16T14:36:25.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.546+0000 7fb244a66700 1 --2- 172.21.15.5:0/3043216386 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7fb22c06db60 0x7fb22c070010 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:25.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.546+0000 7fb244a66700 1 --2- 172.21.15.5:0/3043216386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2400fce40 0x7fb240071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:25.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.546+0000 7fb244a66700 1 --2- 172.21.15.5:0/3043216386 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2400fe040 0x7fb240070310 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:25.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.546+0000 7fb244a66700 1 -- 172.21.15.5:0/3043216386 >> 172.21.15.5:0/3043216386 conn(0x7fb2400f8570 msgr2=0x7fb2400f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:25.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.546+0000 7fb244a66700 1 -- 172.21.15.5:0/3043216386 shutdown_connections 2024-04-16T14:36:25.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.546+0000 7fb244a66700 1 -- 172.21.15.5:0/3043216386 wait complete. 2024-04-16T14:36:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.668+0000 7f40241c5700 1 -- 172.21.15.5:0/82444543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f401c0fed60 msgr2=0x7f401c0faea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.668+0000 7f40241c5700 1 --2- 172.21.15.5:0/82444543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f401c0fed60 0x7f401c0faea0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4010004940 tx=0x7f4010009e30 comp rx=0 tx=0).stop 2024-04-16T14:36:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.668+0000 7f40241c5700 1 -- 172.21.15.5:0/82444543 shutdown_connections 2024-04-16T14:36:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.668+0000 7f40241c5700 1 --2- 172.21.15.5:0/82444543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f401c0fed60 0x7f401c0faea0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.668+0000 7f40241c5700 1 --2- 172.21.15.5:0/82444543 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f401c0fe410 0x7f401c0fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.668+0000 7f40241c5700 1 -- 172.21.15.5:0/82444543 >> 172.21.15.5:0/82444543 conn(0x7f401c0f6bd0 msgr2=0x7f401c0f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.668+0000 7f40241c5700 1 -- 172.21.15.5:0/82444543 shutdown_connections 2024-04-16T14:36:25.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.668+0000 7f40241c5700 1 -- 172.21.15.5:0/82444543 wait complete. 2024-04-16T14:36:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.669+0000 7f40241c5700 1 Processor -- start 2024-04-16T14:36:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.669+0000 7f40241c5700 1 -- start start 2024-04-16T14:36:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.669+0000 7f40241c5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f401c0fe410 0x7f401c113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.669+0000 7f40241c5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f401c0fed60 0x7f401c1144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:25.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.669+0000 7f40241c5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c114af0 con 0x7f401c0fed60 2024-04-16T14:36:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.669+0000 7f40241c5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c115340 con 0x7f401c0fe410 2024-04-16T14:36:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.669+0000 7f4021760700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f401c0fed60 0x7f401c1144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.669+0000 7f4021f61700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f401c0fe410 0x7f401c113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.669+0000 7f4021f61700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f401c0fe410 0x7f401c113f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.5:43828/0 (socket says 172.21.15.5:43828) 2024-04-16T14:36:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.669+0000 7f4021760700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f401c0fed60 0x7f401c1144a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50332/0 (socket says 172.21.15.5:50332) 2024-04-16T14:36:25.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.669+0000 7f4021f61700 1 -- 172.21.15.5:0/484878350 learned_addr learned my addr 172.21.15.5:0/484878350 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:36:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.670+0000 7f4021760700 1 -- 172.21.15.5:0/484878350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f401c0fe410 msgr2=0x7f401c113f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.670+0000 7f4021760700 1 --2- 172.21.15.5:0/484878350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f401c0fe410 0x7f401c113f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.670+0000 7f4021760700 1 -- 172.21.15.5:0/484878350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4010005040 con 0x7f401c0fed60 2024-04-16T14:36:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.670+0000 7f4021f61700 1 --2- 172.21.15.5:0/484878350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f401c0fe410 0x7f401c113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T14:36:25.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.670+0000 7f4021760700 1 --2- 172.21.15.5:0/484878350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f401c0fed60 0x7f401c1144a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4010009fd0 tx=0x7f4010009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.671+0000 7f400e7fc700 1 -- 172.21.15.5:0/484878350 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4010021070 con 0x7f401c0fed60 2024-04-16T14:36:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.671+0000 7f400e7fc700 1 -- 172.21.15.5:0/484878350 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f401001c400 con 0x7f401c0fed60 2024-04-16T14:36:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.671+0000 7f40241c5700 1 -- 172.21.15.5:0/484878350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f401c1155c0 con 0x7f401c0fed60 2024-04-16T14:36:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.671+0000 7f400e7fc700 1 -- 172.21.15.5:0/484878350 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f401000e070 con 0x7f401c0fed60 2024-04-16T14:36:25.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.671+0000 7f40241c5700 1 -- 172.21.15.5:0/484878350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f401c115b00 con 0x7f401c0fed60 2024-04-16T14:36:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.673+0000 7f40241c5700 1 -- 172.21.15.5:0/484878350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f401c101b50 con 0x7f401c0fed60 2024-04-16T14:36:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.673+0000 7f400e7fc700 1 -- 172.21.15.5:0/484878350 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 25) v1 ==== 92029+0+0 (secure 0 0 0) 0x7f401001ca20 con 0x7f401c0fed60 2024-04-16T14:36:25.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.674+0000 7f400e7fc700 1 --2- 172.21.15.5:0/484878350 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f400806dcf0 0x7f40080701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:25.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.674+0000 7f400e7fc700 1 -- 172.21.15.5:0/484878350 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f401008e310 con 0x7f401c0fed60 2024-04-16T14:36:25.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.674+0000 7f4021f61700 1 --2- 172.21.15.5:0/484878350 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f400806dcf0 0x7f40080701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:25.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.675+0000 7f4021f61700 1 --2- 172.21.15.5:0/484878350 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f400806dcf0 0x7f40080701a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4018004fd0 tx=0x7f401800b040 comp rx=0 tx=0).ready entity=mgr.14616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:25.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:25.680+0000 7f400e7fc700 1 -- 172.21.15.5:0/484878350 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f4010057e50 con 0x7f401c0fed60 2024-04-16T14:36:26.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:26.003+0000 7f40241c5700 1 -- 172.21.15.5:0/484878350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f401c05f5f0 con 0x7f401c0fed60 2024-04-16T14:36:26.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:26.003+0000 7f400e7fc700 1 -- 172.21.15.5:0/484878350 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f401005b510 con 0x7f401c0fed60 2024-04-16T14:36:26.002 INFO:teuthology.orchestra.run.smithi005.stdout:HEALTH_OK 2024-04-16T14:36:26.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:26.005+0000 7f40241c5700 1 -- 172.21.15.5:0/484878350 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f400806dcf0 msgr2=0x7f40080701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:26.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:26.005+0000 7f40241c5700 1 --2- 172.21.15.5:0/484878350 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f400806dcf0 0x7f40080701a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4018004fd0 tx=0x7f401800b040 comp rx=0 tx=0).stop 2024-04-16T14:36:26.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:26.005+0000 7f40241c5700 1 -- 172.21.15.5:0/484878350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f401c0fed60 msgr2=0x7f401c1144a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:26.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:26.005+0000 7f40241c5700 1 --2- 172.21.15.5:0/484878350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f401c0fed60 0x7f401c1144a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4010009fd0 tx=0x7f4010009e30 comp rx=0 tx=0).stop 2024-04-16T14:36:26.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:26.005+0000 7f40241c5700 1 -- 172.21.15.5:0/484878350 shutdown_connections 2024-04-16T14:36:26.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:26.005+0000 7f40241c5700 1 --2- 172.21.15.5:0/484878350 >> [v2:172.21.15.115:6828/460631486,v1:172.21.15.115:6829/460631486] conn(0x7f400806dcf0 0x7f40080701a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:26.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:26.005+0000 7f40241c5700 1 --2- 172.21.15.5:0/484878350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f401c0fe410 0x7f401c113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:26.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:26.005+0000 7f40241c5700 1 --2- 172.21.15.5:0/484878350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f401c0fed60 0x7f401c1144a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:26.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:26.005+0000 7f40241c5700 1 -- 172.21.15.5:0/484878350 >> 172.21.15.5:0/484878350 conn(0x7f401c0f6bd0 msgr2=0x7f401c0f8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:26.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:26.005+0000 7f40241c5700 1 -- 172.21.15.5:0/484878350 shutdown_connections 2024-04-16T14:36:26.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:26.005+0000 7f40241c5700 1 -- 172.21.15.5:0/484878350 wait complete. 2024-04-16T14:36:26.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:25 smithi115 ceph-mon[37295]: pgmap v47: 65 pgs: 65 active+clean; 293 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 2.2 MiB/s wr, 400 op/s 2024-04-16T14:36:26.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:25 smithi115 ceph-mon[37295]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:36:26.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:25 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/2231715476' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:36:26.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:25 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:26.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:25 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:26.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:25 smithi005 ceph-mon[28964]: pgmap v47: 65 pgs: 65 active+clean; 293 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 2.2 MiB/s wr, 400 op/s 2024-04-16T14:36:26.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:25 smithi005 ceph-mon[28964]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:36:26.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:25 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/2231715476' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:36:26.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:25 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:26.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:25 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:27.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:26 smithi115 ceph-mon[37295]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:36:27.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:26 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/484878350' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:36:27.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:26 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:36:27.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:26 smithi005 ceph-mon[28964]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:36:27.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:26 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/484878350' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:36:27.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:26 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:36:27.926 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:27 smithi005 ceph-mon[28964]: pgmap v48: 65 pgs: 65 active+clean; 293 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.5 MiB/s wr, 282 op/s 2024-04-16T14:36:27.926 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:27 smithi005 ceph-mon[28964]: mgrmap e26: smithi115.brjkpo(active, since 90s), standbys: smithi005.ipwdkc 2024-04-16T14:36:27.926 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:27 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:27.926 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:27 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:28.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:27 smithi115 ceph-mon[37295]: pgmap v48: 65 pgs: 65 active+clean; 293 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.5 MiB/s wr, 282 op/s 2024-04-16T14:36:28.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:27 smithi115 ceph-mon[37295]: mgrmap e26: smithi115.brjkpo(active, since 90s), standbys: smithi005.ipwdkc 2024-04-16T14:36:28.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:27 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:28.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:27 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:30.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:29 smithi115 ceph-mon[37295]: pgmap v49: 65 pgs: 65 active+clean; 293 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 2.1 MiB/s wr, 444 op/s 2024-04-16T14:36:30.232 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:29 smithi005 ceph-mon[28964]: pgmap v49: 65 pgs: 65 active+clean; 293 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 2.1 MiB/s wr, 444 op/s 2024-04-16T14:36:31.946 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: pgmap v50: 65 pgs: 65 active+clean; 293 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 286 op/s 2024-04-16T14:36:31.946 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:31.946 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:31.946 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:36:31.946 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:36:31.946 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:31.946 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:36:31.946 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "mgr fail", "who": "smithi115.brjkpo"}]: dispatch 2024-04-16T14:36:31.946 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: Activating manager daemon smithi005.ipwdkc 2024-04-16T14:36:31.947 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: osdmap e49: 6 total, 6 up, 6 in 2024-04-16T14:36:31.947 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd='[{"prefix": "mgr fail", "who": "smithi115.brjkpo"}]': finished 2024-04-16T14:36:31.947 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: mgrmap e27: smithi005.ipwdkc(active, starting, since 0.00648111s) 2024-04-16T14:36:31.947 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-04-16T14:36:31.947 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:36:31.947 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi005.wofqlz"}]: dispatch 2024-04-16T14:36:31.947 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi005.vzoqdl"}]: dispatch 2024-04-16T14:36:31.947 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.byfytg"}]: dispatch 2024-04-16T14:36:31.947 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.trkaqh"}]: dispatch 2024-04-16T14:36:31.947 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr metadata", "who": "smithi005.ipwdkc", "id": "smithi005.ipwdkc"}]: dispatch 2024-04-16T14:36:31.947 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-16T14:36:31.947 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-16T14:36:31.947 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-16T14:36:31.947 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-16T14:36:31.947 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-16T14:36:31.948 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-16T14:36:31.948 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-16T14:36:31.948 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-16T14:36:31.948 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-16T14:36:31.948 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: Manager daemon smithi005.ipwdkc is now available 2024-04-16T14:36:31.948 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:36:31.948 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:36:31.948 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi005.ipwdkc/mirror_snapshot_schedule"}]: dispatch 2024-04-16T14:36:31.948 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:31 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi005.ipwdkc/trash_purge_schedule"}]: dispatch 2024-04-16T14:36:32.001 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: pgmap v50: 65 pgs: 65 active+clean; 293 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.3 MiB/s wr, 286 op/s 2024-04-16T14:36:32.001 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:32.001 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:32.002 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:36:32.002 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:36:32.002 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' 2024-04-16T14:36:32.002 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:36:32.002 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "mgr fail", "who": "smithi115.brjkpo"}]: dispatch 2024-04-16T14:36:32.002 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: Activating manager daemon smithi005.ipwdkc 2024-04-16T14:36:32.002 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: osdmap e49: 6 total, 6 up, 6 in 2024-04-16T14:36:32.002 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14616 172.21.15.115:0/3184127694' entity='mgr.smithi115.brjkpo' cmd='[{"prefix": "mgr fail", "who": "smithi115.brjkpo"}]': finished 2024-04-16T14:36:32.002 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: mgrmap e27: smithi005.ipwdkc(active, starting, since 0.00648111s) 2024-04-16T14:36:32.002 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-04-16T14:36:32.002 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:36:32.002 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi005.wofqlz"}]: dispatch 2024-04-16T14:36:32.002 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi005.vzoqdl"}]: dispatch 2024-04-16T14:36:32.003 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.byfytg"}]: dispatch 2024-04-16T14:36:32.003 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.trkaqh"}]: dispatch 2024-04-16T14:36:32.003 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr metadata", "who": "smithi005.ipwdkc", "id": "smithi005.ipwdkc"}]: dispatch 2024-04-16T14:36:32.003 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-16T14:36:32.003 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-16T14:36:32.003 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-16T14:36:32.003 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-16T14:36:32.003 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-16T14:36:32.003 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-16T14:36:32.003 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-16T14:36:32.004 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-16T14:36:32.004 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-16T14:36:32.004 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: Manager daemon smithi005.ipwdkc is now available 2024-04-16T14:36:32.004 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:36:32.004 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:36:32.004 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi005.ipwdkc/mirror_snapshot_schedule"}]: dispatch 2024-04-16T14:36:32.004 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:31 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi005.ipwdkc/trash_purge_schedule"}]: dispatch 2024-04-16T14:36:33.723 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:33 smithi005 ceph-mon[28964]: [16/Apr/2024:14:36:32] ENGINE Bus STARTING 2024-04-16T14:36:33.723 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:33 smithi005 ceph-mon[28964]: [16/Apr/2024:14:36:32] ENGINE Serving on http://172.21.15.5:8765 2024-04-16T14:36:33.723 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:33 smithi005 ceph-mon[28964]: [16/Apr/2024:14:36:32] ENGINE Serving on https://172.21.15.5:7150 2024-04-16T14:36:33.723 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:33 smithi005 ceph-mon[28964]: [16/Apr/2024:14:36:32] ENGINE Bus STARTED 2024-04-16T14:36:33.723 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:33 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:33.723 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:33 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:33.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:33 smithi005 ceph-mon[28964]: mgrmap e28: smithi005.ipwdkc(active, since 1.00808s) 2024-04-16T14:36:33.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:33 smithi115 ceph-mon[37295]: [16/Apr/2024:14:36:32] ENGINE Bus STARTING 2024-04-16T14:36:33.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:33 smithi115 ceph-mon[37295]: [16/Apr/2024:14:36:32] ENGINE Serving on http://172.21.15.5:8765 2024-04-16T14:36:33.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:33 smithi115 ceph-mon[37295]: [16/Apr/2024:14:36:32] ENGINE Serving on https://172.21.15.5:7150 2024-04-16T14:36:33.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:33 smithi115 ceph-mon[37295]: [16/Apr/2024:14:36:32] ENGINE Bus STARTED 2024-04-16T14:36:33.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:33 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:33.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:33 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:33.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:33 smithi115 ceph-mon[37295]: mgrmap e28: smithi005.ipwdkc(active, since 1.00808s) 2024-04-16T14:36:34.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:34 smithi005 ceph-mon[28964]: pgmap v3: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:36:34.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:34 smithi005 ceph-mon[28964]: pgmap v4: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:36:35.092 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:34 smithi115 ceph-mon[37295]: pgmap v3: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:36:35.092 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:34 smithi115 ceph-mon[37295]: pgmap v4: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:36:35.902 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:35 smithi115 ceph-mon[37295]: mgrmap e29: smithi005.ipwdkc(active, since 3s) 2024-04-16T14:36:35.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:35 smithi005 ceph-mon[28964]: mgrmap e29: smithi005.ipwdkc(active, since 3s) 2024-04-16T14:36:36.901 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:36 smithi115 ceph-mon[37295]: pgmap v5: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:36:36.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:36 smithi005 ceph-mon[28964]: pgmap v5: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:36:38.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:38 smithi005 ceph-mon[28964]: pgmap v6: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:36:38.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:38 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:38.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:38 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:38.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:38 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:38.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:38 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:39.126 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:38 smithi115 ceph-mon[37295]: pgmap v6: 65 pgs: 65 active+clean; 301 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:36:39.126 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:38 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:39.126 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:38 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:39.126 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:38 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:39.127 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:38 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:40.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:40 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:40.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:40 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:40.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:40 smithi115 ceph-mon[37295]: pgmap v7: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.3 MiB/s wr, 105 op/s 2024-04-16T14:36:40.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:40 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:40.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:40 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:40.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:40 smithi115 ceph-mon[37295]: Standby manager daemon smithi115.brjkpo started 2024-04-16T14:36:40.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:40 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.115:0/2855163146' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.brjkpo/crt"}]: dispatch 2024-04-16T14:36:40.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:40 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.115:0/2855163146' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-16T14:36:40.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:40 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.115:0/2855163146' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.brjkpo/key"}]: dispatch 2024-04-16T14:36:40.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:40 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.115:0/2855163146' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-16T14:36:40.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:40 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:40.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:40 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:40.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:40 smithi005 ceph-mon[28964]: pgmap v7: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.3 MiB/s wr, 105 op/s 2024-04-16T14:36:40.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:40 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:40.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:40 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:40.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:40 smithi005 ceph-mon[28964]: Standby manager daemon smithi115.brjkpo started 2024-04-16T14:36:40.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:40 smithi005 ceph-mon[28964]: from='mgr.? 172.21.15.115:0/2855163146' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.brjkpo/crt"}]: dispatch 2024-04-16T14:36:40.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:40 smithi005 ceph-mon[28964]: from='mgr.? 172.21.15.115:0/2855163146' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-16T14:36:40.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:40 smithi005 ceph-mon[28964]: from='mgr.? 172.21.15.115:0/2855163146' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.brjkpo/key"}]: dispatch 2024-04-16T14:36:40.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:40 smithi005 ceph-mon[28964]: from='mgr.? 172.21.15.115:0/2855163146' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-16T14:36:42.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:42 smithi115 ceph-mon[37295]: mgrmap e30: smithi005.ipwdkc(active, since 9s), standbys: smithi115.brjkpo 2024-04-16T14:36:42.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:42 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr metadata", "who": "smithi115.brjkpo", "id": "smithi115.brjkpo"}]: dispatch 2024-04-16T14:36:42.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:42 smithi115 ceph-mon[37295]: pgmap v8: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.0 MiB/s wr, 81 op/s 2024-04-16T14:36:42.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:42 smithi005 ceph-mon[28964]: mgrmap e30: smithi005.ipwdkc(active, since 9s), standbys: smithi115.brjkpo 2024-04-16T14:36:42.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:42 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr metadata", "who": "smithi115.brjkpo", "id": "smithi115.brjkpo"}]: dispatch 2024-04-16T14:36:42.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:42 smithi005 ceph-mon[28964]: pgmap v8: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.0 MiB/s wr, 81 op/s 2024-04-16T14:36:44.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:44 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:44.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:44 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:44.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:44 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:36:44.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:44 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:36:44.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:44 smithi115 ceph-mon[37295]: Updating smithi005:/etc/ceph/ceph.conf 2024-04-16T14:36:44.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:44 smithi115 ceph-mon[37295]: Updating smithi115:/etc/ceph/ceph.conf 2024-04-16T14:36:44.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:44 smithi115 ceph-mon[37295]: pgmap v9: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1.8 MiB/s wr, 213 op/s 2024-04-16T14:36:44.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:44 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:44.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:44 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:44.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:44 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:36:44.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:44 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:36:44.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:44 smithi005 ceph-mon[28964]: Updating smithi005:/etc/ceph/ceph.conf 2024-04-16T14:36:44.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:44 smithi005 ceph-mon[28964]: Updating smithi115:/etc/ceph/ceph.conf 2024-04-16T14:36:44.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:44 smithi005 ceph-mon[28964]: pgmap v9: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1.8 MiB/s wr, 213 op/s 2024-04-16T14:36:45.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:45 smithi115 ceph-mon[37295]: Updating smithi115:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.conf 2024-04-16T14:36:45.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:45 smithi115 ceph-mon[37295]: Updating smithi005:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.conf 2024-04-16T14:36:45.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:45 smithi115 ceph-mon[37295]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-04-16T14:36:45.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:45 smithi115 ceph-mon[37295]: Updating smithi005:/etc/ceph/ceph.client.admin.keyring 2024-04-16T14:36:45.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:45 smithi115 ceph-mon[37295]: Updating smithi115:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.client.admin.keyring 2024-04-16T14:36:45.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:45 smithi115 ceph-mon[37295]: Updating smithi005:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.client.admin.keyring 2024-04-16T14:36:45.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:45 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:45.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:45 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:45.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:45 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:45.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:45 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:45.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:45 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:45.968 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:45 smithi005 ceph-mon[28964]: Updating smithi115:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.conf 2024-04-16T14:36:45.969 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:45 smithi005 ceph-mon[28964]: Updating smithi005:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.conf 2024-04-16T14:36:45.969 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:45 smithi005 ceph-mon[28964]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-04-16T14:36:45.969 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:45 smithi005 ceph-mon[28964]: Updating smithi005:/etc/ceph/ceph.client.admin.keyring 2024-04-16T14:36:45.969 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:45 smithi005 ceph-mon[28964]: Updating smithi115:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.client.admin.keyring 2024-04-16T14:36:45.969 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:45 smithi005 ceph-mon[28964]: Updating smithi005:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.client.admin.keyring 2024-04-16T14:36:45.969 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:45 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:45.969 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:45 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:45.969 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:45 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:45.969 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:45 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:45.969 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:45 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:46.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:46 smithi005 ceph-mon[28964]: Reconfiguring prometheus.smithi005 (dependencies changed)... 2024-04-16T14:36:46.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:46 smithi005 ceph-mon[28964]: Reconfiguring daemon prometheus.smithi005 on smithi005 2024-04-16T14:36:46.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:46 smithi005 ceph-mon[28964]: pgmap v10: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.7 MiB/s wr, 195 op/s 2024-04-16T14:36:46.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:46 smithi115 ceph-mon[37295]: Reconfiguring prometheus.smithi005 (dependencies changed)... 2024-04-16T14:36:46.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:46 smithi115 ceph-mon[37295]: Reconfiguring daemon prometheus.smithi005 on smithi005 2024-04-16T14:36:46.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:46 smithi115 ceph-mon[37295]: pgmap v10: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.7 MiB/s wr, 195 op/s 2024-04-16T14:36:47.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:47 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:36:47.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:47 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:36:48.853 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:48 smithi005 ceph-mon[28964]: pgmap v11: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.7 MiB/s wr, 195 op/s 2024-04-16T14:36:48.934 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:48 smithi115 ceph-mon[37295]: pgmap v11: 65 pgs: 65 active+clean; 311 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.7 MiB/s wr, 195 op/s 2024-04-16T14:36:50.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:49 smithi115 ceph-mon[37295]: pgmap v12: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 57 KiB/s rd, 2.8 MiB/s wr, 398 op/s 2024-04-16T14:36:50.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:49 smithi005 ceph-mon[28964]: pgmap v12: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 57 KiB/s rd, 2.8 MiB/s wr, 398 op/s 2024-04-16T14:36:51.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:51 smithi005 ceph-mon[28964]: pgmap v13: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 2.0 MiB/s wr, 337 op/s 2024-04-16T14:36:52.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:51 smithi115 ceph-mon[37295]: pgmap v13: 65 pgs: 65 active+clean; 309 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 2.0 MiB/s wr, 337 op/s 2024-04-16T14:36:53.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:52 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:53.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:52 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:53.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:52 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-16T14:36:53.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:52 smithi115 ceph-mon[37295]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-16T14:36:53.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:52 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:36:53.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:52 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:53.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:52 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:53.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:52 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-16T14:36:53.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:52 smithi005 ceph-mon[28964]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-16T14:36:53.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:52 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:36:54.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:53 smithi115 ceph-mon[37295]: Upgrade: Updating mgr.smithi115.brjkpo 2024-04-16T14:36:54.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:53 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi115.brjkpo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-16T14:36:54.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:53 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-16T14:36:54.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:53 smithi115 ceph-mon[37295]: pgmap v14: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 2.9 MiB/s wr, 538 op/s 2024-04-16T14:36:54.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:53 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:36:54.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:53 smithi115 ceph-mon[37295]: Deploying daemon mgr.smithi115.brjkpo on smithi115 2024-04-16T14:36:54.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:53 smithi005 ceph-mon[28964]: Upgrade: Updating mgr.smithi115.brjkpo 2024-04-16T14:36:54.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:53 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi115.brjkpo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-16T14:36:54.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:53 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-16T14:36:54.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:53 smithi005 ceph-mon[28964]: pgmap v14: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 2.9 MiB/s wr, 538 op/s 2024-04-16T14:36:54.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:53 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:36:54.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:53 smithi005 ceph-mon[28964]: Deploying daemon mgr.smithi115.brjkpo on smithi115 2024-04-16T14:36:55.908 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:55 smithi115 ceph-mon[37295]: pgmap v15: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.9 MiB/s wr, 404 op/s 2024-04-16T14:36:56.151 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:55 smithi005 ceph-mon[28964]: pgmap v15: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.9 MiB/s wr, 404 op/s 2024-04-16T14:36:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.151+0000 7f7d8ef8d700 1 -- 172.21.15.5:0/1021953618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8806e9b0 msgr2=0x7f7d8806ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:56.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.151+0000 7f7d8ef8d700 1 --2- 172.21.15.5:0/1021953618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8806e9b0 0x7f7d8806ee20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7d78009ce0 tx=0x7f7d78004d10 comp rx=0 tx=0).stop 2024-04-16T14:36:56.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.153+0000 7f7d8ef8d700 1 -- 172.21.15.5:0/1021953618 shutdown_connections 2024-04-16T14:36:56.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.153+0000 7f7d8ef8d700 1 --2- 172.21.15.5:0/1021953618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8806e9b0 0x7f7d8806ee20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:56.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.153+0000 7f7d8ef8d700 1 --2- 172.21.15.5:0/1021953618 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d8806f9c0 0x7f7d8806e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:56.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.153+0000 7f7d8ef8d700 1 -- 172.21.15.5:0/1021953618 >> 172.21.15.5:0/1021953618 conn(0x7f7d88069df0 msgr2=0x7f7d8806c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:56.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.154+0000 7f7d8ef8d700 1 -- 172.21.15.5:0/1021953618 shutdown_connections 2024-04-16T14:36:56.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.154+0000 7f7d8ef8d700 1 -- 172.21.15.5:0/1021953618 wait complete. 2024-04-16T14:36:56.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.155+0000 7f7d8ef8d700 1 Processor -- start 2024-04-16T14:36:56.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.155+0000 7f7d8ef8d700 1 -- start start 2024-04-16T14:36:56.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.155+0000 7f7d8ef8d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d8806e9b0 0x7f7d8810b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:56.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.155+0000 7f7d8ef8d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8806f9c0 0x7f7d8810be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:56.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.155+0000 7f7d8ef8d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8810c460 con 0x7f7d8806f9c0 2024-04-16T14:36:56.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.155+0000 7f7d8ef8d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8810c5d0 con 0x7f7d8806e9b0 2024-04-16T14:36:56.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.156+0000 7f7d8cd29700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d8806e9b0 0x7f7d8810b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:56.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.156+0000 7f7d8cd29700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d8806e9b0 0x7f7d8810b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.5:44486/0 (socket says 172.21.15.5:44486) 2024-04-16T14:36:56.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.156+0000 7f7d8cd29700 1 -- 172.21.15.5:0/4288142620 learned_addr learned my addr 172.21.15.5:0/4288142620 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:36:56.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.156+0000 7f7d87fff700 1 --2- 172.21.15.5:0/4288142620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8806f9c0 0x7f7d8810be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:56.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.156+0000 7f7d8cd29700 1 -- 172.21.15.5:0/4288142620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8806f9c0 msgr2=0x7f7d8810be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:56.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.156+0000 7f7d8cd29700 1 --2- 172.21.15.5:0/4288142620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8806f9c0 0x7f7d8810be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:56.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.156+0000 7f7d8cd29700 1 -- 172.21.15.5:0/4288142620 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d78009940 con 0x7f7d8806e9b0 2024-04-16T14:36:56.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.156+0000 7f7d87fff700 1 --2- 172.21.15.5:0/4288142620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8806f9c0 0x7f7d8810be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T14:36:56.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.157+0000 7f7d8cd29700 1 --2- 172.21.15.5:0/4288142620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d8806e9b0 0x7f7d8810b920 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c00eb40 tx=0x7f7d7c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:56.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.158+0000 7f7d857fa700 1 -- 172.21.15.5:0/4288142620 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d7c007cc0 con 0x7f7d8806e9b0 2024-04-16T14:36:56.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.158+0000 7f7d857fa700 1 -- 172.21.15.5:0/4288142620 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7d7c00f040 con 0x7f7d8806e9b0 2024-04-16T14:36:56.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.158+0000 7f7d857fa700 1 -- 172.21.15.5:0/4288142620 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d7c009620 con 0x7f7d8806e9b0 2024-04-16T14:36:56.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.158+0000 7f7d8ef8d700 1 -- 172.21.15.5:0/4288142620 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d88110fd0 con 0x7f7d8806e9b0 2024-04-16T14:36:56.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.158+0000 7f7d8ef8d700 1 -- 172.21.15.5:0/4288142620 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d88111590 con 0x7f7d8806e9b0 2024-04-16T14:36:56.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.159+0000 7f7d8ef8d700 1 -- 172.21.15.5:0/4288142620 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d8804c710 con 0x7f7d8806e9b0 2024-04-16T14:36:56.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.161+0000 7f7d857fa700 1 -- 172.21.15.5:0/4288142620 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 92025+0+0 (secure 0 0 0) 0x7f7d7c009780 con 0x7f7d8806e9b0 2024-04-16T14:36:56.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.161+0000 7f7d857fa700 1 --2- 172.21.15.5:0/4288142620 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7f7d7006dc20 0x7f7d700700d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:56.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.162+0000 7f7d857fa700 1 -- 172.21.15.5:0/4288142620 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f7d7c08cfe0 con 0x7f7d8806e9b0 2024-04-16T14:36:56.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.162+0000 7f7d87fff700 1 --2- 172.21.15.5:0/4288142620 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7f7d7006dc20 0x7f7d700700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:56.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.163+0000 7f7d87fff700 1 --2- 172.21.15.5:0/4288142620 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7f7d7006dc20 0x7f7d700700d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7d78009560 tx=0x7f7d78004d10 comp rx=0 tx=0).ready entity=mgr.14732 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.170+0000 7f7d857fa700 1 -- 172.21.15.5:0/4288142620 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f7d7c05a650 con 0x7f7d8806e9b0 2024-04-16T14:36:56.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.498+0000 7f7d8ef8d700 1 -- 172.21.15.5:0/4288142620 --> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d88108140 con 0x7f7d7006dc20 2024-04-16T14:36:56.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.499+0000 7f7d857fa700 1 -- 172.21.15.5:0/4288142620 <== mgr.14732 v2:172.21.15.5:6800/1956301653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f7d88108140 con 0x7f7d7006dc20 2024-04-16T14:36:56.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.502+0000 7f7d8ef8d700 1 -- 172.21.15.5:0/4288142620 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7f7d7006dc20 msgr2=0x7f7d700700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:56.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.502+0000 7f7d8ef8d700 1 --2- 172.21.15.5:0/4288142620 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7f7d7006dc20 0x7f7d700700d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7d78009560 tx=0x7f7d78004d10 comp rx=0 tx=0).stop 2024-04-16T14:36:56.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.502+0000 7f7d8ef8d700 1 -- 172.21.15.5:0/4288142620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d8806e9b0 msgr2=0x7f7d8810b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:56.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.502+0000 7f7d8ef8d700 1 --2- 172.21.15.5:0/4288142620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d8806e9b0 0x7f7d8810b920 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c00eb40 tx=0x7f7d7c00b040 comp rx=0 tx=0).stop 2024-04-16T14:36:56.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.502+0000 7f7d8ef8d700 1 -- 172.21.15.5:0/4288142620 shutdown_connections 2024-04-16T14:36:56.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.502+0000 7f7d8ef8d700 1 --2- 172.21.15.5:0/4288142620 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7f7d7006dc20 0x7f7d700700d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:56.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.502+0000 7f7d8ef8d700 1 --2- 172.21.15.5:0/4288142620 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d8806e9b0 0x7f7d8810b920 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:56.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.502+0000 7f7d8ef8d700 1 --2- 172.21.15.5:0/4288142620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d8806f9c0 0x7f7d8810be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:56.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.502+0000 7f7d8ef8d700 1 -- 172.21.15.5:0/4288142620 >> 172.21.15.5:0/4288142620 conn(0x7f7d88069df0 msgr2=0x7f7d8806b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:56.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.502+0000 7f7d8ef8d700 1 -- 172.21.15.5:0/4288142620 shutdown_connections 2024-04-16T14:36:56.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.502+0000 7f7d8ef8d700 1 -- 172.21.15.5:0/4288142620 wait complete. 2024-04-16T14:36:56.511 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-04-16T14:36:56.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.619+0000 7f8ce469c700 1 -- 172.21.15.5:0/2861426257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cdc0fff90 msgr2=0x7f8cdc102370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:56.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.619+0000 7f8ce469c700 1 --2- 172.21.15.5:0/2861426257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cdc0fff90 0x7f8cdc102370 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc004940 tx=0x7f8ccc009e30 comp rx=0 tx=0).stop 2024-04-16T14:36:56.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.619+0000 7f8ce469c700 1 -- 172.21.15.5:0/2861426257 shutdown_connections 2024-04-16T14:36:56.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.619+0000 7f8ce469c700 1 --2- 172.21.15.5:0/2861426257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cdc0fff90 0x7f8cdc102370 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:56.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.619+0000 7f8ce469c700 1 --2- 172.21.15.5:0/2861426257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cdc066ea0 0x7f8cdc0ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:56.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.619+0000 7f8ce469c700 1 -- 172.21.15.5:0/2861426257 >> 172.21.15.5:0/2861426257 conn(0x7f8cdc0f7440 msgr2=0x7f8cdc0f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:56.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.619+0000 7f8ce469c700 1 -- 172.21.15.5:0/2861426257 shutdown_connections 2024-04-16T14:36:56.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.619+0000 7f8ce469c700 1 -- 172.21.15.5:0/2861426257 wait complete. 2024-04-16T14:36:56.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.620+0000 7f8ce469c700 1 Processor -- start 2024-04-16T14:36:56.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.620+0000 7f8ce469c700 1 -- start start 2024-04-16T14:36:56.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.620+0000 7f8ce469c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cdc066ea0 0x7f8cdc0fd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.620+0000 7f8ce469c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cdc0fff90 0x7f8cdc0fb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.620+0000 7f8ce469c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc0fd850 con 0x7f8cdc0fff90 2024-04-16T14:36:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.620+0000 7f8ce469c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc0fbe90 con 0x7f8cdc066ea0 2024-04-16T14:36:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.620+0000 7f8ce1c37700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cdc0fff90 0x7f8cdc0fb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.620+0000 7f8ce1c37700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cdc0fff90 0x7f8cdc0fb950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53946/0 (socket says 172.21.15.5:53946) 2024-04-16T14:36:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.620+0000 7f8ce1c37700 1 -- 172.21.15.5:0/3416640015 learned_addr learned my addr 172.21.15.5:0/3416640015 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:36:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.620+0000 7f8ce2438700 1 --2- 172.21.15.5:0/3416640015 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cdc066ea0 0x7f8cdc0fd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.620+0000 7f8ce1c37700 1 -- 172.21.15.5:0/3416640015 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cdc066ea0 msgr2=0x7f8cdc0fd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.620+0000 7f8ce1c37700 1 --2- 172.21.15.5:0/3416640015 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cdc066ea0 0x7f8cdc0fd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.620+0000 7f8ce1c37700 1 -- 172.21.15.5:0/3416640015 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc005040 con 0x7f8cdc0fff90 2024-04-16T14:36:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.621+0000 7f8ce1c37700 1 --2- 172.21.15.5:0/3416640015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cdc0fff90 0x7f8cdc0fb950 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00b0d0 tx=0x7f8ccc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.621+0000 7f8cd2ffd700 1 -- 172.21.15.5:0/3416640015 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ccc00e030 con 0x7f8cdc0fff90 2024-04-16T14:36:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.621+0000 7f8ce469c700 1 -- 172.21.15.5:0/3416640015 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cdc0fc110 con 0x7f8cdc0fff90 2024-04-16T14:36:56.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.621+0000 7f8ce469c700 1 -- 172.21.15.5:0/3416640015 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cdc0fc650 con 0x7f8cdc0fff90 2024-04-16T14:36:56.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.621+0000 7f8cd2ffd700 1 -- 172.21.15.5:0/3416640015 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ccc01c400 con 0x7f8cdc0fff90 2024-04-16T14:36:56.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.621+0000 7f8cd2ffd700 1 -- 172.21.15.5:0/3416640015 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ccc0255e0 con 0x7f8cdc0fff90 2024-04-16T14:36:56.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.622+0000 7f8ce469c700 1 -- 172.21.15.5:0/3416640015 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc00052e0 con 0x7f8cdc0fff90 2024-04-16T14:36:56.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.624+0000 7f8cd2ffd700 1 -- 172.21.15.5:0/3416640015 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 92025+0+0 (secure 0 0 0) 0x7f8ccc013af0 con 0x7f8cdc0fff90 2024-04-16T14:36:56.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.624+0000 7f8cd2ffd700 1 --2- 172.21.15.5:0/3416640015 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7f8cc806db70 0x7f8cc8070020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:56.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.624+0000 7f8cd2ffd700 1 -- 172.21.15.5:0/3416640015 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f8ccc08ec20 con 0x7f8cdc0fff90 2024-04-16T14:36:56.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.624+0000 7f8ce2438700 1 --2- 172.21.15.5:0/3416640015 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7f8cc806db70 0x7f8cc8070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:56.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.625+0000 7f8ce2438700 1 --2- 172.21.15.5:0/3416640015 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7f8cc806db70 0x7f8cc8070020 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8009b80 tx=0x7f8cd800b040 comp rx=0 tx=0).ready entity=mgr.14732 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:56.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.631+0000 7f8cd2ffd700 1 -- 172.21.15.5:0/3416640015 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f8ccc05c180 con 0x7f8cdc0fff90 2024-04-16T14:36:56.830 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:56 smithi115 ceph-mon[37295]: from='client.24543 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:36:56.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.960+0000 7f8ce469c700 1 -- 172.21.15.5:0/3416640015 --> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cc0000bf0 con 0x7f8cc806db70 2024-04-16T14:36:56.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.962+0000 7f8cd2ffd700 1 -- 172.21.15.5:0/3416640015 <== mgr.14732 v2:172.21.15.5:6800/1956301653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f8cc0000bf0 con 0x7f8cc806db70 2024-04-16T14:36:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.964+0000 7f8ce469c700 1 -- 172.21.15.5:0/3416640015 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7f8cc806db70 msgr2=0x7f8cc8070020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.964+0000 7f8ce469c700 1 --2- 172.21.15.5:0/3416640015 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7f8cc806db70 0x7f8cc8070020 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8009b80 tx=0x7f8cd800b040 comp rx=0 tx=0).stop 2024-04-16T14:36:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.964+0000 7f8ce469c700 1 -- 172.21.15.5:0/3416640015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cdc0fff90 msgr2=0x7f8cdc0fb950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.964+0000 7f8ce469c700 1 --2- 172.21.15.5:0/3416640015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cdc0fff90 0x7f8cdc0fb950 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00b0d0 tx=0x7f8ccc009e30 comp rx=0 tx=0).stop 2024-04-16T14:36:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.965+0000 7f8ce469c700 1 -- 172.21.15.5:0/3416640015 shutdown_connections 2024-04-16T14:36:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.965+0000 7f8ce469c700 1 --2- 172.21.15.5:0/3416640015 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7f8cc806db70 0x7f8cc8070020 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.965+0000 7f8ce469c700 1 --2- 172.21.15.5:0/3416640015 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cdc066ea0 0x7f8cdc0fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:56.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.965+0000 7f8ce469c700 1 --2- 172.21.15.5:0/3416640015 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cdc0fff90 0x7f8cdc0fb950 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.965+0000 7f8ce469c700 1 -- 172.21.15.5:0/3416640015 >> 172.21.15.5:0/3416640015 conn(0x7f8cdc0f7440 msgr2=0x7f8cdc0f7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.965+0000 7f8ce469c700 1 -- 172.21.15.5:0/3416640015 shutdown_connections 2024-04-16T14:36:56.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:56.965+0000 7f8ce469c700 1 -- 172.21.15.5:0/3416640015 wait complete. 2024-04-16T14:36:57.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.115+0000 7f4ad7fb1700 1 -- 172.21.15.5:0/2120481811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad00fb1f0 msgr2=0x7f4ad00fb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:57.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.115+0000 7f4ad7fb1700 1 --2- 172.21.15.5:0/2120481811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad00fb1f0 0x7f4ad00fb620 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0004940 tx=0x7f4ac0009e30 comp rx=0 tx=0).stop 2024-04-16T14:36:57.114 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:56 smithi005 ceph-mon[28964]: from='client.24543 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:36:57.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.115+0000 7f4ad7fb1700 1 -- 172.21.15.5:0/2120481811 shutdown_connections 2024-04-16T14:36:57.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.115+0000 7f4ad7fb1700 1 --2- 172.21.15.5:0/2120481811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ad00fbb60 0x7f4ad0102370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:57.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.115+0000 7f4ad7fb1700 1 --2- 172.21.15.5:0/2120481811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad00fb1f0 0x7f4ad00fb620 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:57.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.115+0000 7f4ad7fb1700 1 -- 172.21.15.5:0/2120481811 >> 172.21.15.5:0/2120481811 conn(0x7f4ad00f6bd0 msgr2=0x7f4ad00f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:57.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.116+0000 7f4ad7fb1700 1 -- 172.21.15.5:0/2120481811 shutdown_connections 2024-04-16T14:36:57.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.116+0000 7f4ad7fb1700 1 -- 172.21.15.5:0/2120481811 wait complete. 2024-04-16T14:36:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.117+0000 7f4ad7fb1700 1 Processor -- start 2024-04-16T14:36:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.117+0000 7f4ad7fb1700 1 -- start start 2024-04-16T14:36:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.117+0000 7f4ad7fb1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad00fb1f0 0x7f4ad0114110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.117+0000 7f4ad7fb1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ad00fbb60 0x7f4ad0114650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.117+0000 7f4ad7fb1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad0114ce0 con 0x7f4ad00fb1f0 2024-04-16T14:36:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.117+0000 7f4ad7fb1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad01154c0 con 0x7f4ad00fbb60 2024-04-16T14:36:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.117+0000 7f4ad5d4d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad00fb1f0 0x7f4ad0114110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.117+0000 7f4ad554c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ad00fbb60 0x7f4ad0114650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.117+0000 7f4ad5d4d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad00fb1f0 0x7f4ad0114110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53964/0 (socket says 172.21.15.5:53964) 2024-04-16T14:36:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.117+0000 7f4ad5d4d700 1 -- 172.21.15.5:0/3072808686 learned_addr learned my addr 172.21.15.5:0/3072808686 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:36:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.118+0000 7f4ad5d4d700 1 -- 172.21.15.5:0/3072808686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ad00fbb60 msgr2=0x7f4ad0114650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:57.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.118+0000 7f4ad5d4d700 1 --2- 172.21.15.5:0/3072808686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ad00fbb60 0x7f4ad0114650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:57.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.118+0000 7f4ad5d4d700 1 -- 172.21.15.5:0/3072808686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac0005040 con 0x7f4ad00fb1f0 2024-04-16T14:36:57.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.118+0000 7f4ad5d4d700 1 --2- 172.21.15.5:0/3072808686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad00fb1f0 0x7f4ad0114110 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4ac000b3b0 tx=0x7f4ac0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:57.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.119+0000 7f4ace7fc700 1 -- 172.21.15.5:0/3072808686 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ac000e030 con 0x7f4ad00fb1f0 2024-04-16T14:36:57.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.119+0000 7f4ad7fb1700 1 -- 172.21.15.5:0/3072808686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad0115740 con 0x7f4ad00fb1f0 2024-04-16T14:36:57.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.119+0000 7f4ace7fc700 1 -- 172.21.15.5:0/3072808686 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ac0013420 con 0x7f4ad00fb1f0 2024-04-16T14:36:57.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.119+0000 7f4ace7fc700 1 -- 172.21.15.5:0/3072808686 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ac000bee0 con 0x7f4ad00fb1f0 2024-04-16T14:36:57.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.119+0000 7f4ad7fb1700 1 -- 172.21.15.5:0/3072808686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad0115d00 con 0x7f4ad00fb1f0 2024-04-16T14:36:57.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.120+0000 7f4ad7fb1700 1 -- 172.21.15.5:0/3072808686 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad0101370 con 0x7f4ad00fb1f0 2024-04-16T14:36:57.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.122+0000 7f4ace7fc700 1 -- 172.21.15.5:0/3072808686 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 92025+0+0 (secure 0 0 0) 0x7f4ac0013a90 con 0x7f4ad00fb1f0 2024-04-16T14:36:57.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.123+0000 7f4ace7fc700 1 --2- 172.21.15.5:0/3072808686 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7f4ab806dcf0 0x7f4ab80701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:57.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.123+0000 7f4ad554c700 1 --2- 172.21.15.5:0/3072808686 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7f4ab806dcf0 0x7f4ab80701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:57.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.123+0000 7f4ace7fc700 1 -- 172.21.15.5:0/3072808686 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f4ac008f090 con 0x7f4ad00fb1f0 2024-04-16T14:36:57.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.124+0000 7f4ad554c700 1 --2- 172.21.15.5:0/3072808686 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7f4ab806dcf0 0x7f4ab80701a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4006fd0 tx=0x7f4ac4000f90 comp rx=0 tx=0).ready entity=mgr.14732 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:57.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.132+0000 7f4ace7fc700 1 -- 172.21.15.5:0/3072808686 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f4ac005c5d0 con 0x7f4ad00fb1f0 2024-04-16T14:36:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.454+0000 7f4ad7fb1700 1 -- 172.21.15.5:0/3072808686 --> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ad0116030 con 0x7f4ab806dcf0 2024-04-16T14:36:57.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.471+0000 7f4ace7fc700 1 -- 172.21.15.5:0/3072808686 <== mgr.14732 v2:172.21.15.5:6800/1956301653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f4ad0116030 con 0x7f4ab806dcf0 2024-04-16T14:36:57.470 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-16T14:36:57.470 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.smithi005 smithi005 *:9093,9094 running (75s) 19s ago 9m 23.9M - 0.25.0 c8568f914cd2 f8aaa22ee70c 2024-04-16T14:36:57.470 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi005 smithi005 running (9m) 19s ago 9m 6669k - 17.2.7-868-g412a5526 b04d96489b7c 6a380d6ec070 2024-04-16T14:36:57.470 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi115 smithi115 running (8m) 18s ago 8m 6665k - 17.2.7-868-g412a5526 b04d96489b7c df7cb0bfe65b 2024-04-16T14:36:57.470 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.smithi005 smithi005 *:3000 running (65s) 19s ago 9m 78.0M - 9.4.7 954c08fa6188 9834229a010c 2024-04-16T14:36:57.470 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.vzoqdl smithi005 running (4m) 19s ago 4m 12.2M - 17.2.7-868-g412a5526 b04d96489b7c 84a74a406a1d 2024-04-16T14:36:57.470 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.wofqlz smithi005 running (4m) 19s ago 4m 159M - 17.2.7-868-g412a5526 b04d96489b7c d0e053ab2f72 2024-04-16T14:36:57.470 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.byfytg smithi115 running (4m) 18s ago 4m 169M - 17.2.7-868-g412a5526 b04d96489b7c 595cd0892f66 2024-04-16T14:36:57.470 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.trkaqh smithi115 running (3m) 18s ago 3m 12.8M - 17.2.7-868-g412a5526 b04d96489b7c 5b60cd2ad79b 2024-04-16T14:36:57.470 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi005.ipwdkc smithi005 *:8443,9283,8765 running (50s) 19s ago 10m 480M - 19.0.0-2204-g36befe5d b1a78730e0db 451192b4fc44 2024-04-16T14:36:57.471 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi115.brjkpo smithi115 *:8443,9283 running (2m) 18s ago 8m 69.1M - 19.0.0-2204-g36befe5d b1a78730e0db 5f0019fe08af 2024-04-16T14:36:57.471 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi005 smithi005 running (11m) 19s ago 11m 54.9M 2048M 17.2.7-868-g412a5526 b04d96489b7c 764b6a128874 2024-04-16T14:36:57.471 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi115 smithi115 running (8m) 18s ago 8m 37.2M 2048M 17.2.7-868-g412a5526 b04d96489b7c feb5354cdbe9 2024-04-16T14:36:57.471 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi005 smithi005 *:9100 running (103s) 19s ago 9m 16.6M - 1.5.0 0da6a335fe13 c09bba584a42 2024-04-16T14:36:57.471 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi115 smithi115 *:9100 running (57s) 18s ago 8m 8250k - 1.5.0 0da6a335fe13 78cc9cc150c0 2024-04-16T14:36:57.471 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (7m) 19s ago 7m 197M 1559M 17.2.7-868-g412a5526 b04d96489b7c ed7aa0542d96 2024-04-16T14:36:57.471 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (7m) 19s ago 7m 222M 1559M 17.2.7-868-g412a5526 b04d96489b7c 1868cc6c89f4 2024-04-16T14:36:57.471 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (6m) 19s ago 6m 168M 1559M 17.2.7-868-g412a5526 b04d96489b7c b12745ae7d18 2024-04-16T14:36:57.471 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi115 running (6m) 18s ago 6m 255M 2581M 17.2.7-868-g412a5526 b04d96489b7c 59f81301ebcf 2024-04-16T14:36:57.471 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi115 running (6m) 18s ago 6m 221M 2581M 17.2.7-868-g412a5526 b04d96489b7c e3ea96b7edd9 2024-04-16T14:36:57.471 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi115 running (5m) 18s ago 5m 217M 2581M 17.2.7-868-g412a5526 b04d96489b7c 456fa074e453 2024-04-16T14:36:57.471 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.smithi005 smithi005 *:9095 starting - - - - 2024-04-16T14:36:57.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.474+0000 7f4ad7fb1700 1 -- 172.21.15.5:0/3072808686 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7f4ab806dcf0 msgr2=0x7f4ab80701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:57.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.474+0000 7f4ad7fb1700 1 --2- 172.21.15.5:0/3072808686 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7f4ab806dcf0 0x7f4ab80701a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4006fd0 tx=0x7f4ac4000f90 comp rx=0 tx=0).stop 2024-04-16T14:36:57.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.474+0000 7f4ad7fb1700 1 -- 172.21.15.5:0/3072808686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad00fb1f0 msgr2=0x7f4ad0114110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:57.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.474+0000 7f4ad7fb1700 1 --2- 172.21.15.5:0/3072808686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad00fb1f0 0x7f4ad0114110 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4ac000b3b0 tx=0x7f4ac0009e30 comp rx=0 tx=0).stop 2024-04-16T14:36:57.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.474+0000 7f4ad7fb1700 1 -- 172.21.15.5:0/3072808686 shutdown_connections 2024-04-16T14:36:57.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.474+0000 7f4ad7fb1700 1 --2- 172.21.15.5:0/3072808686 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7f4ab806dcf0 0x7f4ab80701a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:57.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.474+0000 7f4ad7fb1700 1 --2- 172.21.15.5:0/3072808686 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4ad00fb1f0 0x7f4ad0114110 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:57.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.474+0000 7f4ad7fb1700 1 --2- 172.21.15.5:0/3072808686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ad00fbb60 0x7f4ad0114650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:57.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.474+0000 7f4ad7fb1700 1 -- 172.21.15.5:0/3072808686 >> 172.21.15.5:0/3072808686 conn(0x7f4ad00f6bd0 msgr2=0x7f4ad00fe4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:57.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.474+0000 7f4ad7fb1700 1 -- 172.21.15.5:0/3072808686 shutdown_connections 2024-04-16T14:36:57.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.474+0000 7f4ad7fb1700 1 -- 172.21.15.5:0/3072808686 wait complete. 2024-04-16T14:36:57.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.584+0000 7efe9c98c700 1 -- 172.21.15.5:0/599186542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe98100050 msgr2=0x7efe98102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:57.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.584+0000 7efe9c98c700 1 --2- 172.21.15.5:0/599186542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe98100050 0x7efe98102430 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7efe8c004940 tx=0x7efe8c009e30 comp rx=0 tx=0).stop 2024-04-16T14:36:57.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.584+0000 7efe9c98c700 1 -- 172.21.15.5:0/599186542 shutdown_connections 2024-04-16T14:36:57.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.584+0000 7efe9c98c700 1 --2- 172.21.15.5:0/599186542 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe98100050 0x7efe98102430 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:57.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.584+0000 7efe9c98c700 1 --2- 172.21.15.5:0/599186542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe98066ae0 0x7efe980ffb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:57.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.584+0000 7efe9c98c700 1 -- 172.21.15.5:0/599186542 >> 172.21.15.5:0/599186542 conn(0x7efe980f74e0 msgr2=0x7efe980f9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:57.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.584+0000 7efe9c98c700 1 -- 172.21.15.5:0/599186542 shutdown_connections 2024-04-16T14:36:57.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.584+0000 7efe9c98c700 1 -- 172.21.15.5:0/599186542 wait complete. 2024-04-16T14:36:57.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.585+0000 7efe9c98c700 1 Processor -- start 2024-04-16T14:36:57.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.585+0000 7efe9c98c700 1 -- start start 2024-04-16T14:36:57.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.585+0000 7efe9c98c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe98066ae0 0x7efe9810da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:57.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.585+0000 7efe9c98c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe98100050 0x7efe9810df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:57.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.585+0000 7efe9c98c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9810e570 con 0x7efe98100050 2024-04-16T14:36:57.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.585+0000 7efe9c98c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9810ed70 con 0x7efe98066ae0 2024-04-16T14:36:57.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.585+0000 7efe95d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe98100050 0x7efe9810df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:57.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.585+0000 7efe9659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe98066ae0 0x7efe9810da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:57.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.585+0000 7efe95d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe98100050 0x7efe9810df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53986/0 (socket says 172.21.15.5:53986) 2024-04-16T14:36:57.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.585+0000 7efe95d9b700 1 -- 172.21.15.5:0/644177713 learned_addr learned my addr 172.21.15.5:0/644177713 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:36:57.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.585+0000 7efe95d9b700 1 -- 172.21.15.5:0/644177713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe98066ae0 msgr2=0x7efe9810da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:57.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.585+0000 7efe95d9b700 1 --2- 172.21.15.5:0/644177713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe98066ae0 0x7efe9810da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:57.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.585+0000 7efe95d9b700 1 -- 172.21.15.5:0/644177713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8c005040 con 0x7efe98100050 2024-04-16T14:36:57.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.586+0000 7efe95d9b700 1 --2- 172.21.15.5:0/644177713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe98100050 0x7efe9810df70 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7efe8c013870 tx=0x7efe8c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:57.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.586+0000 7efe86ffd700 1 -- 172.21.15.5:0/644177713 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe8c021070 con 0x7efe98100050 2024-04-16T14:36:57.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.586+0000 7efe9c98c700 1 -- 172.21.15.5:0/644177713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe9810eff0 con 0x7efe98100050 2024-04-16T14:36:57.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.586+0000 7efe9c98c700 1 -- 172.21.15.5:0/644177713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe9810f530 con 0x7efe98100050 2024-04-16T14:36:57.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.586+0000 7efe86ffd700 1 -- 172.21.15.5:0/644177713 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe8c009430 con 0x7efe98100050 2024-04-16T14:36:57.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.586+0000 7efe86ffd700 1 -- 172.21.15.5:0/644177713 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe8c00e070 con 0x7efe98100050 2024-04-16T14:36:57.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.587+0000 7efe9c98c700 1 -- 172.21.15.5:0/644177713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe780052e0 con 0x7efe98100050 2024-04-16T14:36:57.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.588+0000 7efe86ffd700 1 -- 172.21.15.5:0/644177713 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 92025+0+0 (secure 0 0 0) 0x7efe8c013af0 con 0x7efe98100050 2024-04-16T14:36:57.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.588+0000 7efe86ffd700 1 --2- 172.21.15.5:0/644177713 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7efe8006db60 0x7efe80070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:57.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.589+0000 7efe86ffd700 1 -- 172.21.15.5:0/644177713 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7efe8c08e4d0 con 0x7efe98100050 2024-04-16T14:36:57.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.589+0000 7efe9659c700 1 --2- 172.21.15.5:0/644177713 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7efe8006db60 0x7efe80070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:57.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.589+0000 7efe9659c700 1 --2- 172.21.15.5:0/644177713 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7efe8006db60 0x7efe80070010 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efe88009b80 tx=0x7efe8800b040 comp rx=0 tx=0).ready entity=mgr.14732 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:57.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:57.596+0000 7efe86ffd700 1 -- 172.21.15.5:0/644177713 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7efe8c05bad0 con 0x7efe98100050 2024-04-16T14:36:57.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:57 smithi115 ceph-mon[37295]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:36:57.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:57 smithi115 ceph-mon[37295]: from='client.14798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:36:57.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:57 smithi115 ceph-mon[37295]: pgmap v16: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.9 MiB/s wr, 404 op/s 2024-04-16T14:36:58.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.058+0000 7efe9c98c700 1 -- 172.21.15.5:0/644177713 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efe78005860 con 0x7efe98100050 2024-04-16T14:36:58.057 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:57 smithi005 ceph-mon[28964]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:36:58.057 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:57 smithi005 ceph-mon[28964]: from='client.14798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:36:58.057 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:57 smithi005 ceph-mon[28964]: pgmap v16: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.9 MiB/s wr, 404 op/s 2024-04-16T14:36:58.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.059+0000 7efe86ffd700 1 -- 172.21.15.5:0/644177713 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7efe8c004490 con 0x7efe98100050 2024-04-16T14:36:58.058 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:36:58.058 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-04-16T14:36:58.058 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 2 2024-04-16T14:36:58.058 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:36:58.058 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-04-16T14:36:58.058 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:36:58.058 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:36:58.058 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-04-16T14:36:58.058 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 6 2024-04-16T14:36:58.059 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:36:58.059 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-04-16T14:36:58.059 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 4 2024-04-16T14:36:58.059 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:36:58.059 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-04-16T14:36:58.059 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 12, 2024-04-16T14:36:58.059 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:36:58.059 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-16T14:36:58.059 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:36:58.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.061+0000 7efe9c98c700 1 -- 172.21.15.5:0/644177713 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7efe8006db60 msgr2=0x7efe80070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:58.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.061+0000 7efe9c98c700 1 --2- 172.21.15.5:0/644177713 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7efe8006db60 0x7efe80070010 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efe88009b80 tx=0x7efe8800b040 comp rx=0 tx=0).stop 2024-04-16T14:36:58.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.061+0000 7efe9c98c700 1 -- 172.21.15.5:0/644177713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe98100050 msgr2=0x7efe9810df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:58.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.061+0000 7efe9c98c700 1 --2- 172.21.15.5:0/644177713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe98100050 0x7efe9810df70 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7efe8c013870 tx=0x7efe8c009e30 comp rx=0 tx=0).stop 2024-04-16T14:36:58.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.061+0000 7efe9c98c700 1 -- 172.21.15.5:0/644177713 shutdown_connections 2024-04-16T14:36:58.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.061+0000 7efe9c98c700 1 --2- 172.21.15.5:0/644177713 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7efe8006db60 0x7efe80070010 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:58.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.061+0000 7efe9c98c700 1 --2- 172.21.15.5:0/644177713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe98066ae0 0x7efe9810da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:58.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.061+0000 7efe9c98c700 1 --2- 172.21.15.5:0/644177713 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe98100050 0x7efe9810df70 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:58.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.061+0000 7efe9c98c700 1 -- 172.21.15.5:0/644177713 >> 172.21.15.5:0/644177713 conn(0x7efe980f74e0 msgr2=0x7efe980f7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:58.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.062+0000 7efe9c98c700 1 -- 172.21.15.5:0/644177713 shutdown_connections 2024-04-16T14:36:58.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.062+0000 7efe9c98c700 1 -- 172.21.15.5:0/644177713 wait complete. 2024-04-16T14:36:58.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.226+0000 7fc1a9e59700 1 -- 172.21.15.5:0/255663840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1a40fcff0 msgr2=0x7fc1a40fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:58.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.226+0000 7fc1a9e59700 1 --2- 172.21.15.5:0/255663840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1a40fcff0 0x7fc1a40fd460 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc198004940 tx=0x7fc198009e30 comp rx=0 tx=0).stop 2024-04-16T14:36:58.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.226+0000 7fc1a9e59700 1 -- 172.21.15.5:0/255663840 shutdown_connections 2024-04-16T14:36:58.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.226+0000 7fc1a9e59700 1 --2- 172.21.15.5:0/255663840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1a40fcff0 0x7fc1a40fd460 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:58.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.226+0000 7fc1a9e59700 1 --2- 172.21.15.5:0/255663840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1a40fbd40 0x7fc1a40fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:58.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.226+0000 7fc1a9e59700 1 -- 172.21.15.5:0/255663840 >> 172.21.15.5:0/255663840 conn(0x7fc1a40f74c0 msgr2=0x7fc1a40f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:58.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.227+0000 7fc1a9e59700 1 -- 172.21.15.5:0/255663840 shutdown_connections 2024-04-16T14:36:58.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.227+0000 7fc1a9e59700 1 -- 172.21.15.5:0/255663840 wait complete. 2024-04-16T14:36:58.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.227+0000 7fc1a9e59700 1 Processor -- start 2024-04-16T14:36:58.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.228+0000 7fc1a9e59700 1 -- start start 2024-04-16T14:36:58.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.228+0000 7fc1a9e59700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1a40fbd40 0x7fc1a410fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:58.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.228+0000 7fc1a9e59700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1a40fcff0 0x7fc1a4110120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:58.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.228+0000 7fc1a9e59700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a41107b0 con 0x7fc1a40fbd40 2024-04-16T14:36:58.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.228+0000 7fc1a9e59700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a4110fa0 con 0x7fc1a40fcff0 2024-04-16T14:36:58.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.229+0000 7fc1a2ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1a40fcff0 0x7fc1a4110120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:58.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.229+0000 7fc1a2ffd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1a40fcff0 0x7fc1a4110120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.5:44552/0 (socket says 172.21.15.5:44552) 2024-04-16T14:36:58.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.229+0000 7fc1a2ffd700 1 -- 172.21.15.5:0/899350719 learned_addr learned my addr 172.21.15.5:0/899350719 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:36:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.229+0000 7fc1a2ffd700 1 -- 172.21.15.5:0/899350719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1a40fbd40 msgr2=0x7fc1a410fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.229+0000 7fc1a2ffd700 1 --2- 172.21.15.5:0/899350719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1a40fbd40 0x7fc1a410fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.229+0000 7fc1a2ffd700 1 -- 172.21.15.5:0/899350719 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc198005040 con 0x7fc1a40fcff0 2024-04-16T14:36:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.229+0000 7fc1a2ffd700 1 --2- 172.21.15.5:0/899350719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1a40fcff0 0x7fc1a4110120 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc19800b970 tx=0x7fc198009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.230+0000 7fc18bfff700 1 -- 172.21.15.5:0/899350719 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc19800e070 con 0x7fc1a40fcff0 2024-04-16T14:36:58.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.230+0000 7fc18bfff700 1 -- 172.21.15.5:0/899350719 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc198004290 con 0x7fc1a40fcff0 2024-04-16T14:36:58.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.231+0000 7fc1a9e59700 1 -- 172.21.15.5:0/899350719 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a4111220 con 0x7fc1a40fcff0 2024-04-16T14:36:58.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.231+0000 7fc1a9e59700 1 -- 172.21.15.5:0/899350719 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a41117e0 con 0x7fc1a40fcff0 2024-04-16T14:36:58.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.231+0000 7fc18bfff700 1 -- 172.21.15.5:0/899350719 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc19802ab60 con 0x7fc1a40fcff0 2024-04-16T14:36:58.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.232+0000 7fc1a9e59700 1 -- 172.21.15.5:0/899350719 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a405f5f0 con 0x7fc1a40fcff0 2024-04-16T14:36:58.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.233+0000 7fc18bfff700 1 -- 172.21.15.5:0/899350719 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 92025+0+0 (secure 0 0 0) 0x7fc198027070 con 0x7fc1a40fcff0 2024-04-16T14:36:58.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.234+0000 7fc18bfff700 1 --2- 172.21.15.5:0/899350719 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7fc18c06d9e0 0x7fc18c06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:58.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.234+0000 7fc18bfff700 1 -- 172.21.15.5:0/899350719 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fc198096c40 con 0x7fc1a40fcff0 2024-04-16T14:36:58.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.236+0000 7fc1a37fe700 1 --2- 172.21.15.5:0/899350719 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7fc18c06d9e0 0x7fc18c06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:58.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.238+0000 7fc1a37fe700 1 --2- 172.21.15.5:0/899350719 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7fc18c06d9e0 0x7fc18c06fe90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc194006fd0 tx=0x7fc194006db0 comp rx=0 tx=0).ready entity=mgr.14732 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:58.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.242+0000 7fc18bfff700 1 -- 172.21.15.5:0/899350719 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7fc198064290 con 0x7fc1a40fcff0 2024-04-16T14:36:58.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.653+0000 7fc1a9e59700 1 -- 172.21.15.5:0/899350719 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc1a4103730 con 0x7fc1a40fcff0 2024-04-16T14:36:58.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.653+0000 7fc18bfff700 1 -- 172.21.15.5:0/899350719 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1846 (secure 0 0 0) 0x7fc198063e20 con 0x7fc1a40fcff0 2024-04-16T14:36:58.652 INFO:teuthology.orchestra.run.smithi005.stdout:e20 2024-04-16T14:36:58.652 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:36:58.652 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:36:58.652 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2024-04-16T14:36:58.652 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:36:58.652 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2024-04-16T14:36:58.653 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2024-04-16T14:36:58.653 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 20 2024-04-16T14:36:58.653 INFO:teuthology.orchestra.run.smithi005.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-16T14:36:58.653 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-16T14:32:45.270024+0000 2024-04-16T14:36:58.653 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-04-16T14:35:42.742829+0000 2024-04-16T14:36:58.653 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2024-04-16T14:36:58.653 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2024-04-16T14:36:58.653 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 60 2024-04-16T14:36:58.653 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2024-04-16T14:36:58.653 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2024-04-16T14:36:58.653 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2024-04-16T14:36:58.653 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2024-04-16T14:36:58.653 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 47 2024-04-16T14:36:58.653 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:36:58.654 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 2 2024-04-16T14:36:58.654 INFO:teuthology.orchestra.run.smithi005.stdout:in 0,1 2024-04-16T14:36:58.654 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=14484,1=24269} 2024-04-16T14:36:58.654 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2024-04-16T14:36:58.654 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2024-04-16T14:36:58.654 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 2024-04-16T14:36:58.654 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3] 2024-04-16T14:36:58.654 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2024-04-16T14:36:58.654 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2024-04-16T14:36:58.654 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2024-04-16T14:36:58.654 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 1 2024-04-16T14:36:58.654 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.wofqlz{0:14484} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:36:58.654 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.byfytg{1:24269} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.115:6824/1662994117,v1:172.21.15.115:6825/1662994117] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:36:58.654 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:36:58.655 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:36:58.655 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2024-04-16T14:36:58.655 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:36:58.655 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.vzoqdl{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.5:6826/187766809,v1:172.21.15.5:6827/187766809] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:36:58.655 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.trkaqh{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:36:58.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.656+0000 7fc1a9e59700 1 -- 172.21.15.5:0/899350719 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7fc18c06d9e0 msgr2=0x7fc18c06fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:58.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.656+0000 7fc1a9e59700 1 --2- 172.21.15.5:0/899350719 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7fc18c06d9e0 0x7fc18c06fe90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc194006fd0 tx=0x7fc194006db0 comp rx=0 tx=0).stop 2024-04-16T14:36:58.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.656+0000 7fc1a9e59700 1 -- 172.21.15.5:0/899350719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1a40fcff0 msgr2=0x7fc1a4110120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:58.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.656+0000 7fc1a9e59700 1 --2- 172.21.15.5:0/899350719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1a40fcff0 0x7fc1a4110120 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc19800b970 tx=0x7fc198009e30 comp rx=0 tx=0).stop 2024-04-16T14:36:58.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.656+0000 7fc1a9e59700 1 -- 172.21.15.5:0/899350719 shutdown_connections 2024-04-16T14:36:58.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.656+0000 7fc1a9e59700 1 --2- 172.21.15.5:0/899350719 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7fc18c06d9e0 0x7fc18c06fe90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:58.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.656+0000 7fc1a9e59700 1 --2- 172.21.15.5:0/899350719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1a40fbd40 0x7fc1a410fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:58.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.656+0000 7fc1a9e59700 1 --2- 172.21.15.5:0/899350719 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1a40fcff0 0x7fc1a4110120 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:58.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.656+0000 7fc1a9e59700 1 -- 172.21.15.5:0/899350719 >> 172.21.15.5:0/899350719 conn(0x7fc1a40f74c0 msgr2=0x7fc1a40f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:58.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.656+0000 7fc1a9e59700 1 -- 172.21.15.5:0/899350719 shutdown_connections 2024-04-16T14:36:58.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.656+0000 7fc1a9e59700 1 -- 172.21.15.5:0/899350719 wait complete. 2024-04-16T14:36:58.656 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 20 2024-04-16T14:36:58.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.776+0000 7f5c0d8ef700 1 -- 172.21.15.5:0/3940959877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c08102370 msgr2=0x7f5c08104750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:58.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.776+0000 7f5c0d8ef700 1 --2- 172.21.15.5:0/3940959877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c08102370 0x7f5c08104750 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc004940 tx=0x7f5bfc009e30 comp rx=0 tx=0).stop 2024-04-16T14:36:58.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.776+0000 7f5c0d8ef700 1 -- 172.21.15.5:0/3940959877 shutdown_connections 2024-04-16T14:36:58.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.776+0000 7f5c0d8ef700 1 --2- 172.21.15.5:0/3940959877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c08102370 0x7f5c08104750 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:58.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.776+0000 7f5c0d8ef700 1 --2- 172.21.15.5:0/3940959877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c080662f0 0x7f5c08101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:58.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.776+0000 7f5c0d8ef700 1 -- 172.21.15.5:0/3940959877 >> 172.21.15.5:0/3940959877 conn(0x7f5c080f74c0 msgr2=0x7f5c080f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:58.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.776+0000 7f5c0d8ef700 1 -- 172.21.15.5:0/3940959877 shutdown_connections 2024-04-16T14:36:58.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.776+0000 7f5c0d8ef700 1 -- 172.21.15.5:0/3940959877 wait complete. 2024-04-16T14:36:58.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.777+0000 7f5c0d8ef700 1 Processor -- start 2024-04-16T14:36:58.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.777+0000 7f5c0d8ef700 1 -- start start 2024-04-16T14:36:58.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.777+0000 7f5c0d8ef700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c080662f0 0x7f5c0810fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:58.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.777+0000 7f5c0d8ef700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c08102370 0x7f5c08110130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:58.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.777+0000 7f5c0d8ef700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c08110730 con 0x7f5c080662f0 2024-04-16T14:36:58.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.777+0000 7f5c0d8ef700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c08110f30 con 0x7f5c08102370 2024-04-16T14:36:58.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.777+0000 7f5c06ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c080662f0 0x7f5c0810fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:58.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.777+0000 7f5c06ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c080662f0 0x7f5c0810fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35772/0 (socket says 172.21.15.5:35772) 2024-04-16T14:36:58.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.777+0000 7f5c06ffd700 1 -- 172.21.15.5:0/2757806421 learned_addr learned my addr 172.21.15.5:0/2757806421 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:36:58.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.777+0000 7f5c067fc700 1 --2- 172.21.15.5:0/2757806421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c08102370 0x7f5c08110130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:58.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.778+0000 7f5c06ffd700 1 -- 172.21.15.5:0/2757806421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c08102370 msgr2=0x7f5c08110130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:58.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.778+0000 7f5c06ffd700 1 --2- 172.21.15.5:0/2757806421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c08102370 0x7f5c08110130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:58.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.778+0000 7f5c06ffd700 1 -- 172.21.15.5:0/2757806421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bfc005040 con 0x7f5c080662f0 2024-04-16T14:36:58.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.778+0000 7f5c06ffd700 1 --2- 172.21.15.5:0/2757806421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c080662f0 0x7f5c0810fbf0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800eb40 tx=0x7f5bf800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:58.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.778+0000 7f5bef7fe700 1 -- 172.21.15.5:0/2757806421 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bf8007cc0 con 0x7f5c080662f0 2024-04-16T14:36:58.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.778+0000 7f5c0d8ef700 1 -- 172.21.15.5:0/2757806421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c081111b0 con 0x7f5c080662f0 2024-04-16T14:36:58.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.778+0000 7f5bef7fe700 1 -- 172.21.15.5:0/2757806421 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5bf800f040 con 0x7f5c080662f0 2024-04-16T14:36:58.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.778+0000 7f5c0d8ef700 1 -- 172.21.15.5:0/2757806421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c081116f0 con 0x7f5c080662f0 2024-04-16T14:36:58.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.778+0000 7f5bef7fe700 1 -- 172.21.15.5:0/2757806421 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bf800c9d0 con 0x7f5c080662f0 2024-04-16T14:36:58.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.779+0000 7f5c0d8ef700 1 -- 172.21.15.5:0/2757806421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf40052e0 con 0x7f5c080662f0 2024-04-16T14:36:58.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.780+0000 7f5bef7fe700 1 -- 172.21.15.5:0/2757806421 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 30) v1 ==== 92025+0+0 (secure 0 0 0) 0x7f5bf800cb30 con 0x7f5c080662f0 2024-04-16T14:36:58.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.780+0000 7f5bef7fe700 1 --2- 172.21.15.5:0/2757806421 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7f5bf006db60 0x7f5bf0070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:58.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.780+0000 7f5bef7fe700 1 -- 172.21.15.5:0/2757806421 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f5bf808cd70 con 0x7f5c080662f0 2024-04-16T14:36:58.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.781+0000 7f5c067fc700 1 --2- 172.21.15.5:0/2757806421 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7f5bf006db60 0x7f5bf0070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:58.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.781+0000 7f5c067fc700 1 --2- 172.21.15.5:0/2757806421 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7f5bf006db60 0x7f5bf0070010 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc00b0d0 tx=0x7f5bfc009e30 comp rx=0 tx=0).ready entity=mgr.14732 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:58.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:58.789+0000 7f5bef7fe700 1 -- 172.21.15.5:0/2757806421 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7f5bf805a380 con 0x7f5c080662f0 2024-04-16T14:36:58.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:58 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:58.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:58 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:58.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:58 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:36:58.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:58 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/644177713' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:36:58.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:58 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/899350719' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:36:59.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.057+0000 7f5c0d8ef700 1 -- 172.21.15.5:0/2757806421 --> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5bf4000bf0 con 0x7f5bf006db60 2024-04-16T14:36:59.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.058+0000 7f5bef7fe700 1 -- 172.21.15.5:0/2757806421 <== mgr.14732 v2:172.21.15.5:6800/1956301653 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f5bf4000bf0 con 0x7f5bf006db60 2024-04-16T14:36:59.057 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:36:59.057 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91", 2024-04-16T14:36:59.057 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-04-16T14:36:59.057 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-16T14:36:59.057 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [], 2024-04-16T14:36:59.057 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "", 2024-04-16T14:36:59.057 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading mgr daemons", 2024-04-16T14:36:59.057 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-04-16T14:36:59.057 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:36:59.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.060+0000 7f5c0d8ef700 1 -- 172.21.15.5:0/2757806421 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7f5bf006db60 msgr2=0x7f5bf0070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:59.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.060+0000 7f5c0d8ef700 1 --2- 172.21.15.5:0/2757806421 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7f5bf006db60 0x7f5bf0070010 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc00b0d0 tx=0x7f5bfc009e30 comp rx=0 tx=0).stop 2024-04-16T14:36:59.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.060+0000 7f5c0d8ef700 1 -- 172.21.15.5:0/2757806421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c080662f0 msgr2=0x7f5c0810fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:59.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.060+0000 7f5c0d8ef700 1 --2- 172.21.15.5:0/2757806421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c080662f0 0x7f5c0810fbf0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800eb40 tx=0x7f5bf800b040 comp rx=0 tx=0).stop 2024-04-16T14:36:59.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.060+0000 7f5c0d8ef700 1 -- 172.21.15.5:0/2757806421 shutdown_connections 2024-04-16T14:36:59.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.061+0000 7f5c0d8ef700 1 --2- 172.21.15.5:0/2757806421 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7f5bf006db60 0x7f5bf0070010 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:59.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.061+0000 7f5c0d8ef700 1 --2- 172.21.15.5:0/2757806421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c080662f0 0x7f5c0810fbf0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:59.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.061+0000 7f5c0d8ef700 1 --2- 172.21.15.5:0/2757806421 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c08102370 0x7f5c08110130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:59.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.061+0000 7f5c0d8ef700 1 -- 172.21.15.5:0/2757806421 >> 172.21.15.5:0/2757806421 conn(0x7f5c080f74c0 msgr2=0x7f5c080f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:59.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.061+0000 7f5c0d8ef700 1 -- 172.21.15.5:0/2757806421 shutdown_connections 2024-04-16T14:36:59.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.061+0000 7f5c0d8ef700 1 -- 172.21.15.5:0/2757806421 wait complete. 2024-04-16T14:36:59.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:58 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:59.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:58 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:36:59.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:58 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:36:59.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:58 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/644177713' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:36:59.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:58 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/899350719' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:36:59.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.211+0000 7fa664bcd700 1 -- 172.21.15.5:0/1211798586 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa65c00bcb0 con 0x7fa6601078e0 2024-04-16T14:36:59.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.212+0000 7fa667e33700 1 -- 172.21.15.5:0/1211798586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6601078e0 msgr2=0x7fa660109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:59.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.212+0000 7fa667e33700 1 --2- 172.21.15.5:0/1211798586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6601078e0 0x7fa660109cc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa65c004940 tx=0x7fa65c009e30 comp rx=0 tx=0).stop 2024-04-16T14:36:59.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.212+0000 7fa667e33700 1 -- 172.21.15.5:0/1211798586 shutdown_connections 2024-04-16T14:36:59.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.212+0000 7fa667e33700 1 --2- 172.21.15.5:0/1211798586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa6601078e0 0x7fa660109cc0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:59.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.212+0000 7fa667e33700 1 --2- 172.21.15.5:0/1211798586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa660104fc0 0x7fa6601073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:59.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.212+0000 7fa667e33700 1 -- 172.21.15.5:0/1211798586 >> 172.21.15.5:0/1211798586 conn(0x7fa66006a390 msgr2=0x7fa66006c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:59.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.213+0000 7fa667e33700 1 -- 172.21.15.5:0/1211798586 shutdown_connections 2024-04-16T14:36:59.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.213+0000 7fa667e33700 1 -- 172.21.15.5:0/1211798586 wait complete. 2024-04-16T14:36:59.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.213+0000 7fa667e33700 1 Processor -- start 2024-04-16T14:36:59.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.214+0000 7fa667e33700 1 -- start start 2024-04-16T14:36:59.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.214+0000 7fa667e33700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa660104fc0 0x7fa66011c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:59.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.214+0000 7fa667e33700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6601078e0 0x7fa66011cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:59.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.214+0000 7fa667e33700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66011d290 con 0x7fa660104fc0 2024-04-16T14:36:59.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.214+0000 7fa667e33700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66011d400 con 0x7fa6601078e0 2024-04-16T14:36:59.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.214+0000 7fa6653ce700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6601078e0 0x7fa66011cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:59.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.214+0000 7fa6653ce700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6601078e0 0x7fa66011cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.5:54500/0 (socket says 172.21.15.5:54500) 2024-04-16T14:36:59.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.214+0000 7fa6653ce700 1 -- 172.21.15.5:0/1083301655 learned_addr learned my addr 172.21.15.5:0/1083301655 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:36:59.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.215+0000 7fa665bcf700 1 --2- 172.21.15.5:0/1083301655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa660104fc0 0x7fa66011c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:59.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.215+0000 7fa6653ce700 1 -- 172.21.15.5:0/1083301655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa660104fc0 msgr2=0x7fa66011c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:59.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.215+0000 7fa6653ce700 1 --2- 172.21.15.5:0/1083301655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa660104fc0 0x7fa66011c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:59.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.215+0000 7fa6653ce700 1 -- 172.21.15.5:0/1083301655 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c005040 con 0x7fa6601078e0 2024-04-16T14:36:59.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.215+0000 7fa6653ce700 1 --2- 172.21.15.5:0/1083301655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6601078e0 0x7fa66011cc90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa65c00b3b0 tx=0x7fa65c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:59.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.216+0000 7fa6567fc700 1 -- 172.21.15.5:0/1083301655 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa65c00e070 con 0x7fa6601078e0 2024-04-16T14:36:59.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.216+0000 7fa667e33700 1 -- 172.21.15.5:0/1083301655 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa660121e00 con 0x7fa6601078e0 2024-04-16T14:36:59.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.216+0000 7fa667e33700 1 -- 172.21.15.5:0/1083301655 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa660122390 con 0x7fa6601078e0 2024-04-16T14:36:59.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.216+0000 7fa6567fc700 1 -- 172.21.15.5:0/1083301655 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa65c009430 con 0x7fa6601078e0 2024-04-16T14:36:59.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.216+0000 7fa6567fc700 1 -- 172.21.15.5:0/1083301655 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa65c013d30 con 0x7fa6601078e0 2024-04-16T14:36:59.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.217+0000 7fa667e33700 1 -- 172.21.15.5:0/1083301655 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6440052e0 con 0x7fa6601078e0 2024-04-16T14:36:59.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.218+0000 7fa6567fc700 1 -- 172.21.15.5:0/1083301655 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 30) v1 ==== 92025+0+0 (secure 0 0 0) 0x7fa65c00bbf0 con 0x7fa6601078e0 2024-04-16T14:36:59.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.219+0000 7fa6567fc700 1 --2- 172.21.15.5:0/1083301655 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7fa64c06dc70 0x7fa64c070120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:36:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.219+0000 7fa6567fc700 1 -- 172.21.15.5:0/1083301655 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fa65c08ec50 con 0x7fa6601078e0 2024-04-16T14:36:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.219+0000 7fa665bcf700 1 --2- 172.21.15.5:0/1083301655 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7fa64c06dc70 0x7fa64c070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:36:59.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.220+0000 7fa665bcf700 1 --2- 172.21.15.5:0/1083301655 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7fa64c06dc70 0x7fa64c070120 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa650004f40 tx=0x7fa65000b040 comp rx=0 tx=0).ready entity=mgr.14732 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:36:59.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.227+0000 7fa6567fc700 1 -- 172.21.15.5:0/1083301655 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184553 (secure 0 0 0) 0x7fa65c05c190 con 0x7fa6601078e0 2024-04-16T14:36:59.461 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-16T14:36:59.462 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-16T14:36:59.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.620+0000 7fa667e33700 1 -- 172.21.15.5:0/1083301655 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa644005860 con 0x7fa6601078e0 2024-04-16T14:36:59.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.620+0000 7fa6567fc700 1 -- 172.21.15.5:0/1083301655 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fa65c05bd20 con 0x7fa6601078e0 2024-04-16T14:36:59.619 INFO:teuthology.orchestra.run.smithi005.stdout:HEALTH_OK 2024-04-16T14:36:59.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.622+0000 7fa667e33700 1 -- 172.21.15.5:0/1083301655 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7fa64c06dc70 msgr2=0x7fa64c070120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:59.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.622+0000 7fa667e33700 1 --2- 172.21.15.5:0/1083301655 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7fa64c06dc70 0x7fa64c070120 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa650004f40 tx=0x7fa65000b040 comp rx=0 tx=0).stop 2024-04-16T14:36:59.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.622+0000 7fa667e33700 1 -- 172.21.15.5:0/1083301655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6601078e0 msgr2=0x7fa66011cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:36:59.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.622+0000 7fa667e33700 1 --2- 172.21.15.5:0/1083301655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6601078e0 0x7fa66011cc90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa65c00b3b0 tx=0x7fa65c009e30 comp rx=0 tx=0).stop 2024-04-16T14:36:59.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.622+0000 7fa667e33700 1 -- 172.21.15.5:0/1083301655 shutdown_connections 2024-04-16T14:36:59.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.622+0000 7fa667e33700 1 --2- 172.21.15.5:0/1083301655 >> [v2:172.21.15.5:6800/1956301653,v1:172.21.15.5:6801/1956301653] conn(0x7fa64c06dc70 0x7fa64c070120 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:59.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.622+0000 7fa667e33700 1 --2- 172.21.15.5:0/1083301655 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa660104fc0 0x7fa66011c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:59.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.622+0000 7fa667e33700 1 --2- 172.21.15.5:0/1083301655 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6601078e0 0x7fa66011cc90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:36:59.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.623+0000 7fa667e33700 1 -- 172.21.15.5:0/1083301655 >> 172.21.15.5:0/1083301655 conn(0x7fa66006a390 msgr2=0x7fa660108030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:36:59.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.623+0000 7fa667e33700 1 -- 172.21.15.5:0/1083301655 shutdown_connections 2024-04-16T14:36:59.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:36:59.623+0000 7fa667e33700 1 -- 172.21.15.5:0/1083301655 wait complete. 2024-04-16T14:36:59.862 DEBUG:teuthology.parallel:result is None 2024-04-16T14:36:59.896 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:59 smithi115 ceph-mon[37295]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:36:59.896 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:59 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/1083301655' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:36:59.896 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:36:59 smithi115 ceph-mon[37295]: pgmap v17: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 58 KiB/s rd, 2.7 MiB/s wr, 566 op/s 2024-04-16T14:37:00.226 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:59 smithi005 ceph-mon[28964]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:37:00.226 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:59 smithi005 ceph-mon[28964]: from='client.? 172.21.15.5:0/1083301655' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:37:00.226 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:36:59 smithi005 ceph-mon[28964]: pgmap v17: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 58 KiB/s rd, 2.7 MiB/s wr, 566 op/s 2024-04-16T14:37:02.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:02 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:02.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:02 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:02.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:02 smithi115 ceph-mon[37295]: pgmap v18: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.5 MiB/s wr, 362 op/s 2024-04-16T14:37:02.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:02 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:37:02.628 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:02 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:02.628 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:02 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:02.629 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:02 smithi005 ceph-mon[28964]: pgmap v18: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.5 MiB/s wr, 362 op/s 2024-04-16T14:37:02.629 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:02 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:37:04.082 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:03 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:04.083 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:03 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:04.083 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:03 smithi005 ceph-mon[28964]: pgmap v19: 65 pgs: 65 active+clean; 305 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 52 KiB/s rd, 2.1 MiB/s wr, 507 op/s 2024-04-16T14:37:04.136 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:03 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:04.136 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:03 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:04.136 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:03 smithi115 ceph-mon[37295]: pgmap v19: 65 pgs: 65 active+clean; 305 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 52 KiB/s rd, 2.1 MiB/s wr, 507 op/s 2024-04-16T14:37:05.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:05 smithi005 ceph-mon[28964]: pgmap v20: 65 pgs: 65 active+clean; 305 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.3 MiB/s wr, 306 op/s 2024-04-16T14:37:06.015 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:05 smithi115 ceph-mon[37295]: pgmap v20: 65 pgs: 65 active+clean; 305 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.3 MiB/s wr, 306 op/s 2024-04-16T14:37:06.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:06 smithi115 ceph-mon[37295]: Standby manager daemon smithi115.brjkpo restarted 2024-04-16T14:37:06.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:06 smithi115 ceph-mon[37295]: Standby manager daemon smithi115.brjkpo started 2024-04-16T14:37:06.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:06 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.115:0/678321031' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.brjkpo/crt"}]: dispatch 2024-04-16T14:37:06.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:06 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.115:0/678321031' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-16T14:37:06.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:06 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.115:0/678321031' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.brjkpo/key"}]: dispatch 2024-04-16T14:37:06.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:06 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.115:0/678321031' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-16T14:37:07.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:06 smithi005 ceph-mon[28964]: Standby manager daemon smithi115.brjkpo restarted 2024-04-16T14:37:07.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:06 smithi005 ceph-mon[28964]: Standby manager daemon smithi115.brjkpo started 2024-04-16T14:37:07.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:06 smithi005 ceph-mon[28964]: from='mgr.? 172.21.15.115:0/678321031' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.brjkpo/crt"}]: dispatch 2024-04-16T14:37:07.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:06 smithi005 ceph-mon[28964]: from='mgr.? 172.21.15.115:0/678321031' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-16T14:37:07.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:06 smithi005 ceph-mon[28964]: from='mgr.? 172.21.15.115:0/678321031' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.brjkpo/key"}]: dispatch 2024-04-16T14:37:07.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:06 smithi005 ceph-mon[28964]: from='mgr.? 172.21.15.115:0/678321031' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-16T14:37:08.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:07 smithi115 ceph-mon[37295]: mgrmap e31: smithi005.ipwdkc(active, since 35s), standbys: smithi115.brjkpo 2024-04-16T14:37:08.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:07 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:08.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:07 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:08.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:07 smithi115 ceph-mon[37295]: pgmap v21: 65 pgs: 65 active+clean; 305 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.3 MiB/s wr, 306 op/s 2024-04-16T14:37:08.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:07 smithi005 ceph-mon[28964]: mgrmap e31: smithi005.ipwdkc(active, since 35s), standbys: smithi115.brjkpo 2024-04-16T14:37:08.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:07 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:08.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:07 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:08.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:07 smithi005 ceph-mon[28964]: pgmap v21: 65 pgs: 65 active+clean; 305 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.3 MiB/s wr, 306 op/s 2024-04-16T14:37:09.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:09 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:09.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:09 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:09.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:09 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:37:09.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:09 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:37:09.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:09 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:09.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:09 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:37:09.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:09 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:37:09.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:09 smithi115 ceph-mon[37295]: Upgrade: Setting container_image for all mgr 2024-04-16T14:37:09.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:09 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:09.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:09 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi005.ipwdkc"}]: dispatch 2024-04-16T14:37:09.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:09 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi005.ipwdkc"}]': finished 2024-04-16T14:37:09.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:09 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi115.brjkpo"}]: dispatch 2024-04-16T14:37:09.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:09 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi115.brjkpo"}]': finished 2024-04-16T14:37:09.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:09 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-16T14:37:09.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:09 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:09.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:09 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:09.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:09 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:37:09.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:09 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:37:09.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:09 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:09.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:09 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:37:09.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:09 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:37:09.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:09 smithi005 ceph-mon[28964]: Upgrade: Setting container_image for all mgr 2024-04-16T14:37:09.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:09 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:09.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:09 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi005.ipwdkc"}]: dispatch 2024-04-16T14:37:09.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:09 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi005.ipwdkc"}]': finished 2024-04-16T14:37:09.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:09 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi115.brjkpo"}]: dispatch 2024-04-16T14:37:09.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:09 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi115.brjkpo"}]': finished 2024-04-16T14:37:09.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:09 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-16T14:37:10.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:10 smithi005 ceph-mon[28964]: pgmap v22: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 1.9 MiB/s wr, 441 op/s 2024-04-16T14:37:10.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:10 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:10.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:10 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-16T14:37:10.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:10 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-16T14:37:10.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:10 smithi005 ceph-mon[28964]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:37:10.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:10 smithi115 ceph-mon[37295]: pgmap v22: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 1.9 MiB/s wr, 441 op/s 2024-04-16T14:37:10.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:10 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:10.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:10 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-16T14:37:10.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:10 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-16T14:37:10.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:10 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:37:11.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:11 smithi005 ceph-mon[28964]: Upgrade: Updating mon.smithi005 2024-04-16T14:37:11.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:11 smithi005 ceph-mon[28964]: Deploying daemon mon.smithi005 on smithi005 2024-04-16T14:37:11.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:11 smithi115 ceph-mon[37295]: Upgrade: Updating mon.smithi005 2024-04-16T14:37:11.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:11 smithi115 ceph-mon[37295]: Deploying daemon mon.smithi005 on smithi005 2024-04-16T14:37:12.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:12 smithi005 ceph-mon[28964]: pgmap v23: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.2 MiB/s wr, 279 op/s 2024-04-16T14:37:12.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:12 smithi115 ceph-mon[37295]: pgmap v23: 65 pgs: 65 active+clean; 303 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.2 MiB/s wr, 279 op/s 2024-04-16T14:37:12.545 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:12 smithi005 systemd[1]: Stopping Ceph mon.smithi005 for 10609bfa-fbfd-11ee-bc90-c7b262605968... 2024-04-16T14:37:12.902 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:12 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi005[28960]: 2024-04-16T14:37:12.545+0000 7f033f643700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi005 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-16T14:37:12.902 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:12 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi005[28960]: 2024-04-16T14:37:12.545+0000 7f033f643700 -1 mon.smithi005@0(leader) e2 *** Got Signal Terminated *** 2024-04-16T14:37:12.902 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:12 smithi005 podman[93219]: 2024-04-16 14:37:12.769920906 +0000 UTC m=+0.334005731 container died 764b6a128874cb1072148ccbda3e07c85813464108a9a0c47db04d2ed4aac488 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi005, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=quincy-412a552, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-16T14:37:13.087 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-04-16T14:37:13.088 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-04-16T14:37:13.352 DEBUG:teuthology.parallel:result is None 2024-04-16T14:37:13.353 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-16T14:37:13.393 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-16T14:37:13.393 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-04-16T14:37:13.435 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-04-16T14:37:13.435 DEBUG:teuthology.parallel:result is None 2024-04-16T14:37:13.582 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:13 smithi005 podman[93219]: 2024-04-16 14:37:13.444203107 +0000 UTC m=+1.008287912 container cleanup 764b6a128874cb1072148ccbda3e07c85813464108a9a0c47db04d2ed4aac488 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi005, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-412a552, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-04-16T14:37:13.583 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:13 smithi005 bash[93219]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi005 2024-04-16T14:37:13.868 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:13 smithi005 podman[93241]: 2024-04-16 14:37:13.671119993 +0000 UTC m=+0.896323773 container remove 764b6a128874cb1072148ccbda3e07c85813464108a9a0c47db04d2ed4aac488 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi005, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=quincy-412a552, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-16T14:37:14.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:13 smithi005 systemd[1]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@mon.smithi005.service: Deactivated successfully. 2024-04-16T14:37:14.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:13 smithi005 systemd[1]: Stopped Ceph mon.smithi005 for 10609bfa-fbfd-11ee-bc90-c7b262605968. 2024-04-16T14:37:14.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:13 smithi005 systemd[1]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@mon.smithi005.service: Consumed 10.855s CPU time. 2024-04-16T14:37:14.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 systemd[1]: Starting Ceph mon.smithi005 for 10609bfa-fbfd-11ee-bc90-c7b262605968... 2024-04-16T14:37:14.589 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 podman[93393]: 2024-04-16 14:37:14.213266592 +0000 UTC m=+0.018255252 image pull b1a78730e0db57f46162ae12211512856024b361a698c3ed431f6fbc73b484c3 quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 2024-04-16T14:37:14.590 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 podman[93393]: 2024-04-16 14:37:14.338834311 +0000 UTC m=+0.143822956 container create 3d0c00924867f33f21442f5ca1540af3327627aa97a05c24e2bef0e4422a1da5 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi005, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, ceph=True, org.label-schema.build-date=20240409, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-04-16T14:37:14.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 podman[93393]: 2024-04-16 14:37:14.592053944 +0000 UTC m=+0.397042587 container init 3d0c00924867f33f21442f5ca1540af3327627aa97a05c24e2bef0e4422a1da5 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi005, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-04-16T14:37:14.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 podman[93393]: 2024-04-16 14:37:14.595750194 +0000 UTC m=+0.400738838 container start 3d0c00924867f33f21442f5ca1540af3327627aa97a05c24e2bef0e4422a1da5 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi005, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-04-16T14:37:14.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: set uid:gid to 167:167 (ceph:ceph) 2024-04-16T14:37:14.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev), process ceph-mon, pid 2 2024-04-16T14:37:14.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: pidfile_write: ignore empty --pid-file 2024-04-16T14:37:14.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: load: jerasure load: lrc 2024-04-16T14:37:14.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: RocksDB version: 7.9.2 2024-04-16T14:37:14.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Git sha 0 2024-04-16T14:37:14.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Compile date 2024-04-15 21:33:45 2024-04-16T14:37:14.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: DB SUMMARY 2024-04-16T14:37:14.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: DB Session ID: 233UZZ67SIBOPVIQRXNB 2024-04-16T14:37:14.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: CURRENT file: CURRENT 2024-04-16T14:37:14.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: IDENTITY file: IDENTITY 2024-04-16T14:37:14.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: MANIFEST file: MANIFEST-000015 size: 971 Bytes 2024-04-16T14:37:14.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi005/store.db dir, Total Num: 1, files: 000030.sst 2024-04-16T14:37:14.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi005/store.db: 000028.log size: 2299038 ; 2024-04-16T14:37:14.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.error_if_exists: 0 2024-04-16T14:37:14.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.create_if_missing: 0 2024-04-16T14:37:14.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.paranoid_checks: 1 2024-04-16T14:37:14.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-16T14:37:14.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-16T14:37:14.977 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-16T14:37:14.977 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.env: 0x562f90771c60 2024-04-16T14:37:14.977 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.fs: PosixFileSystem 2024-04-16T14:37:14.977 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.info_log: 0x562f9214d9a0 2024-04-16T14:37:14.977 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.max_file_opening_threads: 16 2024-04-16T14:37:14.978 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.statistics: (nil) 2024-04-16T14:37:14.978 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.use_fsync: 0 2024-04-16T14:37:14.978 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.max_log_file_size: 0 2024-04-16T14:37:14.978 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-16T14:37:14.978 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-16T14:37:14.978 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.keep_log_file_num: 1000 2024-04-16T14:37:14.978 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.recycle_log_file_num: 0 2024-04-16T14:37:14.979 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.allow_fallocate: 1 2024-04-16T14:37:14.979 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.allow_mmap_reads: 0 2024-04-16T14:37:14.979 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.allow_mmap_writes: 0 2024-04-16T14:37:14.979 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.use_direct_reads: 0 2024-04-16T14:37:14.979 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-16T14:37:14.979 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.create_missing_column_families: 0 2024-04-16T14:37:14.979 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.db_log_dir: 2024-04-16T14:37:14.979 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.wal_dir: 2024-04-16T14:37:14.979 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-16T14:37:14.979 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-16T14:37:14.979 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-16T14:37:14.980 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-16T14:37:14.980 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-16T14:37:14.980 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-16T14:37:14.980 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.advise_random_on_open: 1 2024-04-16T14:37:14.980 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.db_write_buffer_size: 0 2024-04-16T14:37:14.980 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.write_buffer_manager: 0x562f921201e0 2024-04-16T14:37:14.980 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-16T14:37:14.980 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-16T14:37:14.981 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-16T14:37:14.981 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.rate_limiter: (nil) 2024-04-16T14:37:14.981 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-16T14:37:14.981 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.wal_recovery_mode: 2 2024-04-16T14:37:14.981 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.enable_thread_tracking: 0 2024-04-16T14:37:14.981 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.enable_pipelined_write: 0 2024-04-16T14:37:14.981 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.unordered_write: 0 2024-04-16T14:37:14.981 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-16T14:37:14.981 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-16T14:37:14.981 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-16T14:37:14.981 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-16T14:37:14.981 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.row_cache: None 2024-04-16T14:37:14.982 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.wal_filter: None 2024-04-16T14:37:14.982 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-16T14:37:14.982 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.allow_ingest_behind: 0 2024-04-16T14:37:14.982 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.two_write_queues: 0 2024-04-16T14:37:14.982 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.manual_wal_flush: 0 2024-04-16T14:37:14.982 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.wal_compression: 0 2024-04-16T14:37:14.982 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.atomic_flush: 0 2024-04-16T14:37:14.982 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-16T14:37:14.982 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-16T14:37:14.982 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-16T14:37:14.983 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.log_readahead_size: 0 2024-04-16T14:37:14.983 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-16T14:37:14.983 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.best_efforts_recovery: 0 2024-04-16T14:37:14.983 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-16T14:37:14.983 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-16T14:37:14.983 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.allow_data_in_errors: 0 2024-04-16T14:37:14.983 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.db_host_id: __hostname__ 2024-04-16T14:37:14.983 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-16T14:37:14.983 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.max_background_jobs: 2 2024-04-16T14:37:14.983 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.max_background_compactions: -1 2024-04-16T14:37:14.983 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.max_subcompactions: 1 2024-04-16T14:37:14.983 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-16T14:37:14.984 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-16T14:37:14.984 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-16T14:37:14.984 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.max_total_wal_size: 0 2024-04-16T14:37:14.984 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-16T14:37:14.984 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-16T14:37:14.984 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-16T14:37:14.984 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-16T14:37:14.984 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.max_open_files: -1 2024-04-16T14:37:14.984 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.bytes_per_sync: 0 2024-04-16T14:37:14.984 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-16T14:37:14.985 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-16T14:37:14.985 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.compaction_readahead_size: 0 2024-04-16T14:37:14.985 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.max_background_flushes: -1 2024-04-16T14:37:14.985 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Compression algorithms supported: 2024-04-16T14:37:14.985 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-16T14:37:14.985 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: kZSTD supported: 0 2024-04-16T14:37:14.985 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: kXpressCompression supported: 0 2024-04-16T14:37:14.985 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: kLZ4HCCompression supported: 1 2024-04-16T14:37:14.985 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: kZlibCompression supported: 1 2024-04-16T14:37:14.985 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: kSnappyCompression supported: 1 2024-04-16T14:37:14.986 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: kLZ4Compression supported: 1 2024-04-16T14:37:14.986 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: kBZip2Compression supported: 0 2024-04-16T14:37:14.986 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-16T14:37:14.986 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-16T14:37:14.986 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi005/store.db/MANIFEST-000015 2024-04-16T14:37:14.986 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-16T14:37:14.986 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-16T14:37:14.986 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.merge_operator: 2024-04-16T14:37:14.986 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.compaction_filter: None 2024-04-16T14:37:14.986 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.compaction_filter_factory: None 2024-04-16T14:37:14.987 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.sst_partitioner_factory: None 2024-04-16T14:37:14.987 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-16T14:37:14.987 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-16T14:37:14.987 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562f9214daa0) 2024-04-16T14:37:14.987 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: cache_index_and_filter_blocks: 1 2024-04-16T14:37:14.987 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-16T14:37:14.987 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-16T14:37:14.987 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: pin_top_level_index_and_filter: 1 2024-04-16T14:37:14.987 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: index_type: 0 2024-04-16T14:37:14.987 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: data_block_index_type: 0 2024-04-16T14:37:14.987 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: index_shortening: 1 2024-04-16T14:37:14.988 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-16T14:37:14.988 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: checksum: 4 2024-04-16T14:37:14.988 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: no_block_cache: 0 2024-04-16T14:37:14.988 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: block_cache: 0x562f92151090 2024-04-16T14:37:14.988 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: block_cache_name: BinnedLRUCache 2024-04-16T14:37:14.988 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: block_cache_options: 2024-04-16T14:37:14.988 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: capacity : 536870912 2024-04-16T14:37:14.988 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: num_shard_bits : 4 2024-04-16T14:37:14.988 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: strict_capacity_limit : 0 2024-04-16T14:37:14.989 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: high_pri_pool_ratio: 0.000 2024-04-16T14:37:14.989 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: block_cache_compressed: (nil) 2024-04-16T14:37:14.989 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: persistent_cache: (nil) 2024-04-16T14:37:14.989 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: block_size: 4096 2024-04-16T14:37:14.989 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: block_size_deviation: 10 2024-04-16T14:37:14.989 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: block_restart_interval: 16 2024-04-16T14:37:14.989 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: index_block_restart_interval: 1 2024-04-16T14:37:14.989 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: metadata_block_size: 4096 2024-04-16T14:37:14.990 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: partition_filters: 0 2024-04-16T14:37:14.990 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: use_delta_encoding: 1 2024-04-16T14:37:14.990 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: filter_policy: bloomfilter 2024-04-16T14:37:14.990 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: whole_key_filtering: 1 2024-04-16T14:37:14.990 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: verify_compression: 0 2024-04-16T14:37:14.990 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: read_amp_bytes_per_bit: 0 2024-04-16T14:37:14.990 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: format_version: 5 2024-04-16T14:37:14.990 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: enable_index_compression: 1 2024-04-16T14:37:14.990 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: block_align: 0 2024-04-16T14:37:14.990 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: max_auto_readahead_size: 262144 2024-04-16T14:37:14.990 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: prepopulate_block_cache: 0 2024-04-16T14:37:14.991 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: initial_auto_readahead_size: 8192 2024-04-16T14:37:14.991 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: num_file_reads_for_auto_readahead: 2 2024-04-16T14:37:14.991 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.write_buffer_size: 33554432 2024-04-16T14:37:14.991 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.max_write_buffer_number: 2 2024-04-16T14:37:14.991 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.compression: NoCompression 2024-04-16T14:37:14.991 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.bottommost_compression: Disabled 2024-04-16T14:37:14.991 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.prefix_extractor: nullptr 2024-04-16T14:37:14.991 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-16T14:37:14.991 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.num_levels: 7 2024-04-16T14:37:14.991 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-16T14:37:14.991 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-16T14:37:14.991 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-16T14:37:14.991 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-16T14:37:14.992 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-16T14:37:14.992 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-16T14:37:14.992 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-16T14:37:14.992 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-16T14:37:14.992 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-16T14:37:14.992 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-16T14:37:14.992 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-16T14:37:14.992 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-16T14:37:14.992 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-16T14:37:14.992 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.compression_opts.level: 32767 2024-04-16T14:37:14.992 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.compression_opts.strategy: 0 2024-04-16T14:37:14.992 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-16T14:37:14.993 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-16T14:37:14.993 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-16T14:37:14.993 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-16T14:37:14.993 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.compression_opts.enabled: false 2024-04-16T14:37:14.993 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-16T14:37:14.993 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-16T14:37:14.993 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-16T14:37:14.993 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-16T14:37:14.993 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.target_file_size_base: 67108864 2024-04-16T14:37:14.993 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-16T14:37:14.993 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-16T14:37:14.993 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-16T14:37:14.994 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-16T14:37:14.994 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-16T14:37:14.995 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-16T14:37:14.995 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-16T14:37:14.995 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-16T14:37:14.995 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-16T14:37:14.995 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-16T14:37:14.995 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-16T14:37:14.995 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-16T14:37:14.995 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-16T14:37:14.995 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-16T14:37:14.996 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.arena_block_size: 1048576 2024-04-16T14:37:14.996 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-16T14:37:14.996 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-16T14:37:14.996 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.disable_auto_compactions: 0 2024-04-16T14:37:14.996 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-16T14:37:14.996 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-16T14:37:14.996 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-16T14:37:14.996 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-16T14:37:14.996 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-16T14:37:14.996 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-16T14:37:14.996 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-16T14:37:14.996 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-16T14:37:14.997 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-16T14:37:14.997 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-16T14:37:14.997 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.table_properties_collectors: 2024-04-16T14:37:14.997 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.inplace_update_support: 0 2024-04-16T14:37:14.997 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-16T14:37:14.997 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-16T14:37:14.997 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-16T14:37:14.997 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-16T14:37:14.997 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.bloom_locality: 0 2024-04-16T14:37:14.997 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.max_successive_merges: 0 2024-04-16T14:37:14.997 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-16T14:37:14.997 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.paranoid_file_checks: 0 2024-04-16T14:37:14.997 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.force_consistency_checks: 1 2024-04-16T14:37:14.998 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.report_bg_io_stats: 0 2024-04-16T14:37:14.998 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.ttl: 2592000 2024-04-16T14:37:14.998 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-16T14:37:14.998 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-16T14:37:14.998 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-16T14:37:14.998 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.enable_blob_files: false 2024-04-16T14:37:14.998 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.min_blob_size: 0 2024-04-16T14:37:14.998 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.blob_file_size: 268435456 2024-04-16T14:37:14.998 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-16T14:37:14.998 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-16T14:37:14.998 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-16T14:37:14.998 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-16T14:37:14.999 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-16T14:37:14.999 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.blob_file_starting_level: 0 2024-04-16T14:37:14.999 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-16T14:37:14.999 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 30.sst 2024-04-16T14:37:14.999 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-16T14:37:14.999 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi005/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 32, last_sequence is 10295, log_number is 28,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-16T14:37:14.999 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 28 2024-04-16T14:37:14.999 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 62aeac96-9084-4444-bd54-fbab2feeec00 2024-04-16T14:37:14.999 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713278234637103, "job": 1, "event": "recovery_started", "wal_files": [28]} 2024-04-16T14:37:14.999 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #28 mode 2 2024-04-16T14:37:14.999 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713278234644349, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 33, "file_size": 2103525, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10296, "largest_seqno": 11166, "table_properties": {"data_size": 2098752, "index_size": 2732, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1029, "raw_key_size": 9338, "raw_average_key_size": 23, "raw_value_size": 2090031, "raw_average_value_size": 5225, "num_data_blocks": 125, "num_entries": 400, "num_filter_entries": 400, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1713278234, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "62aeac96-9084-4444-bd54-fbab2feeec00", "db_session_id": "233UZZ67SIBOPVIQRXNB", "orig_file_number": 33, "seqno_to_time_mapping": "N/A"}} 2024-04-16T14:37:14.999 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713278234644457, "job": 1, "event": "recovery_finished"} 2024-04-16T14:37:15.000 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: [db/version_set.cc:5047] Creating manifest 35 2024-04-16T14:37:15.000 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-16T14:37:15.000 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi005/store.db/000028.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-16T14:37:15.000 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562f92242000 2024-04-16T14:37:15.000 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: DB pointer 0x562f9222c000 2024-04-16T14:37:15.000 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-16T14:37:15.000 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-16T14:37:15.000 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: ** DB Stats ** 2024-04-16T14:37:15.000 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-16T14:37:15.000 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-16T14:37:15.000 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-16T14:37:15.000 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-16T14:37:15.001 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-16T14:37:15.001 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-16T14:37:15.001 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-16T14:37:15.001 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: 2024-04-16T14:37:15.001 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: ** Compaction Stats [default] ** 2024-04-16T14:37:15.001 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-16T14:37:15.001 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-16T14:37:15.001 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: L0 1/0 2.01 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 525.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-04-16T14:37:15.001 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: L6 1/0 5.25 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-16T14:37:15.001 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Sum 2/0 7.25 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 525.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-04-16T14:37:15.001 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 525.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-04-16T14:37:15.001 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: 2024-04-16T14:37:15.002 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: ** Compaction Stats [default] ** 2024-04-16T14:37:15.002 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-16T14:37:15.002 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-16T14:37:15.002 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 525.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-04-16T14:37:15.002 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: 2024-04-16T14:37:15.002 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-16T14:37:15.002 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: 2024-04-16T14:37:15.002 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-16T14:37:15.002 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-04-16T14:37:15.002 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-16T14:37:15.002 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-16T14:37:15.002 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-16T14:37:15.003 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-16T14:37:15.003 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Cumulative compaction: 0.00 GB write, 98.88 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-16T14:37:15.003 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Interval compaction: 0.00 GB write, 98.88 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-16T14:37:15.003 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-16T14:37:15.003 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Block cache BinnedLRUCache@0x562f92151090#2 capacity: 512.00 MB usage: 3.98 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-04-16T14:37:15.003 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.16 KB,0.000220537%) IndexBlock(1,2.83 KB,0.000539422%) Misc(1,0.00 KB,0%) 2024-04-16T14:37:15.003 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: 2024-04-16T14:37:15.003 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-16T14:37:15.003 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: starting mon.smithi005 rank 0 at public addrs [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] at bind addrs [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi005 fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 2024-04-16T14:37:15.003 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: mon.smithi005@-1(???) e2 preinit fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 2024-04-16T14:37:15.003 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: mon.smithi005@-1(???).mds e20 new map 2024-04-16T14:37:15.004 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: mon.smithi005@-1(???).mds e20 print_map 2024-04-16T14:37:15.004 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: e20 2024-04-16T14:37:15.004 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:37:15.004 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:37:15.004 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: legacy client fscid: 1 2024-04-16T14:37:15.004 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: 2024-04-16T14:37:15.004 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Filesystem 'cephfs' (1) 2024-04-16T14:37:15.004 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: fs_name cephfs 2024-04-16T14:37:15.004 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: epoch 20 2024-04-16T14:37:15.004 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-16T14:37:15.004 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: created 2024-04-16T14:32:45.270024+0000 2024-04-16T14:37:15.004 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: modified 2024-04-16T14:35:42.742829+0000 2024-04-16T14:37:15.004 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: tableserver 0 2024-04-16T14:37:15.005 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: root 0 2024-04-16T14:37:15.005 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: session_timeout 60 2024-04-16T14:37:15.005 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: session_autoclose 300 2024-04-16T14:37:15.005 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: max_file_size 1099511627776 2024-04-16T14:37:15.005 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: max_xattr_size 65536 2024-04-16T14:37:15.005 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: required_client_features {} 2024-04-16T14:37:15.005 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: last_failure 0 2024-04-16T14:37:15.005 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: last_failure_osd_epoch 47 2024-04-16T14:37:15.005 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:37:15.005 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: max_mds 2 2024-04-16T14:37:15.005 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: in 0,1 2024-04-16T14:37:15.006 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: up {0=14484,1=24269} 2024-04-16T14:37:15.006 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: failed 2024-04-16T14:37:15.006 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: damaged 2024-04-16T14:37:15.006 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: stopped 2024-04-16T14:37:15.006 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: data_pools [3] 2024-04-16T14:37:15.006 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: metadata_pool 2 2024-04-16T14:37:15.006 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: inline_data disabled 2024-04-16T14:37:15.006 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: balancer 2024-04-16T14:37:15.006 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: bal_rank_mask -1 2024-04-16T14:37:15.006 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: standby_count_wanted 1 2024-04-16T14:37:15.006 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: qdb_cluster leader: 0 members: 2024-04-16T14:37:15.006 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: [mds.cephfs.smithi005.wofqlz{0:14484} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:37:15.007 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: [mds.cephfs.smithi115.byfytg{1:24269} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.115:6824/1662994117,v1:172.21.15.115:6825/1662994117] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:37:15.007 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: 2024-04-16T14:37:15.007 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: 2024-04-16T14:37:15.007 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: Standby daemons: 2024-04-16T14:37:15.007 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: 2024-04-16T14:37:15.007 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: [mds.cephfs.smithi005.vzoqdl{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.5:6826/187766809,v1:172.21.15.5:6827/187766809] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:37:15.007 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout: [mds.cephfs.smithi115.trkaqh{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:37:15.007 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: mon.smithi005@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-16T14:37:15.007 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: mon.smithi005@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-16T14:37:15.007 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: mon.smithi005@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-16T14:37:15.007 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: mon.smithi005@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-16T14:37:15.007 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 ceph-mon[93420]: mon.smithi005@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2024-04-16T14:37:15.008 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 bash[93393]: 3d0c00924867f33f21442f5ca1540af3327627aa97a05c24e2bef0e4422a1da5 2024-04-16T14:37:15.008 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:14 smithi005 systemd[1]: Started Ceph mon.smithi005 for 10609bfa-fbfd-11ee-bc90-c7b262605968. 2024-04-16T14:37:16.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:16 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-04-16T14:37:16.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:16 smithi115 ceph-mon[37295]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:37:16.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:16 smithi115 ceph-mon[37295]: pgmap v24: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 1.8 MiB/s wr, 429 op/s 2024-04-16T14:37:16.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:16 smithi115 ceph-mon[37295]: pgmap v25: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.3 MiB/s wr, 285 op/s 2024-04-16T14:37:16.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:16 smithi115 ceph-mon[37295]: mon.smithi005 calling monitor election 2024-04-16T14:37:16.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:16 smithi115 ceph-mon[37295]: mon.smithi005 is new leader, mons smithi005,smithi115 in quorum (ranks 0,1) 2024-04-16T14:37:16.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:16 smithi115 ceph-mon[37295]: monmap epoch 2 2024-04-16T14:37:16.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:16 smithi115 ceph-mon[37295]: fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 2024-04-16T14:37:16.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:16 smithi115 ceph-mon[37295]: last_changed 2024-04-16T14:28:26.275259+0000 2024-04-16T14:37:16.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:16 smithi115 ceph-mon[37295]: created 2024-04-16T14:25:42.269119+0000 2024-04-16T14:37:16.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:16 smithi115 ceph-mon[37295]: min_mon_release 17 (quincy) 2024-04-16T14:37:16.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:16 smithi115 ceph-mon[37295]: election_strategy: 1 2024-04-16T14:37:16.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:16 smithi115 ceph-mon[37295]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.smithi005 2024-04-16T14:37:16.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:16 smithi115 ceph-mon[37295]: 1: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.smithi115 2024-04-16T14:37:16.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:16 smithi115 ceph-mon[37295]: fsmap cephfs:2 {0=cephfs.smithi005.wofqlz=up:active,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:37:16.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:16 smithi115 ceph-mon[37295]: osdmap e49: 6 total, 6 up, 6 in 2024-04-16T14:37:16.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:16 smithi115 ceph-mon[37295]: mgrmap e31: smithi005.ipwdkc(active, since 44s), standbys: smithi115.brjkpo 2024-04-16T14:37:16.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:16 smithi115 ceph-mon[37295]: overall HEALTH_OK 2024-04-16T14:37:16.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:16 smithi115 ceph-mon[37295]: from='mgr.14732 ' entity='' 2024-04-16T14:37:16.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:16 smithi115 ceph-mon[37295]: mgrmap e32: smithi005.ipwdkc(active, since 44s), standbys: smithi115.brjkpo 2024-04-16T14:37:16.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:16 smithi005 ceph-mon[93420]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-04-16T14:37:16.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:16 smithi005 ceph-mon[93420]: from='mgr.14732 172.21.15.5:0/2904889046' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:37:16.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:16 smithi005 ceph-mon[93420]: pgmap v24: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 1.8 MiB/s wr, 429 op/s 2024-04-16T14:37:16.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:16 smithi005 ceph-mon[93420]: pgmap v25: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.3 MiB/s wr, 285 op/s 2024-04-16T14:37:16.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:16 smithi005 ceph-mon[93420]: mon.smithi005 calling monitor election 2024-04-16T14:37:16.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:16 smithi005 ceph-mon[93420]: mon.smithi005 is new leader, mons smithi005,smithi115 in quorum (ranks 0,1) 2024-04-16T14:37:16.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:16 smithi005 ceph-mon[93420]: monmap epoch 2 2024-04-16T14:37:16.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:16 smithi005 ceph-mon[93420]: fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 2024-04-16T14:37:16.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:16 smithi005 ceph-mon[93420]: last_changed 2024-04-16T14:28:26.275259+0000 2024-04-16T14:37:16.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:16 smithi005 ceph-mon[93420]: created 2024-04-16T14:25:42.269119+0000 2024-04-16T14:37:16.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:16 smithi005 ceph-mon[93420]: min_mon_release 17 (quincy) 2024-04-16T14:37:16.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:16 smithi005 ceph-mon[93420]: election_strategy: 1 2024-04-16T14:37:16.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:16 smithi005 ceph-mon[93420]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.smithi005 2024-04-16T14:37:16.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:16 smithi005 ceph-mon[93420]: 1: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.smithi115 2024-04-16T14:37:16.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:16 smithi005 ceph-mon[93420]: fsmap cephfs:2 {0=cephfs.smithi005.wofqlz=up:active,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:37:16.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:16 smithi005 ceph-mon[93420]: osdmap e49: 6 total, 6 up, 6 in 2024-04-16T14:37:16.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:16 smithi005 ceph-mon[93420]: mgrmap e31: smithi005.ipwdkc(active, since 44s), standbys: smithi115.brjkpo 2024-04-16T14:37:16.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:16 smithi005 ceph-mon[93420]: overall HEALTH_OK 2024-04-16T14:37:16.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:16 smithi005 ceph-mon[93420]: from='mgr.14732 ' entity='' 2024-04-16T14:37:16.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:16 smithi005 ceph-mon[93420]: mgrmap e32: smithi005.ipwdkc(active, since 44s), standbys: smithi115.brjkpo 2024-04-16T14:37:23.183 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:23 smithi005 ceph-mon[93420]: Standby manager daemon smithi115.brjkpo restarted 2024-04-16T14:37:23.183 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:23 smithi005 ceph-mon[93420]: Standby manager daemon smithi115.brjkpo started 2024-04-16T14:37:23.183 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:23 smithi005 ceph-mon[93420]: from='mgr.? 172.21.15.115:0/3202491378' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.brjkpo/crt"}]: dispatch 2024-04-16T14:37:23.184 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:23 smithi005 ceph-mon[93420]: from='mgr.? 172.21.15.115:0/3202491378' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-16T14:37:23.184 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:23 smithi005 ceph-mon[93420]: from='mgr.? 172.21.15.115:0/3202491378' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.brjkpo/key"}]: dispatch 2024-04-16T14:37:23.184 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:23 smithi005 ceph-mon[93420]: from='mgr.? 172.21.15.115:0/3202491378' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-16T14:37:23.312 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:23 smithi115 ceph-mon[37295]: Standby manager daemon smithi115.brjkpo restarted 2024-04-16T14:37:23.312 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:23 smithi115 ceph-mon[37295]: Standby manager daemon smithi115.brjkpo started 2024-04-16T14:37:23.312 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:23 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.115:0/3202491378' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.brjkpo/crt"}]: dispatch 2024-04-16T14:37:23.312 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:23 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.115:0/3202491378' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-16T14:37:23.312 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:23 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.115:0/3202491378' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi115.brjkpo/key"}]: dispatch 2024-04-16T14:37:23.312 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:23 smithi115 ceph-mon[37295]: from='mgr.? 172.21.15.115:0/3202491378' entity='mgr.smithi115.brjkpo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-16T14:37:24.355 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:24 smithi115 ceph-mon[37295]: mgrmap e33: smithi005.ipwdkc(active, since 51s), standbys: smithi115.brjkpo 2024-04-16T14:37:24.355 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:24 smithi115 ceph-mon[37295]: Active manager daemon smithi005.ipwdkc restarted 2024-04-16T14:37:24.355 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:24 smithi115 ceph-mon[37295]: Activating manager daemon smithi005.ipwdkc 2024-04-16T14:37:24.355 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:24 smithi115 ceph-mon[37295]: osdmap e50: 6 total, 6 up, 6 in 2024-04-16T14:37:24.355 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:24 smithi115 ceph-mon[37295]: mgrmap e34: smithi005.ipwdkc(active, starting, since 0.00534306s), standbys: smithi115.brjkpo 2024-04-16T14:37:24.355 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:24 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-04-16T14:37:24.355 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:24 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:37:24.355 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:24 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi005.wofqlz"}]: dispatch 2024-04-16T14:37:24.355 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:24 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi005.vzoqdl"}]: dispatch 2024-04-16T14:37:24.356 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:24 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.byfytg"}]: dispatch 2024-04-16T14:37:24.356 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:24 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.trkaqh"}]: dispatch 2024-04-16T14:37:24.356 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:24 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr metadata", "who": "smithi005.ipwdkc", "id": "smithi005.ipwdkc"}]: dispatch 2024-04-16T14:37:24.356 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:24 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr metadata", "who": "smithi115.brjkpo", "id": "smithi115.brjkpo"}]: dispatch 2024-04-16T14:37:24.356 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:24 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-16T14:37:24.356 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:24 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-16T14:37:24.356 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:24 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-16T14:37:24.356 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:24 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-16T14:37:24.356 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:24 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-16T14:37:24.356 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:24 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-16T14:37:24.356 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:24 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-16T14:37:24.356 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:24 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-16T14:37:24.356 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:24 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-16T14:37:24.357 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:24 smithi115 ceph-mon[37295]: Manager daemon smithi005.ipwdkc is now available 2024-04-16T14:37:24.357 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:24 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:37:24.357 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:24 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:37:24.357 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:24 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi005.ipwdkc/mirror_snapshot_schedule"}]: dispatch 2024-04-16T14:37:24.357 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:24 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi005.ipwdkc/trash_purge_schedule"}]: dispatch 2024-04-16T14:37:24.416 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:24 smithi005 ceph-mon[93420]: mgrmap e33: smithi005.ipwdkc(active, since 51s), standbys: smithi115.brjkpo 2024-04-16T14:37:24.416 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:24 smithi005 ceph-mon[93420]: Active manager daemon smithi005.ipwdkc restarted 2024-04-16T14:37:24.416 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:24 smithi005 ceph-mon[93420]: Activating manager daemon smithi005.ipwdkc 2024-04-16T14:37:24.416 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:24 smithi005 ceph-mon[93420]: osdmap e50: 6 total, 6 up, 6 in 2024-04-16T14:37:24.417 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:24 smithi005 ceph-mon[93420]: mgrmap e34: smithi005.ipwdkc(active, starting, since 0.00534306s), standbys: smithi115.brjkpo 2024-04-16T14:37:24.417 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-04-16T14:37:24.417 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:37:24.417 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi005.wofqlz"}]: dispatch 2024-04-16T14:37:24.417 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi005.vzoqdl"}]: dispatch 2024-04-16T14:37:24.417 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.byfytg"}]: dispatch 2024-04-16T14:37:24.417 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.trkaqh"}]: dispatch 2024-04-16T14:37:24.417 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr metadata", "who": "smithi005.ipwdkc", "id": "smithi005.ipwdkc"}]: dispatch 2024-04-16T14:37:24.417 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr metadata", "who": "smithi115.brjkpo", "id": "smithi115.brjkpo"}]: dispatch 2024-04-16T14:37:24.417 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-16T14:37:24.417 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-16T14:37:24.417 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-16T14:37:24.417 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-16T14:37:24.417 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-16T14:37:24.418 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-16T14:37:24.418 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-16T14:37:24.418 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-16T14:37:24.418 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-16T14:37:24.418 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:24 smithi005 ceph-mon[93420]: Manager daemon smithi005.ipwdkc is now available 2024-04-16T14:37:24.418 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:37:24.418 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:37:24.418 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi005.ipwdkc/mirror_snapshot_schedule"}]: dispatch 2024-04-16T14:37:24.418 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi005.ipwdkc/trash_purge_schedule"}]: dispatch 2024-04-16T14:37:25.421 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:25 smithi005 ceph-mon[93420]: mgrmap e35: smithi005.ipwdkc(active, since 1.00964s), standbys: smithi115.brjkpo 2024-04-16T14:37:25.421 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:25 smithi005 ceph-mon[93420]: [16/Apr/2024:14:37:24] ENGINE Bus STARTING 2024-04-16T14:37:25.421 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:25 smithi005 ceph-mon[93420]: [16/Apr/2024:14:37:24] ENGINE Serving on http://172.21.15.5:8765 2024-04-16T14:37:25.421 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:25 smithi005 ceph-mon[93420]: [16/Apr/2024:14:37:24] ENGINE Serving on https://172.21.15.5:7150 2024-04-16T14:37:25.421 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:25 smithi005 ceph-mon[93420]: [16/Apr/2024:14:37:24] ENGINE Bus STARTED 2024-04-16T14:37:25.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:25 smithi115 ceph-mon[37295]: mgrmap e35: smithi005.ipwdkc(active, since 1.00964s), standbys: smithi115.brjkpo 2024-04-16T14:37:25.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:25 smithi115 ceph-mon[37295]: [16/Apr/2024:14:37:24] ENGINE Bus STARTING 2024-04-16T14:37:25.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:25 smithi115 ceph-mon[37295]: [16/Apr/2024:14:37:24] ENGINE Serving on http://172.21.15.5:8765 2024-04-16T14:37:25.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:25 smithi115 ceph-mon[37295]: [16/Apr/2024:14:37:24] ENGINE Serving on https://172.21.15.5:7150 2024-04-16T14:37:25.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:25 smithi115 ceph-mon[37295]: [16/Apr/2024:14:37:24] ENGINE Bus STARTED 2024-04-16T14:37:26.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:26 smithi005 ceph-mon[93420]: pgmap v4: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:37:26.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:26 smithi005 ceph-mon[93420]: mgrmap e36: smithi005.ipwdkc(active, since 2s), standbys: smithi115.brjkpo 2024-04-16T14:37:26.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:26 smithi115 ceph-mon[37295]: pgmap v4: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:37:26.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:26 smithi115 ceph-mon[37295]: mgrmap e36: smithi005.ipwdkc(active, since 2s), standbys: smithi115.brjkpo 2024-04-16T14:37:27.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:27 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:27.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:27 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:27.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:27 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:27.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:27 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:28.657 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:28 smithi005 ceph-mon[93420]: pgmap v5: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:37:28.658 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:28 smithi005 ceph-mon[93420]: mgrmap e37: smithi005.ipwdkc(active, since 4s), standbys: smithi115.brjkpo 2024-04-16T14:37:28.658 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:28 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:28.658 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:28 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:28.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:28 smithi115 ceph-mon[37295]: pgmap v5: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:37:28.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:28 smithi115 ceph-mon[37295]: mgrmap e37: smithi005.ipwdkc(active, since 4s), standbys: smithi115.brjkpo 2024-04-16T14:37:28.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:28 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:28.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:28 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:29.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.732+0000 7f18b3a5f700 1 -- 172.21.15.5:0/1569360202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18ac0fce50 msgr2=0x7f18ac0fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:29.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.732+0000 7f18b3a5f700 1 --2- 172.21.15.5:0/1569360202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18ac0fce50 0x7f18ac0fd260 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f18a8004940 tx=0x7f18a8009e30 comp rx=0 tx=0).stop 2024-04-16T14:37:29.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.732+0000 7f18b3a5f700 1 -- 172.21.15.5:0/1569360202 shutdown_connections 2024-04-16T14:37:29.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.732+0000 7f18b3a5f700 1 --2- 172.21.15.5:0/1569360202 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18ac0fe050 0x7f18ac0fe4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:29.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.732+0000 7f18b3a5f700 1 --2- 172.21.15.5:0/1569360202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18ac0fce50 0x7f18ac0fd260 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:29.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.732+0000 7f18b3a5f700 1 -- 172.21.15.5:0/1569360202 >> 172.21.15.5:0/1569360202 conn(0x7f18ac0f8540 msgr2=0x7f18ac0fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:37:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.732+0000 7f18b3a5f700 1 -- 172.21.15.5:0/1569360202 shutdown_connections 2024-04-16T14:37:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.732+0000 7f18b3a5f700 1 -- 172.21.15.5:0/1569360202 wait complete. 2024-04-16T14:37:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.733+0000 7f18b3a5f700 1 Processor -- start 2024-04-16T14:37:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.733+0000 7f18b3a5f700 1 -- start start 2024-04-16T14:37:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.733+0000 7f18b3a5f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18ac0fce50 0x7f18ac10d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:37:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.733+0000 7f18b3a5f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18ac0fe050 0x7f18ac10def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:37:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.733+0000 7f18b3a5f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac10e4f0 con 0x7f18ac0fe050 2024-04-16T14:37:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.733+0000 7f18b3a5f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac10ed40 con 0x7f18ac0fce50 2024-04-16T14:37:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.733+0000 7f18b0ffa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18ac0fe050 0x7f18ac10def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:37:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.733+0000 7f18b0ffa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18ac0fe050 0x7f18ac10def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53572/0 (socket says 172.21.15.5:53572) 2024-04-16T14:37:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.733+0000 7f18b0ffa700 1 -- 172.21.15.5:0/1060422960 learned_addr learned my addr 172.21.15.5:0/1060422960 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:37:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.733+0000 7f18b17fb700 1 --2- 172.21.15.5:0/1060422960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18ac0fce50 0x7f18ac10d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:37:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.733+0000 7f18b0ffa700 1 -- 172.21.15.5:0/1060422960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18ac0fce50 msgr2=0x7f18ac10d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.733+0000 7f18b0ffa700 1 --2- 172.21.15.5:0/1060422960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18ac0fce50 0x7f18ac10d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.733+0000 7f18b0ffa700 1 -- 172.21.15.5:0/1060422960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a8005040 con 0x7f18ac0fe050 2024-04-16T14:37:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.733+0000 7f18b0ffa700 1 --2- 172.21.15.5:0/1060422960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18ac0fe050 0x7f18ac10def0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f189c00eb40 tx=0x7f189c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:37:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.734+0000 7f18a1ffb700 1 -- 172.21.15.5:0/1060422960 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f189c007cc0 con 0x7f18ac0fe050 2024-04-16T14:37:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.734+0000 7f18b3a5f700 1 -- 172.21.15.5:0/1060422960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ac10efc0 con 0x7f18ac0fe050 2024-04-16T14:37:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.734+0000 7f18a1ffb700 1 -- 172.21.15.5:0/1060422960 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f189c00f040 con 0x7f18ac0fe050 2024-04-16T14:37:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.734+0000 7f18a1ffb700 1 -- 172.21.15.5:0/1060422960 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f189c00ca10 con 0x7f18ac0fe050 2024-04-16T14:37:29.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.734+0000 7f18b3a5f700 1 -- 172.21.15.5:0/1060422960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ac10f500 con 0x7f18ac0fe050 2024-04-16T14:37:29.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.735+0000 7f18b3a5f700 1 -- 172.21.15.5:0/1060422960 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18ac05f5f0 con 0x7f18ac0fe050 2024-04-16T14:37:29.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.735+0000 7f18a1ffb700 1 -- 172.21.15.5:0/1060422960 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 92303+0+0 (secure 0 0 0) 0x7f189c00cc80 con 0x7f18ac0fe050 2024-04-16T14:37:29.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.736+0000 7f18a1ffb700 1 --2- 172.21.15.5:0/1060422960 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f189806e260 0x7f1898070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:37:29.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.736+0000 7f18a1ffb700 1 -- 172.21.15.5:0/1060422960 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f189c08d9a0 con 0x7f18ac0fe050 2024-04-16T14:37:29.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.736+0000 7f18b17fb700 1 --2- 172.21.15.5:0/1060422960 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f189806e260 0x7f1898070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:37:29.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.736+0000 7f18b17fb700 1 --2- 172.21.15.5:0/1060422960 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f189806e260 0x7f1898070710 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f18a8013870 tx=0x7f18a8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:37:29.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.741+0000 7f18a1ffb700 1 -- 172.21.15.5:0/1060422960 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f189c05a6e0 con 0x7f18ac0fe050 2024-04-16T14:37:29.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:29 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:29.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:29 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:29.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.975+0000 7f18b3a5f700 1 -- 172.21.15.5:0/1060422960 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f18ac10f720 con 0x7f189806e260 2024-04-16T14:37:29.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.977+0000 7f18a1ffb700 1 -- 172.21.15.5:0/1060422960 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f18ac10f720 con 0x7f189806e260 2024-04-16T14:37:29.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.979+0000 7f18b3a5f700 1 -- 172.21.15.5:0/1060422960 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f189806e260 msgr2=0x7f1898070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:29.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.979+0000 7f18b3a5f700 1 --2- 172.21.15.5:0/1060422960 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f189806e260 0x7f1898070710 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f18a8013870 tx=0x7f18a8009e30 comp rx=0 tx=0).stop 2024-04-16T14:37:29.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.979+0000 7f18b3a5f700 1 -- 172.21.15.5:0/1060422960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18ac0fe050 msgr2=0x7f18ac10def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:29.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.979+0000 7f18b3a5f700 1 --2- 172.21.15.5:0/1060422960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18ac0fe050 0x7f18ac10def0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f189c00eb40 tx=0x7f189c00b040 comp rx=0 tx=0).stop 2024-04-16T14:37:29.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.979+0000 7f18b3a5f700 1 -- 172.21.15.5:0/1060422960 shutdown_connections 2024-04-16T14:37:29.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.979+0000 7f18b3a5f700 1 --2- 172.21.15.5:0/1060422960 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f189806e260 0x7f1898070710 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:29.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.979+0000 7f18b3a5f700 1 --2- 172.21.15.5:0/1060422960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18ac0fce50 0x7f18ac10d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:29.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.979+0000 7f18b3a5f700 1 --2- 172.21.15.5:0/1060422960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18ac0fe050 0x7f18ac10def0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:29.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.979+0000 7f18b3a5f700 1 -- 172.21.15.5:0/1060422960 >> 172.21.15.5:0/1060422960 conn(0x7f18ac0f8540 msgr2=0x7f18ac0f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:37:29.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.979+0000 7f18b3a5f700 1 -- 172.21.15.5:0/1060422960 shutdown_connections 2024-04-16T14:37:29.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:29.979+0000 7f18b3a5f700 1 -- 172.21.15.5:0/1060422960 wait complete. 2024-04-16T14:37:29.988 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-04-16T14:37:29.988 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:29 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:29.988 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:29 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:30.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.090+0000 7efef3d0a700 1 -- 172.21.15.5:0/3357436456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeec0fdff0 msgr2=0x7efeec0fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:30.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.090+0000 7efef3d0a700 1 --2- 172.21.15.5:0/3357436456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeec0fdff0 0x7efeec0fe460 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efee8004940 tx=0x7efee8009e30 comp rx=0 tx=0).stop 2024-04-16T14:37:30.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.090+0000 7efef3d0a700 1 -- 172.21.15.5:0/3357436456 shutdown_connections 2024-04-16T14:37:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.090+0000 7efef3d0a700 1 --2- 172.21.15.5:0/3357436456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeec0fdff0 0x7efeec0fe460 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.090+0000 7efef3d0a700 1 --2- 172.21.15.5:0/3357436456 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efeec0fce80 0x7efeec0fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.090+0000 7efef3d0a700 1 -- 172.21.15.5:0/3357436456 >> 172.21.15.5:0/3357436456 conn(0x7efeec0f8580 msgr2=0x7efeec0fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:37:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.090+0000 7efef3d0a700 1 -- 172.21.15.5:0/3357436456 shutdown_connections 2024-04-16T14:37:30.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.090+0000 7efef3d0a700 1 -- 172.21.15.5:0/3357436456 wait complete. 2024-04-16T14:37:30.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.090+0000 7efef3d0a700 1 Processor -- start 2024-04-16T14:37:30.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.090+0000 7efef3d0a700 1 -- start start 2024-04-16T14:37:30.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.090+0000 7efef3d0a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeec0fce80 0x7efeec10d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:37:30.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.090+0000 7efef3d0a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efeec0fdff0 0x7efeec10dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:37:30.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.090+0000 7efef3d0a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec10e3e0 con 0x7efeec0fce80 2024-04-16T14:37:30.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.090+0000 7efef3d0a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec10e550 con 0x7efeec0fdff0 2024-04-16T14:37:30.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.091+0000 7efef1aa6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeec0fce80 0x7efeec10d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:37:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.091+0000 7efef1aa6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeec0fce80 0x7efeec10d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53592/0 (socket says 172.21.15.5:53592) 2024-04-16T14:37:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.091+0000 7efef1aa6700 1 -- 172.21.15.5:0/3760567430 learned_addr learned my addr 172.21.15.5:0/3760567430 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:37:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.091+0000 7efef12a5700 1 --2- 172.21.15.5:0/3760567430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efeec0fdff0 0x7efeec10dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:37:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.091+0000 7efef1aa6700 1 -- 172.21.15.5:0/3760567430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efeec0fdff0 msgr2=0x7efeec10dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.091+0000 7efef1aa6700 1 --2- 172.21.15.5:0/3760567430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efeec0fdff0 0x7efeec10dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.091+0000 7efef1aa6700 1 -- 172.21.15.5:0/3760567430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee8005040 con 0x7efeec0fce80 2024-04-16T14:37:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.091+0000 7efef1aa6700 1 --2- 172.21.15.5:0/3760567430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeec0fce80 0x7efeec10d8a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efee000eb40 tx=0x7efee000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:37:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.091+0000 7efede7fc700 1 -- 172.21.15.5:0/3760567430 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efee0007cc0 con 0x7efeec0fce80 2024-04-16T14:37:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.091+0000 7efede7fc700 1 -- 172.21.15.5:0/3760567430 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efee000f040 con 0x7efeec0fce80 2024-04-16T14:37:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.091+0000 7efede7fc700 1 -- 172.21.15.5:0/3760567430 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efee000ca10 con 0x7efeec0fce80 2024-04-16T14:37:30.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.091+0000 7efef3d0a700 1 -- 172.21.15.5:0/3760567430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeec112f50 con 0x7efeec0fce80 2024-04-16T14:37:30.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.091+0000 7efef3d0a700 1 -- 172.21.15.5:0/3760567430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeec113400 con 0x7efeec0fce80 2024-04-16T14:37:30.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.092+0000 7efef3d0a700 1 -- 172.21.15.5:0/3760567430 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeec04c710 con 0x7efeec0fce80 2024-04-16T14:37:30.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.093+0000 7efede7fc700 1 -- 172.21.15.5:0/3760567430 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 92303+0+0 (secure 0 0 0) 0x7efee000cc80 con 0x7efeec0fce80 2024-04-16T14:37:30.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.093+0000 7efede7fc700 1 --2- 172.21.15.5:0/3760567430 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7efed806e270 0x7efed8070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:37:30.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.094+0000 7efede7fc700 1 -- 172.21.15.5:0/3760567430 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7efee008d920 con 0x7efeec0fce80 2024-04-16T14:37:30.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.094+0000 7efef12a5700 1 --2- 172.21.15.5:0/3760567430 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7efed806e270 0x7efed8070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:37:30.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.094+0000 7efef12a5700 1 --2- 172.21.15.5:0/3760567430 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7efed806e270 0x7efed8070720 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efee800b0d0 tx=0x7efee8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:37:30.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.098+0000 7efede7fc700 1 -- 172.21.15.5:0/3760567430 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7efee005a660 con 0x7efeec0fce80 2024-04-16T14:37:30.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.323+0000 7efef3d0a700 1 -- 172.21.15.5:0/3760567430 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efeec1135f0 con 0x7efed806e270 2024-04-16T14:37:30.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.324+0000 7efede7fc700 1 -- 172.21.15.5:0/3760567430 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7efeec1135f0 con 0x7efed806e270 2024-04-16T14:37:30.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.327+0000 7efef3d0a700 1 -- 172.21.15.5:0/3760567430 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7efed806e270 msgr2=0x7efed8070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:30.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.327+0000 7efef3d0a700 1 --2- 172.21.15.5:0/3760567430 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7efed806e270 0x7efed8070720 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efee800b0d0 tx=0x7efee8009e30 comp rx=0 tx=0).stop 2024-04-16T14:37:30.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.327+0000 7efef3d0a700 1 -- 172.21.15.5:0/3760567430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeec0fce80 msgr2=0x7efeec10d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:30.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.327+0000 7efef3d0a700 1 --2- 172.21.15.5:0/3760567430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeec0fce80 0x7efeec10d8a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efee000eb40 tx=0x7efee000b040 comp rx=0 tx=0).stop 2024-04-16T14:37:30.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.327+0000 7efef3d0a700 1 -- 172.21.15.5:0/3760567430 shutdown_connections 2024-04-16T14:37:30.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.327+0000 7efef3d0a700 1 --2- 172.21.15.5:0/3760567430 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7efed806e270 0x7efed8070720 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:30.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.327+0000 7efef3d0a700 1 --2- 172.21.15.5:0/3760567430 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeec0fce80 0x7efeec10d8a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:30.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.327+0000 7efef3d0a700 1 --2- 172.21.15.5:0/3760567430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efeec0fdff0 0x7efeec10dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:30.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.327+0000 7efef3d0a700 1 -- 172.21.15.5:0/3760567430 >> 172.21.15.5:0/3760567430 conn(0x7efeec0f8580 msgr2=0x7efeec0f9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:37:30.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.327+0000 7efef3d0a700 1 -- 172.21.15.5:0/3760567430 shutdown_connections 2024-04-16T14:37:30.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.327+0000 7efef3d0a700 1 -- 172.21.15.5:0/3760567430 wait complete. 2024-04-16T14:37:30.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.430+0000 7f3d4b20a700 1 -- 172.21.15.5:0/1306127427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d440fce50 msgr2=0x7f3d440fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:30.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.430+0000 7f3d4b20a700 1 --2- 172.21.15.5:0/1306127427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d440fce50 0x7f3d440fd260 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3d38004940 tx=0x7f3d38009e30 comp rx=0 tx=0).stop 2024-04-16T14:37:30.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.430+0000 7f3d4b20a700 1 -- 172.21.15.5:0/1306127427 shutdown_connections 2024-04-16T14:37:30.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.430+0000 7f3d4b20a700 1 --2- 172.21.15.5:0/1306127427 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d440fe050 0x7f3d440fe4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:30.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.430+0000 7f3d4b20a700 1 --2- 172.21.15.5:0/1306127427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d440fce50 0x7f3d440fd260 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:30.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.430+0000 7f3d4b20a700 1 -- 172.21.15.5:0/1306127427 >> 172.21.15.5:0/1306127427 conn(0x7f3d440f8580 msgr2=0x7f3d440fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:37:30.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.431+0000 7f3d4b20a700 1 -- 172.21.15.5:0/1306127427 shutdown_connections 2024-04-16T14:37:30.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.431+0000 7f3d4b20a700 1 -- 172.21.15.5:0/1306127427 wait complete. 2024-04-16T14:37:30.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.431+0000 7f3d4b20a700 1 Processor -- start 2024-04-16T14:37:30.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.431+0000 7f3d4b20a700 1 -- start start 2024-04-16T14:37:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.431+0000 7f3d4b20a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d440fce50 0x7f3d4410d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:37:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.432+0000 7f3d4b20a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d440fe050 0x7f3d4410de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:37:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.432+0000 7f3d4b20a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4410e440 con 0x7f3d440fce50 2024-04-16T14:37:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.432+0000 7f3d4b20a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4410e5b0 con 0x7f3d440fe050 2024-04-16T14:37:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.432+0000 7f3d48fa6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d440fce50 0x7f3d4410d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:37:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.432+0000 7f3d48fa6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d440fce50 0x7f3d4410d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53604/0 (socket says 172.21.15.5:53604) 2024-04-16T14:37:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.432+0000 7f3d48fa6700 1 -- 172.21.15.5:0/139759607 learned_addr learned my addr 172.21.15.5:0/139759607 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:37:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.432+0000 7f3d43fff700 1 --2- 172.21.15.5:0/139759607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d440fe050 0x7f3d4410de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:37:30.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.432+0000 7f3d48fa6700 1 -- 172.21.15.5:0/139759607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d440fe050 msgr2=0x7f3d4410de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.432+0000 7f3d48fa6700 1 --2- 172.21.15.5:0/139759607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d440fe050 0x7f3d4410de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.432+0000 7f3d48fa6700 1 -- 172.21.15.5:0/139759607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d38005040 con 0x7f3d440fce50 2024-04-16T14:37:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.432+0000 7f3d48fa6700 1 --2- 172.21.15.5:0/139759607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d440fce50 0x7f3d4410d900 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3d38004090 tx=0x7f3d38009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:37:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.432+0000 7f3d417fa700 1 -- 172.21.15.5:0/139759607 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d38021070 con 0x7f3d440fce50 2024-04-16T14:37:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.432+0000 7f3d417fa700 1 -- 172.21.15.5:0/139759607 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3d3801c400 con 0x7f3d440fce50 2024-04-16T14:37:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.432+0000 7f3d4b20a700 1 -- 172.21.15.5:0/139759607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d44112fb0 con 0x7f3d440fce50 2024-04-16T14:37:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.432+0000 7f3d417fa700 1 -- 172.21.15.5:0/139759607 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d3800e070 con 0x7f3d440fce50 2024-04-16T14:37:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.432+0000 7f3d4b20a700 1 -- 172.21.15.5:0/139759607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d44113410 con 0x7f3d440fce50 2024-04-16T14:37:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.433+0000 7f3d4b20a700 1 -- 172.21.15.5:0/139759607 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d4404c710 con 0x7f3d440fce50 2024-04-16T14:37:30.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.434+0000 7f3d417fa700 1 -- 172.21.15.5:0/139759607 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 92303+0+0 (secure 0 0 0) 0x7f3d3801ca50 con 0x7f3d440fce50 2024-04-16T14:37:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.434+0000 7f3d417fa700 1 --2- 172.21.15.5:0/139759607 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3d3406e270 0x7f3d34070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:37:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.434+0000 7f3d417fa700 1 -- 172.21.15.5:0/139759607 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f3d3808ef30 con 0x7f3d440fce50 2024-04-16T14:37:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.435+0000 7f3d43fff700 1 --2- 172.21.15.5:0/139759607 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3d3406e270 0x7f3d34070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:37:30.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.435+0000 7f3d43fff700 1 --2- 172.21.15.5:0/139759607 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3d3406e270 0x7f3d34070720 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3d30009b80 tx=0x7f3d3000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:37:30.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.439+0000 7f3d417fa700 1 -- 172.21.15.5:0/139759607 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f3d380c3740 con 0x7f3d440fce50 2024-04-16T14:37:30.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.655+0000 7f3d4b20a700 1 -- 172.21.15.5:0/139759607 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d44102370 con 0x7f3d3406e270 2024-04-16T14:37:30.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.665+0000 7f3d417fa700 1 -- 172.21.15.5:0/139759607 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f3d44102370 con 0x7f3d3406e270 2024-04-16T14:37:30.664 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-16T14:37:30.664 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.smithi005 smithi005 *:9093,9094 running (108s) 1s ago 10m 26.0M - 0.25.0 c8568f914cd2 f8aaa22ee70c 2024-04-16T14:37:30.664 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi005 smithi005 running (10m) 1s ago 10m 6673k - 17.2.7-868-g412a5526 b04d96489b7c 6a380d6ec070 2024-04-16T14:37:30.664 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi115 smithi115 running (9m) 4s ago 9m 6665k - 17.2.7-868-g412a5526 b04d96489b7c df7cb0bfe65b 2024-04-16T14:37:30.664 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.smithi005 smithi005 *:3000 running (98s) 1s ago 9m 80.4M - 9.4.7 954c08fa6188 9834229a010c 2024-04-16T14:37:30.664 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.vzoqdl smithi005 running (4m) 1s ago 4m 12.7M - 17.2.7-868-g412a5526 b04d96489b7c 84a74a406a1d 2024-04-16T14:37:30.664 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.wofqlz smithi005 running (4m) 1s ago 4m 133M - 17.2.7-868-g412a5526 b04d96489b7c d0e053ab2f72 2024-04-16T14:37:30.664 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.byfytg smithi115 running (4m) 4s ago 4m 121M - 17.2.7-868-g412a5526 b04d96489b7c 595cd0892f66 2024-04-16T14:37:30.664 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.trkaqh smithi115 running (4m) 4s ago 4m 13.2M - 17.2.7-868-g412a5526 b04d96489b7c 5b60cd2ad79b 2024-04-16T14:37:30.665 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi005.ipwdkc smithi005 *:8443,9283,8765 running (83s) 1s ago 11m 472M - 19.0.0-2204-g36befe5d b1a78730e0db 451192b4fc44 2024-04-16T14:37:30.665 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi115.brjkpo smithi115 *:8443,9283,8765 running (33s) 4s ago 9m 447M - 19.0.0-2204-g36befe5d b1a78730e0db 0d75f8211942 2024-04-16T14:37:30.665 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi005 smithi005 running (16s) 1s ago 11m 27.5M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3d0c00924867 2024-04-16T14:37:30.665 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi115 smithi115 running (9m) 4s ago 9m 43.5M 2048M 17.2.7-868-g412a5526 b04d96489b7c feb5354cdbe9 2024-04-16T14:37:30.665 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi005 smithi005 *:9100 running (2m) 1s ago 10m 16.7M - 1.5.0 0da6a335fe13 c09bba584a42 2024-04-16T14:37:30.665 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi115 smithi115 *:9100 running (90s) 4s ago 9m 17.0M - 1.5.0 0da6a335fe13 78cc9cc150c0 2024-04-16T14:37:30.665 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (8m) 1s ago 8m 210M 1559M 17.2.7-868-g412a5526 b04d96489b7c ed7aa0542d96 2024-04-16T14:37:30.665 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (7m) 1s ago 7m 239M 1559M 17.2.7-868-g412a5526 b04d96489b7c 1868cc6c89f4 2024-04-16T14:37:30.665 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (7m) 1s ago 7m 188M 1559M 17.2.7-868-g412a5526 b04d96489b7c b12745ae7d18 2024-04-16T14:37:30.665 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi115 running (7m) 4s ago 7m 270M 2581M 17.2.7-868-g412a5526 b04d96489b7c 59f81301ebcf 2024-04-16T14:37:30.665 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi115 running (6m) 4s ago 6m 240M 2581M 17.2.7-868-g412a5526 b04d96489b7c e3ea96b7edd9 2024-04-16T14:37:30.665 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi115 running (6m) 4s ago 6m 225M 2581M 17.2.7-868-g412a5526 b04d96489b7c 456fa074e453 2024-04-16T14:37:30.665 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.smithi005 smithi005 *:9095 running (39s) 1s ago 9m 41.4M - 2.43.0 a07b618ecd1d dc784e58817c 2024-04-16T14:37:30.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.668+0000 7f3d4b20a700 1 -- 172.21.15.5:0/139759607 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3d3406e270 msgr2=0x7f3d34070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:30.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.668+0000 7f3d4b20a700 1 --2- 172.21.15.5:0/139759607 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3d3406e270 0x7f3d34070720 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3d30009b80 tx=0x7f3d3000b040 comp rx=0 tx=0).stop 2024-04-16T14:37:30.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.668+0000 7f3d4b20a700 1 -- 172.21.15.5:0/139759607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d440fce50 msgr2=0x7f3d4410d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:30.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.668+0000 7f3d4b20a700 1 --2- 172.21.15.5:0/139759607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d440fce50 0x7f3d4410d900 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3d38004090 tx=0x7f3d38009e30 comp rx=0 tx=0).stop 2024-04-16T14:37:30.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.668+0000 7f3d4b20a700 1 -- 172.21.15.5:0/139759607 shutdown_connections 2024-04-16T14:37:30.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.668+0000 7f3d4b20a700 1 --2- 172.21.15.5:0/139759607 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3d3406e270 0x7f3d34070720 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:30.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.668+0000 7f3d4b20a700 1 --2- 172.21.15.5:0/139759607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d440fce50 0x7f3d4410d900 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:30.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.668+0000 7f3d4b20a700 1 --2- 172.21.15.5:0/139759607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d440fe050 0x7f3d4410de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:30.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.668+0000 7f3d4b20a700 1 -- 172.21.15.5:0/139759607 >> 172.21.15.5:0/139759607 conn(0x7f3d440f8580 msgr2=0x7f3d440f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:37:30.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.668+0000 7f3d4b20a700 1 -- 172.21.15.5:0/139759607 shutdown_connections 2024-04-16T14:37:30.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.668+0000 7f3d4b20a700 1 -- 172.21.15.5:0/139759607 wait complete. 2024-04-16T14:37:30.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.770+0000 7f1f979a5700 1 -- 172.21.15.5:0/3917572700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f900708f0 msgr2=0x7f1f90070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:30.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.770+0000 7f1f979a5700 1 --2- 172.21.15.5:0/3917572700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f900708f0 0x7f1f90070d60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1f80004940 tx=0x7f1f80009e30 comp rx=0 tx=0).stop 2024-04-16T14:37:30.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.770+0000 7f1f979a5700 1 -- 172.21.15.5:0/3917572700 shutdown_connections 2024-04-16T14:37:30.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.770+0000 7f1f979a5700 1 --2- 172.21.15.5:0/3917572700 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f900708f0 0x7f1f90070d60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:30.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.770+0000 7f1f979a5700 1 --2- 172.21.15.5:0/3917572700 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f90071ea0 0x7f1f900703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:30.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.770+0000 7f1f979a5700 1 -- 172.21.15.5:0/3917572700 >> 172.21.15.5:0/3917572700 conn(0x7f1f900f8580 msgr2=0x7f1f900fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:37:30.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.770+0000 7f1f979a5700 1 -- 172.21.15.5:0/3917572700 shutdown_connections 2024-04-16T14:37:30.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.770+0000 7f1f979a5700 1 -- 172.21.15.5:0/3917572700 wait complete. 2024-04-16T14:37:30.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.771+0000 7f1f979a5700 1 Processor -- start 2024-04-16T14:37:30.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.771+0000 7f1f979a5700 1 -- start start 2024-04-16T14:37:30.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.771+0000 7f1f979a5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f900708f0 0x7f1f90113f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:37:30.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.771+0000 7f1f979a5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f90071ea0 0x7f1f90114470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:37:30.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.771+0000 7f1f979a5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f90114a70 con 0x7f1f90071ea0 2024-04-16T14:37:30.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.771+0000 7f1f979a5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f90114be0 con 0x7f1f900708f0 2024-04-16T14:37:30.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.771+0000 7f1f94f40700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f90071ea0 0x7f1f90114470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:37:30.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.771+0000 7f1f94f40700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f90071ea0 0x7f1f90114470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53616/0 (socket says 172.21.15.5:53616) 2024-04-16T14:37:30.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.771+0000 7f1f94f40700 1 -- 172.21.15.5:0/2445344755 learned_addr learned my addr 172.21.15.5:0/2445344755 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:37:30.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.771+0000 7f1f95741700 1 --2- 172.21.15.5:0/2445344755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f900708f0 0x7f1f90113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:37:30.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.771+0000 7f1f94f40700 1 -- 172.21.15.5:0/2445344755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f900708f0 msgr2=0x7f1f90113f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:30.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.771+0000 7f1f94f40700 1 --2- 172.21.15.5:0/2445344755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f900708f0 0x7f1f90113f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:30.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.771+0000 7f1f94f40700 1 -- 172.21.15.5:0/2445344755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f80005040 con 0x7f1f90071ea0 2024-04-16T14:37:30.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.772+0000 7f1f94f40700 1 --2- 172.21.15.5:0/2445344755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f90071ea0 0x7f1f90114470 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000b3b0 tx=0x7f1f80009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:37:30.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.772+0000 7f1f85ffb700 1 -- 172.21.15.5:0/2445344755 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f8000e040 con 0x7f1f90071ea0 2024-04-16T14:37:30.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.772+0000 7f1f979a5700 1 -- 172.21.15.5:0/2445344755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f901195e0 con 0x7f1f90071ea0 2024-04-16T14:37:30.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.772+0000 7f1f85ffb700 1 -- 172.21.15.5:0/2445344755 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1f8000bbf0 con 0x7f1f90071ea0 2024-04-16T14:37:30.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.772+0000 7f1f85ffb700 1 -- 172.21.15.5:0/2445344755 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f8001c630 con 0x7f1f90071ea0 2024-04-16T14:37:30.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.772+0000 7f1f979a5700 1 -- 172.21.15.5:0/2445344755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f90119ba0 con 0x7f1f90071ea0 2024-04-16T14:37:30.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.773+0000 7f1f979a5700 1 -- 172.21.15.5:0/2445344755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f9004c710 con 0x7f1f90071ea0 2024-04-16T14:37:30.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.774+0000 7f1f85ffb700 1 -- 172.21.15.5:0/2445344755 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 92303+0+0 (secure 0 0 0) 0x7f1f8000bd60 con 0x7f1f90071ea0 2024-04-16T14:37:30.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.774+0000 7f1f85ffb700 1 --2- 172.21.15.5:0/2445344755 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f1f7c06e270 0x7f1f7c070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:37:30.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.774+0000 7f1f85ffb700 1 -- 172.21.15.5:0/2445344755 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f1f8008e960 con 0x7f1f90071ea0 2024-04-16T14:37:30.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.774+0000 7f1f95741700 1 --2- 172.21.15.5:0/2445344755 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f1f7c06e270 0x7f1f7c070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:37:30.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.775+0000 7f1f95741700 1 --2- 172.21.15.5:0/2445344755 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f1f7c06e270 0x7f1f7c070720 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1f90071be0 tx=0x7f1f8c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:37:30.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:30.779+0000 7f1f85ffb700 1 -- 172.21.15.5:0/2445344755 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f1f8005b670 con 0x7f1f90071ea0 2024-04-16T14:37:30.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:30 smithi005 ceph-mon[93420]: pgmap v6: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:37:30.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:30 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:30.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:30 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:30.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:30 smithi005 ceph-mon[93420]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:37:31.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.073+0000 7f1f979a5700 1 -- 172.21.15.5:0/2445344755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1f90119fd0 con 0x7f1f90071ea0 2024-04-16T14:37:31.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.073+0000 7f1f85ffb700 1 -- 172.21.15.5:0/2445344755 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+843 (secure 0 0 0) 0x7f1f8005b200 con 0x7f1f90071ea0 2024-04-16T14:37:31.072 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:37:31.072 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-04-16T14:37:31.072 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 1, 2024-04-16T14:37:31.072 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 1 2024-04-16T14:37:31.072 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:37:31.072 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-04-16T14:37:31.073 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:37:31.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:37:31.073 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-04-16T14:37:31.073 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 6 2024-04-16T14:37:31.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:37:31.073 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-04-16T14:37:31.073 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 4 2024-04-16T14:37:31.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:37:31.073 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-04-16T14:37:31.073 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 11, 2024-04-16T14:37:31.073 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 3 2024-04-16T14:37:31.073 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-16T14:37:31.074 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:37:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.076+0000 7f1f979a5700 1 -- 172.21.15.5:0/2445344755 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f1f7c06e270 msgr2=0x7f1f7c070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.076+0000 7f1f979a5700 1 --2- 172.21.15.5:0/2445344755 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f1f7c06e270 0x7f1f7c070720 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1f90071be0 tx=0x7f1f8c00b040 comp rx=0 tx=0).stop 2024-04-16T14:37:31.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.076+0000 7f1f979a5700 1 -- 172.21.15.5:0/2445344755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f90071ea0 msgr2=0x7f1f90114470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.076+0000 7f1f979a5700 1 --2- 172.21.15.5:0/2445344755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f90071ea0 0x7f1f90114470 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000b3b0 tx=0x7f1f80009e30 comp rx=0 tx=0).stop 2024-04-16T14:37:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.076+0000 7f1f979a5700 1 -- 172.21.15.5:0/2445344755 shutdown_connections 2024-04-16T14:37:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.076+0000 7f1f979a5700 1 --2- 172.21.15.5:0/2445344755 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f1f7c06e270 0x7f1f7c070720 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.076+0000 7f1f979a5700 1 --2- 172.21.15.5:0/2445344755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f900708f0 0x7f1f90113f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.076+0000 7f1f979a5700 1 --2- 172.21.15.5:0/2445344755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f90071ea0 0x7f1f90114470 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.076+0000 7f1f979a5700 1 -- 172.21.15.5:0/2445344755 >> 172.21.15.5:0/2445344755 conn(0x7f1f900f8580 msgr2=0x7f1f900f9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:37:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.076+0000 7f1f979a5700 1 -- 172.21.15.5:0/2445344755 shutdown_connections 2024-04-16T14:37:31.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.076+0000 7f1f979a5700 1 -- 172.21.15.5:0/2445344755 wait complete. 2024-04-16T14:37:31.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:30 smithi115 ceph-mon[37295]: pgmap v6: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:37:31.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:30 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:31.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:30 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:31.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:30 smithi115 ceph-mon[37295]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:37:31.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.193+0000 7f813a21f700 1 -- 172.21.15.5:0/2807414780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81340fbd40 msgr2=0x7f81340fc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:31.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.193+0000 7f813a21f700 1 --2- 172.21.15.5:0/2807414780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81340fbd40 0x7f81340fc150 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8124004940 tx=0x7f8124009e30 comp rx=0 tx=0).stop 2024-04-16T14:37:31.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.193+0000 7f813a21f700 1 -- 172.21.15.5:0/2807414780 shutdown_connections 2024-04-16T14:37:31.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.193+0000 7f813a21f700 1 --2- 172.21.15.5:0/2807414780 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81340fcff0 0x7f81340fd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:31.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.193+0000 7f813a21f700 1 --2- 172.21.15.5:0/2807414780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81340fbd40 0x7f81340fc150 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:31.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.193+0000 7f813a21f700 1 -- 172.21.15.5:0/2807414780 >> 172.21.15.5:0/2807414780 conn(0x7f81340f74c0 msgr2=0x7f81340f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:37:31.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.193+0000 7f813a21f700 1 -- 172.21.15.5:0/2807414780 shutdown_connections 2024-04-16T14:37:31.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.193+0000 7f813a21f700 1 -- 172.21.15.5:0/2807414780 wait complete. 2024-04-16T14:37:31.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.194+0000 7f813a21f700 1 Processor -- start 2024-04-16T14:37:31.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.194+0000 7f813a21f700 1 -- start start 2024-04-16T14:37:31.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.194+0000 7f813a21f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81340fbd40 0x7f813410c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:37:31.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.194+0000 7f813a21f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81340fcff0 0x7f813410ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:37:31.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.194+0000 7f813a21f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813410d420 con 0x7f81340fcff0 2024-04-16T14:37:31.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.194+0000 7f813a21f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813410dc20 con 0x7f81340fbd40 2024-04-16T14:37:31.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.194+0000 7f8132ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81340fcff0 0x7f813410ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:37:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.194+0000 7f8132ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81340fcff0 0x7f813410ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53622/0 (socket says 172.21.15.5:53622) 2024-04-16T14:37:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.194+0000 7f8132ffd700 1 -- 172.21.15.5:0/4006748540 learned_addr learned my addr 172.21.15.5:0/4006748540 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:37:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.194+0000 7f81337fe700 1 --2- 172.21.15.5:0/4006748540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81340fbd40 0x7f813410c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:37:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.195+0000 7f8132ffd700 1 -- 172.21.15.5:0/4006748540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81340fbd40 msgr2=0x7f813410c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.195+0000 7f8132ffd700 1 --2- 172.21.15.5:0/4006748540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81340fbd40 0x7f813410c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.195+0000 7f8132ffd700 1 -- 172.21.15.5:0/4006748540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8124005040 con 0x7f81340fcff0 2024-04-16T14:37:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.195+0000 7f8132ffd700 1 --2- 172.21.15.5:0/4006748540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81340fcff0 0x7f813410ce20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f812800eb40 tx=0x7f812800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:37:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.195+0000 7f811bfff700 1 -- 172.21.15.5:0/4006748540 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8128007cc0 con 0x7f81340fcff0 2024-04-16T14:37:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.195+0000 7f811bfff700 1 -- 172.21.15.5:0/4006748540 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f812800f040 con 0x7f81340fcff0 2024-04-16T14:37:31.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.195+0000 7f811bfff700 1 -- 172.21.15.5:0/4006748540 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f812800ca10 con 0x7f81340fcff0 2024-04-16T14:37:31.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.195+0000 7f813a21f700 1 -- 172.21.15.5:0/4006748540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f813410dea0 con 0x7f81340fcff0 2024-04-16T14:37:31.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.195+0000 7f813a21f700 1 -- 172.21.15.5:0/4006748540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f813410e320 con 0x7f81340fcff0 2024-04-16T14:37:31.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.196+0000 7f813a21f700 1 -- 172.21.15.5:0/4006748540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f813405f5f0 con 0x7f81340fcff0 2024-04-16T14:37:31.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.197+0000 7f811bfff700 1 -- 172.21.15.5:0/4006748540 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 92303+0+0 (secure 0 0 0) 0x7f812800cb70 con 0x7f81340fcff0 2024-04-16T14:37:31.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.198+0000 7f811bfff700 1 --2- 172.21.15.5:0/4006748540 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f811c06e260 0x7f811c070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:37:31.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.198+0000 7f811bfff700 1 -- 172.21.15.5:0/4006748540 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f812808d940 con 0x7f81340fcff0 2024-04-16T14:37:31.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.198+0000 7f81337fe700 1 --2- 172.21.15.5:0/4006748540 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f811c06e260 0x7f811c070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:37:31.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.198+0000 7f81337fe700 1 --2- 172.21.15.5:0/4006748540 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f811c06e260 0x7f811c070710 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8124009b30 tx=0x7f8124009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:37:31.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.202+0000 7f811bfff700 1 -- 172.21.15.5:0/4006748540 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f812805a660 con 0x7f81340fcff0 2024-04-16T14:37:31.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.462+0000 7f813a21f700 1 -- 172.21.15.5:0/4006748540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f813404bed0 con 0x7f81340fcff0 2024-04-16T14:37:31.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.463+0000 7f811bfff700 1 -- 172.21.15.5:0/4006748540 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1916 (secure 0 0 0) 0x7f812805a1f0 con 0x7f81340fcff0 2024-04-16T14:37:31.461 INFO:teuthology.orchestra.run.smithi005.stdout:e20 2024-04-16T14:37:31.462 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:37:31.462 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:37:31.462 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2024-04-16T14:37:31.462 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:37:31.462 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2024-04-16T14:37:31.462 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2024-04-16T14:37:31.462 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 20 2024-04-16T14:37:31.462 INFO:teuthology.orchestra.run.smithi005.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-16T14:37:31.462 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-16T14:32:45.270024+0000 2024-04-16T14:37:31.462 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-04-16T14:35:42.742829+0000 2024-04-16T14:37:31.462 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2024-04-16T14:37:31.462 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2024-04-16T14:37:31.463 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 60 2024-04-16T14:37:31.463 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2024-04-16T14:37:31.463 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2024-04-16T14:37:31.463 INFO:teuthology.orchestra.run.smithi005.stdout:max_xattr_size 65536 2024-04-16T14:37:31.463 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2024-04-16T14:37:31.463 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2024-04-16T14:37:31.463 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 47 2024-04-16T14:37:31.463 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:37:31.463 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 2 2024-04-16T14:37:31.463 INFO:teuthology.orchestra.run.smithi005.stdout:in 0,1 2024-04-16T14:37:31.463 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=14484,1=24269} 2024-04-16T14:37:31.463 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2024-04-16T14:37:31.463 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2024-04-16T14:37:31.463 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 2024-04-16T14:37:31.463 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3] 2024-04-16T14:37:31.464 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2024-04-16T14:37:31.464 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2024-04-16T14:37:31.464 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2024-04-16T14:37:31.464 INFO:teuthology.orchestra.run.smithi005.stdout:bal_rank_mask -1 2024-04-16T14:37:31.464 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 1 2024-04-16T14:37:31.464 INFO:teuthology.orchestra.run.smithi005.stdout:qdb_cluster leader: 0 members: 2024-04-16T14:37:31.464 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.wofqlz{0:14484} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:37:31.464 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.byfytg{1:24269} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.115:6824/1662994117,v1:172.21.15.115:6825/1662994117] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:37:31.464 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:37:31.464 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:37:31.464 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2024-04-16T14:37:31.464 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:37:31.464 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.vzoqdl{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.5:6826/187766809,v1:172.21.15.5:6827/187766809] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:37:31.464 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.trkaqh{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:37:31.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.465+0000 7f813a21f700 1 -- 172.21.15.5:0/4006748540 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f811c06e260 msgr2=0x7f811c070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:31.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.465+0000 7f813a21f700 1 --2- 172.21.15.5:0/4006748540 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f811c06e260 0x7f811c070710 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8124009b30 tx=0x7f8124009e30 comp rx=0 tx=0).stop 2024-04-16T14:37:31.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.465+0000 7f813a21f700 1 -- 172.21.15.5:0/4006748540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81340fcff0 msgr2=0x7f813410ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:31.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.465+0000 7f813a21f700 1 --2- 172.21.15.5:0/4006748540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81340fcff0 0x7f813410ce20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f812800eb40 tx=0x7f812800b040 comp rx=0 tx=0).stop 2024-04-16T14:37:31.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.465+0000 7f813a21f700 1 -- 172.21.15.5:0/4006748540 shutdown_connections 2024-04-16T14:37:31.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.465+0000 7f813a21f700 1 --2- 172.21.15.5:0/4006748540 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f811c06e260 0x7f811c070710 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:31.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.465+0000 7f813a21f700 1 --2- 172.21.15.5:0/4006748540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81340fbd40 0x7f813410c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:31.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.465+0000 7f813a21f700 1 --2- 172.21.15.5:0/4006748540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81340fcff0 0x7f813410ce20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:31.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.465+0000 7f813a21f700 1 -- 172.21.15.5:0/4006748540 >> 172.21.15.5:0/4006748540 conn(0x7f81340f74c0 msgr2=0x7f81340f8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:37:31.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.465+0000 7f813a21f700 1 -- 172.21.15.5:0/4006748540 shutdown_connections 2024-04-16T14:37:31.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.465+0000 7f813a21f700 1 -- 172.21.15.5:0/4006748540 wait complete. 2024-04-16T14:37:31.466 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 20 2024-04-16T14:37:31.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.573+0000 7f7d493cf700 1 -- 172.21.15.5:0/2037000018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d440fcff0 msgr2=0x7f7d440fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:31.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.573+0000 7f7d493cf700 1 --2- 172.21.15.5:0/2037000018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d440fcff0 0x7f7d440fd460 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c004940 tx=0x7f7d2c009e30 comp rx=0 tx=0).stop 2024-04-16T14:37:31.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.573+0000 7f7d493cf700 1 -- 172.21.15.5:0/2037000018 shutdown_connections 2024-04-16T14:37:31.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.573+0000 7f7d493cf700 1 --2- 172.21.15.5:0/2037000018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d440fcff0 0x7f7d440fd460 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:31.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.573+0000 7f7d493cf700 1 --2- 172.21.15.5:0/2037000018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d440fbd40 0x7f7d440fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:31.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.573+0000 7f7d493cf700 1 -- 172.21.15.5:0/2037000018 >> 172.21.15.5:0/2037000018 conn(0x7f7d440f74c0 msgr2=0x7f7d440f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:37:31.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.573+0000 7f7d493cf700 1 -- 172.21.15.5:0/2037000018 shutdown_connections 2024-04-16T14:37:31.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.573+0000 7f7d493cf700 1 -- 172.21.15.5:0/2037000018 wait complete. 2024-04-16T14:37:31.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.574+0000 7f7d493cf700 1 Processor -- start 2024-04-16T14:37:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.574+0000 7f7d493cf700 1 -- start start 2024-04-16T14:37:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.574+0000 7f7d493cf700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d440fbd40 0x7f7d4410c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:37:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.574+0000 7f7d493cf700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d440fcff0 0x7f7d4410ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:37:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.574+0000 7f7d493cf700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4410d420 con 0x7f7d440fcff0 2024-04-16T14:37:31.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.574+0000 7f7d493cf700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4410dc20 con 0x7f7d440fbd40 2024-04-16T14:37:31.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.575+0000 7f7d3a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d440fcff0 0x7f7d4410ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:37:31.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.575+0000 7f7d3a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d440fcff0 0x7f7d4410ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53652/0 (socket says 172.21.15.5:53652) 2024-04-16T14:37:31.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.575+0000 7f7d3a7fc700 1 -- 172.21.15.5:0/1385905454 learned_addr learned my addr 172.21.15.5:0/1385905454 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:37:31.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.575+0000 7f7d42ffd700 1 --2- 172.21.15.5:0/1385905454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d440fbd40 0x7f7d4410c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:37:31.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.575+0000 7f7d3a7fc700 1 -- 172.21.15.5:0/1385905454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d440fbd40 msgr2=0x7f7d4410c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:31.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.575+0000 7f7d3a7fc700 1 --2- 172.21.15.5:0/1385905454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d440fbd40 0x7f7d4410c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:31.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.575+0000 7f7d3a7fc700 1 -- 172.21.15.5:0/1385905454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d34005040 con 0x7f7d440fcff0 2024-04-16T14:37:31.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.575+0000 7f7d42ffd700 1 --2- 172.21.15.5:0/1385905454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d440fbd40 0x7f7d4410c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T14:37:31.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.575+0000 7f7d3a7fc700 1 --2- 172.21.15.5:0/1385905454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d440fcff0 0x7f7d4410ce20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c013870 tx=0x7f7d2c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:37:31.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.575+0000 7f7d3bfff700 1 -- 172.21.15.5:0/1385905454 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d2c021070 con 0x7f7d440fcff0 2024-04-16T14:37:31.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.575+0000 7f7d3bfff700 1 -- 172.21.15.5:0/1385905454 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7d2c01c400 con 0x7f7d440fcff0 2024-04-16T14:37:31.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.575+0000 7f7d493cf700 1 -- 172.21.15.5:0/1385905454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d2c005040 con 0x7f7d440fcff0 2024-04-16T14:37:31.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.575+0000 7f7d3bfff700 1 -- 172.21.15.5:0/1385905454 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d2c00e070 con 0x7f7d440fcff0 2024-04-16T14:37:31.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.575+0000 7f7d493cf700 1 -- 172.21.15.5:0/1385905454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4410e250 con 0x7f7d440fcff0 2024-04-16T14:37:31.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.576+0000 7f7d493cf700 1 -- 172.21.15.5:0/1385905454 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d44104fd0 con 0x7f7d440fcff0 2024-04-16T14:37:31.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.577+0000 7f7d3bfff700 1 -- 172.21.15.5:0/1385905454 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 92303+0+0 (secure 0 0 0) 0x7f7d2c01ca20 con 0x7f7d440fcff0 2024-04-16T14:37:31.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.577+0000 7f7d3bfff700 1 --2- 172.21.15.5:0/1385905454 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f7d3006e260 0x7f7d30070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:37:31.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.577+0000 7f7d3bfff700 1 -- 172.21.15.5:0/1385905454 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f7d2c08f010 con 0x7f7d440fcff0 2024-04-16T14:37:31.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.578+0000 7f7d42ffd700 1 --2- 172.21.15.5:0/1385905454 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f7d3006e260 0x7f7d30070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:37:31.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.578+0000 7f7d42ffd700 1 --2- 172.21.15.5:0/1385905454 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f7d3006e260 0x7f7d30070710 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7d34009fd0 tx=0x7f7d34009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:37:31.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.584+0000 7f7d3bfff700 1 -- 172.21.15.5:0/1385905454 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f7d2c05bd20 con 0x7f7d440fcff0 2024-04-16T14:37:31.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.815+0000 7f7d493cf700 1 -- 172.21.15.5:0/1385905454 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d4410e530 con 0x7f7d3006e260 2024-04-16T14:37:31.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.816+0000 7f7d3bfff700 1 -- 172.21.15.5:0/1385905454 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f7d4410e530 con 0x7f7d3006e260 2024-04-16T14:37:31.815 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:37:31.815 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91", 2024-04-16T14:37:31.815 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-04-16T14:37:31.815 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-16T14:37:31.815 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [ 2024-04-16T14:37:31.815 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr" 2024-04-16T14:37:31.815 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-04-16T14:37:31.816 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "3/21 daemons upgraded", 2024-04-16T14:37:31.816 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "", 2024-04-16T14:37:31.816 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-04-16T14:37:31.816 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:37:31.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.819+0000 7f7d493cf700 1 -- 172.21.15.5:0/1385905454 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f7d3006e260 msgr2=0x7f7d30070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:31.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.819+0000 7f7d493cf700 1 --2- 172.21.15.5:0/1385905454 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f7d3006e260 0x7f7d30070710 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7d34009fd0 tx=0x7f7d34009e30 comp rx=0 tx=0).stop 2024-04-16T14:37:31.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.819+0000 7f7d493cf700 1 -- 172.21.15.5:0/1385905454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d440fcff0 msgr2=0x7f7d4410ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:31.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.819+0000 7f7d493cf700 1 --2- 172.21.15.5:0/1385905454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d440fcff0 0x7f7d4410ce20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c013870 tx=0x7f7d2c009e30 comp rx=0 tx=0).stop 2024-04-16T14:37:31.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.819+0000 7f7d493cf700 1 -- 172.21.15.5:0/1385905454 shutdown_connections 2024-04-16T14:37:31.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.819+0000 7f7d493cf700 1 --2- 172.21.15.5:0/1385905454 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f7d3006e260 0x7f7d30070710 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:31.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.819+0000 7f7d493cf700 1 --2- 172.21.15.5:0/1385905454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d440fbd40 0x7f7d4410c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:31.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.819+0000 7f7d493cf700 1 --2- 172.21.15.5:0/1385905454 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7d440fcff0 0x7f7d4410ce20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:31.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.819+0000 7f7d493cf700 1 -- 172.21.15.5:0/1385905454 >> 172.21.15.5:0/1385905454 conn(0x7f7d440f74c0 msgr2=0x7f7d440f8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:37:31.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.819+0000 7f7d493cf700 1 -- 172.21.15.5:0/1385905454 shutdown_connections 2024-04-16T14:37:31.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.819+0000 7f7d493cf700 1 -- 172.21.15.5:0/1385905454 wait complete. 2024-04-16T14:37:31.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.928+0000 7fede3fef700 1 -- 172.21.15.5:0/2010641467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feddc0fce40 msgr2=0x7feddc0fd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:31.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.928+0000 7fede3fef700 1 --2- 172.21.15.5:0/2010641467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feddc0fce40 0x7feddc0fd250 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fedd0004940 tx=0x7fedd0009e30 comp rx=0 tx=0).stop 2024-04-16T14:37:31.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.928+0000 7fede3fef700 1 -- 172.21.15.5:0/2010641467 shutdown_connections 2024-04-16T14:37:31.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.928+0000 7fede3fef700 1 --2- 172.21.15.5:0/2010641467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feddc0fe040 0x7feddc0fe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:31.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.928+0000 7fede3fef700 1 --2- 172.21.15.5:0/2010641467 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feddc0fce40 0x7feddc0fd250 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:31.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.928+0000 7fede3fef700 1 -- 172.21.15.5:0/2010641467 >> 172.21.15.5:0/2010641467 conn(0x7feddc0f8570 msgr2=0x7feddc0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:37:31.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.928+0000 7fede3fef700 1 -- 172.21.15.5:0/2010641467 shutdown_connections 2024-04-16T14:37:31.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.928+0000 7fede3fef700 1 -- 172.21.15.5:0/2010641467 wait complete. 2024-04-16T14:37:31.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.928+0000 7fede3fef700 1 Processor -- start 2024-04-16T14:37:31.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.928+0000 7fede3fef700 1 -- start start 2024-04-16T14:37:31.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.929+0000 7fede3fef700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feddc0fce40 0x7feddc071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:37:31.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.929+0000 7fede3fef700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feddc0fe040 0x7feddc070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:37:31.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.929+0000 7fede3fef700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc0708c0 con 0x7feddc0fe040 2024-04-16T14:37:31.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.929+0000 7fede3fef700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc070a30 con 0x7feddc0fce40 2024-04-16T14:37:31.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.929+0000 7fede158a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feddc0fe040 0x7feddc070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:37:31.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.929+0000 7fede1d8b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feddc0fce40 0x7feddc071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:37:31.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.929+0000 7fede158a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feddc0fe040 0x7feddc070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53668/0 (socket says 172.21.15.5:53668) 2024-04-16T14:37:31.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.929+0000 7fede158a700 1 -- 172.21.15.5:0/2056424627 learned_addr learned my addr 172.21.15.5:0/2056424627 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:37:31.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.929+0000 7fede1d8b700 1 -- 172.21.15.5:0/2056424627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feddc0fe040 msgr2=0x7feddc070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:31.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.929+0000 7fede1d8b700 1 --2- 172.21.15.5:0/2056424627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feddc0fe040 0x7feddc070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:31.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.929+0000 7fede1d8b700 1 -- 172.21.15.5:0/2056424627 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd0005040 con 0x7feddc0fce40 2024-04-16T14:37:31.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.929+0000 7fede158a700 1 --2- 172.21.15.5:0/2056424627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feddc0fe040 0x7feddc070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T14:37:31.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.929+0000 7fede1d8b700 1 --2- 172.21.15.5:0/2056424627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feddc0fce40 0x7feddc071e40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fedd0000c00 tx=0x7fedd0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:37:31.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.929+0000 7fedce7fc700 1 -- 172.21.15.5:0/2056424627 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedd000e030 con 0x7feddc0fce40 2024-04-16T14:37:31.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.930+0000 7fede3fef700 1 -- 172.21.15.5:0/2056424627 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feddc070cb0 con 0x7feddc0fce40 2024-04-16T14:37:31.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.930+0000 7fedce7fc700 1 -- 172.21.15.5:0/2056424627 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fedd0013de0 con 0x7feddc0fce40 2024-04-16T14:37:31.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.930+0000 7fedce7fc700 1 -- 172.21.15.5:0/2056424627 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedd001cdc0 con 0x7feddc0fce40 2024-04-16T14:37:31.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.930+0000 7fede3fef700 1 -- 172.21.15.5:0/2056424627 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feddc115a00 con 0x7feddc0fce40 2024-04-16T14:37:31.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.931+0000 7fede3fef700 1 -- 172.21.15.5:0/2056424627 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feddc05f5f0 con 0x7feddc0fce40 2024-04-16T14:37:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.931+0000 7fedce7fc700 1 -- 172.21.15.5:0/2056424627 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 37) v1 ==== 92303+0+0 (secure 0 0 0) 0x7fedd001c650 con 0x7feddc0fce40 2024-04-16T14:37:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.932+0000 7fedce7fc700 1 --2- 172.21.15.5:0/2056424627 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fedc806e200 0x7fedc80706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:37:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.932+0000 7fedce7fc700 1 -- 172.21.15.5:0/2056424627 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fedd008f650 con 0x7feddc0fce40 2024-04-16T14:37:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.932+0000 7fede158a700 1 --2- 172.21.15.5:0/2056424627 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fedc806e200 0x7fedc80706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:37:31.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.932+0000 7fede158a700 1 --2- 172.21.15.5:0/2056424627 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fedc806e200 0x7fedc80706b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fedd80041d0 tx=0x7fedd800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:37:31.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:31.936+0000 7fedce7fc700 1 -- 172.21.15.5:0/2056424627 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fedd0058710 con 0x7feddc0fce40 2024-04-16T14:37:32.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:32 smithi005 ceph-mon[93420]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:37:32.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:32 smithi005 ceph-mon[93420]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:37:32.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:32.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:32.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:37:32.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:37:32.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:32 smithi005 ceph-mon[93420]: Updating smithi005:/etc/ceph/ceph.conf 2024-04-16T14:37:32.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:32 smithi005 ceph-mon[93420]: Updating smithi115:/etc/ceph/ceph.conf 2024-04-16T14:37:32.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:32 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/2445344755' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:37:32.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:32 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/4006748540' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:37:32.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:32.245+0000 7fede3fef700 1 -- 172.21.15.5:0/2056424627 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7feddc04bed0 con 0x7feddc0fce40 2024-04-16T14:37:32.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:32.245+0000 7fedce7fc700 1 -- 172.21.15.5:0/2056424627 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fedd005bdd0 con 0x7feddc0fce40 2024-04-16T14:37:32.244 INFO:teuthology.orchestra.run.smithi005.stdout:HEALTH_OK 2024-04-16T14:37:32.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:32.249+0000 7fede3fef700 1 -- 172.21.15.5:0/2056424627 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fedc806e200 msgr2=0x7fedc80706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:32.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:32.249+0000 7fede3fef700 1 --2- 172.21.15.5:0/2056424627 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fedc806e200 0x7fedc80706b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fedd80041d0 tx=0x7fedd800b040 comp rx=0 tx=0).stop 2024-04-16T14:37:32.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:32.249+0000 7fede3fef700 1 -- 172.21.15.5:0/2056424627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feddc0fce40 msgr2=0x7feddc071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:37:32.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:32.249+0000 7fede3fef700 1 --2- 172.21.15.5:0/2056424627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feddc0fce40 0x7feddc071e40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fedd0000c00 tx=0x7fedd0009e30 comp rx=0 tx=0).stop 2024-04-16T14:37:32.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:32.249+0000 7fede3fef700 1 -- 172.21.15.5:0/2056424627 shutdown_connections 2024-04-16T14:37:32.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:32.249+0000 7fede3fef700 1 --2- 172.21.15.5:0/2056424627 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fedc806e200 0x7fedc80706b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:32.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:32.249+0000 7fede3fef700 1 --2- 172.21.15.5:0/2056424627 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feddc0fce40 0x7feddc071e40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:32.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:32.249+0000 7fede3fef700 1 --2- 172.21.15.5:0/2056424627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feddc0fe040 0x7feddc070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:37:32.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:32.249+0000 7fede3fef700 1 -- 172.21.15.5:0/2056424627 >> 172.21.15.5:0/2056424627 conn(0x7feddc0f8570 msgr2=0x7feddc0f9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:37:32.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:32.249+0000 7fede3fef700 1 -- 172.21.15.5:0/2056424627 shutdown_connections 2024-04-16T14:37:32.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:37:32.249+0000 7fede3fef700 1 -- 172.21.15.5:0/2056424627 wait complete. 2024-04-16T14:37:32.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:32 smithi115 ceph-mon[37295]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:37:32.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:32 smithi115 ceph-mon[37295]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:37:32.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:32 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:32.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:32 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:32.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:32 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:37:32.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:32 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:37:32.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:32 smithi115 ceph-mon[37295]: Updating smithi005:/etc/ceph/ceph.conf 2024-04-16T14:37:32.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:32 smithi115 ceph-mon[37295]: Updating smithi115:/etc/ceph/ceph.conf 2024-04-16T14:37:32.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:32 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/2445344755' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:37:32.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:32 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/4006748540' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:37:33.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:33 smithi115 ceph-mon[37295]: pgmap v7: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-16T14:37:33.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:33 smithi115 ceph-mon[37295]: Updating smithi005:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.conf 2024-04-16T14:37:33.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:33 smithi115 ceph-mon[37295]: Updating smithi115:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.conf 2024-04-16T14:37:33.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:33 smithi115 ceph-mon[37295]: Updating smithi005:/etc/ceph/ceph.client.admin.keyring 2024-04-16T14:37:33.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:33 smithi115 ceph-mon[37295]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-04-16T14:37:33.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:33 smithi115 ceph-mon[37295]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:37:33.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:33 smithi115 ceph-mon[37295]: Updating smithi005:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.client.admin.keyring 2024-04-16T14:37:33.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:33 smithi115 ceph-mon[37295]: Updating smithi115:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.client.admin.keyring 2024-04-16T14:37:33.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:33 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:33.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:33 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:33.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:33 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:33.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:33 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:33.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:33 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:33.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:33 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:37:33.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:33 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:37:33.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:33 smithi115 ceph-mon[37295]: from='client.? 172.21.15.5:0/2056424627' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:37:33.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:33 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-16T14:37:33.457 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:33 smithi005 ceph-mon[93420]: pgmap v7: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-04-16T14:37:33.458 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:33 smithi005 ceph-mon[93420]: Updating smithi005:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.conf 2024-04-16T14:37:33.458 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:33 smithi005 ceph-mon[93420]: Updating smithi115:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.conf 2024-04-16T14:37:33.458 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:33 smithi005 ceph-mon[93420]: Updating smithi005:/etc/ceph/ceph.client.admin.keyring 2024-04-16T14:37:33.458 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:33 smithi005 ceph-mon[93420]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-04-16T14:37:33.458 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:33 smithi005 ceph-mon[93420]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:37:33.458 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:33 smithi005 ceph-mon[93420]: Updating smithi005:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.client.admin.keyring 2024-04-16T14:37:33.458 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:33 smithi005 ceph-mon[93420]: Updating smithi115:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/config/ceph.client.admin.keyring 2024-04-16T14:37:33.458 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:33 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:33.458 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:33 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:33.458 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:33 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:33.458 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:33 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:33.458 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:33 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:33.459 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:33 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:37:33.459 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:33 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:37:33.459 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:33 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/2056424627' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:37:33.459 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:33 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-16T14:37:35.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:34 smithi115 ceph-mon[37295]: pgmap v8: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-16T14:37:35.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:34 smithi115 ceph-mon[37295]: Upgrade: Updating mon.smithi115 2024-04-16T14:37:35.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:34 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:35.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:34 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-16T14:37:35.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:34 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-16T14:37:35.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:34 smithi115 ceph-mon[37295]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:37:35.051 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:34 smithi115 ceph-mon[37295]: Deploying daemon mon.smithi115 on smithi115 2024-04-16T14:37:35.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:34 smithi005 ceph-mon[93420]: pgmap v8: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-16T14:37:35.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:34 smithi005 ceph-mon[93420]: Upgrade: Updating mon.smithi115 2024-04-16T14:37:35.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:34 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:35.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:34 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-16T14:37:35.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:34 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-16T14:37:35.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:34 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:37:35.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:34 smithi005 ceph-mon[93420]: Deploying daemon mon.smithi115 on smithi115 2024-04-16T14:37:35.915 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:35 smithi115 systemd[1]: Stopping Ceph mon.smithi115 for 10609bfa-fbfd-11ee-bc90-c7b262605968... 2024-04-16T14:37:36.173 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:35 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi115[37277]: 2024-04-16T14:37:35.915+0000 7f1b7f81e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi115 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-16T14:37:36.174 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:35 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi115[37277]: 2024-04-16T14:37:35.915+0000 7f1b7f81e700 -1 mon.smithi115@1(peon) e2 *** Got Signal Terminated *** 2024-04-16T14:37:36.174 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:35 smithi115 podman[83251]: 2024-04-16 14:37:35.947436156 +0000 UTC m=+0.151234897 container died feb5354cdbe9e309d0a7aa4bbc77e19f27a9c3e740dbbfc9946e1eb96a3c6fa5 (image=quay.ceph.io/ceph-ci/ceph@sha256:15b9a118425d53cc97d2f7bc08f63df1d8bfa1149df59d4de72a305b04501998, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi115, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=quincy-412a552, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-04-16T14:37:36.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:36 smithi115 podman[83251]: 2024-04-16 14:37:36.283081942 +0000 UTC m=+0.486880694 container cleanup feb5354cdbe9e309d0a7aa4bbc77e19f27a9c3e740dbbfc9946e1eb96a3c6fa5 (image=quay.ceph.io/ceph-ci/ceph@sha256:15b9a118425d53cc97d2f7bc08f63df1d8bfa1149df59d4de72a305b04501998, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi115, ceph=True, RELEASE=quincy-412a552, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-16T14:37:36.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:36 smithi115 bash[83251]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi115 2024-04-16T14:37:36.903 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:36 smithi115 podman[83265]: 2024-04-16 14:37:36.493257724 +0000 UTC m=+0.547744301 container remove feb5354cdbe9e309d0a7aa4bbc77e19f27a9c3e740dbbfc9946e1eb96a3c6fa5 (image=quay.ceph.io/ceph-ci/ceph@sha256:15b9a118425d53cc97d2f7bc08f63df1d8bfa1149df59d4de72a305b04501998, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi115, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=quincy-412a552, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240409, ceph=True, org.label-schema.license=GPLv2) 2024-04-16T14:37:36.903 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:36 smithi115 systemd[1]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@mon.smithi115.service: Deactivated successfully. 2024-04-16T14:37:36.903 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:36 smithi115 systemd[1]: Stopped Ceph mon.smithi115 for 10609bfa-fbfd-11ee-bc90-c7b262605968. 2024-04-16T14:37:36.903 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:36 smithi115 systemd[1]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@mon.smithi115.service: Consumed 5.441s CPU time. 2024-04-16T14:37:37.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:36 smithi115 systemd[1]: Starting Ceph mon.smithi115 for 10609bfa-fbfd-11ee-bc90-c7b262605968... 2024-04-16T14:37:37.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 podman[83396]: 2024-04-16 14:37:37.02452572 +0000 UTC m=+0.018178870 image pull b1a78730e0db57f46162ae12211512856024b361a698c3ed431f6fbc73b484c3 quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 2024-04-16T14:37:37.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 podman[83396]: 2024-04-16 14:37:37.152733634 +0000 UTC m=+0.146386787 container create 3b916a4928b2e0a27b8e412b3bd7dd493ca6613432be452f1d6d66b2f804fdd5 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi115, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-16T14:37:37.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 podman[83396]: 2024-04-16 14:37:37.355051711 +0000 UTC m=+0.348704875 container init 3b916a4928b2e0a27b8e412b3bd7dd493ca6613432be452f1d6d66b2f804fdd5 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi115, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.build-date=20240409, ceph=True) 2024-04-16T14:37:37.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 podman[83396]: 2024-04-16 14:37:37.358280568 +0000 UTC m=+0.351933719 container start 3b916a4928b2e0a27b8e412b3bd7dd493ca6613432be452f1d6d66b2f804fdd5 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi115, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5) 2024-04-16T14:37:37.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: set uid:gid to 167:167 (ceph:ceph) 2024-04-16T14:37:37.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev), process ceph-mon, pid 2 2024-04-16T14:37:37.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: pidfile_write: ignore empty --pid-file 2024-04-16T14:37:37.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: load: jerasure load: lrc 2024-04-16T14:37:37.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: RocksDB version: 7.9.2 2024-04-16T14:37:37.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Git sha 0 2024-04-16T14:37:37.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Compile date 2024-04-15 21:33:45 2024-04-16T14:37:37.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: DB SUMMARY 2024-04-16T14:37:37.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: DB Session ID: BATS4DC0YO7T3NNUMLGR 2024-04-16T14:37:37.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: CURRENT file: CURRENT 2024-04-16T14:37:37.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: IDENTITY file: IDENTITY 2024-04-16T14:37:37.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: MANIFEST file: MANIFEST-000009 size: 896 Bytes 2024-04-16T14:37:37.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi115/store.db dir, Total Num: 1, files: 000024.sst 2024-04-16T14:37:37.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi115/store.db: 000022.log size: 6275355 ; 2024-04-16T14:37:37.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.error_if_exists: 0 2024-04-16T14:37:37.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.create_if_missing: 0 2024-04-16T14:37:37.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.paranoid_checks: 1 2024-04-16T14:37:37.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-16T14:37:37.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-16T14:37:37.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-16T14:37:37.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.env: 0x55646f835c60 2024-04-16T14:37:37.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.fs: PosixFileSystem 2024-04-16T14:37:37.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.info_log: 0x5564707fd9a0 2024-04-16T14:37:37.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.max_file_opening_threads: 16 2024-04-16T14:37:37.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.statistics: (nil) 2024-04-16T14:37:37.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.use_fsync: 0 2024-04-16T14:37:37.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.max_log_file_size: 0 2024-04-16T14:37:37.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-16T14:37:37.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-16T14:37:37.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.keep_log_file_num: 1000 2024-04-16T14:37:37.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.recycle_log_file_num: 0 2024-04-16T14:37:37.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.allow_fallocate: 1 2024-04-16T14:37:37.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.allow_mmap_reads: 0 2024-04-16T14:37:37.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.allow_mmap_writes: 0 2024-04-16T14:37:37.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.use_direct_reads: 0 2024-04-16T14:37:37.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-16T14:37:37.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.create_missing_column_families: 0 2024-04-16T14:37:37.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.db_log_dir: 2024-04-16T14:37:37.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.wal_dir: 2024-04-16T14:37:37.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-16T14:37:37.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-16T14:37:37.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-16T14:37:37.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-16T14:37:37.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-16T14:37:37.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-16T14:37:37.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.advise_random_on_open: 1 2024-04-16T14:37:37.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.db_write_buffer_size: 0 2024-04-16T14:37:37.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.write_buffer_manager: 0x5564707d01e0 2024-04-16T14:37:37.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-16T14:37:37.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-16T14:37:37.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-16T14:37:37.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.rate_limiter: (nil) 2024-04-16T14:37:37.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-16T14:37:37.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.wal_recovery_mode: 2 2024-04-16T14:37:37.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.enable_thread_tracking: 0 2024-04-16T14:37:37.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.enable_pipelined_write: 0 2024-04-16T14:37:37.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.unordered_write: 0 2024-04-16T14:37:37.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-16T14:37:37.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-16T14:37:37.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-16T14:37:37.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-16T14:37:37.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.row_cache: None 2024-04-16T14:37:37.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.wal_filter: None 2024-04-16T14:37:37.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-16T14:37:37.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.allow_ingest_behind: 0 2024-04-16T14:37:37.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.two_write_queues: 0 2024-04-16T14:37:37.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.manual_wal_flush: 0 2024-04-16T14:37:37.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.wal_compression: 0 2024-04-16T14:37:37.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.atomic_flush: 0 2024-04-16T14:37:37.688 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-16T14:37:37.688 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-16T14:37:37.688 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-16T14:37:37.688 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.log_readahead_size: 0 2024-04-16T14:37:37.688 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-16T14:37:37.688 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.best_efforts_recovery: 0 2024-04-16T14:37:37.688 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-16T14:37:37.688 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-16T14:37:37.688 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.allow_data_in_errors: 0 2024-04-16T14:37:37.689 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.db_host_id: __hostname__ 2024-04-16T14:37:37.689 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-16T14:37:37.689 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.max_background_jobs: 2 2024-04-16T14:37:37.689 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.max_background_compactions: -1 2024-04-16T14:37:37.689 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.max_subcompactions: 1 2024-04-16T14:37:37.689 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-16T14:37:37.689 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-16T14:37:37.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-16T14:37:37.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.max_total_wal_size: 0 2024-04-16T14:37:37.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-16T14:37:37.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-16T14:37:37.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-16T14:37:37.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-16T14:37:37.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.max_open_files: -1 2024-04-16T14:37:37.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.bytes_per_sync: 0 2024-04-16T14:37:37.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-16T14:37:37.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-16T14:37:37.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.compaction_readahead_size: 0 2024-04-16T14:37:37.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.max_background_flushes: -1 2024-04-16T14:37:37.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Compression algorithms supported: 2024-04-16T14:37:37.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-16T14:37:37.690 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: kZSTD supported: 0 2024-04-16T14:37:37.691 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: kXpressCompression supported: 0 2024-04-16T14:37:37.691 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: kLZ4HCCompression supported: 1 2024-04-16T14:37:37.691 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: kZlibCompression supported: 1 2024-04-16T14:37:37.691 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: kSnappyCompression supported: 1 2024-04-16T14:37:37.691 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: kLZ4Compression supported: 1 2024-04-16T14:37:37.691 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: kBZip2Compression supported: 0 2024-04-16T14:37:37.691 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-16T14:37:37.691 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-16T14:37:37.691 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi115/store.db/MANIFEST-000009 2024-04-16T14:37:37.691 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-16T14:37:37.691 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-16T14:37:37.691 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.merge_operator: 2024-04-16T14:37:37.691 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.compaction_filter: None 2024-04-16T14:37:37.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.compaction_filter_factory: None 2024-04-16T14:37:37.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.sst_partitioner_factory: None 2024-04-16T14:37:37.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-16T14:37:37.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-16T14:37:37.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5564707fdaa0) 2024-04-16T14:37:37.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: cache_index_and_filter_blocks: 1 2024-04-16T14:37:37.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-16T14:37:37.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-16T14:37:37.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: pin_top_level_index_and_filter: 1 2024-04-16T14:37:37.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: index_type: 0 2024-04-16T14:37:37.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: data_block_index_type: 0 2024-04-16T14:37:37.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: index_shortening: 1 2024-04-16T14:37:37.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-16T14:37:37.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: checksum: 4 2024-04-16T14:37:37.692 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: no_block_cache: 0 2024-04-16T14:37:37.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_cache: 0x556470801090 2024-04-16T14:37:37.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_cache_name: BinnedLRUCache 2024-04-16T14:37:37.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_cache_options: 2024-04-16T14:37:37.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: capacity : 536870912 2024-04-16T14:37:37.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: num_shard_bits : 4 2024-04-16T14:37:37.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: strict_capacity_limit : 0 2024-04-16T14:37:37.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: high_pri_pool_ratio: 0.000 2024-04-16T14:37:37.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_cache_compressed: (nil) 2024-04-16T14:37:37.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: persistent_cache: (nil) 2024-04-16T14:37:37.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_size: 4096 2024-04-16T14:37:37.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_size_deviation: 10 2024-04-16T14:37:37.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_restart_interval: 16 2024-04-16T14:37:37.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: index_block_restart_interval: 1 2024-04-16T14:37:37.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: metadata_block_size: 4096 2024-04-16T14:37:37.693 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: partition_filters: 0 2024-04-16T14:37:37.694 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: use_delta_encoding: 1 2024-04-16T14:37:37.694 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: filter_policy: bloomfilter 2024-04-16T14:37:37.694 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: whole_key_filtering: 1 2024-04-16T14:37:37.694 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: verify_compression: 0 2024-04-16T14:37:37.694 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: read_amp_bytes_per_bit: 0 2024-04-16T14:37:37.694 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: format_version: 5 2024-04-16T14:37:37.694 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: enable_index_compression: 1 2024-04-16T14:37:37.694 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: block_align: 0 2024-04-16T14:37:37.694 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: max_auto_readahead_size: 262144 2024-04-16T14:37:37.694 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: prepopulate_block_cache: 0 2024-04-16T14:37:37.694 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: initial_auto_readahead_size: 8192 2024-04-16T14:37:37.695 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: num_file_reads_for_auto_readahead: 2 2024-04-16T14:37:37.695 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.write_buffer_size: 33554432 2024-04-16T14:37:37.695 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.max_write_buffer_number: 2 2024-04-16T14:37:37.695 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.compression: NoCompression 2024-04-16T14:37:37.695 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.bottommost_compression: Disabled 2024-04-16T14:37:37.695 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.prefix_extractor: nullptr 2024-04-16T14:37:37.695 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-16T14:37:37.695 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.num_levels: 7 2024-04-16T14:37:37.695 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-16T14:37:37.695 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-16T14:37:37.695 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-16T14:37:37.695 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-16T14:37:37.695 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-16T14:37:37.695 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-16T14:37:37.696 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-16T14:37:37.696 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-16T14:37:37.696 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-16T14:37:37.696 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-16T14:37:37.696 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-16T14:37:37.696 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-16T14:37:37.696 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-16T14:37:37.696 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.compression_opts.level: 32767 2024-04-16T14:37:37.696 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.compression_opts.strategy: 0 2024-04-16T14:37:37.696 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-16T14:37:37.696 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-16T14:37:37.696 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-16T14:37:37.696 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-16T14:37:37.696 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.compression_opts.enabled: false 2024-04-16T14:37:37.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-16T14:37:37.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-16T14:37:37.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-16T14:37:37.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-16T14:37:37.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.target_file_size_base: 67108864 2024-04-16T14:37:37.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-16T14:37:37.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-16T14:37:37.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-16T14:37:37.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-16T14:37:37.697 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-16T14:37:37.699 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-16T14:37:37.699 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-16T14:37:37.699 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-16T14:37:37.699 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-16T14:37:37.699 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-16T14:37:37.699 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-16T14:37:37.699 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-16T14:37:37.699 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-16T14:37:37.700 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-16T14:37:37.700 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.arena_block_size: 1048576 2024-04-16T14:37:37.700 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-16T14:37:37.700 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-16T14:37:37.700 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.disable_auto_compactions: 0 2024-04-16T14:37:37.700 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-16T14:37:37.700 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-16T14:37:37.700 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-16T14:37:37.700 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-16T14:37:37.700 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-16T14:37:37.700 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-16T14:37:37.700 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-16T14:37:37.701 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-16T14:37:37.701 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-16T14:37:37.701 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-16T14:37:37.701 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.table_properties_collectors: 2024-04-16T14:37:37.701 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.inplace_update_support: 0 2024-04-16T14:37:37.701 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-16T14:37:37.701 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-16T14:37:37.701 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-16T14:37:37.701 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-16T14:37:37.701 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.bloom_locality: 0 2024-04-16T14:37:37.701 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.max_successive_merges: 0 2024-04-16T14:37:37.701 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-16T14:37:37.702 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.paranoid_file_checks: 0 2024-04-16T14:37:37.702 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.force_consistency_checks: 1 2024-04-16T14:37:37.702 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.report_bg_io_stats: 0 2024-04-16T14:37:37.702 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.ttl: 2592000 2024-04-16T14:37:37.702 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-16T14:37:37.702 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-16T14:37:37.702 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-16T14:37:37.702 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.enable_blob_files: false 2024-04-16T14:37:37.702 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.min_blob_size: 0 2024-04-16T14:37:37.702 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.blob_file_size: 268435456 2024-04-16T14:37:37.703 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-16T14:37:37.703 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-16T14:37:37.703 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-16T14:37:37.703 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-16T14:37:37.703 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-16T14:37:37.703 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.blob_file_starting_level: 0 2024-04-16T14:37:37.703 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-16T14:37:37.703 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 24.sst 2024-04-16T14:37:37.703 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-16T14:37:37.703 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi115/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 26, last_sequence is 10374, log_number is 22,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-16T14:37:37.703 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 22 2024-04-16T14:37:37.704 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1f053f23-728a-4e5e-8e7c-fdf8bc3a594b 2024-04-16T14:37:37.704 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713278257388235, "job": 1, "event": "recovery_started", "wal_files": [22]} 2024-04-16T14:37:37.704 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #22 mode 2 2024-04-16T14:37:37.704 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713278257406067, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 27, "file_size": 3791562, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10379, "largest_seqno": 11810, "table_properties": {"data_size": 3784846, "index_size": 4161, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1541, "raw_key_size": 14186, "raw_average_key_size": 23, "raw_value_size": 3771808, "raw_average_value_size": 6224, "num_data_blocks": 189, "num_entries": 606, "num_filter_entries": 606, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1713278257, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1f053f23-728a-4e5e-8e7c-fdf8bc3a594b", "db_session_id": "BATS4DC0YO7T3NNUMLGR", "orig_file_number": 27, "seqno_to_time_mapping": "N/A"}} 2024-04-16T14:37:37.704 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713278257406185, "job": 1, "event": "recovery_finished"} 2024-04-16T14:37:37.704 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: [db/version_set.cc:5047] Creating manifest 29 2024-04-16T14:37:37.704 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-16T14:37:37.704 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi115/store.db/000022.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-16T14:37:37.704 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5564708f2000 2024-04-16T14:37:37.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: DB pointer 0x5564708dc000 2024-04-16T14:37:37.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-16T14:37:37.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-16T14:37:37.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** DB Stats ** 2024-04-16T14:37:37.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-16T14:37:37.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-16T14:37:37.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-16T14:37:37.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-16T14:37:37.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-16T14:37:37.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-16T14:37:37.705 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-16T14:37:37.706 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-04-16T14:37:37.706 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** Compaction Stats [default] ** 2024-04-16T14:37:37.706 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-16T14:37:37.706 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-16T14:37:37.706 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: L0 1/0 3.62 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 506.8 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-04-16T14:37:37.706 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: L6 1/0 5.25 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-16T14:37:37.706 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Sum 2/0 8.86 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 506.8 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-04-16T14:37:37.706 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 506.8 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-04-16T14:37:37.706 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-04-16T14:37:37.707 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** Compaction Stats [default] ** 2024-04-16T14:37:37.707 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-16T14:37:37.707 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-16T14:37:37.707 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 506.8 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-04-16T14:37:37.707 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-04-16T14:37:37.707 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-16T14:37:37.707 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-04-16T14:37:37.707 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-16T14:37:37.707 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Flush(GB): cumulative 0.004, interval 0.004 2024-04-16T14:37:37.707 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-16T14:37:37.707 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-16T14:37:37.707 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-16T14:37:37.707 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-16T14:37:37.707 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Cumulative compaction: 0.00 GB write, 176.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-16T14:37:37.707 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Interval compaction: 0.00 GB write, 176.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-16T14:37:37.708 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-16T14:37:37.708 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Block cache BinnedLRUCache@0x556470801090#2 capacity: 512.00 MB usage: 6.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-04-16T14:37:37.708 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.78 KB,0.000339746%) IndexBlock(1,4.58 KB,0.000873208%) Misc(1,0.00 KB,0%) 2024-04-16T14:37:37.708 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-04-16T14:37:37.708 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-16T14:37:37.708 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: starting mon.smithi115 rank 1 at public addrs [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] at bind addrs [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi115 fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 2024-04-16T14:37:37.708 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: mon.smithi115@-1(???) e2 preinit fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 2024-04-16T14:37:37.708 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: mon.smithi115@-1(???).mds e20 new map 2024-04-16T14:37:37.708 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: mon.smithi115@-1(???).mds e20 print_map 2024-04-16T14:37:37.708 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: e20 2024-04-16T14:37:37.708 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:37:37.708 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:37:37.708 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: legacy client fscid: 1 2024-04-16T14:37:37.708 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-04-16T14:37:37.709 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Filesystem 'cephfs' (1) 2024-04-16T14:37:37.709 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: fs_name cephfs 2024-04-16T14:37:37.709 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: epoch 20 2024-04-16T14:37:37.709 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-16T14:37:37.709 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: created 2024-04-16T14:32:45.270024+0000 2024-04-16T14:37:37.709 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: modified 2024-04-16T14:35:42.742829+0000 2024-04-16T14:37:37.709 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: tableserver 0 2024-04-16T14:37:37.709 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: root 0 2024-04-16T14:37:37.709 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: session_timeout 60 2024-04-16T14:37:37.709 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: session_autoclose 300 2024-04-16T14:37:37.709 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: max_file_size 1099511627776 2024-04-16T14:37:37.710 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: max_xattr_size 65536 2024-04-16T14:37:37.710 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: required_client_features {} 2024-04-16T14:37:37.710 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: last_failure 0 2024-04-16T14:37:37.710 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: last_failure_osd_epoch 47 2024-04-16T14:37:37.710 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:37:37.710 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: max_mds 2 2024-04-16T14:37:37.710 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: in 0,1 2024-04-16T14:37:37.710 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: up {0=14484,1=24269} 2024-04-16T14:37:37.710 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: failed 2024-04-16T14:37:37.710 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: damaged 2024-04-16T14:37:37.710 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: stopped 2024-04-16T14:37:37.710 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: data_pools [3] 2024-04-16T14:37:37.710 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: metadata_pool 2 2024-04-16T14:37:37.710 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: inline_data disabled 2024-04-16T14:37:37.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: balancer 2024-04-16T14:37:37.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: bal_rank_mask -1 2024-04-16T14:37:37.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: standby_count_wanted 1 2024-04-16T14:37:37.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: qdb_cluster leader: 0 members: 2024-04-16T14:37:37.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: [mds.cephfs.smithi005.wofqlz{0:14484} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:37:37.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: [mds.cephfs.smithi115.byfytg{1:24269} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.115:6824/1662994117,v1:172.21.15.115:6825/1662994117] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:37:37.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-04-16T14:37:37.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-04-16T14:37:37.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: Standby daemons: 2024-04-16T14:37:37.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: 2024-04-16T14:37:37.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: [mds.cephfs.smithi005.vzoqdl{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.5:6826/187766809,v1:172.21.15.5:6827/187766809] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:37:37.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout: [mds.cephfs.smithi115.trkaqh{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:37:37.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: mon.smithi115@-1(???).osd e50 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-16T14:37:37.711 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: mon.smithi115@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-04-16T14:37:37.712 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: mon.smithi115@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-04-16T14:37:37.712 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: mon.smithi115@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2024-04-16T14:37:37.712 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: mon.smithi115@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-04-16T14:37:37.712 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 bash[83396]: 3b916a4928b2e0a27b8e412b3bd7dd493ca6613432be452f1d6d66b2f804fdd5 2024-04-16T14:37:37.712 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 systemd[1]: Started Ceph mon.smithi115 for 10609bfa-fbfd-11ee-bc90-c7b262605968. 2024-04-16T14:37:37.712 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:37 smithi115 ceph-mon[83414]: pgmap v9: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-16T14:37:37.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:37 smithi005 ceph-mon[93420]: pgmap v9: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-16T14:37:38.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:38 smithi115 ceph-mon[83414]: pgmap v10: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-16T14:37:38.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-04-16T14:37:38.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:37:38.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:38 smithi115 ceph-mon[83414]: mon.smithi005 calling monitor election 2024-04-16T14:37:38.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:38 smithi115 ceph-mon[83414]: mon.smithi115 calling monitor election 2024-04-16T14:37:38.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:38 smithi115 ceph-mon[83414]: mon.smithi005 is new leader, mons smithi005,smithi115 in quorum (ranks 0,1) 2024-04-16T14:37:38.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:38 smithi115 ceph-mon[83414]: monmap epoch 3 2024-04-16T14:37:38.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:38 smithi115 ceph-mon[83414]: fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 2024-04-16T14:37:38.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:38 smithi115 ceph-mon[83414]: last_changed 2024-04-16T14:37:37.481043+0000 2024-04-16T14:37:38.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:38 smithi115 ceph-mon[83414]: created 2024-04-16T14:25:42.269119+0000 2024-04-16T14:37:38.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:38 smithi115 ceph-mon[83414]: min_mon_release 19 (squid) 2024-04-16T14:37:38.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:38 smithi115 ceph-mon[83414]: election_strategy: 1 2024-04-16T14:37:38.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:38 smithi115 ceph-mon[83414]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.smithi005 2024-04-16T14:37:38.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:38 smithi115 ceph-mon[83414]: 1: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.smithi115 2024-04-16T14:37:38.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:38 smithi115 ceph-mon[83414]: fsmap cephfs:2 {0=cephfs.smithi005.wofqlz=up:active,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:37:38.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:38 smithi115 ceph-mon[83414]: osdmap e50: 6 total, 6 up, 6 in 2024-04-16T14:37:38.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:38 smithi115 ceph-mon[83414]: mgrmap e37: smithi005.ipwdkc(active, since 14s), standbys: smithi115.brjkpo 2024-04-16T14:37:38.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:38 smithi115 ceph-mon[83414]: overall HEALTH_OK 2024-04-16T14:37:38.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:38.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:38.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:37:38.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:37:38.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:38 smithi005 ceph-mon[93420]: pgmap v10: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-16T14:37:38.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi005"}]: dispatch 2024-04-16T14:37:38.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mon metadata", "id": "smithi115"}]: dispatch 2024-04-16T14:37:38.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:38 smithi005 ceph-mon[93420]: mon.smithi005 calling monitor election 2024-04-16T14:37:38.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:38 smithi005 ceph-mon[93420]: mon.smithi115 calling monitor election 2024-04-16T14:37:38.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:38 smithi005 ceph-mon[93420]: mon.smithi005 is new leader, mons smithi005,smithi115 in quorum (ranks 0,1) 2024-04-16T14:37:38.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:38 smithi005 ceph-mon[93420]: monmap epoch 3 2024-04-16T14:37:38.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:38 smithi005 ceph-mon[93420]: fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 2024-04-16T14:37:38.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:38 smithi005 ceph-mon[93420]: last_changed 2024-04-16T14:37:37.481043+0000 2024-04-16T14:37:38.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:38 smithi005 ceph-mon[93420]: created 2024-04-16T14:25:42.269119+0000 2024-04-16T14:37:38.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:38 smithi005 ceph-mon[93420]: min_mon_release 19 (squid) 2024-04-16T14:37:38.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:38 smithi005 ceph-mon[93420]: election_strategy: 1 2024-04-16T14:37:38.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:38 smithi005 ceph-mon[93420]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.smithi005 2024-04-16T14:37:38.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:38 smithi005 ceph-mon[93420]: 1: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.smithi115 2024-04-16T14:37:38.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:38 smithi005 ceph-mon[93420]: fsmap cephfs:2 {0=cephfs.smithi005.wofqlz=up:active,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:37:38.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:38 smithi005 ceph-mon[93420]: osdmap e50: 6 total, 6 up, 6 in 2024-04-16T14:37:38.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:38 smithi005 ceph-mon[93420]: mgrmap e37: smithi005.ipwdkc(active, since 14s), standbys: smithi115.brjkpo 2024-04-16T14:37:38.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:38 smithi005 ceph-mon[93420]: overall HEALTH_OK 2024-04-16T14:37:38.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:38.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:38.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:37:38.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:37:40.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:40 smithi115 ceph-mon[83414]: pgmap v11: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-16T14:37:40.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:40 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:40.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:40 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:40.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:40 smithi005 ceph-mon[93420]: pgmap v11: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-16T14:37:40.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:40 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:40.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:40 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:42.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:42 smithi115 ceph-mon[83414]: pgmap v12: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-16T14:37:42.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:42 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:42.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:42 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:42.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:42 smithi005 ceph-mon[93420]: pgmap v12: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-16T14:37:42.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:42 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:42.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:42 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:44.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:44 smithi115 ceph-mon[83414]: pgmap v13: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:37:44.978 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:44 smithi005 ceph-mon[93420]: pgmap v13: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:37:46.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:46.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:46.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:37:46.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:37:46.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:46.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-16T14:37:46.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-16T14:37:46.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:37:46.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:46.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:46.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:37:46.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:37:46.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:46.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-16T14:37:46.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-16T14:37:46.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:37:47.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:47 smithi115 ceph-mon[83414]: pgmap v14: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:37:47.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:47 smithi115 ceph-mon[83414]: Reconfiguring mon.smithi005 (monmap changed)... 2024-04-16T14:37:47.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:47 smithi115 ceph-mon[83414]: Reconfiguring daemon mon.smithi005 on smithi005 2024-04-16T14:37:47.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:47 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:47.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:47 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:47.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:47 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi005.ipwdkc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-16T14:37:47.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:47 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-16T14:37:47.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:47 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:37:47.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:47 smithi005 ceph-mon[93420]: pgmap v14: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:37:47.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:47 smithi005 ceph-mon[93420]: Reconfiguring mon.smithi005 (monmap changed)... 2024-04-16T14:37:47.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:47 smithi005 ceph-mon[93420]: Reconfiguring daemon mon.smithi005 on smithi005 2024-04-16T14:37:47.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:47 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:47.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:47 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:47.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:47 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi005.ipwdkc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-16T14:37:47.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:47 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-16T14:37:47.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:47 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:37:48.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:48 smithi115 ceph-mon[83414]: Reconfiguring mgr.smithi005.ipwdkc (monmap changed)... 2024-04-16T14:37:48.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:48 smithi115 ceph-mon[83414]: Reconfiguring daemon mgr.smithi005.ipwdkc on smithi005 2024-04-16T14:37:48.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:48 smithi005 ceph-mon[93420]: Reconfiguring mgr.smithi005.ipwdkc (monmap changed)... 2024-04-16T14:37:48.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:48 smithi005 ceph-mon[93420]: Reconfiguring daemon mgr.smithi005.ipwdkc on smithi005 2024-04-16T14:37:49.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:49 smithi115 ceph-mon[83414]: pgmap v15: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:37:49.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:49 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:49.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:49 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:49.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:49 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi005", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-16T14:37:49.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:49 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:37:49.464 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:49 smithi005 ceph-mon[93420]: pgmap v15: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:37:49.464 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:49 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:49.464 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:49 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:49.464 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:49 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi005", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-16T14:37:49.465 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:49 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:37:50.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:50 smithi115 ceph-mon[83414]: Reconfiguring crash.smithi005 (monmap changed)... 2024-04-16T14:37:50.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:50 smithi115 ceph-mon[83414]: Reconfiguring daemon crash.smithi005 on smithi005 2024-04-16T14:37:50.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:50 smithi005 ceph-mon[93420]: Reconfiguring crash.smithi005 (monmap changed)... 2024-04-16T14:37:50.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:50 smithi005 ceph-mon[93420]: Reconfiguring daemon crash.smithi005 on smithi005 2024-04-16T14:37:51.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:51 smithi005 ceph-mon[93420]: pgmap v16: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:37:51.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:51 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:51.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:51 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:51.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:51 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-16T14:37:51.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:51 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:37:51.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:51 smithi115 ceph-mon[83414]: pgmap v16: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:37:51.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:51 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:51.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:51 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:51.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:51 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-16T14:37:51.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:51 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:37:52.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:52 smithi005 ceph-mon[93420]: Reconfiguring osd.0 (monmap changed)... 2024-04-16T14:37:52.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:52 smithi005 ceph-mon[93420]: Reconfiguring daemon osd.0 on smithi005 2024-04-16T14:37:52.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:52 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:52.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:52 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:52.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:52 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-16T14:37:52.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:52 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:37:52.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:52 smithi115 ceph-mon[83414]: Reconfiguring osd.0 (monmap changed)... 2024-04-16T14:37:52.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:52 smithi115 ceph-mon[83414]: Reconfiguring daemon osd.0 on smithi005 2024-04-16T14:37:52.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:52 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:52.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:52 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:52.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:52 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-16T14:37:52.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:52 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:37:53.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:53 smithi115 ceph-mon[83414]: pgmap v17: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:37:53.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:53 smithi115 ceph-mon[83414]: Reconfiguring osd.1 (monmap changed)... 2024-04-16T14:37:53.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:53 smithi115 ceph-mon[83414]: Reconfiguring daemon osd.1 on smithi005 2024-04-16T14:37:53.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:53 smithi005 ceph-mon[93420]: pgmap v17: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:37:53.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:53 smithi005 ceph-mon[93420]: Reconfiguring osd.1 (monmap changed)... 2024-04-16T14:37:53.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:53 smithi005 ceph-mon[93420]: Reconfiguring daemon osd.1 on smithi005 2024-04-16T14:37:54.409 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:54 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:37:54.410 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:54 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:54.410 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:54 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:54.410 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:54 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-16T14:37:54.410 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:54 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:37:54.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:54 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:37:54.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:54 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:54.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:54 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:54.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:54 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-16T14:37:54.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:54 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:37:55.415 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:55 smithi005 ceph-mon[93420]: pgmap v18: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:37:55.416 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:55 smithi005 ceph-mon[93420]: Reconfiguring osd.2 (monmap changed)... 2024-04-16T14:37:55.416 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:55 smithi005 ceph-mon[93420]: Reconfiguring daemon osd.2 on smithi005 2024-04-16T14:37:55.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:55 smithi115 ceph-mon[83414]: pgmap v18: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:37:55.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:55 smithi115 ceph-mon[83414]: Reconfiguring osd.2 (monmap changed)... 2024-04-16T14:37:55.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:55 smithi115 ceph-mon[83414]: Reconfiguring daemon osd.2 on smithi005 2024-04-16T14:37:56.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:56 smithi005 ceph-mon[93420]: pgmap v19: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:37:56.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:56 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:56.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:56 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:56.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:56 smithi005 ceph-mon[93420]: Reconfiguring mds.cephfs.smithi005.vzoqdl (monmap changed)... 2024-04-16T14:37:56.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:56 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi005.vzoqdl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-16T14:37:56.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:56 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:37:56.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:56 smithi005 ceph-mon[93420]: Reconfiguring daemon mds.cephfs.smithi005.vzoqdl on smithi005 2024-04-16T14:37:56.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:56 smithi115 ceph-mon[83414]: pgmap v19: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:37:56.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:56 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:56.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:56 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:56.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:56 smithi115 ceph-mon[83414]: Reconfiguring mds.cephfs.smithi005.vzoqdl (monmap changed)... 2024-04-16T14:37:56.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:56 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi005.vzoqdl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-16T14:37:56.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:56 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:37:56.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:56 smithi115 ceph-mon[83414]: Reconfiguring daemon mds.cephfs.smithi005.vzoqdl on smithi005 2024-04-16T14:37:58.630 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:58 smithi005 ceph-mon[93420]: pgmap v20: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:37:58.631 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:58.631 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:58.631 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:58 smithi005 ceph-mon[93420]: Reconfiguring mds.cephfs.smithi005.wofqlz (monmap changed)... 2024-04-16T14:37:58.631 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi005.wofqlz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-16T14:37:58.631 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:37:58.631 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:37:58 smithi005 ceph-mon[93420]: Reconfiguring daemon mds.cephfs.smithi005.wofqlz on smithi005 2024-04-16T14:37:58.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:58 smithi115 ceph-mon[83414]: pgmap v20: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:37:58.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:58.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:37:58.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:58 smithi115 ceph-mon[83414]: Reconfiguring mds.cephfs.smithi005.wofqlz (monmap changed)... 2024-04-16T14:37:58.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi005.wofqlz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-16T14:37:58.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:37:58.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:37:58 smithi115 ceph-mon[83414]: Reconfiguring daemon mds.cephfs.smithi005.wofqlz on smithi005 2024-04-16T14:38:00.346 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:00 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:00.346 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:00 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:00.346 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:00 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi115", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-16T14:38:00.346 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:00 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:38:00.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:00 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:00.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:00 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:00.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:00 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi115", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-16T14:38:00.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:00 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:38:01.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:01 smithi115 ceph-mon[83414]: Reconfiguring crash.smithi115 (monmap changed)... 2024-04-16T14:38:01.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:01 smithi115 ceph-mon[83414]: Reconfiguring daemon crash.smithi115 on smithi115 2024-04-16T14:38:01.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:01 smithi115 ceph-mon[83414]: pgmap v21: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:01.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:01 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:01.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:01 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:01.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:01 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi115.brjkpo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-16T14:38:01.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:01 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-16T14:38:01.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:01 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:38:01.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:01 smithi005 ceph-mon[93420]: Reconfiguring crash.smithi115 (monmap changed)... 2024-04-16T14:38:01.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:01 smithi005 ceph-mon[93420]: Reconfiguring daemon crash.smithi115 on smithi115 2024-04-16T14:38:01.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:01 smithi005 ceph-mon[93420]: pgmap v21: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:01.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:01 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:01.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:01 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:01.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:01 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi115.brjkpo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-16T14:38:01.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:01 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-16T14:38:01.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:01 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:38:02.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.368+0000 7f6f4d8d3700 1 -- 172.21.15.5:0/2832407871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f480fcfa0 msgr2=0x7f6f480fd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:02.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.368+0000 7f6f4d8d3700 1 --2- 172.21.15.5:0/2832407871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f480fcfa0 0x7f6f480fd410 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c004940 tx=0x7f6f3c009e30 comp rx=0 tx=0).stop 2024-04-16T14:38:02.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.368+0000 7f6f4d8d3700 1 -- 172.21.15.5:0/2832407871 shutdown_connections 2024-04-16T14:38:02.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.368+0000 7f6f4d8d3700 1 --2- 172.21.15.5:0/2832407871 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f480fcfa0 0x7f6f480fd410 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:02.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.369+0000 7f6f4d8d3700 1 --2- 172.21.15.5:0/2832407871 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f480fbcf0 0x7f6f480fc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:02.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.369+0000 7f6f4d8d3700 1 -- 172.21.15.5:0/2832407871 >> 172.21.15.5:0/2832407871 conn(0x7f6f480f7450 msgr2=0x7f6f480f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:02.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.369+0000 7f6f4d8d3700 1 -- 172.21.15.5:0/2832407871 shutdown_connections 2024-04-16T14:38:02.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.369+0000 7f6f4d8d3700 1 -- 172.21.15.5:0/2832407871 wait complete. 2024-04-16T14:38:02.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.369+0000 7f6f4d8d3700 1 Processor -- start 2024-04-16T14:38:02.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.369+0000 7f6f4d8d3700 1 -- start start 2024-04-16T14:38:02.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.370+0000 7f6f4d8d3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f480fbcf0 0x7f6f4810dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:02.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.370+0000 7f6f4d8d3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f480fcfa0 0x7f6f4810e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:02.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.370+0000 7f6f4d8d3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4810e900 con 0x7f6f480fbcf0 2024-04-16T14:38:02.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.370+0000 7f6f4d8d3700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f48113210 con 0x7f6f480fcfa0 2024-04-16T14:38:02.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.370+0000 7f6f46ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f480fbcf0 0x7f6f4810dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:02.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.370+0000 7f6f46ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f480fbcf0 0x7f6f4810dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51778/0 (socket says 172.21.15.5:51778) 2024-04-16T14:38:02.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.370+0000 7f6f46ffd700 1 -- 172.21.15.5:0/1380927703 learned_addr learned my addr 172.21.15.5:0/1380927703 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:38:02.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.370+0000 7f6f467fc700 1 --2- 172.21.15.5:0/1380927703 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f480fcfa0 0x7f6f4810e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:02.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.370+0000 7f6f46ffd700 1 -- 172.21.15.5:0/1380927703 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f480fcfa0 msgr2=0x7f6f4810e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:02.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.370+0000 7f6f46ffd700 1 --2- 172.21.15.5:0/1380927703 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f480fcfa0 0x7f6f4810e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:02.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.370+0000 7f6f46ffd700 1 -- 172.21.15.5:0/1380927703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3c005040 con 0x7f6f480fbcf0 2024-04-16T14:38:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.370+0000 7f6f46ffd700 1 --2- 172.21.15.5:0/1380927703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f480fbcf0 0x7f6f4810dcb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800b790 tx=0x7f6f38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.370+0000 7f6f2f7fe700 1 -- 172.21.15.5:0/1380927703 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f3800f6f0 con 0x7f6f480fbcf0 2024-04-16T14:38:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.370+0000 7f6f2f7fe700 1 -- 172.21.15.5:0/1380927703 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6f3800fd20 con 0x7f6f480fbcf0 2024-04-16T14:38:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.370+0000 7f6f2f7fe700 1 -- 172.21.15.5:0/1380927703 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f380103a0 con 0x7f6f480fbcf0 2024-04-16T14:38:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.370+0000 7f6f4d8d3700 1 -- 172.21.15.5:0/1380927703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f48113470 con 0x7f6f480fbcf0 2024-04-16T14:38:02.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.371+0000 7f6f4d8d3700 1 -- 172.21.15.5:0/1380927703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f48113a00 con 0x7f6f480fbcf0 2024-04-16T14:38:02.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.372+0000 7f6f4d8d3700 1 -- 172.21.15.5:0/1380927703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f48101b30 con 0x7f6f480fbcf0 2024-04-16T14:38:02.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.372+0000 7f6f2f7fe700 1 -- 172.21.15.5:0/1380927703 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 92303+0+0 (secure 0 0 0) 0x7f6f38011400 con 0x7f6f480fbcf0 2024-04-16T14:38:02.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.373+0000 7f6f2f7fe700 1 --2- 172.21.15.5:0/1380927703 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f6f3006e270 0x7f6f30070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:02.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.373+0000 7f6f2f7fe700 1 -- 172.21.15.5:0/1380927703 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f6f3808d980 con 0x7f6f480fbcf0 2024-04-16T14:38:02.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.373+0000 7f6f467fc700 1 --2- 172.21.15.5:0/1380927703 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f6f3006e270 0x7f6f30070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:02.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.373+0000 7f6f467fc700 1 --2- 172.21.15.5:0/1380927703 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f6f3006e270 0x7f6f30070720 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c009fd0 tx=0x7f6f3c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:02.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.378+0000 7f6f2f7fe700 1 -- 172.21.15.5:0/1380927703 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f6f38056d10 con 0x7f6f480fbcf0 2024-04-16T14:38:02.380 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:02 smithi115 ceph-mon[83414]: Reconfiguring mgr.smithi115.brjkpo (monmap changed)... 2024-04-16T14:38:02.380 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:02 smithi115 ceph-mon[83414]: Reconfiguring daemon mgr.smithi115.brjkpo on smithi115 2024-04-16T14:38:02.389 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:02 smithi005 ceph-mon[93420]: Reconfiguring mgr.smithi115.brjkpo (monmap changed)... 2024-04-16T14:38:02.389 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:02 smithi005 ceph-mon[93420]: Reconfiguring daemon mgr.smithi115.brjkpo on smithi115 2024-04-16T14:38:02.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.609+0000 7f6f4d8d3700 1 -- 172.21.15.5:0/1380927703 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f48104940 con 0x7f6f3006e270 2024-04-16T14:38:02.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.610+0000 7f6f2f7fe700 1 -- 172.21.15.5:0/1380927703 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f6f48104940 con 0x7f6f3006e270 2024-04-16T14:38:02.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.612+0000 7f6f4d8d3700 1 -- 172.21.15.5:0/1380927703 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f6f3006e270 msgr2=0x7f6f30070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:02.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.612+0000 7f6f4d8d3700 1 --2- 172.21.15.5:0/1380927703 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f6f3006e270 0x7f6f30070720 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c009fd0 tx=0x7f6f3c009e30 comp rx=0 tx=0).stop 2024-04-16T14:38:02.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.612+0000 7f6f4d8d3700 1 -- 172.21.15.5:0/1380927703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f480fbcf0 msgr2=0x7f6f4810dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:02.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.612+0000 7f6f4d8d3700 1 --2- 172.21.15.5:0/1380927703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f480fbcf0 0x7f6f4810dcb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800b790 tx=0x7f6f38009250 comp rx=0 tx=0).stop 2024-04-16T14:38:02.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.612+0000 7f6f4d8d3700 1 -- 172.21.15.5:0/1380927703 shutdown_connections 2024-04-16T14:38:02.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.612+0000 7f6f4d8d3700 1 --2- 172.21.15.5:0/1380927703 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f6f3006e270 0x7f6f30070720 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:02.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.612+0000 7f6f4d8d3700 1 --2- 172.21.15.5:0/1380927703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6f480fbcf0 0x7f6f4810dcb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:02.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.612+0000 7f6f4d8d3700 1 --2- 172.21.15.5:0/1380927703 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f480fcfa0 0x7f6f4810e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:02.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.612+0000 7f6f4d8d3700 1 -- 172.21.15.5:0/1380927703 >> 172.21.15.5:0/1380927703 conn(0x7f6f480f7450 msgr2=0x7f6f48066b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:02.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.612+0000 7f6f4d8d3700 1 -- 172.21.15.5:0/1380927703 shutdown_connections 2024-04-16T14:38:02.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.612+0000 7f6f4d8d3700 1 -- 172.21.15.5:0/1380927703 wait complete. 2024-04-16T14:38:02.622 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-04-16T14:38:02.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.720+0000 7fb864e92700 1 -- 172.21.15.5:0/3146222494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8600fe040 msgr2=0x7fb8600fe4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:02.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.720+0000 7fb864e92700 1 --2- 172.21.15.5:0/3146222494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8600fe040 0x7fb8600fe4b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb854004940 tx=0x7fb854009e30 comp rx=0 tx=0).stop 2024-04-16T14:38:02.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.721+0000 7fb864e92700 1 -- 172.21.15.5:0/3146222494 shutdown_connections 2024-04-16T14:38:02.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.721+0000 7fb864e92700 1 --2- 172.21.15.5:0/3146222494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8600fe040 0x7fb8600fe4b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:02.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.721+0000 7fb864e92700 1 --2- 172.21.15.5:0/3146222494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8600fce40 0x7fb8600fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:02.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.721+0000 7fb864e92700 1 -- 172.21.15.5:0/3146222494 >> 172.21.15.5:0/3146222494 conn(0x7fb8600f8590 msgr2=0x7fb8600fa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:02.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.721+0000 7fb864e92700 1 -- 172.21.15.5:0/3146222494 shutdown_connections 2024-04-16T14:38:02.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.721+0000 7fb864e92700 1 -- 172.21.15.5:0/3146222494 wait complete. 2024-04-16T14:38:02.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.721+0000 7fb864e92700 1 Processor -- start 2024-04-16T14:38:02.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.721+0000 7fb864e92700 1 -- start start 2024-04-16T14:38:02.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.722+0000 7fb864e92700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8600fce40 0x7fb86010da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:02.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.722+0000 7fb864e92700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8600fe040 0x7fb86010dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:02.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.722+0000 7fb864e92700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86010e5a0 con 0x7fb8600fce40 2024-04-16T14:38:02.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.722+0000 7fb864e92700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86010edf0 con 0x7fb8600fe040 2024-04-16T14:38:02.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.722+0000 7fb85e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8600fce40 0x7fb86010da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:02.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.722+0000 7fb85e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8600fce40 0x7fb86010da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51794/0 (socket says 172.21.15.5:51794) 2024-04-16T14:38:02.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.722+0000 7fb85e59c700 1 -- 172.21.15.5:0/2119338172 learned_addr learned my addr 172.21.15.5:0/2119338172 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:38:02.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.722+0000 7fb85dd9b700 1 --2- 172.21.15.5:0/2119338172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8600fe040 0x7fb86010dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:02.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.722+0000 7fb85e59c700 1 -- 172.21.15.5:0/2119338172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8600fe040 msgr2=0x7fb86010dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:02.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.722+0000 7fb85e59c700 1 --2- 172.21.15.5:0/2119338172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8600fe040 0x7fb86010dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.722+0000 7fb85e59c700 1 -- 172.21.15.5:0/2119338172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb854005040 con 0x7fb8600fce40 2024-04-16T14:38:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.722+0000 7fb85e59c700 1 --2- 172.21.15.5:0/2119338172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8600fce40 0x7fb86010da60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb850002a80 tx=0x7fb850004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.722+0000 7fb84effd700 1 -- 172.21.15.5:0/2119338172 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb850007cc0 con 0x7fb8600fce40 2024-04-16T14:38:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.722+0000 7fb84effd700 1 -- 172.21.15.5:0/2119338172 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb85000f040 con 0x7fb8600fce40 2024-04-16T14:38:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.722+0000 7fb864e92700 1 -- 172.21.15.5:0/2119338172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86010f0d0 con 0x7fb8600fce40 2024-04-16T14:38:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.723+0000 7fb84effd700 1 -- 172.21.15.5:0/2119338172 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb85000da30 con 0x7fb8600fce40 2024-04-16T14:38:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.723+0000 7fb864e92700 1 -- 172.21.15.5:0/2119338172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86010f610 con 0x7fb8600fce40 2024-04-16T14:38:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.723+0000 7fb864e92700 1 -- 172.21.15.5:0/2119338172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb86005f5f0 con 0x7fb8600fce40 2024-04-16T14:38:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.724+0000 7fb84effd700 1 -- 172.21.15.5:0/2119338172 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 92303+0+0 (secure 0 0 0) 0x7fb85000db90 con 0x7fb8600fce40 2024-04-16T14:38:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.725+0000 7fb84effd700 1 --2- 172.21.15.5:0/2119338172 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fb84806e260 0x7fb848070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.725+0000 7fb84effd700 1 -- 172.21.15.5:0/2119338172 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fb85008da50 con 0x7fb8600fce40 2024-04-16T14:38:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.725+0000 7fb85dd9b700 1 --2- 172.21.15.5:0/2119338172 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fb84806e260 0x7fb848070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:02.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.725+0000 7fb85dd9b700 1 --2- 172.21.15.5:0/2119338172 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fb84806e260 0x7fb848070710 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb854004890 tx=0x7fb854009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:02.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.729+0000 7fb84effd700 1 -- 172.21.15.5:0/2119338172 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fb85005a760 con 0x7fb8600fce40 2024-04-16T14:38:02.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.957+0000 7fb864e92700 1 -- 172.21.15.5:0/2119338172 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb86010fa50 con 0x7fb84806e260 2024-04-16T14:38:02.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.958+0000 7fb84effd700 1 -- 172.21.15.5:0/2119338172 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fb86010fa50 con 0x7fb84806e260 2024-04-16T14:38:02.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.961+0000 7fb864e92700 1 -- 172.21.15.5:0/2119338172 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fb84806e260 msgr2=0x7fb848070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:02.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.961+0000 7fb864e92700 1 --2- 172.21.15.5:0/2119338172 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fb84806e260 0x7fb848070710 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb854004890 tx=0x7fb854009e30 comp rx=0 tx=0).stop 2024-04-16T14:38:02.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.961+0000 7fb864e92700 1 -- 172.21.15.5:0/2119338172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8600fce40 msgr2=0x7fb86010da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:02.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.961+0000 7fb864e92700 1 --2- 172.21.15.5:0/2119338172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8600fce40 0x7fb86010da60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb850002a80 tx=0x7fb850004600 comp rx=0 tx=0).stop 2024-04-16T14:38:02.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.961+0000 7fb864e92700 1 -- 172.21.15.5:0/2119338172 shutdown_connections 2024-04-16T14:38:02.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.961+0000 7fb864e92700 1 --2- 172.21.15.5:0/2119338172 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fb84806e260 0x7fb848070710 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:02.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.961+0000 7fb864e92700 1 --2- 172.21.15.5:0/2119338172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8600fce40 0x7fb86010da60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:02.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.961+0000 7fb864e92700 1 --2- 172.21.15.5:0/2119338172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8600fe040 0x7fb86010dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:02.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.961+0000 7fb864e92700 1 -- 172.21.15.5:0/2119338172 >> 172.21.15.5:0/2119338172 conn(0x7fb8600f8590 msgr2=0x7fb8600f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:02.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.961+0000 7fb864e92700 1 -- 172.21.15.5:0/2119338172 shutdown_connections 2024-04-16T14:38:02.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:02.961+0000 7fb864e92700 1 -- 172.21.15.5:0/2119338172 wait complete. 2024-04-16T14:38:03.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.066+0000 7fc84b027700 1 -- 172.21.15.5:0/2738114340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8440fbb20 msgr2=0x7fc8440fe380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:03.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.066+0000 7fc84b027700 1 --2- 172.21.15.5:0/2738114340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8440fbb20 0x7fc8440fe380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc830004940 tx=0x7fc830009e30 comp rx=0 tx=0).stop 2024-04-16T14:38:03.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.066+0000 7fc84b027700 1 -- 172.21.15.5:0/2738114340 shutdown_connections 2024-04-16T14:38:03.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.066+0000 7fc84b027700 1 --2- 172.21.15.5:0/2738114340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8440fbb20 0x7fc8440fe380 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:03.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.066+0000 7fc84b027700 1 --2- 172.21.15.5:0/2738114340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8440fb1d0 0x7fc8440fb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:03.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.066+0000 7fc84b027700 1 -- 172.21.15.5:0/2738114340 >> 172.21.15.5:0/2738114340 conn(0x7fc8440f6bd0 msgr2=0x7fc8440f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:03.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.066+0000 7fc84b027700 1 -- 172.21.15.5:0/2738114340 shutdown_connections 2024-04-16T14:38:03.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.066+0000 7fc84b027700 1 -- 172.21.15.5:0/2738114340 wait complete. 2024-04-16T14:38:03.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.066+0000 7fc84b027700 1 Processor -- start 2024-04-16T14:38:03.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.066+0000 7fc84b027700 1 -- start start 2024-04-16T14:38:03.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.067+0000 7fc84b027700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8440fb1d0 0x7fc8440fdc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:03.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.067+0000 7fc84b027700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8440fbb20 0x7fc8440fc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:03.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.067+0000 7fc84b027700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8440fc740 con 0x7fc8440fbb20 2024-04-16T14:38:03.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.067+0000 7fc84b027700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8440fc880 con 0x7fc8440fb1d0 2024-04-16T14:38:03.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.067+0000 7fc848dc3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8440fb1d0 0x7fc8440fdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:03.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.067+0000 7fc843fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8440fbb20 0x7fc8440fc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:03.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.067+0000 7fc848dc3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8440fb1d0 0x7fc8440fdc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.5:54590/0 (socket says 172.21.15.5:54590) 2024-04-16T14:38:03.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.067+0000 7fc848dc3700 1 -- 172.21.15.5:0/1751755660 learned_addr learned my addr 172.21.15.5:0/1751755660 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:38:03.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.067+0000 7fc843fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8440fbb20 0x7fc8440fc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51814/0 (socket says 172.21.15.5:51814) 2024-04-16T14:38:03.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.067+0000 7fc848dc3700 1 -- 172.21.15.5:0/1751755660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8440fbb20 msgr2=0x7fc8440fc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:03.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.067+0000 7fc848dc3700 1 --2- 172.21.15.5:0/1751755660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8440fbb20 0x7fc8440fc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:03.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.067+0000 7fc848dc3700 1 -- 172.21.15.5:0/1751755660 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc830005040 con 0x7fc8440fb1d0 2024-04-16T14:38:03.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.067+0000 7fc848dc3700 1 --2- 172.21.15.5:0/1751755660 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8440fb1d0 0x7fc8440fdc70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc838002a50 tx=0x7fc8380046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:03.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.068+0000 7fc8417fa700 1 -- 172.21.15.5:0/1751755660 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc838007cc0 con 0x7fc8440fb1d0 2024-04-16T14:38:03.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.068+0000 7fc8417fa700 1 -- 172.21.15.5:0/1751755660 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc83800f040 con 0x7fc8440fb1d0 2024-04-16T14:38:03.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.068+0000 7fc84b027700 1 -- 172.21.15.5:0/1751755660 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8440fcb30 con 0x7fc8440fb1d0 2024-04-16T14:38:03.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.068+0000 7fc8417fa700 1 -- 172.21.15.5:0/1751755660 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc83800da30 con 0x7fc8440fb1d0 2024-04-16T14:38:03.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.068+0000 7fc84b027700 1 -- 172.21.15.5:0/1751755660 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc844115ca0 con 0x7fc8440fb1d0 2024-04-16T14:38:03.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.069+0000 7fc84b027700 1 -- 172.21.15.5:0/1751755660 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc84405f5f0 con 0x7fc8440fb1d0 2024-04-16T14:38:03.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.069+0000 7fc8417fa700 1 -- 172.21.15.5:0/1751755660 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 37) v1 ==== 92303+0+0 (secure 0 0 0) 0x7fc83800db90 con 0x7fc8440fb1d0 2024-04-16T14:38:03.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.070+0000 7fc8417fa700 1 --2- 172.21.15.5:0/1751755660 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc83406e260 0x7fc834070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:03.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.070+0000 7fc8417fa700 1 -- 172.21.15.5:0/1751755660 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fc83808daf0 con 0x7fc8440fb1d0 2024-04-16T14:38:03.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.070+0000 7fc843fff700 1 --2- 172.21.15.5:0/1751755660 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc83406e260 0x7fc834070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:03.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.070+0000 7fc843fff700 1 --2- 172.21.15.5:0/1751755660 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc83406e260 0x7fc834070710 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc83000b3b0 tx=0x7fc830009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:03.076 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.075+0000 7fc8417fa700 1 -- 172.21.15.5:0/1751755660 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fc838056c30 con 0x7fc8440fb1d0 2024-04-16T14:38:03.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:03 smithi005 ceph-mon[93420]: pgmap v22: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:03.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:03 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:03.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:03 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:03.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:03 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-16T14:38:03.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:03 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-16T14:38:03.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:03 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:38:03.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.292+0000 7fc84b027700 1 -- 172.21.15.5:0/1751755660 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc844105ca0 con 0x7fc83406e260 2024-04-16T14:38:03.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.302+0000 7fc8417fa700 1 -- 172.21.15.5:0/1751755660 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fc844105ca0 con 0x7fc83406e260 2024-04-16T14:38:03.301 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-16T14:38:03.301 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.smithi005 smithi005 *:9093,9094 running (2m) 34s ago 10m 26.0M - 0.25.0 c8568f914cd2 f8aaa22ee70c 2024-04-16T14:38:03.301 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi005 smithi005 running (10m) 34s ago 10m 6673k - 17.2.7-868-g412a5526 b04d96489b7c 6a380d6ec070 2024-04-16T14:38:03.301 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi115 smithi115 running (9m) 22s ago 9m 6665k - 17.2.7-868-g412a5526 b04d96489b7c df7cb0bfe65b 2024-04-16T14:38:03.302 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.smithi005 smithi005 *:3000 running (2m) 34s ago 10m 80.4M - 9.4.7 954c08fa6188 9834229a010c 2024-04-16T14:38:03.302 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.vzoqdl smithi005 running (5m) 34s ago 5m 12.7M - 17.2.7-868-g412a5526 b04d96489b7c 84a74a406a1d 2024-04-16T14:38:03.302 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.wofqlz smithi005 running (5m) 34s ago 5m 133M - 17.2.7-868-g412a5526 b04d96489b7c d0e053ab2f72 2024-04-16T14:38:03.302 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.byfytg smithi115 running (5m) 22s ago 5m 118M - 17.2.7-868-g412a5526 b04d96489b7c 595cd0892f66 2024-04-16T14:38:03.302 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.trkaqh smithi115 running (5m) 22s ago 5m 13.5M - 17.2.7-868-g412a5526 b04d96489b7c 5b60cd2ad79b 2024-04-16T14:38:03.302 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi005.ipwdkc smithi005 *:8443,9283,8765 running (116s) 34s ago 12m 472M - 19.0.0-2204-g36befe5d b1a78730e0db 451192b4fc44 2024-04-16T14:38:03.302 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi115.brjkpo smithi115 *:8443,9283,8765 running (66s) 22s ago 9m 448M - 19.0.0-2204-g36befe5d b1a78730e0db 0d75f8211942 2024-04-16T14:38:03.303 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi005 smithi005 running (49s) 34s ago 12m 27.5M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3d0c00924867 2024-04-16T14:38:03.303 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi115 smithi115 running (26s) 22s ago 9m 25.9M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3b916a4928b2 2024-04-16T14:38:03.303 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi005 smithi005 *:9100 running (2m) 34s ago 10m 16.7M - 1.5.0 0da6a335fe13 c09bba584a42 2024-04-16T14:38:03.303 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi115 smithi115 *:9100 running (2m) 22s ago 9m 16.8M - 1.5.0 0da6a335fe13 78cc9cc150c0 2024-04-16T14:38:03.303 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (8m) 34s ago 8m 210M 1559M 17.2.7-868-g412a5526 b04d96489b7c ed7aa0542d96 2024-04-16T14:38:03.303 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (8m) 34s ago 8m 239M 1559M 17.2.7-868-g412a5526 b04d96489b7c 1868cc6c89f4 2024-04-16T14:38:03.304 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (7m) 34s ago 7m 188M 1559M 17.2.7-868-g412a5526 b04d96489b7c b12745ae7d18 2024-04-16T14:38:03.304 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi115 running (7m) 22s ago 7m 271M 2581M 17.2.7-868-g412a5526 b04d96489b7c 59f81301ebcf 2024-04-16T14:38:03.304 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi115 running (7m) 22s ago 7m 241M 2581M 17.2.7-868-g412a5526 b04d96489b7c e3ea96b7edd9 2024-04-16T14:38:03.304 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi115 running (6m) 22s ago 6m 225M 2581M 17.2.7-868-g412a5526 b04d96489b7c 456fa074e453 2024-04-16T14:38:03.304 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.smithi005 smithi005 *:9095 running (71s) 34s ago 10m 41.4M - 2.43.0 a07b618ecd1d dc784e58817c 2024-04-16T14:38:03.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.305+0000 7fc84b027700 1 -- 172.21.15.5:0/1751755660 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc83406e260 msgr2=0x7fc834070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:03.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.305+0000 7fc84b027700 1 --2- 172.21.15.5:0/1751755660 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc83406e260 0x7fc834070710 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc83000b3b0 tx=0x7fc830009e30 comp rx=0 tx=0).stop 2024-04-16T14:38:03.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.305+0000 7fc84b027700 1 -- 172.21.15.5:0/1751755660 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8440fb1d0 msgr2=0x7fc8440fdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:03.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.305+0000 7fc84b027700 1 --2- 172.21.15.5:0/1751755660 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8440fb1d0 0x7fc8440fdc70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc838002a50 tx=0x7fc8380046b0 comp rx=0 tx=0).stop 2024-04-16T14:38:03.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.305+0000 7fc84b027700 1 -- 172.21.15.5:0/1751755660 shutdown_connections 2024-04-16T14:38:03.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.305+0000 7fc84b027700 1 --2- 172.21.15.5:0/1751755660 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc83406e260 0x7fc834070710 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:03.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.305+0000 7fc84b027700 1 --2- 172.21.15.5:0/1751755660 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8440fb1d0 0x7fc8440fdc70 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:03.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.305+0000 7fc84b027700 1 --2- 172.21.15.5:0/1751755660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc8440fbb20 0x7fc8440fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:03.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.305+0000 7fc84b027700 1 -- 172.21.15.5:0/1751755660 >> 172.21.15.5:0/1751755660 conn(0x7fc8440f6bd0 msgr2=0x7fc8440f82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:03.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.305+0000 7fc84b027700 1 -- 172.21.15.5:0/1751755660 shutdown_connections 2024-04-16T14:38:03.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.305+0000 7fc84b027700 1 -- 172.21.15.5:0/1751755660 wait complete. 2024-04-16T14:38:03.390 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:03 smithi115 ceph-mon[83414]: pgmap v22: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:03.390 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:03 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:03.390 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:03 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:03.391 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:03 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-16T14:38:03.391 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:03 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-16T14:38:03.391 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:03 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:38:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.407+0000 7f1c96635700 1 -- 172.21.15.5:0/708577393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c900fcf90 msgr2=0x7f1c900fd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.407+0000 7f1c96635700 1 --2- 172.21.15.5:0/708577393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c900fcf90 0x7f1c900fd400 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1c84004940 tx=0x7f1c84009e30 comp rx=0 tx=0).stop 2024-04-16T14:38:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.407+0000 7f1c96635700 1 -- 172.21.15.5:0/708577393 shutdown_connections 2024-04-16T14:38:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.407+0000 7f1c96635700 1 --2- 172.21.15.5:0/708577393 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c900fcf90 0x7f1c900fd400 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.407+0000 7f1c96635700 1 --2- 172.21.15.5:0/708577393 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c900fbe20 0x7f1c900fc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.407+0000 7f1c96635700 1 -- 172.21.15.5:0/708577393 >> 172.21.15.5:0/708577393 conn(0x7f1c900f74e0 msgr2=0x7f1c900f9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:03.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.407+0000 7f1c96635700 1 -- 172.21.15.5:0/708577393 shutdown_connections 2024-04-16T14:38:03.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.407+0000 7f1c96635700 1 -- 172.21.15.5:0/708577393 wait complete. 2024-04-16T14:38:03.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.408+0000 7f1c96635700 1 Processor -- start 2024-04-16T14:38:03.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.408+0000 7f1c96635700 1 -- start start 2024-04-16T14:38:03.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.409+0000 7f1c96635700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c900fbe20 0x7f1c9010da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:03.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.409+0000 7f1c96635700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c900fcf90 0x7f1c9010df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:03.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.409+0000 7f1c96635700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9010e540 con 0x7f1c900fbe20 2024-04-16T14:38:03.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.409+0000 7f1c96635700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9010ed90 con 0x7f1c900fcf90 2024-04-16T14:38:03.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.409+0000 7f1c8ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c900fbe20 0x7f1c9010da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:03.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.409+0000 7f1c8ffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c900fbe20 0x7f1c9010da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51834/0 (socket says 172.21.15.5:51834) 2024-04-16T14:38:03.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.409+0000 7f1c8ffff700 1 -- 172.21.15.5:0/3922746183 learned_addr learned my addr 172.21.15.5:0/3922746183 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:38:03.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.409+0000 7f1c8f7fe700 1 --2- 172.21.15.5:0/3922746183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c900fcf90 0x7f1c9010df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:03.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.409+0000 7f1c8f7fe700 1 -- 172.21.15.5:0/3922746183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c900fbe20 msgr2=0x7f1c9010da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:03.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.409+0000 7f1c8f7fe700 1 --2- 172.21.15.5:0/3922746183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c900fbe20 0x7f1c9010da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:03.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.409+0000 7f1c8f7fe700 1 -- 172.21.15.5:0/3922746183 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c84005040 con 0x7f1c900fcf90 2024-04-16T14:38:03.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.409+0000 7f1c8f7fe700 1 --2- 172.21.15.5:0/3922746183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c900fcf90 0x7f1c9010df40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1c84000c00 tx=0x7f1c84009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:03.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.409+0000 7f1c8cff9700 1 -- 172.21.15.5:0/3922746183 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c8400e030 con 0x7f1c900fcf90 2024-04-16T14:38:03.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.409+0000 7f1c8cff9700 1 -- 172.21.15.5:0/3922746183 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1c84013de0 con 0x7f1c900fcf90 2024-04-16T14:38:03.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.410+0000 7f1c8cff9700 1 -- 172.21.15.5:0/3922746183 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c8401ce50 con 0x7f1c900fcf90 2024-04-16T14:38:03.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.410+0000 7f1c96635700 1 -- 172.21.15.5:0/3922746183 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c9010f010 con 0x7f1c900fcf90 2024-04-16T14:38:03.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.410+0000 7f1c96635700 1 -- 172.21.15.5:0/3922746183 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c9010f550 con 0x7f1c900fcf90 2024-04-16T14:38:03.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.411+0000 7f1c8cff9700 1 -- 172.21.15.5:0/3922746183 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 37) v1 ==== 92303+0+0 (secure 0 0 0) 0x7f1c84013910 con 0x7f1c900fcf90 2024-04-16T14:38:03.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.411+0000 7f1c96635700 1 -- 172.21.15.5:0/3922746183 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c90101b20 con 0x7f1c900fcf90 2024-04-16T14:38:03.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.411+0000 7f1c8cff9700 1 --2- 172.21.15.5:0/3922746183 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f1c7806e200 0x7f1c780706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:03.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.411+0000 7f1c8cff9700 1 -- 172.21.15.5:0/3922746183 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f1c8408f650 con 0x7f1c900fcf90 2024-04-16T14:38:03.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.411+0000 7f1c8ffff700 1 --2- 172.21.15.5:0/3922746183 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f1c7806e200 0x7f1c780706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:03.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.412+0000 7f1c8ffff700 1 --2- 172.21.15.5:0/3922746183 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f1c7806e200 0x7f1c780706b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1c80008fd0 tx=0x7f1c8000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:03.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.416+0000 7f1c8cff9700 1 -- 172.21.15.5:0/3922746183 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f1c8405c2e0 con 0x7f1c900fcf90 2024-04-16T14:38:03.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.746+0000 7f1c96635700 1 -- 172.21.15.5:0/3922746183 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1c9005f5f0 con 0x7f1c900fcf90 2024-04-16T14:38:03.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.747+0000 7f1c8cff9700 1 -- 172.21.15.5:0/3922746183 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7f1c8405be70 con 0x7f1c900fcf90 2024-04-16T14:38:03.746 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:38:03.746 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-04-16T14:38:03.746 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:38:03.746 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:38:03.746 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-04-16T14:38:03.746 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:38:03.746 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:38:03.746 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-04-16T14:38:03.747 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 6 2024-04-16T14:38:03.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:38:03.747 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-04-16T14:38:03.747 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 4 2024-04-16T14:38:03.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:38:03.747 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-04-16T14:38:03.747 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 10, 2024-04-16T14:38:03.747 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 4 2024-04-16T14:38:03.747 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-16T14:38:03.747 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:38:03.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.749+0000 7f1c96635700 1 -- 172.21.15.5:0/3922746183 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f1c7806e200 msgr2=0x7f1c780706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:03.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.749+0000 7f1c96635700 1 --2- 172.21.15.5:0/3922746183 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f1c7806e200 0x7f1c780706b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1c80008fd0 tx=0x7f1c8000b040 comp rx=0 tx=0).stop 2024-04-16T14:38:03.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.749+0000 7f1c96635700 1 -- 172.21.15.5:0/3922746183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c900fcf90 msgr2=0x7f1c9010df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:03.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.749+0000 7f1c96635700 1 --2- 172.21.15.5:0/3922746183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c900fcf90 0x7f1c9010df40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1c84000c00 tx=0x7f1c84009e30 comp rx=0 tx=0).stop 2024-04-16T14:38:03.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.749+0000 7f1c96635700 1 -- 172.21.15.5:0/3922746183 shutdown_connections 2024-04-16T14:38:03.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.749+0000 7f1c96635700 1 --2- 172.21.15.5:0/3922746183 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f1c7806e200 0x7f1c780706b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:03.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.749+0000 7f1c96635700 1 --2- 172.21.15.5:0/3922746183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c900fbe20 0x7f1c9010da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:03.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.749+0000 7f1c96635700 1 --2- 172.21.15.5:0/3922746183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c900fcf90 0x7f1c9010df40 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:03.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.749+0000 7f1c96635700 1 -- 172.21.15.5:0/3922746183 >> 172.21.15.5:0/3922746183 conn(0x7f1c900f74e0 msgr2=0x7f1c900f8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:03.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.749+0000 7f1c96635700 1 -- 172.21.15.5:0/3922746183 shutdown_connections 2024-04-16T14:38:03.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.749+0000 7f1c96635700 1 -- 172.21.15.5:0/3922746183 wait complete. 2024-04-16T14:38:03.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.854+0000 7f19b6da2700 1 -- 172.21.15.5:0/2087891334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19b00fe260 msgr2=0x7f19b00fe670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:03.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.854+0000 7f19b6da2700 1 --2- 172.21.15.5:0/2087891334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19b00fe260 0x7f19b00fe670 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009ce0 tx=0x7f19a0004d10 comp rx=0 tx=0).stop 2024-04-16T14:38:03.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.854+0000 7f19b6da2700 1 -- 172.21.15.5:0/2087891334 shutdown_connections 2024-04-16T14:38:03.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.854+0000 7f19b6da2700 1 --2- 172.21.15.5:0/2087891334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19b00febb0 0x7f19b00facf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:03.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.854+0000 7f19b6da2700 1 --2- 172.21.15.5:0/2087891334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19b00fe260 0x7f19b00fe670 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:03.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.854+0000 7f19b6da2700 1 -- 172.21.15.5:0/2087891334 >> 172.21.15.5:0/2087891334 conn(0x7f19b00f6a00 msgr2=0x7f19b00f8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:03.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.854+0000 7f19b6da2700 1 -- 172.21.15.5:0/2087891334 shutdown_connections 2024-04-16T14:38:03.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.854+0000 7f19b6da2700 1 -- 172.21.15.5:0/2087891334 wait complete. 2024-04-16T14:38:03.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.854+0000 7f19b6da2700 1 Processor -- start 2024-04-16T14:38:03.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.854+0000 7f19b6da2700 1 -- start start 2024-04-16T14:38:03.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.855+0000 7f19b6da2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19b00fe260 0x7f19b00fda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:03.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.855+0000 7f19b6da2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19b00febb0 0x7f19b00fbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:03.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.855+0000 7f19b6da2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b00fc4d0 con 0x7f19b00fe260 2024-04-16T14:38:03.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.855+0000 7f19b6da2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b00fc640 con 0x7f19b00febb0 2024-04-16T14:38:03.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.855+0000 7f19b5da0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19b00fe260 0x7f19b00fda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:03.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.855+0000 7f19b5da0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19b00fe260 0x7f19b00fda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51854/0 (socket says 172.21.15.5:51854) 2024-04-16T14:38:03.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.855+0000 7f19b5da0700 1 -- 172.21.15.5:0/1816879567 learned_addr learned my addr 172.21.15.5:0/1816879567 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:38:03.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.855+0000 7f19b559f700 1 --2- 172.21.15.5:0/1816879567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19b00febb0 0x7f19b00fbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:03.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.855+0000 7f19b5da0700 1 -- 172.21.15.5:0/1816879567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19b00febb0 msgr2=0x7f19b00fbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:03.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.855+0000 7f19b5da0700 1 --2- 172.21.15.5:0/1816879567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19b00febb0 0x7f19b00fbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:03.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.855+0000 7f19b5da0700 1 -- 172.21.15.5:0/1816879567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a0009940 con 0x7f19b00fe260 2024-04-16T14:38:03.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.855+0000 7f19b559f700 1 --2- 172.21.15.5:0/1816879567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19b00febb0 0x7f19b00fbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T14:38:03.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.855+0000 7f19b5da0700 1 --2- 172.21.15.5:0/1816879567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19b00fe260 0x7f19b00fda50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f19a0004b70 tx=0x7f19a0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:03.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.855+0000 7f19ae7fc700 1 -- 172.21.15.5:0/1816879567 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19a000e040 con 0x7f19b00fe260 2024-04-16T14:38:03.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.855+0000 7f19ae7fc700 1 -- 172.21.15.5:0/1816879567 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f19a0008ea0 con 0x7f19b00fe260 2024-04-16T14:38:03.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.855+0000 7f19ae7fc700 1 -- 172.21.15.5:0/1816879567 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19a001c7c0 con 0x7f19b00fe260 2024-04-16T14:38:03.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.855+0000 7f19b6da2700 1 -- 172.21.15.5:0/1816879567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b00fc8c0 con 0x7f19b00fe260 2024-04-16T14:38:03.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.856+0000 7f19b6da2700 1 -- 172.21.15.5:0/1816879567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b0115a90 con 0x7f19b00fe260 2024-04-16T14:38:03.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.857+0000 7f19b6da2700 1 -- 172.21.15.5:0/1816879567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b005f5f0 con 0x7f19b00fe260 2024-04-16T14:38:03.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.857+0000 7f19ae7fc700 1 -- 172.21.15.5:0/1816879567 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 92303+0+0 (secure 0 0 0) 0x7f19a0012b70 con 0x7f19b00fe260 2024-04-16T14:38:03.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.858+0000 7f19ae7fc700 1 --2- 172.21.15.5:0/1816879567 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f199806e260 0x7f1998070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:03.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.858+0000 7f19ae7fc700 1 -- 172.21.15.5:0/1816879567 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f19a008f8d0 con 0x7f19b00fe260 2024-04-16T14:38:03.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.858+0000 7f19b559f700 1 --2- 172.21.15.5:0/1816879567 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f199806e260 0x7f1998070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:03.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.858+0000 7f19b559f700 1 --2- 172.21.15.5:0/1816879567 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f199806e260 0x7f1998070710 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f19a40095c0 tx=0x7f19a4007f20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:03.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:03.862+0000 7f19ae7fc700 1 -- 172.21.15.5:0/1816879567 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f19a0058ab0 con 0x7f19b00fe260 2024-04-16T14:38:04.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.116+0000 7f19b6da2700 1 -- 172.21.15.5:0/1816879567 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f19b0115db0 con 0x7f19b00fe260 2024-04-16T14:38:04.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.116+0000 7f19ae7fc700 1 -- 172.21.15.5:0/1816879567 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1916 (secure 0 0 0) 0x7f19a0004e10 con 0x7f19b00fe260 2024-04-16T14:38:04.115 INFO:teuthology.orchestra.run.smithi005.stdout:e20 2024-04-16T14:38:04.115 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:38:04.115 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:38:04.115 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2024-04-16T14:38:04.115 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:38:04.115 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2024-04-16T14:38:04.115 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2024-04-16T14:38:04.115 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 20 2024-04-16T14:38:04.115 INFO:teuthology.orchestra.run.smithi005.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-16T14:38:04.115 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-16T14:32:45.270024+0000 2024-04-16T14:38:04.115 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-04-16T14:35:42.742829+0000 2024-04-16T14:38:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2024-04-16T14:38:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2024-04-16T14:38:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 60 2024-04-16T14:38:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2024-04-16T14:38:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2024-04-16T14:38:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:max_xattr_size 65536 2024-04-16T14:38:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2024-04-16T14:38:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2024-04-16T14:38:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 47 2024-04-16T14:38:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:38:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 2 2024-04-16T14:38:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:in 0,1 2024-04-16T14:38:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=14484,1=24269} 2024-04-16T14:38:04.116 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2024-04-16T14:38:04.117 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2024-04-16T14:38:04.117 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 2024-04-16T14:38:04.117 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3] 2024-04-16T14:38:04.117 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2024-04-16T14:38:04.117 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2024-04-16T14:38:04.117 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2024-04-16T14:38:04.117 INFO:teuthology.orchestra.run.smithi005.stdout:bal_rank_mask -1 2024-04-16T14:38:04.117 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 1 2024-04-16T14:38:04.117 INFO:teuthology.orchestra.run.smithi005.stdout:qdb_cluster leader: 0 members: 2024-04-16T14:38:04.117 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.wofqlz{0:14484} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:38:04.117 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.byfytg{1:24269} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.115:6824/1662994117,v1:172.21.15.115:6825/1662994117] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:38:04.117 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:38:04.117 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:38:04.117 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2024-04-16T14:38:04.118 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:38:04.118 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.vzoqdl{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.5:6826/187766809,v1:172.21.15.5:6827/187766809] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:38:04.118 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.trkaqh{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:38:04.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.118+0000 7f19b6da2700 1 -- 172.21.15.5:0/1816879567 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f199806e260 msgr2=0x7f1998070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:04.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.118+0000 7f19b6da2700 1 --2- 172.21.15.5:0/1816879567 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f199806e260 0x7f1998070710 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f19a40095c0 tx=0x7f19a4007f20 comp rx=0 tx=0).stop 2024-04-16T14:38:04.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.118+0000 7f19b6da2700 1 -- 172.21.15.5:0/1816879567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19b00fe260 msgr2=0x7f19b00fda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:04.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.118+0000 7f19b6da2700 1 --2- 172.21.15.5:0/1816879567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19b00fe260 0x7f19b00fda50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f19a0004b70 tx=0x7f19a0004d10 comp rx=0 tx=0).stop 2024-04-16T14:38:04.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.118+0000 7f19b6da2700 1 -- 172.21.15.5:0/1816879567 shutdown_connections 2024-04-16T14:38:04.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.118+0000 7f19b6da2700 1 --2- 172.21.15.5:0/1816879567 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f199806e260 0x7f1998070710 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:04.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.118+0000 7f19b6da2700 1 --2- 172.21.15.5:0/1816879567 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19b00fe260 0x7f19b00fda50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:04.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.118+0000 7f19b6da2700 1 --2- 172.21.15.5:0/1816879567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19b00febb0 0x7f19b00fbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:04.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.118+0000 7f19b6da2700 1 -- 172.21.15.5:0/1816879567 >> 172.21.15.5:0/1816879567 conn(0x7f19b00f6a00 msgr2=0x7f19b00f81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:04.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.118+0000 7f19b6da2700 1 -- 172.21.15.5:0/1816879567 shutdown_connections 2024-04-16T14:38:04.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.118+0000 7f19b6da2700 1 -- 172.21.15.5:0/1816879567 wait complete. 2024-04-16T14:38:04.119 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 20 2024-04-16T14:38:04.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.223+0000 7fe8bf559700 1 -- 172.21.15.5:0/3779409765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b80fbcf0 msgr2=0x7fe8b80fc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:04.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.223+0000 7fe8bf559700 1 --2- 172.21.15.5:0/3779409765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b80fbcf0 0x7fe8b80fc100 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4004940 tx=0x7fe8b4009e30 comp rx=0 tx=0).stop 2024-04-16T14:38:04.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.223+0000 7fe8bf559700 1 -- 172.21.15.5:0/3779409765 shutdown_connections 2024-04-16T14:38:04.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.223+0000 7fe8bf559700 1 --2- 172.21.15.5:0/3779409765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8b80fcfa0 0x7fe8b80fd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:04.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.223+0000 7fe8bf559700 1 --2- 172.21.15.5:0/3779409765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b80fbcf0 0x7fe8b80fc100 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.223+0000 7fe8bf559700 1 -- 172.21.15.5:0/3779409765 >> 172.21.15.5:0/3779409765 conn(0x7fe8b80f7450 msgr2=0x7fe8b80f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.223+0000 7fe8bf559700 1 -- 172.21.15.5:0/3779409765 shutdown_connections 2024-04-16T14:38:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.223+0000 7fe8bf559700 1 -- 172.21.15.5:0/3779409765 wait complete. 2024-04-16T14:38:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.224+0000 7fe8bf559700 1 Processor -- start 2024-04-16T14:38:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.224+0000 7fe8bf559700 1 -- start start 2024-04-16T14:38:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.224+0000 7fe8bf559700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8b80fbcf0 0x7fe8b810d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.224+0000 7fe8bf559700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b80fcfa0 0x7fe8b810de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.224+0000 7fe8bf559700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b810e400 con 0x7fe8b80fcfa0 2024-04-16T14:38:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.224+0000 7fe8bf559700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b810e570 con 0x7fe8b80fbcf0 2024-04-16T14:38:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.224+0000 7fe8bcaf4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b80fcfa0 0x7fe8b810de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.224+0000 7fe8bcaf4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b80fcfa0 0x7fe8b810de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51880/0 (socket says 172.21.15.5:51880) 2024-04-16T14:38:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.224+0000 7fe8bd2f5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8b80fbcf0 0x7fe8b810d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.224+0000 7fe8bcaf4700 1 -- 172.21.15.5:0/359614450 learned_addr learned my addr 172.21.15.5:0/359614450 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:38:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.224+0000 7fe8bd2f5700 1 -- 172.21.15.5:0/359614450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b80fcfa0 msgr2=0x7fe8b810de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.224+0000 7fe8bd2f5700 1 --2- 172.21.15.5:0/359614450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b80fcfa0 0x7fe8b810de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.224+0000 7fe8bd2f5700 1 -- 172.21.15.5:0/359614450 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b4005040 con 0x7fe8b80fbcf0 2024-04-16T14:38:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.225+0000 7fe8bd2f5700 1 --2- 172.21.15.5:0/359614450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8b80fbcf0 0x7fe8b810d8c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4000c00 tx=0x7fe8b4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.225+0000 7fe8adffb700 1 -- 172.21.15.5:0/359614450 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8b400e030 con 0x7fe8b80fbcf0 2024-04-16T14:38:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.225+0000 7fe8adffb700 1 -- 172.21.15.5:0/359614450 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe8b4013de0 con 0x7fe8b80fbcf0 2024-04-16T14:38:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.225+0000 7fe8bf559700 1 -- 172.21.15.5:0/359614450 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b8112f70 con 0x7fe8b80fbcf0 2024-04-16T14:38:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.225+0000 7fe8adffb700 1 -- 172.21.15.5:0/359614450 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8b401ce50 con 0x7fe8b80fbcf0 2024-04-16T14:38:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.225+0000 7fe8bf559700 1 -- 172.21.15.5:0/359614450 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b8113420 con 0x7fe8b80fbcf0 2024-04-16T14:38:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.226+0000 7fe8bf559700 1 -- 172.21.15.5:0/359614450 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b8101b30 con 0x7fe8b80fbcf0 2024-04-16T14:38:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.226+0000 7fe8adffb700 1 -- 172.21.15.5:0/359614450 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 37) v1 ==== 92303+0+0 (secure 0 0 0) 0x7fe8b401c400 con 0x7fe8b80fbcf0 2024-04-16T14:38:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.227+0000 7fe8adffb700 1 --2- 172.21.15.5:0/359614450 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe8a406e200 0x7fe8a40706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.227+0000 7fe8adffb700 1 -- 172.21.15.5:0/359614450 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fe8b408f680 con 0x7fe8b80fbcf0 2024-04-16T14:38:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.227+0000 7fe8bcaf4700 1 --2- 172.21.15.5:0/359614450 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe8a406e200 0x7fe8a40706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.227+0000 7fe8bcaf4700 1 --2- 172.21.15.5:0/359614450 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe8a406e200 0x7fe8a40706b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8008fd0 tx=0x7fe8a800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:04.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.232+0000 7fe8adffb700 1 -- 172.21.15.5:0/359614450 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fe8b405c2b0 con 0x7fe8b80fbcf0 2024-04-16T14:38:04.393 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:04 smithi115 ceph-mon[83414]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:38:04.393 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:04 smithi115 ceph-mon[83414]: Reconfiguring mon.smithi115 (monmap changed)... 2024-04-16T14:38:04.393 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:04 smithi115 ceph-mon[83414]: Reconfiguring daemon mon.smithi115 on smithi115 2024-04-16T14:38:04.393 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:04 smithi115 ceph-mon[83414]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:38:04.393 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:04 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/3922746183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:38:04.393 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:04 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/1816879567' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:38:04.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.457+0000 7fe8bf559700 1 -- 172.21.15.5:0/359614450 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8b802b490 con 0x7fe8a406e200 2024-04-16T14:38:04.456 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:04 smithi005 ceph-mon[93420]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:38:04.456 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:04 smithi005 ceph-mon[93420]: Reconfiguring mon.smithi115 (monmap changed)... 2024-04-16T14:38:04.456 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:04 smithi005 ceph-mon[93420]: Reconfiguring daemon mon.smithi115 on smithi115 2024-04-16T14:38:04.456 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:04 smithi005 ceph-mon[93420]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:38:04.456 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:04 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/3922746183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:38:04.456 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:04 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/1816879567' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:38:04.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.459+0000 7fe8adffb700 1 -- 172.21.15.5:0/359614450 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fe8b802b490 con 0x7fe8a406e200 2024-04-16T14:38:04.457 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:38:04.457 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91", 2024-04-16T14:38:04.457 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-04-16T14:38:04.457 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-16T14:38:04.457 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [ 2024-04-16T14:38:04.457 INFO:teuthology.orchestra.run.smithi005.stdout: "mon", 2024-04-16T14:38:04.457 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr" 2024-04-16T14:38:04.457 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-04-16T14:38:04.457 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "4/21 daemons upgraded", 2024-04-16T14:38:04.457 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading mon daemons", 2024-04-16T14:38:04.458 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-04-16T14:38:04.458 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:38:04.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.461+0000 7fe8bf559700 1 -- 172.21.15.5:0/359614450 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe8a406e200 msgr2=0x7fe8a40706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:04.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.461+0000 7fe8bf559700 1 --2- 172.21.15.5:0/359614450 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe8a406e200 0x7fe8a40706b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8008fd0 tx=0x7fe8a800b040 comp rx=0 tx=0).stop 2024-04-16T14:38:04.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.461+0000 7fe8bf559700 1 -- 172.21.15.5:0/359614450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8b80fbcf0 msgr2=0x7fe8b810d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:04.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.461+0000 7fe8bf559700 1 --2- 172.21.15.5:0/359614450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8b80fbcf0 0x7fe8b810d8c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4000c00 tx=0x7fe8b4009e30 comp rx=0 tx=0).stop 2024-04-16T14:38:04.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.461+0000 7fe8bf559700 1 -- 172.21.15.5:0/359614450 shutdown_connections 2024-04-16T14:38:04.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.461+0000 7fe8bf559700 1 --2- 172.21.15.5:0/359614450 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe8a406e200 0x7fe8a40706b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:04.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.461+0000 7fe8bf559700 1 --2- 172.21.15.5:0/359614450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8b80fbcf0 0x7fe8b810d8c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:04.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.461+0000 7fe8bf559700 1 --2- 172.21.15.5:0/359614450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8b80fcfa0 0x7fe8b810de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:04.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.461+0000 7fe8bf559700 1 -- 172.21.15.5:0/359614450 >> 172.21.15.5:0/359614450 conn(0x7fe8b80f7450 msgr2=0x7fe8b80667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:04.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.461+0000 7fe8bf559700 1 -- 172.21.15.5:0/359614450 shutdown_connections 2024-04-16T14:38:04.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.461+0000 7fe8bf559700 1 -- 172.21.15.5:0/359614450 wait complete. 2024-04-16T14:38:04.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.565+0000 7f9199a8f700 1 -- 172.21.15.5:0/1166587716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91940fff30 msgr2=0x7f9194102350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:04.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.565+0000 7f9199a8f700 1 --2- 172.21.15.5:0/1166587716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91940fff30 0x7f9194102350 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9188004940 tx=0x7f9188009e30 comp rx=0 tx=0).stop 2024-04-16T14:38:04.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.565+0000 7f9199a8f700 1 -- 172.21.15.5:0/1166587716 shutdown_connections 2024-04-16T14:38:04.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.565+0000 7f9199a8f700 1 --2- 172.21.15.5:0/1166587716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f91940fff30 0x7f9194102350 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:04.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.565+0000 7f9199a8f700 1 --2- 172.21.15.5:0/1166587716 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9194066f60 0x7f91940ff9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:04.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.565+0000 7f9199a8f700 1 -- 172.21.15.5:0/1166587716 >> 172.21.15.5:0/1166587716 conn(0x7f91940f7460 msgr2=0x7f91940f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:04.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.566+0000 7f9199a8f700 1 -- 172.21.15.5:0/1166587716 shutdown_connections 2024-04-16T14:38:04.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.566+0000 7f9199a8f700 1 -- 172.21.15.5:0/1166587716 wait complete. 2024-04-16T14:38:04.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.566+0000 7f9199a8f700 1 Processor -- start 2024-04-16T14:38:04.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.566+0000 7f9199a8f700 1 -- start start 2024-04-16T14:38:04.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.566+0000 7f9199a8f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9194066f60 0x7f91940fd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:04.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.566+0000 7f9199a8f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91940fff30 0x7f91940fb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:04.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.566+0000 7f9199a8f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91940fd840 con 0x7f9194066f60 2024-04-16T14:38:04.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.566+0000 7f9199a8f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91940fbe30 con 0x7f91940fff30 2024-04-16T14:38:04.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.567+0000 7f91937fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9194066f60 0x7f91940fd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:04.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.567+0000 7f91937fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9194066f60 0x7f91940fd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51898/0 (socket says 172.21.15.5:51898) 2024-04-16T14:38:04.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.567+0000 7f91937fe700 1 -- 172.21.15.5:0/3662081049 learned_addr learned my addr 172.21.15.5:0/3662081049 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:38:04.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.567+0000 7f9192ffd700 1 --2- 172.21.15.5:0/3662081049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91940fff30 0x7f91940fb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:04.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.567+0000 7f91937fe700 1 -- 172.21.15.5:0/3662081049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91940fff30 msgr2=0x7f91940fb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:04.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.567+0000 7f91937fe700 1 --2- 172.21.15.5:0/3662081049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91940fff30 0x7f91940fb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:04.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.567+0000 7f91937fe700 1 -- 172.21.15.5:0/3662081049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9188005040 con 0x7f9194066f60 2024-04-16T14:38:04.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.567+0000 7f9192ffd700 1 --2- 172.21.15.5:0/3662081049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91940fff30 0x7f91940fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-16T14:38:04.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.567+0000 7f91937fe700 1 --2- 172.21.15.5:0/3662081049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9194066f60 0x7f91940fd240 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f918400eb40 tx=0x7f918400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:04.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.567+0000 7f917bfff700 1 -- 172.21.15.5:0/3662081049 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9184007cc0 con 0x7f9194066f60 2024-04-16T14:38:04.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.567+0000 7f917bfff700 1 -- 172.21.15.5:0/3662081049 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f918400f040 con 0x7f9194066f60 2024-04-16T14:38:04.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.567+0000 7f9199a8f700 1 -- 172.21.15.5:0/3662081049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91940fc080 con 0x7f9194066f60 2024-04-16T14:38:04.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.567+0000 7f917bfff700 1 -- 172.21.15.5:0/3662081049 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f918400c9d0 con 0x7f9194066f60 2024-04-16T14:38:04.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.567+0000 7f9199a8f700 1 -- 172.21.15.5:0/3662081049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91940fc5c0 con 0x7f9194066f60 2024-04-16T14:38:04.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.568+0000 7f9199a8f700 1 -- 172.21.15.5:0/3662081049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f919404c710 con 0x7f9194066f60 2024-04-16T14:38:04.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.569+0000 7f917bfff700 1 -- 172.21.15.5:0/3662081049 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 92303+0+0 (secure 0 0 0) 0x7f918400cc40 con 0x7f9194066f60 2024-04-16T14:38:04.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.569+0000 7f917bfff700 1 --2- 172.21.15.5:0/3662081049 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f917c06e270 0x7f917c070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:04.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.570+0000 7f917bfff700 1 -- 172.21.15.5:0/3662081049 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f918408d890 con 0x7f9194066f60 2024-04-16T14:38:04.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.570+0000 7f9192ffd700 1 --2- 172.21.15.5:0/3662081049 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f917c06e270 0x7f917c070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:04.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.570+0000 7f9192ffd700 1 --2- 172.21.15.5:0/3662081049 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f917c06e270 0x7f917c070720 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9188009b30 tx=0x7f9188009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:04.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.574+0000 7f917bfff700 1 -- 172.21.15.5:0/3662081049 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f918405a530 con 0x7f9194066f60 2024-04-16T14:38:04.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.869+0000 7f9199a8f700 1 -- 172.21.15.5:0/3662081049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f91940676c0 con 0x7f9194066f60 2024-04-16T14:38:04.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.869+0000 7f917bfff700 1 -- 172.21.15.5:0/3662081049 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f918405a0c0 con 0x7f9194066f60 2024-04-16T14:38:04.868 INFO:teuthology.orchestra.run.smithi005.stdout:HEALTH_OK 2024-04-16T14:38:04.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.871+0000 7f9199a8f700 1 -- 172.21.15.5:0/3662081049 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f917c06e270 msgr2=0x7f917c070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:04.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.871+0000 7f9199a8f700 1 --2- 172.21.15.5:0/3662081049 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f917c06e270 0x7f917c070720 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9188009b30 tx=0x7f9188009e30 comp rx=0 tx=0).stop 2024-04-16T14:38:04.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.871+0000 7f9199a8f700 1 -- 172.21.15.5:0/3662081049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9194066f60 msgr2=0x7f91940fd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:04.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.871+0000 7f9199a8f700 1 --2- 172.21.15.5:0/3662081049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9194066f60 0x7f91940fd240 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f918400eb40 tx=0x7f918400b040 comp rx=0 tx=0).stop 2024-04-16T14:38:04.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.871+0000 7f9199a8f700 1 -- 172.21.15.5:0/3662081049 shutdown_connections 2024-04-16T14:38:04.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.871+0000 7f9199a8f700 1 --2- 172.21.15.5:0/3662081049 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f917c06e270 0x7f917c070720 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:04.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.871+0000 7f9199a8f700 1 --2- 172.21.15.5:0/3662081049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9194066f60 0x7f91940fd240 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:04.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.871+0000 7f9199a8f700 1 --2- 172.21.15.5:0/3662081049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91940fff30 0x7f91940fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:04.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.871+0000 7f9199a8f700 1 -- 172.21.15.5:0/3662081049 >> 172.21.15.5:0/3662081049 conn(0x7f91940f7460 msgr2=0x7f91940f7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:04.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.871+0000 7f9199a8f700 1 -- 172.21.15.5:0/3662081049 shutdown_connections 2024-04-16T14:38:04.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:04.871+0000 7f9199a8f700 1 -- 172.21.15.5:0/3662081049 wait complete. 2024-04-16T14:38:05.231 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:05 smithi115 ceph-mon[83414]: pgmap v23: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:05.232 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:05 smithi115 ceph-mon[83414]: from='client.44107 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:38:05.232 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:05 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:05.232 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:05 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:05.232 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:05 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-16T14:38:05.232 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:05 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:38:05.232 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:05 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/3662081049' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:38:05.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:05 smithi005 ceph-mon[93420]: pgmap v23: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:05.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:05 smithi005 ceph-mon[93420]: from='client.44107 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:38:05.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:05 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:05.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:05 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:05.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:05 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-16T14:38:05.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:05 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:38:05.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:05 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/3662081049' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:38:06.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:06 smithi115 ceph-mon[83414]: Reconfiguring osd.3 (monmap changed)... 2024-04-16T14:38:06.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:06 smithi115 ceph-mon[83414]: Reconfiguring daemon osd.3 on smithi115 2024-04-16T14:38:06.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:06 smithi115 ceph-mon[83414]: from='client.44119 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:38:06.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:06 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:06.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:06 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:06.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:06 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-16T14:38:06.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:06 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:38:06.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:06 smithi005 ceph-mon[93420]: Reconfiguring osd.3 (monmap changed)... 2024-04-16T14:38:06.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:06 smithi005 ceph-mon[93420]: Reconfiguring daemon osd.3 on smithi115 2024-04-16T14:38:06.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:06 smithi005 ceph-mon[93420]: from='client.44119 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:38:06.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:06 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:06.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:06 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:06.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:06 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-16T14:38:06.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:06 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:38:07.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:07 smithi115 ceph-mon[83414]: pgmap v24: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:07.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:07 smithi115 ceph-mon[83414]: Reconfiguring osd.4 (monmap changed)... 2024-04-16T14:38:07.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:07 smithi115 ceph-mon[83414]: Reconfiguring daemon osd.4 on smithi115 2024-04-16T14:38:07.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:07 smithi005 ceph-mon[93420]: pgmap v24: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:07.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:07 smithi005 ceph-mon[93420]: Reconfiguring osd.4 (monmap changed)... 2024-04-16T14:38:07.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:07 smithi005 ceph-mon[93420]: Reconfiguring daemon osd.4 on smithi115 2024-04-16T14:38:08.900 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:08 smithi115 ceph-mon[83414]: pgmap v25: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:08.900 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:08 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:08.900 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:08 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:08.900 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:08 smithi115 ceph-mon[83414]: Reconfiguring osd.5 (monmap changed)... 2024-04-16T14:38:08.900 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:08 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-16T14:38:08.901 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:08 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:38:08.901 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:08 smithi115 ceph-mon[83414]: Reconfiguring daemon osd.5 on smithi115 2024-04-16T14:38:08.901 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:08 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:38:08.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:08 smithi005 ceph-mon[93420]: pgmap v25: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:08.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:08 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:08.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:08 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:08.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:08 smithi005 ceph-mon[93420]: Reconfiguring osd.5 (monmap changed)... 2024-04-16T14:38:08.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:08 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-16T14:38:08.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:08 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:38:08.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:08 smithi005 ceph-mon[93420]: Reconfiguring daemon osd.5 on smithi115 2024-04-16T14:38:08.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:08 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:38:10.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:10 smithi115 ceph-mon[83414]: pgmap v26: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:10.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:10 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:10.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:10 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:10.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:10 smithi115 ceph-mon[83414]: Reconfiguring mds.cephfs.smithi115.byfytg (monmap changed)... 2024-04-16T14:38:10.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:10 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.byfytg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-16T14:38:10.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:10 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:38:10.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:10 smithi115 ceph-mon[83414]: Reconfiguring daemon mds.cephfs.smithi115.byfytg on smithi115 2024-04-16T14:38:10.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:10 smithi005 ceph-mon[93420]: pgmap v26: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:10.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:10 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:10.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:10 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:10.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:10 smithi005 ceph-mon[93420]: Reconfiguring mds.cephfs.smithi115.byfytg (monmap changed)... 2024-04-16T14:38:10.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:10 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.byfytg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-16T14:38:10.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:10 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:38:10.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:10 smithi005 ceph-mon[93420]: Reconfiguring daemon mds.cephfs.smithi115.byfytg on smithi115 2024-04-16T14:38:12.164 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:11 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:12.164 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:11 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:12.164 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:11 smithi115 ceph-mon[83414]: Reconfiguring mds.cephfs.smithi115.trkaqh (monmap changed)... 2024-04-16T14:38:12.164 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:11 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.trkaqh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-16T14:38:12.164 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:11 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:38:12.164 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:11 smithi115 ceph-mon[83414]: Reconfiguring daemon mds.cephfs.smithi115.trkaqh on smithi115 2024-04-16T14:38:12.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:11 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:12.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:11 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:12.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:11 smithi005 ceph-mon[93420]: Reconfiguring mds.cephfs.smithi115.trkaqh (monmap changed)... 2024-04-16T14:38:12.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:11 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.trkaqh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-16T14:38:12.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:11 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:38:12.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:11 smithi005 ceph-mon[93420]: Reconfiguring daemon mds.cephfs.smithi115.trkaqh on smithi115 2024-04-16T14:38:13.144 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:12 smithi005 ceph-mon[93420]: pgmap v27: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:13.144 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:12 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:13.144 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:12 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:13.144 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:12 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:38:13.144 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:12 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:38:13.144 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:12 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:38:13.144 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:12 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:13.144 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:12 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi005"}]: dispatch 2024-04-16T14:38:13.145 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:12 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi005"}]': finished 2024-04-16T14:38:13.145 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:12 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi115"}]: dispatch 2024-04-16T14:38:13.145 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:12 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi115"}]': finished 2024-04-16T14:38:13.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:12 smithi115 ceph-mon[83414]: pgmap v27: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:13.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:12 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:13.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:12 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:13.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:12 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:38:13.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:12 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:38:13.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:12 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:38:13.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:12 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:13.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:12 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi005"}]: dispatch 2024-04-16T14:38:13.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:12 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi005"}]': finished 2024-04-16T14:38:13.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:12 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi115"}]: dispatch 2024-04-16T14:38:13.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:12 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi115"}]': finished 2024-04-16T14:38:13.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:13 smithi005 ceph-mon[93420]: Upgrade: Setting container_image for all mon 2024-04-16T14:38:14.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:13 smithi115 ceph-mon[83414]: Upgrade: Setting container_image for all mon 2024-04-16T14:38:15.109 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:14 smithi005 ceph-mon[93420]: pgmap v28: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:15.109 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:14 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:15.109 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:14 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi005", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-16T14:38:15.110 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:14 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:38:15.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:14 smithi115 ceph-mon[83414]: pgmap v28: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:15.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:14 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:15.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:14 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi005", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-16T14:38:15.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:14 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:38:16.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:15 smithi115 ceph-mon[83414]: Upgrade: Updating crash.smithi005 (1/2) 2024-04-16T14:38:16.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:15 smithi115 ceph-mon[83414]: Deploying daemon crash.smithi005 on smithi005 2024-04-16T14:38:16.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:15 smithi005 ceph-mon[93420]: Upgrade: Updating crash.smithi005 (1/2) 2024-04-16T14:38:16.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:15 smithi005 ceph-mon[93420]: Deploying daemon crash.smithi005 on smithi005 2024-04-16T14:38:17.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:16 smithi115 ceph-mon[83414]: pgmap v29: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:17.210 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:16 smithi005 ceph-mon[93420]: pgmap v29: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:18.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:18 smithi005 ceph-mon[93420]: pgmap v30: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:18.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:18 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:18.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:18 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:19.105 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:18 smithi115 ceph-mon[83414]: pgmap v30: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:19.105 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:18 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:19.105 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:18 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:21.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:20 smithi115 ceph-mon[83414]: pgmap v31: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:21.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:20 smithi115 ceph-mon[83414]: Upgrade: Updating crash.smithi115 (2/2) 2024-04-16T14:38:21.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:20 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:21.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:20 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi115", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-16T14:38:21.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:20 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:38:21.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:20 smithi115 ceph-mon[83414]: Deploying daemon crash.smithi115 on smithi115 2024-04-16T14:38:21.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:20 smithi005 ceph-mon[93420]: pgmap v31: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:21.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:20 smithi005 ceph-mon[93420]: Upgrade: Updating crash.smithi115 (2/2) 2024-04-16T14:38:21.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:20 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:21.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:20 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi115", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-16T14:38:21.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:20 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:38:21.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:20 smithi005 ceph-mon[93420]: Deploying daemon crash.smithi115 on smithi115 2024-04-16T14:38:23.229 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:22 smithi005 ceph-mon[93420]: pgmap v32: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:23.256 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:22 smithi115 ceph-mon[83414]: pgmap v32: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:24.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:23 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:38:24.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:23 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:24.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:23 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:24.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:23 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:38:24.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:23 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:38:24.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:23 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:24.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:23 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:24.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:23 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:38:25.212 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:24 smithi005 ceph-mon[93420]: pgmap v33: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:25.212 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:25.212 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:25.220 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:24 smithi115 ceph-mon[83414]: pgmap v33: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:25.220 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:24 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:25.220 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:24 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:27.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:26 smithi115 ceph-mon[83414]: pgmap v34: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:27.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:26 smithi005 ceph-mon[93420]: pgmap v34: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:28.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:28 smithi005 ceph-mon[93420]: pgmap v35: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:28.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:28 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:28.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:28 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:28.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:28 smithi115 ceph-mon[83414]: pgmap v35: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:28.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:28 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:28.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:28 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:29.578 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:29 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:29.578 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:29 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:29.578 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:29 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:29.578 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:29 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:29.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:29 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:29.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:29 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:29.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:29 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:29.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:29 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:30.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:30 smithi005 ceph-mon[93420]: pgmap v36: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:30.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:30 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:30.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:30 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:31.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:30 smithi115 ceph-mon[83414]: pgmap v36: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:31.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:30 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:31.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:30 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:32.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:32 smithi115 ceph-mon[83414]: pgmap v37: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:32.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:32.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:32.950 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:32 smithi005 ceph-mon[93420]: pgmap v37: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:32.950 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:32.950 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:34.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:34 smithi005 ceph-mon[93420]: pgmap v38: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:34.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:34 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:34.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:34 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:34.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:34 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:38:34.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:34 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:38:34.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:34 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:34.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:34 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:38:34.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:34 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:38:34.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:34 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:38:34.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:34 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:38:34.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:34 smithi005 ceph-mon[93420]: Upgrade: Setting container_image for all crash 2024-04-16T14:38:34.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:34 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:34.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:34 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi005"}]: dispatch 2024-04-16T14:38:34.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:34 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi005"}]': finished 2024-04-16T14:38:34.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:34 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi115"}]: dispatch 2024-04-16T14:38:34.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:34 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi115"}]': finished 2024-04-16T14:38:34.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:34 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-16T14:38:34.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:34 smithi005 ceph-mon[93420]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-16T14:38:34.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:34 smithi005 ceph-mon[93420]: Upgrade: osd.0 is safe to restart 2024-04-16T14:38:34.734 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:34 smithi115 ceph-mon[83414]: pgmap v38: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:34.734 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:34 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:34.734 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:34 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:34.734 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:34 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:38:34.734 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:34 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:38:34.734 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:34 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:34.734 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:34 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:38:34.735 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:34 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:38:34.735 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:34 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:38:34.735 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:34 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:38:34.735 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:34 smithi115 ceph-mon[83414]: Upgrade: Setting container_image for all crash 2024-04-16T14:38:34.735 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:34 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:34.735 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:34 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi005"}]: dispatch 2024-04-16T14:38:34.735 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:34 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi005"}]': finished 2024-04-16T14:38:34.735 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:34 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi115"}]: dispatch 2024-04-16T14:38:34.735 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:34 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi115"}]': finished 2024-04-16T14:38:34.735 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:34 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-16T14:38:34.735 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:34 smithi115 ceph-mon[83414]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-16T14:38:34.735 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:34 smithi115 ceph-mon[83414]: Upgrade: osd.0 is safe to restart 2024-04-16T14:38:34.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.978+0000 7f8cc9955700 1 -- 172.21.15.5:0/844731856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cc40fbcf0 msgr2=0x7f8cc40fc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.978+0000 7f8cc9955700 1 --2- 172.21.15.5:0/844731856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cc40fbcf0 0x7f8cc40fc100 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4004940 tx=0x7f8cb4009e30 comp rx=0 tx=0).stop 2024-04-16T14:38:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.978+0000 7f8cc9955700 1 -- 172.21.15.5:0/844731856 shutdown_connections 2024-04-16T14:38:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.978+0000 7f8cc9955700 1 --2- 172.21.15.5:0/844731856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cc40fcfa0 0x7f8cc40fd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.978+0000 7f8cc9955700 1 --2- 172.21.15.5:0/844731856 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cc40fbcf0 0x7f8cc40fc100 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.978+0000 7f8cc9955700 1 -- 172.21.15.5:0/844731856 >> 172.21.15.5:0/844731856 conn(0x7f8cc40f7450 msgr2=0x7f8cc40f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.978+0000 7f8cc9955700 1 -- 172.21.15.5:0/844731856 shutdown_connections 2024-04-16T14:38:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.978+0000 7f8cc9955700 1 -- 172.21.15.5:0/844731856 wait complete. 2024-04-16T14:38:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.979+0000 7f8cc9955700 1 Processor -- start 2024-04-16T14:38:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.979+0000 7f8cc9955700 1 -- start start 2024-04-16T14:38:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.979+0000 7f8cc9955700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cc40fbcf0 0x7f8cc4066c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.979+0000 7f8cc9955700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cc40fcfa0 0x7f8cc41127d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.979+0000 7f8cc9955700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc4112d10 con 0x7f8cc40fbcf0 2024-04-16T14:38:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.979+0000 7f8cc9955700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc4112e50 con 0x7f8cc40fcfa0 2024-04-16T14:38:34.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.979+0000 7f8cc2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cc40fbcf0 0x7f8cc4066c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.979+0000 7f8cc2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cc40fbcf0 0x7f8cc4066c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49506/0 (socket says 172.21.15.5:49506) 2024-04-16T14:38:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.979+0000 7f8cc2ffd700 1 -- 172.21.15.5:0/1000046821 learned_addr learned my addr 172.21.15.5:0/1000046821 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:38:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.979+0000 7f8cc27fc700 1 --2- 172.21.15.5:0/1000046821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cc40fcfa0 0x7f8cc41127d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.980+0000 7f8cc2ffd700 1 -- 172.21.15.5:0/1000046821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cc40fcfa0 msgr2=0x7f8cc41127d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.980+0000 7f8cc2ffd700 1 --2- 172.21.15.5:0/1000046821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cc40fcfa0 0x7f8cc41127d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.980+0000 7f8cc2ffd700 1 -- 172.21.15.5:0/1000046821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb4005040 con 0x7f8cc40fbcf0 2024-04-16T14:38:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.980+0000 7f8cc2ffd700 1 --2- 172.21.15.5:0/1000046821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cc40fbcf0 0x7f8cc4066c80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4009150 tx=0x7f8cb4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.980+0000 7f8cab7fe700 1 -- 172.21.15.5:0/1000046821 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cb400e040 con 0x7f8cc40fbcf0 2024-04-16T14:38:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.980+0000 7f8cc9955700 1 -- 172.21.15.5:0/1000046821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc4113050 con 0x7f8cc40fbcf0 2024-04-16T14:38:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.980+0000 7f8cab7fe700 1 -- 172.21.15.5:0/1000046821 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8cb400bbf0 con 0x7f8cc40fbcf0 2024-04-16T14:38:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.980+0000 7f8cab7fe700 1 -- 172.21.15.5:0/1000046821 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cb401c630 con 0x7f8cc40fbcf0 2024-04-16T14:38:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.980+0000 7f8cc9955700 1 -- 172.21.15.5:0/1000046821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc4113610 con 0x7f8cc40fbcf0 2024-04-16T14:38:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.981+0000 7f8cc9955700 1 -- 172.21.15.5:0/1000046821 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc404c710 con 0x7f8cc40fbcf0 2024-04-16T14:38:34.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.982+0000 7f8cab7fe700 1 -- 172.21.15.5:0/1000046821 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 92303+0+0 (secure 0 0 0) 0x7f8cb400bd60 con 0x7f8cc40fbcf0 2024-04-16T14:38:34.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.982+0000 7f8cab7fe700 1 --2- 172.21.15.5:0/1000046821 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f8cac06e270 0x7f8cac070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:34.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.983+0000 7f8cab7fe700 1 -- 172.21.15.5:0/1000046821 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f8cb408f0d0 con 0x7f8cc40fbcf0 2024-04-16T14:38:34.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.983+0000 7f8cc27fc700 1 --2- 172.21.15.5:0/1000046821 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f8cac06e270 0x7f8cac070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:34.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.983+0000 7f8cc27fc700 1 --2- 172.21.15.5:0/1000046821 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f8cac06e270 0x7f8cac070720 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80041d0 tx=0x7f8cb80043c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:34.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:34.987+0000 7f8cab7fe700 1 -- 172.21.15.5:0/1000046821 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f8cb405bde0 con 0x7f8cc40fbcf0 2024-04-16T14:38:35.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.216+0000 7f8cc9955700 1 -- 172.21.15.5:0/1000046821 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cc4101360 con 0x7f8cac06e270 2024-04-16T14:38:35.215 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.217+0000 7f8cab7fe700 1 -- 172.21.15.5:0/1000046821 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8cc4101360 con 0x7f8cac06e270 2024-04-16T14:38:35.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.219+0000 7f8cc9955700 1 -- 172.21.15.5:0/1000046821 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f8cac06e270 msgr2=0x7f8cac070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:35.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.219+0000 7f8cc9955700 1 --2- 172.21.15.5:0/1000046821 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f8cac06e270 0x7f8cac070720 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80041d0 tx=0x7f8cb80043c0 comp rx=0 tx=0).stop 2024-04-16T14:38:35.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.219+0000 7f8cc9955700 1 -- 172.21.15.5:0/1000046821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cc40fbcf0 msgr2=0x7f8cc4066c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:35.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.219+0000 7f8cc9955700 1 --2- 172.21.15.5:0/1000046821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cc40fbcf0 0x7f8cc4066c80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4009150 tx=0x7f8cb4009e30 comp rx=0 tx=0).stop 2024-04-16T14:38:35.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.219+0000 7f8cc9955700 1 -- 172.21.15.5:0/1000046821 shutdown_connections 2024-04-16T14:38:35.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.219+0000 7f8cc9955700 1 --2- 172.21.15.5:0/1000046821 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f8cac06e270 0x7f8cac070720 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:35.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.219+0000 7f8cc9955700 1 --2- 172.21.15.5:0/1000046821 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8cc40fbcf0 0x7f8cc4066c80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:35.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.219+0000 7f8cc9955700 1 --2- 172.21.15.5:0/1000046821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cc40fcfa0 0x7f8cc41127d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:35.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.219+0000 7f8cc9955700 1 -- 172.21.15.5:0/1000046821 >> 172.21.15.5:0/1000046821 conn(0x7f8cc40f7450 msgr2=0x7f8cc40f8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:35.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.220+0000 7f8cc9955700 1 -- 172.21.15.5:0/1000046821 shutdown_connections 2024-04-16T14:38:35.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.220+0000 7f8cc9955700 1 -- 172.21.15.5:0/1000046821 wait complete. 2024-04-16T14:38:35.229 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-04-16T14:38:35.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.329+0000 7ff7f1a4b700 1 -- 172.21.15.5:0/1320751912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7ec0fce50 msgr2=0x7ff7ec0fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:35.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.329+0000 7ff7f1a4b700 1 --2- 172.21.15.5:0/1320751912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7ec0fce50 0x7ff7ec0fd260 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc004940 tx=0x7ff7dc009e30 comp rx=0 tx=0).stop 2024-04-16T14:38:35.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.329+0000 7ff7f1a4b700 1 -- 172.21.15.5:0/1320751912 shutdown_connections 2024-04-16T14:38:35.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.329+0000 7ff7f1a4b700 1 --2- 172.21.15.5:0/1320751912 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7ec0fe050 0x7ff7ec0fe4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:35.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.329+0000 7ff7f1a4b700 1 --2- 172.21.15.5:0/1320751912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7ec0fce50 0x7ff7ec0fd260 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:35.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.329+0000 7ff7f1a4b700 1 -- 172.21.15.5:0/1320751912 >> 172.21.15.5:0/1320751912 conn(0x7ff7ec0f8540 msgr2=0x7ff7ec0fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:35.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.329+0000 7ff7f1a4b700 1 -- 172.21.15.5:0/1320751912 shutdown_connections 2024-04-16T14:38:35.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.329+0000 7ff7f1a4b700 1 -- 172.21.15.5:0/1320751912 wait complete. 2024-04-16T14:38:35.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.329+0000 7ff7f1a4b700 1 Processor -- start 2024-04-16T14:38:35.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.329+0000 7ff7f1a4b700 1 -- start start 2024-04-16T14:38:35.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.330+0000 7ff7f1a4b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7ec0fce50 0x7ff7ec071c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:35.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.330+0000 7ff7f1a4b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7ec0fe050 0x7ff7ec070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:35.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.330+0000 7ff7f1a4b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec072260 con 0x7ff7ec0fe050 2024-04-16T14:38:35.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.330+0000 7ff7f1a4b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec070850 con 0x7ff7ec0fce50 2024-04-16T14:38:35.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.330+0000 7ff7ea7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7ec0fe050 0x7ff7ec070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:35.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.330+0000 7ff7ea7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7ec0fe050 0x7ff7ec070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49520/0 (socket says 172.21.15.5:49520) 2024-04-16T14:38:35.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.330+0000 7ff7ea7fc700 1 -- 172.21.15.5:0/1015403804 learned_addr learned my addr 172.21.15.5:0/1015403804 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:38:35.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.330+0000 7ff7ea7fc700 1 -- 172.21.15.5:0/1015403804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7ec0fce50 msgr2=0x7ff7ec071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:35.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.330+0000 7ff7eaffd700 1 --2- 172.21.15.5:0/1015403804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7ec0fce50 0x7ff7ec071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:35.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.330+0000 7ff7ea7fc700 1 --2- 172.21.15.5:0/1015403804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7ec0fce50 0x7ff7ec071c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:35.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.330+0000 7ff7ea7fc700 1 -- 172.21.15.5:0/1015403804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7dc005040 con 0x7ff7ec0fe050 2024-04-16T14:38:35.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.330+0000 7ff7eaffd700 1 --2- 172.21.15.5:0/1015403804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7ec0fce50 0x7ff7ec071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:38:35.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.330+0000 7ff7ea7fc700 1 --2- 172.21.15.5:0/1015403804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7ec0fe050 0x7ff7ec070310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff7e000eb40 tx=0x7ff7e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:35.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.330+0000 7ff7d37fe700 1 -- 172.21.15.5:0/1015403804 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7e0007cc0 con 0x7ff7ec0fe050 2024-04-16T14:38:35.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.331+0000 7ff7d37fe700 1 -- 172.21.15.5:0/1015403804 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff7e000f040 con 0x7ff7ec0fe050 2024-04-16T14:38:35.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.331+0000 7ff7d37fe700 1 -- 172.21.15.5:0/1015403804 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7e0009620 con 0x7ff7ec0fe050 2024-04-16T14:38:35.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.331+0000 7ff7f1a4b700 1 -- 172.21.15.5:0/1015403804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7ec070aa0 con 0x7ff7ec0fe050 2024-04-16T14:38:35.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.331+0000 7ff7f1a4b700 1 -- 172.21.15.5:0/1015403804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7ec070fe0 con 0x7ff7ec0fe050 2024-04-16T14:38:35.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.332+0000 7ff7f1a4b700 1 -- 172.21.15.5:0/1015403804 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7ec04c710 con 0x7ff7ec0fe050 2024-04-16T14:38:35.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.332+0000 7ff7d37fe700 1 -- 172.21.15.5:0/1015403804 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 92303+0+0 (secure 0 0 0) 0x7ff7e0009780 con 0x7ff7ec0fe050 2024-04-16T14:38:35.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.333+0000 7ff7d37fe700 1 --2- 172.21.15.5:0/1015403804 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff7d406e270 0x7ff7d4070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:35.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.333+0000 7ff7d37fe700 1 -- 172.21.15.5:0/1015403804 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7ff7e008da60 con 0x7ff7ec0fe050 2024-04-16T14:38:35.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.333+0000 7ff7eaffd700 1 --2- 172.21.15.5:0/1015403804 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff7d406e270 0x7ff7d4070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:35.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.333+0000 7ff7eaffd700 1 --2- 172.21.15.5:0/1015403804 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff7d406e270 0x7ff7d4070720 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc013870 tx=0x7ff7dc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:35.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.338+0000 7ff7d37fe700 1 -- 172.21.15.5:0/1015403804 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7ff7e005a7a0 con 0x7ff7ec0fe050 2024-04-16T14:38:35.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.567+0000 7ff7f1a4b700 1 -- 172.21.15.5:0/1015403804 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7ec1022f0 con 0x7ff7d406e270 2024-04-16T14:38:35.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.568+0000 7ff7d37fe700 1 -- 172.21.15.5:0/1015403804 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff7ec1022f0 con 0x7ff7d406e270 2024-04-16T14:38:35.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.570+0000 7ff7f1a4b700 1 -- 172.21.15.5:0/1015403804 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff7d406e270 msgr2=0x7ff7d4070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.570+0000 7ff7f1a4b700 1 --2- 172.21.15.5:0/1015403804 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff7d406e270 0x7ff7d4070720 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc013870 tx=0x7ff7dc009e30 comp rx=0 tx=0).stop 2024-04-16T14:38:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.570+0000 7ff7f1a4b700 1 -- 172.21.15.5:0/1015403804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7ec0fe050 msgr2=0x7ff7ec070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.570+0000 7ff7f1a4b700 1 --2- 172.21.15.5:0/1015403804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7ec0fe050 0x7ff7ec070310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff7e000eb40 tx=0x7ff7e000b040 comp rx=0 tx=0).stop 2024-04-16T14:38:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.570+0000 7ff7f1a4b700 1 -- 172.21.15.5:0/1015403804 shutdown_connections 2024-04-16T14:38:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.570+0000 7ff7f1a4b700 1 --2- 172.21.15.5:0/1015403804 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff7d406e270 0x7ff7d4070720 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.570+0000 7ff7f1a4b700 1 --2- 172.21.15.5:0/1015403804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7ec0fce50 0x7ff7ec071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.570+0000 7ff7f1a4b700 1 --2- 172.21.15.5:0/1015403804 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7ec0fe050 0x7ff7ec070310 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.570+0000 7ff7f1a4b700 1 -- 172.21.15.5:0/1015403804 >> 172.21.15.5:0/1015403804 conn(0x7ff7ec0f8540 msgr2=0x7ff7ec0f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.570+0000 7ff7f1a4b700 1 -- 172.21.15.5:0/1015403804 shutdown_connections 2024-04-16T14:38:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.570+0000 7ff7f1a4b700 1 -- 172.21.15.5:0/1015403804 wait complete. 2024-04-16T14:38:35.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.683+0000 7ff044cd0700 1 -- 172.21.15.5:0/713376225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0400fcf00 msgr2=0x7ff0400fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:35.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.683+0000 7ff044cd0700 1 --2- 172.21.15.5:0/713376225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0400fcf00 0x7ff0400fd310 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff030004880 tx=0x7ff030009e30 comp rx=0 tx=0).stop 2024-04-16T14:38:35.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.683+0000 7ff044cd0700 1 -- 172.21.15.5:0/713376225 shutdown_connections 2024-04-16T14:38:35.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.683+0000 7ff044cd0700 1 --2- 172.21.15.5:0/713376225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0400fe070 0x7ff0400fe4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:35.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.683+0000 7ff044cd0700 1 --2- 172.21.15.5:0/713376225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0400fcf00 0x7ff0400fd310 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:35.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.683+0000 7ff044cd0700 1 -- 172.21.15.5:0/713376225 >> 172.21.15.5:0/713376225 conn(0x7ff0400f85e0 msgr2=0x7ff0400fa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:35.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.684+0000 7ff044cd0700 1 -- 172.21.15.5:0/713376225 shutdown_connections 2024-04-16T14:38:35.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.684+0000 7ff044cd0700 1 -- 172.21.15.5:0/713376225 wait complete. 2024-04-16T14:38:35.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.684+0000 7ff044cd0700 1 Processor -- start 2024-04-16T14:38:35.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.684+0000 7ff044cd0700 1 -- start start 2024-04-16T14:38:35.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.684+0000 7ff044cd0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0400fcf00 0x7ff04010b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:35.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.684+0000 7ff044cd0700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0400fe070 0x7ff04010bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:35.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.684+0000 7ff044cd0700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04010c380 con 0x7ff0400fcf00 2024-04-16T14:38:35.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.684+0000 7ff044cd0700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04010cbd0 con 0x7ff0400fe070 2024-04-16T14:38:35.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.685+0000 7ff03e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0400fcf00 0x7ff04010b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:35.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.685+0000 7ff03e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0400fcf00 0x7ff04010b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49550/0 (socket says 172.21.15.5:49550) 2024-04-16T14:38:35.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.685+0000 7ff03e59c700 1 -- 172.21.15.5:0/2353652413 learned_addr learned my addr 172.21.15.5:0/2353652413 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:38:35.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.685+0000 7ff03dd9b700 1 --2- 172.21.15.5:0/2353652413 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0400fe070 0x7ff04010bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:35.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.685+0000 7ff03e59c700 1 -- 172.21.15.5:0/2353652413 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0400fe070 msgr2=0x7ff04010bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:35.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.685+0000 7ff03e59c700 1 --2- 172.21.15.5:0/2353652413 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0400fe070 0x7ff04010bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:35.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.685+0000 7ff03e59c700 1 -- 172.21.15.5:0/2353652413 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff030005040 con 0x7ff0400fcf00 2024-04-16T14:38:35.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.685+0000 7ff03e59c700 1 --2- 172.21.15.5:0/2353652413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0400fcf00 0x7ff04010b840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff030008f80 tx=0x7ff030009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:35.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.685+0000 7ff02effd700 1 -- 172.21.15.5:0/2353652413 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff03001e070 con 0x7ff0400fcf00 2024-04-16T14:38:35.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.685+0000 7ff044cd0700 1 -- 172.21.15.5:0/2353652413 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff04010ce50 con 0x7ff0400fcf00 2024-04-16T14:38:35.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.685+0000 7ff02effd700 1 -- 172.21.15.5:0/2353652413 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff030009af0 con 0x7ff0400fcf00 2024-04-16T14:38:35.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.685+0000 7ff02effd700 1 -- 172.21.15.5:0/2353652413 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff030022410 con 0x7ff0400fcf00 2024-04-16T14:38:35.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.685+0000 7ff044cd0700 1 -- 172.21.15.5:0/2353652413 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff04010d330 con 0x7ff0400fcf00 2024-04-16T14:38:35.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.686+0000 7ff044cd0700 1 -- 172.21.15.5:0/2353652413 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff04005f5f0 con 0x7ff0400fcf00 2024-04-16T14:38:35.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.687+0000 7ff02effd700 1 -- 172.21.15.5:0/2353652413 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 92303+0+0 (secure 0 0 0) 0x7ff030016020 con 0x7ff0400fcf00 2024-04-16T14:38:35.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.687+0000 7ff02effd700 1 --2- 172.21.15.5:0/2353652413 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff02806e2b0 0x7ff028070760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:35.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.687+0000 7ff03dd9b700 1 --2- 172.21.15.5:0/2353652413 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff02806e2b0 0x7ff028070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:35.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.687+0000 7ff02effd700 1 -- 172.21.15.5:0/2353652413 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7ff030092d20 con 0x7ff0400fcf00 2024-04-16T14:38:35.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.688+0000 7ff03dd9b700 1 --2- 172.21.15.5:0/2353652413 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff02806e2b0 0x7ff028070760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff0340046c0 tx=0x7ff03400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:35.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.692+0000 7ff02effd700 1 -- 172.21.15.5:0/2353652413 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7ff03005fa20 con 0x7ff0400fcf00 2024-04-16T14:38:35.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.907+0000 7ff044cd0700 1 -- 172.21.15.5:0/2353652413 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff04010d6b0 con 0x7ff02806e2b0 2024-04-16T14:38:35.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.917+0000 7ff02effd700 1 -- 172.21.15.5:0/2353652413 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7ff04010d6b0 con 0x7ff02806e2b0 2024-04-16T14:38:35.916 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-16T14:38:35.916 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.smithi005 smithi005 *:9093,9094 running (2m) 7s ago 11m 26.0M - 0.25.0 c8568f914cd2 f8aaa22ee70c 2024-04-16T14:38:35.916 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi005 smithi005 running (18s) 7s ago 11m 6656k - 19.0.0-2204-g36befe5d b1a78730e0db d6efa08e65e3 2024-04-16T14:38:35.916 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi115 smithi115 running (12s) 8s ago 10m 6660k - 19.0.0-2204-g36befe5d b1a78730e0db b2a2f2965e2a 2024-04-16T14:38:35.916 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.smithi005 smithi005 *:3000 running (2m) 7s ago 10m 84.5M - 9.4.7 954c08fa6188 9834229a010c 2024-04-16T14:38:35.916 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.vzoqdl smithi005 running (5m) 7s ago 5m 13.1M - 17.2.7-868-g412a5526 b04d96489b7c 84a74a406a1d 2024-04-16T14:38:35.916 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.wofqlz smithi005 running (5m) 7s ago 5m 133M - 17.2.7-868-g412a5526 b04d96489b7c d0e053ab2f72 2024-04-16T14:38:35.916 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.byfytg smithi115 running (5m) 8s ago 5m 118M - 17.2.7-868-g412a5526 b04d96489b7c 595cd0892f66 2024-04-16T14:38:35.916 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.trkaqh smithi115 running (5m) 8s ago 5m 13.7M - 17.2.7-868-g412a5526 b04d96489b7c 5b60cd2ad79b 2024-04-16T14:38:35.916 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi005.ipwdkc smithi005 *:8443,9283,8765 running (2m) 7s ago 12m 495M - 19.0.0-2204-g36befe5d b1a78730e0db 451192b4fc44 2024-04-16T14:38:35.916 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi115.brjkpo smithi115 *:8443,9283,8765 running (98s) 8s ago 10m 448M - 19.0.0-2204-g36befe5d b1a78730e0db 0d75f8211942 2024-04-16T14:38:35.917 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi005 smithi005 running (81s) 7s ago 12m 39.5M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3d0c00924867 2024-04-16T14:38:35.917 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi115 smithi115 running (58s) 8s ago 10m 37.5M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3b916a4928b2 2024-04-16T14:38:35.917 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi005 smithi005 *:9100 running (3m) 7s ago 11m 16.7M - 1.5.0 0da6a335fe13 c09bba584a42 2024-04-16T14:38:35.917 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi115 smithi115 *:9100 running (2m) 8s ago 10m 16.7M - 1.5.0 0da6a335fe13 78cc9cc150c0 2024-04-16T14:38:35.917 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (9m) 7s ago 9m 211M 1559M 17.2.7-868-g412a5526 b04d96489b7c ed7aa0542d96 2024-04-16T14:38:35.917 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (8m) 7s ago 8m 241M 1559M 17.2.7-868-g412a5526 b04d96489b7c 1868cc6c89f4 2024-04-16T14:38:35.917 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (8m) 7s ago 8m 189M 1559M 17.2.7-868-g412a5526 b04d96489b7c b12745ae7d18 2024-04-16T14:38:35.917 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi115 running (8m) 8s ago 8m 271M 2581M 17.2.7-868-g412a5526 b04d96489b7c 59f81301ebcf 2024-04-16T14:38:35.917 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi115 running (7m) 8s ago 7m 242M 2581M 17.2.7-868-g412a5526 b04d96489b7c e3ea96b7edd9 2024-04-16T14:38:35.917 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi115 running (7m) 8s ago 7m 227M 2581M 17.2.7-868-g412a5526 b04d96489b7c 456fa074e453 2024-04-16T14:38:35.917 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.smithi005 smithi005 *:9095 running (104s) 7s ago 10m 46.5M - 2.43.0 a07b618ecd1d dc784e58817c 2024-04-16T14:38:35.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.920+0000 7ff044cd0700 1 -- 172.21.15.5:0/2353652413 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff02806e2b0 msgr2=0x7ff028070760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:35.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.920+0000 7ff044cd0700 1 --2- 172.21.15.5:0/2353652413 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff02806e2b0 0x7ff028070760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff0340046c0 tx=0x7ff03400b040 comp rx=0 tx=0).stop 2024-04-16T14:38:35.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.920+0000 7ff044cd0700 1 -- 172.21.15.5:0/2353652413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0400fcf00 msgr2=0x7ff04010b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:35.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.920+0000 7ff044cd0700 1 --2- 172.21.15.5:0/2353652413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0400fcf00 0x7ff04010b840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff030008f80 tx=0x7ff030009e30 comp rx=0 tx=0).stop 2024-04-16T14:38:35.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.920+0000 7ff044cd0700 1 -- 172.21.15.5:0/2353652413 shutdown_connections 2024-04-16T14:38:35.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.920+0000 7ff044cd0700 1 --2- 172.21.15.5:0/2353652413 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff02806e2b0 0x7ff028070760 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:35.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.920+0000 7ff044cd0700 1 --2- 172.21.15.5:0/2353652413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0400fcf00 0x7ff04010b840 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:35.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.920+0000 7ff044cd0700 1 --2- 172.21.15.5:0/2353652413 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0400fe070 0x7ff04010bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:35.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.920+0000 7ff044cd0700 1 -- 172.21.15.5:0/2353652413 >> 172.21.15.5:0/2353652413 conn(0x7ff0400f85e0 msgr2=0x7ff0400f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:35.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.920+0000 7ff044cd0700 1 -- 172.21.15.5:0/2353652413 shutdown_connections 2024-04-16T14:38:35.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:35.920+0000 7ff044cd0700 1 -- 172.21.15.5:0/2353652413 wait complete. 2024-04-16T14:38:36.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.028+0000 7ff7bd666700 1 -- 172.21.15.5:0/2829011201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7b80fcf00 msgr2=0x7ff7b80fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:36.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.028+0000 7ff7bd666700 1 --2- 172.21.15.5:0/2829011201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7b80fcf00 0x7ff7b80fd310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8009ce0 tx=0x7ff7a8004d10 comp rx=0 tx=0).stop 2024-04-16T14:38:36.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.028+0000 7ff7bd666700 1 -- 172.21.15.5:0/2829011201 shutdown_connections 2024-04-16T14:38:36.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.028+0000 7ff7bd666700 1 --2- 172.21.15.5:0/2829011201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7b80fe070 0x7ff7b80fe4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:36.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.028+0000 7ff7bd666700 1 --2- 172.21.15.5:0/2829011201 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7b80fcf00 0x7ff7b80fd310 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:36.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.028+0000 7ff7bd666700 1 -- 172.21.15.5:0/2829011201 >> 172.21.15.5:0/2829011201 conn(0x7ff7b80f85e0 msgr2=0x7ff7b80fa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:36.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.028+0000 7ff7bd666700 1 -- 172.21.15.5:0/2829011201 shutdown_connections 2024-04-16T14:38:36.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.028+0000 7ff7bd666700 1 -- 172.21.15.5:0/2829011201 wait complete. 2024-04-16T14:38:36.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.029+0000 7ff7bd666700 1 Processor -- start 2024-04-16T14:38:36.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.029+0000 7ff7bd666700 1 -- start start 2024-04-16T14:38:36.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.029+0000 7ff7bd666700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7b80fcf00 0x7ff7b810db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:36.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.029+0000 7ff7bd666700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7b80fe070 0x7ff7b810e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:36.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.029+0000 7ff7bd666700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b810e750 con 0x7ff7b80fe070 2024-04-16T14:38:36.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.029+0000 7ff7bd666700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b810ef40 con 0x7ff7b80fcf00 2024-04-16T14:38:36.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.029+0000 7ff7b67fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7b80fe070 0x7ff7b810e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:36.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.029+0000 7ff7b67fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7b80fe070 0x7ff7b810e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49574/0 (socket says 172.21.15.5:49574) 2024-04-16T14:38:36.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.029+0000 7ff7b67fc700 1 -- 172.21.15.5:0/2801206378 learned_addr learned my addr 172.21.15.5:0/2801206378 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:38:36.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.029+0000 7ff7b6ffd700 1 --2- 172.21.15.5:0/2801206378 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7b80fcf00 0x7ff7b810db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:36.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.029+0000 7ff7b67fc700 1 -- 172.21.15.5:0/2801206378 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7b80fcf00 msgr2=0x7ff7b810db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:36.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.029+0000 7ff7b67fc700 1 --2- 172.21.15.5:0/2801206378 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7b80fcf00 0x7ff7b810db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:36.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.029+0000 7ff7b67fc700 1 -- 172.21.15.5:0/2801206378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a8009940 con 0x7ff7b80fe070 2024-04-16T14:38:36.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.029+0000 7ff7b67fc700 1 --2- 172.21.15.5:0/2801206378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7b80fe070 0x7ff7b810e0c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff7a000b790 tx=0x7ff7a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:36.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.030+0000 7ff7af7fe700 1 -- 172.21.15.5:0/2801206378 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7a000f770 con 0x7ff7b80fe070 2024-04-16T14:38:36.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.030+0000 7ff7bd666700 1 -- 172.21.15.5:0/2801206378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b810f220 con 0x7ff7b80fe070 2024-04-16T14:38:36.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.030+0000 7ff7af7fe700 1 -- 172.21.15.5:0/2801206378 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff7a000fda0 con 0x7ff7b80fe070 2024-04-16T14:38:36.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.030+0000 7ff7af7fe700 1 -- 172.21.15.5:0/2801206378 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7a000d310 con 0x7ff7b80fe070 2024-04-16T14:38:36.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.030+0000 7ff7bd666700 1 -- 172.21.15.5:0/2801206378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b810f7e0 con 0x7ff7b80fe070 2024-04-16T14:38:36.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.031+0000 7ff7bd666700 1 -- 172.21.15.5:0/2801206378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b805f5f0 con 0x7ff7b80fe070 2024-04-16T14:38:36.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.031+0000 7ff7af7fe700 1 -- 172.21.15.5:0/2801206378 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 92303+0+0 (secure 0 0 0) 0x7ff7a0010420 con 0x7ff7b80fe070 2024-04-16T14:38:36.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.032+0000 7ff7af7fe700 1 --2- 172.21.15.5:0/2801206378 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff7a406e260 0x7ff7a4070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:36.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.032+0000 7ff7af7fe700 1 -- 172.21.15.5:0/2801206378 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7ff7a008dcb0 con 0x7ff7b80fe070 2024-04-16T14:38:36.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.032+0000 7ff7b6ffd700 1 --2- 172.21.15.5:0/2801206378 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff7a406e260 0x7ff7a4070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:36.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.032+0000 7ff7b6ffd700 1 --2- 172.21.15.5:0/2801206378 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff7a406e260 0x7ff7a4070710 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff7a80095a0 tx=0x7ff7a8004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:36.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.036+0000 7ff7af7fe700 1 -- 172.21.15.5:0/2801206378 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7ff7a005aad0 con 0x7ff7b80fe070 2024-04-16T14:38:36.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.337+0000 7ff7bd666700 1 -- 172.21.15.5:0/2801206378 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff7b8105970 con 0x7ff7b80fe070 2024-04-16T14:38:36.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.338+0000 7ff7af7fe700 1 -- 172.21.15.5:0/2801206378 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7ff7a005a660 con 0x7ff7b80fe070 2024-04-16T14:38:36.337 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:38:36.337 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-04-16T14:38:36.337 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:38:36.337 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:38:36.337 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-04-16T14:38:36.337 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:38:36.337 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:38:36.337 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-04-16T14:38:36.338 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 6 2024-04-16T14:38:36.338 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:38:36.338 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-04-16T14:38:36.338 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 4 2024-04-16T14:38:36.338 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:38:36.338 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-04-16T14:38:36.338 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 10, 2024-04-16T14:38:36.338 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 4 2024-04-16T14:38:36.338 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-16T14:38:36.338 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:38:36.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.340+0000 7ff7bd666700 1 -- 172.21.15.5:0/2801206378 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff7a406e260 msgr2=0x7ff7a4070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:36.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.340+0000 7ff7bd666700 1 --2- 172.21.15.5:0/2801206378 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff7a406e260 0x7ff7a4070710 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff7a80095a0 tx=0x7ff7a8004d10 comp rx=0 tx=0).stop 2024-04-16T14:38:36.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.340+0000 7ff7bd666700 1 -- 172.21.15.5:0/2801206378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7b80fe070 msgr2=0x7ff7b810e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:36.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.340+0000 7ff7bd666700 1 --2- 172.21.15.5:0/2801206378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7b80fe070 0x7ff7b810e0c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff7a000b790 tx=0x7ff7a0009250 comp rx=0 tx=0).stop 2024-04-16T14:38:36.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.340+0000 7ff7bd666700 1 -- 172.21.15.5:0/2801206378 shutdown_connections 2024-04-16T14:38:36.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.340+0000 7ff7bd666700 1 --2- 172.21.15.5:0/2801206378 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff7a406e260 0x7ff7a4070710 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:36.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.340+0000 7ff7bd666700 1 --2- 172.21.15.5:0/2801206378 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7b80fcf00 0x7ff7b810db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:36.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.340+0000 7ff7bd666700 1 --2- 172.21.15.5:0/2801206378 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff7b80fe070 0x7ff7b810e0c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:36.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.340+0000 7ff7bd666700 1 -- 172.21.15.5:0/2801206378 >> 172.21.15.5:0/2801206378 conn(0x7ff7b80f85e0 msgr2=0x7ff7b80f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:36.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.340+0000 7ff7bd666700 1 -- 172.21.15.5:0/2801206378 shutdown_connections 2024-04-16T14:38:36.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.340+0000 7ff7bd666700 1 -- 172.21.15.5:0/2801206378 wait complete. 2024-04-16T14:38:36.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:36 smithi115 ceph-mon[83414]: Upgrade: Updating osd.0 2024-04-16T14:38:36.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:36 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:36.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:36 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-16T14:38:36.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:36 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:38:36.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:36 smithi115 ceph-mon[83414]: Deploying daemon osd.0 on smithi005 2024-04-16T14:38:36.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:36 smithi115 ceph-mon[83414]: pgmap v39: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:36.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:36 smithi115 ceph-mon[83414]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:38:36.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:36 smithi115 ceph-mon[83414]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:38:36.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:36 smithi115 ceph-mon[83414]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:38:36.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.447+0000 7f8b65ca5700 1 -- 172.21.15.5:0/577582295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b600fbd40 msgr2=0x7f8b600fc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:36.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.447+0000 7f8b65ca5700 1 --2- 172.21.15.5:0/577582295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b600fbd40 0x7f8b600fc150 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8b50004940 tx=0x7f8b50009e30 comp rx=0 tx=0).stop 2024-04-16T14:38:36.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.447+0000 7f8b65ca5700 1 -- 172.21.15.5:0/577582295 shutdown_connections 2024-04-16T14:38:36.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.447+0000 7f8b65ca5700 1 --2- 172.21.15.5:0/577582295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b600fcff0 0x7f8b600fd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:36.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.447+0000 7f8b65ca5700 1 --2- 172.21.15.5:0/577582295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b600fbd40 0x7f8b600fc150 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:36.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.447+0000 7f8b65ca5700 1 -- 172.21.15.5:0/577582295 >> 172.21.15.5:0/577582295 conn(0x7f8b600f74c0 msgr2=0x7f8b600f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:36.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.447+0000 7f8b65ca5700 1 -- 172.21.15.5:0/577582295 shutdown_connections 2024-04-16T14:38:36.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.447+0000 7f8b65ca5700 1 -- 172.21.15.5:0/577582295 wait complete. 2024-04-16T14:38:36.446 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:36 smithi005 ceph-mon[93420]: Upgrade: Updating osd.0 2024-04-16T14:38:36.446 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:36 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:36.447 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:36 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-16T14:38:36.447 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:36 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:38:36.447 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:36 smithi005 ceph-mon[93420]: Deploying daemon osd.0 on smithi005 2024-04-16T14:38:36.447 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:36 smithi005 ceph-mon[93420]: pgmap v39: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:36.447 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:36 smithi005 ceph-mon[93420]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:38:36.447 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:36 smithi005 ceph-mon[93420]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:38:36.447 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:36 smithi005 ceph-mon[93420]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:38:36.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.448+0000 7f8b65ca5700 1 Processor -- start 2024-04-16T14:38:36.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.448+0000 7f8b65ca5700 1 -- start start 2024-04-16T14:38:36.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.448+0000 7f8b65ca5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b600fbd40 0x7f8b6010fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:36.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.448+0000 7f8b65ca5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b600fcff0 0x7f8b601101f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:36.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.448+0000 7f8b65ca5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60110880 con 0x7f8b600fcff0 2024-04-16T14:38:36.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.448+0000 7f8b65ca5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60111020 con 0x7f8b600fbd40 2024-04-16T14:38:36.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.448+0000 7f8b5effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b600fcff0 0x7f8b601101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:36.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.448+0000 7f8b5effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b600fcff0 0x7f8b601101f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49584/0 (socket says 172.21.15.5:49584) 2024-04-16T14:38:36.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.448+0000 7f8b5effd700 1 -- 172.21.15.5:0/2903433127 learned_addr learned my addr 172.21.15.5:0/2903433127 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:38:36.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.448+0000 7f8b5f7fe700 1 --2- 172.21.15.5:0/2903433127 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b600fbd40 0x7f8b6010fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:36.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.448+0000 7f8b5effd700 1 -- 172.21.15.5:0/2903433127 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b600fbd40 msgr2=0x7f8b6010fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:36.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.448+0000 7f8b5effd700 1 --2- 172.21.15.5:0/2903433127 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b600fbd40 0x7f8b6010fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:36.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.448+0000 7f8b5effd700 1 -- 172.21.15.5:0/2903433127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b50005040 con 0x7f8b600fcff0 2024-04-16T14:38:36.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.449+0000 7f8b5effd700 1 --2- 172.21.15.5:0/2903433127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b600fcff0 0x7f8b601101f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400b790 tx=0x7f8b54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:36.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.449+0000 7f8b47fff700 1 -- 172.21.15.5:0/2903433127 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b5400f6f0 con 0x7f8b600fcff0 2024-04-16T14:38:36.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.449+0000 7f8b47fff700 1 -- 172.21.15.5:0/2903433127 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b5400fd20 con 0x7f8b600fcff0 2024-04-16T14:38:36.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.449+0000 7f8b65ca5700 1 -- 172.21.15.5:0/2903433127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b60111300 con 0x7f8b600fcff0 2024-04-16T14:38:36.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.449+0000 7f8b47fff700 1 -- 172.21.15.5:0/2903433127 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b540103a0 con 0x7f8b600fcff0 2024-04-16T14:38:36.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.449+0000 7f8b65ca5700 1 -- 172.21.15.5:0/2903433127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b601118c0 con 0x7f8b600fcff0 2024-04-16T14:38:36.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.450+0000 7f8b47fff700 1 -- 172.21.15.5:0/2903433127 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 92303+0+0 (secure 0 0 0) 0x7f8b54011400 con 0x7f8b600fcff0 2024-04-16T14:38:36.450 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.450+0000 7f8b65ca5700 1 -- 172.21.15.5:0/2903433127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b60101980 con 0x7f8b600fcff0 2024-04-16T14:38:36.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.451+0000 7f8b47fff700 1 --2- 172.21.15.5:0/2903433127 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f8b4806e260 0x7f8b48070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:36.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.451+0000 7f8b47fff700 1 -- 172.21.15.5:0/2903433127 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f8b5408da80 con 0x7f8b600fcff0 2024-04-16T14:38:36.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.451+0000 7f8b5f7fe700 1 --2- 172.21.15.5:0/2903433127 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f8b4806e260 0x7f8b48070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:36.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.452+0000 7f8b5f7fe700 1 --2- 172.21.15.5:0/2903433127 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f8b4806e260 0x7f8b48070710 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000b970 tx=0x7f8b50009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:36.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.455+0000 7f8b47fff700 1 -- 172.21.15.5:0/2903433127 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f8b5405a8a0 con 0x7f8b600fcff0 2024-04-16T14:38:36.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.710+0000 7f8b65ca5700 1 -- 172.21.15.5:0/2903433127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8b6005f5f0 con 0x7f8b600fcff0 2024-04-16T14:38:36.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.710+0000 7f8b47fff700 1 -- 172.21.15.5:0/2903433127 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1916 (secure 0 0 0) 0x7f8b5405a430 con 0x7f8b600fcff0 2024-04-16T14:38:36.712 INFO:teuthology.orchestra.run.smithi005.stdout:e20 2024-04-16T14:38:36.712 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:38:36.712 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:38:36.713 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2024-04-16T14:38:36.713 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:38:36.713 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2024-04-16T14:38:36.713 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2024-04-16T14:38:36.713 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 20 2024-04-16T14:38:36.713 INFO:teuthology.orchestra.run.smithi005.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-16T14:38:36.713 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-16T14:32:45.270024+0000 2024-04-16T14:38:36.713 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-04-16T14:35:42.742829+0000 2024-04-16T14:38:36.714 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2024-04-16T14:38:36.714 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2024-04-16T14:38:36.714 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 60 2024-04-16T14:38:36.714 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2024-04-16T14:38:36.714 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2024-04-16T14:38:36.714 INFO:teuthology.orchestra.run.smithi005.stdout:max_xattr_size 65536 2024-04-16T14:38:36.714 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2024-04-16T14:38:36.714 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2024-04-16T14:38:36.715 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 47 2024-04-16T14:38:36.715 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:38:36.715 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 2 2024-04-16T14:38:36.715 INFO:teuthology.orchestra.run.smithi005.stdout:in 0,1 2024-04-16T14:38:36.715 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=14484,1=24269} 2024-04-16T14:38:36.715 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2024-04-16T14:38:36.715 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2024-04-16T14:38:36.716 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 2024-04-16T14:38:36.716 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3] 2024-04-16T14:38:36.716 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2024-04-16T14:38:36.716 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2024-04-16T14:38:36.716 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2024-04-16T14:38:36.716 INFO:teuthology.orchestra.run.smithi005.stdout:bal_rank_mask -1 2024-04-16T14:38:36.716 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 1 2024-04-16T14:38:36.716 INFO:teuthology.orchestra.run.smithi005.stdout:qdb_cluster leader: 0 members: 2024-04-16T14:38:36.717 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.wofqlz{0:14484} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:38:36.717 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.byfytg{1:24269} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.115:6824/1662994117,v1:172.21.15.115:6825/1662994117] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:38:36.717 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:38:36.717 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:38:36.717 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2024-04-16T14:38:36.717 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:38:36.717 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.vzoqdl{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.5:6826/187766809,v1:172.21.15.5:6827/187766809] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:38:36.717 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.trkaqh{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:38:36.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.712+0000 7f8b65ca5700 1 -- 172.21.15.5:0/2903433127 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f8b4806e260 msgr2=0x7f8b48070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:36.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.712+0000 7f8b65ca5700 1 --2- 172.21.15.5:0/2903433127 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f8b4806e260 0x7f8b48070710 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000b970 tx=0x7f8b50009e30 comp rx=0 tx=0).stop 2024-04-16T14:38:36.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.712+0000 7f8b65ca5700 1 -- 172.21.15.5:0/2903433127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b600fcff0 msgr2=0x7f8b601101f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:36.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.712+0000 7f8b65ca5700 1 --2- 172.21.15.5:0/2903433127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b600fcff0 0x7f8b601101f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400b790 tx=0x7f8b54009250 comp rx=0 tx=0).stop 2024-04-16T14:38:36.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.712+0000 7f8b65ca5700 1 -- 172.21.15.5:0/2903433127 shutdown_connections 2024-04-16T14:38:36.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.712+0000 7f8b65ca5700 1 --2- 172.21.15.5:0/2903433127 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f8b4806e260 0x7f8b48070710 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:36.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.712+0000 7f8b65ca5700 1 --2- 172.21.15.5:0/2903433127 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b600fbd40 0x7f8b6010fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:36.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.712+0000 7f8b65ca5700 1 --2- 172.21.15.5:0/2903433127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8b600fcff0 0x7f8b601101f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:36.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.712+0000 7f8b65ca5700 1 -- 172.21.15.5:0/2903433127 >> 172.21.15.5:0/2903433127 conn(0x7f8b600f74c0 msgr2=0x7f8b60065bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:36.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.713+0000 7f8b65ca5700 1 -- 172.21.15.5:0/2903433127 shutdown_connections 2024-04-16T14:38:36.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.713+0000 7f8b65ca5700 1 -- 172.21.15.5:0/2903433127 wait complete. 2024-04-16T14:38:36.720 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 20 2024-04-16T14:38:36.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.818+0000 7fa1a0b16700 1 -- 172.21.15.5:0/1827108506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa19c0fff50 msgr2=0x7fa19c102370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:36.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.818+0000 7fa1a0b16700 1 --2- 172.21.15.5:0/1827108506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa19c0fff50 0x7fa19c102370 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa184004940 tx=0x7fa184009e30 comp rx=0 tx=0).stop 2024-04-16T14:38:36.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.818+0000 7fa1a0b16700 1 -- 172.21.15.5:0/1827108506 shutdown_connections 2024-04-16T14:38:36.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.818+0000 7fa1a0b16700 1 --2- 172.21.15.5:0/1827108506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa19c0fff50 0x7fa19c102370 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:36.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.818+0000 7fa1a0b16700 1 --2- 172.21.15.5:0/1827108506 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa19c066f60 0x7fa19c0ffa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:36.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.818+0000 7fa1a0b16700 1 -- 172.21.15.5:0/1827108506 >> 172.21.15.5:0/1827108506 conn(0x7fa19c0f7480 msgr2=0x7fa19c0f98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:36.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.818+0000 7fa1a0b16700 1 -- 172.21.15.5:0/1827108506 shutdown_connections 2024-04-16T14:38:36.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.818+0000 7fa1a0b16700 1 -- 172.21.15.5:0/1827108506 wait complete. 2024-04-16T14:38:36.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.818+0000 7fa1a0b16700 1 Processor -- start 2024-04-16T14:38:36.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.818+0000 7fa1a0b16700 1 -- start start 2024-04-16T14:38:36.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.819+0000 7fa1a0b16700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa19c066f60 0x7fa19c10dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:36.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.819+0000 7fa1a0b16700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa19c0fff50 0x7fa19c10e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:36.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.819+0000 7fa1a0b16700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c10e820 con 0x7fa19c066f60 2024-04-16T14:38:36.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.819+0000 7fa1a0b16700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c1131c0 con 0x7fa19c0fff50 2024-04-16T14:38:36.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.819+0000 7fa19a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa19c066f60 0x7fa19c10dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:36.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.819+0000 7fa19a59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa19c066f60 0x7fa19c10dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49604/0 (socket says 172.21.15.5:49604) 2024-04-16T14:38:36.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.819+0000 7fa19a59c700 1 -- 172.21.15.5:0/3925135969 learned_addr learned my addr 172.21.15.5:0/3925135969 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:38:36.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.819+0000 7fa199d9b700 1 --2- 172.21.15.5:0/3925135969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa19c0fff50 0x7fa19c10e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:36.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.819+0000 7fa19a59c700 1 -- 172.21.15.5:0/3925135969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa19c0fff50 msgr2=0x7fa19c10e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:36.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.819+0000 7fa19a59c700 1 --2- 172.21.15.5:0/3925135969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa19c0fff50 0x7fa19c10e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:36.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.819+0000 7fa19a59c700 1 -- 172.21.15.5:0/3925135969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa184005040 con 0x7fa19c066f60 2024-04-16T14:38:36.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.819+0000 7fa199d9b700 1 --2- 172.21.15.5:0/3925135969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa19c0fff50 0x7fa19c10e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:38:36.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.819+0000 7fa19a59c700 1 --2- 172.21.15.5:0/3925135969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa19c066f60 0x7fa19c10dc90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa18c00cb90 tx=0x7fa18c007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:36.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.819+0000 7fa192ffd700 1 -- 172.21.15.5:0/3925135969 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa18c00a9f0 con 0x7fa19c066f60 2024-04-16T14:38:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.819+0000 7fa192ffd700 1 -- 172.21.15.5:0/3925135969 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa18c00ab50 con 0x7fa19c066f60 2024-04-16T14:38:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.819+0000 7fa1a0b16700 1 -- 172.21.15.5:0/3925135969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19c113360 con 0x7fa19c066f60 2024-04-16T14:38:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.819+0000 7fa192ffd700 1 -- 172.21.15.5:0/3925135969 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa18c011620 con 0x7fa19c066f60 2024-04-16T14:38:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.820+0000 7fa1a0b16700 1 -- 172.21.15.5:0/3925135969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19c113920 con 0x7fa19c066f60 2024-04-16T14:38:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.821+0000 7fa1a0b16700 1 -- 172.21.15.5:0/3925135969 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa19c04c710 con 0x7fa19c066f60 2024-04-16T14:38:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.821+0000 7fa192ffd700 1 -- 172.21.15.5:0/3925135969 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 92303+0+0 (secure 0 0 0) 0x7fa18c00acc0 con 0x7fa19c066f60 2024-04-16T14:38:36.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.822+0000 7fa192ffd700 1 --2- 172.21.15.5:0/3925135969 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa18806e270 0x7fa188070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:36.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.822+0000 7fa192ffd700 1 -- 172.21.15.5:0/3925135969 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fa18c08e3b0 con 0x7fa19c066f60 2024-04-16T14:38:36.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.822+0000 7fa199d9b700 1 --2- 172.21.15.5:0/3925135969 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa18806e270 0x7fa188070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:36.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.822+0000 7fa199d9b700 1 --2- 172.21.15.5:0/3925135969 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa18806e270 0x7fa188070720 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa18400b7a0 tx=0x7fa184009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:36.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:36.826+0000 7fa192ffd700 1 -- 172.21.15.5:0/3925135969 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fa18c0576a0 con 0x7fa19c066f60 2024-04-16T14:38:37.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.056+0000 7fa1a0b16700 1 -- 172.21.15.5:0/3925135969 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa19c101ba0 con 0x7fa18806e270 2024-04-16T14:38:37.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.057+0000 7fa192ffd700 1 -- 172.21.15.5:0/3925135969 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa19c101ba0 con 0x7fa18806e270 2024-04-16T14:38:37.055 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:38:37.055 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91", 2024-04-16T14:38:37.056 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-04-16T14:38:37.056 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-16T14:38:37.056 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [ 2024-04-16T14:38:37.056 INFO:teuthology.orchestra.run.smithi005.stdout: "mon", 2024-04-16T14:38:37.056 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr", 2024-04-16T14:38:37.056 INFO:teuthology.orchestra.run.smithi005.stdout: "crash" 2024-04-16T14:38:37.056 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-04-16T14:38:37.056 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "6/21 daemons upgraded", 2024-04-16T14:38:37.056 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading osd daemons", 2024-04-16T14:38:37.056 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-04-16T14:38:37.056 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:38:37.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.059+0000 7fa1a0b16700 1 -- 172.21.15.5:0/3925135969 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa18806e270 msgr2=0x7fa188070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:37.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.059+0000 7fa1a0b16700 1 --2- 172.21.15.5:0/3925135969 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa18806e270 0x7fa188070720 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa18400b7a0 tx=0x7fa184009e30 comp rx=0 tx=0).stop 2024-04-16T14:38:37.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.059+0000 7fa1a0b16700 1 -- 172.21.15.5:0/3925135969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa19c066f60 msgr2=0x7fa19c10dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:37.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.059+0000 7fa1a0b16700 1 --2- 172.21.15.5:0/3925135969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa19c066f60 0x7fa19c10dc90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa18c00cb90 tx=0x7fa18c007eb0 comp rx=0 tx=0).stop 2024-04-16T14:38:37.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.059+0000 7fa1a0b16700 1 -- 172.21.15.5:0/3925135969 shutdown_connections 2024-04-16T14:38:37.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.059+0000 7fa1a0b16700 1 --2- 172.21.15.5:0/3925135969 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa18806e270 0x7fa188070720 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:37.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.059+0000 7fa1a0b16700 1 --2- 172.21.15.5:0/3925135969 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa19c066f60 0x7fa19c10dc90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:37.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.059+0000 7fa1a0b16700 1 --2- 172.21.15.5:0/3925135969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa19c0fff50 0x7fa19c10e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:37.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.059+0000 7fa1a0b16700 1 -- 172.21.15.5:0/3925135969 >> 172.21.15.5:0/3925135969 conn(0x7fa19c0f7480 msgr2=0x7fa19c0f98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:37.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.060+0000 7fa1a0b16700 1 -- 172.21.15.5:0/3925135969 shutdown_connections 2024-04-16T14:38:37.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.060+0000 7fa1a0b16700 1 -- 172.21.15.5:0/3925135969 wait complete. 2024-04-16T14:38:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.162+0000 7eff10d8d700 1 -- 172.21.15.5:0/3918404885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff0c0fc740 msgr2=0x7eff0c0fcbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.162+0000 7eff10d8d700 1 --2- 172.21.15.5:0/3918404885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff0c0fc740 0x7eff0c0fcbb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efef4004a50 tx=0x7efef400af40 comp rx=0 tx=0).stop 2024-04-16T14:38:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.162+0000 7eff10d8d700 1 -- 172.21.15.5:0/3918404885 shutdown_connections 2024-04-16T14:38:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.162+0000 7eff10d8d700 1 --2- 172.21.15.5:0/3918404885 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff0c0fc740 0x7eff0c0fcbb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.162+0000 7eff10d8d700 1 --2- 172.21.15.5:0/3918404885 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff0c0fb490 0x7eff0c0fb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.162+0000 7eff10d8d700 1 -- 172.21.15.5:0/3918404885 >> 172.21.15.5:0/3918404885 conn(0x7eff0c0f6bf0 msgr2=0x7eff0c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.162+0000 7eff10d8d700 1 -- 172.21.15.5:0/3918404885 shutdown_connections 2024-04-16T14:38:37.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.162+0000 7eff10d8d700 1 -- 172.21.15.5:0/3918404885 wait complete. 2024-04-16T14:38:37.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.163+0000 7eff10d8d700 1 Processor -- start 2024-04-16T14:38:37.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.163+0000 7eff10d8d700 1 -- start start 2024-04-16T14:38:37.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.163+0000 7eff10d8d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff0c0fb490 0x7eff0c10d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:37.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.163+0000 7eff10d8d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff0c0fc740 0x7eff0c10de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:37.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.163+0000 7eff10d8d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c10e470 con 0x7eff0c0fc740 2024-04-16T14:38:37.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.163+0000 7eff10d8d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c10e5e0 con 0x7eff0c0fb490 2024-04-16T14:38:37.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.163+0000 7eff01d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff0c0fc740 0x7eff0c10de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.163+0000 7eff01d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff0c0fc740 0x7eff0c10de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49630/0 (socket says 172.21.15.5:49630) 2024-04-16T14:38:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.163+0000 7eff01d9b700 1 -- 172.21.15.5:0/760641199 learned_addr learned my addr 172.21.15.5:0/760641199 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:38:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.163+0000 7eff0a59c700 1 --2- 172.21.15.5:0/760641199 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff0c0fb490 0x7eff0c10d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.163+0000 7eff01d9b700 1 -- 172.21.15.5:0/760641199 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff0c0fb490 msgr2=0x7eff0c10d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.163+0000 7eff01d9b700 1 --2- 172.21.15.5:0/760641199 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff0c0fb490 0x7eff0c10d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.164+0000 7eff01d9b700 1 -- 172.21.15.5:0/760641199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef4005040 con 0x7eff0c0fc740 2024-04-16T14:38:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.164+0000 7eff01d9b700 1 --2- 172.21.15.5:0/760641199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff0c0fc740 0x7eff0c10de70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efef40043d0 tx=0x7efef400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.164+0000 7eff037fe700 1 -- 172.21.15.5:0/760641199 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efef400f050 con 0x7eff0c0fc740 2024-04-16T14:38:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.164+0000 7eff037fe700 1 -- 172.21.15.5:0/760641199 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efef400ca30 con 0x7eff0c0fc740 2024-04-16T14:38:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.164+0000 7eff10d8d700 1 -- 172.21.15.5:0/760641199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff0c112fe0 con 0x7eff0c0fc740 2024-04-16T14:38:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.164+0000 7eff037fe700 1 -- 172.21.15.5:0/760641199 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efef4014950 con 0x7eff0c0fc740 2024-04-16T14:38:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.164+0000 7eff10d8d700 1 -- 172.21.15.5:0/760641199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0c113460 con 0x7eff0c0fc740 2024-04-16T14:38:37.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.165+0000 7eff10d8d700 1 -- 172.21.15.5:0/760641199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff0c04c710 con 0x7eff0c0fc740 2024-04-16T14:38:37.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.166+0000 7eff037fe700 1 -- 172.21.15.5:0/760641199 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 37) v1 ==== 92303+0+0 (secure 0 0 0) 0x7efef4014c10 con 0x7eff0c0fc740 2024-04-16T14:38:37.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.166+0000 7eff037fe700 1 --2- 172.21.15.5:0/760641199 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7efef806e270 0x7efef8070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:38:37.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.166+0000 7eff037fe700 1 -- 172.21.15.5:0/760641199 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6410+0+0 (secure 0 0 0) 0x7efef408fae0 con 0x7eff0c0fc740 2024-04-16T14:38:37.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.166+0000 7eff0a59c700 1 --2- 172.21.15.5:0/760641199 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7efef806e270 0x7efef8070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:38:37.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.167+0000 7eff0a59c700 1 --2- 172.21.15.5:0/760641199 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7efef806e270 0x7efef8070720 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efefc007fd0 tx=0x7efefc009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:38:37.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.171+0000 7eff037fe700 1 -- 172.21.15.5:0/760641199 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7efef405c7f0 con 0x7eff0c0fc740 2024-04-16T14:38:37.315 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:37 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/2801206378' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:38:37.315 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:37 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/2903433127' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:38:37.315 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:37 smithi005 ceph-mon[93420]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:38:37.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:37 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/2801206378' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:38:37.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:37 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/2903433127' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:38:37.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:37 smithi115 ceph-mon[83414]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:38:37.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.473+0000 7eff10d8d700 1 -- 172.21.15.5:0/760641199 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7eff0c1036f0 con 0x7eff0c0fc740 2024-04-16T14:38:37.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.473+0000 7eff037fe700 1 -- 172.21.15.5:0/760641199 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7efef405c380 con 0x7eff0c0fc740 2024-04-16T14:38:37.472 INFO:teuthology.orchestra.run.smithi005.stdout:HEALTH_OK 2024-04-16T14:38:37.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.475+0000 7eff10d8d700 1 -- 172.21.15.5:0/760641199 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7efef806e270 msgr2=0x7efef8070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:37.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.475+0000 7eff10d8d700 1 --2- 172.21.15.5:0/760641199 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7efef806e270 0x7efef8070720 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efefc007fd0 tx=0x7efefc009040 comp rx=0 tx=0).stop 2024-04-16T14:38:37.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.475+0000 7eff10d8d700 1 -- 172.21.15.5:0/760641199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff0c0fc740 msgr2=0x7eff0c10de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:38:37.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.475+0000 7eff10d8d700 1 --2- 172.21.15.5:0/760641199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff0c0fc740 0x7eff0c10de70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efef40043d0 tx=0x7efef400af40 comp rx=0 tx=0).stop 2024-04-16T14:38:37.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.475+0000 7eff10d8d700 1 -- 172.21.15.5:0/760641199 shutdown_connections 2024-04-16T14:38:37.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.475+0000 7eff10d8d700 1 --2- 172.21.15.5:0/760641199 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7efef806e270 0x7efef8070720 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:37.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.475+0000 7eff10d8d700 1 --2- 172.21.15.5:0/760641199 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff0c0fb490 0x7eff0c10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:37.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.475+0000 7eff10d8d700 1 --2- 172.21.15.5:0/760641199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7eff0c0fc740 0x7eff0c10de70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:38:37.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.475+0000 7eff10d8d700 1 -- 172.21.15.5:0/760641199 >> 172.21.15.5:0/760641199 conn(0x7eff0c0f6bf0 msgr2=0x7eff0c0f82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:38:37.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.476+0000 7eff10d8d700 1 -- 172.21.15.5:0/760641199 shutdown_connections 2024-04-16T14:38:37.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:38:37.476+0000 7eff10d8d700 1 -- 172.21.15.5:0/760641199 wait complete. 2024-04-16T14:38:38.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:38 smithi005 ceph-mon[93420]: pgmap v40: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:38.301 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:38 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/760641199' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:38:38.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:38 smithi115 ceph-mon[83414]: pgmap v40: 65 pgs: 65 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:38.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:38 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/760641199' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:38:38.973 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:38 smithi005 systemd[1]: Stopping Ceph osd.0 for 10609bfa-fbfd-11ee-bc90-c7b262605968... 2024-04-16T14:38:39.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:38:39.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:39 smithi005 ceph-mon[93420]: osd.0 marked itself down and dead 2024-04-16T14:38:39.225 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:38 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0[47594]: 2024-04-16T14:38:38.973+0000 7ff6ff851700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-16T14:38:39.225 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:38 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0[47594]: 2024-04-16T14:38:38.973+0000 7ff6ff851700 -1 osd.0 50 *** Got signal Terminated *** 2024-04-16T14:38:39.225 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:38 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0[47594]: 2024-04-16T14:38:38.973+0000 7ff6ff851700 -1 osd.0 50 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-16T14:38:39.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:38:39.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:39 smithi115 ceph-mon[83414]: osd.0 marked itself down and dead 2024-04-16T14:38:39.882 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:39 smithi005 podman[101847]: 2024-04-16 14:38:39.630885765 +0000 UTC m=+0.800233724 container died ed7aa0542d96c6a141faf30e80c84daa4ffbdb66ff930f0c4f7375391eeaf1c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:15b9a118425d53cc97d2f7bc08f63df1d8bfa1149df59d4de72a305b04501998, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=quincy-412a552, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-16T14:38:40.195 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:39 smithi005 podman[101847]: 2024-04-16 14:38:39.983379954 +0000 UTC m=+1.152727907 container cleanup ed7aa0542d96c6a141faf30e80c84daa4ffbdb66ff930f0c4f7375391eeaf1c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:15b9a118425d53cc97d2f7bc08f63df1d8bfa1149df59d4de72a305b04501998, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=quincy-412a552, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409, GIT_BRANCH=HEAD) 2024-04-16T14:38:40.195 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:39 smithi005 bash[101847]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0 2024-04-16T14:38:40.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:40 smithi005 ceph-mon[93420]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-16T14:38:40.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:40 smithi005 ceph-mon[93420]: osdmap e51: 6 total, 5 up, 6 in 2024-04-16T14:38:40.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:40 smithi005 ceph-mon[93420]: pgmap v42: 65 pgs: 34 peering, 31 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:40.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:40 smithi005 ceph-mon[93420]: osdmap e52: 6 total, 5 up, 6 in 2024-04-16T14:38:40.475 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:40 smithi005 podman[101866]: 2024-04-16 14:38:40.276624245 +0000 UTC m=+0.646620177 container remove ed7aa0542d96c6a141faf30e80c84daa4ffbdb66ff930f0c4f7375391eeaf1c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:15b9a118425d53cc97d2f7bc08f63df1d8bfa1149df59d4de72a305b04501998, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=quincy-412a552, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True) 2024-04-16T14:38:40.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:40 smithi115 ceph-mon[83414]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-16T14:38:40.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:40 smithi115 ceph-mon[83414]: osdmap e51: 6 total, 5 up, 6 in 2024-04-16T14:38:40.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:40 smithi115 ceph-mon[83414]: pgmap v42: 65 pgs: 34 peering, 31 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:40.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:40 smithi115 ceph-mon[83414]: osdmap e52: 6 total, 5 up, 6 in 2024-04-16T14:38:40.919 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:40 smithi005 podman[101957]: 2024-04-16 14:38:40.492734955 +0000 UTC m=+0.018633749 image pull b1a78730e0db57f46162ae12211512856024b361a698c3ed431f6fbc73b484c3 quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 2024-04-16T14:38:40.920 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:40 smithi005 podman[101957]: 2024-04-16 14:38:40.594182853 +0000 UTC m=+0.120081669 container create 986ce2b749ab4e7aac69c25b7d9bb261de4f9a4a667f906cbe89ed01a895dc6d (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240409, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True) 2024-04-16T14:38:40.920 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:40 smithi005 podman[101957]: 2024-04-16 14:38:40.822012836 +0000 UTC m=+0.347911624 container init 986ce2b749ab4e7aac69c25b7d9bb261de4f9a4a667f906cbe89ed01a895dc6d (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240409, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-04-16T14:38:40.920 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:40 smithi005 podman[101957]: 2024-04-16 14:38:40.825636213 +0000 UTC m=+0.351534996 container start 986ce2b749ab4e7aac69c25b7d9bb261de4f9a4a667f906cbe89ed01a895dc6d (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-04-16T14:38:40.920 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:40 smithi005 podman[101957]: 2024-04-16 14:38:40.921736442 +0000 UTC m=+0.447635226 container attach 986ce2b749ab4e7aac69c25b7d9bb261de4f9a4a667f906cbe89ed01a895dc6d (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, GIT_BRANCH=HEAD) 2024-04-16T14:38:41.197 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:41 smithi005 podman[101957]: 2024-04-16 14:38:41.129077128 +0000 UTC m=+0.654975907 container died 986ce2b749ab4e7aac69c25b7d9bb261de4f9a4a667f906cbe89ed01a895dc6d (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-16T14:38:41.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:41 smithi005 ceph-mon[93420]: Health check failed: Reduced data availability: 34 pgs peering (PG_AVAILABILITY) 2024-04-16T14:38:41.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:41 smithi115 ceph-mon[83414]: Health check failed: Reduced data availability: 34 pgs peering (PG_AVAILABILITY) 2024-04-16T14:38:41.945 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:41 smithi005 podman[101983]: 2024-04-16 14:38:41.717682437 +0000 UTC m=+0.579635069 container remove 986ce2b749ab4e7aac69c25b7d9bb261de4f9a4a667f906cbe89ed01a895dc6d (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5) 2024-04-16T14:38:41.945 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:41 smithi005 systemd[1]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.0.service: Deactivated successfully. 2024-04-16T14:38:41.945 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:41 smithi005 systemd[1]: Stopped Ceph osd.0 for 10609bfa-fbfd-11ee-bc90-c7b262605968. 2024-04-16T14:38:41.945 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:41 smithi005 systemd[1]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.0.service: Consumed 54.121s CPU time. 2024-04-16T14:38:42.201 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:41 smithi005 systemd[1]: Starting Ceph osd.0 for 10609bfa-fbfd-11ee-bc90-c7b262605968... 2024-04-16T14:38:42.201 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:42 smithi005 podman[102087]: 2024-04-16 14:38:42.067791279 +0000 UTC m=+0.019017383 image pull b1a78730e0db57f46162ae12211512856024b361a698c3ed431f6fbc73b484c3 quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 2024-04-16T14:38:42.201 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:42 smithi005 podman[102087]: 2024-04-16 14:38:42.191660312 +0000 UTC m=+0.142886447 container create b0e02ce0d1d39706d458815e0990e82db9ed37943e026cf31c022f51914db59e (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240409) 2024-04-16T14:38:42.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:42 smithi005 ceph-mon[93420]: pgmap v44: 65 pgs: 34 peering, 31 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:42.476 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:42 smithi005 podman[102087]: 2024-04-16 14:38:42.413023732 +0000 UTC m=+0.364249825 container init b0e02ce0d1d39706d458815e0990e82db9ed37943e026cf31c022f51914db59e (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0-activate, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-16T14:38:42.476 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:42 smithi005 podman[102087]: 2024-04-16 14:38:42.416335558 +0000 UTC m=+0.367561652 container start b0e02ce0d1d39706d458815e0990e82db9ed37943e026cf31c022f51914db59e (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0-activate, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-16T14:38:42.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:42 smithi115 ceph-mon[83414]: pgmap v44: 65 pgs: 34 peering, 31 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:42.869 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:42 smithi005 podman[102087]: 2024-04-16 14:38:42.51320525 +0000 UTC m=+0.464431358 container attach b0e02ce0d1d39706d458815e0990e82db9ed37943e026cf31c022f51914db59e (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0-activate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-16T14:38:43.224 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:42 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0-activate[102101]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-16T14:38:43.224 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:42 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0-activate[102101]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-16T14:38:43.225 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:42 smithi005 bash[102087]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-16T14:38:43.225 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:42 smithi005 bash[102087]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-16T14:38:43.225 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:42 smithi005 bash[102087]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-16T14:38:43.225 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:42 smithi005 bash[102087]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-16T14:38:43.225 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:42 smithi005 bash[102087]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-04-16T14:38:43.226 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:42 smithi005 bash[102087]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-16T14:38:43.226 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:42 smithi005 bash[102087]: --> ceph-volume raw activate successful for osd ID: 0 2024-04-16T14:38:43.226 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:42 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0-activate[102101]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-16T14:38:43.226 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:42 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0-activate[102101]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-16T14:38:43.226 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:42 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0-activate[102101]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-04-16T14:38:43.226 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:42 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0-activate[102101]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-16T14:38:43.227 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:42 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0-activate[102101]: --> ceph-volume raw activate successful for osd ID: 0 2024-04-16T14:38:43.227 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:42 smithi005 podman[102087]: 2024-04-16 14:38:42.896243879 +0000 UTC m=+0.847469963 container died b0e02ce0d1d39706d458815e0990e82db9ed37943e026cf31c022f51914db59e (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0-activate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240409, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-16T14:38:43.873 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:43 smithi005 podman[102239]: 2024-04-16 14:38:43.5107491 +0000 UTC m=+0.609165855 container remove b0e02ce0d1d39706d458815e0990e82db9ed37943e026cf31c022f51914db59e (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, maintainer=Guillaume Abrioux ) 2024-04-16T14:38:43.873 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:43 smithi005 podman[102298]: 2024-04-16 14:38:43.635151597 +0000 UTC m=+0.018654641 image pull b1a78730e0db57f46162ae12211512856024b361a698c3ed431f6fbc73b484c3 quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 2024-04-16T14:38:43.873 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:43 smithi005 podman[102298]: 2024-04-16 14:38:43.747176098 +0000 UTC m=+0.130679131 container create 91d9246d45e04ff08ea6d186909efb62cb74a23846313dee936448cbcfbe0e2c (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-16T14:38:44.224 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:43 smithi005 podman[102298]: 2024-04-16 14:38:43.990068828 +0000 UTC m=+0.373571871 container init 91d9246d45e04ff08ea6d186909efb62cb74a23846313dee936448cbcfbe0e2c (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-04-16T14:38:44.224 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:43 smithi005 podman[102298]: 2024-04-16 14:38:43.993569962 +0000 UTC m=+0.377073006 container start 91d9246d45e04ff08ea6d186909efb62cb74a23846313dee936448cbcfbe0e2c (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0, io.buildah.version=1.33.5, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True) 2024-04-16T14:38:44.224 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:44 smithi005 ceph-osd[102318]: -- 172.21.15.5:0/608556262 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5562b138d680 con 0x5562b1357000 2024-04-16T14:38:44.224 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:44 smithi005 bash[102298]: 91d9246d45e04ff08ea6d186909efb62cb74a23846313dee936448cbcfbe0e2c 2024-04-16T14:38:44.224 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:44 smithi005 systemd[1]: Started Ceph osd.0 for 10609bfa-fbfd-11ee-bc90-c7b262605968. 2024-04-16T14:38:44.951 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:44 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0[102314]: 2024-04-16T14:38:44.537+0000 7fb015b997c0 -1 Falling back to public interface 2024-04-16T14:38:45.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:45 smithi005 ceph-mon[93420]: pgmap v45: 65 pgs: 34 peering, 31 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:45.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:45 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:45.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:45 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:45.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:45 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:38:45.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:45 smithi115 ceph-mon[83414]: pgmap v45: 65 pgs: 34 peering, 31 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:38:45.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:45 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:45.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:45 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:45.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:45 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:38:46.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:46 smithi115 ceph-mon[83414]: pgmap v46: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 69/354 objects degraded (19.492%) 2024-04-16T14:38:46.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:46 smithi115 ceph-mon[83414]: Health check failed: Degraded data redundancy: 69/354 objects degraded (19.492%), 19 pgs degraded (PG_DEGRADED) 2024-04-16T14:38:46.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:46 smithi115 ceph-mon[83414]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 34 pgs peering) 2024-04-16T14:38:46.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:46 smithi005 ceph-mon[93420]: pgmap v46: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 69/354 objects degraded (19.492%) 2024-04-16T14:38:46.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:46 smithi005 ceph-mon[93420]: Health check failed: Degraded data redundancy: 69/354 objects degraded (19.492%), 19 pgs degraded (PG_DEGRADED) 2024-04-16T14:38:46.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:46 smithi005 ceph-mon[93420]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 34 pgs peering) 2024-04-16T14:38:48.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:48 smithi005 ceph-mon[93420]: pgmap v47: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 69/354 objects degraded (19.492%) 2024-04-16T14:38:48.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:48 smithi115 ceph-mon[83414]: pgmap v47: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 69/354 objects degraded (19.492%) 2024-04-16T14:38:49.224 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:48 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0[102314]: 2024-04-16T14:38:48.915+0000 7fb015b997c0 -1 osd.0 50 log_to_monitors true 2024-04-16T14:38:49.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:49 smithi115 ceph-mon[83414]: from='osd.0 [v2:172.21.15.5:6802/1335449550,v1:172.21.15.5:6803/1335449550]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-16T14:38:49.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:49 smithi005 ceph-mon[93420]: from='osd.0 [v2:172.21.15.5:6802/1335449550,v1:172.21.15.5:6803/1335449550]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-16T14:38:50.271 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:38:50 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0[102314]: 2024-04-16T14:38:49.999+0000 7fb002fe9700 -1 osd.0 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T14:38:50.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:50 smithi115 ceph-mon[83414]: pgmap v48: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 69/354 objects degraded (19.492%) 2024-04-16T14:38:50.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:50 smithi115 ceph-mon[83414]: from='osd.0 [v2:172.21.15.5:6802/1335449550,v1:172.21.15.5:6803/1335449550]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-16T14:38:50.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:50 smithi115 ceph-mon[83414]: osdmap e53: 6 total, 5 up, 6 in 2024-04-16T14:38:50.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:50 smithi115 ceph-mon[83414]: from='osd.0 [v2:172.21.15.5:6802/1335449550,v1:172.21.15.5:6803/1335449550]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-04-16T14:38:50.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:50 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:50.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:50 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:50.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:50 smithi115 ceph-mon[83414]: from='osd.0 [v2:172.21.15.5:6802/1335449550,v1:172.21.15.5:6803/1335449550]' entity='osd.0' 2024-04-16T14:38:50.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:50 smithi005 ceph-mon[93420]: pgmap v48: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 300 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 69/354 objects degraded (19.492%) 2024-04-16T14:38:50.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:50 smithi005 ceph-mon[93420]: from='osd.0 [v2:172.21.15.5:6802/1335449550,v1:172.21.15.5:6803/1335449550]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-16T14:38:50.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:50 smithi005 ceph-mon[93420]: osdmap e53: 6 total, 5 up, 6 in 2024-04-16T14:38:50.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:50 smithi005 ceph-mon[93420]: from='osd.0 [v2:172.21.15.5:6802/1335449550,v1:172.21.15.5:6803/1335449550]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-04-16T14:38:50.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:50 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:50.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:50 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:50.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:50 smithi005 ceph-mon[93420]: from='osd.0 [v2:172.21.15.5:6802/1335449550,v1:172.21.15.5:6803/1335449550]' entity='osd.0' 2024-04-16T14:38:51.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:51 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:51.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:51 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:51.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:51 smithi005 ceph-mon[93420]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-16T14:38:51.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:51 smithi005 ceph-mon[93420]: osd.0 [v2:172.21.15.5:6802/1335449550,v1:172.21.15.5:6803/1335449550] boot 2024-04-16T14:38:51.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:51 smithi005 ceph-mon[93420]: osdmap e54: 6 total, 6 up, 6 in 2024-04-16T14:38:51.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:51 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-16T14:38:52.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:51 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:52.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:51 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:52.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:51 smithi115 ceph-mon[83414]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-16T14:38:52.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:51 smithi115 ceph-mon[83414]: osd.0 [v2:172.21.15.5:6802/1335449550,v1:172.21.15.5:6803/1335449550] boot 2024-04-16T14:38:52.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:51 smithi115 ceph-mon[83414]: osdmap e54: 6 total, 6 up, 6 in 2024-04-16T14:38:52.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:51 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-16T14:38:53.418 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:53 smithi005 ceph-mon[93420]: pgmap v51: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 69/354 objects degraded (19.492%) 2024-04-16T14:38:53.419 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:53 smithi005 ceph-mon[93420]: osdmap e55: 6 total, 6 up, 6 in 2024-04-16T14:38:53.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:53 smithi115 ceph-mon[83414]: pgmap v51: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 69/354 objects degraded (19.492%) 2024-04-16T14:38:53.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:53 smithi115 ceph-mon[83414]: osdmap e55: 6 total, 6 up, 6 in 2024-04-16T14:38:54.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:54 smithi005 ceph-mon[93420]: pgmap v53: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 69/354 objects degraded (19.492%) 2024-04-16T14:38:54.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:54 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:54.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:54 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:38:54.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:54 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:54.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:54 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:54.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:54 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:38:54.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:54 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:38:54.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:54 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:54.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:54 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:38:54.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:54 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:38:54.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:54 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:38:54.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:54 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:38:54.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:54 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-16T14:38:54.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:54 smithi115 ceph-mon[83414]: pgmap v53: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 69/354 objects degraded (19.492%) 2024-04-16T14:38:54.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:54 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:54.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:54 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:38:54.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:54 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:54.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:54 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:54.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:54 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:38:54.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:54 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:38:54.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:54 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:38:54.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:54 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:38:54.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:54 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:38:54.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:54 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:38:54.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:54 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:38:54.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:54 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-16T14:38:55.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:55 smithi115 ceph-mon[83414]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-16T14:38:55.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:55 smithi115 ceph-mon[83414]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-04-16T14:38:55.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:55 smithi005 ceph-mon[93420]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-16T14:38:55.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:55 smithi005 ceph-mon[93420]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-04-16T14:38:56.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:56 smithi115 ceph-mon[83414]: pgmap v54: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-04-16T14:38:56.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:56 smithi115 ceph-mon[83414]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 69/354 objects degraded (19.492%), 19 pgs degraded) 2024-04-16T14:38:56.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:56 smithi115 ceph-mon[83414]: Cluster is now healthy 2024-04-16T14:38:56.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:56 smithi115 ceph-mon[83414]: mgrmap e38: smithi005.ipwdkc(active, since 92s), standbys: smithi115.brjkpo 2024-04-16T14:38:56.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:56 smithi005 ceph-mon[93420]: pgmap v54: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-04-16T14:38:56.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:56 smithi005 ceph-mon[93420]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 69/354 objects degraded (19.492%), 19 pgs degraded) 2024-04-16T14:38:56.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:56 smithi005 ceph-mon[93420]: Cluster is now healthy 2024-04-16T14:38:56.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:56 smithi005 ceph-mon[93420]: mgrmap e38: smithi005.ipwdkc(active, since 92s), standbys: smithi115.brjkpo 2024-04-16T14:38:58.656 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:38:58 smithi005 ceph-mon[93420]: pgmap v55: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 773 B/s wr, 0 op/s 2024-04-16T14:38:58.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:38:58 smithi115 ceph-mon[83414]: pgmap v55: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 773 B/s wr, 0 op/s 2024-04-16T14:39:00.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:00 smithi115 ceph-mon[83414]: pgmap v56: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 747 B/s wr, 0 op/s 2024-04-16T14:39:00.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:00 smithi005 ceph-mon[93420]: pgmap v56: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 747 B/s wr, 0 op/s 2024-04-16T14:39:02.537 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:02 smithi005 ceph-mon[93420]: pgmap v57: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 614 B/s wr, 0 op/s 2024-04-16T14:39:02.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:02 smithi115 ceph-mon[83414]: pgmap v57: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 614 B/s wr, 0 op/s 2024-04-16T14:39:04.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:04 smithi115 ceph-mon[83414]: pgmap v58: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 547 B/s wr, 0 op/s 2024-04-16T14:39:04.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:04 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:04.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:04 smithi005 ceph-mon[93420]: pgmap v58: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 547 B/s wr, 0 op/s 2024-04-16T14:39:04.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:04 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:06.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:06 smithi115 ceph-mon[83414]: pgmap v59: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-16T14:39:06.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:06 smithi005 ceph-mon[93420]: pgmap v59: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-04-16T14:39:07.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.595+0000 7f5674f82700 1 -- 172.21.15.5:0/1551329872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56700fbd00 msgr2=0x7f56700fc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:07.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.595+0000 7f5674f82700 1 --2- 172.21.15.5:0/1551329872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56700fbd00 0x7f56700fc110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5660004940 tx=0x7f5660009e30 comp rx=0 tx=0).stop 2024-04-16T14:39:07.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.595+0000 7f5674f82700 1 -- 172.21.15.5:0/1551329872 shutdown_connections 2024-04-16T14:39:07.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.595+0000 7f5674f82700 1 --2- 172.21.15.5:0/1551329872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56700fcfb0 0x7f56700fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:07.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.595+0000 7f5674f82700 1 --2- 172.21.15.5:0/1551329872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56700fbd00 0x7f56700fc110 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:07.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.595+0000 7f5674f82700 1 -- 172.21.15.5:0/1551329872 >> 172.21.15.5:0/1551329872 conn(0x7f56700f7480 msgr2=0x7f56700f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:07.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.595+0000 7f5674f82700 1 -- 172.21.15.5:0/1551329872 shutdown_connections 2024-04-16T14:39:07.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.595+0000 7f5674f82700 1 -- 172.21.15.5:0/1551329872 wait complete. 2024-04-16T14:39:07.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.596+0000 7f5674f82700 1 Processor -- start 2024-04-16T14:39:07.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.596+0000 7f5674f82700 1 -- start start 2024-04-16T14:39:07.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.596+0000 7f5674f82700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56700fbd00 0x7f5670066d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:07.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.596+0000 7f5674f82700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56700fcfb0 0x7f5670112730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:07.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.596+0000 7f5674f82700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5670112c70 con 0x7f56700fcfb0 2024-04-16T14:39:07.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.596+0000 7f5674f82700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5670112db0 con 0x7f56700fbd00 2024-04-16T14:39:07.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.596+0000 7f566dd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56700fcfb0 0x7f5670112730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:07.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.596+0000 7f566dd9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56700fcfb0 0x7f5670112730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44658/0 (socket says 172.21.15.5:44658) 2024-04-16T14:39:07.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.596+0000 7f566dd9b700 1 -- 172.21.15.5:0/396994877 learned_addr learned my addr 172.21.15.5:0/396994877 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:39:07.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.596+0000 7f566e59c700 1 --2- 172.21.15.5:0/396994877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56700fbd00 0x7f5670066d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:07.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.596+0000 7f566dd9b700 1 -- 172.21.15.5:0/396994877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56700fbd00 msgr2=0x7f5670066d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:07.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.596+0000 7f566dd9b700 1 --2- 172.21.15.5:0/396994877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56700fbd00 0x7f5670066d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:07.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.596+0000 7f566dd9b700 1 -- 172.21.15.5:0/396994877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5660005040 con 0x7f56700fcfb0 2024-04-16T14:39:07.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.596+0000 7f566dd9b700 1 --2- 172.21.15.5:0/396994877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56700fcfb0 0x7f5670112730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f566400c8c0 tx=0x7f56640044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:07.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.597+0000 7f565effd700 1 -- 172.21.15.5:0/396994877 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f566400a920 con 0x7f56700fcfb0 2024-04-16T14:39:07.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.597+0000 7f565effd700 1 -- 172.21.15.5:0/396994877 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f566400ce60 con 0x7f56700fcfb0 2024-04-16T14:39:07.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.597+0000 7f5674f82700 1 -- 172.21.15.5:0/396994877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5670113040 con 0x7f56700fcfb0 2024-04-16T14:39:07.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.597+0000 7f565effd700 1 -- 172.21.15.5:0/396994877 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56640113a0 con 0x7f56700fcfb0 2024-04-16T14:39:07.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.597+0000 7f5674f82700 1 -- 172.21.15.5:0/396994877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56701135d0 con 0x7f56700fcfb0 2024-04-16T14:39:07.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.598+0000 7f5674f82700 1 -- 172.21.15.5:0/396994877 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f567004c710 con 0x7f56700fcfb0 2024-04-16T14:39:07.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.598+0000 7f565effd700 1 -- 172.21.15.5:0/396994877 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f5664012400 con 0x7f56700fcfb0 2024-04-16T14:39:07.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.599+0000 7f565effd700 1 --2- 172.21.15.5:0/396994877 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f565806e140 0x7f56580705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:07.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.599+0000 7f565effd700 1 -- 172.21.15.5:0/396994877 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f566408dbd0 con 0x7f56700fcfb0 2024-04-16T14:39:07.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.599+0000 7f566e59c700 1 --2- 172.21.15.5:0/396994877 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f565806e140 0x7f56580705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:07.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.599+0000 7f566e59c700 1 --2- 172.21.15.5:0/396994877 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f565806e140 0x7f56580705f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f566000b3b0 tx=0x7f5660009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:07.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.604+0000 7f565effd700 1 -- 172.21.15.5:0/396994877 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f566405aae0 con 0x7f56700fcfb0 2024-04-16T14:39:07.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.828+0000 7f5674f82700 1 -- 172.21.15.5:0/396994877 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5670101370 con 0x7f565806e140 2024-04-16T14:39:07.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.829+0000 7f565effd700 1 -- 172.21.15.5:0/396994877 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5670101370 con 0x7f565806e140 2024-04-16T14:39:07.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.831+0000 7f5674f82700 1 -- 172.21.15.5:0/396994877 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f565806e140 msgr2=0x7f56580705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:07.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.831+0000 7f5674f82700 1 --2- 172.21.15.5:0/396994877 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f565806e140 0x7f56580705f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f566000b3b0 tx=0x7f5660009e30 comp rx=0 tx=0).stop 2024-04-16T14:39:07.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.831+0000 7f5674f82700 1 -- 172.21.15.5:0/396994877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56700fcfb0 msgr2=0x7f5670112730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:07.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.831+0000 7f5674f82700 1 --2- 172.21.15.5:0/396994877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56700fcfb0 0x7f5670112730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f566400c8c0 tx=0x7f56640044c0 comp rx=0 tx=0).stop 2024-04-16T14:39:07.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.831+0000 7f5674f82700 1 -- 172.21.15.5:0/396994877 shutdown_connections 2024-04-16T14:39:07.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.831+0000 7f5674f82700 1 --2- 172.21.15.5:0/396994877 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f565806e140 0x7f56580705f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:07.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.831+0000 7f5674f82700 1 --2- 172.21.15.5:0/396994877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56700fbd00 0x7f5670066d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:07.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.831+0000 7f5674f82700 1 --2- 172.21.15.5:0/396994877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56700fcfb0 0x7f5670112730 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:07.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.831+0000 7f5674f82700 1 -- 172.21.15.5:0/396994877 >> 172.21.15.5:0/396994877 conn(0x7f56700f7480 msgr2=0x7f56700f8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:07.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.831+0000 7f5674f82700 1 -- 172.21.15.5:0/396994877 shutdown_connections 2024-04-16T14:39:07.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.831+0000 7f5674f82700 1 -- 172.21.15.5:0/396994877 wait complete. 2024-04-16T14:39:07.840 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-04-16T14:39:07.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.936+0000 7fcb1f3c2700 1 -- 172.21.15.5:0/3139658056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb180fdff0 msgr2=0x7fcb180fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:07.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.936+0000 7fcb1f3c2700 1 --2- 172.21.15.5:0/3139658056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb180fdff0 0x7fcb180fe460 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcb08004940 tx=0x7fcb08009e30 comp rx=0 tx=0).stop 2024-04-16T14:39:07.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.936+0000 7fcb1f3c2700 1 -- 172.21.15.5:0/3139658056 shutdown_connections 2024-04-16T14:39:07.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.936+0000 7fcb1f3c2700 1 --2- 172.21.15.5:0/3139658056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb180fdff0 0x7fcb180fe460 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:07.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.936+0000 7fcb1f3c2700 1 --2- 172.21.15.5:0/3139658056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb180fce80 0x7fcb180fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:07.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.936+0000 7fcb1f3c2700 1 -- 172.21.15.5:0/3139658056 >> 172.21.15.5:0/3139658056 conn(0x7fcb180f8580 msgr2=0x7fcb180fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:07.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.936+0000 7fcb1f3c2700 1 -- 172.21.15.5:0/3139658056 shutdown_connections 2024-04-16T14:39:07.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.936+0000 7fcb1f3c2700 1 -- 172.21.15.5:0/3139658056 wait complete. 2024-04-16T14:39:07.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.936+0000 7fcb1f3c2700 1 Processor -- start 2024-04-16T14:39:07.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.936+0000 7fcb1f3c2700 1 -- start start 2024-04-16T14:39:07.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.936+0000 7fcb1f3c2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb180fce80 0x7fcb1810d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:07.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.936+0000 7fcb1f3c2700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb180fdff0 0x7fcb1810de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:07.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.936+0000 7fcb1f3c2700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1810e400 con 0x7fcb180fce80 2024-04-16T14:39:07.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.936+0000 7fcb1f3c2700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1810e570 con 0x7fcb180fdff0 2024-04-16T14:39:07.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.937+0000 7fcb1d15e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb180fce80 0x7fcb1810d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:07.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.937+0000 7fcb1d15e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb180fce80 0x7fcb1810d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44680/0 (socket says 172.21.15.5:44680) 2024-04-16T14:39:07.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.937+0000 7fcb1d15e700 1 -- 172.21.15.5:0/3022877802 learned_addr learned my addr 172.21.15.5:0/3022877802 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:39:07.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.937+0000 7fcb1c95d700 1 --2- 172.21.15.5:0/3022877802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb180fdff0 0x7fcb1810de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:07.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.937+0000 7fcb1d15e700 1 -- 172.21.15.5:0/3022877802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb180fdff0 msgr2=0x7fcb1810de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:07.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.937+0000 7fcb1d15e700 1 --2- 172.21.15.5:0/3022877802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb180fdff0 0x7fcb1810de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:07.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.937+0000 7fcb1d15e700 1 -- 172.21.15.5:0/3022877802 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb08005040 con 0x7fcb180fce80 2024-04-16T14:39:07.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.937+0000 7fcb1c95d700 1 --2- 172.21.15.5:0/3022877802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb180fdff0 0x7fcb1810de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:39:07.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.937+0000 7fcb1d15e700 1 --2- 172.21.15.5:0/3022877802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb180fce80 0x7fcb1810d8c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400eb70 tx=0x7fcb1400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:07.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.937+0000 7fcb0dffb700 1 -- 172.21.15.5:0/3022877802 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb14007cc0 con 0x7fcb180fce80 2024-04-16T14:39:07.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.937+0000 7fcb0dffb700 1 -- 172.21.15.5:0/3022877802 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcb1400f040 con 0x7fcb180fce80 2024-04-16T14:39:07.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.937+0000 7fcb1f3c2700 1 -- 172.21.15.5:0/3022877802 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb18112f70 con 0x7fcb180fce80 2024-04-16T14:39:07.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.937+0000 7fcb0dffb700 1 -- 172.21.15.5:0/3022877802 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb14009640 con 0x7fcb180fce80 2024-04-16T14:39:07.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.938+0000 7fcb1f3c2700 1 -- 172.21.15.5:0/3022877802 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb180703b0 con 0x7fcb180fce80 2024-04-16T14:39:07.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.939+0000 7fcb1f3c2700 1 -- 172.21.15.5:0/3022877802 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb1804c710 con 0x7fcb180fce80 2024-04-16T14:39:07.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.939+0000 7fcb0dffb700 1 -- 172.21.15.5:0/3022877802 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fcb140097a0 con 0x7fcb180fce80 2024-04-16T14:39:07.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.939+0000 7fcb0dffb700 1 --2- 172.21.15.5:0/3022877802 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fcb04072550 0x7fcb04074a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:07.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.940+0000 7fcb0dffb700 1 -- 172.21.15.5:0/3022877802 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fcb1408d750 con 0x7fcb180fce80 2024-04-16T14:39:07.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.940+0000 7fcb1c95d700 1 --2- 172.21.15.5:0/3022877802 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fcb04072550 0x7fcb04074a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:07.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.940+0000 7fcb1c95d700 1 --2- 172.21.15.5:0/3022877802 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fcb04072550 0x7fcb04074a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcb08000c00 tx=0x7fcb08009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:07.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:07.944+0000 7fcb0dffb700 1 -- 172.21.15.5:0/3022877802 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fcb1405a600 con 0x7fcb180fce80 2024-04-16T14:39:08.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.175+0000 7fcb1f3c2700 1 -- 172.21.15.5:0/3022877802 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb18102290 con 0x7fcb04072550 2024-04-16T14:39:08.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.176+0000 7fcb0dffb700 1 -- 172.21.15.5:0/3022877802 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fcb18102290 con 0x7fcb04072550 2024-04-16T14:39:08.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.179+0000 7fcb1f3c2700 1 -- 172.21.15.5:0/3022877802 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fcb04072550 msgr2=0x7fcb04074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:08.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.179+0000 7fcb1f3c2700 1 --2- 172.21.15.5:0/3022877802 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fcb04072550 0x7fcb04074a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcb08000c00 tx=0x7fcb08009e30 comp rx=0 tx=0).stop 2024-04-16T14:39:08.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.179+0000 7fcb1f3c2700 1 -- 172.21.15.5:0/3022877802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb180fce80 msgr2=0x7fcb1810d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:08.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.179+0000 7fcb1f3c2700 1 --2- 172.21.15.5:0/3022877802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb180fce80 0x7fcb1810d8c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcb1400eb70 tx=0x7fcb1400b040 comp rx=0 tx=0).stop 2024-04-16T14:39:08.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.179+0000 7fcb1f3c2700 1 -- 172.21.15.5:0/3022877802 shutdown_connections 2024-04-16T14:39:08.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.179+0000 7fcb1f3c2700 1 --2- 172.21.15.5:0/3022877802 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fcb04072550 0x7fcb04074a00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:08.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.179+0000 7fcb1f3c2700 1 --2- 172.21.15.5:0/3022877802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcb180fce80 0x7fcb1810d8c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:08.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.179+0000 7fcb1f3c2700 1 --2- 172.21.15.5:0/3022877802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcb180fdff0 0x7fcb1810de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:08.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.179+0000 7fcb1f3c2700 1 -- 172.21.15.5:0/3022877802 >> 172.21.15.5:0/3022877802 conn(0x7fcb180f8580 msgr2=0x7fcb180f9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:08.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.179+0000 7fcb1f3c2700 1 -- 172.21.15.5:0/3022877802 shutdown_connections 2024-04-16T14:39:08.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.179+0000 7fcb1f3c2700 1 -- 172.21.15.5:0/3022877802 wait complete. 2024-04-16T14:39:08.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.284+0000 7f03fa371700 1 -- 172.21.15.5:0/2424033476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03f40ffff0 msgr2=0x7f03f41023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:08.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.284+0000 7f03fa371700 1 --2- 172.21.15.5:0/2424033476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03f40ffff0 0x7f03f41023d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f03e8004940 tx=0x7f03e8009e30 comp rx=0 tx=0).stop 2024-04-16T14:39:08.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.284+0000 7f03fa371700 1 -- 172.21.15.5:0/2424033476 shutdown_connections 2024-04-16T14:39:08.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.284+0000 7f03fa371700 1 --2- 172.21.15.5:0/2424033476 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03f40ffff0 0x7f03f41023d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:08.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.284+0000 7f03fa371700 1 --2- 172.21.15.5:0/2424033476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03f4066270 0x7f03f40ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:08.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.284+0000 7f03fa371700 1 -- 172.21.15.5:0/2424033476 >> 172.21.15.5:0/2424033476 conn(0x7f03f40f74c0 msgr2=0x7f03f40f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:08.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.284+0000 7f03fa371700 1 -- 172.21.15.5:0/2424033476 shutdown_connections 2024-04-16T14:39:08.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.284+0000 7f03fa371700 1 -- 172.21.15.5:0/2424033476 wait complete. 2024-04-16T14:39:08.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.284+0000 7f03fa371700 1 Processor -- start 2024-04-16T14:39:08.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.285+0000 7f03fa371700 1 -- start start 2024-04-16T14:39:08.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.285+0000 7f03fa371700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03f4066270 0x7f03f40fd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:08.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.285+0000 7f03fa371700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03f40ffff0 0x7f03f40fb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:08.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.285+0000 7f03fa371700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f40fbf60 con 0x7f03f40ffff0 2024-04-16T14:39:08.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.285+0000 7f03fa371700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f40fc0d0 con 0x7f03f4066270 2024-04-16T14:39:08.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.285+0000 7f03f37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03f40ffff0 0x7f03f40fb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:08.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.285+0000 7f03f37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03f40ffff0 0x7f03f40fb9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44708/0 (socket says 172.21.15.5:44708) 2024-04-16T14:39:08.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.285+0000 7f03f37fe700 1 -- 172.21.15.5:0/666678819 learned_addr learned my addr 172.21.15.5:0/666678819 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:39:08.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.285+0000 7f03f3fff700 1 --2- 172.21.15.5:0/666678819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03f4066270 0x7f03f40fd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:08.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.285+0000 7f03f37fe700 1 -- 172.21.15.5:0/666678819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03f4066270 msgr2=0x7f03f40fd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:08.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.285+0000 7f03f37fe700 1 --2- 172.21.15.5:0/666678819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03f4066270 0x7f03f40fd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:08.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.285+0000 7f03f37fe700 1 -- 172.21.15.5:0/666678819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e8005040 con 0x7f03f40ffff0 2024-04-16T14:39:08.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.285+0000 7f03f3fff700 1 --2- 172.21.15.5:0/666678819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03f4066270 0x7f03f40fd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:39:08.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.285+0000 7f03f37fe700 1 --2- 172.21.15.5:0/666678819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03f40ffff0 0x7f03f40fb9b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f03e800b3b0 tx=0x7f03e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:08.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.286+0000 7f03f0ff9700 1 -- 172.21.15.5:0/666678819 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03e800e040 con 0x7f03f40ffff0 2024-04-16T14:39:08.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.286+0000 7f03f0ff9700 1 -- 172.21.15.5:0/666678819 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f03e800bcc0 con 0x7f03f40ffff0 2024-04-16T14:39:08.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.286+0000 7f03fa371700 1 -- 172.21.15.5:0/666678819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f40fc350 con 0x7f03f40ffff0 2024-04-16T14:39:08.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.286+0000 7f03f0ff9700 1 -- 172.21.15.5:0/666678819 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03e801c630 con 0x7f03f40ffff0 2024-04-16T14:39:08.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.286+0000 7f03fa371700 1 -- 172.21.15.5:0/666678819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f4115a80 con 0x7f03f40ffff0 2024-04-16T14:39:08.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.287+0000 7f03fa371700 1 -- 172.21.15.5:0/666678819 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f405f5f0 con 0x7f03f40ffff0 2024-04-16T14:39:08.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.287+0000 7f03f0ff9700 1 -- 172.21.15.5:0/666678819 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f03e8013980 con 0x7f03f40ffff0 2024-04-16T14:39:08.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.288+0000 7f03f0ff9700 1 --2- 172.21.15.5:0/666678819 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f03dc06e140 0x7f03dc0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:08.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.288+0000 7f03f0ff9700 1 -- 172.21.15.5:0/666678819 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f03e808e770 con 0x7f03f40ffff0 2024-04-16T14:39:08.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.288+0000 7f03f3fff700 1 --2- 172.21.15.5:0/666678819 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f03dc06e140 0x7f03dc0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:08.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.288+0000 7f03f3fff700 1 --2- 172.21.15.5:0/666678819 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f03dc06e140 0x7f03dc0705f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009fd0 tx=0x7f03e400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:08.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.292+0000 7f03f0ff9700 1 -- 172.21.15.5:0/666678819 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f03e8057b70 con 0x7f03f40ffff0 2024-04-16T14:39:08.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.510+0000 7f03fa371700 1 -- 172.21.15.5:0/666678819 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f03f40f8fb0 con 0x7f03dc06e140 2024-04-16T14:39:08.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.520+0000 7f03f0ff9700 1 -- 172.21.15.5:0/666678819 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f03f40f8fb0 con 0x7f03dc06e140 2024-04-16T14:39:08.518 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-16T14:39:08.519 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.smithi005 smithi005 *:9093,9094 running (3m) 19s ago 11m 26.0M - 0.25.0 c8568f914cd2 f8aaa22ee70c 2024-04-16T14:39:08.519 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi005 smithi005 running (50s) 19s ago 12m 6656k - 19.0.0-2204-g36befe5d b1a78730e0db d6efa08e65e3 2024-04-16T14:39:08.519 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi115 smithi115 running (45s) 41s ago 10m 6660k - 19.0.0-2204-g36befe5d b1a78730e0db b2a2f2965e2a 2024-04-16T14:39:08.519 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.smithi005 smithi005 *:3000 running (3m) 19s ago 11m 85.9M - 9.4.7 954c08fa6188 9834229a010c 2024-04-16T14:39:08.519 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.vzoqdl smithi005 running (6m) 19s ago 6m 13.2M - 17.2.7-868-g412a5526 b04d96489b7c 84a74a406a1d 2024-04-16T14:39:08.519 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.wofqlz smithi005 running (6m) 19s ago 6m 133M - 17.2.7-868-g412a5526 b04d96489b7c d0e053ab2f72 2024-04-16T14:39:08.519 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.byfytg smithi115 running (6m) 41s ago 6m 118M - 17.2.7-868-g412a5526 b04d96489b7c 595cd0892f66 2024-04-16T14:39:08.519 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.trkaqh smithi115 running (6m) 41s ago 6m 13.7M - 17.2.7-868-g412a5526 b04d96489b7c 5b60cd2ad79b 2024-04-16T14:39:08.519 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi005.ipwdkc smithi005 *:8443,9283,8765 running (3m) 19s ago 13m 498M - 19.0.0-2204-g36befe5d b1a78730e0db 451192b4fc44 2024-04-16T14:39:08.519 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi115.brjkpo smithi115 *:8443,9283,8765 running (2m) 41s ago 10m 448M - 19.0.0-2204-g36befe5d b1a78730e0db 0d75f8211942 2024-04-16T14:39:08.519 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi005 smithi005 running (114s) 19s ago 13m 41.2M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3d0c00924867 2024-04-16T14:39:08.519 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi115 smithi115 running (91s) 41s ago 10m 37.5M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3b916a4928b2 2024-04-16T14:39:08.519 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi005 smithi005 *:9100 running (3m) 19s ago 11m 16.4M - 1.5.0 0da6a335fe13 c09bba584a42 2024-04-16T14:39:08.520 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi115 smithi115 *:9100 running (3m) 41s ago 10m 16.7M - 1.5.0 0da6a335fe13 78cc9cc150c0 2024-04-16T14:39:08.520 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (24s) 19s ago 9m 12.6M 1559M 19.0.0-2204-g36befe5d b1a78730e0db 91d9246d45e0 2024-04-16T14:39:08.520 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (9m) 19s ago 9m 240M 1559M 17.2.7-868-g412a5526 b04d96489b7c 1868cc6c89f4 2024-04-16T14:39:08.520 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (9m) 19s ago 9m 188M 1559M 17.2.7-868-g412a5526 b04d96489b7c b12745ae7d18 2024-04-16T14:39:08.520 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi115 running (8m) 41s ago 8m 271M 2581M 17.2.7-868-g412a5526 b04d96489b7c 59f81301ebcf 2024-04-16T14:39:08.520 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi115 running (8m) 41s ago 8m 242M 2581M 17.2.7-868-g412a5526 b04d96489b7c e3ea96b7edd9 2024-04-16T14:39:08.520 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi115 running (7m) 41s ago 7m 227M 2581M 17.2.7-868-g412a5526 b04d96489b7c 456fa074e453 2024-04-16T14:39:08.520 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.smithi005 smithi005 *:9095 running (2m) 19s ago 11m 48.9M - 2.43.0 a07b618ecd1d dc784e58817c 2024-04-16T14:39:08.520 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:08 smithi005 ceph-mon[93420]: pgmap v60: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:08.520 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:08 smithi005 ceph-mon[93420]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:39:08.520 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:08 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:08.520 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:08 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:39:08.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.522+0000 7f03fa371700 1 -- 172.21.15.5:0/666678819 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f03dc06e140 msgr2=0x7f03dc0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:08.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.522+0000 7f03fa371700 1 --2- 172.21.15.5:0/666678819 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f03dc06e140 0x7f03dc0705f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009fd0 tx=0x7f03e400b040 comp rx=0 tx=0).stop 2024-04-16T14:39:08.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.522+0000 7f03fa371700 1 -- 172.21.15.5:0/666678819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03f40ffff0 msgr2=0x7f03f40fb9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:08.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.522+0000 7f03fa371700 1 --2- 172.21.15.5:0/666678819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03f40ffff0 0x7f03f40fb9b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f03e800b3b0 tx=0x7f03e8009e30 comp rx=0 tx=0).stop 2024-04-16T14:39:08.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.522+0000 7f03fa371700 1 -- 172.21.15.5:0/666678819 shutdown_connections 2024-04-16T14:39:08.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.522+0000 7f03fa371700 1 --2- 172.21.15.5:0/666678819 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f03dc06e140 0x7f03dc0705f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:08.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.522+0000 7f03fa371700 1 --2- 172.21.15.5:0/666678819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03f4066270 0x7f03f40fd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:08.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.522+0000 7f03fa371700 1 --2- 172.21.15.5:0/666678819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03f40ffff0 0x7f03f40fb9b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:08.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.522+0000 7f03fa371700 1 -- 172.21.15.5:0/666678819 >> 172.21.15.5:0/666678819 conn(0x7f03f40f74c0 msgr2=0x7f03f40f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:08.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.523+0000 7f03fa371700 1 -- 172.21.15.5:0/666678819 shutdown_connections 2024-04-16T14:39:08.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.523+0000 7f03fa371700 1 -- 172.21.15.5:0/666678819 wait complete. 2024-04-16T14:39:08.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.625+0000 7f0e8ac31700 1 -- 172.21.15.5:0/3392440687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e840fcfa0 msgr2=0x7f0e840fd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:08.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.625+0000 7f0e8ac31700 1 --2- 172.21.15.5:0/3392440687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e840fcfa0 0x7f0e840fd410 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0e74004940 tx=0x7f0e74009e30 comp rx=0 tx=0).stop 2024-04-16T14:39:08.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.625+0000 7f0e8ac31700 1 -- 172.21.15.5:0/3392440687 shutdown_connections 2024-04-16T14:39:08.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.625+0000 7f0e8ac31700 1 --2- 172.21.15.5:0/3392440687 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e840fcfa0 0x7f0e840fd410 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:08.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.625+0000 7f0e8ac31700 1 --2- 172.21.15.5:0/3392440687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e840fbcf0 0x7f0e840fc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:08.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.625+0000 7f0e8ac31700 1 -- 172.21.15.5:0/3392440687 >> 172.21.15.5:0/3392440687 conn(0x7f0e840f7450 msgr2=0x7f0e840f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:08.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.625+0000 7f0e8ac31700 1 -- 172.21.15.5:0/3392440687 shutdown_connections 2024-04-16T14:39:08.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.626+0000 7f0e8ac31700 1 -- 172.21.15.5:0/3392440687 wait complete. 2024-04-16T14:39:08.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.626+0000 7f0e8ac31700 1 Processor -- start 2024-04-16T14:39:08.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.626+0000 7f0e8ac31700 1 -- start start 2024-04-16T14:39:08.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.626+0000 7f0e8ac31700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e840fbcf0 0x7f0e84103c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:08.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.627+0000 7f0e8ac31700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e840fcfa0 0x7f0e84102300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:08.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.627+0000 7f0e8ac31700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e84104250 con 0x7f0e840fcfa0 2024-04-16T14:39:08.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.627+0000 7f0e8ac31700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e84102840 con 0x7f0e840fbcf0 2024-04-16T14:39:08.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.627+0000 7f0e7bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e840fcfa0 0x7f0e84102300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:08.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.627+0000 7f0e7bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e840fcfa0 0x7f0e84102300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59832/0 (socket says 172.21.15.5:59832) 2024-04-16T14:39:08.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.627+0000 7f0e7bfff700 1 -- 172.21.15.5:0/1706267967 learned_addr learned my addr 172.21.15.5:0/1706267967 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:39:08.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.627+0000 7f0e889cd700 1 --2- 172.21.15.5:0/1706267967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e840fbcf0 0x7f0e84103c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:08.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.627+0000 7f0e7bfff700 1 -- 172.21.15.5:0/1706267967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e840fbcf0 msgr2=0x7f0e84103c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:08.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.627+0000 7f0e7bfff700 1 --2- 172.21.15.5:0/1706267967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e840fbcf0 0x7f0e84103c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:08.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.627+0000 7f0e7bfff700 1 -- 172.21.15.5:0/1706267967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e74005040 con 0x7f0e840fcfa0 2024-04-16T14:39:08.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.627+0000 7f0e7bfff700 1 --2- 172.21.15.5:0/1706267967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e840fcfa0 0x7f0e84102300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0e74009150 tx=0x7f0e74009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:08.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.627+0000 7f0e797fa700 1 -- 172.21.15.5:0/1706267967 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e7400e040 con 0x7f0e840fcfa0 2024-04-16T14:39:08.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.627+0000 7f0e797fa700 1 -- 172.21.15.5:0/1706267967 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0e74004290 con 0x7f0e840fcfa0 2024-04-16T14:39:08.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.627+0000 7f0e8ac31700 1 -- 172.21.15.5:0/1706267967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e84102a90 con 0x7f0e840fcfa0 2024-04-16T14:39:08.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.627+0000 7f0e797fa700 1 -- 172.21.15.5:0/1706267967 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e7401c630 con 0x7f0e840fcfa0 2024-04-16T14:39:08.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.627+0000 7f0e8ac31700 1 -- 172.21.15.5:0/1706267967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e84103050 con 0x7f0e840fcfa0 2024-04-16T14:39:08.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.629+0000 7f0e8ac31700 1 -- 172.21.15.5:0/1706267967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e8404c710 con 0x7f0e840fcfa0 2024-04-16T14:39:08.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.629+0000 7f0e797fa700 1 -- 172.21.15.5:0/1706267967 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f0e7400bbf0 con 0x7f0e840fcfa0 2024-04-16T14:39:08.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.630+0000 7f0e797fa700 1 --2- 172.21.15.5:0/1706267967 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f0e6c06e140 0x7f0e6c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:08.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.630+0000 7f0e889cd700 1 --2- 172.21.15.5:0/1706267967 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f0e6c06e140 0x7f0e6c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:08.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.630+0000 7f0e797fa700 1 -- 172.21.15.5:0/1706267967 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f0e7408e700 con 0x7f0e840fcfa0 2024-04-16T14:39:08.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.630+0000 7f0e889cd700 1 --2- 172.21.15.5:0/1706267967 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f0e6c06e140 0x7f0e6c0705f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0e80007a40 tx=0x7f0e80009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:08.632 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.634+0000 7f0e797fa700 1 -- 172.21.15.5:0/1706267967 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f0e7405b630 con 0x7f0e840fcfa0 2024-04-16T14:39:08.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:08 smithi115 ceph-mon[83414]: pgmap v60: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:08.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:08 smithi115 ceph-mon[83414]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:39:08.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:08 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:08.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:08 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:39:08.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.932+0000 7f0e8ac31700 1 -- 172.21.15.5:0/1706267967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0e84105a20 con 0x7f0e840fcfa0 2024-04-16T14:39:08.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.933+0000 7f0e797fa700 1 -- 172.21.15.5:0/1706267967 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f0e7405b1c0 con 0x7f0e840fcfa0 2024-04-16T14:39:08.932 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:39:08.932 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-04-16T14:39:08.932 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:39:08.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:39:08.932 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-04-16T14:39:08.932 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:39:08.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:39:08.932 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-04-16T14:39:08.932 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 5, 2024-04-16T14:39:08.932 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 1 2024-04-16T14:39:08.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:39:08.932 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-04-16T14:39:08.933 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 4 2024-04-16T14:39:08.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:39:08.933 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-04-16T14:39:08.933 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 9, 2024-04-16T14:39:08.933 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 5 2024-04-16T14:39:08.933 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-16T14:39:08.933 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:39:08.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.935+0000 7f0e8ac31700 1 -- 172.21.15.5:0/1706267967 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f0e6c06e140 msgr2=0x7f0e6c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:08.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.935+0000 7f0e8ac31700 1 --2- 172.21.15.5:0/1706267967 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f0e6c06e140 0x7f0e6c0705f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0e80007a40 tx=0x7f0e80009da0 comp rx=0 tx=0).stop 2024-04-16T14:39:08.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.935+0000 7f0e8ac31700 1 -- 172.21.15.5:0/1706267967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e840fcfa0 msgr2=0x7f0e84102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:08.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.935+0000 7f0e8ac31700 1 --2- 172.21.15.5:0/1706267967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e840fcfa0 0x7f0e84102300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0e74009150 tx=0x7f0e74009e30 comp rx=0 tx=0).stop 2024-04-16T14:39:08.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.936+0000 7f0e8ac31700 1 -- 172.21.15.5:0/1706267967 shutdown_connections 2024-04-16T14:39:08.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.936+0000 7f0e8ac31700 1 --2- 172.21.15.5:0/1706267967 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f0e6c06e140 0x7f0e6c0705f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:08.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.936+0000 7f0e8ac31700 1 --2- 172.21.15.5:0/1706267967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e840fbcf0 0x7f0e84103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:08.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.936+0000 7f0e8ac31700 1 --2- 172.21.15.5:0/1706267967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0e840fcfa0 0x7f0e84102300 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:08.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.936+0000 7f0e8ac31700 1 -- 172.21.15.5:0/1706267967 >> 172.21.15.5:0/1706267967 conn(0x7f0e840f7450 msgr2=0x7f0e840f8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:08.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.936+0000 7f0e8ac31700 1 -- 172.21.15.5:0/1706267967 shutdown_connections 2024-04-16T14:39:08.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:08.936+0000 7f0e8ac31700 1 -- 172.21.15.5:0/1706267967 wait complete. 2024-04-16T14:39:09.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.039+0000 7fe7d7b52700 1 -- 172.21.15.5:0/440629535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7d00fbcf0 msgr2=0x7fe7d00fc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:09.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.039+0000 7fe7d7b52700 1 --2- 172.21.15.5:0/440629535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7d00fbcf0 0x7fe7d00fc100 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc004940 tx=0x7fe7cc009e30 comp rx=0 tx=0).stop 2024-04-16T14:39:09.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.040+0000 7fe7d7b52700 1 -- 172.21.15.5:0/440629535 shutdown_connections 2024-04-16T14:39:09.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.040+0000 7fe7d7b52700 1 --2- 172.21.15.5:0/440629535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7d00fcfa0 0x7fe7d00fd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:09.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.040+0000 7fe7d7b52700 1 --2- 172.21.15.5:0/440629535 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7d00fbcf0 0x7fe7d00fc100 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:09.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.040+0000 7fe7d7b52700 1 -- 172.21.15.5:0/440629535 >> 172.21.15.5:0/440629535 conn(0x7fe7d00f7450 msgr2=0x7fe7d00f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:09.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.040+0000 7fe7d7b52700 1 -- 172.21.15.5:0/440629535 shutdown_connections 2024-04-16T14:39:09.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.040+0000 7fe7d7b52700 1 -- 172.21.15.5:0/440629535 wait complete. 2024-04-16T14:39:09.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.040+0000 7fe7d7b52700 1 Processor -- start 2024-04-16T14:39:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.040+0000 7fe7d7b52700 1 -- start start 2024-04-16T14:39:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.040+0000 7fe7d7b52700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7d00fbcf0 0x7fe7d010dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.040+0000 7fe7d7b52700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7d00fcfa0 0x7fe7d010e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.040+0000 7fe7d7b52700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d010e880 con 0x7fe7d00fcfa0 2024-04-16T14:39:09.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.040+0000 7fe7d7b52700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d0113220 con 0x7fe7d00fbcf0 2024-04-16T14:39:09.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.041+0000 7fe7d50ed700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7d00fcfa0 0x7fe7d010e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:09.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.041+0000 7fe7d50ed700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7d00fcfa0 0x7fe7d010e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59856/0 (socket says 172.21.15.5:59856) 2024-04-16T14:39:09.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.041+0000 7fe7d50ed700 1 -- 172.21.15.5:0/4261243350 learned_addr learned my addr 172.21.15.5:0/4261243350 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:39:09.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.041+0000 7fe7d58ee700 1 --2- 172.21.15.5:0/4261243350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7d00fbcf0 0x7fe7d010dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:09.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.041+0000 7fe7d50ed700 1 -- 172.21.15.5:0/4261243350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7d00fbcf0 msgr2=0x7fe7d010dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:09.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.041+0000 7fe7d50ed700 1 --2- 172.21.15.5:0/4261243350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7d00fbcf0 0x7fe7d010dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:09.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.041+0000 7fe7d50ed700 1 -- 172.21.15.5:0/4261243350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7cc005040 con 0x7fe7d00fcfa0 2024-04-16T14:39:09.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.041+0000 7fe7d50ed700 1 --2- 172.21.15.5:0/4261243350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7d00fcfa0 0x7fe7d010e200 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0002a50 tx=0x7fe7c00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:09.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.041+0000 7fe7c67fc700 1 -- 172.21.15.5:0/4261243350 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7c0007cc0 con 0x7fe7d00fcfa0 2024-04-16T14:39:09.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.041+0000 7fe7c67fc700 1 -- 172.21.15.5:0/4261243350 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe7c000f040 con 0x7fe7d00fcfa0 2024-04-16T14:39:09.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.041+0000 7fe7c67fc700 1 -- 172.21.15.5:0/4261243350 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7c000da70 con 0x7fe7d00fcfa0 2024-04-16T14:39:09.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.041+0000 7fe7d7b52700 1 -- 172.21.15.5:0/4261243350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d0113420 con 0x7fe7d00fcfa0 2024-04-16T14:39:09.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.041+0000 7fe7d7b52700 1 -- 172.21.15.5:0/4261243350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d0113960 con 0x7fe7d00fcfa0 2024-04-16T14:39:09.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.042+0000 7fe7d7b52700 1 -- 172.21.15.5:0/4261243350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d004c710 con 0x7fe7d00fcfa0 2024-04-16T14:39:09.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.043+0000 7fe7c67fc700 1 -- 172.21.15.5:0/4261243350 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fe7c000dc10 con 0x7fe7d00fcfa0 2024-04-16T14:39:09.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.043+0000 7fe7c67fc700 1 --2- 172.21.15.5:0/4261243350 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe7bc06e140 0x7fe7bc0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:09.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.043+0000 7fe7c67fc700 1 -- 172.21.15.5:0/4261243350 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fe7c008d180 con 0x7fe7d00fcfa0 2024-04-16T14:39:09.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.043+0000 7fe7d58ee700 1 --2- 172.21.15.5:0/4261243350 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe7bc06e140 0x7fe7bc0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:09.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.044+0000 7fe7d58ee700 1 --2- 172.21.15.5:0/4261243350 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe7bc06e140 0x7fe7bc0705f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc000c00 tx=0x7fe7cc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:09.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.048+0000 7fe7c67fc700 1 -- 172.21.15.5:0/4261243350 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fe7c0056500 con 0x7fe7d00fcfa0 2024-04-16T14:39:09.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.309+0000 7fe7d7b52700 1 -- 172.21.15.5:0/4261243350 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe7d00676c0 con 0x7fe7d00fcfa0 2024-04-16T14:39:09.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.309+0000 7fe7c67fc700 1 -- 172.21.15.5:0/4261243350 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1916 (secure 0 0 0) 0x7fe7c0059bc0 con 0x7fe7d00fcfa0 2024-04-16T14:39:09.308 INFO:teuthology.orchestra.run.smithi005.stdout:e20 2024-04-16T14:39:09.308 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:39:09.308 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:39:09.308 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2024-04-16T14:39:09.308 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:39:09.308 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2024-04-16T14:39:09.308 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2024-04-16T14:39:09.308 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 20 2024-04-16T14:39:09.308 INFO:teuthology.orchestra.run.smithi005.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-16T14:39:09.308 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-16T14:32:45.270024+0000 2024-04-16T14:39:09.309 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-04-16T14:35:42.742829+0000 2024-04-16T14:39:09.309 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2024-04-16T14:39:09.309 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2024-04-16T14:39:09.309 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 60 2024-04-16T14:39:09.309 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2024-04-16T14:39:09.309 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2024-04-16T14:39:09.309 INFO:teuthology.orchestra.run.smithi005.stdout:max_xattr_size 65536 2024-04-16T14:39:09.309 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2024-04-16T14:39:09.309 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2024-04-16T14:39:09.309 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 47 2024-04-16T14:39:09.310 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:39:09.310 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 2 2024-04-16T14:39:09.310 INFO:teuthology.orchestra.run.smithi005.stdout:in 0,1 2024-04-16T14:39:09.310 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=14484,1=24269} 2024-04-16T14:39:09.310 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2024-04-16T14:39:09.310 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2024-04-16T14:39:09.310 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 2024-04-16T14:39:09.310 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3] 2024-04-16T14:39:09.310 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2024-04-16T14:39:09.310 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2024-04-16T14:39:09.310 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2024-04-16T14:39:09.311 INFO:teuthology.orchestra.run.smithi005.stdout:bal_rank_mask -1 2024-04-16T14:39:09.311 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 1 2024-04-16T14:39:09.311 INFO:teuthology.orchestra.run.smithi005.stdout:qdb_cluster leader: 0 members: 2024-04-16T14:39:09.311 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.wofqlz{0:14484} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:39:09.311 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.byfytg{1:24269} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.115:6824/1662994117,v1:172.21.15.115:6825/1662994117] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:39:09.311 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:39:09.311 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:39:09.311 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2024-04-16T14:39:09.311 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:39:09.311 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.vzoqdl{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.5:6826/187766809,v1:172.21.15.5:6827/187766809] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:39:09.311 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.trkaqh{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:39:09.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.311+0000 7fe7d7b52700 1 -- 172.21.15.5:0/4261243350 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe7bc06e140 msgr2=0x7fe7bc0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:09.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.311+0000 7fe7d7b52700 1 --2- 172.21.15.5:0/4261243350 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe7bc06e140 0x7fe7bc0705f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc000c00 tx=0x7fe7cc009e30 comp rx=0 tx=0).stop 2024-04-16T14:39:09.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.311+0000 7fe7d7b52700 1 -- 172.21.15.5:0/4261243350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7d00fcfa0 msgr2=0x7fe7d010e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:09.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.311+0000 7fe7d7b52700 1 --2- 172.21.15.5:0/4261243350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7d00fcfa0 0x7fe7d010e200 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0002a50 tx=0x7fe7c00046b0 comp rx=0 tx=0).stop 2024-04-16T14:39:09.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.311+0000 7fe7d7b52700 1 -- 172.21.15.5:0/4261243350 shutdown_connections 2024-04-16T14:39:09.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.311+0000 7fe7d7b52700 1 --2- 172.21.15.5:0/4261243350 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe7bc06e140 0x7fe7bc0705f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:09.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.311+0000 7fe7d7b52700 1 --2- 172.21.15.5:0/4261243350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7d00fbcf0 0x7fe7d010dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:09.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.311+0000 7fe7d7b52700 1 --2- 172.21.15.5:0/4261243350 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7d00fcfa0 0x7fe7d010e200 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:09.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.311+0000 7fe7d7b52700 1 -- 172.21.15.5:0/4261243350 >> 172.21.15.5:0/4261243350 conn(0x7fe7d00f7450 msgr2=0x7fe7d00f8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:09.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.311+0000 7fe7d7b52700 1 -- 172.21.15.5:0/4261243350 shutdown_connections 2024-04-16T14:39:09.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.311+0000 7fe7d7b52700 1 -- 172.21.15.5:0/4261243350 wait complete. 2024-04-16T14:39:09.313 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 20 2024-04-16T14:39:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.417+0000 7f397c6cc700 1 -- 172.21.15.5:0/2505952615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39740fbcf0 msgr2=0x7f39740fc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.417+0000 7f397c6cc700 1 --2- 172.21.15.5:0/2505952615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39740fbcf0 0x7f39740fc100 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3970004940 tx=0x7f3970009e30 comp rx=0 tx=0).stop 2024-04-16T14:39:09.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.418+0000 7f397c6cc700 1 -- 172.21.15.5:0/2505952615 shutdown_connections 2024-04-16T14:39:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.418+0000 7f397c6cc700 1 --2- 172.21.15.5:0/2505952615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39740fcfa0 0x7f39740fd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.418+0000 7f397c6cc700 1 --2- 172.21.15.5:0/2505952615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39740fbcf0 0x7f39740fc100 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.418+0000 7f397c6cc700 1 -- 172.21.15.5:0/2505952615 >> 172.21.15.5:0/2505952615 conn(0x7f39740f7450 msgr2=0x7f39740f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.418+0000 7f397c6cc700 1 -- 172.21.15.5:0/2505952615 shutdown_connections 2024-04-16T14:39:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.418+0000 7f397c6cc700 1 -- 172.21.15.5:0/2505952615 wait complete. 2024-04-16T14:39:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.418+0000 7f397c6cc700 1 Processor -- start 2024-04-16T14:39:09.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.418+0000 7f397c6cc700 1 -- start start 2024-04-16T14:39:09.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.418+0000 7f397c6cc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39740fbcf0 0x7f397410c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:09.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.418+0000 7f397c6cc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39740fcfa0 0x7f397410ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.418+0000 7f397c6cc700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397410d460 con 0x7f39740fbcf0 2024-04-16T14:39:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.418+0000 7f397c6cc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397410dcb0 con 0x7f39740fcfa0 2024-04-16T14:39:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.419+0000 7f397a468700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39740fbcf0 0x7f397410c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.419+0000 7f397a468700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39740fbcf0 0x7f397410c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59868/0 (socket says 172.21.15.5:59868) 2024-04-16T14:39:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.419+0000 7f397a468700 1 -- 172.21.15.5:0/3760034515 learned_addr learned my addr 172.21.15.5:0/3760034515 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:39:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.419+0000 7f3979c67700 1 --2- 172.21.15.5:0/3760034515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39740fcfa0 0x7f397410ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.419+0000 7f397a468700 1 -- 172.21.15.5:0/3760034515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39740fcfa0 msgr2=0x7f397410ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.419+0000 7f397a468700 1 --2- 172.21.15.5:0/3760034515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39740fcfa0 0x7f397410ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.419+0000 7f397a468700 1 -- 172.21.15.5:0/3760034515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3970005040 con 0x7f39740fbcf0 2024-04-16T14:39:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.419+0000 7f397a468700 1 --2- 172.21.15.5:0/3760034515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39740fbcf0 0x7f397410c920 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f397000b3b0 tx=0x7f3970009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.419+0000 7f396affd700 1 -- 172.21.15.5:0/3760034515 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f397000e040 con 0x7f39740fbcf0 2024-04-16T14:39:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.419+0000 7f397c6cc700 1 -- 172.21.15.5:0/3760034515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f397410df30 con 0x7f39740fbcf0 2024-04-16T14:39:09.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.419+0000 7f396affd700 1 -- 172.21.15.5:0/3760034515 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f397000bcc0 con 0x7f39740fbcf0 2024-04-16T14:39:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.419+0000 7f396affd700 1 -- 172.21.15.5:0/3760034515 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f397001c630 con 0x7f39740fbcf0 2024-04-16T14:39:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.419+0000 7f397c6cc700 1 -- 172.21.15.5:0/3760034515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f397410e470 con 0x7f39740fbcf0 2024-04-16T14:39:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.420+0000 7f397c6cc700 1 -- 172.21.15.5:0/3760034515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f397405f5f0 con 0x7f39740fbcf0 2024-04-16T14:39:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.421+0000 7f396affd700 1 -- 172.21.15.5:0/3760034515 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f3970013980 con 0x7f39740fbcf0 2024-04-16T14:39:09.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.421+0000 7f396affd700 1 --2- 172.21.15.5:0/3760034515 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f396006e140 0x7f39600705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.421+0000 7f396affd700 1 -- 172.21.15.5:0/3760034515 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f397008e770 con 0x7f39740fbcf0 2024-04-16T14:39:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.421+0000 7f3979c67700 1 --2- 172.21.15.5:0/3760034515 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f396006e140 0x7f39600705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:09.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.422+0000 7f3979c67700 1 --2- 172.21.15.5:0/3760034515 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f396006e140 0x7f39600705f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3964007fd0 tx=0x7f3964009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:09.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.426+0000 7f396affd700 1 -- 172.21.15.5:0/3760034515 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f397005b6a0 con 0x7f39740fbcf0 2024-04-16T14:39:09.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.662+0000 7f397c6cc700 1 -- 172.21.15.5:0/3760034515 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f397410e7a0 con 0x7f396006e140 2024-04-16T14:39:09.661 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:09 smithi005 ceph-mon[93420]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:39:09.661 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:09 smithi005 ceph-mon[93420]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:39:09.661 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:09 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/1706267967' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:39:09.661 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:09 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-16T14:39:09.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.664+0000 7f396affd700 1 -- 172.21.15.5:0/3760034515 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f397410e7a0 con 0x7f396006e140 2024-04-16T14:39:09.662 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:39:09.662 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91", 2024-04-16T14:39:09.662 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-04-16T14:39:09.662 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-16T14:39:09.662 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [ 2024-04-16T14:39:09.662 INFO:teuthology.orchestra.run.smithi005.stdout: "mon", 2024-04-16T14:39:09.663 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr", 2024-04-16T14:39:09.663 INFO:teuthology.orchestra.run.smithi005.stdout: "crash" 2024-04-16T14:39:09.663 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-04-16T14:39:09.663 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "7/21 daemons upgraded", 2024-04-16T14:39:09.663 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading osd daemons", 2024-04-16T14:39:09.663 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-04-16T14:39:09.663 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:39:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.666+0000 7f397c6cc700 1 -- 172.21.15.5:0/3760034515 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f396006e140 msgr2=0x7f39600705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.666+0000 7f397c6cc700 1 --2- 172.21.15.5:0/3760034515 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f396006e140 0x7f39600705f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3964007fd0 tx=0x7f3964009040 comp rx=0 tx=0).stop 2024-04-16T14:39:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.666+0000 7f397c6cc700 1 -- 172.21.15.5:0/3760034515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39740fbcf0 msgr2=0x7f397410c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.666+0000 7f397c6cc700 1 --2- 172.21.15.5:0/3760034515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39740fbcf0 0x7f397410c920 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f397000b3b0 tx=0x7f3970009e30 comp rx=0 tx=0).stop 2024-04-16T14:39:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.666+0000 7f397c6cc700 1 -- 172.21.15.5:0/3760034515 shutdown_connections 2024-04-16T14:39:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.666+0000 7f397c6cc700 1 --2- 172.21.15.5:0/3760034515 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f396006e140 0x7f39600705f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.666+0000 7f397c6cc700 1 --2- 172.21.15.5:0/3760034515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39740fbcf0 0x7f397410c920 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.666+0000 7f397c6cc700 1 --2- 172.21.15.5:0/3760034515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39740fcfa0 0x7f397410ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.666+0000 7f397c6cc700 1 -- 172.21.15.5:0/3760034515 >> 172.21.15.5:0/3760034515 conn(0x7f39740f7450 msgr2=0x7f39740f8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.666+0000 7f397c6cc700 1 -- 172.21.15.5:0/3760034515 shutdown_connections 2024-04-16T14:39:09.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.666+0000 7f397c6cc700 1 -- 172.21.15.5:0/3760034515 wait complete. 2024-04-16T14:39:09.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:09 smithi115 ceph-mon[83414]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:39:09.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:09 smithi115 ceph-mon[83414]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:39:09.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:09 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/1706267967' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:39:09.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:09 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-16T14:39:09.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.785+0000 7fdb1d84e700 1 -- 172.21.15.5:0/3118132595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb180fbd40 msgr2=0x7fdb180fc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:09.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.785+0000 7fdb1d84e700 1 --2- 172.21.15.5:0/3118132595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb180fbd40 0x7fdb180fc150 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdb08009ce0 tx=0x7fdb08004d10 comp rx=0 tx=0).stop 2024-04-16T14:39:09.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.785+0000 7fdb1d84e700 1 -- 172.21.15.5:0/3118132595 shutdown_connections 2024-04-16T14:39:09.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.785+0000 7fdb1d84e700 1 --2- 172.21.15.5:0/3118132595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb180fcff0 0x7fdb180fd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:09.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.785+0000 7fdb1d84e700 1 --2- 172.21.15.5:0/3118132595 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb180fbd40 0x7fdb180fc150 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:09.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.785+0000 7fdb1d84e700 1 -- 172.21.15.5:0/3118132595 >> 172.21.15.5:0/3118132595 conn(0x7fdb180f74c0 msgr2=0x7fdb180f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:09.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.785+0000 7fdb1d84e700 1 -- 172.21.15.5:0/3118132595 shutdown_connections 2024-04-16T14:39:09.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.785+0000 7fdb1d84e700 1 -- 172.21.15.5:0/3118132595 wait complete. 2024-04-16T14:39:09.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.786+0000 7fdb1d84e700 1 Processor -- start 2024-04-16T14:39:09.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.786+0000 7fdb1d84e700 1 -- start start 2024-04-16T14:39:09.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.786+0000 7fdb1d84e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb180fbd40 0x7fdb1810dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:09.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.786+0000 7fdb1d84e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb180fcff0 0x7fdb1810e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:09.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.786+0000 7fdb1d84e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1810e710 con 0x7fdb180fcff0 2024-04-16T14:39:09.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.786+0000 7fdb1d84e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1810ef10 con 0x7fdb180fbd40 2024-04-16T14:39:09.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.786+0000 7fdb167fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb180fcff0 0x7fdb1810e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:09.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.786+0000 7fdb167fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb180fcff0 0x7fdb1810e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59880/0 (socket says 172.21.15.5:59880) 2024-04-16T14:39:09.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.786+0000 7fdb167fc700 1 -- 172.21.15.5:0/1771661311 learned_addr learned my addr 172.21.15.5:0/1771661311 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:39:09.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.786+0000 7fdb16ffd700 1 --2- 172.21.15.5:0/1771661311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb180fbd40 0x7fdb1810dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:09.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.786+0000 7fdb167fc700 1 -- 172.21.15.5:0/1771661311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb180fbd40 msgr2=0x7fdb1810dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:09.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.786+0000 7fdb167fc700 1 --2- 172.21.15.5:0/1771661311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb180fbd40 0x7fdb1810dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:09.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.786+0000 7fdb167fc700 1 -- 172.21.15.5:0/1771661311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb08009940 con 0x7fdb180fcff0 2024-04-16T14:39:09.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.787+0000 7fdb167fc700 1 --2- 172.21.15.5:0/1771661311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb180fcff0 0x7fdb1810e110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdb0000c830 tx=0x7fdb00004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:09.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.787+0000 7fdb0f7fe700 1 -- 172.21.15.5:0/1771661311 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb000106f0 con 0x7fdb180fcff0 2024-04-16T14:39:09.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.787+0000 7fdb0f7fe700 1 -- 172.21.15.5:0/1771661311 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdb00010d20 con 0x7fdb180fcff0 2024-04-16T14:39:09.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.787+0000 7fdb1d84e700 1 -- 172.21.15.5:0/1771661311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb1810f1f0 con 0x7fdb180fcff0 2024-04-16T14:39:09.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.787+0000 7fdb0f7fe700 1 -- 172.21.15.5:0/1771661311 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb000113a0 con 0x7fdb180fcff0 2024-04-16T14:39:09.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.787+0000 7fdb1d84e700 1 -- 172.21.15.5:0/1771661311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb1810f730 con 0x7fdb180fcff0 2024-04-16T14:39:09.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.788+0000 7fdb1d84e700 1 -- 172.21.15.5:0/1771661311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb18101b80 con 0x7fdb180fcff0 2024-04-16T14:39:09.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.788+0000 7fdb0f7fe700 1 -- 172.21.15.5:0/1771661311 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fdb00012400 con 0x7fdb180fcff0 2024-04-16T14:39:09.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.789+0000 7fdb0f7fe700 1 --2- 172.21.15.5:0/1771661311 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fdb0406e140 0x7fdb040705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:09.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.789+0000 7fdb0f7fe700 1 -- 172.21.15.5:0/1771661311 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fdb0008daa0 con 0x7fdb180fcff0 2024-04-16T14:39:09.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.789+0000 7fdb16ffd700 1 --2- 172.21.15.5:0/1771661311 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fdb0406e140 0x7fdb040705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:09.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.789+0000 7fdb16ffd700 1 --2- 172.21.15.5:0/1771661311 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fdb0406e140 0x7fdb040705f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdb08015040 tx=0x7fdb08004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:09.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:09.794+0000 7fdb0f7fe700 1 -- 172.21.15.5:0/1771661311 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fdb0005a9d0 con 0x7fdb180fcff0 2024-04-16T14:39:10.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:10.098+0000 7fdb1d84e700 1 -- 172.21.15.5:0/1771661311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdb1805f5f0 con 0x7fdb180fcff0 2024-04-16T14:39:10.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:10.098+0000 7fdb0f7fe700 1 -- 172.21.15.5:0/1771661311 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fdb0005a560 con 0x7fdb180fcff0 2024-04-16T14:39:10.097 INFO:teuthology.orchestra.run.smithi005.stdout:HEALTH_OK 2024-04-16T14:39:10.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:10.101+0000 7fdb1d84e700 1 -- 172.21.15.5:0/1771661311 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fdb0406e140 msgr2=0x7fdb040705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:10.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:10.101+0000 7fdb1d84e700 1 --2- 172.21.15.5:0/1771661311 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fdb0406e140 0x7fdb040705f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdb08015040 tx=0x7fdb08004d10 comp rx=0 tx=0).stop 2024-04-16T14:39:10.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:10.101+0000 7fdb1d84e700 1 -- 172.21.15.5:0/1771661311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb180fcff0 msgr2=0x7fdb1810e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:10.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:10.101+0000 7fdb1d84e700 1 --2- 172.21.15.5:0/1771661311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb180fcff0 0x7fdb1810e110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdb0000c830 tx=0x7fdb00004470 comp rx=0 tx=0).stop 2024-04-16T14:39:10.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:10.101+0000 7fdb1d84e700 1 -- 172.21.15.5:0/1771661311 shutdown_connections 2024-04-16T14:39:10.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:10.101+0000 7fdb1d84e700 1 --2- 172.21.15.5:0/1771661311 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fdb0406e140 0x7fdb040705f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:10.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:10.101+0000 7fdb1d84e700 1 --2- 172.21.15.5:0/1771661311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb180fbd40 0x7fdb1810dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:10.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:10.101+0000 7fdb1d84e700 1 --2- 172.21.15.5:0/1771661311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb180fcff0 0x7fdb1810e110 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:10.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:10.101+0000 7fdb1d84e700 1 -- 172.21.15.5:0/1771661311 >> 172.21.15.5:0/1771661311 conn(0x7fdb180f74c0 msgr2=0x7fdb18065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:10.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:10.101+0000 7fdb1d84e700 1 -- 172.21.15.5:0/1771661311 shutdown_connections 2024-04-16T14:39:10.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:10.101+0000 7fdb1d84e700 1 -- 172.21.15.5:0/1771661311 wait complete. 2024-04-16T14:39:10.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:10 smithi115 ceph-mon[83414]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-16T14:39:10.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:10 smithi115 ceph-mon[83414]: Upgrade: osd.1 is safe to restart 2024-04-16T14:39:10.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:10 smithi115 ceph-mon[83414]: pgmap v61: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:10.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:10 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/4261243350' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:39:10.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:10 smithi115 ceph-mon[83414]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:39:10.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:10 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/1771661311' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:39:10.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:10 smithi005 ceph-mon[93420]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-16T14:39:10.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:10 smithi005 ceph-mon[93420]: Upgrade: osd.1 is safe to restart 2024-04-16T14:39:10.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:10 smithi005 ceph-mon[93420]: pgmap v61: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:10.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:10 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/4261243350' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:39:10.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:10 smithi005 ceph-mon[93420]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:39:10.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:10 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/1771661311' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:39:12.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:11 smithi115 ceph-mon[83414]: Upgrade: Updating osd.1 2024-04-16T14:39:12.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:11 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:12.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:11 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-16T14:39:12.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:11 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:39:12.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:11 smithi115 ceph-mon[83414]: Deploying daemon osd.1 on smithi005 2024-04-16T14:39:12.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:11 smithi005 ceph-mon[93420]: Upgrade: Updating osd.1 2024-04-16T14:39:12.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:11 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:12.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:11 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-16T14:39:12.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:11 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:39:12.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:11 smithi005 ceph-mon[93420]: Deploying daemon osd.1 on smithi005 2024-04-16T14:39:13.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:12 smithi115 ceph-mon[83414]: pgmap v62: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:13.214 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:12 smithi005 ceph-mon[93420]: pgmap v62: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:14.417 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:14 smithi005 systemd[1]: Stopping Ceph osd.1 for 10609bfa-fbfd-11ee-bc90-c7b262605968... 2024-04-16T14:39:14.724 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:14 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1[55157]: 2024-04-16T14:39:14.418+0000 7f2ca733f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-16T14:39:14.724 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:14 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1[55157]: 2024-04-16T14:39:14.418+0000 7f2ca733f700 -1 osd.1 55 *** Got signal Terminated *** 2024-04-16T14:39:14.725 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:14 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1[55157]: 2024-04-16T14:39:14.418+0000 7f2ca733f700 -1 osd.1 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-16T14:39:15.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:14 smithi115 ceph-mon[83414]: pgmap v63: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:15.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:14 smithi115 ceph-mon[83414]: osd.1 marked itself down and dead 2024-04-16T14:39:15.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:14 smithi005 ceph-mon[93420]: pgmap v63: 65 pgs: 65 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:15.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:14 smithi005 ceph-mon[93420]: osd.1 marked itself down and dead 2024-04-16T14:39:15.724 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:15 smithi005 podman[107522]: 2024-04-16 14:39:15.450215362 +0000 UTC m=+1.141675848 container died 1868cc6c89f43ba910cfe8062b2cd3b3aef7f58d14bfdcc60e07e84d62d15d5b (image=quay.ceph.io/ceph-ci/ceph@sha256:15b9a118425d53cc97d2f7bc08f63df1d8bfa1149df59d4de72a305b04501998, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=quincy-412a552, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-04-16T14:39:16.110 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:15 smithi005 ceph-mon[93420]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-16T14:39:16.110 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:15 smithi005 ceph-mon[93420]: osdmap e56: 6 total, 5 up, 6 in 2024-04-16T14:39:16.110 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:15 smithi005 ceph-mon[93420]: osdmap e57: 6 total, 5 up, 6 in 2024-04-16T14:39:16.110 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:15 smithi005 podman[107522]: 2024-04-16 14:39:15.885579303 +0000 UTC m=+1.577039784 container cleanup 1868cc6c89f43ba910cfe8062b2cd3b3aef7f58d14bfdcc60e07e84d62d15d5b (image=quay.ceph.io/ceph-ci/ceph@sha256:15b9a118425d53cc97d2f7bc08f63df1d8bfa1149df59d4de72a305b04501998, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=quincy-412a552, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-16T14:39:16.111 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:15 smithi005 bash[107522]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1 2024-04-16T14:39:16.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:15 smithi115 ceph-mon[83414]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-16T14:39:16.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:15 smithi115 ceph-mon[83414]: osdmap e56: 6 total, 5 up, 6 in 2024-04-16T14:39:16.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:15 smithi115 ceph-mon[83414]: osdmap e57: 6 total, 5 up, 6 in 2024-04-16T14:39:16.474 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:16 smithi005 podman[107541]: 2024-04-16 14:39:16.11229851 +0000 UTC m=+0.658745565 container remove 1868cc6c89f43ba910cfe8062b2cd3b3aef7f58d14bfdcc60e07e84d62d15d5b (image=quay.ceph.io/ceph-ci/ceph@sha256:15b9a118425d53cc97d2f7bc08f63df1d8bfa1149df59d4de72a305b04501998, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1, org.label-schema.build-date=20240409, RELEASE=quincy-412a552, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-16T14:39:16.830 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:16 smithi005 podman[107630]: 2024-04-16 14:39:16.459136573 +0000 UTC m=+0.017988110 image pull b1a78730e0db57f46162ae12211512856024b361a698c3ed431f6fbc73b484c3 quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 2024-04-16T14:39:16.830 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:16 smithi005 podman[107630]: 2024-04-16 14:39:16.571675363 +0000 UTC m=+0.130526885 container create 7e3e3f0df9164c686a96dc5dc2880df118cba93812883aca74d1502332d93b1c (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1-deactivate, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-04-16T14:39:16.831 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:16 smithi005 podman[107630]: 2024-04-16 14:39:16.749508274 +0000 UTC m=+0.308359811 container init 7e3e3f0df9164c686a96dc5dc2880df118cba93812883aca74d1502332d93b1c (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-04-16T14:39:16.831 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:16 smithi005 podman[107630]: 2024-04-16 14:39:16.752904318 +0000 UTC m=+0.311755841 container start 7e3e3f0df9164c686a96dc5dc2880df118cba93812883aca74d1502332d93b1c (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1-deactivate, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-16T14:39:16.831 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:16 smithi005 podman[107630]: 2024-04-16 14:39:16.832833398 +0000 UTC m=+0.391684935 container attach 7e3e3f0df9164c686a96dc5dc2880df118cba93812883aca74d1502332d93b1c (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-04-16T14:39:17.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:16 smithi005 ceph-mon[93420]: pgmap v65: 65 pgs: 12 stale+active+clean, 53 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:17.225 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:17 smithi005 podman[107630]: 2024-04-16 14:39:17.053466735 +0000 UTC m=+0.612318258 container died 7e3e3f0df9164c686a96dc5dc2880df118cba93812883aca74d1502332d93b1c (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-16T14:39:17.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:16 smithi115 ceph-mon[83414]: pgmap v65: 65 pgs: 12 stale+active+clean, 53 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:17.974 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:17 smithi005 podman[107656]: 2024-04-16 14:39:17.653338451 +0000 UTC m=+0.594497086 container remove 7e3e3f0df9164c686a96dc5dc2880df118cba93812883aca74d1502332d93b1c (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-04-16T14:39:17.974 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:17 smithi005 systemd[1]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.1.service: Deactivated successfully. 2024-04-16T14:39:17.974 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:17 smithi005 systemd[1]: Stopped Ceph osd.1 for 10609bfa-fbfd-11ee-bc90-c7b262605968. 2024-04-16T14:39:17.975 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:17 smithi005 systemd[1]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.1.service: Consumed 1min 764ms CPU time. 2024-04-16T14:39:17.975 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:17 smithi005 systemd[1]: Starting Ceph osd.1 for 10609bfa-fbfd-11ee-bc90-c7b262605968... 2024-04-16T14:39:18.430 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:18 smithi005 podman[107761]: 2024-04-16 14:39:18.018709086 +0000 UTC m=+0.017960970 image pull b1a78730e0db57f46162ae12211512856024b361a698c3ed431f6fbc73b484c3 quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 2024-04-16T14:39:18.430 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:18 smithi005 podman[107761]: 2024-04-16 14:39:18.121178703 +0000 UTC m=+0.120430635 container create fb0a9077052e016065ff63bdadfcfcb998b96e9d470e4c701de35592c0f30112 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1-activate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240409, ceph=True, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-16T14:39:18.430 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:18 smithi005 podman[107761]: 2024-04-16 14:39:18.349773996 +0000 UTC m=+0.349025873 container init fb0a9077052e016065ff63bdadfcfcb998b96e9d470e4c701de35592c0f30112 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, ceph=True, org.label-schema.schema-version=1.0) 2024-04-16T14:39:18.430 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:18 smithi005 podman[107761]: 2024-04-16 14:39:18.353354158 +0000 UTC m=+0.352606030 container start fb0a9077052e016065ff63bdadfcfcb998b96e9d470e4c701de35592c0f30112 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1-activate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409) 2024-04-16T14:39:18.430 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:18 smithi005 podman[107761]: 2024-04-16 14:39:18.432198246 +0000 UTC m=+0.431450135 container attach fb0a9077052e016065ff63bdadfcfcb998b96e9d470e4c701de35592c0f30112 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1-activate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240409) 2024-04-16T14:39:19.183 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:18 smithi005 ceph-mon[93420]: pgmap v67: 65 pgs: 12 stale+active+clean, 53 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:19.183 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:18 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1-activate[107775]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-16T14:39:19.183 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:18 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1-activate[107775]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-16T14:39:19.183 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:18 smithi005 bash[107761]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-16T14:39:19.183 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:18 smithi005 bash[107761]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-16T14:39:19.183 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:18 smithi005 bash[107761]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-16T14:39:19.183 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:18 smithi005 bash[107761]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-16T14:39:19.183 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:18 smithi005 bash[107761]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-04-16T14:39:19.184 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:18 smithi005 bash[107761]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-16T14:39:19.184 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:18 smithi005 bash[107761]: --> ceph-volume raw activate successful for osd ID: 1 2024-04-16T14:39:19.184 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:18 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1-activate[107775]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-16T14:39:19.184 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:18 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1-activate[107775]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-16T14:39:19.184 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:18 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1-activate[107775]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-04-16T14:39:19.184 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:18 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1-activate[107775]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-16T14:39:19.184 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:18 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1-activate[107775]: --> ceph-volume raw activate successful for osd ID: 1 2024-04-16T14:39:19.184 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:18 smithi005 podman[107761]: 2024-04-16 14:39:18.833505677 +0000 UTC m=+0.832757537 container died fb0a9077052e016065ff63bdadfcfcb998b96e9d470e4c701de35592c0f30112 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1-activate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409) 2024-04-16T14:39:19.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:18 smithi115 ceph-mon[83414]: pgmap v67: 65 pgs: 12 stale+active+clean, 53 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:19.724 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:19 smithi005 podman[107898]: 2024-04-16 14:39:19.469611467 +0000 UTC m=+0.630701224 container remove fb0a9077052e016065ff63bdadfcfcb998b96e9d470e4c701de35592c0f30112 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-16T14:39:19.724 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:19 smithi005 podman[107965]: 2024-04-16 14:39:19.67055527 +0000 UTC m=+0.099794085 container create d930ce515e3e68377b8a91e504dafb5c5c2829fd9c670a151cbff324d85489e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1, org.label-schema.schema-version=1.0, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-16T14:39:19.724 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:19 smithi005 podman[107965]: 2024-04-16 14:39:19.58947424 +0000 UTC m=+0.018713054 image pull b1a78730e0db57f46162ae12211512856024b361a698c3ed431f6fbc73b484c3 quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 2024-04-16T14:39:20.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:19 smithi005 ceph-mon[93420]: Health check failed: Degraded data redundancy: 49/354 objects degraded (13.842%), 14 pgs degraded (PG_DEGRADED) 2024-04-16T14:39:20.224 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:19 smithi005 podman[107965]: 2024-04-16 14:39:19.881257128 +0000 UTC m=+0.310495951 container init d930ce515e3e68377b8a91e504dafb5c5c2829fd9c670a151cbff324d85489e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1, org.label-schema.build-date=20240409, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-16T14:39:20.224 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:19 smithi005 podman[107965]: 2024-04-16 14:39:19.884528746 +0000 UTC m=+0.313767566 container start d930ce515e3e68377b8a91e504dafb5c5c2829fd9c670a151cbff324d85489e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-16T14:39:20.224 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:19 smithi005 ceph-osd[107985]: -- 172.21.15.5:0/3016493299 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c1f74d5680 con 0x55c1f749ec00 2024-04-16T14:39:20.225 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:19 smithi005 bash[107965]: d930ce515e3e68377b8a91e504dafb5c5c2829fd9c670a151cbff324d85489e6 2024-04-16T14:39:20.225 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:19 smithi005 systemd[1]: Started Ceph osd.1 for 10609bfa-fbfd-11ee-bc90-c7b262605968. 2024-04-16T14:39:20.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:19 smithi115 ceph-mon[83414]: Health check failed: Degraded data redundancy: 49/354 objects degraded (13.842%), 14 pgs degraded (PG_DEGRADED) 2024-04-16T14:39:20.724 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:20 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1[107981]: 2024-04-16T14:39:20.427+0000 7f3896c867c0 -1 Falling back to public interface 2024-04-16T14:39:21.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:21 smithi005 ceph-mon[93420]: pgmap v68: 65 pgs: 14 active+undersized+degraded, 3 stale+active+clean, 15 active+undersized, 33 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 49/354 objects degraded (13.842%) 2024-04-16T14:39:21.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:21 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:21.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:21 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:21.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:21 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:39:21.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:21 smithi115 ceph-mon[83414]: pgmap v68: 65 pgs: 14 active+undersized+degraded, 3 stale+active+clean, 15 active+undersized, 33 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 49/354 objects degraded (13.842%) 2024-04-16T14:39:21.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:21 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:21.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:21 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:21.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:21 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:39:23.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:23 smithi005 ceph-mon[93420]: pgmap v69: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/354 objects degraded (15.819%) 2024-04-16T14:39:23.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:23 smithi115 ceph-mon[83414]: pgmap v69: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/354 objects degraded (15.819%) 2024-04-16T14:39:24.548 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:24 smithi005 ceph-mon[93420]: pgmap v70: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/354 objects degraded (15.819%) 2024-04-16T14:39:24.548 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:24.549 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:39:24.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:24 smithi115 ceph-mon[83414]: pgmap v70: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/354 objects degraded (15.819%) 2024-04-16T14:39:24.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:24 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:24.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:24 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:39:25.974 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:25 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1[107981]: 2024-04-16T14:39:25.528+0000 7f3896c867c0 -1 osd.1 55 log_to_monitors true 2024-04-16T14:39:26.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:26 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:26.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:26 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:26.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:26 smithi115 ceph-mon[83414]: from='osd.1 [v2:172.21.15.5:6810/2244573810,v1:172.21.15.5:6811/2244573810]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-16T14:39:26.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:26 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:26.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:26 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:26.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:26 smithi005 ceph-mon[93420]: from='osd.1 [v2:172.21.15.5:6810/2244573810,v1:172.21.15.5:6811/2244573810]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-16T14:39:27.083 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:39:26 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1[107981]: 2024-04-16T14:39:26.805+0000 7f38840d6700 -1 osd.1 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T14:39:27.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:27 smithi115 ceph-mon[83414]: pgmap v71: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/354 objects degraded (15.819%) 2024-04-16T14:39:27.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:27 smithi115 ceph-mon[83414]: from='osd.1 [v2:172.21.15.5:6810/2244573810,v1:172.21.15.5:6811/2244573810]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-16T14:39:27.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:27 smithi115 ceph-mon[83414]: osdmap e58: 6 total, 5 up, 6 in 2024-04-16T14:39:27.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:27 smithi115 ceph-mon[83414]: from='osd.1 [v2:172.21.15.5:6810/2244573810,v1:172.21.15.5:6811/2244573810]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-04-16T14:39:27.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:27 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:27.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:27 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:27.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:27 smithi115 ceph-mon[83414]: from='osd.1 [v2:172.21.15.5:6810/2244573810,v1:172.21.15.5:6811/2244573810]' entity='osd.1' 2024-04-16T14:39:27.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:27 smithi005 ceph-mon[93420]: pgmap v71: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 300 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56/354 objects degraded (15.819%) 2024-04-16T14:39:27.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:27 smithi005 ceph-mon[93420]: from='osd.1 [v2:172.21.15.5:6810/2244573810,v1:172.21.15.5:6811/2244573810]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-16T14:39:27.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:27 smithi005 ceph-mon[93420]: osdmap e58: 6 total, 5 up, 6 in 2024-04-16T14:39:27.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:27 smithi005 ceph-mon[93420]: from='osd.1 [v2:172.21.15.5:6810/2244573810,v1:172.21.15.5:6811/2244573810]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-04-16T14:39:27.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:27 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:27.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:27 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:27.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:27 smithi005 ceph-mon[93420]: from='osd.1 [v2:172.21.15.5:6810/2244573810,v1:172.21.15.5:6811/2244573810]' entity='osd.1' 2024-04-16T14:39:28.173 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:28 smithi005 ceph-mon[93420]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-16T14:39:28.174 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:28 smithi005 ceph-mon[93420]: osd.1 [v2:172.21.15.5:6810/2244573810,v1:172.21.15.5:6811/2244573810] boot 2024-04-16T14:39:28.174 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:28 smithi005 ceph-mon[93420]: osdmap e59: 6 total, 6 up, 6 in 2024-04-16T14:39:28.174 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:28 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-16T14:39:28.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:28 smithi115 ceph-mon[83414]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-16T14:39:28.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:28 smithi115 ceph-mon[83414]: osd.1 [v2:172.21.15.5:6810/2244573810,v1:172.21.15.5:6811/2244573810] boot 2024-04-16T14:39:28.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:28 smithi115 ceph-mon[83414]: osdmap e59: 6 total, 6 up, 6 in 2024-04-16T14:39:28.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:28 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-16T14:39:29.308 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:29 smithi005 ceph-mon[93420]: pgmap v73: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 56/354 objects degraded (15.819%) 2024-04-16T14:39:29.308 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:29 smithi005 ceph-mon[93420]: osdmap e60: 6 total, 6 up, 6 in 2024-04-16T14:39:29.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:29 smithi115 ceph-mon[83414]: pgmap v73: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 56/354 objects degraded (15.819%) 2024-04-16T14:39:29.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:29 smithi115 ceph-mon[83414]: osdmap e60: 6 total, 6 up, 6 in 2024-04-16T14:39:30.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:30 smithi115 ceph-mon[83414]: Health check update: Degraded data redundancy: 56/354 objects degraded (15.819%), 16 pgs degraded (PG_DEGRADED) 2024-04-16T14:39:30.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:30 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:30.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:30 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:30.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:30 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:39:30.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:30 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:39:30.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:30 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:30.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:30 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:39:30.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:30 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:39:30.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:30 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:39:30.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:30 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:39:30.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:30 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-16T14:39:30.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:30 smithi005 ceph-mon[93420]: Health check update: Degraded data redundancy: 56/354 objects degraded (15.819%), 16 pgs degraded (PG_DEGRADED) 2024-04-16T14:39:30.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:30 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:30.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:30 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:30.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:30 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:39:30.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:30 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:39:30.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:30 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:30.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:30 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:39:30.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:30 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:39:30.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:30 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:39:30.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:30 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:39:30.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:30 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-16T14:39:31.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:31 smithi115 ceph-mon[83414]: pgmap v76: 65 pgs: 7 active+undersized+degraded, 7 active+undersized, 51 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 23/354 objects degraded (6.497%) 2024-04-16T14:39:31.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:31 smithi115 ceph-mon[83414]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-16T14:39:31.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:31 smithi115 ceph-mon[83414]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-04-16T14:39:31.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:31 smithi005 ceph-mon[93420]: pgmap v76: 65 pgs: 7 active+undersized+degraded, 7 active+undersized, 51 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 23/354 objects degraded (6.497%) 2024-04-16T14:39:31.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:31 smithi005 ceph-mon[93420]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-16T14:39:31.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:31 smithi005 ceph-mon[93420]: Upgrade: unsafe to stop osd(s) at this time (3 PGs are or would become offline) 2024-04-16T14:39:32.397 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:32 smithi005 ceph-mon[93420]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/354 objects degraded (6.497%), 7 pgs degraded) 2024-04-16T14:39:32.398 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:32 smithi005 ceph-mon[93420]: Cluster is now healthy 2024-04-16T14:39:32.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:32 smithi115 ceph-mon[83414]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/354 objects degraded (6.497%), 7 pgs degraded) 2024-04-16T14:39:32.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:32 smithi115 ceph-mon[83414]: Cluster is now healthy 2024-04-16T14:39:33.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:33 smithi115 ceph-mon[83414]: pgmap v77: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:33.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:33 smithi005 ceph-mon[93420]: pgmap v77: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:35.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:35 smithi115 ceph-mon[83414]: pgmap v78: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:35.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:35 smithi005 ceph-mon[93420]: pgmap v78: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:37.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:37 smithi115 ceph-mon[83414]: pgmap v79: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:37.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:37 smithi005 ceph-mon[93420]: pgmap v79: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:38.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:38 smithi115 ceph-mon[83414]: fsmap cephfs:2 {0=cephfs.smithi005.wofqlz=up:active,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:39:38.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:38 smithi115 ceph-mon[83414]: pgmap v80: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:38.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:38 smithi005 ceph-mon[93420]: fsmap cephfs:2 {0=cephfs.smithi005.wofqlz=up:active,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:39:38.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:38 smithi005 ceph-mon[93420]: pgmap v80: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:39.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:39.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:39:39.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:39.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:39.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:39:39.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.221+0000 7f0891269700 1 -- 172.21.15.5:0/1259164815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f088c0fcf00 msgr2=0x7f088c0fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:40.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.221+0000 7f0891269700 1 --2- 172.21.15.5:0/1259164815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f088c0fcf00 0x7f088c0fd310 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f087c004940 tx=0x7f087c009e30 comp rx=0 tx=0).stop 2024-04-16T14:39:40.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.221+0000 7f0891269700 1 -- 172.21.15.5:0/1259164815 shutdown_connections 2024-04-16T14:39:40.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.221+0000 7f0891269700 1 --2- 172.21.15.5:0/1259164815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f088c0fe070 0x7f088c0fe4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:40.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.221+0000 7f0891269700 1 --2- 172.21.15.5:0/1259164815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f088c0fcf00 0x7f088c0fd310 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:40.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.221+0000 7f0891269700 1 -- 172.21.15.5:0/1259164815 >> 172.21.15.5:0/1259164815 conn(0x7f088c0f85e0 msgr2=0x7f088c0fa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:40.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.221+0000 7f0891269700 1 -- 172.21.15.5:0/1259164815 shutdown_connections 2024-04-16T14:39:40.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.221+0000 7f0891269700 1 -- 172.21.15.5:0/1259164815 wait complete. 2024-04-16T14:39:40.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.222+0000 7f0891269700 1 Processor -- start 2024-04-16T14:39:40.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.222+0000 7f0891269700 1 -- start start 2024-04-16T14:39:40.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.222+0000 7f0891269700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f088c0fcf00 0x7f088c10da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:40.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.222+0000 7f0891269700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f088c0fe070 0x7f088c10df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:40.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.222+0000 7f0891269700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088c10e570 con 0x7f088c0fe070 2024-04-16T14:39:40.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.222+0000 7f0891269700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088c10edc0 con 0x7f088c0fcf00 2024-04-16T14:39:40.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.222+0000 7f0883fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f088c0fe070 0x7f088c10df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:40.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.222+0000 7f0883fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f088c0fe070 0x7f088c10df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34040/0 (socket says 172.21.15.5:34040) 2024-04-16T14:39:40.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.222+0000 7f0883fff700 1 -- 172.21.15.5:0/956676380 learned_addr learned my addr 172.21.15.5:0/956676380 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:39:40.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.222+0000 7f088affd700 1 --2- 172.21.15.5:0/956676380 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f088c0fcf00 0x7f088c10da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:40.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.222+0000 7f0883fff700 1 -- 172.21.15.5:0/956676380 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f088c0fcf00 msgr2=0x7f088c10da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:40.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.222+0000 7f0883fff700 1 --2- 172.21.15.5:0/956676380 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f088c0fcf00 0x7f088c10da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:40.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.222+0000 7f0883fff700 1 -- 172.21.15.5:0/956676380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087c005040 con 0x7f088c0fe070 2024-04-16T14:39:40.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.223+0000 7f0883fff700 1 --2- 172.21.15.5:0/956676380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f088c0fe070 0x7f088c10df70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0874002a50 tx=0x7f08740046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:40.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.223+0000 7f08837fe700 1 -- 172.21.15.5:0/956676380 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0874007cc0 con 0x7f088c0fe070 2024-04-16T14:39:40.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.223+0000 7f0891269700 1 -- 172.21.15.5:0/956676380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f088c10f0a0 con 0x7f088c0fe070 2024-04-16T14:39:40.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.223+0000 7f08837fe700 1 -- 172.21.15.5:0/956676380 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f087400f040 con 0x7f088c0fe070 2024-04-16T14:39:40.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.223+0000 7f08837fe700 1 -- 172.21.15.5:0/956676380 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f087400da30 con 0x7f088c0fe070 2024-04-16T14:39:40.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.223+0000 7f0891269700 1 -- 172.21.15.5:0/956676380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f088c10f5e0 con 0x7f088c0fe070 2024-04-16T14:39:40.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.224+0000 7f0891269700 1 -- 172.21.15.5:0/956676380 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f088c05f5f0 con 0x7f088c0fe070 2024-04-16T14:39:40.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.224+0000 7f08837fe700 1 -- 172.21.15.5:0/956676380 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f087400dbb0 con 0x7f088c0fe070 2024-04-16T14:39:40.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.225+0000 7f08837fe700 1 --2- 172.21.15.5:0/956676380 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f087806e140 0x7f08780705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:40.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.225+0000 7f08837fe700 1 -- 172.21.15.5:0/956676380 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f087408d8c0 con 0x7f088c0fe070 2024-04-16T14:39:40.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.225+0000 7f088affd700 1 --2- 172.21.15.5:0/956676380 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f087806e140 0x7f08780705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:40.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.226+0000 7f088affd700 1 --2- 172.21.15.5:0/956676380 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f087806e140 0x7f08780705f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f087c00b970 tx=0x7f087c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:40.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.230+0000 7f08837fe700 1 -- 172.21.15.5:0/956676380 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f087405a770 con 0x7f088c0fe070 2024-04-16T14:39:40.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.457+0000 7f0891269700 1 -- 172.21.15.5:0/956676380 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f088c10f8c0 con 0x7f087806e140 2024-04-16T14:39:40.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.458+0000 7f08837fe700 1 -- 172.21.15.5:0/956676380 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f088c10f8c0 con 0x7f087806e140 2024-04-16T14:39:40.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.460+0000 7f0891269700 1 -- 172.21.15.5:0/956676380 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f087806e140 msgr2=0x7f08780705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:40.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.460+0000 7f0891269700 1 --2- 172.21.15.5:0/956676380 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f087806e140 0x7f08780705f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f087c00b970 tx=0x7f087c009e30 comp rx=0 tx=0).stop 2024-04-16T14:39:40.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.460+0000 7f0891269700 1 -- 172.21.15.5:0/956676380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f088c0fe070 msgr2=0x7f088c10df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:40.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.460+0000 7f0891269700 1 --2- 172.21.15.5:0/956676380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f088c0fe070 0x7f088c10df70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0874002a50 tx=0x7f08740046b0 comp rx=0 tx=0).stop 2024-04-16T14:39:40.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.460+0000 7f0891269700 1 -- 172.21.15.5:0/956676380 shutdown_connections 2024-04-16T14:39:40.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.460+0000 7f0891269700 1 --2- 172.21.15.5:0/956676380 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f087806e140 0x7f08780705f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:40.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.460+0000 7f0891269700 1 --2- 172.21.15.5:0/956676380 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f088c0fcf00 0x7f088c10da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:40.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.460+0000 7f0891269700 1 --2- 172.21.15.5:0/956676380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f088c0fe070 0x7f088c10df70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:40.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.460+0000 7f0891269700 1 -- 172.21.15.5:0/956676380 >> 172.21.15.5:0/956676380 conn(0x7f088c0f85e0 msgr2=0x7f088c0f9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:40.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.460+0000 7f0891269700 1 -- 172.21.15.5:0/956676380 shutdown_connections 2024-04-16T14:39:40.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.460+0000 7f0891269700 1 -- 172.21.15.5:0/956676380 wait complete. 2024-04-16T14:39:40.469 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-04-16T14:39:40.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:40 smithi005 ceph-mon[93420]: pgmap v81: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:40.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.565+0000 7f67ea374700 1 -- 172.21.15.5:0/1908435558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e40fbcf0 msgr2=0x7f67e40fc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:40.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.565+0000 7f67ea374700 1 --2- 172.21.15.5:0/1908435558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e40fbcf0 0x7f67e40fc100 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f67d4004940 tx=0x7f67d4009e30 comp rx=0 tx=0).stop 2024-04-16T14:39:40.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.565+0000 7f67ea374700 1 -- 172.21.15.5:0/1908435558 shutdown_connections 2024-04-16T14:39:40.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.565+0000 7f67ea374700 1 --2- 172.21.15.5:0/1908435558 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67e40fcfa0 0x7f67e40fd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:40.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.565+0000 7f67ea374700 1 --2- 172.21.15.5:0/1908435558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e40fbcf0 0x7f67e40fc100 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:40.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.565+0000 7f67ea374700 1 -- 172.21.15.5:0/1908435558 >> 172.21.15.5:0/1908435558 conn(0x7f67e40f7450 msgr2=0x7f67e40f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:40.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.565+0000 7f67ea374700 1 -- 172.21.15.5:0/1908435558 shutdown_connections 2024-04-16T14:39:40.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.565+0000 7f67ea374700 1 -- 172.21.15.5:0/1908435558 wait complete. 2024-04-16T14:39:40.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.566+0000 7f67ea374700 1 Processor -- start 2024-04-16T14:39:40.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.566+0000 7f67ea374700 1 -- start start 2024-04-16T14:39:40.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.566+0000 7f67ea374700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e40fbcf0 0x7f67e410fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:40.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.566+0000 7f67ea374700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67e40fcfa0 0x7f67e4110130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:40.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.566+0000 7f67ea374700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e4110730 con 0x7f67e40fbcf0 2024-04-16T14:39:40.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.566+0000 7f67ea374700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e41108a0 con 0x7f67e40fcfa0 2024-04-16T14:39:40.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.566+0000 7f67e3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e40fbcf0 0x7f67e410fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:40.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.566+0000 7f67e3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e40fbcf0 0x7f67e410fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34066/0 (socket says 172.21.15.5:34066) 2024-04-16T14:39:40.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.566+0000 7f67e3fff700 1 -- 172.21.15.5:0/3731390396 learned_addr learned my addr 172.21.15.5:0/3731390396 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:39:40.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.566+0000 7f67dbfff700 1 --2- 172.21.15.5:0/3731390396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67e40fcfa0 0x7f67e4110130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:40.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.567+0000 7f67e3fff700 1 -- 172.21.15.5:0/3731390396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67e40fcfa0 msgr2=0x7f67e4110130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:40.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.567+0000 7f67e3fff700 1 --2- 172.21.15.5:0/3731390396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67e40fcfa0 0x7f67e4110130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:40.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.567+0000 7f67e3fff700 1 -- 172.21.15.5:0/3731390396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d4005040 con 0x7f67e40fbcf0 2024-04-16T14:39:40.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.567+0000 7f67e3fff700 1 --2- 172.21.15.5:0/3731390396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e40fbcf0 0x7f67e410fbf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f67d4009fd0 tx=0x7f67d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:40.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.567+0000 7f67e17fa700 1 -- 172.21.15.5:0/3731390396 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67d400e040 con 0x7f67e40fbcf0 2024-04-16T14:39:40.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.567+0000 7f67e17fa700 1 -- 172.21.15.5:0/3731390396 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f67d400bcc0 con 0x7f67e40fbcf0 2024-04-16T14:39:40.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.567+0000 7f67ea374700 1 -- 172.21.15.5:0/3731390396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e41152a0 con 0x7f67e40fbcf0 2024-04-16T14:39:40.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.567+0000 7f67e17fa700 1 -- 172.21.15.5:0/3731390396 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67d401c630 con 0x7f67e40fbcf0 2024-04-16T14:39:40.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.567+0000 7f67ea374700 1 -- 172.21.15.5:0/3731390396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e4115860 con 0x7f67e40fbcf0 2024-04-16T14:39:40.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.568+0000 7f67ea374700 1 -- 172.21.15.5:0/3731390396 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e4101930 con 0x7f67e40fbcf0 2024-04-16T14:39:40.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.569+0000 7f67e17fa700 1 -- 172.21.15.5:0/3731390396 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f67d4013980 con 0x7f67e40fbcf0 2024-04-16T14:39:40.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.569+0000 7f67e17fa700 1 --2- 172.21.15.5:0/3731390396 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f67d006e140 0x7f67d00705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:40.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.570+0000 7f67e17fa700 1 -- 172.21.15.5:0/3731390396 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f67d408ee80 con 0x7f67e40fbcf0 2024-04-16T14:39:40.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.570+0000 7f67dbfff700 1 --2- 172.21.15.5:0/3731390396 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f67d006e140 0x7f67d00705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:40.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.570+0000 7f67dbfff700 1 --2- 172.21.15.5:0/3731390396 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f67d006e140 0x7f67d00705f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f67cc004f40 tx=0x7f67cc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:40.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.574+0000 7f67e17fa700 1 -- 172.21.15.5:0/3731390396 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f67d405be50 con 0x7f67e40fbcf0 2024-04-16T14:39:40.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:40 smithi115 ceph-mon[83414]: pgmap v81: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:40.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.798+0000 7f67ea374700 1 -- 172.21.15.5:0/3731390396 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f67e402b310 con 0x7f67d006e140 2024-04-16T14:39:40.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.800+0000 7f67e17fa700 1 -- 172.21.15.5:0/3731390396 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f67e402b310 con 0x7f67d006e140 2024-04-16T14:39:40.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.802+0000 7f67ea374700 1 -- 172.21.15.5:0/3731390396 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f67d006e140 msgr2=0x7f67d00705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:40.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.802+0000 7f67ea374700 1 --2- 172.21.15.5:0/3731390396 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f67d006e140 0x7f67d00705f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f67cc004f40 tx=0x7f67cc00b040 comp rx=0 tx=0).stop 2024-04-16T14:39:40.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.802+0000 7f67ea374700 1 -- 172.21.15.5:0/3731390396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e40fbcf0 msgr2=0x7f67e410fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:40.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.802+0000 7f67ea374700 1 --2- 172.21.15.5:0/3731390396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e40fbcf0 0x7f67e410fbf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f67d4009fd0 tx=0x7f67d4009e30 comp rx=0 tx=0).stop 2024-04-16T14:39:40.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.802+0000 7f67ea374700 1 -- 172.21.15.5:0/3731390396 shutdown_connections 2024-04-16T14:39:40.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.802+0000 7f67ea374700 1 --2- 172.21.15.5:0/3731390396 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f67d006e140 0x7f67d00705f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:40.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.802+0000 7f67ea374700 1 --2- 172.21.15.5:0/3731390396 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67e40fbcf0 0x7f67e410fbf0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:40.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.802+0000 7f67ea374700 1 --2- 172.21.15.5:0/3731390396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67e40fcfa0 0x7f67e4110130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:40.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.802+0000 7f67ea374700 1 -- 172.21.15.5:0/3731390396 >> 172.21.15.5:0/3731390396 conn(0x7f67e40f7450 msgr2=0x7f67e40668d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:40.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.802+0000 7f67ea374700 1 -- 172.21.15.5:0/3731390396 shutdown_connections 2024-04-16T14:39:40.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.802+0000 7f67ea374700 1 -- 172.21.15.5:0/3731390396 wait complete. 2024-04-16T14:39:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.905+0000 7f43990ad700 1 -- 172.21.15.5:0/3977500168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43940fbcf0 msgr2=0x7f43940fc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.905+0000 7f43990ad700 1 --2- 172.21.15.5:0/3977500168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43940fbcf0 0x7f43940fc100 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4384004940 tx=0x7f4384009e30 comp rx=0 tx=0).stop 2024-04-16T14:39:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.905+0000 7f43990ad700 1 -- 172.21.15.5:0/3977500168 shutdown_connections 2024-04-16T14:39:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.905+0000 7f43990ad700 1 --2- 172.21.15.5:0/3977500168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43940fcfa0 0x7f43940fd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.905+0000 7f43990ad700 1 --2- 172.21.15.5:0/3977500168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43940fbcf0 0x7f43940fc100 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.905+0000 7f43990ad700 1 -- 172.21.15.5:0/3977500168 >> 172.21.15.5:0/3977500168 conn(0x7f43940f7450 msgr2=0x7f43940f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.905+0000 7f43990ad700 1 -- 172.21.15.5:0/3977500168 shutdown_connections 2024-04-16T14:39:40.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.905+0000 7f43990ad700 1 -- 172.21.15.5:0/3977500168 wait complete. 2024-04-16T14:39:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.906+0000 7f43990ad700 1 Processor -- start 2024-04-16T14:39:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.906+0000 7f43990ad700 1 -- start start 2024-04-16T14:39:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.906+0000 7f43990ad700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43940fbcf0 0x7f439410dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.906+0000 7f43990ad700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43940fcfa0 0x7f439410e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.906+0000 7f43990ad700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439410e860 con 0x7f43940fbcf0 2024-04-16T14:39:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.906+0000 7f43990ad700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4394113200 con 0x7f43940fcfa0 2024-04-16T14:39:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.906+0000 7f4392d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43940fbcf0 0x7f439410dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.906+0000 7f4392d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43940fbcf0 0x7f439410dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34090/0 (socket says 172.21.15.5:34090) 2024-04-16T14:39:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.906+0000 7f4392d9d700 1 -- 172.21.15.5:0/4091331996 learned_addr learned my addr 172.21.15.5:0/4091331996 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:39:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.906+0000 7f439259c700 1 --2- 172.21.15.5:0/4091331996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43940fcfa0 0x7f439410e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:40.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.907+0000 7f4392d9d700 1 -- 172.21.15.5:0/4091331996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43940fcfa0 msgr2=0x7f439410e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.907+0000 7f4392d9d700 1 --2- 172.21.15.5:0/4091331996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43940fcfa0 0x7f439410e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.907+0000 7f4392d9d700 1 -- 172.21.15.5:0/4091331996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4384005040 con 0x7f43940fbcf0 2024-04-16T14:39:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.907+0000 7f4392d9d700 1 --2- 172.21.15.5:0/4091331996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43940fbcf0 0x7f439410dca0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4384009150 tx=0x7f4384009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.907+0000 7f437b7fe700 1 -- 172.21.15.5:0/4091331996 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f438400e040 con 0x7f43940fbcf0 2024-04-16T14:39:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.907+0000 7f437b7fe700 1 -- 172.21.15.5:0/4091331996 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4384004290 con 0x7f43940fbcf0 2024-04-16T14:39:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.907+0000 7f43990ad700 1 -- 172.21.15.5:0/4091331996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43941133a0 con 0x7f43940fbcf0 2024-04-16T14:39:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.907+0000 7f437b7fe700 1 -- 172.21.15.5:0/4091331996 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f438401c630 con 0x7f43940fbcf0 2024-04-16T14:39:40.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.907+0000 7f43990ad700 1 -- 172.21.15.5:0/4091331996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4394113910 con 0x7f43940fbcf0 2024-04-16T14:39:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.908+0000 7f43990ad700 1 -- 172.21.15.5:0/4091331996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f439404c710 con 0x7f43940fbcf0 2024-04-16T14:39:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.909+0000 7f437b7fe700 1 -- 172.21.15.5:0/4091331996 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f438400bbf0 con 0x7f43940fbcf0 2024-04-16T14:39:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.909+0000 7f437b7fe700 1 --2- 172.21.15.5:0/4091331996 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f437c06e140 0x7f437c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.909+0000 7f437b7fe700 1 -- 172.21.15.5:0/4091331996 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f438408e600 con 0x7f43940fbcf0 2024-04-16T14:39:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.909+0000 7f439259c700 1 --2- 172.21.15.5:0/4091331996 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f437c06e140 0x7f437c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:40.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.910+0000 7f439259c700 1 --2- 172.21.15.5:0/4091331996 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f437c06e140 0x7f437c0705f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f439410f170 tx=0x7f438800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:40.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:40.914+0000 7f437b7fe700 1 -- 172.21.15.5:0/4091331996 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f4384057aa0 con 0x7f43940fbcf0 2024-04-16T14:39:41.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.129+0000 7f43990ad700 1 -- 172.21.15.5:0/4091331996 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f43940f9070 con 0x7f437c06e140 2024-04-16T14:39:41.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.139+0000 7f437b7fe700 1 -- 172.21.15.5:0/4091331996 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f43940f9070 con 0x7f437c06e140 2024-04-16T14:39:41.137 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-16T14:39:41.137 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.smithi005 smithi005 *:9093,9094 running (3m) 16s ago 12m 26.0M - 0.25.0 c8568f914cd2 f8aaa22ee70c 2024-04-16T14:39:41.137 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi005 smithi005 running (83s) 16s ago 12m 6656k - 19.0.0-2204-g36befe5d b1a78730e0db d6efa08e65e3 2024-04-16T14:39:41.138 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi115 smithi115 running (77s) 73s ago 11m 6660k - 19.0.0-2204-g36befe5d b1a78730e0db b2a2f2965e2a 2024-04-16T14:39:41.138 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.smithi005 smithi005 *:3000 running (3m) 16s ago 12m 85.9M - 9.4.7 954c08fa6188 9834229a010c 2024-04-16T14:39:41.138 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.vzoqdl smithi005 running (6m) 16s ago 6m 13.3M - 17.2.7-868-g412a5526 b04d96489b7c 84a74a406a1d 2024-04-16T14:39:41.138 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.wofqlz smithi005 running (6m) 16s ago 6m 133M - 17.2.7-868-g412a5526 b04d96489b7c d0e053ab2f72 2024-04-16T14:39:41.138 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.byfytg smithi115 running (6m) 73s ago 6m 118M - 17.2.7-868-g412a5526 b04d96489b7c 595cd0892f66 2024-04-16T14:39:41.138 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.trkaqh smithi115 running (6m) 73s ago 6m 13.7M - 17.2.7-868-g412a5526 b04d96489b7c 5b60cd2ad79b 2024-04-16T14:39:41.139 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi005.ipwdkc smithi005 *:8443,9283,8765 running (3m) 16s ago 13m 499M - 19.0.0-2204-g36befe5d b1a78730e0db 451192b4fc44 2024-04-16T14:39:41.139 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi115.brjkpo smithi115 *:8443,9283,8765 running (2m) 73s ago 11m 448M - 19.0.0-2204-g36befe5d b1a78730e0db 0d75f8211942 2024-04-16T14:39:41.139 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi005 smithi005 running (2m) 16s ago 13m 44.4M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3d0c00924867 2024-04-16T14:39:41.139 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi115 smithi115 running (2m) 73s ago 11m 37.5M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3b916a4928b2 2024-04-16T14:39:41.139 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi005 smithi005 *:9100 running (4m) 16s ago 12m 16.9M - 1.5.0 0da6a335fe13 c09bba584a42 2024-04-16T14:39:41.139 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi115 smithi115 *:9100 running (3m) 73s ago 11m 16.7M - 1.5.0 0da6a335fe13 78cc9cc150c0 2024-04-16T14:39:41.140 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (57s) 16s ago 10m 100M 1559M 19.0.0-2204-g36befe5d b1a78730e0db 91d9246d45e0 2024-04-16T14:39:41.140 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (21s) 16s ago 10m 11.9M 1559M 19.0.0-2204-g36befe5d b1a78730e0db d930ce515e3e 2024-04-16T14:39:41.140 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (9m) 16s ago 9m 189M 1559M 17.2.7-868-g412a5526 b04d96489b7c b12745ae7d18 2024-04-16T14:39:41.140 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi115 running (9m) 73s ago 9m 271M 2581M 17.2.7-868-g412a5526 b04d96489b7c 59f81301ebcf 2024-04-16T14:39:41.140 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi115 running (8m) 73s ago 8m 242M 2581M 17.2.7-868-g412a5526 b04d96489b7c e3ea96b7edd9 2024-04-16T14:39:41.140 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi115 running (8m) 73s ago 8m 227M 2581M 17.2.7-868-g412a5526 b04d96489b7c 456fa074e453 2024-04-16T14:39:41.140 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.smithi005 smithi005 *:9095 running (2m) 16s ago 11m 56.7M - 2.43.0 a07b618ecd1d dc784e58817c 2024-04-16T14:39:41.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.141+0000 7f43990ad700 1 -- 172.21.15.5:0/4091331996 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f437c06e140 msgr2=0x7f437c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:41.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.141+0000 7f43990ad700 1 --2- 172.21.15.5:0/4091331996 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f437c06e140 0x7f437c0705f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f439410f170 tx=0x7f438800b040 comp rx=0 tx=0).stop 2024-04-16T14:39:41.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.141+0000 7f43990ad700 1 -- 172.21.15.5:0/4091331996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43940fbcf0 msgr2=0x7f439410dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:41.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.141+0000 7f43990ad700 1 --2- 172.21.15.5:0/4091331996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43940fbcf0 0x7f439410dca0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4384009150 tx=0x7f4384009e30 comp rx=0 tx=0).stop 2024-04-16T14:39:41.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.141+0000 7f43990ad700 1 -- 172.21.15.5:0/4091331996 shutdown_connections 2024-04-16T14:39:41.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.141+0000 7f43990ad700 1 --2- 172.21.15.5:0/4091331996 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f437c06e140 0x7f437c0705f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.141+0000 7f43990ad700 1 --2- 172.21.15.5:0/4091331996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43940fbcf0 0x7f439410dca0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.141+0000 7f43990ad700 1 --2- 172.21.15.5:0/4091331996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43940fcfa0 0x7f439410e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.141+0000 7f43990ad700 1 -- 172.21.15.5:0/4091331996 >> 172.21.15.5:0/4091331996 conn(0x7f43940f7450 msgr2=0x7f43940f8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.141+0000 7f43990ad700 1 -- 172.21.15.5:0/4091331996 shutdown_connections 2024-04-16T14:39:41.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.141+0000 7f43990ad700 1 -- 172.21.15.5:0/4091331996 wait complete. 2024-04-16T14:39:41.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.245+0000 7ff4a9c83700 1 -- 172.21.15.5:0/2875244492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a40fcff0 msgr2=0x7ff4a40fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:41.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.245+0000 7ff4a9c83700 1 --2- 172.21.15.5:0/2875244492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a40fcff0 0x7ff4a40fd460 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff498004940 tx=0x7ff498009e30 comp rx=0 tx=0).stop 2024-04-16T14:39:41.245 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.245+0000 7ff4a9c83700 1 -- 172.21.15.5:0/2875244492 shutdown_connections 2024-04-16T14:39:41.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.245+0000 7ff4a9c83700 1 --2- 172.21.15.5:0/2875244492 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a40fcff0 0x7ff4a40fd460 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:41.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.245+0000 7ff4a9c83700 1 --2- 172.21.15.5:0/2875244492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4a40fbd40 0x7ff4a40fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:41.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.245+0000 7ff4a9c83700 1 -- 172.21.15.5:0/2875244492 >> 172.21.15.5:0/2875244492 conn(0x7ff4a40f74c0 msgr2=0x7ff4a40f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:41.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.245+0000 7ff4a9c83700 1 -- 172.21.15.5:0/2875244492 shutdown_connections 2024-04-16T14:39:41.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.245+0000 7ff4a9c83700 1 -- 172.21.15.5:0/2875244492 wait complete. 2024-04-16T14:39:41.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.245+0000 7ff4a9c83700 1 Processor -- start 2024-04-16T14:39:41.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.246+0000 7ff4a9c83700 1 -- start start 2024-04-16T14:39:41.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.246+0000 7ff4a9c83700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a40fbd40 0x7ff4a40ffe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:41.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.246+0000 7ff4a9c83700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4a40fcff0 0x7ff4a40fe330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:41.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.246+0000 7ff4a9c83700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a40fe950 con 0x7ff4a40fbd40 2024-04-16T14:39:41.246 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.246+0000 7ff4a9c83700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a40fea90 con 0x7ff4a40fcff0 2024-04-16T14:39:41.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.246+0000 7ff4a37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a40fbd40 0x7ff4a40ffe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:41.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.246+0000 7ff4a37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a40fbd40 0x7ff4a40ffe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34100/0 (socket says 172.21.15.5:34100) 2024-04-16T14:39:41.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.246+0000 7ff4a37fe700 1 -- 172.21.15.5:0/2205371818 learned_addr learned my addr 172.21.15.5:0/2205371818 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:39:41.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.246+0000 7ff4a2ffd700 1 --2- 172.21.15.5:0/2205371818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4a40fcff0 0x7ff4a40fe330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:41.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.246+0000 7ff4a37fe700 1 -- 172.21.15.5:0/2205371818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4a40fcff0 msgr2=0x7ff4a40fe330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:41.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.246+0000 7ff4a37fe700 1 --2- 172.21.15.5:0/2205371818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4a40fcff0 0x7ff4a40fe330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:41.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.246+0000 7ff4a37fe700 1 -- 172.21.15.5:0/2205371818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff498005040 con 0x7ff4a40fbd40 2024-04-16T14:39:41.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.246+0000 7ff4a2ffd700 1 --2- 172.21.15.5:0/2205371818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4a40fcff0 0x7ff4a40fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T14:39:41.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.247+0000 7ff4a37fe700 1 --2- 172.21.15.5:0/2205371818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a40fbd40 0x7ff4a40ffe10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff49400bbb0 tx=0x7ff494009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:41.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.247+0000 7ff48bfff700 1 -- 172.21.15.5:0/2205371818 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4940092e0 con 0x7ff4a40fbd40 2024-04-16T14:39:41.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.247+0000 7ff48bfff700 1 -- 172.21.15.5:0/2205371818 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff49400cbd0 con 0x7ff4a40fbd40 2024-04-16T14:39:41.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.247+0000 7ff4a9c83700 1 -- 172.21.15.5:0/2205371818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a40fed70 con 0x7ff4a40fbd40 2024-04-16T14:39:41.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.247+0000 7ff48bfff700 1 -- 172.21.15.5:0/2205371818 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff494007400 con 0x7ff4a40fbd40 2024-04-16T14:39:41.248 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.247+0000 7ff4a9c83700 1 -- 172.21.15.5:0/2205371818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a4115a90 con 0x7ff4a40fbd40 2024-04-16T14:39:41.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.248+0000 7ff4a9c83700 1 -- 172.21.15.5:0/2205371818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a4101b80 con 0x7ff4a40fbd40 2024-04-16T14:39:41.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.248+0000 7ff48bfff700 1 -- 172.21.15.5:0/2205371818 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7ff494012070 con 0x7ff4a40fbd40 2024-04-16T14:39:41.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.249+0000 7ff48bfff700 1 --2- 172.21.15.5:0/2205371818 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff48c06e140 0x7ff48c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:41.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.249+0000 7ff4a2ffd700 1 --2- 172.21.15.5:0/2205371818 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff48c06e140 0x7ff48c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:41.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.249+0000 7ff48bfff700 1 -- 172.21.15.5:0/2205371818 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6410+0+0 (secure 0 0 0) 0x7ff49408d840 con 0x7ff4a40fbd40 2024-04-16T14:39:41.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.249+0000 7ff4a2ffd700 1 --2- 172.21.15.5:0/2205371818 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff48c06e140 0x7ff48c0705f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff4a41003f0 tx=0x7ff498009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:41.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.253+0000 7ff48bfff700 1 -- 172.21.15.5:0/2205371818 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7ff494056c30 con 0x7ff4a40fbd40 2024-04-16T14:39:41.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.551+0000 7ff4a9c83700 1 -- 172.21.15.5:0/2205371818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff4a41049d0 con 0x7ff4a40fbd40 2024-04-16T14:39:41.550 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:41 smithi005 ceph-mon[93420]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:39:41.550 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:41 smithi005 ceph-mon[93420]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:39:41.550 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:41 smithi005 ceph-mon[93420]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:39:41.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.551+0000 7ff48bfff700 1 -- 172.21.15.5:0/2205371818 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7ff4a41049d0 con 0x7ff4a40fbd40 2024-04-16T14:39:41.551 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:39:41.551 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-04-16T14:39:41.551 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:39:41.551 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:39:41.551 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-04-16T14:39:41.551 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:39:41.551 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:39:41.551 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-04-16T14:39:41.551 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 4, 2024-04-16T14:39:41.551 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:39:41.551 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:39:41.551 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-04-16T14:39:41.551 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 4 2024-04-16T14:39:41.552 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:39:41.552 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-04-16T14:39:41.552 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 8, 2024-04-16T14:39:41.552 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 6 2024-04-16T14:39:41.552 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-16T14:39:41.552 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:39:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.554+0000 7ff4a9c83700 1 -- 172.21.15.5:0/2205371818 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff48c06e140 msgr2=0x7ff48c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:41.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.554+0000 7ff4a9c83700 1 --2- 172.21.15.5:0/2205371818 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff48c06e140 0x7ff48c0705f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff4a41003f0 tx=0x7ff498009e30 comp rx=0 tx=0).stop 2024-04-16T14:39:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.554+0000 7ff4a9c83700 1 -- 172.21.15.5:0/2205371818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a40fbd40 msgr2=0x7ff4a40ffe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.554+0000 7ff4a9c83700 1 --2- 172.21.15.5:0/2205371818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a40fbd40 0x7ff4a40ffe10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff49400bbb0 tx=0x7ff494009840 comp rx=0 tx=0).stop 2024-04-16T14:39:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.554+0000 7ff4a9c83700 1 -- 172.21.15.5:0/2205371818 shutdown_connections 2024-04-16T14:39:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.554+0000 7ff4a9c83700 1 --2- 172.21.15.5:0/2205371818 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff48c06e140 0x7ff48c0705f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.554+0000 7ff4a9c83700 1 --2- 172.21.15.5:0/2205371818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4a40fbd40 0x7ff4a40ffe10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.554+0000 7ff4a9c83700 1 --2- 172.21.15.5:0/2205371818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4a40fcff0 0x7ff4a40fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.554+0000 7ff4a9c83700 1 -- 172.21.15.5:0/2205371818 >> 172.21.15.5:0/2205371818 conn(0x7ff4a40f74c0 msgr2=0x7ff4a4065b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.554+0000 7ff4a9c83700 1 -- 172.21.15.5:0/2205371818 shutdown_connections 2024-04-16T14:39:41.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.554+0000 7ff4a9c83700 1 -- 172.21.15.5:0/2205371818 wait complete. 2024-04-16T14:39:41.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.657+0000 7fe4d91fe700 1 -- 172.21.15.5:0/2484046517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d40fcfa0 msgr2=0x7fe4d40fd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:41.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.657+0000 7fe4d91fe700 1 --2- 172.21.15.5:0/2484046517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d40fcfa0 0x7fe4d40fd410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8004940 tx=0x7fe4c8009e30 comp rx=0 tx=0).stop 2024-04-16T14:39:41.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.657+0000 7fe4d91fe700 1 -- 172.21.15.5:0/2484046517 shutdown_connections 2024-04-16T14:39:41.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.657+0000 7fe4d91fe700 1 --2- 172.21.15.5:0/2484046517 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d40fcfa0 0x7fe4d40fd410 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:41.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.657+0000 7fe4d91fe700 1 --2- 172.21.15.5:0/2484046517 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4d40fbcf0 0x7fe4d40fc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:41.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.657+0000 7fe4d91fe700 1 -- 172.21.15.5:0/2484046517 >> 172.21.15.5:0/2484046517 conn(0x7fe4d40f7450 msgr2=0x7fe4d40f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:41.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.657+0000 7fe4d91fe700 1 -- 172.21.15.5:0/2484046517 shutdown_connections 2024-04-16T14:39:41.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.657+0000 7fe4d91fe700 1 -- 172.21.15.5:0/2484046517 wait complete. 2024-04-16T14:39:41.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.658+0000 7fe4d91fe700 1 Processor -- start 2024-04-16T14:39:41.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.658+0000 7fe4d91fe700 1 -- start start 2024-04-16T14:39:41.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.658+0000 7fe4d91fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d40fbcf0 0x7fe4d410dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:41.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.658+0000 7fe4d91fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4d40fcfa0 0x7fe4d410e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:41.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.658+0000 7fe4d91fe700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d410e8c0 con 0x7fe4d40fbcf0 2024-04-16T14:39:41.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.658+0000 7fe4d91fe700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d41131d0 con 0x7fe4d40fcfa0 2024-04-16T14:39:41.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.658+0000 7fe4d2d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d40fbcf0 0x7fe4d410dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:41.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.658+0000 7fe4d2d9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d40fbcf0 0x7fe4d410dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34116/0 (socket says 172.21.15.5:34116) 2024-04-16T14:39:41.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.658+0000 7fe4d2d9d700 1 -- 172.21.15.5:0/3298530222 learned_addr learned my addr 172.21.15.5:0/3298530222 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:39:41.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.658+0000 7fe4d259c700 1 --2- 172.21.15.5:0/3298530222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4d40fcfa0 0x7fe4d410e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:41.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.659+0000 7fe4d2d9d700 1 -- 172.21.15.5:0/3298530222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4d40fcfa0 msgr2=0x7fe4d410e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:41.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.659+0000 7fe4d2d9d700 1 --2- 172.21.15.5:0/3298530222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4d40fcfa0 0x7fe4d410e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:41.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.659+0000 7fe4d2d9d700 1 -- 172.21.15.5:0/3298530222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c8005040 con 0x7fe4d40fbcf0 2024-04-16T14:39:41.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.659+0000 7fe4d259c700 1 --2- 172.21.15.5:0/3298530222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4d40fcfa0 0x7fe4d410e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T14:39:41.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.659+0000 7fe4d2d9d700 1 --2- 172.21.15.5:0/3298530222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d40fbcf0 0x7fe4d410dca0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe4c400b790 tx=0x7fe4c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:41.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.659+0000 7fe4bb7fe700 1 -- 172.21.15.5:0/3298530222 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4c400f770 con 0x7fe4d40fbcf0 2024-04-16T14:39:41.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.659+0000 7fe4bb7fe700 1 -- 172.21.15.5:0/3298530222 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe4c400fda0 con 0x7fe4d40fbcf0 2024-04-16T14:39:41.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.659+0000 7fe4d91fe700 1 -- 172.21.15.5:0/3298530222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d4113430 con 0x7fe4d40fbcf0 2024-04-16T14:39:41.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.659+0000 7fe4bb7fe700 1 -- 172.21.15.5:0/3298530222 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4c400d310 con 0x7fe4d40fbcf0 2024-04-16T14:39:41.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.659+0000 7fe4d91fe700 1 -- 172.21.15.5:0/3298530222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d41139c0 con 0x7fe4d40fbcf0 2024-04-16T14:39:41.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.660+0000 7fe4d91fe700 1 -- 172.21.15.5:0/3298530222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d4101b30 con 0x7fe4d40fbcf0 2024-04-16T14:39:41.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.661+0000 7fe4bb7fe700 1 -- 172.21.15.5:0/3298530222 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fe4c4010420 con 0x7fe4d40fbcf0 2024-04-16T14:39:41.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.661+0000 7fe4bb7fe700 1 --2- 172.21.15.5:0/3298530222 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe4bc06e140 0x7fe4bc0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:41.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.661+0000 7fe4bb7fe700 1 -- 172.21.15.5:0/3298530222 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fe4c408da80 con 0x7fe4d40fbcf0 2024-04-16T14:39:41.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.661+0000 7fe4d259c700 1 --2- 172.21.15.5:0/3298530222 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe4bc06e140 0x7fe4bc0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:41.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.662+0000 7fe4d259c700 1 --2- 172.21.15.5:0/3298530222 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe4bc06e140 0x7fe4bc0705f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800b3b0 tx=0x7fe4c8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:41.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.666+0000 7fe4bb7fe700 1 -- 172.21.15.5:0/3298530222 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fe4c4056f20 con 0x7fe4d40fbcf0 2024-04-16T14:39:41.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:41 smithi115 ceph-mon[83414]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:39:41.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:41 smithi115 ceph-mon[83414]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:39:41.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:41 smithi115 ceph-mon[83414]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:39:41.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.917+0000 7fe4d91fe700 1 -- 172.21.15.5:0/3298530222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe4d41049a0 con 0x7fe4d40fbcf0 2024-04-16T14:39:41.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.917+0000 7fe4bb7fe700 1 -- 172.21.15.5:0/3298530222 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1914 (secure 0 0 0) 0x7fe4c405a5e0 con 0x7fe4d40fbcf0 2024-04-16T14:39:41.916 INFO:teuthology.orchestra.run.smithi005.stdout:e21 2024-04-16T14:39:41.916 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:39:41.916 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:39:41.916 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2024-04-16T14:39:41.916 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:39:41.916 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2024-04-16T14:39:41.916 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2024-04-16T14:39:41.916 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 21 2024-04-16T14:39:41.917 INFO:teuthology.orchestra.run.smithi005.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-16T14:39:41.917 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-16T14:32:45.270024+0000 2024-04-16T14:39:41.917 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-04-16T14:39:37.155127+0000 2024-04-16T14:39:41.917 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2024-04-16T14:39:41.917 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2024-04-16T14:39:41.917 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 60 2024-04-16T14:39:41.917 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2024-04-16T14:39:41.917 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2024-04-16T14:39:41.917 INFO:teuthology.orchestra.run.smithi005.stdout:max_xattr_size 65536 2024-04-16T14:39:41.917 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2024-04-16T14:39:41.917 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2024-04-16T14:39:41.917 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 47 2024-04-16T14:39:41.917 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:39:41.917 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 2 2024-04-16T14:39:41.917 INFO:teuthology.orchestra.run.smithi005.stdout:in 0,1 2024-04-16T14:39:41.917 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=14484,1=24269} 2024-04-16T14:39:41.918 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2024-04-16T14:39:41.918 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2024-04-16T14:39:41.918 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 2024-04-16T14:39:41.918 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3] 2024-04-16T14:39:41.918 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2024-04-16T14:39:41.918 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2024-04-16T14:39:41.918 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2024-04-16T14:39:41.918 INFO:teuthology.orchestra.run.smithi005.stdout:bal_rank_mask -1 2024-04-16T14:39:41.918 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 1 2024-04-16T14:39:41.918 INFO:teuthology.orchestra.run.smithi005.stdout:qdb_cluster leader: 14484 members: 14484,24269 2024-04-16T14:39:41.918 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.wofqlz{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:39:41.918 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.byfytg{1:24269} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.115:6824/1662994117,v1:172.21.15.115:6825/1662994117] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:39:41.918 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:39:41.918 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:39:41.919 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2024-04-16T14:39:41.919 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:39:41.919 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.vzoqdl{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.5:6826/187766809,v1:172.21.15.5:6827/187766809] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:39:41.919 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.trkaqh{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:39:41.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.920+0000 7fe4d91fe700 1 -- 172.21.15.5:0/3298530222 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe4bc06e140 msgr2=0x7fe4bc0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:41.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.920+0000 7fe4d91fe700 1 --2- 172.21.15.5:0/3298530222 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe4bc06e140 0x7fe4bc0705f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800b3b0 tx=0x7fe4c8009e30 comp rx=0 tx=0).stop 2024-04-16T14:39:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.920+0000 7fe4d91fe700 1 -- 172.21.15.5:0/3298530222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d40fbcf0 msgr2=0x7fe4d410dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.920+0000 7fe4d91fe700 1 --2- 172.21.15.5:0/3298530222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d40fbcf0 0x7fe4d410dca0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe4c400b790 tx=0x7fe4c4009250 comp rx=0 tx=0).stop 2024-04-16T14:39:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.920+0000 7fe4d91fe700 1 -- 172.21.15.5:0/3298530222 shutdown_connections 2024-04-16T14:39:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.920+0000 7fe4d91fe700 1 --2- 172.21.15.5:0/3298530222 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe4bc06e140 0x7fe4bc0705f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.920+0000 7fe4d91fe700 1 --2- 172.21.15.5:0/3298530222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4d40fbcf0 0x7fe4d410dca0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.920+0000 7fe4d91fe700 1 --2- 172.21.15.5:0/3298530222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4d40fcfa0 0x7fe4d410e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.920+0000 7fe4d91fe700 1 -- 172.21.15.5:0/3298530222 >> 172.21.15.5:0/3298530222 conn(0x7fe4d40f7450 msgr2=0x7fe4d4066ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.921+0000 7fe4d91fe700 1 -- 172.21.15.5:0/3298530222 shutdown_connections 2024-04-16T14:39:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:41.921+0000 7fe4d91fe700 1 -- 172.21.15.5:0/3298530222 wait complete. 2024-04-16T14:39:41.920 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 21 2024-04-16T14:39:42.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.025+0000 7fb468bd9700 1 -- 172.21.15.5:0/2397242308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb464102330 msgr2=0x7fb464104710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:42.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.025+0000 7fb468bd9700 1 --2- 172.21.15.5:0/2397242308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb464102330 0x7fb464104710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb458004940 tx=0x7fb458009e30 comp rx=0 tx=0).stop 2024-04-16T14:39:42.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.025+0000 7fb468bd9700 1 -- 172.21.15.5:0/2397242308 shutdown_connections 2024-04-16T14:39:42.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.025+0000 7fb468bd9700 1 --2- 172.21.15.5:0/2397242308 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb464102330 0x7fb464104710 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:42.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.025+0000 7fb468bd9700 1 --2- 172.21.15.5:0/2397242308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb464066f80 0x7fb464101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:42.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.025+0000 7fb468bd9700 1 -- 172.21.15.5:0/2397242308 >> 172.21.15.5:0/2397242308 conn(0x7fb4640f74a0 msgr2=0x7fb4640f98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:42.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.025+0000 7fb468bd9700 1 -- 172.21.15.5:0/2397242308 shutdown_connections 2024-04-16T14:39:42.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.025+0000 7fb468bd9700 1 -- 172.21.15.5:0/2397242308 wait complete. 2024-04-16T14:39:42.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.025+0000 7fb468bd9700 1 Processor -- start 2024-04-16T14:39:42.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.025+0000 7fb468bd9700 1 -- start start 2024-04-16T14:39:42.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.025+0000 7fb468bd9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb464066f80 0x7fb46410fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:42.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.025+0000 7fb468bd9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb464102330 0x7fb4641100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:42.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.026+0000 7fb468bd9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4641106c0 con 0x7fb464102330 2024-04-16T14:39:42.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.026+0000 7fb468bd9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb464110830 con 0x7fb464066f80 2024-04-16T14:39:42.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.026+0000 7fb461d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb464102330 0x7fb4641100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:42.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.026+0000 7fb461d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb464102330 0x7fb4641100c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34128/0 (socket says 172.21.15.5:34128) 2024-04-16T14:39:42.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.026+0000 7fb461d9b700 1 -- 172.21.15.5:0/2682398447 learned_addr learned my addr 172.21.15.5:0/2682398447 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:39:42.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.026+0000 7fb46259c700 1 --2- 172.21.15.5:0/2682398447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb464066f80 0x7fb46410fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:42.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.026+0000 7fb461d9b700 1 -- 172.21.15.5:0/2682398447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb464066f80 msgr2=0x7fb46410fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:42.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.026+0000 7fb461d9b700 1 --2- 172.21.15.5:0/2682398447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb464066f80 0x7fb46410fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:42.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.026+0000 7fb461d9b700 1 -- 172.21.15.5:0/2682398447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb458005040 con 0x7fb464102330 2024-04-16T14:39:42.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.026+0000 7fb46259c700 1 --2- 172.21.15.5:0/2682398447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb464066f80 0x7fb46410fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:39:42.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.026+0000 7fb461d9b700 1 --2- 172.21.15.5:0/2682398447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb464102330 0x7fb4641100c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb45800b3b0 tx=0x7fb458009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:42.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.026+0000 7fb452ffd700 1 -- 172.21.15.5:0/2682398447 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb45800e040 con 0x7fb464102330 2024-04-16T14:39:42.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.026+0000 7fb468bd9700 1 -- 172.21.15.5:0/2682398447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb464115230 con 0x7fb464102330 2024-04-16T14:39:42.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.026+0000 7fb452ffd700 1 -- 172.21.15.5:0/2682398447 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb45800bcc0 con 0x7fb464102330 2024-04-16T14:39:42.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.026+0000 7fb452ffd700 1 -- 172.21.15.5:0/2682398447 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb45801c630 con 0x7fb464102330 2024-04-16T14:39:42.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.026+0000 7fb468bd9700 1 -- 172.21.15.5:0/2682398447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4641157f0 con 0x7fb464102330 2024-04-16T14:39:42.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.027+0000 7fb468bd9700 1 -- 172.21.15.5:0/2682398447 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb46404c710 con 0x7fb464102330 2024-04-16T14:39:42.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.028+0000 7fb452ffd700 1 -- 172.21.15.5:0/2682398447 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fb458013980 con 0x7fb464102330 2024-04-16T14:39:42.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.028+0000 7fb452ffd700 1 --2- 172.21.15.5:0/2682398447 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fb44c06e140 0x7fb44c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:42.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.028+0000 7fb452ffd700 1 -- 172.21.15.5:0/2682398447 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fb45808e850 con 0x7fb464102330 2024-04-16T14:39:42.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.028+0000 7fb46259c700 1 --2- 172.21.15.5:0/2682398447 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fb44c06e140 0x7fb44c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:42.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.029+0000 7fb46259c700 1 --2- 172.21.15.5:0/2682398447 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fb44c06e140 0x7fb44c0705f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb454007fd0 tx=0x7fb454009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:42.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.033+0000 7fb452ffd700 1 -- 172.21.15.5:0/2682398447 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fb45805b700 con 0x7fb464102330 2024-04-16T14:39:42.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.260+0000 7fb468bd9700 1 -- 172.21.15.5:0/2682398447 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4640f8f90 con 0x7fb44c06e140 2024-04-16T14:39:42.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.261+0000 7fb452ffd700 1 -- 172.21.15.5:0/2682398447 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb4640f8f90 con 0x7fb44c06e140 2024-04-16T14:39:42.260 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:39:42.260 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91", 2024-04-16T14:39:42.260 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-04-16T14:39:42.260 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-16T14:39:42.260 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [ 2024-04-16T14:39:42.261 INFO:teuthology.orchestra.run.smithi005.stdout: "mon", 2024-04-16T14:39:42.261 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr", 2024-04-16T14:39:42.261 INFO:teuthology.orchestra.run.smithi005.stdout: "crash" 2024-04-16T14:39:42.261 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-04-16T14:39:42.261 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "8/21 daemons upgraded", 2024-04-16T14:39:42.261 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading osd daemons", 2024-04-16T14:39:42.262 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-04-16T14:39:42.262 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:39:42.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.263+0000 7fb468bd9700 1 -- 172.21.15.5:0/2682398447 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fb44c06e140 msgr2=0x7fb44c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:42.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.263+0000 7fb468bd9700 1 --2- 172.21.15.5:0/2682398447 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fb44c06e140 0x7fb44c0705f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb454007fd0 tx=0x7fb454009040 comp rx=0 tx=0).stop 2024-04-16T14:39:42.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.263+0000 7fb468bd9700 1 -- 172.21.15.5:0/2682398447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb464102330 msgr2=0x7fb4641100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:42.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.263+0000 7fb468bd9700 1 --2- 172.21.15.5:0/2682398447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb464102330 0x7fb4641100c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb45800b3b0 tx=0x7fb458009e30 comp rx=0 tx=0).stop 2024-04-16T14:39:42.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.263+0000 7fb468bd9700 1 -- 172.21.15.5:0/2682398447 shutdown_connections 2024-04-16T14:39:42.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.263+0000 7fb468bd9700 1 --2- 172.21.15.5:0/2682398447 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fb44c06e140 0x7fb44c0705f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:42.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.263+0000 7fb468bd9700 1 --2- 172.21.15.5:0/2682398447 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb464066f80 0x7fb46410fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.263+0000 7fb468bd9700 1 --2- 172.21.15.5:0/2682398447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb464102330 0x7fb4641100c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.263+0000 7fb468bd9700 1 -- 172.21.15.5:0/2682398447 >> 172.21.15.5:0/2682398447 conn(0x7fb4640f74a0 msgr2=0x7fb4640f7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.263+0000 7fb468bd9700 1 -- 172.21.15.5:0/2682398447 shutdown_connections 2024-04-16T14:39:42.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.263+0000 7fb468bd9700 1 -- 172.21.15.5:0/2682398447 wait complete. 2024-04-16T14:39:42.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.366+0000 7f204db9e700 1 -- 172.21.15.5:0/2761873416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20480fcc20 msgr2=0x7f20480fd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:42.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.367+0000 7f204db9e700 1 --2- 172.21.15.5:0/2761873416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20480fcc20 0x7f20480fd030 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f203c004940 tx=0x7f203c009e30 comp rx=0 tx=0).stop 2024-04-16T14:39:42.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.367+0000 7f204db9e700 1 -- 172.21.15.5:0/2761873416 shutdown_connections 2024-04-16T14:39:42.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.367+0000 7f204db9e700 1 --2- 172.21.15.5:0/2761873416 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20480fded0 0x7f20480fe340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:42.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.367+0000 7f204db9e700 1 --2- 172.21.15.5:0/2761873416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20480fcc20 0x7f20480fd030 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:42.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.367+0000 7f204db9e700 1 -- 172.21.15.5:0/2761873416 >> 172.21.15.5:0/2761873416 conn(0x7f20480f83a0 msgr2=0x7f20480fa7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:42.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.367+0000 7f204db9e700 1 -- 172.21.15.5:0/2761873416 shutdown_connections 2024-04-16T14:39:42.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.367+0000 7f204db9e700 1 -- 172.21.15.5:0/2761873416 wait complete. 2024-04-16T14:39:42.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.367+0000 7f204db9e700 1 Processor -- start 2024-04-16T14:39:42.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.367+0000 7f204db9e700 1 -- start start 2024-04-16T14:39:42.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.368+0000 7f204db9e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20480fcc20 0x7f2048071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:42.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.368+0000 7f204db9e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20480fded0 0x7f2048070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:42.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.368+0000 7f204db9e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20480708c0 con 0x7f20480fded0 2024-04-16T14:39:42.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.368+0000 7f204db9e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2048070a30 con 0x7f20480fcc20 2024-04-16T14:39:42.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.368+0000 7f2047fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20480fded0 0x7f2048070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:42.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.368+0000 7f2047fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20480fded0 0x7f2048070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34136/0 (socket says 172.21.15.5:34136) 2024-04-16T14:39:42.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.368+0000 7f2047fff700 1 -- 172.21.15.5:0/2773073932 learned_addr learned my addr 172.21.15.5:0/2773073932 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:39:42.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.368+0000 7f204cb9c700 1 --2- 172.21.15.5:0/2773073932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20480fcc20 0x7f2048071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:42.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.368+0000 7f2047fff700 1 -- 172.21.15.5:0/2773073932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20480fcc20 msgr2=0x7f2048071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:42.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.368+0000 7f2047fff700 1 --2- 172.21.15.5:0/2773073932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20480fcc20 0x7f2048071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:42.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.368+0000 7f2047fff700 1 -- 172.21.15.5:0/2773073932 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203c005040 con 0x7f20480fded0 2024-04-16T14:39:42.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.368+0000 7f2047fff700 1 --2- 172.21.15.5:0/2773073932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20480fded0 0x7f2048070310 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f203400eb40 tx=0x7f203400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:42.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.368+0000 7f20457fa700 1 -- 172.21.15.5:0/2773073932 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2034007cc0 con 0x7f20480fded0 2024-04-16T14:39:42.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.368+0000 7f20457fa700 1 -- 172.21.15.5:0/2773073932 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f203400f040 con 0x7f20480fded0 2024-04-16T14:39:42.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.368+0000 7f204db9e700 1 -- 172.21.15.5:0/2773073932 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2048070cb0 con 0x7f20480fded0 2024-04-16T14:39:42.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.368+0000 7f20457fa700 1 -- 172.21.15.5:0/2773073932 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f203400ca10 con 0x7f20480fded0 2024-04-16T14:39:42.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.368+0000 7f204db9e700 1 -- 172.21.15.5:0/2773073932 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2048115810 con 0x7f20480fded0 2024-04-16T14:39:42.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.369+0000 7f204db9e700 1 -- 172.21.15.5:0/2773073932 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20480fc020 con 0x7f20480fded0 2024-04-16T14:39:42.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.370+0000 7f20457fa700 1 -- 172.21.15.5:0/2773073932 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f203400cb70 con 0x7f20480fded0 2024-04-16T14:39:42.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.370+0000 7f20457fa700 1 --2- 172.21.15.5:0/2773073932 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f203806e140 0x7f20380705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:39:42.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.370+0000 7f20457fa700 1 -- 172.21.15.5:0/2773073932 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f203408d620 con 0x7f20480fded0 2024-04-16T14:39:42.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.370+0000 7f204cb9c700 1 --2- 172.21.15.5:0/2773073932 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f203806e140 0x7f20380705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:39:42.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.371+0000 7f204cb9c700 1 --2- 172.21.15.5:0/2773073932 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f203806e140 0x7f20380705f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f203c013870 tx=0x7f203c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:39:42.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.375+0000 7f20457fa700 1 -- 172.21.15.5:0/2773073932 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f2034056ad0 con 0x7f20480fded0 2024-04-16T14:39:42.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.675+0000 7f204db9e700 1 -- 172.21.15.5:0/2773073932 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f20481159a0 con 0x7f20480fded0 2024-04-16T14:39:42.674 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:42 smithi005 ceph-mon[93420]: pgmap v82: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:42.674 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:42 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/2205371818' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:39:42.674 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:42 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/3298530222' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:39:42.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.676+0000 7f20457fa700 1 -- 172.21.15.5:0/2773073932 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f203405a190 con 0x7f20480fded0 2024-04-16T14:39:42.675 INFO:teuthology.orchestra.run.smithi005.stdout:HEALTH_OK 2024-04-16T14:39:42.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.678+0000 7f204db9e700 1 -- 172.21.15.5:0/2773073932 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f203806e140 msgr2=0x7f20380705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.678+0000 7f204db9e700 1 --2- 172.21.15.5:0/2773073932 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f203806e140 0x7f20380705f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f203c013870 tx=0x7f203c009e30 comp rx=0 tx=0).stop 2024-04-16T14:39:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.678+0000 7f204db9e700 1 -- 172.21.15.5:0/2773073932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20480fded0 msgr2=0x7f2048070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:39:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.678+0000 7f204db9e700 1 --2- 172.21.15.5:0/2773073932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20480fded0 0x7f2048070310 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f203400eb40 tx=0x7f203400b040 comp rx=0 tx=0).stop 2024-04-16T14:39:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.678+0000 7f204db9e700 1 -- 172.21.15.5:0/2773073932 shutdown_connections 2024-04-16T14:39:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.678+0000 7f204db9e700 1 --2- 172.21.15.5:0/2773073932 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f203806e140 0x7f20380705f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.678+0000 7f204db9e700 1 --2- 172.21.15.5:0/2773073932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20480fcc20 0x7f2048071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.678+0000 7f204db9e700 1 --2- 172.21.15.5:0/2773073932 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20480fded0 0x7f2048070310 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:39:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.678+0000 7f204db9e700 1 -- 172.21.15.5:0/2773073932 >> 172.21.15.5:0/2773073932 conn(0x7f20480f83a0 msgr2=0x7f20480f9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:39:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.678+0000 7f204db9e700 1 -- 172.21.15.5:0/2773073932 shutdown_connections 2024-04-16T14:39:42.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:39:42.678+0000 7f204db9e700 1 -- 172.21.15.5:0/2773073932 wait complete. 2024-04-16T14:39:42.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:42 smithi115 ceph-mon[83414]: pgmap v82: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:42.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:42 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/2205371818' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:39:42.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:42 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/3298530222' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:39:43.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:43 smithi115 ceph-mon[83414]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:39:43.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:43 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/2773073932' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:39:43.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:43 smithi005 ceph-mon[93420]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:39:43.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:43 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/2773073932' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:39:44.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:44 smithi115 ceph-mon[83414]: pgmap v83: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:44.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:44 smithi005 ceph-mon[93420]: pgmap v83: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:45.584 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:45 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-16T14:39:45.584 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:45 smithi005 ceph-mon[93420]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-16T14:39:45.584 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:45 smithi005 ceph-mon[93420]: Upgrade: osd.2 is safe to restart 2024-04-16T14:39:45.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:45 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-16T14:39:45.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:45 smithi115 ceph-mon[83414]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-16T14:39:45.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:45 smithi115 ceph-mon[83414]: Upgrade: osd.2 is safe to restart 2024-04-16T14:39:46.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:46 smithi115 ceph-mon[83414]: pgmap v84: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:46.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:46 smithi005 ceph-mon[93420]: pgmap v84: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:47.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:47 smithi005 ceph-mon[93420]: Upgrade: Updating osd.2 2024-04-16T14:39:47.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:47 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:47.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:47 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-16T14:39:47.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:47 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:39:47.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:47 smithi005 ceph-mon[93420]: Deploying daemon osd.2 on smithi005 2024-04-16T14:39:47.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:47 smithi115 ceph-mon[83414]: Upgrade: Updating osd.2 2024-04-16T14:39:47.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:47 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:47.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:47 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-16T14:39:47.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:47 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:39:47.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:47 smithi115 ceph-mon[83414]: Deploying daemon osd.2 on smithi005 2024-04-16T14:39:48.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:48 smithi005 ceph-mon[93420]: pgmap v85: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:48.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:48 smithi115 ceph-mon[83414]: pgmap v85: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:49.993 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:49 smithi005 systemd[1]: Stopping Ceph osd.2 for 10609bfa-fbfd-11ee-bc90-c7b262605968... 2024-04-16T14:39:50.474 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:49 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2[62661]: 2024-04-16T14:39:49.994+0000 7f48e4bea700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-16T14:39:50.475 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:49 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2[62661]: 2024-04-16T14:39:49.994+0000 7f48e4bea700 -1 osd.2 60 *** Got signal Terminated *** 2024-04-16T14:39:50.475 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:49 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2[62661]: 2024-04-16T14:39:49.994+0000 7f48e4bea700 -1 osd.2 60 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-16T14:39:50.901 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:50 smithi005 ceph-mon[93420]: pgmap v86: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:50.901 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:50 smithi005 ceph-mon[93420]: osd.2 marked itself down and dead 2024-04-16T14:39:50.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:50 smithi115 ceph-mon[83414]: pgmap v86: 65 pgs: 65 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:50.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:50 smithi115 ceph-mon[83414]: osd.2 marked itself down and dead 2024-04-16T14:39:51.224 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:50 smithi005 podman[112892]: 2024-04-16 14:39:50.903818329 +0000 UTC m=+1.015465031 container died b12745ae7d18a73b0a3c2cd264b201397fe32b4bc87b3ed825edc276f9e4d6b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:15b9a118425d53cc97d2f7bc08f63df1d8bfa1149df59d4de72a305b04501998, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=quincy-412a552, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-16T14:39:51.535 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:51 smithi005 podman[112892]: 2024-04-16 14:39:51.311017742 +0000 UTC m=+1.422664439 container cleanup b12745ae7d18a73b0a3c2cd264b201397fe32b4bc87b3ed825edc276f9e4d6b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:15b9a118425d53cc97d2f7bc08f63df1d8bfa1149df59d4de72a305b04501998, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=quincy-412a552, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True) 2024-04-16T14:39:51.535 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:51 smithi005 bash[112892]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2 2024-04-16T14:39:51.891 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:51 smithi005 ceph-mon[93420]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-16T14:39:51.891 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:51 smithi005 ceph-mon[93420]: osdmap e61: 6 total, 5 up, 6 in 2024-04-16T14:39:51.891 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:51 smithi005 podman[112909]: 2024-04-16 14:39:51.53753084 +0000 UTC m=+0.631612127 container remove b12745ae7d18a73b0a3c2cd264b201397fe32b4bc87b3ed825edc276f9e4d6b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:15b9a118425d53cc97d2f7bc08f63df1d8bfa1149df59d4de72a305b04501998, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-412a552) 2024-04-16T14:39:51.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:51 smithi115 ceph-mon[83414]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-16T14:39:51.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:51 smithi115 ceph-mon[83414]: osdmap e61: 6 total, 5 up, 6 in 2024-04-16T14:39:52.181 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:51 smithi005 podman[112999]: 2024-04-16 14:39:51.79668814 +0000 UTC m=+0.018362026 image pull b1a78730e0db57f46162ae12211512856024b361a698c3ed431f6fbc73b484c3 quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 2024-04-16T14:39:52.181 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:51 smithi005 podman[112999]: 2024-04-16 14:39:51.897048125 +0000 UTC m=+0.118721992 container create 4ea9fc8a057d05389394dd433e65060fb0ccb9c1c954d70009dee7d8e110cc00 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-16T14:39:52.181 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:52 smithi005 podman[112999]: 2024-04-16 14:39:52.116385108 +0000 UTC m=+0.338058989 container init 4ea9fc8a057d05389394dd433e65060fb0ccb9c1c954d70009dee7d8e110cc00 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2-deactivate, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-16T14:39:52.181 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:52 smithi005 podman[112999]: 2024-04-16 14:39:52.120206323 +0000 UTC m=+0.341880193 container start 4ea9fc8a057d05389394dd433e65060fb0ccb9c1c954d70009dee7d8e110cc00 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, ceph=True, org.label-schema.build-date=20240409, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-16T14:39:52.181 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:52 smithi005 podman[112999]: 2024-04-16 14:39:52.182956287 +0000 UTC m=+0.404630174 container attach 4ea9fc8a057d05389394dd433e65060fb0ccb9c1c954d70009dee7d8e110cc00 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2-deactivate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-04-16T14:39:52.474 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:52 smithi005 podman[112999]: 2024-04-16 14:39:52.422514279 +0000 UTC m=+0.644188147 container died 4ea9fc8a057d05389394dd433e65060fb0ccb9c1c954d70009dee7d8e110cc00 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, maintainer=Guillaume Abrioux ) 2024-04-16T14:39:52.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:52 smithi115 ceph-mon[83414]: pgmap v88: 65 pgs: 7 peering, 5 stale+active+clean, 53 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:52.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:52 smithi115 ceph-mon[83414]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-04-16T14:39:52.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:52 smithi115 ceph-mon[83414]: osdmap e62: 6 total, 5 up, 6 in 2024-04-16T14:39:52.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:52 smithi005 ceph-mon[93420]: pgmap v88: 65 pgs: 7 peering, 5 stale+active+clean, 53 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:52.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:52 smithi005 ceph-mon[93420]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-04-16T14:39:52.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:52 smithi005 ceph-mon[93420]: osdmap e62: 6 total, 5 up, 6 in 2024-04-16T14:39:53.474 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:53 smithi005 podman[113024]: 2024-04-16 14:39:53.020116202 +0000 UTC m=+0.592514612 container remove 4ea9fc8a057d05389394dd433e65060fb0ccb9c1c954d70009dee7d8e110cc00 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, ceph=True) 2024-04-16T14:39:53.475 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:53 smithi005 systemd[1]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.2.service: Deactivated successfully. 2024-04-16T14:39:53.475 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:53 smithi005 systemd[1]: Stopped Ceph osd.2 for 10609bfa-fbfd-11ee-bc90-c7b262605968. 2024-04-16T14:39:53.475 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:53 smithi005 systemd[1]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.2.service: Consumed 49.752s CPU time. 2024-04-16T14:39:53.475 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:53 smithi005 systemd[1]: Starting Ceph osd.2 for 10609bfa-fbfd-11ee-bc90-c7b262605968... 2024-04-16T14:39:53.796 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:53 smithi005 podman[113125]: 2024-04-16 14:39:53.382005412 +0000 UTC m=+0.018163192 image pull b1a78730e0db57f46162ae12211512856024b361a698c3ed431f6fbc73b484c3 quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 2024-04-16T14:39:53.797 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:53 smithi005 podman[113125]: 2024-04-16 14:39:53.513141206 +0000 UTC m=+0.149299009 container create aab6f5d16dbff62f13f9ff50f82ee5fdf59cef1f27acc0e3c40bffe7f662d281 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-16T14:39:53.797 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:53 smithi005 podman[113125]: 2024-04-16 14:39:53.724039264 +0000 UTC m=+0.360197028 container init aab6f5d16dbff62f13f9ff50f82ee5fdf59cef1f27acc0e3c40bffe7f662d281 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.license=GPLv2) 2024-04-16T14:39:53.797 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:53 smithi005 podman[113125]: 2024-04-16 14:39:53.727395178 +0000 UTC m=+0.363552945 container start aab6f5d16dbff62f13f9ff50f82ee5fdf59cef1f27acc0e3c40bffe7f662d281 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-16T14:39:53.797 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:53 smithi005 podman[113125]: 2024-04-16 14:39:53.798990774 +0000 UTC m=+0.435148542 container attach aab6f5d16dbff62f13f9ff50f82ee5fdf59cef1f27acc0e3c40bffe7f662d281 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2-activate, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240409, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-16T14:39:54.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:54 smithi005 ceph-mon[93420]: pgmap v90: 65 pgs: 7 peering, 5 stale+active+clean, 53 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:54.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:54 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:54.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:54 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:39:54.475 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:54 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2-activate[113140]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-16T14:39:54.475 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:54 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2-activate[113140]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-16T14:39:54.475 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:54 smithi005 bash[113125]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-16T14:39:54.475 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:54 smithi005 bash[113125]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-16T14:39:54.475 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:54 smithi005 bash[113125]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-16T14:39:54.476 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:54 smithi005 bash[113125]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-16T14:39:54.476 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:54 smithi005 bash[113125]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-04-16T14:39:54.476 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:54 smithi005 bash[113125]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-16T14:39:54.476 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:54 smithi005 bash[113125]: --> ceph-volume raw activate successful for osd ID: 2 2024-04-16T14:39:54.476 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:54 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2-activate[113140]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-16T14:39:54.476 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:54 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2-activate[113140]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-16T14:39:54.476 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:54 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2-activate[113140]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-04-16T14:39:54.476 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:54 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2-activate[113140]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-16T14:39:54.476 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:54 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2-activate[113140]: --> ceph-volume raw activate successful for osd ID: 2 2024-04-16T14:39:54.476 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:54 smithi005 podman[113125]: 2024-04-16 14:39:54.207560913 +0000 UTC m=+0.843718682 container died aab6f5d16dbff62f13f9ff50f82ee5fdf59cef1f27acc0e3c40bffe7f662d281 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-16T14:39:54.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:54 smithi115 ceph-mon[83414]: pgmap v90: 65 pgs: 7 peering, 5 stale+active+clean, 53 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-04-16T14:39:54.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:54 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:54.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:54 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:39:54.962 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:54 smithi005 podman[113264]: 2024-04-16 14:39:54.752883607 +0000 UTC m=+0.540362815 container remove aab6f5d16dbff62f13f9ff50f82ee5fdf59cef1f27acc0e3c40bffe7f662d281 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2-activate, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.build-date=20240409, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-16T14:39:55.224 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:54 smithi005 podman[113327]: 2024-04-16 14:39:54.867834522 +0000 UTC m=+0.017972059 image pull b1a78730e0db57f46162ae12211512856024b361a698c3ed431f6fbc73b484c3 quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 2024-04-16T14:39:55.224 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:54 smithi005 podman[113327]: 2024-04-16 14:39:54.979196823 +0000 UTC m=+0.129334390 container create fdc5fe68ac57e8a855fe530198bee63b2c56818f7c91819cfaed48f26b77eda6 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240409) 2024-04-16T14:39:55.224 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:55 smithi005 podman[113327]: 2024-04-16 14:39:55.190127115 +0000 UTC m=+0.340264640 container init fdc5fe68ac57e8a855fe530198bee63b2c56818f7c91819cfaed48f26b77eda6 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240409, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-16T14:39:55.224 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:55 smithi005 podman[113327]: 2024-04-16 14:39:55.193374763 +0000 UTC m=+0.343512289 container start fdc5fe68ac57e8a855fe530198bee63b2c56818f7c91819cfaed48f26b77eda6 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-16T14:39:55.225 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:55 smithi005 ceph-osd[113345]: -- 172.21.15.5:0/1448323848 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563401fab680 con 0x563401f74c00 2024-04-16T14:39:55.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:55 smithi115 ceph-mon[83414]: Health check failed: Degraded data redundancy: 30/354 objects degraded (8.475%), 9 pgs degraded (PG_DEGRADED) 2024-04-16T14:39:55.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:55 smithi005 ceph-mon[93420]: Health check failed: Degraded data redundancy: 30/354 objects degraded (8.475%), 9 pgs degraded (PG_DEGRADED) 2024-04-16T14:39:55.724 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:55 smithi005 bash[113327]: fdc5fe68ac57e8a855fe530198bee63b2c56818f7c91819cfaed48f26b77eda6 2024-04-16T14:39:55.724 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:55 smithi005 systemd[1]: Started Ceph osd.2 for 10609bfa-fbfd-11ee-bc90-c7b262605968. 2024-04-16T14:39:56.202 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:39:55 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2[113341]: 2024-04-16T14:39:55.729+0000 7f4a105a17c0 -1 Falling back to public interface 2024-04-16T14:39:56.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:56 smithi005 ceph-mon[93420]: pgmap v91: 65 pgs: 9 active+undersized+degraded, 7 peering, 11 active+undersized, 38 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 30/354 objects degraded (8.475%) 2024-04-16T14:39:56.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:56 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:56.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:56 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:56.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:56 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:39:56.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:56 smithi115 ceph-mon[83414]: pgmap v91: 65 pgs: 9 active+undersized+degraded, 7 peering, 11 active+undersized, 38 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 30/354 objects degraded (8.475%) 2024-04-16T14:39:56.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:56 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:56.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:56 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:39:56.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:56 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:39:57.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:57 smithi005 ceph-mon[93420]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-04-16T14:39:57.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:57 smithi115 ceph-mon[83414]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-04-16T14:39:58.657 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:58 smithi005 ceph-mon[93420]: pgmap v92: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 43/354 objects degraded (12.147%) 2024-04-16T14:39:58.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:58 smithi115 ceph-mon[83414]: pgmap v92: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 43/354 objects degraded (12.147%) 2024-04-16T14:39:59.581 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:39:59 smithi005 ceph-mon[93420]: fsmap cephfs:2 {0=cephfs.smithi005.wofqlz=up:active,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:39:59.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:39:59 smithi115 ceph-mon[83414]: fsmap cephfs:2 {0=cephfs.smithi005.wofqlz=up:active,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:40:00.395 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:40:00 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2[113341]: 2024-04-16T14:40:00.042+0000 7f4a105a17c0 -1 osd.2 60 log_to_monitors true 2024-04-16T14:40:00.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:00 smithi115 ceph-mon[83414]: pgmap v93: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 43/354 objects degraded (12.147%) 2024-04-16T14:40:00.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:00 smithi115 ceph-mon[83414]: Health detail: HEALTH_WARN 1 osds down; Degraded data redundancy: 43/354 objects degraded (12.147%), 12 pgs degraded 2024-04-16T14:40:00.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:00 smithi115 ceph-mon[83414]: [WRN] OSD_DOWN: 1 osds down 2024-04-16T14:40:00.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:00 smithi115 ceph-mon[83414]: osd.2 (root=default,host=smithi005) is down 2024-04-16T14:40:00.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:00 smithi115 ceph-mon[83414]: [WRN] PG_DEGRADED: Degraded data redundancy: 43/354 objects degraded (12.147%), 12 pgs degraded 2024-04-16T14:40:00.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:00 smithi115 ceph-mon[83414]: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-04-16T14:40:00.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:00 smithi115 ceph-mon[83414]: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-04-16T14:40:00.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:00 smithi115 ceph-mon[83414]: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-04-16T14:40:00.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:00 smithi115 ceph-mon[83414]: pg 2.d is active+undersized+degraded, acting [1,3] 2024-04-16T14:40:00.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:00 smithi115 ceph-mon[83414]: pg 2.e is active+undersized+degraded, acting [0,3] 2024-04-16T14:40:00.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:00 smithi115 ceph-mon[83414]: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-04-16T14:40:00.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:00 smithi115 ceph-mon[83414]: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-04-16T14:40:00.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:00 smithi115 ceph-mon[83414]: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-04-16T14:40:00.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:00 smithi115 ceph-mon[83414]: pg 2.17 is active+undersized+degraded, acting [5,1] 2024-04-16T14:40:00.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:00 smithi115 ceph-mon[83414]: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-04-16T14:40:00.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:00 smithi115 ceph-mon[83414]: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-04-16T14:40:00.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:00 smithi115 ceph-mon[83414]: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-04-16T14:40:00.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:00 smithi115 ceph-mon[83414]: from='osd.2 [v2:172.21.15.5:6818/643342483,v1:172.21.15.5:6819/643342483]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-16T14:40:00.724 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:40:00 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2[113341]: 2024-04-16T14:40:00.416+0000 7f4a019f9700 -1 osd.2 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T14:40:00.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:00 smithi005 ceph-mon[93420]: pgmap v93: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 300 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 43/354 objects degraded (12.147%) 2024-04-16T14:40:00.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:00 smithi005 ceph-mon[93420]: Health detail: HEALTH_WARN 1 osds down; Degraded data redundancy: 43/354 objects degraded (12.147%), 12 pgs degraded 2024-04-16T14:40:00.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:00 smithi005 ceph-mon[93420]: [WRN] OSD_DOWN: 1 osds down 2024-04-16T14:40:00.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:00 smithi005 ceph-mon[93420]: osd.2 (root=default,host=smithi005) is down 2024-04-16T14:40:00.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:00 smithi005 ceph-mon[93420]: [WRN] PG_DEGRADED: Degraded data redundancy: 43/354 objects degraded (12.147%), 12 pgs degraded 2024-04-16T14:40:00.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:00 smithi005 ceph-mon[93420]: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-04-16T14:40:00.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:00 smithi005 ceph-mon[93420]: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-04-16T14:40:00.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:00 smithi005 ceph-mon[93420]: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-04-16T14:40:00.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:00 smithi005 ceph-mon[93420]: pg 2.d is active+undersized+degraded, acting [1,3] 2024-04-16T14:40:00.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:00 smithi005 ceph-mon[93420]: pg 2.e is active+undersized+degraded, acting [0,3] 2024-04-16T14:40:00.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:00 smithi005 ceph-mon[93420]: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-04-16T14:40:00.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:00 smithi005 ceph-mon[93420]: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-04-16T14:40:00.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:00 smithi005 ceph-mon[93420]: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-04-16T14:40:00.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:00 smithi005 ceph-mon[93420]: pg 2.17 is active+undersized+degraded, acting [5,1] 2024-04-16T14:40:00.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:00 smithi005 ceph-mon[93420]: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-04-16T14:40:00.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:00 smithi005 ceph-mon[93420]: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-04-16T14:40:00.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:00 smithi005 ceph-mon[93420]: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-04-16T14:40:00.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:00 smithi005 ceph-mon[93420]: from='osd.2 [v2:172.21.15.5:6818/643342483,v1:172.21.15.5:6819/643342483]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-16T14:40:01.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:01 smithi115 ceph-mon[83414]: from='osd.2 [v2:172.21.15.5:6818/643342483,v1:172.21.15.5:6819/643342483]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-16T14:40:01.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:01 smithi115 ceph-mon[83414]: osdmap e63: 6 total, 5 up, 6 in 2024-04-16T14:40:01.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:01 smithi115 ceph-mon[83414]: from='osd.2 [v2:172.21.15.5:6818/643342483,v1:172.21.15.5:6819/643342483]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-04-16T14:40:01.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:01 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:01.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:01 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:01.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:01 smithi005 ceph-mon[93420]: from='osd.2 [v2:172.21.15.5:6818/643342483,v1:172.21.15.5:6819/643342483]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-16T14:40:01.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:01 smithi005 ceph-mon[93420]: osdmap e63: 6 total, 5 up, 6 in 2024-04-16T14:40:01.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:01 smithi005 ceph-mon[93420]: from='osd.2 [v2:172.21.15.5:6818/643342483,v1:172.21.15.5:6819/643342483]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-04-16T14:40:01.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:01 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:01.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:01 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:02.662 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:02 smithi005 ceph-mon[93420]: pgmap v95: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 43/354 objects degraded (12.147%) 2024-04-16T14:40:02.662 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:02 smithi005 ceph-mon[93420]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-16T14:40:02.662 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:02 smithi005 ceph-mon[93420]: osd.2 [v2:172.21.15.5:6818/643342483,v1:172.21.15.5:6819/643342483] boot 2024-04-16T14:40:02.663 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:02 smithi005 ceph-mon[93420]: osdmap e64: 6 total, 6 up, 6 in 2024-04-16T14:40:02.663 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:02 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-16T14:40:02.663 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:02 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:02.663 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:02 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:02.663 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:02 smithi005 ceph-mon[93420]: osdmap e65: 6 total, 6 up, 6 in 2024-04-16T14:40:02.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:02 smithi115 ceph-mon[83414]: pgmap v95: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 43/354 objects degraded (12.147%) 2024-04-16T14:40:02.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:02 smithi115 ceph-mon[83414]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-16T14:40:02.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:02 smithi115 ceph-mon[83414]: osd.2 [v2:172.21.15.5:6818/643342483,v1:172.21.15.5:6819/643342483] boot 2024-04-16T14:40:02.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:02 smithi115 ceph-mon[83414]: osdmap e64: 6 total, 6 up, 6 in 2024-04-16T14:40:02.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:02 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-16T14:40:02.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:02 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:02.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:02 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:02.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:02 smithi115 ceph-mon[83414]: osdmap e65: 6 total, 6 up, 6 in 2024-04-16T14:40:04.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:04 smithi115 ceph-mon[83414]: pgmap v98: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 43/354 objects degraded (12.147%) 2024-04-16T14:40:04.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:04 smithi005 ceph-mon[93420]: pgmap v98: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 43/354 objects degraded (12.147%) 2024-04-16T14:40:05.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:05 smithi115 ceph-mon[83414]: Health check update: Degraded data redundancy: 43/354 objects degraded (12.147%), 12 pgs degraded (PG_DEGRADED) 2024-04-16T14:40:05.718 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:05 smithi005 ceph-mon[93420]: Health check update: Degraded data redundancy: 43/354 objects degraded (12.147%), 12 pgs degraded (PG_DEGRADED) 2024-04-16T14:40:06.849 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:06 smithi005 ceph-mon[93420]: pgmap v99: 65 pgs: 5 active+undersized+degraded, 7 active+undersized, 53 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 18/354 objects degraded (5.085%) 2024-04-16T14:40:06.850 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:06 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:06.850 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:06 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:06.850 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:06 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:40:06.850 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:06 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:40:06.850 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:06 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:06.850 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:06 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:40:06.850 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:06 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:40:06.850 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:06 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:40:06.850 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:06 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:40:06.850 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:06 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-16T14:40:06.850 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:06 smithi005 ceph-mon[93420]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-16T14:40:06.850 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:06 smithi005 ceph-mon[93420]: Upgrade: unsafe to stop osd(s) at this time (5 PGs are or would become offline) 2024-04-16T14:40:06.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:06 smithi115 ceph-mon[83414]: pgmap v99: 65 pgs: 5 active+undersized+degraded, 7 active+undersized, 53 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 18/354 objects degraded (5.085%) 2024-04-16T14:40:06.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:06 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:06.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:06 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:06.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:06 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:40:06.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:06 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:40:06.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:06 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:06.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:06 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:40:06.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:06 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:40:06.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:06 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:40:06.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:06 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:40:06.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:06 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-16T14:40:06.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:06 smithi115 ceph-mon[83414]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-16T14:40:06.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:06 smithi115 ceph-mon[83414]: Upgrade: unsafe to stop osd(s) at this time (5 PGs are or would become offline) 2024-04-16T14:40:07.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:07 smithi115 ceph-mon[83414]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/354 objects degraded (5.085%), 5 pgs degraded) 2024-04-16T14:40:07.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:07 smithi115 ceph-mon[83414]: Cluster is now healthy 2024-04-16T14:40:07.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:07 smithi005 ceph-mon[93420]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/354 objects degraded (5.085%), 5 pgs degraded) 2024-04-16T14:40:07.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:07 smithi005 ceph-mon[93420]: Cluster is now healthy 2024-04-16T14:40:08.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:08 smithi115 ceph-mon[83414]: pgmap v100: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:08.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:08 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:08.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:08 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:40:08.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:08 smithi005 ceph-mon[93420]: pgmap v100: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:08.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:08 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:08.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:08 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:40:10.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:10 smithi115 ceph-mon[83414]: pgmap v101: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:10.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:10 smithi005 ceph-mon[93420]: pgmap v101: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:12.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.797+0000 7f2c2674b700 1 -- 172.21.15.5:0/2668516006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c20102310 msgr2=0x7f2c201046f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:12.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.797+0000 7f2c2674b700 1 --2- 172.21.15.5:0/2668516006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c20102310 0x7f2c201046f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2c14004940 tx=0x7f2c14009e30 comp rx=0 tx=0).stop 2024-04-16T14:40:12.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.797+0000 7f2c2674b700 1 -- 172.21.15.5:0/2668516006 shutdown_connections 2024-04-16T14:40:12.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.797+0000 7f2c2674b700 1 --2- 172.21.15.5:0/2668516006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c20102310 0x7f2c201046f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:12.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.797+0000 7f2c2674b700 1 --2- 172.21.15.5:0/2668516006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c20066b80 0x7f2c20101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:12.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.797+0000 7f2c2674b700 1 -- 172.21.15.5:0/2668516006 >> 172.21.15.5:0/2668516006 conn(0x7f2c200f7440 msgr2=0x7f2c200f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:12.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.797+0000 7f2c2674b700 1 -- 172.21.15.5:0/2668516006 shutdown_connections 2024-04-16T14:40:12.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.797+0000 7f2c2674b700 1 -- 172.21.15.5:0/2668516006 wait complete. 2024-04-16T14:40:12.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.798+0000 7f2c2674b700 1 Processor -- start 2024-04-16T14:40:12.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.798+0000 7f2c2674b700 1 -- start start 2024-04-16T14:40:12.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.798+0000 7f2c2674b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c20066b80 0x7f2c2010fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:12.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.798+0000 7f2c2674b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c20102310 0x7f2c20110240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:12.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.798+0000 7f2c2674b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c201108d0 con 0x7f2c20102310 2024-04-16T14:40:12.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.798+0000 7f2c2674b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c20110fb0 con 0x7f2c20066b80 2024-04-16T14:40:12.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.798+0000 7f2c1f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c20102310 0x7f2c20110240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:12.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.798+0000 7f2c1f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c20102310 0x7f2c20110240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53762/0 (socket says 172.21.15.5:53762) 2024-04-16T14:40:12.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.798+0000 7f2c1f7fe700 1 -- 172.21.15.5:0/396371101 learned_addr learned my addr 172.21.15.5:0/396371101 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:40:12.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.798+0000 7f2c1ffff700 1 --2- 172.21.15.5:0/396371101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c20066b80 0x7f2c2010fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:12.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.798+0000 7f2c1f7fe700 1 -- 172.21.15.5:0/396371101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c20066b80 msgr2=0x7f2c2010fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:12.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.798+0000 7f2c1f7fe700 1 --2- 172.21.15.5:0/396371101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c20066b80 0x7f2c2010fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:12.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.799+0000 7f2c1f7fe700 1 -- 172.21.15.5:0/396371101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c14005040 con 0x7f2c20102310 2024-04-16T14:40:12.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.799+0000 7f2c1f7fe700 1 --2- 172.21.15.5:0/396371101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c20102310 0x7f2c20110240 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2c1400b3b0 tx=0x7f2c14009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:12.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.799+0000 7f2c1cff9700 1 -- 172.21.15.5:0/396371101 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c1400e040 con 0x7f2c20102310 2024-04-16T14:40:12.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.799+0000 7f2c1cff9700 1 -- 172.21.15.5:0/396371101 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2c1400bcc0 con 0x7f2c20102310 2024-04-16T14:40:12.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.799+0000 7f2c2674b700 1 -- 172.21.15.5:0/396371101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c20111230 con 0x7f2c20102310 2024-04-16T14:40:12.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.799+0000 7f2c1cff9700 1 -- 172.21.15.5:0/396371101 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c1401c630 con 0x7f2c20102310 2024-04-16T14:40:12.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.799+0000 7f2c2674b700 1 -- 172.21.15.5:0/396371101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c201117f0 con 0x7f2c20102310 2024-04-16T14:40:12.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.800+0000 7f2c2674b700 1 -- 172.21.15.5:0/396371101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c2005f5f0 con 0x7f2c20102310 2024-04-16T14:40:12.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.801+0000 7f2c1cff9700 1 -- 172.21.15.5:0/396371101 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f2c14013980 con 0x7f2c20102310 2024-04-16T14:40:12.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.801+0000 7f2c1cff9700 1 --2- 172.21.15.5:0/396371101 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f2c0806e140 0x7f2c080705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:12.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.801+0000 7f2c1cff9700 1 -- 172.21.15.5:0/396371101 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f2c1408e830 con 0x7f2c20102310 2024-04-16T14:40:12.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.801+0000 7f2c1ffff700 1 --2- 172.21.15.5:0/396371101 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f2c0806e140 0x7f2c080705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:12.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.802+0000 7f2c1ffff700 1 --2- 172.21.15.5:0/396371101 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f2c0806e140 0x7f2c080705f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2c10006fd0 tx=0x7f2c10008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:12.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:12.806+0000 7f2c1cff9700 1 -- 172.21.15.5:0/396371101 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f2c1405b6e0 con 0x7f2c20102310 2024-04-16T14:40:12.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:12 smithi115 ceph-mon[83414]: pgmap v102: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:12.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:12 smithi005 ceph-mon[93420]: pgmap v102: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:13.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.033+0000 7f2c2674b700 1 -- 172.21.15.5:0/396371101 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c20111a80 con 0x7f2c0806e140 2024-04-16T14:40:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.034+0000 7f2c1cff9700 1 -- 172.21.15.5:0/396371101 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2c20111a80 con 0x7f2c0806e140 2024-04-16T14:40:13.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.036+0000 7f2c2674b700 1 -- 172.21.15.5:0/396371101 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f2c0806e140 msgr2=0x7f2c080705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.036+0000 7f2c2674b700 1 --2- 172.21.15.5:0/396371101 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f2c0806e140 0x7f2c080705f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2c10006fd0 tx=0x7f2c10008040 comp rx=0 tx=0).stop 2024-04-16T14:40:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.036+0000 7f2c2674b700 1 -- 172.21.15.5:0/396371101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c20102310 msgr2=0x7f2c20110240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.036+0000 7f2c2674b700 1 --2- 172.21.15.5:0/396371101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c20102310 0x7f2c20110240 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2c1400b3b0 tx=0x7f2c14009e30 comp rx=0 tx=0).stop 2024-04-16T14:40:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.036+0000 7f2c2674b700 1 -- 172.21.15.5:0/396371101 shutdown_connections 2024-04-16T14:40:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.036+0000 7f2c2674b700 1 --2- 172.21.15.5:0/396371101 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f2c0806e140 0x7f2c080705f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.036+0000 7f2c2674b700 1 --2- 172.21.15.5:0/396371101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2c20066b80 0x7f2c2010fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.036+0000 7f2c2674b700 1 --2- 172.21.15.5:0/396371101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2c20102310 0x7f2c20110240 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.036+0000 7f2c2674b700 1 -- 172.21.15.5:0/396371101 >> 172.21.15.5:0/396371101 conn(0x7f2c200f7440 msgr2=0x7f2c200f7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.036+0000 7f2c2674b700 1 -- 172.21.15.5:0/396371101 shutdown_connections 2024-04-16T14:40:13.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.036+0000 7f2c2674b700 1 -- 172.21.15.5:0/396371101 wait complete. 2024-04-16T14:40:13.045 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-04-16T14:40:13.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.141+0000 7fa00bb05700 1 -- 172.21.15.5:0/2052087222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0040fd9d0 msgr2=0x7fa0040ffdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:13.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.141+0000 7fa00bb05700 1 --2- 172.21.15.5:0/2052087222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0040fd9d0 0x7fa0040ffdb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa000009ce0 tx=0x7fa000004d10 comp rx=0 tx=0).stop 2024-04-16T14:40:13.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.141+0000 7fa00bb05700 1 -- 172.21.15.5:0/2052087222 shutdown_connections 2024-04-16T14:40:13.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.141+0000 7fa00bb05700 1 --2- 172.21.15.5:0/2052087222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0041002f0 0x7fa0041026d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:13.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.141+0000 7fa00bb05700 1 --2- 172.21.15.5:0/2052087222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0040fd9d0 0x7fa0040ffdb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:13.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.141+0000 7fa00bb05700 1 -- 172.21.15.5:0/2052087222 >> 172.21.15.5:0/2052087222 conn(0x7fa0040f7450 msgr2=0x7fa0040f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:13.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.141+0000 7fa00bb05700 1 -- 172.21.15.5:0/2052087222 shutdown_connections 2024-04-16T14:40:13.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.141+0000 7fa00bb05700 1 -- 172.21.15.5:0/2052087222 wait complete. 2024-04-16T14:40:13.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.141+0000 7fa00bb05700 1 Processor -- start 2024-04-16T14:40:13.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.141+0000 7fa00bb05700 1 -- start start 2024-04-16T14:40:13.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.142+0000 7fa00bb05700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0040fd9d0 0x7fa00410dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:13.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.142+0000 7fa00bb05700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0041002f0 0x7fa00410e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:13.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.142+0000 7fa00bb05700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00410e7e0 con 0x7fa0041002f0 2024-04-16T14:40:13.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.142+0000 7fa00bb05700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00410ef80 con 0x7fa0040fd9d0 2024-04-16T14:40:13.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.142+0000 7fa0090a0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0041002f0 0x7fa00410e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:13.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.142+0000 7fa0090a0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0041002f0 0x7fa00410e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53766/0 (socket says 172.21.15.5:53766) 2024-04-16T14:40:13.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.142+0000 7fa0090a0700 1 -- 172.21.15.5:0/515314767 learned_addr learned my addr 172.21.15.5:0/515314767 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:40:13.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.142+0000 7fa0098a1700 1 --2- 172.21.15.5:0/515314767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0040fd9d0 0x7fa00410dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:13.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.142+0000 7fa0090a0700 1 -- 172.21.15.5:0/515314767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0040fd9d0 msgr2=0x7fa00410dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:13.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.142+0000 7fa0090a0700 1 --2- 172.21.15.5:0/515314767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0040fd9d0 0x7fa00410dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.142+0000 7fa0090a0700 1 -- 172.21.15.5:0/515314767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa000009940 con 0x7fa0041002f0 2024-04-16T14:40:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.142+0000 7fa0098a1700 1 --2- 172.21.15.5:0/515314767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0040fd9d0 0x7fa00410dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:40:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.142+0000 7fa0090a0700 1 --2- 172.21.15.5:0/515314767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0041002f0 0x7fa00410e150 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400b790 tx=0x7f9ff4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.142+0000 7f9ffa7fc700 1 -- 172.21.15.5:0/515314767 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ff400f770 con 0x7fa0041002f0 2024-04-16T14:40:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.142+0000 7f9ffa7fc700 1 -- 172.21.15.5:0/515314767 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ff400fda0 con 0x7fa0041002f0 2024-04-16T14:40:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.142+0000 7fa00bb05700 1 -- 172.21.15.5:0/515314767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa00410f260 con 0x7fa0041002f0 2024-04-16T14:40:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.142+0000 7f9ffa7fc700 1 -- 172.21.15.5:0/515314767 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ff400d310 con 0x7fa0041002f0 2024-04-16T14:40:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.143+0000 7fa00bb05700 1 -- 172.21.15.5:0/515314767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00410f820 con 0x7fa0041002f0 2024-04-16T14:40:13.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.143+0000 7fa00bb05700 1 -- 172.21.15.5:0/515314767 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa00405f5f0 con 0x7fa0041002f0 2024-04-16T14:40:13.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.144+0000 7f9ffa7fc700 1 -- 172.21.15.5:0/515314767 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f9ff4010420 con 0x7fa0041002f0 2024-04-16T14:40:13.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.144+0000 7f9ffa7fc700 1 --2- 172.21.15.5:0/515314767 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f9ff006e140 0x7f9ff00705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:13.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.145+0000 7f9ffa7fc700 1 -- 172.21.15.5:0/515314767 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f9ff408db10 con 0x7fa0041002f0 2024-04-16T14:40:13.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.145+0000 7fa0098a1700 1 --2- 172.21.15.5:0/515314767 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f9ff006e140 0x7f9ff00705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:13.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.145+0000 7fa0098a1700 1 --2- 172.21.15.5:0/515314767 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f9ff006e140 0x7f9ff00705f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa000000f80 tx=0x7fa000004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:13.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.149+0000 7f9ffa7fc700 1 -- 172.21.15.5:0/515314767 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f9ff405aa20 con 0x7fa0041002f0 2024-04-16T14:40:13.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.375+0000 7fa00bb05700 1 -- 172.21.15.5:0/515314767 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa00410fc60 con 0x7f9ff006e140 2024-04-16T14:40:13.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.376+0000 7f9ffa7fc700 1 -- 172.21.15.5:0/515314767 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa00410fc60 con 0x7f9ff006e140 2024-04-16T14:40:13.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.378+0000 7fa00bb05700 1 -- 172.21.15.5:0/515314767 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f9ff006e140 msgr2=0x7f9ff00705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:13.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.378+0000 7fa00bb05700 1 --2- 172.21.15.5:0/515314767 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f9ff006e140 0x7f9ff00705f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa000000f80 tx=0x7fa000004d10 comp rx=0 tx=0).stop 2024-04-16T14:40:13.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.378+0000 7fa00bb05700 1 -- 172.21.15.5:0/515314767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0041002f0 msgr2=0x7fa00410e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:13.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.378+0000 7fa00bb05700 1 --2- 172.21.15.5:0/515314767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0041002f0 0x7fa00410e150 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400b790 tx=0x7f9ff4009250 comp rx=0 tx=0).stop 2024-04-16T14:40:13.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.378+0000 7fa00bb05700 1 -- 172.21.15.5:0/515314767 shutdown_connections 2024-04-16T14:40:13.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.378+0000 7fa00bb05700 1 --2- 172.21.15.5:0/515314767 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f9ff006e140 0x7f9ff00705f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:13.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.378+0000 7fa00bb05700 1 --2- 172.21.15.5:0/515314767 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0040fd9d0 0x7fa00410dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:13.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.378+0000 7fa00bb05700 1 --2- 172.21.15.5:0/515314767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0041002f0 0x7fa00410e150 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:13.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.378+0000 7fa00bb05700 1 -- 172.21.15.5:0/515314767 >> 172.21.15.5:0/515314767 conn(0x7fa0040f7450 msgr2=0x7fa0040f7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:13.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.378+0000 7fa00bb05700 1 -- 172.21.15.5:0/515314767 shutdown_connections 2024-04-16T14:40:13.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.378+0000 7fa00bb05700 1 -- 172.21.15.5:0/515314767 wait complete. 2024-04-16T14:40:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.482+0000 7fe5b076f700 1 -- 172.21.15.5:0/300709083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5a80fce80 msgr2=0x7fe5a80fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.482+0000 7fe5b076f700 1 --2- 172.21.15.5:0/300709083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5a80fce80 0x7fe5a80fd290 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4004940 tx=0x7fe5a4009e30 comp rx=0 tx=0).stop 2024-04-16T14:40:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.482+0000 7fe5b076f700 1 -- 172.21.15.5:0/300709083 shutdown_connections 2024-04-16T14:40:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.482+0000 7fe5b076f700 1 --2- 172.21.15.5:0/300709083 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5a80fdff0 0x7fe5a80fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.482+0000 7fe5b076f700 1 --2- 172.21.15.5:0/300709083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5a80fce80 0x7fe5a80fd290 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.482+0000 7fe5b076f700 1 -- 172.21.15.5:0/300709083 >> 172.21.15.5:0/300709083 conn(0x7fe5a80f8580 msgr2=0x7fe5a80fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.483+0000 7fe5b076f700 1 -- 172.21.15.5:0/300709083 shutdown_connections 2024-04-16T14:40:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.483+0000 7fe5b076f700 1 -- 172.21.15.5:0/300709083 wait complete. 2024-04-16T14:40:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.483+0000 7fe5b076f700 1 Processor -- start 2024-04-16T14:40:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.483+0000 7fe5b076f700 1 -- start start 2024-04-16T14:40:13.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.483+0000 7fe5b076f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5a80fce80 0x7fe5a810d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.483+0000 7fe5b076f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5a80fdff0 0x7fe5a810dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.483+0000 7fe5b076f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a810e4a0 con 0x7fe5a80fce80 2024-04-16T14:40:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.483+0000 7fe5b076f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a810e610 con 0x7fe5a80fdff0 2024-04-16T14:40:13.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.483+0000 7fe5ae50b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5a80fce80 0x7fe5a810d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:13.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.483+0000 7fe5ae50b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5a80fce80 0x7fe5a810d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53788/0 (socket says 172.21.15.5:53788) 2024-04-16T14:40:13.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.483+0000 7fe5ae50b700 1 -- 172.21.15.5:0/602094347 learned_addr learned my addr 172.21.15.5:0/602094347 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:40:13.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.483+0000 7fe5add0a700 1 --2- 172.21.15.5:0/602094347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5a80fdff0 0x7fe5a810dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:13.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.484+0000 7fe5ae50b700 1 -- 172.21.15.5:0/602094347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5a80fdff0 msgr2=0x7fe5a810dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:13.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.484+0000 7fe5ae50b700 1 --2- 172.21.15.5:0/602094347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5a80fdff0 0x7fe5a810dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:13.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.484+0000 7fe5ae50b700 1 -- 172.21.15.5:0/602094347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a4005040 con 0x7fe5a80fce80 2024-04-16T14:40:13.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.484+0000 7fe5ae50b700 1 --2- 172.21.15.5:0/602094347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5a80fce80 0x7fe5a810d960 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe5a400b3b0 tx=0x7fe5a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:13.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.484+0000 7fe59effd700 1 -- 172.21.15.5:0/602094347 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5a400e040 con 0x7fe5a80fce80 2024-04-16T14:40:13.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.484+0000 7fe59effd700 1 -- 172.21.15.5:0/602094347 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe5a400bcc0 con 0x7fe5a80fce80 2024-04-16T14:40:13.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.484+0000 7fe5b076f700 1 -- 172.21.15.5:0/602094347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a8113010 con 0x7fe5a80fce80 2024-04-16T14:40:13.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.484+0000 7fe59effd700 1 -- 172.21.15.5:0/602094347 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5a401c630 con 0x7fe5a80fce80 2024-04-16T14:40:13.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.484+0000 7fe5b076f700 1 -- 172.21.15.5:0/602094347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a81135d0 con 0x7fe5a80fce80 2024-04-16T14:40:13.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.485+0000 7fe5b076f700 1 -- 172.21.15.5:0/602094347 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a804c710 con 0x7fe5a80fce80 2024-04-16T14:40:13.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.485+0000 7fe59effd700 1 -- 172.21.15.5:0/602094347 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fe5a4013420 con 0x7fe5a80fce80 2024-04-16T14:40:13.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.486+0000 7fe59effd700 1 --2- 172.21.15.5:0/602094347 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe59406e140 0x7fe5940705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:13.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.486+0000 7fe59effd700 1 -- 172.21.15.5:0/602094347 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fe5a408e750 con 0x7fe5a80fce80 2024-04-16T14:40:13.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.486+0000 7fe5add0a700 1 --2- 172.21.15.5:0/602094347 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe59406e140 0x7fe5940705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:13.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.486+0000 7fe5add0a700 1 --2- 172.21.15.5:0/602094347 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe59406e140 0x7fe5940705f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe598004990 tx=0x7fe598009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:13.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.491+0000 7fe59effd700 1 -- 172.21.15.5:0/602094347 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fe5a405b680 con 0x7fe5a80fce80 2024-04-16T14:40:13.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.707+0000 7fe5b076f700 1 -- 172.21.15.5:0/602094347 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5a8102350 con 0x7fe59406e140 2024-04-16T14:40:13.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.717+0000 7fe59effd700 1 -- 172.21.15.5:0/602094347 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fe5a8102350 con 0x7fe59406e140 2024-04-16T14:40:13.715 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-16T14:40:13.715 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.smithi005 smithi005 *:9093,9094 running (4m) 12s ago 12m 24.6M - 0.25.0 c8568f914cd2 f8aaa22ee70c 2024-04-16T14:40:13.716 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi005 smithi005 running (116s) 12s ago 13m 6656k - 19.0.0-2204-g36befe5d b1a78730e0db d6efa08e65e3 2024-04-16T14:40:13.716 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi115 smithi115 running (110s) 106s ago 11m 6660k - 19.0.0-2204-g36befe5d b1a78730e0db b2a2f2965e2a 2024-04-16T14:40:13.716 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.smithi005 smithi005 *:3000 running (4m) 12s ago 12m 85.9M - 9.4.7 954c08fa6188 9834229a010c 2024-04-16T14:40:13.716 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.vzoqdl smithi005 running (7m) 12s ago 7m 13.5M - 17.2.7-868-g412a5526 b04d96489b7c 84a74a406a1d 2024-04-16T14:40:13.716 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.wofqlz smithi005 running (7m) 12s ago 7m 133M - 17.2.7-868-g412a5526 b04d96489b7c d0e053ab2f72 2024-04-16T14:40:13.716 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.byfytg smithi115 running (7m) 106s ago 7m 118M - 17.2.7-868-g412a5526 b04d96489b7c 595cd0892f66 2024-04-16T14:40:13.716 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.trkaqh smithi115 running (7m) 106s ago 7m 13.7M - 17.2.7-868-g412a5526 b04d96489b7c 5b60cd2ad79b 2024-04-16T14:40:13.716 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi005.ipwdkc smithi005 *:8443,9283,8765 running (4m) 12s ago 14m 501M - 19.0.0-2204-g36befe5d b1a78730e0db 451192b4fc44 2024-04-16T14:40:13.716 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi115.brjkpo smithi115 *:8443,9283,8765 running (3m) 106s ago 11m 448M - 19.0.0-2204-g36befe5d b1a78730e0db 0d75f8211942 2024-04-16T14:40:13.716 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi005 smithi005 running (2m) 12s ago 14m 45.8M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3d0c00924867 2024-04-16T14:40:13.716 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi115 smithi115 running (2m) 106s ago 11m 37.5M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3b916a4928b2 2024-04-16T14:40:13.716 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi005 smithi005 *:9100 running (4m) 12s ago 13m 16.7M - 1.5.0 0da6a335fe13 c09bba584a42 2024-04-16T14:40:13.716 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi115 smithi115 *:9100 running (4m) 106s ago 11m 16.7M - 1.5.0 0da6a335fe13 78cc9cc150c0 2024-04-16T14:40:13.717 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (90s) 12s ago 11m 100M 1559M 19.0.0-2204-g36befe5d b1a78730e0db 91d9246d45e0 2024-04-16T14:40:13.717 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (54s) 12s ago 10m 100M 1559M 19.0.0-2204-g36befe5d b1a78730e0db d930ce515e3e 2024-04-16T14:40:13.717 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (18s) 12s ago 10m 12.7M 1559M 19.0.0-2204-g36befe5d b1a78730e0db fdc5fe68ac57 2024-04-16T14:40:13.717 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi115 running (9m) 106s ago 9m 271M 2581M 17.2.7-868-g412a5526 b04d96489b7c 59f81301ebcf 2024-04-16T14:40:13.717 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi115 running (9m) 106s ago 9m 242M 2581M 17.2.7-868-g412a5526 b04d96489b7c e3ea96b7edd9 2024-04-16T14:40:13.717 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi115 running (8m) 106s ago 8m 227M 2581M 17.2.7-868-g412a5526 b04d96489b7c 456fa074e453 2024-04-16T14:40:13.717 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.smithi005 smithi005 *:9095 running (3m) 12s ago 12m 58.9M - 2.43.0 a07b618ecd1d dc784e58817c 2024-04-16T14:40:13.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.719+0000 7fe5b076f700 1 -- 172.21.15.5:0/602094347 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe59406e140 msgr2=0x7fe5940705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:13.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.719+0000 7fe5b076f700 1 --2- 172.21.15.5:0/602094347 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe59406e140 0x7fe5940705f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe598004990 tx=0x7fe598009ee0 comp rx=0 tx=0).stop 2024-04-16T14:40:13.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.719+0000 7fe5b076f700 1 -- 172.21.15.5:0/602094347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5a80fce80 msgr2=0x7fe5a810d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:13.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.719+0000 7fe5b076f700 1 --2- 172.21.15.5:0/602094347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5a80fce80 0x7fe5a810d960 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe5a400b3b0 tx=0x7fe5a4009e30 comp rx=0 tx=0).stop 2024-04-16T14:40:13.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.719+0000 7fe5b076f700 1 -- 172.21.15.5:0/602094347 shutdown_connections 2024-04-16T14:40:13.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.719+0000 7fe5b076f700 1 --2- 172.21.15.5:0/602094347 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe59406e140 0x7fe5940705f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:13.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.719+0000 7fe5b076f700 1 --2- 172.21.15.5:0/602094347 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5a80fce80 0x7fe5a810d960 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:13.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.719+0000 7fe5b076f700 1 --2- 172.21.15.5:0/602094347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5a80fdff0 0x7fe5a810dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:13.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.719+0000 7fe5b076f700 1 -- 172.21.15.5:0/602094347 >> 172.21.15.5:0/602094347 conn(0x7fe5a80f8580 msgr2=0x7fe5a80f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:13.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.719+0000 7fe5b076f700 1 -- 172.21.15.5:0/602094347 shutdown_connections 2024-04-16T14:40:13.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.719+0000 7fe5b076f700 1 -- 172.21.15.5:0/602094347 wait complete. 2024-04-16T14:40:13.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.822+0000 7f27cc8e7700 1 -- 172.21.15.5:0/457608682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27c80fce50 msgr2=0x7f27c80fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:13.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.822+0000 7f27cc8e7700 1 --2- 172.21.15.5:0/457608682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27c80fce50 0x7f27c80fd260 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f27b8004940 tx=0x7f27b8009e30 comp rx=0 tx=0).stop 2024-04-16T14:40:13.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.822+0000 7f27cc8e7700 1 -- 172.21.15.5:0/457608682 shutdown_connections 2024-04-16T14:40:13.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.822+0000 7f27cc8e7700 1 --2- 172.21.15.5:0/457608682 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27c80fe050 0x7f27c80fe4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:13.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.822+0000 7f27cc8e7700 1 --2- 172.21.15.5:0/457608682 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27c80fce50 0x7f27c80fd260 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:13.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.822+0000 7f27cc8e7700 1 -- 172.21.15.5:0/457608682 >> 172.21.15.5:0/457608682 conn(0x7f27c80f8580 msgr2=0x7f27c80fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:13.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.822+0000 7f27cc8e7700 1 -- 172.21.15.5:0/457608682 shutdown_connections 2024-04-16T14:40:13.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.822+0000 7f27cc8e7700 1 -- 172.21.15.5:0/457608682 wait complete. 2024-04-16T14:40:13.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.823+0000 7f27cc8e7700 1 Processor -- start 2024-04-16T14:40:13.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.823+0000 7f27cc8e7700 1 -- start start 2024-04-16T14:40:13.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.823+0000 7f27cc8e7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27c80fce50 0x7f27c810d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.823+0000 7f27cc8e7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27c80fe050 0x7f27c810deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.823+0000 7f27cc8e7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c810e4b0 con 0x7f27c80fe050 2024-04-16T14:40:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.823+0000 7f27cc8e7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c810e620 con 0x7f27c80fce50 2024-04-16T14:40:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.823+0000 7f27c5d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27c80fe050 0x7f27c810deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.823+0000 7f27c5d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27c80fe050 0x7f27c810deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53808/0 (socket says 172.21.15.5:53808) 2024-04-16T14:40:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.823+0000 7f27c5d9b700 1 -- 172.21.15.5:0/2141667134 learned_addr learned my addr 172.21.15.5:0/2141667134 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:40:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.823+0000 7f27c659c700 1 --2- 172.21.15.5:0/2141667134 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27c80fce50 0x7f27c810d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.823+0000 7f27c5d9b700 1 -- 172.21.15.5:0/2141667134 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27c80fce50 msgr2=0x7f27c810d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.823+0000 7f27c5d9b700 1 --2- 172.21.15.5:0/2141667134 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27c80fce50 0x7f27c810d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.823+0000 7f27c5d9b700 1 -- 172.21.15.5:0/2141667134 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b8005040 con 0x7f27c80fe050 2024-04-16T14:40:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.823+0000 7f27c659c700 1 --2- 172.21.15.5:0/2141667134 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27c80fce50 0x7f27c810d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:40:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.823+0000 7f27c5d9b700 1 --2- 172.21.15.5:0/2141667134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27c80fe050 0x7f27c810deb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f27bc002a50 tx=0x7f27bc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.824+0000 7f27b6ffd700 1 -- 172.21.15.5:0/2141667134 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27bc007cc0 con 0x7f27c80fe050 2024-04-16T14:40:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.824+0000 7f27b6ffd700 1 -- 172.21.15.5:0/2141667134 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f27bc00f040 con 0x7f27c80fe050 2024-04-16T14:40:13.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.824+0000 7f27cc8e7700 1 -- 172.21.15.5:0/2141667134 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c8113080 con 0x7f27c80fe050 2024-04-16T14:40:13.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.824+0000 7f27b6ffd700 1 -- 172.21.15.5:0/2141667134 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27bc009640 con 0x7f27c80fe050 2024-04-16T14:40:13.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.824+0000 7f27cc8e7700 1 -- 172.21.15.5:0/2141667134 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c8113640 con 0x7f27c80fe050 2024-04-16T14:40:13.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.825+0000 7f27cc8e7700 1 -- 172.21.15.5:0/2141667134 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c804c710 con 0x7f27c80fe050 2024-04-16T14:40:13.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.825+0000 7f27b6ffd700 1 -- 172.21.15.5:0/2141667134 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f27bc0097a0 con 0x7f27c80fe050 2024-04-16T14:40:13.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.826+0000 7f27b6ffd700 1 --2- 172.21.15.5:0/2141667134 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f27b006e140 0x7f27b00705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:13.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.826+0000 7f27b6ffd700 1 -- 172.21.15.5:0/2141667134 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f27bc08d940 con 0x7f27c80fe050 2024-04-16T14:40:13.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.826+0000 7f27c659c700 1 --2- 172.21.15.5:0/2141667134 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f27b006e140 0x7f27b00705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:13.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.826+0000 7f27c659c700 1 --2- 172.21.15.5:0/2141667134 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f27b006e140 0x7f27b00705f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f27b800b3b0 tx=0x7f27b8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:13.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:13.830+0000 7f27b6ffd700 1 -- 172.21.15.5:0/2141667134 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f27bc05a7f0 con 0x7f27c80fe050 2024-04-16T14:40:13.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:13 smithi115 ceph-mon[83414]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:40:13.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:13 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:13.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:13 smithi005 ceph-mon[93420]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:40:13.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:13 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:14.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.129+0000 7f27cc8e7700 1 -- 172.21.15.5:0/2141667134 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f27c8113a90 con 0x7f27c80fe050 2024-04-16T14:40:14.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.130+0000 7f27b6ffd700 1 -- 172.21.15.5:0/2141667134 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f27bc05a380 con 0x7f27c80fe050 2024-04-16T14:40:14.129 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:40:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-04-16T14:40:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:40:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:40:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-04-16T14:40:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:40:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:40:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-04-16T14:40:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 3, 2024-04-16T14:40:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 3 2024-04-16T14:40:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:40:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-04-16T14:40:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 4 2024-04-16T14:40:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:40:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-04-16T14:40:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 7, 2024-04-16T14:40:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 7 2024-04-16T14:40:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-16T14:40:14.130 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:40:14.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.132+0000 7f27cc8e7700 1 -- 172.21.15.5:0/2141667134 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f27b006e140 msgr2=0x7f27b00705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:14.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.132+0000 7f27cc8e7700 1 --2- 172.21.15.5:0/2141667134 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f27b006e140 0x7f27b00705f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f27b800b3b0 tx=0x7f27b8009e30 comp rx=0 tx=0).stop 2024-04-16T14:40:14.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.132+0000 7f27cc8e7700 1 -- 172.21.15.5:0/2141667134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27c80fe050 msgr2=0x7f27c810deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:14.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.132+0000 7f27cc8e7700 1 --2- 172.21.15.5:0/2141667134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27c80fe050 0x7f27c810deb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f27bc002a50 tx=0x7f27bc0046b0 comp rx=0 tx=0).stop 2024-04-16T14:40:14.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.132+0000 7f27cc8e7700 1 -- 172.21.15.5:0/2141667134 shutdown_connections 2024-04-16T14:40:14.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.132+0000 7f27cc8e7700 1 --2- 172.21.15.5:0/2141667134 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f27b006e140 0x7f27b00705f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:14.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.132+0000 7f27cc8e7700 1 --2- 172.21.15.5:0/2141667134 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27c80fce50 0x7f27c810d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:14.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.132+0000 7f27cc8e7700 1 --2- 172.21.15.5:0/2141667134 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27c80fe050 0x7f27c810deb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:14.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.132+0000 7f27cc8e7700 1 -- 172.21.15.5:0/2141667134 >> 172.21.15.5:0/2141667134 conn(0x7f27c80f8580 msgr2=0x7f27c80f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:14.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.132+0000 7f27cc8e7700 1 -- 172.21.15.5:0/2141667134 shutdown_connections 2024-04-16T14:40:14.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.132+0000 7f27cc8e7700 1 -- 172.21.15.5:0/2141667134 wait complete. 2024-04-16T14:40:14.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.236+0000 7f7bdcfa1700 1 -- 172.21.15.5:0/4285584142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7bd8066ca0 msgr2=0x7f7bd80ff8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:14.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.236+0000 7f7bdcfa1700 1 --2- 172.21.15.5:0/4285584142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7bd8066ca0 0x7f7bd80ff8f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8004940 tx=0x7f7bc8009e30 comp rx=0 tx=0).stop 2024-04-16T14:40:14.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.236+0000 7f7bdcfa1700 1 -- 172.21.15.5:0/4285584142 shutdown_connections 2024-04-16T14:40:14.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.236+0000 7f7bdcfa1700 1 --2- 172.21.15.5:0/4285584142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bd80ffe30 0x7f7bd8102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:14.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.236+0000 7f7bdcfa1700 1 --2- 172.21.15.5:0/4285584142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7bd8066ca0 0x7f7bd80ff8f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:14.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.236+0000 7f7bdcfa1700 1 -- 172.21.15.5:0/4285584142 >> 172.21.15.5:0/4285584142 conn(0x7f7bd80f72a0 msgr2=0x7f7bd80f96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:14.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.236+0000 7f7bdcfa1700 1 -- 172.21.15.5:0/4285584142 shutdown_connections 2024-04-16T14:40:14.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.237+0000 7f7bdcfa1700 1 -- 172.21.15.5:0/4285584142 wait complete. 2024-04-16T14:40:14.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.237+0000 7f7bdcfa1700 1 Processor -- start 2024-04-16T14:40:14.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.237+0000 7f7bdcfa1700 1 -- start start 2024-04-16T14:40:14.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.237+0000 7f7bdcfa1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bd8066ca0 0x7f7bd80fd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:14.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.237+0000 7f7bdcfa1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7bd80ffe30 0x7f7bd80fb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:14.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.237+0000 7f7bdcfa1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd80fbd80 con 0x7f7bd80ffe30 2024-04-16T14:40:14.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.237+0000 7f7bdcfa1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd80fbec0 con 0x7f7bd8066ca0 2024-04-16T14:40:14.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.237+0000 7f7bd6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7bd80ffe30 0x7f7bd80fb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:14.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.238+0000 7f7bd6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7bd80ffe30 0x7f7bd80fb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53836/0 (socket says 172.21.15.5:53836) 2024-04-16T14:40:14.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.238+0000 7f7bd6ffd700 1 -- 172.21.15.5:0/2310166695 learned_addr learned my addr 172.21.15.5:0/2310166695 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:40:14.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.238+0000 7f7bd77fe700 1 --2- 172.21.15.5:0/2310166695 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bd8066ca0 0x7f7bd80fd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:14.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.238+0000 7f7bd6ffd700 1 -- 172.21.15.5:0/2310166695 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bd8066ca0 msgr2=0x7f7bd80fd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:14.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.238+0000 7f7bd6ffd700 1 --2- 172.21.15.5:0/2310166695 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bd8066ca0 0x7f7bd80fd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:14.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.238+0000 7f7bd6ffd700 1 -- 172.21.15.5:0/2310166695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc8005040 con 0x7f7bd80ffe30 2024-04-16T14:40:14.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.238+0000 7f7bd6ffd700 1 --2- 172.21.15.5:0/2310166695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7bd80ffe30 0x7f7bd80fb7f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc002a80 tx=0x7f7bcc004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:14.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.238+0000 7f7bbffff700 1 -- 172.21.15.5:0/2310166695 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bcc004e80 con 0x7f7bd80ffe30 2024-04-16T14:40:14.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.238+0000 7f7bdcfa1700 1 -- 172.21.15.5:0/2310166695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd80fc1a0 con 0x7f7bd80ffe30 2024-04-16T14:40:14.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.238+0000 7f7bbffff700 1 -- 172.21.15.5:0/2310166695 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7bcc00f040 con 0x7f7bd80ffe30 2024-04-16T14:40:14.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.238+0000 7f7bbffff700 1 -- 172.21.15.5:0/2310166695 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bcc00daa0 con 0x7f7bd80ffe30 2024-04-16T14:40:14.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.238+0000 7f7bdcfa1700 1 -- 172.21.15.5:0/2310166695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd8115970 con 0x7f7bd80ffe30 2024-04-16T14:40:14.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.240+0000 7f7bdcfa1700 1 -- 172.21.15.5:0/2310166695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd80faf40 con 0x7f7bd80ffe30 2024-04-16T14:40:14.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.240+0000 7f7bbffff700 1 -- 172.21.15.5:0/2310166695 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f7bcc00dc00 con 0x7f7bd80ffe30 2024-04-16T14:40:14.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.240+0000 7f7bbffff700 1 --2- 172.21.15.5:0/2310166695 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f7bc006e140 0x7f7bc00705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:14.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.240+0000 7f7bbffff700 1 -- 172.21.15.5:0/2310166695 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f7bcc08d160 con 0x7f7bd80ffe30 2024-04-16T14:40:14.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.240+0000 7f7bd77fe700 1 --2- 172.21.15.5:0/2310166695 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f7bc006e140 0x7f7bc00705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:14.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.241+0000 7f7bd77fe700 1 --2- 172.21.15.5:0/2310166695 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f7bc006e140 0x7f7bc00705f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7bc800b970 tx=0x7f7bc8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:14.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.245+0000 7f7bbffff700 1 -- 172.21.15.5:0/2310166695 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f7bcc0564e0 con 0x7f7bd80ffe30 2024-04-16T14:40:14.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.506+0000 7f7bdcfa1700 1 -- 172.21.15.5:0/2310166695 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7bd804bed0 con 0x7f7bd80ffe30 2024-04-16T14:40:14.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.507+0000 7f7bbffff700 1 -- 172.21.15.5:0/2310166695 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1897 (secure 0 0 0) 0x7f7bcc059ba0 con 0x7f7bd80ffe30 2024-04-16T14:40:14.506 INFO:teuthology.orchestra.run.smithi005.stdout:e22 2024-04-16T14:40:14.506 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:40:14.506 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:40:14.506 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2024-04-16T14:40:14.506 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:40:14.506 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2024-04-16T14:40:14.506 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2024-04-16T14:40:14.506 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 22 2024-04-16T14:40:14.506 INFO:teuthology.orchestra.run.smithi005.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-16T14:40:14.506 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-16T14:32:45.270024+0000 2024-04-16T14:40:14.507 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-04-16T14:39:57.598894+0000 2024-04-16T14:40:14.507 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2024-04-16T14:40:14.507 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2024-04-16T14:40:14.507 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 60 2024-04-16T14:40:14.507 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2024-04-16T14:40:14.507 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2024-04-16T14:40:14.507 INFO:teuthology.orchestra.run.smithi005.stdout:max_xattr_size 65536 2024-04-16T14:40:14.507 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2024-04-16T14:40:14.507 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2024-04-16T14:40:14.507 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 47 2024-04-16T14:40:14.507 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:40:14.507 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 2 2024-04-16T14:40:14.507 INFO:teuthology.orchestra.run.smithi005.stdout:in 0,1 2024-04-16T14:40:14.507 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=14484,1=24269} 2024-04-16T14:40:14.507 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2024-04-16T14:40:14.508 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2024-04-16T14:40:14.508 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 2024-04-16T14:40:14.508 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3] 2024-04-16T14:40:14.508 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2024-04-16T14:40:14.508 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2024-04-16T14:40:14.508 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2024-04-16T14:40:14.508 INFO:teuthology.orchestra.run.smithi005.stdout:bal_rank_mask -1 2024-04-16T14:40:14.508 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 1 2024-04-16T14:40:14.508 INFO:teuthology.orchestra.run.smithi005.stdout:qdb_cluster leader: 14484 members: 24269,14484 2024-04-16T14:40:14.508 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.wofqlz{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:40:14.508 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.byfytg{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.115:6824/1662994117,v1:172.21.15.115:6825/1662994117] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:40:14.508 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:40:14.508 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:40:14.508 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2024-04-16T14:40:14.508 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:40:14.509 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.vzoqdl{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.5:6826/187766809,v1:172.21.15.5:6827/187766809] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:40:14.509 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.trkaqh{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:40:14.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.509+0000 7f7bdcfa1700 1 -- 172.21.15.5:0/2310166695 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f7bc006e140 msgr2=0x7f7bc00705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:14.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.509+0000 7f7bdcfa1700 1 --2- 172.21.15.5:0/2310166695 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f7bc006e140 0x7f7bc00705f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7bc800b970 tx=0x7f7bc8009e30 comp rx=0 tx=0).stop 2024-04-16T14:40:14.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.509+0000 7f7bdcfa1700 1 -- 172.21.15.5:0/2310166695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7bd80ffe30 msgr2=0x7f7bd80fb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:14.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.509+0000 7f7bdcfa1700 1 --2- 172.21.15.5:0/2310166695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7bd80ffe30 0x7f7bd80fb7f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc002a80 tx=0x7f7bcc004630 comp rx=0 tx=0).stop 2024-04-16T14:40:14.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.509+0000 7f7bdcfa1700 1 -- 172.21.15.5:0/2310166695 shutdown_connections 2024-04-16T14:40:14.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.509+0000 7f7bdcfa1700 1 --2- 172.21.15.5:0/2310166695 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f7bc006e140 0x7f7bc00705f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:14.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.509+0000 7f7bdcfa1700 1 --2- 172.21.15.5:0/2310166695 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7bd8066ca0 0x7f7bd80fd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:14.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.509+0000 7f7bdcfa1700 1 --2- 172.21.15.5:0/2310166695 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7bd80ffe30 0x7f7bd80fb7f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:14.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.509+0000 7f7bdcfa1700 1 -- 172.21.15.5:0/2310166695 >> 172.21.15.5:0/2310166695 conn(0x7f7bd80f72a0 msgr2=0x7f7bd80f76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:14.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.509+0000 7f7bdcfa1700 1 -- 172.21.15.5:0/2310166695 shutdown_connections 2024-04-16T14:40:14.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.509+0000 7f7bdcfa1700 1 -- 172.21.15.5:0/2310166695 wait complete. 2024-04-16T14:40:14.510 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 22 2024-04-16T14:40:14.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.615+0000 7f23da0eb700 1 -- 172.21.15.5:0/1893061017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23d40fc320 msgr2=0x7f23d40fc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:14.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.615+0000 7f23da0eb700 1 --2- 172.21.15.5:0/1893061017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23d40fc320 0x7f23d40fc730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f23c4009ce0 tx=0x7f23c4004d10 comp rx=0 tx=0).stop 2024-04-16T14:40:14.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.615+0000 7f23da0eb700 1 -- 172.21.15.5:0/1893061017 shutdown_connections 2024-04-16T14:40:14.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.615+0000 7f23da0eb700 1 --2- 172.21.15.5:0/1893061017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23d40fcc70 0x7f23d40fd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:14.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.615+0000 7f23da0eb700 1 --2- 172.21.15.5:0/1893061017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23d40fc320 0x7f23d40fc730 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:14.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.615+0000 7f23da0eb700 1 -- 172.21.15.5:0/1893061017 >> 172.21.15.5:0/1893061017 conn(0x7f23d40f6bd0 msgr2=0x7f23d40f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:14.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.615+0000 7f23da0eb700 1 -- 172.21.15.5:0/1893061017 shutdown_connections 2024-04-16T14:40:14.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.615+0000 7f23da0eb700 1 -- 172.21.15.5:0/1893061017 wait complete. 2024-04-16T14:40:14.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.615+0000 7f23da0eb700 1 Processor -- start 2024-04-16T14:40:14.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.616+0000 7f23da0eb700 1 -- start start 2024-04-16T14:40:14.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.616+0000 7f23da0eb700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23d40fc320 0x7f23d41108a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:14.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.616+0000 7f23da0eb700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23d40fcc70 0x7f23d4112df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:14.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.616+0000 7f23da0eb700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d40fbd10 con 0x7f23d40fc320 2024-04-16T14:40:14.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.616+0000 7f23da0eb700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d40fbe50 con 0x7f23d40fcc70 2024-04-16T14:40:14.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.616+0000 7f23d37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23d40fc320 0x7f23d41108a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:14.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.616+0000 7f23d37fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23d40fc320 0x7f23d41108a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53848/0 (socket says 172.21.15.5:53848) 2024-04-16T14:40:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.616+0000 7f23d37fe700 1 -- 172.21.15.5:0/2424700285 learned_addr learned my addr 172.21.15.5:0/2424700285 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:40:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.616+0000 7f23d2ffd700 1 --2- 172.21.15.5:0/2424700285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23d40fcc70 0x7f23d4112df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.616+0000 7f23d37fe700 1 -- 172.21.15.5:0/2424700285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23d40fcc70 msgr2=0x7f23d4112df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.616+0000 7f23d37fe700 1 --2- 172.21.15.5:0/2424700285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23d40fcc70 0x7f23d4112df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.616+0000 7f23d37fe700 1 -- 172.21.15.5:0/2424700285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c4009940 con 0x7f23d40fc320 2024-04-16T14:40:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.616+0000 7f23d37fe700 1 --2- 172.21.15.5:0/2424700285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23d40fc320 0x7f23d41108a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f23c4009380 tx=0x7f23c4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.616+0000 7f23bbfff700 1 -- 172.21.15.5:0/2424700285 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23c400e040 con 0x7f23d40fc320 2024-04-16T14:40:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.617+0000 7f23bbfff700 1 -- 172.21.15.5:0/2424700285 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f23c40128e0 con 0x7f23d40fc320 2024-04-16T14:40:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.617+0000 7f23bbfff700 1 -- 172.21.15.5:0/2424700285 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23c401c930 con 0x7f23d40fc320 2024-04-16T14:40:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.617+0000 7f23da0eb700 1 -- 172.21.15.5:0/2424700285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d4113330 con 0x7f23d40fc320 2024-04-16T14:40:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.617+0000 7f23da0eb700 1 -- 172.21.15.5:0/2424700285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d41138a0 con 0x7f23d40fc320 2024-04-16T14:40:14.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.617+0000 7f23da0eb700 1 -- 172.21.15.5:0/2424700285 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d405f5f0 con 0x7f23d40fc320 2024-04-16T14:40:14.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.618+0000 7f23bbfff700 1 -- 172.21.15.5:0/2424700285 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f23c4012a50 con 0x7f23d40fc320 2024-04-16T14:40:14.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.619+0000 7f23bbfff700 1 --2- 172.21.15.5:0/2424700285 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f23bc06e140 0x7f23bc0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:14.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.619+0000 7f23bbfff700 1 -- 172.21.15.5:0/2424700285 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f23c408f6b0 con 0x7f23d40fc320 2024-04-16T14:40:14.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.619+0000 7f23d2ffd700 1 --2- 172.21.15.5:0/2424700285 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f23bc06e140 0x7f23bc0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:14.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.619+0000 7f23d2ffd700 1 --2- 172.21.15.5:0/2424700285 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f23bc06e140 0x7f23bc0705f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f23c8004f40 tx=0x7f23c800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:14.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.623+0000 7f23bbfff700 1 -- 172.21.15.5:0/2424700285 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f23c4058a30 con 0x7f23d40fc320 2024-04-16T14:40:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.848+0000 7f23da0eb700 1 -- 172.21.15.5:0/2424700285 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f23d4101400 con 0x7f23bc06e140 2024-04-16T14:40:14.847 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:14 smithi005 ceph-mon[93420]: pgmap v103: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:14.847 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:14 smithi005 ceph-mon[93420]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:40:14.847 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:14 smithi005 ceph-mon[93420]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:40:14.847 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:14 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/2141667134' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:40:14.848 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:14 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/2310166695' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:40:14.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.850+0000 7f23bbfff700 1 -- 172.21.15.5:0/2424700285 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f23d4101400 con 0x7f23bc06e140 2024-04-16T14:40:14.848 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:40:14.848 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91", 2024-04-16T14:40:14.848 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-04-16T14:40:14.848 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-16T14:40:14.848 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [ 2024-04-16T14:40:14.849 INFO:teuthology.orchestra.run.smithi005.stdout: "mon", 2024-04-16T14:40:14.849 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr", 2024-04-16T14:40:14.849 INFO:teuthology.orchestra.run.smithi005.stdout: "crash" 2024-04-16T14:40:14.849 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-04-16T14:40:14.849 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "9/21 daemons upgraded", 2024-04-16T14:40:14.849 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading osd daemons", 2024-04-16T14:40:14.849 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-04-16T14:40:14.849 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:40:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.852+0000 7f23da0eb700 1 -- 172.21.15.5:0/2424700285 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f23bc06e140 msgr2=0x7f23bc0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.852+0000 7f23da0eb700 1 --2- 172.21.15.5:0/2424700285 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f23bc06e140 0x7f23bc0705f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f23c8004f40 tx=0x7f23c800b040 comp rx=0 tx=0).stop 2024-04-16T14:40:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.852+0000 7f23da0eb700 1 -- 172.21.15.5:0/2424700285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23d40fc320 msgr2=0x7f23d41108a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.852+0000 7f23da0eb700 1 --2- 172.21.15.5:0/2424700285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23d40fc320 0x7f23d41108a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f23c4009380 tx=0x7f23c4004d10 comp rx=0 tx=0).stop 2024-04-16T14:40:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.852+0000 7f23da0eb700 1 -- 172.21.15.5:0/2424700285 shutdown_connections 2024-04-16T14:40:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.852+0000 7f23da0eb700 1 --2- 172.21.15.5:0/2424700285 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f23bc06e140 0x7f23bc0705f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.852+0000 7f23da0eb700 1 --2- 172.21.15.5:0/2424700285 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23d40fc320 0x7f23d41108a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.852+0000 7f23da0eb700 1 --2- 172.21.15.5:0/2424700285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23d40fcc70 0x7f23d4112df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.852+0000 7f23da0eb700 1 -- 172.21.15.5:0/2424700285 >> 172.21.15.5:0/2424700285 conn(0x7f23d40f6bd0 msgr2=0x7f23d40f82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.852+0000 7f23da0eb700 1 -- 172.21.15.5:0/2424700285 shutdown_connections 2024-04-16T14:40:14.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.852+0000 7f23da0eb700 1 -- 172.21.15.5:0/2424700285 wait complete. 2024-04-16T14:40:14.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:14 smithi115 ceph-mon[83414]: pgmap v103: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:14.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:14 smithi115 ceph-mon[83414]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:40:14.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:14 smithi115 ceph-mon[83414]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:40:14.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:14 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/2141667134' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:40:14.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:14 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/2310166695' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:40:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.956+0000 7f4a28104700 1 -- 172.21.15.5:0/1792930324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a200fdff0 msgr2=0x7f4a200fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.956+0000 7f4a28104700 1 --2- 172.21.15.5:0/1792930324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a200fdff0 0x7f4a200fe460 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4a10004940 tx=0x7f4a10009e30 comp rx=0 tx=0).stop 2024-04-16T14:40:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.956+0000 7f4a28104700 1 -- 172.21.15.5:0/1792930324 shutdown_connections 2024-04-16T14:40:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.956+0000 7f4a28104700 1 --2- 172.21.15.5:0/1792930324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a200fdff0 0x7f4a200fe460 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.956+0000 7f4a28104700 1 --2- 172.21.15.5:0/1792930324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a200fce80 0x7f4a200fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.956+0000 7f4a28104700 1 -- 172.21.15.5:0/1792930324 >> 172.21.15.5:0/1792930324 conn(0x7f4a200f8580 msgr2=0x7f4a200fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.956+0000 7f4a28104700 1 -- 172.21.15.5:0/1792930324 shutdown_connections 2024-04-16T14:40:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.956+0000 7f4a28104700 1 -- 172.21.15.5:0/1792930324 wait complete. 2024-04-16T14:40:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.956+0000 7f4a28104700 1 Processor -- start 2024-04-16T14:40:14.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.957+0000 7f4a28104700 1 -- start start 2024-04-16T14:40:14.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.957+0000 7f4a28104700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a200fce80 0x7f4a2010d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:14.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.957+0000 7f4a28104700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a200fdff0 0x7f4a2010de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:14.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.957+0000 7f4a28104700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2010e450 con 0x7f4a200fce80 2024-04-16T14:40:14.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.957+0000 7f4a28104700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2010e5c0 con 0x7f4a200fdff0 2024-04-16T14:40:14.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.957+0000 7f4a25ea0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a200fce80 0x7f4a2010d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:14.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.957+0000 7f4a25ea0700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a200fce80 0x7f4a2010d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53872/0 (socket says 172.21.15.5:53872) 2024-04-16T14:40:14.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.957+0000 7f4a25ea0700 1 -- 172.21.15.5:0/1119801284 learned_addr learned my addr 172.21.15.5:0/1119801284 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:40:14.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.957+0000 7f4a2569f700 1 --2- 172.21.15.5:0/1119801284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a200fdff0 0x7f4a2010de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:14.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.957+0000 7f4a25ea0700 1 -- 172.21.15.5:0/1119801284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a200fdff0 msgr2=0x7f4a2010de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:14.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.957+0000 7f4a25ea0700 1 --2- 172.21.15.5:0/1119801284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a200fdff0 0x7f4a2010de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:14.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.957+0000 7f4a25ea0700 1 -- 172.21.15.5:0/1119801284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a10005040 con 0x7f4a200fce80 2024-04-16T14:40:14.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.957+0000 7f4a25ea0700 1 --2- 172.21.15.5:0/1119801284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a200fce80 0x7f4a2010d910 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c00c830 tx=0x7f4a1c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:14.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.957+0000 7f4a167fc700 1 -- 172.21.15.5:0/1119801284 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a1c00a760 con 0x7f4a200fce80 2024-04-16T14:40:14.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.957+0000 7f4a167fc700 1 -- 172.21.15.5:0/1119801284 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4a1c00ad90 con 0x7f4a200fce80 2024-04-16T14:40:14.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.958+0000 7f4a167fc700 1 -- 172.21.15.5:0/1119801284 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a1c0113a0 con 0x7f4a200fce80 2024-04-16T14:40:14.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.958+0000 7f4a28104700 1 -- 172.21.15.5:0/1119801284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a20112fc0 con 0x7f4a200fce80 2024-04-16T14:40:14.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.958+0000 7f4a28104700 1 -- 172.21.15.5:0/1119801284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a20113550 con 0x7f4a200fce80 2024-04-16T14:40:14.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.959+0000 7f4a28104700 1 -- 172.21.15.5:0/1119801284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a2004c710 con 0x7f4a200fce80 2024-04-16T14:40:14.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.959+0000 7f4a167fc700 1 -- 172.21.15.5:0/1119801284 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f4a1c012400 con 0x7f4a200fce80 2024-04-16T14:40:14.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.960+0000 7f4a167fc700 1 --2- 172.21.15.5:0/1119801284 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f4a0c06e140 0x7f4a0c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:14.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.960+0000 7f4a2569f700 1 --2- 172.21.15.5:0/1119801284 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f4a0c06e140 0x7f4a0c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:14.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.960+0000 7f4a167fc700 1 -- 172.21.15.5:0/1119801284 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f4a1c08db40 con 0x7f4a200fce80 2024-04-16T14:40:14.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.960+0000 7f4a2569f700 1 --2- 172.21.15.5:0/1119801284 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f4a0c06e140 0x7f4a0c0705f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4a1000b970 tx=0x7f4a10009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:14.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:14.965+0000 7f4a167fc700 1 -- 172.21.15.5:0/1119801284 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f4a1c05aa70 con 0x7f4a200fce80 2024-04-16T14:40:15.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:15.259+0000 7f4a28104700 1 -- 172.21.15.5:0/1119801284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4a201058e0 con 0x7f4a200fce80 2024-04-16T14:40:15.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:15.259+0000 7f4a167fc700 1 -- 172.21.15.5:0/1119801284 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f4a1c05a600 con 0x7f4a200fce80 2024-04-16T14:40:15.258 INFO:teuthology.orchestra.run.smithi005.stdout:HEALTH_OK 2024-04-16T14:40:15.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:15.261+0000 7f4a28104700 1 -- 172.21.15.5:0/1119801284 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f4a0c06e140 msgr2=0x7f4a0c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:15.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:15.261+0000 7f4a28104700 1 --2- 172.21.15.5:0/1119801284 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f4a0c06e140 0x7f4a0c0705f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4a1000b970 tx=0x7f4a10009e30 comp rx=0 tx=0).stop 2024-04-16T14:40:15.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:15.261+0000 7f4a28104700 1 -- 172.21.15.5:0/1119801284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a200fce80 msgr2=0x7f4a2010d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:15.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:15.261+0000 7f4a28104700 1 --2- 172.21.15.5:0/1119801284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a200fce80 0x7f4a2010d910 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c00c830 tx=0x7f4a1c004470 comp rx=0 tx=0).stop 2024-04-16T14:40:15.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:15.262+0000 7f4a28104700 1 -- 172.21.15.5:0/1119801284 shutdown_connections 2024-04-16T14:40:15.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:15.262+0000 7f4a28104700 1 --2- 172.21.15.5:0/1119801284 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f4a0c06e140 0x7f4a0c0705f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:15.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:15.262+0000 7f4a28104700 1 --2- 172.21.15.5:0/1119801284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a200fce80 0x7f4a2010d910 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:15.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:15.262+0000 7f4a28104700 1 --2- 172.21.15.5:0/1119801284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a200fdff0 0x7f4a2010de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:15.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:15.262+0000 7f4a28104700 1 -- 172.21.15.5:0/1119801284 >> 172.21.15.5:0/1119801284 conn(0x7f4a200f8580 msgr2=0x7f4a200f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:15.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:15.262+0000 7f4a28104700 1 -- 172.21.15.5:0/1119801284 shutdown_connections 2024-04-16T14:40:15.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:15.262+0000 7f4a28104700 1 -- 172.21.15.5:0/1119801284 wait complete. 2024-04-16T14:40:15.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:15 smithi115 ceph-mon[83414]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:40:15.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:15 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/1119801284' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:40:15.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:15 smithi005 ceph-mon[93420]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:40:15.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:15 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/1119801284' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:40:16.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:16 smithi115 ceph-mon[83414]: pgmap v104: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:16.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:16 smithi005 ceph-mon[93420]: pgmap v104: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:18.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:18 smithi115 ceph-mon[83414]: pgmap v105: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:18.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:18 smithi005 ceph-mon[93420]: pgmap v105: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:20.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:20 smithi115 ceph-mon[83414]: pgmap v106: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:20.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:20 smithi005 ceph-mon[93420]: pgmap v106: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:21.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:21 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-16T14:40:21.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:21 smithi115 ceph-mon[83414]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-16T14:40:21.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:21 smithi115 ceph-mon[83414]: Upgrade: osd.3 is safe to restart 2024-04-16T14:40:21.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:21 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-16T14:40:21.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:21 smithi005 ceph-mon[93420]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-16T14:40:21.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:21 smithi005 ceph-mon[93420]: Upgrade: osd.3 is safe to restart 2024-04-16T14:40:22.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:22 smithi115 ceph-mon[83414]: pgmap v107: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:22.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:22 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:22.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:22 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-16T14:40:22.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:22 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:40:22.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:22 smithi005 ceph-mon[93420]: pgmap v107: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:22.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:22 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:22.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:22 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-16T14:40:22.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:22 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:40:23.913 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:23 smithi115 ceph-mon[83414]: Upgrade: Updating osd.3 2024-04-16T14:40:23.913 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:23 smithi115 ceph-mon[83414]: Deploying daemon osd.3 on smithi115 2024-04-16T14:40:23.913 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:23 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:40:23.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:23 smithi005 ceph-mon[93420]: Upgrade: Updating osd.3 2024-04-16T14:40:23.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:23 smithi005 ceph-mon[93420]: Deploying daemon osd.3 on smithi115 2024-04-16T14:40:23.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:23 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:40:24.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:24 smithi115 ceph-mon[83414]: pgmap v108: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:24.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:24 smithi005 ceph-mon[93420]: pgmap v108: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:25.682 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:25 smithi115 systemd[1]: Stopping Ceph osd.3 for 10609bfa-fbfd-11ee-bc90-c7b262605968... 2024-04-16T14:40:26.181 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:25 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3[42864]: 2024-04-16T14:40:25.759+0000 7fb2bf6cc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-16T14:40:26.181 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:25 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3[42864]: 2024-04-16T14:40:25.759+0000 7fb2bf6cc700 -1 osd.3 65 *** Got signal Terminated *** 2024-04-16T14:40:26.181 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:25 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3[42864]: 2024-04-16T14:40:25.759+0000 7fb2bf6cc700 -1 osd.3 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-16T14:40:26.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:26 smithi115 ceph-mon[83414]: pgmap v109: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:26.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:26 smithi115 ceph-mon[83414]: osd.3 marked itself down and dead 2024-04-16T14:40:26.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:26 smithi005 ceph-mon[93420]: pgmap v109: 65 pgs: 65 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:26.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:26 smithi005 ceph-mon[93420]: osd.3 marked itself down and dead 2024-04-16T14:40:27.333 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:27 smithi115 podman[92678]: 2024-04-16 14:40:27.062499553 +0000 UTC m=+1.405333653 container died 59f81301ebcf12241c759798be544b4dba2a992f97afacb53989fb070b578fe1 (image=quay.ceph.io/ceph-ci/ceph@sha256:15b9a118425d53cc97d2f7bc08f63df1d8bfa1149df59d4de72a305b04501998, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=quincy-412a552, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409) 2024-04-16T14:40:27.656 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:27 smithi115 podman[92678]: 2024-04-16 14:40:27.42671699 +0000 UTC m=+1.769551137 container cleanup 59f81301ebcf12241c759798be544b4dba2a992f97afacb53989fb070b578fe1 (image=quay.ceph.io/ceph-ci/ceph@sha256:15b9a118425d53cc97d2f7bc08f63df1d8bfa1149df59d4de72a305b04501998, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=quincy-412a552, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-16T14:40:27.656 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:27 smithi115 bash[92678]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3 2024-04-16T14:40:27.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:27 smithi115 ceph-mon[83414]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-16T14:40:27.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:27 smithi115 ceph-mon[83414]: osdmap e66: 6 total, 5 up, 6 in 2024-04-16T14:40:27.931 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:27 smithi115 podman[92706]: 2024-04-16 14:40:27.736945664 +0000 UTC m=+0.677399487 container remove 59f81301ebcf12241c759798be544b4dba2a992f97afacb53989fb070b578fe1 (image=quay.ceph.io/ceph-ci/ceph@sha256:15b9a118425d53cc97d2f7bc08f63df1d8bfa1149df59d4de72a305b04501998, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.schema-version=1.0, RELEASE=quincy-412a552, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-16T14:40:27.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:27 smithi005 ceph-mon[93420]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-16T14:40:27.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:27 smithi005 ceph-mon[93420]: osdmap e66: 6 total, 5 up, 6 in 2024-04-16T14:40:28.337 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:28 smithi115 podman[92801]: 2024-04-16 14:40:27.941186998 +0000 UTC m=+0.018102638 image pull b1a78730e0db57f46162ae12211512856024b361a698c3ed431f6fbc73b484c3 quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 2024-04-16T14:40:28.338 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:28 smithi115 podman[92801]: 2024-04-16 14:40:28.046177604 +0000 UTC m=+0.123093268 container create 27d1fbb5be9a9854ef5a2991c862d3af4fd2f0bf90773d5e5b1f81681709002f (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-04-16T14:40:28.338 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:28 smithi115 podman[92801]: 2024-04-16 14:40:28.256815282 +0000 UTC m=+0.333730903 container init 27d1fbb5be9a9854ef5a2991c862d3af4fd2f0bf90773d5e5b1f81681709002f (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3-deactivate, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-16T14:40:28.338 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:28 smithi115 podman[92801]: 2024-04-16 14:40:28.260025461 +0000 UTC m=+0.336941083 container start 27d1fbb5be9a9854ef5a2991c862d3af4fd2f0bf90773d5e5b1f81681709002f (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3-deactivate, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-16T14:40:28.338 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:28 smithi115 podman[92801]: 2024-04-16 14:40:28.339998808 +0000 UTC m=+0.416914435 container attach 27d1fbb5be9a9854ef5a2991c862d3af4fd2f0bf90773d5e5b1f81681709002f (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux ) 2024-04-16T14:40:28.669 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:28 smithi115 podman[92801]: 2024-04-16 14:40:28.548636441 +0000 UTC m=+0.625552081 container died 27d1fbb5be9a9854ef5a2991c862d3af4fd2f0bf90773d5e5b1f81681709002f (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409) 2024-04-16T14:40:28.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:28 smithi115 ceph-mon[83414]: pgmap v111: 65 pgs: 16 stale+active+clean, 49 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:28.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:28 smithi115 ceph-mon[83414]: osdmap e67: 6 total, 5 up, 6 in 2024-04-16T14:40:28.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:28 smithi005 ceph-mon[93420]: pgmap v111: 65 pgs: 16 stale+active+clean, 49 active+clean; 300 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:28.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:28 smithi005 ceph-mon[93420]: osdmap e67: 6 total, 5 up, 6 in 2024-04-16T14:40:29.431 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:29 smithi115 podman[92826]: 2024-04-16 14:40:29.110482296 +0000 UTC m=+0.552537491 container remove 27d1fbb5be9a9854ef5a2991c862d3af4fd2f0bf90773d5e5b1f81681709002f (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-16T14:40:29.431 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:29 smithi115 systemd[1]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.3.service: Deactivated successfully. 2024-04-16T14:40:29.432 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:29 smithi115 systemd[1]: Stopped Ceph osd.3 for 10609bfa-fbfd-11ee-bc90-c7b262605968. 2024-04-16T14:40:29.432 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:29 smithi115 systemd[1]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.3.service: Consumed 1min 8.154s CPU time. 2024-04-16T14:40:29.432 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:29 smithi115 systemd[1]: Starting Ceph osd.3 for 10609bfa-fbfd-11ee-bc90-c7b262605968... 2024-04-16T14:40:29.853 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:29 smithi115 ceph-mon[83414]: Health check failed: Degraded data redundancy: 41/354 objects degraded (11.582%), 9 pgs degraded (PG_DEGRADED) 2024-04-16T14:40:29.853 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:29 smithi115 podman[92932]: 2024-04-16 14:40:29.457223974 +0000 UTC m=+0.017275685 image pull b1a78730e0db57f46162ae12211512856024b361a698c3ed431f6fbc73b484c3 quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 2024-04-16T14:40:29.854 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:29 smithi115 podman[92932]: 2024-04-16 14:40:29.561869756 +0000 UTC m=+0.121921443 container create 9248d60914368dbee4f9dadf07f61f3701e1a9d54e31fd95eb37a0d3ee6d347d (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3-activate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5) 2024-04-16T14:40:29.854 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:29 smithi115 podman[92932]: 2024-04-16 14:40:29.781101339 +0000 UTC m=+0.341153027 container init 9248d60914368dbee4f9dadf07f61f3701e1a9d54e31fd95eb37a0d3ee6d347d (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3-activate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5) 2024-04-16T14:40:29.854 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:29 smithi115 podman[92932]: 2024-04-16 14:40:29.784504256 +0000 UTC m=+0.344555945 container start 9248d60914368dbee4f9dadf07f61f3701e1a9d54e31fd95eb37a0d3ee6d347d (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3-activate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409) 2024-04-16T14:40:29.854 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:29 smithi115 podman[92932]: 2024-04-16 14:40:29.855912991 +0000 UTC m=+0.415964697 container attach 9248d60914368dbee4f9dadf07f61f3701e1a9d54e31fd95eb37a0d3ee6d347d (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3-activate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409) 2024-04-16T14:40:29.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:29 smithi005 ceph-mon[93420]: Health check failed: Degraded data redundancy: 41/354 objects degraded (11.582%), 9 pgs degraded (PG_DEGRADED) 2024-04-16T14:40:30.548 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:30 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3-activate[92947]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-16T14:40:30.548 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:30 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3-activate[92947]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-16T14:40:30.548 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:30 smithi115 bash[92932]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-16T14:40:30.548 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:30 smithi115 bash[92932]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-16T14:40:30.548 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:30 smithi115 bash[92932]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-16T14:40:30.548 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:30 smithi115 bash[92932]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-16T14:40:30.548 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:30 smithi115 bash[92932]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-04-16T14:40:30.548 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:30 smithi115 bash[92932]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-16T14:40:30.548 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:30 smithi115 bash[92932]: --> ceph-volume raw activate successful for osd ID: 3 2024-04-16T14:40:30.549 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:30 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3-activate[92947]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-16T14:40:30.549 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:30 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3-activate[92947]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-16T14:40:30.549 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:30 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3-activate[92947]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-04-16T14:40:30.549 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:30 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3-activate[92947]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-16T14:40:30.549 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:30 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3-activate[92947]: --> ceph-volume raw activate successful for osd ID: 3 2024-04-16T14:40:30.549 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:30 smithi115 podman[92932]: 2024-04-16 14:40:30.255797737 +0000 UTC m=+0.815849419 container died 9248d60914368dbee4f9dadf07f61f3701e1a9d54e31fd95eb37a0d3ee6d347d (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-04-16T14:40:30.857 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:30 smithi115 ceph-mon[83414]: pgmap v113: 65 pgs: 9 active+undersized+degraded, 6 stale+active+clean, 9 active+undersized, 41 active+clean; 300 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 41/354 objects degraded (11.582%) 2024-04-16T14:40:30.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:30 smithi005 ceph-mon[93420]: pgmap v113: 65 pgs: 9 active+undersized+degraded, 6 stale+active+clean, 9 active+undersized, 41 active+clean; 300 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 41/354 objects degraded (11.582%) 2024-04-16T14:40:31.173 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:30 smithi115 podman[93071]: 2024-04-16 14:40:30.859775189 +0000 UTC m=+0.598301348 container remove 9248d60914368dbee4f9dadf07f61f3701e1a9d54e31fd95eb37a0d3ee6d347d (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-16T14:40:31.173 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:31 smithi115 podman[93138]: 2024-04-16 14:40:30.97578891 +0000 UTC m=+0.017763560 image pull b1a78730e0db57f46162ae12211512856024b361a698c3ed431f6fbc73b484c3 quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 2024-04-16T14:40:31.173 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:31 smithi115 podman[93138]: 2024-04-16 14:40:31.07766402 +0000 UTC m=+0.119638658 container create 808ebb96c862028b9ec6f48ab2711348ea69cf650838fafb1da4b63a0f0b78eb (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-16T14:40:31.681 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:31 smithi115 podman[93138]: 2024-04-16 14:40:31.305006127 +0000 UTC m=+0.346980759 container init 808ebb96c862028b9ec6f48ab2711348ea69cf650838fafb1da4b63a0f0b78eb (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-16T14:40:31.681 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:31 smithi115 podman[93138]: 2024-04-16 14:40:31.308225992 +0000 UTC m=+0.350200624 container start 808ebb96c862028b9ec6f48ab2711348ea69cf650838fafb1da4b63a0f0b78eb (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409, io.buildah.version=1.33.5) 2024-04-16T14:40:31.682 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:31 smithi115 bash[93138]: 808ebb96c862028b9ec6f48ab2711348ea69cf650838fafb1da4b63a0f0b78eb 2024-04-16T14:40:31.682 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:31 smithi115 systemd[1]: Started Ceph osd.3 for 10609bfa-fbfd-11ee-bc90-c7b262605968. 2024-04-16T14:40:32.181 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:31 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3[93153]: 2024-04-16T14:40:31.850+0000 7f6f744bb7c0 -1 Falling back to public interface 2024-04-16T14:40:32.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:32 smithi115 ceph-mon[83414]: pgmap v114: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 300 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 73/354 objects degraded (20.621%) 2024-04-16T14:40:32.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:32.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:32.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:40:32.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:32 smithi005 ceph-mon[93420]: pgmap v114: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 300 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 73/354 objects degraded (20.621%) 2024-04-16T14:40:32.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:32.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:32.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:40:34.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:34 smithi005 ceph-mon[93420]: pgmap v115: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 300 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 73/354 objects degraded (20.621%) 2024-04-16T14:40:34.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:34 smithi115 ceph-mon[83414]: pgmap v115: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 300 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 73/354 objects degraded (20.621%) 2024-04-16T14:40:35.832 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:35 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:35.832 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:35 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:35.832 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:35 smithi115 ceph-mon[83414]: Health check update: Degraded data redundancy: 73/354 objects degraded (20.621%), 19 pgs degraded (PG_DEGRADED) 2024-04-16T14:40:35.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:35 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:35.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:35 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:35.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:35 smithi005 ceph-mon[93420]: Health check update: Degraded data redundancy: 73/354 objects degraded (20.621%), 19 pgs degraded (PG_DEGRADED) 2024-04-16T14:40:36.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:36 smithi115 ceph-mon[83414]: pgmap v116: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 300 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 73/354 objects degraded (20.621%) 2024-04-16T14:40:36.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:36 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:36.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:36 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:36.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:36 smithi005 ceph-mon[93420]: pgmap v116: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 300 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 73/354 objects degraded (20.621%) 2024-04-16T14:40:36.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:36 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:36.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:36 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:37.300 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:37 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3[93153]: 2024-04-16T14:40:37.031+0000 7f6f744bb7c0 -1 osd.3 65 log_to_monitors true 2024-04-16T14:40:37.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:37 smithi115 ceph-mon[83414]: from='osd.3 [v2:172.21.15.115:6800/4263407632,v1:172.21.15.115:6801/4263407632]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-16T14:40:37.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:37 smithi115 ceph-mon[83414]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-16T14:40:37.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:37 smithi005 ceph-mon[93420]: from='osd.3 [v2:172.21.15.115:6800/4263407632,v1:172.21.15.115:6801/4263407632]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-16T14:40:37.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:37 smithi005 ceph-mon[93420]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-16T14:40:38.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:38 smithi115 ceph-mon[83414]: pgmap v117: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 300 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 73/354 objects degraded (20.621%) 2024-04-16T14:40:38.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:38 smithi115 ceph-mon[83414]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-16T14:40:38.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:38 smithi115 ceph-mon[83414]: osdmap e68: 6 total, 5 up, 6 in 2024-04-16T14:40:38.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:38 smithi115 ceph-mon[83414]: from='osd.3 [v2:172.21.15.115:6800/4263407632,v1:172.21.15.115:6801/4263407632]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-04-16T14:40:38.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:38 smithi115 ceph-mon[83414]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-04-16T14:40:38.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:38.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:40:38.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:38 smithi115 ceph-mon[83414]: from='osd.3 ' entity='osd.3' 2024-04-16T14:40:38.932 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:40:38 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3[93153]: 2024-04-16T14:40:38.474+0000 7f6f6190b700 -1 osd.3 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T14:40:38.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:38 smithi005 ceph-mon[93420]: pgmap v117: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 300 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 73/354 objects degraded (20.621%) 2024-04-16T14:40:38.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:38 smithi005 ceph-mon[93420]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-16T14:40:38.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:38 smithi005 ceph-mon[93420]: osdmap e68: 6 total, 5 up, 6 in 2024-04-16T14:40:38.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:38 smithi005 ceph-mon[93420]: from='osd.3 [v2:172.21.15.115:6800/4263407632,v1:172.21.15.115:6801/4263407632]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-04-16T14:40:38.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:38 smithi005 ceph-mon[93420]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-04-16T14:40:38.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:38.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:40:38.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:38 smithi005 ceph-mon[93420]: from='osd.3 ' entity='osd.3' 2024-04-16T14:40:40.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:40 smithi115 ceph-mon[83414]: pgmap v119: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 73/354 objects degraded (20.621%) 2024-04-16T14:40:40.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:40 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:40.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:40 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:40.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:40 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:40:40.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:40 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:40:40.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:40 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:40.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:40 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:40:40.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:40 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:40:40.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:40 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:40:40.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:40 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:40:40.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:40 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-16T14:40:40.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:40 smithi115 ceph-mon[83414]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-16T14:40:40.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:40 smithi115 ceph-mon[83414]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-04-16T14:40:40.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:40 smithi115 ceph-mon[83414]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-16T14:40:40.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:40 smithi115 ceph-mon[83414]: osd.3 [v2:172.21.15.115:6800/4263407632,v1:172.21.15.115:6801/4263407632] boot 2024-04-16T14:40:40.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:40 smithi115 ceph-mon[83414]: osdmap e69: 6 total, 6 up, 6 in 2024-04-16T14:40:40.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:40 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-16T14:40:40.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:40 smithi005 ceph-mon[93420]: pgmap v119: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 73/354 objects degraded (20.621%) 2024-04-16T14:40:40.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:40 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:40.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:40 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:40.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:40 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:40:40.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:40 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:40:40.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:40 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:40.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:40 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:40:40.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:40 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:40:40.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:40 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:40:40.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:40 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:40:40.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:40 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-16T14:40:40.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:40 smithi005 ceph-mon[93420]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-16T14:40:40.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:40 smithi005 ceph-mon[93420]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-04-16T14:40:40.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:40 smithi005 ceph-mon[93420]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-16T14:40:40.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:40 smithi005 ceph-mon[93420]: osd.3 [v2:172.21.15.115:6800/4263407632,v1:172.21.15.115:6801/4263407632] boot 2024-04-16T14:40:40.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:40 smithi005 ceph-mon[93420]: osdmap e69: 6 total, 6 up, 6 in 2024-04-16T14:40:40.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:40 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-16T14:40:41.934 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:41 smithi115 ceph-mon[83414]: osdmap e70: 6 total, 6 up, 6 in 2024-04-16T14:40:41.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:41 smithi005 ceph-mon[93420]: osdmap e70: 6 total, 6 up, 6 in 2024-04-16T14:40:42.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:42 smithi115 ceph-mon[83414]: pgmap v122: 65 pgs: 3 peering, 14 active+undersized+degraded, 14 active+undersized, 34 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 58/354 objects degraded (16.384%) 2024-04-16T14:40:42.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:42 smithi115 ceph-mon[83414]: Health check update: Degraded data redundancy: 58/354 objects degraded (16.384%), 14 pgs degraded (PG_DEGRADED) 2024-04-16T14:40:42.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:42 smithi005 ceph-mon[93420]: pgmap v122: 65 pgs: 3 peering, 14 active+undersized+degraded, 14 active+undersized, 34 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 58/354 objects degraded (16.384%) 2024-04-16T14:40:42.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:42 smithi005 ceph-mon[93420]: Health check update: Degraded data redundancy: 58/354 objects degraded (16.384%), 14 pgs degraded (PG_DEGRADED) 2024-04-16T14:40:44.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:44 smithi005 ceph-mon[93420]: pgmap v123: 65 pgs: 3 peering, 4 active+undersized+degraded, 8 active+undersized, 50 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 14/354 objects degraded (3.955%) 2024-04-16T14:40:44.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:44 smithi115 ceph-mon[83414]: pgmap v123: 65 pgs: 3 peering, 4 active+undersized+degraded, 8 active+undersized, 50 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 14/354 objects degraded (3.955%) 2024-04-16T14:40:45.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.377+0000 7f70fdcb1700 1 -- 172.21.15.5:0/3390348104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f80fcff0 msgr2=0x7f70f80fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:45.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.377+0000 7f70fdcb1700 1 --2- 172.21.15.5:0/3390348104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f80fcff0 0x7f70f80fd460 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f70ec004940 tx=0x7f70ec009e30 comp rx=0 tx=0).stop 2024-04-16T14:40:45.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.378+0000 7f70fdcb1700 1 -- 172.21.15.5:0/3390348104 shutdown_connections 2024-04-16T14:40:45.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.378+0000 7f70fdcb1700 1 --2- 172.21.15.5:0/3390348104 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f80fcff0 0x7f70f80fd460 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:45.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.378+0000 7f70fdcb1700 1 --2- 172.21.15.5:0/3390348104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70f80fbd40 0x7f70f80fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:45.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.378+0000 7f70fdcb1700 1 -- 172.21.15.5:0/3390348104 >> 172.21.15.5:0/3390348104 conn(0x7f70f80f74c0 msgr2=0x7f70f80f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:45.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.378+0000 7f70fdcb1700 1 -- 172.21.15.5:0/3390348104 shutdown_connections 2024-04-16T14:40:45.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.378+0000 7f70fdcb1700 1 -- 172.21.15.5:0/3390348104 wait complete. 2024-04-16T14:40:45.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.378+0000 7f70fdcb1700 1 Processor -- start 2024-04-16T14:40:45.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.378+0000 7f70fdcb1700 1 -- start start 2024-04-16T14:40:45.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.378+0000 7f70fdcb1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f80fbd40 0x7f70f8110710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:45.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.378+0000 7f70fdcb1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70f80fcff0 0x7f70f8112c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:45.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.378+0000 7f70fdcb1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f80663c0 con 0x7f70f80fbd40 2024-04-16T14:40:45.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.379+0000 7f70fdcb1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f8066500 con 0x7f70f80fcff0 2024-04-16T14:40:45.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.379+0000 7f70f77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f80fbd40 0x7f70f8110710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:45.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.379+0000 7f70f77fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f80fbd40 0x7f70f8110710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48622/0 (socket says 172.21.15.5:48622) 2024-04-16T14:40:45.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.379+0000 7f70f77fe700 1 -- 172.21.15.5:0/305286690 learned_addr learned my addr 172.21.15.5:0/305286690 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:40:45.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.379+0000 7f70f6ffd700 1 --2- 172.21.15.5:0/305286690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70f80fcff0 0x7f70f8112c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:45.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.379+0000 7f70f77fe700 1 -- 172.21.15.5:0/305286690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70f80fcff0 msgr2=0x7f70f8112c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:45.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.379+0000 7f70f77fe700 1 --2- 172.21.15.5:0/305286690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70f80fcff0 0x7f70f8112c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:45.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.379+0000 7f70f77fe700 1 -- 172.21.15.5:0/305286690 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec005040 con 0x7f70f80fbd40 2024-04-16T14:40:45.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.379+0000 7f70f77fe700 1 --2- 172.21.15.5:0/305286690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f80fbd40 0x7f70f8110710 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f70e8002a50 tx=0x7f70e80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:45.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.379+0000 7f70dffff700 1 -- 172.21.15.5:0/305286690 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70e8007cc0 con 0x7f70f80fbd40 2024-04-16T14:40:45.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.379+0000 7f70dffff700 1 -- 172.21.15.5:0/305286690 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f70e800f040 con 0x7f70f80fbd40 2024-04-16T14:40:45.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.379+0000 7f70fdcb1700 1 -- 172.21.15.5:0/305286690 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f8113260 con 0x7f70f80fbd40 2024-04-16T14:40:45.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.379+0000 7f70dffff700 1 -- 172.21.15.5:0/305286690 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70e800db70 con 0x7f70f80fbd40 2024-04-16T14:40:45.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.380+0000 7f70fdcb1700 1 -- 172.21.15.5:0/305286690 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f8113820 con 0x7f70f80fbd40 2024-04-16T14:40:45.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.381+0000 7f70fdcb1700 1 -- 172.21.15.5:0/305286690 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f805f5f0 con 0x7f70f80fbd40 2024-04-16T14:40:45.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.381+0000 7f70dffff700 1 -- 172.21.15.5:0/305286690 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f70e800dd10 con 0x7f70f80fbd40 2024-04-16T14:40:45.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.382+0000 7f70dffff700 1 --2- 172.21.15.5:0/305286690 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f70e006e140 0x7f70e00705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:45.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.382+0000 7f70dffff700 1 -- 172.21.15.5:0/305286690 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f70e808d240 con 0x7f70f80fbd40 2024-04-16T14:40:45.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.382+0000 7f70f6ffd700 1 --2- 172.21.15.5:0/305286690 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f70e006e140 0x7f70e00705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:45.382 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.382+0000 7f70f6ffd700 1 --2- 172.21.15.5:0/305286690 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f70e006e140 0x7f70e00705f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00b3b0 tx=0x7f70ec009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:45.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.387+0000 7f70dffff700 1 -- 172.21.15.5:0/305286690 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f70e80565c0 con 0x7f70f80fbd40 2024-04-16T14:40:45.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.615+0000 7f70fdcb1700 1 -- 172.21.15.5:0/305286690 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f70f8101360 con 0x7f70e006e140 2024-04-16T14:40:45.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.616+0000 7f70dffff700 1 -- 172.21.15.5:0/305286690 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f70f8101360 con 0x7f70e006e140 2024-04-16T14:40:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.618+0000 7f70fdcb1700 1 -- 172.21.15.5:0/305286690 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f70e006e140 msgr2=0x7f70e00705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:45.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.618+0000 7f70fdcb1700 1 --2- 172.21.15.5:0/305286690 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f70e006e140 0x7f70e00705f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00b3b0 tx=0x7f70ec009e30 comp rx=0 tx=0).stop 2024-04-16T14:40:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.618+0000 7f70fdcb1700 1 -- 172.21.15.5:0/305286690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f80fbd40 msgr2=0x7f70f8110710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.618+0000 7f70fdcb1700 1 --2- 172.21.15.5:0/305286690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f80fbd40 0x7f70f8110710 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f70e8002a50 tx=0x7f70e80046b0 comp rx=0 tx=0).stop 2024-04-16T14:40:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.618+0000 7f70fdcb1700 1 -- 172.21.15.5:0/305286690 shutdown_connections 2024-04-16T14:40:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.618+0000 7f70fdcb1700 1 --2- 172.21.15.5:0/305286690 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f70e006e140 0x7f70e00705f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.618+0000 7f70fdcb1700 1 --2- 172.21.15.5:0/305286690 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70f80fbd40 0x7f70f8110710 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.618+0000 7f70fdcb1700 1 --2- 172.21.15.5:0/305286690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70f80fcff0 0x7f70f8112c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.618+0000 7f70fdcb1700 1 -- 172.21.15.5:0/305286690 >> 172.21.15.5:0/305286690 conn(0x7f70f80f74c0 msgr2=0x7f70f80f8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.618+0000 7f70fdcb1700 1 -- 172.21.15.5:0/305286690 shutdown_connections 2024-04-16T14:40:45.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.618+0000 7f70fdcb1700 1 -- 172.21.15.5:0/305286690 wait complete. 2024-04-16T14:40:45.627 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-04-16T14:40:45.627 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:45 smithi005 ceph-mon[93420]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/354 objects degraded (3.955%), 4 pgs degraded) 2024-04-16T14:40:45.627 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:45 smithi005 ceph-mon[93420]: Cluster is now healthy 2024-04-16T14:40:45.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.722+0000 7f85b5820700 1 -- 172.21.15.5:0/59717979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85b00fce80 msgr2=0x7f85b00fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:45.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.722+0000 7f85b5820700 1 --2- 172.21.15.5:0/59717979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85b00fce80 0x7f85b00fd290 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f85a0004940 tx=0x7f85a0009e30 comp rx=0 tx=0).stop 2024-04-16T14:40:45.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.723+0000 7f85b5820700 1 -- 172.21.15.5:0/59717979 shutdown_connections 2024-04-16T14:40:45.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.723+0000 7f85b5820700 1 --2- 172.21.15.5:0/59717979 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85b00fdff0 0x7f85b00fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:45.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.723+0000 7f85b5820700 1 --2- 172.21.15.5:0/59717979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85b00fce80 0x7f85b00fd290 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:45.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.723+0000 7f85b5820700 1 -- 172.21.15.5:0/59717979 >> 172.21.15.5:0/59717979 conn(0x7f85b00f8580 msgr2=0x7f85b00fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:45.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.723+0000 7f85b5820700 1 -- 172.21.15.5:0/59717979 shutdown_connections 2024-04-16T14:40:45.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.723+0000 7f85b5820700 1 -- 172.21.15.5:0/59717979 wait complete. 2024-04-16T14:40:45.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.723+0000 7f85b5820700 1 Processor -- start 2024-04-16T14:40:45.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.723+0000 7f85b5820700 1 -- start start 2024-04-16T14:40:45.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.724+0000 7f85b5820700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85b00fce80 0x7f85b010d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:45.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.724+0000 7f85b5820700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85b00fdff0 0x7f85b010dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:45.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.724+0000 7f85b5820700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b010e4a0 con 0x7f85b00fce80 2024-04-16T14:40:45.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.724+0000 7f85b5820700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b010e610 con 0x7f85b00fdff0 2024-04-16T14:40:45.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.724+0000 7f85aeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85b00fce80 0x7f85b010d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:45.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.724+0000 7f85aeffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85b00fce80 0x7f85b010d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48642/0 (socket says 172.21.15.5:48642) 2024-04-16T14:40:45.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.724+0000 7f85aeffd700 1 -- 172.21.15.5:0/2019197364 learned_addr learned my addr 172.21.15.5:0/2019197364 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:40:45.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.724+0000 7f85aeffd700 1 -- 172.21.15.5:0/2019197364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85b00fdff0 msgr2=0x7f85b010dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:45.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.724+0000 7f85ae7fc700 1 --2- 172.21.15.5:0/2019197364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85b00fdff0 0x7f85b010dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:45.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.724+0000 7f85aeffd700 1 --2- 172.21.15.5:0/2019197364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85b00fdff0 0x7f85b010dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:45.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.724+0000 7f85aeffd700 1 -- 172.21.15.5:0/2019197364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a0005040 con 0x7f85b00fce80 2024-04-16T14:40:45.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.724+0000 7f85ae7fc700 1 --2- 172.21.15.5:0/2019197364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85b00fdff0 0x7f85b010dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:40:45.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.724+0000 7f85aeffd700 1 --2- 172.21.15.5:0/2019197364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85b00fce80 0x7f85b010d960 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f85a000b3b0 tx=0x7f85a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:45.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.724+0000 7f85977fe700 1 -- 172.21.15.5:0/2019197364 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85a000e040 con 0x7f85b00fce80 2024-04-16T14:40:45.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.724+0000 7f85977fe700 1 -- 172.21.15.5:0/2019197364 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f85a000bcc0 con 0x7f85b00fce80 2024-04-16T14:40:45.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.724+0000 7f85b5820700 1 -- 172.21.15.5:0/2019197364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b0113010 con 0x7f85b00fce80 2024-04-16T14:40:45.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.725+0000 7f85977fe700 1 -- 172.21.15.5:0/2019197364 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85a001c630 con 0x7f85b00fce80 2024-04-16T14:40:45.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.725+0000 7f85b5820700 1 -- 172.21.15.5:0/2019197364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b01135d0 con 0x7f85b00fce80 2024-04-16T14:40:45.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.726+0000 7f85b5820700 1 -- 172.21.15.5:0/2019197364 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85b004c710 con 0x7f85b00fce80 2024-04-16T14:40:45.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.726+0000 7f85977fe700 1 -- 172.21.15.5:0/2019197364 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f85a0013980 con 0x7f85b00fce80 2024-04-16T14:40:45.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.727+0000 7f85977fe700 1 --2- 172.21.15.5:0/2019197364 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f859806e140 0x7f85980705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:45.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.727+0000 7f85977fe700 1 -- 172.21.15.5:0/2019197364 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f85a008e850 con 0x7f85b00fce80 2024-04-16T14:40:45.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.727+0000 7f85ae7fc700 1 --2- 172.21.15.5:0/2019197364 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f859806e140 0x7f85980705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:45.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.727+0000 7f85ae7fc700 1 --2- 172.21.15.5:0/2019197364 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f859806e140 0x7f85980705f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f85a4007fd0 tx=0x7f85a4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:45.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.731+0000 7f85977fe700 1 -- 172.21.15.5:0/2019197364 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f85a005b700 con 0x7f85b00fce80 2024-04-16T14:40:45.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:45 smithi115 ceph-mon[83414]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/354 objects degraded (3.955%), 4 pgs degraded) 2024-04-16T14:40:45.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:45 smithi115 ceph-mon[83414]: Cluster is now healthy 2024-04-16T14:40:45.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.958+0000 7f85b5820700 1 -- 172.21.15.5:0/2019197364 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f85b0102350 con 0x7f859806e140 2024-04-16T14:40:45.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.959+0000 7f85977fe700 1 -- 172.21.15.5:0/2019197364 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f85b0102350 con 0x7f859806e140 2024-04-16T14:40:45.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.961+0000 7f85b5820700 1 -- 172.21.15.5:0/2019197364 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f859806e140 msgr2=0x7f85980705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:45.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.962+0000 7f85b5820700 1 --2- 172.21.15.5:0/2019197364 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f859806e140 0x7f85980705f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f85a4007fd0 tx=0x7f85a4009040 comp rx=0 tx=0).stop 2024-04-16T14:40:45.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.962+0000 7f85b5820700 1 -- 172.21.15.5:0/2019197364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85b00fce80 msgr2=0x7f85b010d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:45.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.962+0000 7f85b5820700 1 --2- 172.21.15.5:0/2019197364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85b00fce80 0x7f85b010d960 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f85a000b3b0 tx=0x7f85a0009e30 comp rx=0 tx=0).stop 2024-04-16T14:40:45.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.962+0000 7f85b5820700 1 -- 172.21.15.5:0/2019197364 shutdown_connections 2024-04-16T14:40:45.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.962+0000 7f85b5820700 1 --2- 172.21.15.5:0/2019197364 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f859806e140 0x7f85980705f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:45.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.962+0000 7f85b5820700 1 --2- 172.21.15.5:0/2019197364 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f85b00fce80 0x7f85b010d960 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:45.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.962+0000 7f85b5820700 1 --2- 172.21.15.5:0/2019197364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85b00fdff0 0x7f85b010dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:45.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.962+0000 7f85b5820700 1 -- 172.21.15.5:0/2019197364 >> 172.21.15.5:0/2019197364 conn(0x7f85b00f8580 msgr2=0x7f85b00f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:45.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.962+0000 7f85b5820700 1 -- 172.21.15.5:0/2019197364 shutdown_connections 2024-04-16T14:40:45.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:45.962+0000 7f85b5820700 1 -- 172.21.15.5:0/2019197364 wait complete. 2024-04-16T14:40:46.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.066+0000 7f7c7253f700 1 -- 172.21.15.5:0/3662864130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c6c0fe090 msgr2=0x7f7c6c0fe500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:46.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.066+0000 7f7c7253f700 1 --2- 172.21.15.5:0/3662864130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c6c0fe090 0x7f7c6c0fe500 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7c60004940 tx=0x7f7c60009e30 comp rx=0 tx=0).stop 2024-04-16T14:40:46.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.066+0000 7f7c7253f700 1 -- 172.21.15.5:0/3662864130 shutdown_connections 2024-04-16T14:40:46.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.066+0000 7f7c7253f700 1 --2- 172.21.15.5:0/3662864130 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c6c0fe090 0x7f7c6c0fe500 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:46.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.066+0000 7f7c7253f700 1 --2- 172.21.15.5:0/3662864130 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c6c0fcf20 0x7f7c6c0fd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:46.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.066+0000 7f7c7253f700 1 -- 172.21.15.5:0/3662864130 >> 172.21.15.5:0/3662864130 conn(0x7f7c6c0f85c0 msgr2=0x7f7c6c0faa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:46.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.066+0000 7f7c7253f700 1 -- 172.21.15.5:0/3662864130 shutdown_connections 2024-04-16T14:40:46.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.066+0000 7f7c7253f700 1 -- 172.21.15.5:0/3662864130 wait complete. 2024-04-16T14:40:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.067+0000 7f7c7253f700 1 Processor -- start 2024-04-16T14:40:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.067+0000 7f7c7253f700 1 -- start start 2024-04-16T14:40:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.067+0000 7f7c7253f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c6c0fcf20 0x7f7c6c10da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.067+0000 7f7c7253f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c6c0fe090 0x7f7c6c10dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.067+0000 7f7c7253f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c10e5b0 con 0x7f7c6c0fe090 2024-04-16T14:40:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.067+0000 7f7c7253f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c10ee00 con 0x7f7c6c0fcf20 2024-04-16T14:40:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.067+0000 7f7c6b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c6c0fe090 0x7f7c6c10dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.067+0000 7f7c6b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c6c0fe090 0x7f7c6c10dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48660/0 (socket says 172.21.15.5:48660) 2024-04-16T14:40:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.067+0000 7f7c6b7fe700 1 -- 172.21.15.5:0/81639186 learned_addr learned my addr 172.21.15.5:0/81639186 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:40:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.067+0000 7f7c6bfff700 1 --2- 172.21.15.5:0/81639186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c6c0fcf20 0x7f7c6c10da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.068+0000 7f7c6b7fe700 1 -- 172.21.15.5:0/81639186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c6c0fcf20 msgr2=0x7f7c6c10da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:46.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.068+0000 7f7c6b7fe700 1 --2- 172.21.15.5:0/81639186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c6c0fcf20 0x7f7c6c10da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.068+0000 7f7c6b7fe700 1 -- 172.21.15.5:0/81639186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c60005040 con 0x7f7c6c0fe090 2024-04-16T14:40:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.068+0000 7f7c6b7fe700 1 --2- 172.21.15.5:0/81639186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c6c0fe090 0x7f7c6c10dfb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7c6000b3b0 tx=0x7f7c60009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.068+0000 7f7c68ff9700 1 -- 172.21.15.5:0/81639186 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c6000e040 con 0x7f7c6c0fe090 2024-04-16T14:40:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.068+0000 7f7c68ff9700 1 -- 172.21.15.5:0/81639186 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7c6000bbf0 con 0x7f7c6c0fe090 2024-04-16T14:40:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.068+0000 7f7c7253f700 1 -- 172.21.15.5:0/81639186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6c10f080 con 0x7f7c6c0fe090 2024-04-16T14:40:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.068+0000 7f7c68ff9700 1 -- 172.21.15.5:0/81639186 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c6001c630 con 0x7f7c6c0fe090 2024-04-16T14:40:46.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.068+0000 7f7c7253f700 1 -- 172.21.15.5:0/81639186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6c10f5c0 con 0x7f7c6c0fe090 2024-04-16T14:40:46.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.069+0000 7f7c7253f700 1 -- 172.21.15.5:0/81639186 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6c05f5f0 con 0x7f7c6c0fe090 2024-04-16T14:40:46.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.070+0000 7f7c68ff9700 1 -- 172.21.15.5:0/81639186 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f7c60013420 con 0x7f7c6c0fe090 2024-04-16T14:40:46.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.070+0000 7f7c68ff9700 1 --2- 172.21.15.5:0/81639186 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f7c5406e140 0x7f7c540705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:46.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.070+0000 7f7c68ff9700 1 -- 172.21.15.5:0/81639186 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f7c6008e6f0 con 0x7f7c6c0fe090 2024-04-16T14:40:46.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.070+0000 7f7c6bfff700 1 --2- 172.21.15.5:0/81639186 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f7c5406e140 0x7f7c540705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:46.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.071+0000 7f7c6bfff700 1 --2- 172.21.15.5:0/81639186 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f7c5406e140 0x7f7c540705f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c004f40 tx=0x7f7c5c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:46.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.075+0000 7f7c68ff9700 1 -- 172.21.15.5:0/81639186 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f7c6005b620 con 0x7f7c6c0fe090 2024-04-16T14:40:46.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.292+0000 7f7c7253f700 1 -- 172.21.15.5:0/81639186 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c6c10f8a0 con 0x7f7c5406e140 2024-04-16T14:40:46.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.302+0000 7f7c68ff9700 1 -- 172.21.15.5:0/81639186 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f7c6c10f8a0 con 0x7f7c5406e140 2024-04-16T14:40:46.300 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-16T14:40:46.300 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.smithi005 smithi005 *:9093,9094 running (5m) 45s ago 13m 24.6M - 0.25.0 c8568f914cd2 f8aaa22ee70c 2024-04-16T14:40:46.300 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi005 smithi005 running (2m) 45s ago 13m 6656k - 19.0.0-2204-g36befe5d b1a78730e0db d6efa08e65e3 2024-04-16T14:40:46.300 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi115 smithi115 running (2m) 11s ago 12m 6660k - 19.0.0-2204-g36befe5d b1a78730e0db b2a2f2965e2a 2024-04-16T14:40:46.301 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.smithi005 smithi005 *:3000 running (4m) 45s ago 13m 85.9M - 9.4.7 954c08fa6188 9834229a010c 2024-04-16T14:40:46.301 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.vzoqdl smithi005 running (7m) 45s ago 7m 13.5M - 17.2.7-868-g412a5526 b04d96489b7c 84a74a406a1d 2024-04-16T14:40:46.301 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.wofqlz smithi005 running (7m) 45s ago 7m 133M - 17.2.7-868-g412a5526 b04d96489b7c d0e053ab2f72 2024-04-16T14:40:46.301 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.byfytg smithi115 running (7m) 11s ago 7m 118M - 17.2.7-868-g412a5526 b04d96489b7c 595cd0892f66 2024-04-16T14:40:46.301 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.trkaqh smithi115 running (7m) 11s ago 7m 14.2M - 17.2.7-868-g412a5526 b04d96489b7c 5b60cd2ad79b 2024-04-16T14:40:46.301 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi005.ipwdkc smithi005 *:8443,9283,8765 running (4m) 45s ago 14m 501M - 19.0.0-2204-g36befe5d b1a78730e0db 451192b4fc44 2024-04-16T14:40:46.301 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi115.brjkpo smithi115 *:8443,9283,8765 running (3m) 11s ago 12m 450M - 19.0.0-2204-g36befe5d b1a78730e0db 0d75f8211942 2024-04-16T14:40:46.301 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi005 smithi005 running (3m) 45s ago 15m 45.8M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3d0c00924867 2024-04-16T14:40:46.301 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi115 smithi115 running (3m) 11s ago 12m 42.1M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3b916a4928b2 2024-04-16T14:40:46.301 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi005 smithi005 *:9100 running (5m) 45s ago 13m 16.7M - 1.5.0 0da6a335fe13 c09bba584a42 2024-04-16T14:40:46.301 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi115 smithi115 *:9100 running (4m) 11s ago 12m 17.0M - 1.5.0 0da6a335fe13 78cc9cc150c0 2024-04-16T14:40:46.301 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (2m) 45s ago 11m 100M 1559M 19.0.0-2204-g36befe5d b1a78730e0db 91d9246d45e0 2024-04-16T14:40:46.301 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (86s) 45s ago 11m 100M 1559M 19.0.0-2204-g36befe5d b1a78730e0db d930ce515e3e 2024-04-16T14:40:46.301 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (51s) 45s ago 10m 12.7M 1559M 19.0.0-2204-g36befe5d b1a78730e0db fdc5fe68ac57 2024-04-16T14:40:46.302 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi115 running (15s) 11s ago 10m 11.9M 2581M 19.0.0-2204-g36befe5d b1a78730e0db 808ebb96c862 2024-04-16T14:40:46.302 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi115 running (9m) 11s ago 9m 242M 2581M 17.2.7-868-g412a5526 b04d96489b7c e3ea96b7edd9 2024-04-16T14:40:46.302 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi115 running (9m) 11s ago 9m 223M 2581M 17.2.7-868-g412a5526 b04d96489b7c 456fa074e453 2024-04-16T14:40:46.302 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.smithi005 smithi005 *:9095 running (3m) 45s ago 12m 58.9M - 2.43.0 a07b618ecd1d dc784e58817c 2024-04-16T14:40:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.304+0000 7f7c7253f700 1 -- 172.21.15.5:0/81639186 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f7c5406e140 msgr2=0x7f7c540705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.304+0000 7f7c7253f700 1 --2- 172.21.15.5:0/81639186 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f7c5406e140 0x7f7c540705f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c004f40 tx=0x7f7c5c00b040 comp rx=0 tx=0).stop 2024-04-16T14:40:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.304+0000 7f7c7253f700 1 -- 172.21.15.5:0/81639186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c6c0fe090 msgr2=0x7f7c6c10dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.304+0000 7f7c7253f700 1 --2- 172.21.15.5:0/81639186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c6c0fe090 0x7f7c6c10dfb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7c6000b3b0 tx=0x7f7c60009e30 comp rx=0 tx=0).stop 2024-04-16T14:40:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.304+0000 7f7c7253f700 1 -- 172.21.15.5:0/81639186 shutdown_connections 2024-04-16T14:40:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.304+0000 7f7c7253f700 1 --2- 172.21.15.5:0/81639186 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f7c5406e140 0x7f7c540705f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.304+0000 7f7c7253f700 1 --2- 172.21.15.5:0/81639186 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c6c0fcf20 0x7f7c6c10da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.304+0000 7f7c7253f700 1 --2- 172.21.15.5:0/81639186 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7c6c0fe090 0x7f7c6c10dfb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.304+0000 7f7c7253f700 1 -- 172.21.15.5:0/81639186 >> 172.21.15.5:0/81639186 conn(0x7f7c6c0f85c0 msgr2=0x7f7c6c0f9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.304+0000 7f7c7253f700 1 -- 172.21.15.5:0/81639186 shutdown_connections 2024-04-16T14:40:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.304+0000 7f7c7253f700 1 -- 172.21.15.5:0/81639186 wait complete. 2024-04-16T14:40:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.407+0000 7ff4568fd700 1 -- 172.21.15.5:0/2601799428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4500fbd40 msgr2=0x7ff4500fc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.407+0000 7ff4568fd700 1 --2- 172.21.15.5:0/2601799428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4500fbd40 0x7ff4500fc150 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff440004940 tx=0x7ff440009e30 comp rx=0 tx=0).stop 2024-04-16T14:40:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.407+0000 7ff4568fd700 1 -- 172.21.15.5:0/2601799428 shutdown_connections 2024-04-16T14:40:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.407+0000 7ff4568fd700 1 --2- 172.21.15.5:0/2601799428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4500fcff0 0x7ff4500fd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.407+0000 7ff4568fd700 1 --2- 172.21.15.5:0/2601799428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4500fbd40 0x7ff4500fc150 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.407+0000 7ff4568fd700 1 -- 172.21.15.5:0/2601799428 >> 172.21.15.5:0/2601799428 conn(0x7ff4500f74c0 msgr2=0x7ff4500f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.407+0000 7ff4568fd700 1 -- 172.21.15.5:0/2601799428 shutdown_connections 2024-04-16T14:40:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.407+0000 7ff4568fd700 1 -- 172.21.15.5:0/2601799428 wait complete. 2024-04-16T14:40:46.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.407+0000 7ff4568fd700 1 Processor -- start 2024-04-16T14:40:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.408+0000 7ff4568fd700 1 -- start start 2024-04-16T14:40:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.408+0000 7ff4568fd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4500fbd40 0x7ff450110740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.408+0000 7ff4568fd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4500fcff0 0x7ff450112c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.408+0000 7ff4568fd700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff450066360 con 0x7ff4500fcff0 2024-04-16T14:40:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.408+0000 7ff4568fd700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4500664a0 con 0x7ff4500fbd40 2024-04-16T14:40:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.408+0000 7ff44f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4500fcff0 0x7ff450112c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.408+0000 7ff44f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4500fcff0 0x7ff450112c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48690/0 (socket says 172.21.15.5:48690) 2024-04-16T14:40:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.408+0000 7ff44f7fe700 1 -- 172.21.15.5:0/1748002706 learned_addr learned my addr 172.21.15.5:0/1748002706 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:40:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.408+0000 7ff44ffff700 1 --2- 172.21.15.5:0/1748002706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4500fbd40 0x7ff450110740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.408+0000 7ff44f7fe700 1 -- 172.21.15.5:0/1748002706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4500fbd40 msgr2=0x7ff450110740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:46.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.408+0000 7ff44f7fe700 1 --2- 172.21.15.5:0/1748002706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4500fbd40 0x7ff450110740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:46.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.408+0000 7ff44f7fe700 1 -- 172.21.15.5:0/1748002706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff440005040 con 0x7ff4500fcff0 2024-04-16T14:40:46.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.409+0000 7ff44f7fe700 1 --2- 172.21.15.5:0/1748002706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4500fcff0 0x7ff450112c90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff444002a50 tx=0x7ff4440046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:46.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.409+0000 7ff44cff9700 1 -- 172.21.15.5:0/1748002706 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff444007cc0 con 0x7ff4500fcff0 2024-04-16T14:40:46.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.409+0000 7ff44cff9700 1 -- 172.21.15.5:0/1748002706 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff44400f040 con 0x7ff4500fcff0 2024-04-16T14:40:46.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.409+0000 7ff4568fd700 1 -- 172.21.15.5:0/1748002706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff450113230 con 0x7ff4500fcff0 2024-04-16T14:40:46.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.409+0000 7ff44cff9700 1 -- 172.21.15.5:0/1748002706 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff444009640 con 0x7ff4500fcff0 2024-04-16T14:40:46.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.409+0000 7ff4568fd700 1 -- 172.21.15.5:0/1748002706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4501137f0 con 0x7ff4500fcff0 2024-04-16T14:40:46.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.410+0000 7ff4568fd700 1 -- 172.21.15.5:0/1748002706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff45005f5f0 con 0x7ff4500fcff0 2024-04-16T14:40:46.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.410+0000 7ff44cff9700 1 -- 172.21.15.5:0/1748002706 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7ff4440097a0 con 0x7ff4500fcff0 2024-04-16T14:40:46.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.411+0000 7ff44cff9700 1 --2- 172.21.15.5:0/1748002706 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff43806e140 0x7ff4380705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:46.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.411+0000 7ff44cff9700 1 -- 172.21.15.5:0/1748002706 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6410+0+0 (secure 0 0 0) 0x7ff44408d940 con 0x7ff4500fcff0 2024-04-16T14:40:46.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.411+0000 7ff44ffff700 1 --2- 172.21.15.5:0/1748002706 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff43806e140 0x7ff4380705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:46.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.411+0000 7ff44ffff700 1 --2- 172.21.15.5:0/1748002706 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff43806e140 0x7ff4380705f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff44000b970 tx=0x7ff440009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:46.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.416+0000 7ff44cff9700 1 -- 172.21.15.5:0/1748002706 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7ff444056cc0 con 0x7ff4500fcff0 2024-04-16T14:40:46.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.717+0000 7ff4568fd700 1 -- 172.21.15.5:0/1748002706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff450113ab0 con 0x7ff4500fcff0 2024-04-16T14:40:46.716 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:46 smithi005 ceph-mon[93420]: pgmap v124: 65 pgs: 3 peering, 62 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:46.716 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:46 smithi005 ceph-mon[93420]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:40:46.716 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:46 smithi005 ceph-mon[93420]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:40:46.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.717+0000 7ff44cff9700 1 -- 172.21.15.5:0/1748002706 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7ff44405a380 con 0x7ff4500fcff0 2024-04-16T14:40:46.717 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:40:46.717 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-04-16T14:40:46.717 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:40:46.717 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:40:46.717 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-04-16T14:40:46.717 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:40:46.717 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:40:46.717 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-04-16T14:40:46.717 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 2, 2024-04-16T14:40:46.717 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 4 2024-04-16T14:40:46.717 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:40:46.718 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-04-16T14:40:46.718 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 4 2024-04-16T14:40:46.718 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:40:46.718 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-04-16T14:40:46.718 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 6, 2024-04-16T14:40:46.718 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 8 2024-04-16T14:40:46.718 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-16T14:40:46.718 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:40:46.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.719+0000 7ff4568fd700 1 -- 172.21.15.5:0/1748002706 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff43806e140 msgr2=0x7ff4380705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:46.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.719+0000 7ff4568fd700 1 --2- 172.21.15.5:0/1748002706 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff43806e140 0x7ff4380705f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff44000b970 tx=0x7ff440009e30 comp rx=0 tx=0).stop 2024-04-16T14:40:46.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.719+0000 7ff4568fd700 1 -- 172.21.15.5:0/1748002706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4500fcff0 msgr2=0x7ff450112c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:46.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.719+0000 7ff4568fd700 1 --2- 172.21.15.5:0/1748002706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4500fcff0 0x7ff450112c90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff444002a50 tx=0x7ff4440046b0 comp rx=0 tx=0).stop 2024-04-16T14:40:46.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.719+0000 7ff4568fd700 1 -- 172.21.15.5:0/1748002706 shutdown_connections 2024-04-16T14:40:46.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.719+0000 7ff4568fd700 1 --2- 172.21.15.5:0/1748002706 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff43806e140 0x7ff4380705f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:46.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.719+0000 7ff4568fd700 1 --2- 172.21.15.5:0/1748002706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4500fbd40 0x7ff450110740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:46.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.719+0000 7ff4568fd700 1 --2- 172.21.15.5:0/1748002706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff4500fcff0 0x7ff450112c90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:46.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.719+0000 7ff4568fd700 1 -- 172.21.15.5:0/1748002706 >> 172.21.15.5:0/1748002706 conn(0x7ff4500f74c0 msgr2=0x7ff4500f8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:46.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.719+0000 7ff4568fd700 1 -- 172.21.15.5:0/1748002706 shutdown_connections 2024-04-16T14:40:46.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.719+0000 7ff4568fd700 1 -- 172.21.15.5:0/1748002706 wait complete. 2024-04-16T14:40:46.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.823+0000 7f7562e97700 1 -- 172.21.15.5:0/2534004329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f755c0fffd0 msgr2=0x7f755c1023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:46.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.823+0000 7f7562e97700 1 --2- 172.21.15.5:0/2534004329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f755c0fffd0 0x7f755c1023b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7548004940 tx=0x7f7548009e30 comp rx=0 tx=0).stop 2024-04-16T14:40:46.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.823+0000 7f7562e97700 1 -- 172.21.15.5:0/2534004329 shutdown_connections 2024-04-16T14:40:46.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.823+0000 7f7562e97700 1 --2- 172.21.15.5:0/2534004329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f755c0fffd0 0x7f755c1023b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:46.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.823+0000 7f7562e97700 1 --2- 172.21.15.5:0/2534004329 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f755c066290 0x7f755c0ffa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:46.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.823+0000 7f7562e97700 1 -- 172.21.15.5:0/2534004329 >> 172.21.15.5:0/2534004329 conn(0x7f755c0f74c0 msgr2=0x7f755c0f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:46.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.823+0000 7f7562e97700 1 -- 172.21.15.5:0/2534004329 shutdown_connections 2024-04-16T14:40:46.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.823+0000 7f7562e97700 1 -- 172.21.15.5:0/2534004329 wait complete. 2024-04-16T14:40:46.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.823+0000 7f7562e97700 1 Processor -- start 2024-04-16T14:40:46.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.824+0000 7f7562e97700 1 -- start start 2024-04-16T14:40:46.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.824+0000 7f7562e97700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f755c066290 0x7f755c10fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:46.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.824+0000 7f7562e97700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f755c0fffd0 0x7f755c1102a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:46.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.824+0000 7f7562e97700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c110f60 con 0x7f755c066290 2024-04-16T14:40:46.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.824+0000 7f7562e97700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c1110d0 con 0x7f755c0fffd0 2024-04-16T14:40:46.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.824+0000 7f7560c33700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f755c066290 0x7f755c10fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:46.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.824+0000 7f7560c33700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f755c066290 0x7f755c10fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48720/0 (socket says 172.21.15.5:48720) 2024-04-16T14:40:46.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.824+0000 7f7560c33700 1 -- 172.21.15.5:0/409821519 learned_addr learned my addr 172.21.15.5:0/409821519 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:40:46.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.824+0000 7f755bfff700 1 --2- 172.21.15.5:0/409821519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f755c0fffd0 0x7f755c1102a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:46.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.824+0000 7f7560c33700 1 -- 172.21.15.5:0/409821519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f755c0fffd0 msgr2=0x7f755c1102a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:46.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.824+0000 7f7560c33700 1 --2- 172.21.15.5:0/409821519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f755c0fffd0 0x7f755c1102a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:46.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.824+0000 7f7560c33700 1 -- 172.21.15.5:0/409821519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7548005040 con 0x7f755c066290 2024-04-16T14:40:46.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.825+0000 7f7560c33700 1 --2- 172.21.15.5:0/409821519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f755c066290 0x7f755c10fd60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f755000b790 tx=0x7f7550009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:46.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.825+0000 7f75597fa700 1 -- 172.21.15.5:0/409821519 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f755000f6f0 con 0x7f755c066290 2024-04-16T14:40:46.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.825+0000 7f75597fa700 1 -- 172.21.15.5:0/409821519 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f755000fd20 con 0x7f755c066290 2024-04-16T14:40:46.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.825+0000 7f7562e97700 1 -- 172.21.15.5:0/409821519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755c1113b0 con 0x7f755c066290 2024-04-16T14:40:46.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.825+0000 7f75597fa700 1 -- 172.21.15.5:0/409821519 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75500103a0 con 0x7f755c066290 2024-04-16T14:40:46.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.825+0000 7f7562e97700 1 -- 172.21.15.5:0/409821519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755c111970 con 0x7f755c066290 2024-04-16T14:40:46.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.826+0000 7f7562e97700 1 -- 172.21.15.5:0/409821519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f755c05f5f0 con 0x7f755c066290 2024-04-16T14:40:46.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.826+0000 7f75597fa700 1 -- 172.21.15.5:0/409821519 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f7550010500 con 0x7f755c066290 2024-04-16T14:40:46.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.827+0000 7f75597fa700 1 --2- 172.21.15.5:0/409821519 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f754c06e150 0x7f754c070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:46.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.827+0000 7f75597fa700 1 -- 172.21.15.5:0/409821519 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f755008d9a0 con 0x7f755c066290 2024-04-16T14:40:46.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.827+0000 7f755bfff700 1 --2- 172.21.15.5:0/409821519 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f754c06e150 0x7f754c070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:46.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.827+0000 7f755bfff700 1 --2- 172.21.15.5:0/409821519 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f754c06e150 0x7f754c070600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7548004f90 tx=0x7f7548009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:46.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:46.831+0000 7f75597fa700 1 -- 172.21.15.5:0/409821519 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f755005a8c0 con 0x7f755c066290 2024-04-16T14:40:46.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:46 smithi115 ceph-mon[83414]: pgmap v124: 65 pgs: 3 peering, 62 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:46.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:46 smithi115 ceph-mon[83414]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:40:46.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:46 smithi115 ceph-mon[83414]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:40:47.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.086+0000 7f7562e97700 1 -- 172.21.15.5:0/409821519 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f755c105950 con 0x7f755c066290 2024-04-16T14:40:47.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.087+0000 7f75597fa700 1 -- 172.21.15.5:0/409821519 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1897 (secure 0 0 0) 0x7f755005a450 con 0x7f755c066290 2024-04-16T14:40:47.085 INFO:teuthology.orchestra.run.smithi005.stdout:e22 2024-04-16T14:40:47.085 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:40:47.086 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:40:47.086 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2024-04-16T14:40:47.086 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:40:47.086 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2024-04-16T14:40:47.086 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2024-04-16T14:40:47.086 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 22 2024-04-16T14:40:47.086 INFO:teuthology.orchestra.run.smithi005.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-16T14:40:47.086 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-16T14:32:45.270024+0000 2024-04-16T14:40:47.086 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-04-16T14:39:57.598894+0000 2024-04-16T14:40:47.086 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2024-04-16T14:40:47.086 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2024-04-16T14:40:47.086 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 60 2024-04-16T14:40:47.087 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2024-04-16T14:40:47.087 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2024-04-16T14:40:47.087 INFO:teuthology.orchestra.run.smithi005.stdout:max_xattr_size 65536 2024-04-16T14:40:47.087 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2024-04-16T14:40:47.087 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2024-04-16T14:40:47.087 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 47 2024-04-16T14:40:47.087 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:40:47.087 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 2 2024-04-16T14:40:47.087 INFO:teuthology.orchestra.run.smithi005.stdout:in 0,1 2024-04-16T14:40:47.087 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=14484,1=24269} 2024-04-16T14:40:47.087 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2024-04-16T14:40:47.087 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2024-04-16T14:40:47.087 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 2024-04-16T14:40:47.087 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3] 2024-04-16T14:40:47.088 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2024-04-16T14:40:47.088 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2024-04-16T14:40:47.088 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2024-04-16T14:40:47.088 INFO:teuthology.orchestra.run.smithi005.stdout:bal_rank_mask -1 2024-04-16T14:40:47.088 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 1 2024-04-16T14:40:47.088 INFO:teuthology.orchestra.run.smithi005.stdout:qdb_cluster leader: 14484 members: 24269,14484 2024-04-16T14:40:47.088 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.wofqlz{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:40:47.088 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.byfytg{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.115:6824/1662994117,v1:172.21.15.115:6825/1662994117] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:40:47.088 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:40:47.088 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:40:47.088 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2024-04-16T14:40:47.088 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:40:47.088 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.vzoqdl{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.5:6826/187766809,v1:172.21.15.5:6827/187766809] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:40:47.088 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.trkaqh{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:40:47.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.089+0000 7f7562e97700 1 -- 172.21.15.5:0/409821519 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f754c06e150 msgr2=0x7f754c070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:47.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.089+0000 7f7562e97700 1 --2- 172.21.15.5:0/409821519 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f754c06e150 0x7f754c070600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7548004f90 tx=0x7f7548009e30 comp rx=0 tx=0).stop 2024-04-16T14:40:47.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.089+0000 7f7562e97700 1 -- 172.21.15.5:0/409821519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f755c066290 msgr2=0x7f755c10fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:47.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.089+0000 7f7562e97700 1 --2- 172.21.15.5:0/409821519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f755c066290 0x7f755c10fd60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f755000b790 tx=0x7f7550009220 comp rx=0 tx=0).stop 2024-04-16T14:40:47.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.089+0000 7f7562e97700 1 -- 172.21.15.5:0/409821519 shutdown_connections 2024-04-16T14:40:47.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.089+0000 7f7562e97700 1 --2- 172.21.15.5:0/409821519 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f754c06e150 0x7f754c070600 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.089+0000 7f7562e97700 1 --2- 172.21.15.5:0/409821519 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f755c066290 0x7f755c10fd60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.089+0000 7f7562e97700 1 --2- 172.21.15.5:0/409821519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f755c0fffd0 0x7f755c1102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.089+0000 7f7562e97700 1 -- 172.21.15.5:0/409821519 >> 172.21.15.5:0/409821519 conn(0x7f755c0f74c0 msgr2=0x7f755c0fbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.089+0000 7f7562e97700 1 -- 172.21.15.5:0/409821519 shutdown_connections 2024-04-16T14:40:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.089+0000 7f7562e97700 1 -- 172.21.15.5:0/409821519 wait complete. 2024-04-16T14:40:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 22 2024-04-16T14:40:47.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.194+0000 7fc28d2c8700 1 -- 172.21.15.5:0/3260816653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2880fce50 msgr2=0x7fc2880fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:47.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.194+0000 7fc28d2c8700 1 --2- 172.21.15.5:0/3260816653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2880fce50 0x7fc2880fd260 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc278004940 tx=0x7fc278009e30 comp rx=0 tx=0).stop 2024-04-16T14:40:47.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.194+0000 7fc28d2c8700 1 -- 172.21.15.5:0/3260816653 shutdown_connections 2024-04-16T14:40:47.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.194+0000 7fc28d2c8700 1 --2- 172.21.15.5:0/3260816653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2880fe050 0x7fc2880fe4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:47.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.194+0000 7fc28d2c8700 1 --2- 172.21.15.5:0/3260816653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2880fce50 0x7fc2880fd260 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:47.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.194+0000 7fc28d2c8700 1 -- 172.21.15.5:0/3260816653 >> 172.21.15.5:0/3260816653 conn(0x7fc2880f8540 msgr2=0x7fc2880fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:47.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.194+0000 7fc28d2c8700 1 -- 172.21.15.5:0/3260816653 shutdown_connections 2024-04-16T14:40:47.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.194+0000 7fc28d2c8700 1 -- 172.21.15.5:0/3260816653 wait complete. 2024-04-16T14:40:47.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.195+0000 7fc28d2c8700 1 Processor -- start 2024-04-16T14:40:47.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.195+0000 7fc28d2c8700 1 -- start start 2024-04-16T14:40:47.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.195+0000 7fc28d2c8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2880fce50 0x7fc28810d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:47.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.195+0000 7fc28d2c8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2880fe050 0x7fc28810de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:47.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.195+0000 7fc28d2c8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28810e520 con 0x7fc2880fce50 2024-04-16T14:40:47.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.195+0000 7fc28d2c8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc288112ec0 con 0x7fc2880fe050 2024-04-16T14:40:47.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.195+0000 7fc286ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2880fce50 0x7fc28810d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:47.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.195+0000 7fc286ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2880fce50 0x7fc28810d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48738/0 (socket says 172.21.15.5:48738) 2024-04-16T14:40:47.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.195+0000 7fc286ffd700 1 -- 172.21.15.5:0/704598639 learned_addr learned my addr 172.21.15.5:0/704598639 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:40:47.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.195+0000 7fc2867fc700 1 --2- 172.21.15.5:0/704598639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2880fe050 0x7fc28810de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:47.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.195+0000 7fc286ffd700 1 -- 172.21.15.5:0/704598639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2880fe050 msgr2=0x7fc28810de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:47.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.195+0000 7fc286ffd700 1 --2- 172.21.15.5:0/704598639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2880fe050 0x7fc28810de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:47.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.195+0000 7fc286ffd700 1 -- 172.21.15.5:0/704598639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc278005040 con 0x7fc2880fce50 2024-04-16T14:40:47.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.195+0000 7fc286ffd700 1 --2- 172.21.15.5:0/704598639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2880fce50 0x7fc28810d950 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc278000c00 tx=0x7fc278009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:47.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.196+0000 7fc26f7fe700 1 -- 172.21.15.5:0/704598639 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc27800e040 con 0x7fc2880fce50 2024-04-16T14:40:47.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.196+0000 7fc26f7fe700 1 -- 172.21.15.5:0/704598639 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc27800bcc0 con 0x7fc2880fce50 2024-04-16T14:40:47.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.196+0000 7fc28d2c8700 1 -- 172.21.15.5:0/704598639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2881130c0 con 0x7fc2880fce50 2024-04-16T14:40:47.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.196+0000 7fc26f7fe700 1 -- 172.21.15.5:0/704598639 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc27801c630 con 0x7fc2880fce50 2024-04-16T14:40:47.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.196+0000 7fc28d2c8700 1 -- 172.21.15.5:0/704598639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc288113630 con 0x7fc2880fce50 2024-04-16T14:40:47.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.197+0000 7fc28d2c8700 1 -- 172.21.15.5:0/704598639 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc28804c710 con 0x7fc2880fce50 2024-04-16T14:40:47.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.197+0000 7fc26f7fe700 1 -- 172.21.15.5:0/704598639 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fc278013980 con 0x7fc2880fce50 2024-04-16T14:40:47.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.197+0000 7fc26f7fe700 1 --2- 172.21.15.5:0/704598639 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc27006e140 0x7fc2700705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:47.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.198+0000 7fc26f7fe700 1 -- 172.21.15.5:0/704598639 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fc27808eea0 con 0x7fc2880fce50 2024-04-16T14:40:47.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.198+0000 7fc2867fc700 1 --2- 172.21.15.5:0/704598639 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc27006e140 0x7fc2700705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:47.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.198+0000 7fc2867fc700 1 --2- 172.21.15.5:0/704598639 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc27006e140 0x7fc2700705f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc27c006fd0 tx=0x7fc27c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:47.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.202+0000 7fc26f7fe700 1 -- 172.21.15.5:0/704598639 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fc27805be80 con 0x7fc2880fce50 2024-04-16T14:40:47.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.432+0000 7fc28d2c8700 1 -- 172.21.15.5:0/704598639 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc288102330 con 0x7fc27006e140 2024-04-16T14:40:47.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.434+0000 7fc26f7fe700 1 -- 172.21.15.5:0/704598639 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fc288102330 con 0x7fc27006e140 2024-04-16T14:40:47.432 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:40:47.432 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91", 2024-04-16T14:40:47.432 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-04-16T14:40:47.433 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-16T14:40:47.433 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [ 2024-04-16T14:40:47.433 INFO:teuthology.orchestra.run.smithi005.stdout: "mon", 2024-04-16T14:40:47.433 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr", 2024-04-16T14:40:47.433 INFO:teuthology.orchestra.run.smithi005.stdout: "crash" 2024-04-16T14:40:47.433 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-04-16T14:40:47.433 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "10/21 daemons upgraded", 2024-04-16T14:40:47.433 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading osd daemons", 2024-04-16T14:40:47.433 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-04-16T14:40:47.433 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:40:47.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.436+0000 7fc28d2c8700 1 -- 172.21.15.5:0/704598639 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc27006e140 msgr2=0x7fc2700705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:47.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.436+0000 7fc28d2c8700 1 --2- 172.21.15.5:0/704598639 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc27006e140 0x7fc2700705f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc27c006fd0 tx=0x7fc27c008040 comp rx=0 tx=0).stop 2024-04-16T14:40:47.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.436+0000 7fc28d2c8700 1 -- 172.21.15.5:0/704598639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2880fce50 msgr2=0x7fc28810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:47.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.436+0000 7fc28d2c8700 1 --2- 172.21.15.5:0/704598639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2880fce50 0x7fc28810d950 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc278000c00 tx=0x7fc278009e30 comp rx=0 tx=0).stop 2024-04-16T14:40:47.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.437+0000 7fc28d2c8700 1 -- 172.21.15.5:0/704598639 shutdown_connections 2024-04-16T14:40:47.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.437+0000 7fc28d2c8700 1 --2- 172.21.15.5:0/704598639 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc27006e140 0x7fc2700705f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:47.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.437+0000 7fc28d2c8700 1 --2- 172.21.15.5:0/704598639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2880fce50 0x7fc28810d950 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:47.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.437+0000 7fc28d2c8700 1 --2- 172.21.15.5:0/704598639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2880fe050 0x7fc28810de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:47.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.437+0000 7fc28d2c8700 1 -- 172.21.15.5:0/704598639 >> 172.21.15.5:0/704598639 conn(0x7fc2880f8540 msgr2=0x7fc2880f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:47.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.437+0000 7fc28d2c8700 1 -- 172.21.15.5:0/704598639 shutdown_connections 2024-04-16T14:40:47.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.437+0000 7fc28d2c8700 1 -- 172.21.15.5:0/704598639 wait complete. 2024-04-16T14:40:47.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.542+0000 7f6af3db6700 1 -- 172.21.15.5:0/518938057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aec0fbcf0 msgr2=0x7f6aec0fc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:47.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.542+0000 7f6af3db6700 1 --2- 172.21.15.5:0/518938057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aec0fbcf0 0x7f6aec0fc100 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8004940 tx=0x7f6ae8009e30 comp rx=0 tx=0).stop 2024-04-16T14:40:47.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.542+0000 7f6af3db6700 1 -- 172.21.15.5:0/518938057 shutdown_connections 2024-04-16T14:40:47.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.542+0000 7f6af3db6700 1 --2- 172.21.15.5:0/518938057 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6aec0fcfa0 0x7f6aec0fd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:47.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.542+0000 7f6af3db6700 1 --2- 172.21.15.5:0/518938057 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aec0fbcf0 0x7f6aec0fc100 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:47.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.542+0000 7f6af3db6700 1 -- 172.21.15.5:0/518938057 >> 172.21.15.5:0/518938057 conn(0x7f6aec0f7450 msgr2=0x7f6aec0f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:47.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.542+0000 7f6af3db6700 1 -- 172.21.15.5:0/518938057 shutdown_connections 2024-04-16T14:40:47.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.542+0000 7f6af3db6700 1 -- 172.21.15.5:0/518938057 wait complete. 2024-04-16T14:40:47.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.543+0000 7f6af3db6700 1 Processor -- start 2024-04-16T14:40:47.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.543+0000 7f6af3db6700 1 -- start start 2024-04-16T14:40:47.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.543+0000 7f6af3db6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aec0fbcf0 0x7f6aec0ffdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:47.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.543+0000 7f6af3db6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6aec0fcfa0 0x7f6aec0fe2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:47.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.543+0000 7f6af3db6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec0fe870 con 0x7f6aec0fbcf0 2024-04-16T14:40:47.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.543+0000 7f6af3db6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec0fe9b0 con 0x7f6aec0fcfa0 2024-04-16T14:40:47.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.543+0000 7f6af1b52700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aec0fbcf0 0x7f6aec0ffdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:47.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.543+0000 7f6af1b52700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aec0fbcf0 0x7f6aec0ffdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48754/0 (socket says 172.21.15.5:48754) 2024-04-16T14:40:47.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.543+0000 7f6af1b52700 1 -- 172.21.15.5:0/531585697 learned_addr learned my addr 172.21.15.5:0/531585697 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:40:47.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.543+0000 7f6af1351700 1 --2- 172.21.15.5:0/531585697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6aec0fcfa0 0x7f6aec0fe2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:47.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.543+0000 7f6af1b52700 1 -- 172.21.15.5:0/531585697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6aec0fcfa0 msgr2=0x7f6aec0fe2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:47.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.543+0000 7f6af1b52700 1 --2- 172.21.15.5:0/531585697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6aec0fcfa0 0x7f6aec0fe2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:47.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.543+0000 7f6af1b52700 1 -- 172.21.15.5:0/531585697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae8005040 con 0x7f6aec0fbcf0 2024-04-16T14:40:47.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.544+0000 7f6af1b52700 1 --2- 172.21.15.5:0/531585697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aec0fbcf0 0x7f6aec0ffdc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8013870 tx=0x7f6ae8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:47.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.544+0000 7f6ae27fc700 1 -- 172.21.15.5:0/531585697 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ae800e070 con 0x7f6aec0fbcf0 2024-04-16T14:40:47.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.544+0000 7f6ae27fc700 1 -- 172.21.15.5:0/531585697 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6ae8013de0 con 0x7f6aec0fbcf0 2024-04-16T14:40:47.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.544+0000 7f6af3db6700 1 -- 172.21.15.5:0/531585697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aec0fec30 con 0x7f6aec0fbcf0 2024-04-16T14:40:47.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.544+0000 7f6ae27fc700 1 -- 172.21.15.5:0/531585697 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ae801cea0 con 0x7f6aec0fbcf0 2024-04-16T14:40:47.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.544+0000 7f6af3db6700 1 -- 172.21.15.5:0/531585697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aec0ff110 con 0x7f6aec0fbcf0 2024-04-16T14:40:47.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.545+0000 7f6af3db6700 1 -- 172.21.15.5:0/531585697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aec101b30 con 0x7f6aec0fbcf0 2024-04-16T14:40:47.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.545+0000 7f6ae27fc700 1 -- 172.21.15.5:0/531585697 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f6ae801c690 con 0x7f6aec0fbcf0 2024-04-16T14:40:47.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.546+0000 7f6ae27fc700 1 --2- 172.21.15.5:0/531585697 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f6ad806e150 0x7f6ad8070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:40:47.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.546+0000 7f6ae27fc700 1 -- 172.21.15.5:0/531585697 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f6ae808f120 con 0x7f6aec0fbcf0 2024-04-16T14:40:47.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.546+0000 7f6af1351700 1 --2- 172.21.15.5:0/531585697 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f6ad806e150 0x7f6ad8070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:40:47.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.547+0000 7f6af1351700 1 --2- 172.21.15.5:0/531585697 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f6ad806e150 0x7f6ad8070600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6aec1003a0 tx=0x7f6adc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:40:47.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.551+0000 7f6ae27fc700 1 -- 172.21.15.5:0/531585697 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f6ae80585c0 con 0x7f6aec0fbcf0 2024-04-16T14:40:47.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:47 smithi005 ceph-mon[93420]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:40:47.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:47 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/1748002706' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:40:47.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:47 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/409821519' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:40:47.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.849+0000 7f6af3db6700 1 -- 172.21.15.5:0/531585697 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6aec1048e0 con 0x7f6aec0fbcf0 2024-04-16T14:40:47.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.849+0000 7f6ae27fc700 1 -- 172.21.15.5:0/531585697 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f6ae8004490 con 0x7f6aec0fbcf0 2024-04-16T14:40:47.848 INFO:teuthology.orchestra.run.smithi005.stdout:HEALTH_OK 2024-04-16T14:40:47.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.851+0000 7f6af3db6700 1 -- 172.21.15.5:0/531585697 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f6ad806e150 msgr2=0x7f6ad8070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:47.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.851+0000 7f6af3db6700 1 --2- 172.21.15.5:0/531585697 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f6ad806e150 0x7f6ad8070600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6aec1003a0 tx=0x7f6adc00b040 comp rx=0 tx=0).stop 2024-04-16T14:40:47.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.851+0000 7f6af3db6700 1 -- 172.21.15.5:0/531585697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aec0fbcf0 msgr2=0x7f6aec0ffdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:40:47.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.851+0000 7f6af3db6700 1 --2- 172.21.15.5:0/531585697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aec0fbcf0 0x7f6aec0ffdc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8013870 tx=0x7f6ae8009e30 comp rx=0 tx=0).stop 2024-04-16T14:40:47.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.852+0000 7f6af3db6700 1 -- 172.21.15.5:0/531585697 shutdown_connections 2024-04-16T14:40:47.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.852+0000 7f6af3db6700 1 --2- 172.21.15.5:0/531585697 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f6ad806e150 0x7f6ad8070600 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:47.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.852+0000 7f6af3db6700 1 --2- 172.21.15.5:0/531585697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6aec0fbcf0 0x7f6aec0ffdc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:47.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.852+0000 7f6af3db6700 1 --2- 172.21.15.5:0/531585697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6aec0fcfa0 0x7f6aec0fe2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:40:47.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.852+0000 7f6af3db6700 1 -- 172.21.15.5:0/531585697 >> 172.21.15.5:0/531585697 conn(0x7f6aec0f7450 msgr2=0x7f6aec0663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:40:47.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.852+0000 7f6af3db6700 1 -- 172.21.15.5:0/531585697 shutdown_connections 2024-04-16T14:40:47.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:40:47.852+0000 7f6af3db6700 1 -- 172.21.15.5:0/531585697 wait complete. 2024-04-16T14:40:47.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:47 smithi115 ceph-mon[83414]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:40:47.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:47 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/1748002706' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:40:47.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:47 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/409821519' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:40:48.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:48 smithi115 ceph-mon[83414]: pgmap v125: 65 pgs: 65 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:48.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:48 smithi115 ceph-mon[83414]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:40:48.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:48 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/531585697' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:40:48.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:48 smithi005 ceph-mon[93420]: pgmap v125: 65 pgs: 65 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:48.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:48 smithi005 ceph-mon[93420]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:40:48.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:48 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/531585697' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:40:50.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:50 smithi115 ceph-mon[83414]: pgmap v126: 65 pgs: 65 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:50.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:50 smithi005 ceph-mon[93420]: pgmap v126: 65 pgs: 65 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:52.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:52 smithi115 ceph-mon[83414]: pgmap v127: 65 pgs: 65 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:52.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:52 smithi005 ceph-mon[93420]: pgmap v127: 65 pgs: 65 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:54.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:54 smithi115 ceph-mon[83414]: pgmap v128: 65 pgs: 65 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:54.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:54 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:54.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:54 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:40:54.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:54 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:54.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:54 smithi005 ceph-mon[93420]: pgmap v128: 65 pgs: 65 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:54.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:54 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:54.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:54 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:40:54.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:54 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:55.646 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:55 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-16T14:40:55.646 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:55 smithi115 ceph-mon[83414]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-16T14:40:55.646 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:55 smithi115 ceph-mon[83414]: Upgrade: osd.4 is safe to restart 2024-04-16T14:40:55.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:55 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-16T14:40:55.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:55 smithi005 ceph-mon[93420]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-16T14:40:55.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:55 smithi005 ceph-mon[93420]: Upgrade: osd.4 is safe to restart 2024-04-16T14:40:57.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:57 smithi115 ceph-mon[83414]: pgmap v129: 65 pgs: 65 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:57.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:57 smithi115 ceph-mon[83414]: Upgrade: Updating osd.4 2024-04-16T14:40:57.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:57 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:57.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:57 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-16T14:40:57.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:57 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:40:57.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:57 smithi115 ceph-mon[83414]: Deploying daemon osd.4 on smithi115 2024-04-16T14:40:57.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:57 smithi005 ceph-mon[93420]: pgmap v129: 65 pgs: 65 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:57.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:57 smithi005 ceph-mon[93420]: Upgrade: Updating osd.4 2024-04-16T14:40:57.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:57 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:40:57.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:57 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-16T14:40:57.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:57 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:40:57.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:57 smithi005 ceph-mon[93420]: Deploying daemon osd.4 on smithi115 2024-04-16T14:40:59.176 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:40:59 smithi115 ceph-mon[83414]: pgmap v130: 65 pgs: 65 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:59.431 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:40:59 smithi115 systemd[1]: Stopping Ceph osd.4 for 10609bfa-fbfd-11ee-bc90-c7b262605968... 2024-04-16T14:40:59.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:40:59 smithi005 ceph-mon[93420]: pgmap v130: 65 pgs: 65 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:40:59.931 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:40:59 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4[49714]: 2024-04-16T14:40:59.564+0000 7fbf2c46d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-16T14:40:59.931 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:40:59 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4[49714]: 2024-04-16T14:40:59.564+0000 7fbf2c46d700 -1 osd.4 70 *** Got signal Terminated *** 2024-04-16T14:40:59.932 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:40:59 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4[49714]: 2024-04-16T14:40:59.564+0000 7fbf2c46d700 -1 osd.4 70 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-16T14:41:00.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:00 smithi115 ceph-mon[83414]: osd.4 marked itself down and dead 2024-04-16T14:41:00.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:00 smithi005 ceph-mon[93420]: osd.4 marked itself down and dead 2024-04-16T14:41:00.878 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:00 smithi115 podman[98022]: 2024-04-16 14:41:00.485768786 +0000 UTC m=+1.153332954 container died e3ea96b7edd9f1a3a664da681a098f1a5e589de1597bf4600e95dc750e097f57 (image=quay.ceph.io/ceph-ci/ceph@sha256:15b9a118425d53cc97d2f7bc08f63df1d8bfa1149df59d4de72a305b04501998, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4, io.buildah.version=1.33.5, RELEASE=quincy-412a552, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-16T14:41:00.878 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:00 smithi115 podman[98022]: 2024-04-16 14:41:00.880633342 +0000 UTC m=+1.548197494 container cleanup e3ea96b7edd9f1a3a664da681a098f1a5e589de1597bf4600e95dc750e097f57 (image=quay.ceph.io/ceph-ci/ceph@sha256:15b9a118425d53cc97d2f7bc08f63df1d8bfa1149df59d4de72a305b04501998, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=quincy-412a552, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-16T14:41:01.146 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:00 smithi115 bash[98022]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4 2024-04-16T14:41:01.147 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:01 smithi115 ceph-mon[83414]: pgmap v131: 65 pgs: 65 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:41:01.147 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:01 smithi115 ceph-mon[83414]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-16T14:41:01.147 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:01 smithi115 ceph-mon[83414]: osdmap e71: 6 total, 5 up, 6 in 2024-04-16T14:41:01.431 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:01 smithi115 podman[98040]: 2024-04-16 14:41:01.149172075 +0000 UTC m=+0.657320050 container remove e3ea96b7edd9f1a3a664da681a098f1a5e589de1597bf4600e95dc750e097f57 (image=quay.ceph.io/ceph-ci/ceph@sha256:15b9a118425d53cc97d2f7bc08f63df1d8bfa1149df59d4de72a305b04501998, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-412a552, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5) 2024-04-16T14:41:01.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:01 smithi005 ceph-mon[93420]: pgmap v131: 65 pgs: 65 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:41:01.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:01 smithi005 ceph-mon[93420]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-16T14:41:01.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:01 smithi005 ceph-mon[93420]: osdmap e71: 6 total, 5 up, 6 in 2024-04-16T14:41:01.758 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:01 smithi115 podman[98130]: 2024-04-16 14:41:01.408239341 +0000 UTC m=+0.017820341 image pull b1a78730e0db57f46162ae12211512856024b361a698c3ed431f6fbc73b484c3 quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 2024-04-16T14:41:01.758 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:01 smithi115 podman[98130]: 2024-04-16 14:41:01.524776046 +0000 UTC m=+0.134357024 container create b003d85c5502a6f08c1575aeaaad6a0f56d89813c7aaa518b1c9547083e7acdf (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-04-16T14:41:01.758 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:01 smithi115 podman[98130]: 2024-04-16 14:41:01.760632629 +0000 UTC m=+0.370213610 container init b003d85c5502a6f08c1575aeaaad6a0f56d89813c7aaa518b1c9547083e7acdf (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-16T14:41:02.016 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:01 smithi115 podman[98130]: 2024-04-16 14:41:01.764117991 +0000 UTC m=+0.373698969 container start b003d85c5502a6f08c1575aeaaad6a0f56d89813c7aaa518b1c9547083e7acdf (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-16T14:41:02.016 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:01 smithi115 podman[98130]: 2024-04-16 14:41:01.877215288 +0000 UTC m=+0.486796276 container attach b003d85c5502a6f08c1575aeaaad6a0f56d89813c7aaa518b1c9547083e7acdf (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-04-16T14:41:02.344 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:02 smithi115 ceph-mon[83414]: osdmap e72: 6 total, 5 up, 6 in 2024-04-16T14:41:02.344 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:02 smithi115 podman[98130]: 2024-04-16 14:41:02.051804575 +0000 UTC m=+0.661385547 container died b003d85c5502a6f08c1575aeaaad6a0f56d89813c7aaa518b1c9547083e7acdf (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, GIT_BRANCH=HEAD, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5) 2024-04-16T14:41:02.375 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:02 smithi005 ceph-mon[93420]: osdmap e72: 6 total, 5 up, 6 in 2024-04-16T14:41:02.932 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:02 smithi115 podman[98155]: 2024-04-16 14:41:02.63065915 +0000 UTC m=+0.573190955 container remove b003d85c5502a6f08c1575aeaaad6a0f56d89813c7aaa518b1c9547083e7acdf (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-16T14:41:02.932 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:02 smithi115 systemd[1]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.4.service: Deactivated successfully. 2024-04-16T14:41:02.932 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:02 smithi115 systemd[1]: Stopped Ceph osd.4 for 10609bfa-fbfd-11ee-bc90-c7b262605968. 2024-04-16T14:41:02.932 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:02 smithi115 systemd[1]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.4.service: Consumed 58.822s CPU time. 2024-04-16T14:41:02.932 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:02 smithi115 systemd[1]: Starting Ceph osd.4 for 10609bfa-fbfd-11ee-bc90-c7b262605968... 2024-04-16T14:41:03.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:03 smithi115 ceph-mon[83414]: pgmap v134: 65 pgs: 4 active+undersized+degraded, 2 peering, 4 stale+active+clean, 4 active+undersized, 51 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 12/354 objects degraded (3.390%) 2024-04-16T14:41:03.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:03 smithi115 ceph-mon[83414]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-16T14:41:03.299 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:03 smithi115 ceph-mon[83414]: Health check failed: Degraded data redundancy: 12/354 objects degraded (3.390%), 4 pgs degraded (PG_DEGRADED) 2024-04-16T14:41:03.299 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:03 smithi115 podman[98258]: 2024-04-16 14:41:02.978573898 +0000 UTC m=+0.018036552 image pull b1a78730e0db57f46162ae12211512856024b361a698c3ed431f6fbc73b484c3 quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 2024-04-16T14:41:03.299 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:03 smithi115 podman[98258]: 2024-04-16 14:41:03.081783302 +0000 UTC m=+0.121245932 container create b6fbae291e49df4800491b35e1cd0cde0f61572f58dcf5786345e0d635e099e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4-activate, org.label-schema.build-date=20240409, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-04-16T14:41:03.299 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:03 smithi115 podman[98258]: 2024-04-16 14:41:03.301485403 +0000 UTC m=+0.340948051 container init b6fbae291e49df4800491b35e1cd0cde0f61572f58dcf5786345e0d635e099e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4-activate, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, maintainer=Guillaume Abrioux , RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-04-16T14:41:03.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:03 smithi005 ceph-mon[93420]: pgmap v134: 65 pgs: 4 active+undersized+degraded, 2 peering, 4 stale+active+clean, 4 active+undersized, 51 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 12/354 objects degraded (3.390%) 2024-04-16T14:41:03.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:03 smithi005 ceph-mon[93420]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-16T14:41:03.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:03 smithi005 ceph-mon[93420]: Health check failed: Degraded data redundancy: 12/354 objects degraded (3.390%), 4 pgs degraded (PG_DEGRADED) 2024-04-16T14:41:03.681 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:03 smithi115 podman[98258]: 2024-04-16 14:41:03.305309411 +0000 UTC m=+0.344772048 container start b6fbae291e49df4800491b35e1cd0cde0f61572f58dcf5786345e0d635e099e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4-activate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True) 2024-04-16T14:41:03.682 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:03 smithi115 podman[98258]: 2024-04-16 14:41:03.384185967 +0000 UTC m=+0.423648608 container attach b6fbae291e49df4800491b35e1cd0cde0f61572f58dcf5786345e0d635e099e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4-activate, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-16T14:41:04.077 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:03 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4-activate[98273]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-16T14:41:04.077 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:03 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4-activate[98273]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-16T14:41:04.077 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:03 smithi115 bash[98258]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-16T14:41:04.077 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:03 smithi115 bash[98258]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-16T14:41:04.077 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:03 smithi115 bash[98258]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-16T14:41:04.077 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:03 smithi115 bash[98258]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-16T14:41:04.077 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:03 smithi115 bash[98258]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-04-16T14:41:04.077 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:03 smithi115 bash[98258]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-16T14:41:04.078 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:03 smithi115 bash[98258]: --> ceph-volume raw activate successful for osd ID: 4 2024-04-16T14:41:04.078 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:03 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4-activate[98273]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-16T14:41:04.078 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:03 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4-activate[98273]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-16T14:41:04.078 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:03 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4-activate[98273]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-04-16T14:41:04.078 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:03 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4-activate[98273]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-16T14:41:04.078 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:03 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4-activate[98273]: --> ceph-volume raw activate successful for osd ID: 4 2024-04-16T14:41:04.078 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:03 smithi115 podman[98258]: 2024-04-16 14:41:03.775057017 +0000 UTC m=+0.814519661 container died b6fbae291e49df4800491b35e1cd0cde0f61572f58dcf5786345e0d635e099e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5) 2024-04-16T14:41:04.681 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:04 smithi115 podman[98408]: 2024-04-16 14:41:04.354504281 +0000 UTC m=+0.574141473 container remove b6fbae291e49df4800491b35e1cd0cde0f61572f58dcf5786345e0d635e099e5 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4-activate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-16T14:41:04.681 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:04 smithi115 podman[98474]: 2024-04-16 14:41:04.471995644 +0000 UTC m=+0.017821584 image pull b1a78730e0db57f46162ae12211512856024b361a698c3ed431f6fbc73b484c3 quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 2024-04-16T14:41:04.682 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:04 smithi115 podman[98474]: 2024-04-16 14:41:04.588783554 +0000 UTC m=+0.134609466 container create 74d7d2ac5a6a60409d1fa6711cac488496796a46204bddfda431e9a1fd7c4fe3 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-16T14:41:05.021 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:04 smithi115 podman[98474]: 2024-04-16 14:41:04.791353896 +0000 UTC m=+0.337179810 container init 74d7d2ac5a6a60409d1fa6711cac488496796a46204bddfda431e9a1fd7c4fe3 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-04-16T14:41:05.022 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:04 smithi115 podman[98474]: 2024-04-16 14:41:04.794434842 +0000 UTC m=+0.340260755 container start 74d7d2ac5a6a60409d1fa6711cac488496796a46204bddfda431e9a1fd7c4fe3 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, ceph=True, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-04-16T14:41:05.022 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:04 smithi115 ceph-osd[98493]: -- 172.21.15.115:0/2661875513 <== mon.1 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560979445680 con 0x56097940ec00 2024-04-16T14:41:05.022 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:04 smithi115 bash[98474]: 74d7d2ac5a6a60409d1fa6711cac488496796a46204bddfda431e9a1fd7c4fe3 2024-04-16T14:41:05.022 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:04 smithi115 systemd[1]: Started Ceph osd.4 for 10609bfa-fbfd-11ee-bc90-c7b262605968. 2024-04-16T14:41:05.331 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:05 smithi115 ceph-mon[83414]: pgmap v135: 65 pgs: 10 active+undersized+degraded, 2 peering, 3 stale+active+clean, 9 active+undersized, 41 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 40/354 objects degraded (11.299%) 2024-04-16T14:41:05.331 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:05 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:05.332 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:05 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:05.332 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:05 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:41:05.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:05 smithi005 ceph-mon[93420]: pgmap v135: 65 pgs: 10 active+undersized+degraded, 2 peering, 3 stale+active+clean, 9 active+undersized, 41 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 40/354 objects degraded (11.299%) 2024-04-16T14:41:05.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:05 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:05.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:05 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:05.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:05 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:41:05.681 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:05 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4[98489]: 2024-04-16T14:41:05.332+0000 7f6af7ea27c0 -1 Falling back to public interface 2024-04-16T14:41:07.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:07 smithi005 ceph-mon[93420]: pgmap v136: 65 pgs: 16 active+undersized+degraded, 2 peering, 16 active+undersized, 31 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 59/354 objects degraded (16.667%) 2024-04-16T14:41:07.398 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:07 smithi115 ceph-mon[83414]: pgmap v136: 65 pgs: 16 active+undersized+degraded, 2 peering, 16 active+undersized, 31 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 59/354 objects degraded (16.667%) 2024-04-16T14:41:09.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:08 smithi005 ceph-mon[93420]: pgmap v137: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 59/354 objects degraded (16.667%) 2024-04-16T14:41:09.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:08 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:09.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:08 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:09.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:08 smithi005 ceph-mon[93420]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-16T14:41:09.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:08 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:09.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:08 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:41:09.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:08 smithi115 ceph-mon[83414]: pgmap v137: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 59/354 objects degraded (16.667%) 2024-04-16T14:41:09.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:08 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:09.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:08 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:09.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:08 smithi115 ceph-mon[83414]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-16T14:41:09.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:08 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:09.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:08 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:41:10.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:10 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:10.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:10 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:10.428 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:10 smithi115 ceph-mon[83414]: Health check update: Degraded data redundancy: 59/354 objects degraded (16.667%), 16 pgs degraded (PG_DEGRADED) 2024-04-16T14:41:10.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:10 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:10.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:10 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:10.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:10 smithi005 ceph-mon[93420]: Health check update: Degraded data redundancy: 59/354 objects degraded (16.667%), 16 pgs degraded (PG_DEGRADED) 2024-04-16T14:41:10.681 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:10 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4[98489]: 2024-04-16T14:41:10.427+0000 7f6af7ea27c0 -1 osd.4 70 log_to_monitors true 2024-04-16T14:41:11.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:11 smithi115 ceph-mon[83414]: pgmap v138: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 59/354 objects degraded (16.667%) 2024-04-16T14:41:11.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:11 smithi115 ceph-mon[83414]: from='osd.4 [v2:172.21.15.115:6808/139500214,v1:172.21.15.115:6809/139500214]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-16T14:41:11.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:11 smithi115 ceph-mon[83414]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-16T14:41:11.432 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:41:11 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4[98489]: 2024-04-16T14:41:11.141+0000 7f6ae92fa700 -1 osd.4 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T14:41:11.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:11 smithi005 ceph-mon[93420]: pgmap v138: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 300 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 59/354 objects degraded (16.667%) 2024-04-16T14:41:11.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:11 smithi005 ceph-mon[93420]: from='osd.4 [v2:172.21.15.115:6808/139500214,v1:172.21.15.115:6809/139500214]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-16T14:41:11.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:11 smithi005 ceph-mon[93420]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-16T14:41:12.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:12 smithi115 ceph-mon[83414]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-16T14:41:12.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:12 smithi115 ceph-mon[83414]: osdmap e73: 6 total, 5 up, 6 in 2024-04-16T14:41:12.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:12 smithi115 ceph-mon[83414]: from='osd.4 [v2:172.21.15.115:6808/139500214,v1:172.21.15.115:6809/139500214]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-04-16T14:41:12.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:12 smithi115 ceph-mon[83414]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-04-16T14:41:12.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:12 smithi005 ceph-mon[93420]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-16T14:41:12.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:12 smithi005 ceph-mon[93420]: osdmap e73: 6 total, 5 up, 6 in 2024-04-16T14:41:12.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:12 smithi005 ceph-mon[93420]: from='osd.4 [v2:172.21.15.115:6808/139500214,v1:172.21.15.115:6809/139500214]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-04-16T14:41:12.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:12 smithi005 ceph-mon[93420]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-04-16T14:41:13.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:13 smithi115 ceph-mon[83414]: pgmap v140: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 59/354 objects degraded (16.667%) 2024-04-16T14:41:13.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:13 smithi115 ceph-mon[83414]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-16T14:41:13.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:13 smithi115 ceph-mon[83414]: osd.4 [v2:172.21.15.115:6808/139500214,v1:172.21.15.115:6809/139500214] boot 2024-04-16T14:41:13.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:13 smithi115 ceph-mon[83414]: osdmap e74: 6 total, 6 up, 6 in 2024-04-16T14:41:13.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:13 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-16T14:41:13.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:13 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:13.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:13 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:13.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:13 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:41:13.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:13 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:41:13.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:13 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:13.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:13 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:41:13.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:13 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:13.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:13 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:13.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:13 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:13.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:13 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-16T14:41:13.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:13 smithi005 ceph-mon[93420]: pgmap v140: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 59/354 objects degraded (16.667%) 2024-04-16T14:41:13.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:13 smithi005 ceph-mon[93420]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-16T14:41:13.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:13 smithi005 ceph-mon[93420]: osd.4 [v2:172.21.15.115:6808/139500214,v1:172.21.15.115:6809/139500214] boot 2024-04-16T14:41:13.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:13 smithi005 ceph-mon[93420]: osdmap e74: 6 total, 6 up, 6 in 2024-04-16T14:41:13.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:13 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-16T14:41:13.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:13 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:13.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:13 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:13.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:13 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:41:13.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:13 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:41:13.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:13 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:13.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:13 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:41:13.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:13 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:13.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:13 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:13.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:13 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:13.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:13 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-16T14:41:14.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:14 smithi115 ceph-mon[83414]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-16T14:41:14.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:14 smithi115 ceph-mon[83414]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-04-16T14:41:14.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:14 smithi115 ceph-mon[83414]: osdmap e75: 6 total, 6 up, 6 in 2024-04-16T14:41:14.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:14 smithi005 ceph-mon[93420]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-16T14:41:14.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:14 smithi005 ceph-mon[93420]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-04-16T14:41:14.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:14 smithi005 ceph-mon[93420]: osdmap e75: 6 total, 6 up, 6 in 2024-04-16T14:41:15.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:15 smithi115 ceph-mon[83414]: pgmap v143: 65 pgs: 10 peering, 11 active+undersized+degraded, 13 active+undersized, 31 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/354 objects degraded (9.605%) 2024-04-16T14:41:15.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:15 smithi115 ceph-mon[83414]: Health check update: Degraded data redundancy: 34/354 objects degraded (9.605%), 11 pgs degraded (PG_DEGRADED) 2024-04-16T14:41:15.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:15 smithi005 ceph-mon[93420]: pgmap v143: 65 pgs: 10 peering, 11 active+undersized+degraded, 13 active+undersized, 31 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 34/354 objects degraded (9.605%) 2024-04-16T14:41:15.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:15 smithi005 ceph-mon[93420]: Health check update: Degraded data redundancy: 34/354 objects degraded (9.605%), 11 pgs degraded (PG_DEGRADED) 2024-04-16T14:41:17.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:17 smithi115 ceph-mon[83414]: pgmap v144: 65 pgs: 10 peering, 7 active+undersized+degraded, 7 active+undersized, 41 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 19/354 objects degraded (5.367%) 2024-04-16T14:41:17.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:17 smithi005 ceph-mon[93420]: pgmap v144: 65 pgs: 10 peering, 7 active+undersized+degraded, 7 active+undersized, 41 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 19/354 objects degraded (5.367%) 2024-04-16T14:41:17.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.972+0000 7f8639456700 1 -- 172.21.15.5:0/368198081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86340fbd00 msgr2=0x7f86340fc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:17.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.972+0000 7f8639456700 1 --2- 172.21.15.5:0/368198081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86340fbd00 0x7f86340fc110 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8624004940 tx=0x7f8624009e30 comp rx=0 tx=0).stop 2024-04-16T14:41:17.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.972+0000 7f8639456700 1 -- 172.21.15.5:0/368198081 shutdown_connections 2024-04-16T14:41:17.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.972+0000 7f8639456700 1 --2- 172.21.15.5:0/368198081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86340fcfb0 0x7f86340fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.972+0000 7f8639456700 1 --2- 172.21.15.5:0/368198081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86340fbd00 0x7f86340fc110 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.972+0000 7f8639456700 1 -- 172.21.15.5:0/368198081 >> 172.21.15.5:0/368198081 conn(0x7f86340f7480 msgr2=0x7f86340f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.972+0000 7f8639456700 1 -- 172.21.15.5:0/368198081 shutdown_connections 2024-04-16T14:41:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.972+0000 7f8639456700 1 -- 172.21.15.5:0/368198081 wait complete. 2024-04-16T14:41:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.973+0000 7f8639456700 1 Processor -- start 2024-04-16T14:41:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.973+0000 7f8639456700 1 -- start start 2024-04-16T14:41:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.973+0000 7f8639456700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86340fbd00 0x7f8634066d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.973+0000 7f8639456700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86340fcfb0 0x7f8634112740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.973+0000 7f8639456700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8634112c80 con 0x7f86340fbd00 2024-04-16T14:41:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.973+0000 7f8639456700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8634112dc0 con 0x7f86340fcfb0 2024-04-16T14:41:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.973+0000 7f8632ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86340fbd00 0x7f8634066d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:17.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.973+0000 7f8632ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86340fbd00 0x7f8634066d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56922/0 (socket says 172.21.15.5:56922) 2024-04-16T14:41:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.973+0000 7f8632ffd700 1 -- 172.21.15.5:0/197495501 learned_addr learned my addr 172.21.15.5:0/197495501 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:41:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.973+0000 7f86327fc700 1 --2- 172.21.15.5:0/197495501 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86340fcfb0 0x7f8634112740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.973+0000 7f8632ffd700 1 -- 172.21.15.5:0/197495501 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86340fcfb0 msgr2=0x7f8634112740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.973+0000 7f8632ffd700 1 --2- 172.21.15.5:0/197495501 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86340fcfb0 0x7f8634112740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.973+0000 7f8632ffd700 1 -- 172.21.15.5:0/197495501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8624005040 con 0x7f86340fbd00 2024-04-16T14:41:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.973+0000 7f86327fc700 1 --2- 172.21.15.5:0/197495501 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86340fcfb0 0x7f8634112740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T14:41:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.973+0000 7f8632ffd700 1 --2- 172.21.15.5:0/197495501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86340fbd00 0x7f8634066d00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8624013870 tx=0x7f8624009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.974+0000 7f861b7fe700 1 -- 172.21.15.5:0/197495501 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f862400e070 con 0x7f86340fbd00 2024-04-16T14:41:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.974+0000 7f861b7fe700 1 -- 172.21.15.5:0/197495501 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f862401c400 con 0x7f86340fbd00 2024-04-16T14:41:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.974+0000 7f8639456700 1 -- 172.21.15.5:0/197495501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8634112fc0 con 0x7f86340fbd00 2024-04-16T14:41:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.974+0000 7f861b7fe700 1 -- 172.21.15.5:0/197495501 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f862400b650 con 0x7f86340fbd00 2024-04-16T14:41:17.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.974+0000 7f8639456700 1 -- 172.21.15.5:0/197495501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8634113420 con 0x7f86340fbd00 2024-04-16T14:41:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.975+0000 7f8639456700 1 -- 172.21.15.5:0/197495501 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f863404c710 con 0x7f86340fbd00 2024-04-16T14:41:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.975+0000 7f861b7fe700 1 -- 172.21.15.5:0/197495501 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f862401ca00 con 0x7f86340fbd00 2024-04-16T14:41:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.976+0000 7f861b7fe700 1 --2- 172.21.15.5:0/197495501 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f861c06e140 0x7f861c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.976+0000 7f86327fc700 1 --2- 172.21.15.5:0/197495501 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f861c06e140 0x7f861c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.976+0000 7f861b7fe700 1 -- 172.21.15.5:0/197495501 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f862408f230 con 0x7f86340fbd00 2024-04-16T14:41:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.977+0000 7f86327fc700 1 --2- 172.21.15.5:0/197495501 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f861c06e140 0x7f861c0705f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8628004600 tx=0x7f862800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:17.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:17.981+0000 7f861b7fe700 1 -- 172.21.15.5:0/197495501 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f862405c160 con 0x7f86340fbd00 2024-04-16T14:41:18.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.215+0000 7f8639456700 1 -- 172.21.15.5:0/197495501 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8634113640 con 0x7f861c06e140 2024-04-16T14:41:18.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.216+0000 7f861b7fe700 1 -- 172.21.15.5:0/197495501 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f8634113640 con 0x7f861c06e140 2024-04-16T14:41:18.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.218+0000 7f8639456700 1 -- 172.21.15.5:0/197495501 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f861c06e140 msgr2=0x7f861c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:18.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.218+0000 7f8639456700 1 --2- 172.21.15.5:0/197495501 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f861c06e140 0x7f861c0705f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8628004600 tx=0x7f862800b040 comp rx=0 tx=0).stop 2024-04-16T14:41:18.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.218+0000 7f8639456700 1 -- 172.21.15.5:0/197495501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86340fbd00 msgr2=0x7f8634066d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:18.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.218+0000 7f8639456700 1 --2- 172.21.15.5:0/197495501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86340fbd00 0x7f8634066d00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8624013870 tx=0x7f8624009e30 comp rx=0 tx=0).stop 2024-04-16T14:41:18.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.218+0000 7f8639456700 1 -- 172.21.15.5:0/197495501 shutdown_connections 2024-04-16T14:41:18.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.218+0000 7f8639456700 1 --2- 172.21.15.5:0/197495501 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f861c06e140 0x7f861c0705f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:18.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.218+0000 7f8639456700 1 --2- 172.21.15.5:0/197495501 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f86340fbd00 0x7f8634066d00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:18.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.218+0000 7f8639456700 1 --2- 172.21.15.5:0/197495501 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86340fcfb0 0x7f8634112740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:18.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.218+0000 7f8639456700 1 -- 172.21.15.5:0/197495501 >> 172.21.15.5:0/197495501 conn(0x7f86340f7480 msgr2=0x7f86340f8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:18.217 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.218+0000 7f8639456700 1 -- 172.21.15.5:0/197495501 shutdown_connections 2024-04-16T14:41:18.218 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.218+0000 7f8639456700 1 -- 172.21.15.5:0/197495501 wait complete. 2024-04-16T14:41:18.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:18 smithi005 ceph-mon[93420]: pgmap v145: 65 pgs: 10 peering, 55 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:41:18.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:18 smithi005 ceph-mon[93420]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 19/354 objects degraded (5.367%), 7 pgs degraded) 2024-04-16T14:41:18.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:18 smithi005 ceph-mon[93420]: Cluster is now healthy 2024-04-16T14:41:18.229 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-04-16T14:41:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.324+0000 7fec30af1700 1 -- 172.21.15.5:0/189194342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec2c0fffa0 msgr2=0x7fec2c102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.324+0000 7fec30af1700 1 --2- 172.21.15.5:0/189194342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec2c0fffa0 0x7fec2c102380 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fec20004940 tx=0x7fec20009e30 comp rx=0 tx=0).stop 2024-04-16T14:41:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.325+0000 7fec30af1700 1 -- 172.21.15.5:0/189194342 shutdown_connections 2024-04-16T14:41:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.325+0000 7fec30af1700 1 --2- 172.21.15.5:0/189194342 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec2c0fffa0 0x7fec2c102380 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.325+0000 7fec30af1700 1 --2- 172.21.15.5:0/189194342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec2c066ee0 0x7fec2c0ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.325+0000 7fec30af1700 1 -- 172.21.15.5:0/189194342 >> 172.21.15.5:0/189194342 conn(0x7fec2c0f7450 msgr2=0x7fec2c0f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.325+0000 7fec30af1700 1 -- 172.21.15.5:0/189194342 shutdown_connections 2024-04-16T14:41:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.325+0000 7fec30af1700 1 -- 172.21.15.5:0/189194342 wait complete. 2024-04-16T14:41:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.325+0000 7fec30af1700 1 Processor -- start 2024-04-16T14:41:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.325+0000 7fec30af1700 1 -- start start 2024-04-16T14:41:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.325+0000 7fec30af1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec2c066ee0 0x7fec2c10dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.325+0000 7fec30af1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec2c0fffa0 0x7fec2c10e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.325+0000 7fec30af1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c10e820 con 0x7fec2c0fffa0 2024-04-16T14:41:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.325+0000 7fec30af1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c1131c0 con 0x7fec2c066ee0 2024-04-16T14:41:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.325+0000 7fec29d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec2c0fffa0 0x7fec2c10e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.326+0000 7fec29d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec2c0fffa0 0x7fec2c10e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56928/0 (socket says 172.21.15.5:56928) 2024-04-16T14:41:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.326+0000 7fec29d9b700 1 -- 172.21.15.5:0/4126428744 learned_addr learned my addr 172.21.15.5:0/4126428744 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:41:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.326+0000 7fec2a59c700 1 --2- 172.21.15.5:0/4126428744 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec2c066ee0 0x7fec2c10dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.326+0000 7fec29d9b700 1 -- 172.21.15.5:0/4126428744 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec2c066ee0 msgr2=0x7fec2c10dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.326+0000 7fec29d9b700 1 --2- 172.21.15.5:0/4126428744 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec2c066ee0 0x7fec2c10dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.326+0000 7fec29d9b700 1 -- 172.21.15.5:0/4126428744 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec20005040 con 0x7fec2c0fffa0 2024-04-16T14:41:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.326+0000 7fec29d9b700 1 --2- 172.21.15.5:0/4126428744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec2c0fffa0 0x7fec2c10e1d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fec20009150 tx=0x7fec20009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.326+0000 7fec1affd700 1 -- 172.21.15.5:0/4126428744 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec2000e040 con 0x7fec2c0fffa0 2024-04-16T14:41:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.326+0000 7fec1affd700 1 -- 172.21.15.5:0/4126428744 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec2000bbf0 con 0x7fec2c0fffa0 2024-04-16T14:41:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.326+0000 7fec1affd700 1 -- 172.21.15.5:0/4126428744 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec2001c630 con 0x7fec2c0fffa0 2024-04-16T14:41:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.326+0000 7fec30af1700 1 -- 172.21.15.5:0/4126428744 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec2c113300 con 0x7fec2c0fffa0 2024-04-16T14:41:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.326+0000 7fec30af1700 1 -- 172.21.15.5:0/4126428744 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2c113860 con 0x7fec2c0fffa0 2024-04-16T14:41:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.327+0000 7fec30af1700 1 -- 172.21.15.5:0/4126428744 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec2c04c710 con 0x7fec2c0fffa0 2024-04-16T14:41:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.328+0000 7fec1affd700 1 -- 172.21.15.5:0/4126428744 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fec2000bd60 con 0x7fec2c0fffa0 2024-04-16T14:41:18.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.328+0000 7fec1affd700 1 --2- 172.21.15.5:0/4126428744 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fec1406e140 0x7fec140705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:18.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.328+0000 7fec2a59c700 1 --2- 172.21.15.5:0/4126428744 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fec1406e140 0x7fec140705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:18.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.328+0000 7fec1affd700 1 -- 172.21.15.5:0/4126428744 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fec2008ee00 con 0x7fec2c0fffa0 2024-04-16T14:41:18.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.329+0000 7fec2a59c700 1 --2- 172.21.15.5:0/4126428744 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fec1406e140 0x7fec140705f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fec2c10f130 tx=0x7fec1c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:18.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.333+0000 7fec1affd700 1 -- 172.21.15.5:0/4126428744 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fec200582a0 con 0x7fec2c0fffa0 2024-04-16T14:41:18.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.558+0000 7fec30af1700 1 -- 172.21.15.5:0/4126428744 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fec2c101bf0 con 0x7fec1406e140 2024-04-16T14:41:18.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.559+0000 7fec1affd700 1 -- 172.21.15.5:0/4126428744 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fec2c101bf0 con 0x7fec1406e140 2024-04-16T14:41:18.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.561+0000 7fec30af1700 1 -- 172.21.15.5:0/4126428744 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fec1406e140 msgr2=0x7fec140705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:18.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.561+0000 7fec30af1700 1 --2- 172.21.15.5:0/4126428744 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fec1406e140 0x7fec140705f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fec2c10f130 tx=0x7fec1c00b040 comp rx=0 tx=0).stop 2024-04-16T14:41:18.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.561+0000 7fec30af1700 1 -- 172.21.15.5:0/4126428744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec2c0fffa0 msgr2=0x7fec2c10e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:18.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.561+0000 7fec30af1700 1 --2- 172.21.15.5:0/4126428744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec2c0fffa0 0x7fec2c10e1d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fec20009150 tx=0x7fec20009e30 comp rx=0 tx=0).stop 2024-04-16T14:41:18.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.561+0000 7fec30af1700 1 -- 172.21.15.5:0/4126428744 shutdown_connections 2024-04-16T14:41:18.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.561+0000 7fec30af1700 1 --2- 172.21.15.5:0/4126428744 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fec1406e140 0x7fec140705f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:18.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.561+0000 7fec30af1700 1 --2- 172.21.15.5:0/4126428744 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec2c066ee0 0x7fec2c10dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:18.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.561+0000 7fec30af1700 1 --2- 172.21.15.5:0/4126428744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec2c0fffa0 0x7fec2c10e1d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:18.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.561+0000 7fec30af1700 1 -- 172.21.15.5:0/4126428744 >> 172.21.15.5:0/4126428744 conn(0x7fec2c0f7450 msgr2=0x7fec2c0f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:18.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.562+0000 7fec30af1700 1 -- 172.21.15.5:0/4126428744 shutdown_connections 2024-04-16T14:41:18.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.562+0000 7fec30af1700 1 -- 172.21.15.5:0/4126428744 wait complete. 2024-04-16T14:41:18.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.665+0000 7fc7d1c74700 1 -- 172.21.15.5:0/793663428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7cc066f20 msgr2=0x7fc7cc0ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:18.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.665+0000 7fc7d1c74700 1 --2- 172.21.15.5:0/793663428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7cc066f20 0x7fc7cc0ffa50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009ce0 tx=0x7fc7bc004d10 comp rx=0 tx=0).stop 2024-04-16T14:41:18.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.665+0000 7fc7d1c74700 1 -- 172.21.15.5:0/793663428 shutdown_connections 2024-04-16T14:41:18.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.665+0000 7fc7d1c74700 1 --2- 172.21.15.5:0/793663428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7cc0fff90 0x7fc7cc102370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:18.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.665+0000 7fc7d1c74700 1 --2- 172.21.15.5:0/793663428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7cc066f20 0x7fc7cc0ffa50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:18.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.665+0000 7fc7d1c74700 1 -- 172.21.15.5:0/793663428 >> 172.21.15.5:0/793663428 conn(0x7fc7cc0f7480 msgr2=0x7fc7cc0f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:18.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.665+0000 7fc7d1c74700 1 -- 172.21.15.5:0/793663428 shutdown_connections 2024-04-16T14:41:18.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.665+0000 7fc7d1c74700 1 -- 172.21.15.5:0/793663428 wait complete. 2024-04-16T14:41:18.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.666+0000 7fc7d1c74700 1 Processor -- start 2024-04-16T14:41:18.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.666+0000 7fc7d1c74700 1 -- start start 2024-04-16T14:41:18.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.666+0000 7fc7d1c74700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7cc066f20 0x7fc7cc10da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:18.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.666+0000 7fc7d1c74700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7cc0fff90 0x7fc7cc10df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:18.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.666+0000 7fc7d1c74700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc10e540 con 0x7fc7cc0fff90 2024-04-16T14:41:18.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.666+0000 7fc7d1c74700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc10e6b0 con 0x7fc7cc066f20 2024-04-16T14:41:18.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.666+0000 7fc7c2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7cc0fff90 0x7fc7cc10df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.666+0000 7fc7c2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7cc0fff90 0x7fc7cc10df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47608/0 (socket says 172.21.15.5:47608) 2024-04-16T14:41:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.666+0000 7fc7c2ffd700 1 -- 172.21.15.5:0/1920440357 learned_addr learned my addr 172.21.15.5:0/1920440357 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:41:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.667+0000 7fc7cb7fe700 1 --2- 172.21.15.5:0/1920440357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7cc066f20 0x7fc7cc10da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.667+0000 7fc7c2ffd700 1 -- 172.21.15.5:0/1920440357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7cc066f20 msgr2=0x7fc7cc10da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.667+0000 7fc7c2ffd700 1 --2- 172.21.15.5:0/1920440357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7cc066f20 0x7fc7cc10da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.667+0000 7fc7c2ffd700 1 -- 172.21.15.5:0/1920440357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7bc009940 con 0x7fc7cc0fff90 2024-04-16T14:41:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.667+0000 7fc7cb7fe700 1 --2- 172.21.15.5:0/1920440357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7cc066f20 0x7fc7cc10da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T14:41:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.667+0000 7fc7c2ffd700 1 --2- 172.21.15.5:0/1920440357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7cc0fff90 0x7fc7cc10df40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400eb40 tx=0x7fc7b400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.667+0000 7fc7c8ff9700 1 -- 172.21.15.5:0/1920440357 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7b4007cc0 con 0x7fc7cc0fff90 2024-04-16T14:41:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.667+0000 7fc7c8ff9700 1 -- 172.21.15.5:0/1920440357 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc7b400f040 con 0x7fc7cc0fff90 2024-04-16T14:41:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.667+0000 7fc7d1c74700 1 -- 172.21.15.5:0/1920440357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7cc1130b0 con 0x7fc7cc0fff90 2024-04-16T14:41:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.667+0000 7fc7c8ff9700 1 -- 172.21.15.5:0/1920440357 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7b4009620 con 0x7fc7cc0fff90 2024-04-16T14:41:18.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.667+0000 7fc7d1c74700 1 -- 172.21.15.5:0/1920440357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7cc113670 con 0x7fc7cc0fff90 2024-04-16T14:41:18.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.668+0000 7fc7d1c74700 1 -- 172.21.15.5:0/1920440357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7cc04c710 con 0x7fc7cc0fff90 2024-04-16T14:41:18.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.669+0000 7fc7c8ff9700 1 -- 172.21.15.5:0/1920440357 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fc7b4009780 con 0x7fc7cc0fff90 2024-04-16T14:41:18.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.669+0000 7fc7c8ff9700 1 --2- 172.21.15.5:0/1920440357 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc7b806e140 0x7fc7b80705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:18.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.669+0000 7fc7c8ff9700 1 -- 172.21.15.5:0/1920440357 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fc7b408d7e0 con 0x7fc7cc0fff90 2024-04-16T14:41:18.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.669+0000 7fc7cb7fe700 1 --2- 172.21.15.5:0/1920440357 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc7b806e140 0x7fc7b80705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:18.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.670+0000 7fc7cb7fe700 1 --2- 172.21.15.5:0/1920440357 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc7b806e140 0x7fc7b80705f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc004f80 tx=0x7fc7bc004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:18.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.674+0000 7fc7c8ff9700 1 -- 172.21.15.5:0/1920440357 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fc7b405a740 con 0x7fc7cc0fff90 2024-04-16T14:41:18.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:18 smithi115 ceph-mon[83414]: pgmap v145: 65 pgs: 10 peering, 55 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:41:18.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:18 smithi115 ceph-mon[83414]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 19/354 objects degraded (5.367%), 7 pgs degraded) 2024-04-16T14:41:18.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:18 smithi115 ceph-mon[83414]: Cluster is now healthy 2024-04-16T14:41:18.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.891+0000 7fc7d1c74700 1 -- 172.21.15.5:0/1920440357 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7cc0f8f70 con 0x7fc7b806e140 2024-04-16T14:41:18.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.902+0000 7fc7c8ff9700 1 -- 172.21.15.5:0/1920440357 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fc7cc0f8f70 con 0x7fc7b806e140 2024-04-16T14:41:18.901 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-16T14:41:18.901 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.smithi005 smithi005 *:9093,9094 running (5m) 78s ago 13m 24.6M - 0.25.0 c8568f914cd2 f8aaa22ee70c 2024-04-16T14:41:18.901 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi005 smithi005 running (3m) 78s ago 14m 6656k - 19.0.0-2204-g36befe5d b1a78730e0db d6efa08e65e3 2024-04-16T14:41:18.901 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi115 smithi115 running (2m) 10s ago 13m 6660k - 19.0.0-2204-g36befe5d b1a78730e0db b2a2f2965e2a 2024-04-16T14:41:18.901 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.smithi005 smithi005 *:3000 running (5m) 78s ago 13m 85.9M - 9.4.7 954c08fa6188 9834229a010c 2024-04-16T14:41:18.901 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.vzoqdl smithi005 running (8m) 78s ago 8m 13.5M - 17.2.7-868-g412a5526 b04d96489b7c 84a74a406a1d 2024-04-16T14:41:18.901 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.wofqlz smithi005 running (8m) 78s ago 8m 133M - 17.2.7-868-g412a5526 b04d96489b7c d0e053ab2f72 2024-04-16T14:41:18.901 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.byfytg smithi115 running (8m) 10s ago 8m 118M - 17.2.7-868-g412a5526 b04d96489b7c 595cd0892f66 2024-04-16T14:41:18.901 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.trkaqh smithi115 running (8m) 10s ago 8m 14.4M - 17.2.7-868-g412a5526 b04d96489b7c 5b60cd2ad79b 2024-04-16T14:41:18.901 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi005.ipwdkc smithi005 *:8443,9283,8765 running (5m) 78s ago 15m 501M - 19.0.0-2204-g36befe5d b1a78730e0db 451192b4fc44 2024-04-16T14:41:18.902 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi115.brjkpo smithi115 *:8443,9283,8765 running (4m) 10s ago 12m 450M - 19.0.0-2204-g36befe5d b1a78730e0db 0d75f8211942 2024-04-16T14:41:18.902 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi005 smithi005 running (4m) 78s ago 15m 45.8M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3d0c00924867 2024-04-16T14:41:18.902 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi115 smithi115 running (3m) 10s ago 12m 43.0M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3b916a4928b2 2024-04-16T14:41:18.902 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi005 smithi005 *:9100 running (6m) 78s ago 14m 16.7M - 1.5.0 0da6a335fe13 c09bba584a42 2024-04-16T14:41:18.902 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi115 smithi115 *:9100 running (5m) 10s ago 13m 16.8M - 1.5.0 0da6a335fe13 78cc9cc150c0 2024-04-16T14:41:18.902 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (2m) 78s ago 12m 100M 1559M 19.0.0-2204-g36befe5d b1a78730e0db 91d9246d45e0 2024-04-16T14:41:18.902 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (119s) 78s ago 11m 100M 1559M 19.0.0-2204-g36befe5d b1a78730e0db d930ce515e3e 2024-04-16T14:41:18.902 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (84s) 78s ago 11m 12.7M 1559M 19.0.0-2204-g36befe5d b1a78730e0db fdc5fe68ac57 2024-04-16T14:41:18.902 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi115 running (47s) 10s ago 10m 103M 2581M 19.0.0-2204-g36befe5d b1a78730e0db 808ebb96c862 2024-04-16T14:41:18.902 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi115 running (14s) 10s ago 10m 12.5M 2581M 19.0.0-2204-g36befe5d b1a78730e0db 74d7d2ac5a6a 2024-04-16T14:41:18.902 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi115 running (9m) 10s ago 9m 225M 2581M 17.2.7-868-g412a5526 b04d96489b7c 456fa074e453 2024-04-16T14:41:18.902 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.smithi005 smithi005 *:9095 running (4m) 78s ago 13m 58.9M - 2.43.0 a07b618ecd1d dc784e58817c 2024-04-16T14:41:18.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.904+0000 7fc7d1c74700 1 -- 172.21.15.5:0/1920440357 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc7b806e140 msgr2=0x7fc7b80705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:18.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.904+0000 7fc7d1c74700 1 --2- 172.21.15.5:0/1920440357 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc7b806e140 0x7fc7b80705f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc004f80 tx=0x7fc7bc004d10 comp rx=0 tx=0).stop 2024-04-16T14:41:18.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.904+0000 7fc7d1c74700 1 -- 172.21.15.5:0/1920440357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7cc0fff90 msgr2=0x7fc7cc10df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:18.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.904+0000 7fc7d1c74700 1 --2- 172.21.15.5:0/1920440357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7cc0fff90 0x7fc7cc10df40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400eb40 tx=0x7fc7b400b040 comp rx=0 tx=0).stop 2024-04-16T14:41:18.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.904+0000 7fc7d1c74700 1 -- 172.21.15.5:0/1920440357 shutdown_connections 2024-04-16T14:41:18.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.904+0000 7fc7d1c74700 1 --2- 172.21.15.5:0/1920440357 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc7b806e140 0x7fc7b80705f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:18.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.904+0000 7fc7d1c74700 1 --2- 172.21.15.5:0/1920440357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7cc066f20 0x7fc7cc10da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:18.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.904+0000 7fc7d1c74700 1 --2- 172.21.15.5:0/1920440357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc7cc0fff90 0x7fc7cc10df40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:18.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.904+0000 7fc7d1c74700 1 -- 172.21.15.5:0/1920440357 >> 172.21.15.5:0/1920440357 conn(0x7fc7cc0f7480 msgr2=0x7fc7cc0f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:18.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.905+0000 7fc7d1c74700 1 -- 172.21.15.5:0/1920440357 shutdown_connections 2024-04-16T14:41:18.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:18.905+0000 7fc7d1c74700 1 -- 172.21.15.5:0/1920440357 wait complete. 2024-04-16T14:41:19.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.007+0000 7f6472d9f700 1 -- 172.21.15.5:0/1079430904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f646c066dc0 msgr2=0x7f646c0ff810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:19.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.007+0000 7f6472d9f700 1 --2- 172.21.15.5:0/1079430904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f646c066dc0 0x7f646c0ff810 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6468004940 tx=0x7f6468009e30 comp rx=0 tx=0).stop 2024-04-16T14:41:19.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.007+0000 7f6472d9f700 1 -- 172.21.15.5:0/1079430904 shutdown_connections 2024-04-16T14:41:19.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.007+0000 7f6472d9f700 1 --2- 172.21.15.5:0/1079430904 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f646c0ffd50 0x7f646c102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:19.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.007+0000 7f6472d9f700 1 --2- 172.21.15.5:0/1079430904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f646c066dc0 0x7f646c0ff810 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:19.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.007+0000 7f6472d9f700 1 -- 172.21.15.5:0/1079430904 >> 172.21.15.5:0/1079430904 conn(0x7f646c0f72a0 msgr2=0x7f646c0f96b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:19.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.008+0000 7f6472d9f700 1 -- 172.21.15.5:0/1079430904 shutdown_connections 2024-04-16T14:41:19.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.008+0000 7f6472d9f700 1 -- 172.21.15.5:0/1079430904 wait complete. 2024-04-16T14:41:19.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.008+0000 7f6472d9f700 1 Processor -- start 2024-04-16T14:41:19.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.008+0000 7f6472d9f700 1 -- start start 2024-04-16T14:41:19.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.008+0000 7f6472d9f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f646c066dc0 0x7f646c10fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:19.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.008+0000 7f6472d9f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f646c0ffd50 0x7f646c10ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:19.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.008+0000 7f6472d9f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c1105a0 con 0x7f646c0ffd50 2024-04-16T14:41:19.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.008+0000 7f6472d9f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c110df0 con 0x7f646c066dc0 2024-04-16T14:41:19.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.008+0000 7f647159c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f646c0ffd50 0x7f646c10ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:19.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.008+0000 7f647159c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f646c0ffd50 0x7f646c10ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47630/0 (socket says 172.21.15.5:47630) 2024-04-16T14:41:19.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.008+0000 7f647159c700 1 -- 172.21.15.5:0/2444458434 learned_addr learned my addr 172.21.15.5:0/2444458434 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:41:19.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.009+0000 7f6471d9d700 1 --2- 172.21.15.5:0/2444458434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f646c066dc0 0x7f646c10fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:19.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.009+0000 7f647159c700 1 -- 172.21.15.5:0/2444458434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f646c066dc0 msgr2=0x7f646c10fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:19.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.009+0000 7f647159c700 1 --2- 172.21.15.5:0/2444458434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f646c066dc0 0x7f646c10fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:19.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.009+0000 7f647159c700 1 -- 172.21.15.5:0/2444458434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6468005040 con 0x7f646c0ffd50 2024-04-16T14:41:19.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.009+0000 7f647159c700 1 --2- 172.21.15.5:0/2444458434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f646c0ffd50 0x7f646c10ffa0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f645c002a50 tx=0x7f645c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:19.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.009+0000 7f64627fc700 1 -- 172.21.15.5:0/2444458434 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f645c007cc0 con 0x7f646c0ffd50 2024-04-16T14:41:19.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.009+0000 7f64627fc700 1 -- 172.21.15.5:0/2444458434 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f645c00f040 con 0x7f646c0ffd50 2024-04-16T14:41:19.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.009+0000 7f6472d9f700 1 -- 172.21.15.5:0/2444458434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f646c1110d0 con 0x7f646c0ffd50 2024-04-16T14:41:19.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.009+0000 7f64627fc700 1 -- 172.21.15.5:0/2444458434 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f645c009640 con 0x7f646c0ffd50 2024-04-16T14:41:19.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.009+0000 7f6472d9f700 1 -- 172.21.15.5:0/2444458434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646c111610 con 0x7f646c0ffd50 2024-04-16T14:41:19.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.010+0000 7f6472d9f700 1 -- 172.21.15.5:0/2444458434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f646c0faf20 con 0x7f646c0ffd50 2024-04-16T14:41:19.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.011+0000 7f64627fc700 1 -- 172.21.15.5:0/2444458434 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f645c0097a0 con 0x7f646c0ffd50 2024-04-16T14:41:19.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.011+0000 7f64627fc700 1 --2- 172.21.15.5:0/2444458434 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f645806e140 0x7f64580705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:19.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.011+0000 7f64627fc700 1 -- 172.21.15.5:0/2444458434 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f645c08d940 con 0x7f646c0ffd50 2024-04-16T14:41:19.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.011+0000 7f6471d9d700 1 --2- 172.21.15.5:0/2444458434 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f645806e140 0x7f64580705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:19.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.011+0000 7f6471d9d700 1 --2- 172.21.15.5:0/2444458434 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f645806e140 0x7f64580705f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f646800b970 tx=0x7f6468009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:19.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.016+0000 7f64627fc700 1 -- 172.21.15.5:0/2444458434 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f645c05a7f0 con 0x7f646c0ffd50 2024-04-16T14:41:19.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.313+0000 7f6472d9f700 1 -- 172.21.15.5:0/2444458434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f646c1118d0 con 0x7f646c0ffd50 2024-04-16T14:41:19.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.313+0000 7f64627fc700 1 -- 172.21.15.5:0/2444458434 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f645c05a380 con 0x7f646c0ffd50 2024-04-16T14:41:19.312 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:41:19.312 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-04-16T14:41:19.312 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:41:19.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:41:19.312 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-04-16T14:41:19.312 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:41:19.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:41:19.313 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-04-16T14:41:19.313 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 1, 2024-04-16T14:41:19.313 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 5 2024-04-16T14:41:19.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:41:19.313 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-04-16T14:41:19.313 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 4 2024-04-16T14:41:19.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:41:19.313 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-04-16T14:41:19.313 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 5, 2024-04-16T14:41:19.313 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 9 2024-04-16T14:41:19.313 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-16T14:41:19.313 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:41:19.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.315+0000 7f6472d9f700 1 -- 172.21.15.5:0/2444458434 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f645806e140 msgr2=0x7f64580705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:19.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.315+0000 7f6472d9f700 1 --2- 172.21.15.5:0/2444458434 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f645806e140 0x7f64580705f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f646800b970 tx=0x7f6468009e30 comp rx=0 tx=0).stop 2024-04-16T14:41:19.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.315+0000 7f6472d9f700 1 -- 172.21.15.5:0/2444458434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f646c0ffd50 msgr2=0x7f646c10ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:19.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.315+0000 7f6472d9f700 1 --2- 172.21.15.5:0/2444458434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f646c0ffd50 0x7f646c10ffa0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f645c002a50 tx=0x7f645c0046b0 comp rx=0 tx=0).stop 2024-04-16T14:41:19.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.315+0000 7f6472d9f700 1 -- 172.21.15.5:0/2444458434 shutdown_connections 2024-04-16T14:41:19.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.315+0000 7f6472d9f700 1 --2- 172.21.15.5:0/2444458434 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f645806e140 0x7f64580705f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:19.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.315+0000 7f6472d9f700 1 --2- 172.21.15.5:0/2444458434 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f646c066dc0 0x7f646c10fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:19.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.315+0000 7f6472d9f700 1 --2- 172.21.15.5:0/2444458434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f646c0ffd50 0x7f646c10ffa0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:19.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.315+0000 7f6472d9f700 1 -- 172.21.15.5:0/2444458434 >> 172.21.15.5:0/2444458434 conn(0x7f646c0f72a0 msgr2=0x7f646c0fb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:19.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.316+0000 7f6472d9f700 1 -- 172.21.15.5:0/2444458434 shutdown_connections 2024-04-16T14:41:19.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.316+0000 7f6472d9f700 1 -- 172.21.15.5:0/2444458434 wait complete. 2024-04-16T14:41:19.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.418+0000 7f8258f15700 1 -- 172.21.15.5:0/541184851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82540fbcf0 msgr2=0x7f82540fc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:19.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.418+0000 7f8258f15700 1 --2- 172.21.15.5:0/541184851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82540fbcf0 0x7f82540fc100 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8244004940 tx=0x7f8244009e30 comp rx=0 tx=0).stop 2024-04-16T14:41:19.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.418+0000 7f8258f15700 1 -- 172.21.15.5:0/541184851 shutdown_connections 2024-04-16T14:41:19.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.418+0000 7f8258f15700 1 --2- 172.21.15.5:0/541184851 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82540fcfa0 0x7f82540fd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:19.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.418+0000 7f8258f15700 1 --2- 172.21.15.5:0/541184851 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82540fbcf0 0x7f82540fc100 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:19.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.418+0000 7f8258f15700 1 -- 172.21.15.5:0/541184851 >> 172.21.15.5:0/541184851 conn(0x7f82540f7450 msgr2=0x7f82540f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:19.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.418+0000 7f8258f15700 1 -- 172.21.15.5:0/541184851 shutdown_connections 2024-04-16T14:41:19.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.419+0000 7f8258f15700 1 -- 172.21.15.5:0/541184851 wait complete. 2024-04-16T14:41:19.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.419+0000 7f8258f15700 1 Processor -- start 2024-04-16T14:41:19.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.419+0000 7f8258f15700 1 -- start start 2024-04-16T14:41:19.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.419+0000 7f8258f15700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82540fbcf0 0x7f825410dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:19.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.419+0000 7f8258f15700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82540fcfa0 0x7f825410e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:19.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.419+0000 7f8258f15700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825410e870 con 0x7f82540fcfa0 2024-04-16T14:41:19.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.419+0000 7f8258f15700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8254113180 con 0x7f82540fbcf0 2024-04-16T14:41:19.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.419+0000 7f8251d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82540fcfa0 0x7f825410e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:19.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.419+0000 7f8251d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82540fcfa0 0x7f825410e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47654/0 (socket says 172.21.15.5:47654) 2024-04-16T14:41:19.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.419+0000 7f8251d9b700 1 -- 172.21.15.5:0/372146284 learned_addr learned my addr 172.21.15.5:0/372146284 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:41:19.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.419+0000 7f825259c700 1 --2- 172.21.15.5:0/372146284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82540fbcf0 0x7f825410dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:19.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.420+0000 7f8251d9b700 1 -- 172.21.15.5:0/372146284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82540fbcf0 msgr2=0x7f825410dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:19.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.420+0000 7f8251d9b700 1 --2- 172.21.15.5:0/372146284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82540fbcf0 0x7f825410dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:19.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.420+0000 7f8251d9b700 1 -- 172.21.15.5:0/372146284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8244005040 con 0x7f82540fcfa0 2024-04-16T14:41:19.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.420+0000 7f8251d9b700 1 --2- 172.21.15.5:0/372146284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82540fcfa0 0x7f825410e190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f824800b790 tx=0x7f8248009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:19.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.420+0000 7f8242ffd700 1 -- 172.21.15.5:0/372146284 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f824800f6f0 con 0x7f82540fcfa0 2024-04-16T14:41:19.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.420+0000 7f8242ffd700 1 -- 172.21.15.5:0/372146284 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f824800fd20 con 0x7f82540fcfa0 2024-04-16T14:41:19.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.420+0000 7f8258f15700 1 -- 172.21.15.5:0/372146284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82541133e0 con 0x7f82540fcfa0 2024-04-16T14:41:19.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.420+0000 7f8242ffd700 1 -- 172.21.15.5:0/372146284 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82480103a0 con 0x7f82540fcfa0 2024-04-16T14:41:19.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.420+0000 7f8258f15700 1 -- 172.21.15.5:0/372146284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8254113970 con 0x7f82540fcfa0 2024-04-16T14:41:19.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.421+0000 7f8258f15700 1 -- 172.21.15.5:0/372146284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8254101b30 con 0x7f82540fcfa0 2024-04-16T14:41:19.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.422+0000 7f8242ffd700 1 -- 172.21.15.5:0/372146284 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f824800f850 con 0x7f82540fcfa0 2024-04-16T14:41:19.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.422+0000 7f8242ffd700 1 --2- 172.21.15.5:0/372146284 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f823c06e140 0x7f823c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:19.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.422+0000 7f825259c700 1 --2- 172.21.15.5:0/372146284 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f823c06e140 0x7f823c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:19.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.422+0000 7f8242ffd700 1 -- 172.21.15.5:0/372146284 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f824808d980 con 0x7f82540fcfa0 2024-04-16T14:41:19.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.423+0000 7f825259c700 1 --2- 172.21.15.5:0/372146284 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f823c06e140 0x7f823c0705f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8244000c00 tx=0x7f8244009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:19.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.427+0000 7f8242ffd700 1 -- 172.21.15.5:0/372146284 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f8248056d80 con 0x7f82540fcfa0 2024-04-16T14:41:19.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:19 smithi005 ceph-mon[93420]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:41:19.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:19 smithi005 ceph-mon[93420]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:41:19.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:19 smithi005 ceph-mon[93420]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:41:19.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:19 smithi115 ceph-mon[83414]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:41:19.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:19 smithi115 ceph-mon[83414]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:41:19.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:19 smithi115 ceph-mon[83414]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:41:19.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.685+0000 7f8258f15700 1 -- 172.21.15.5:0/372146284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f825404c710 con 0x7f82540fcfa0 2024-04-16T14:41:19.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.685+0000 7f8242ffd700 1 -- 172.21.15.5:0/372146284 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1897 (secure 0 0 0) 0x7f824805a440 con 0x7f82540fcfa0 2024-04-16T14:41:19.684 INFO:teuthology.orchestra.run.smithi005.stdout:e22 2024-04-16T14:41:19.684 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:41:19.684 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:41:19.684 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2024-04-16T14:41:19.684 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:41:19.684 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2024-04-16T14:41:19.684 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2024-04-16T14:41:19.684 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 22 2024-04-16T14:41:19.684 INFO:teuthology.orchestra.run.smithi005.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-16T14:41:19.684 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-16T14:32:45.270024+0000 2024-04-16T14:41:19.684 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-04-16T14:39:57.598894+0000 2024-04-16T14:41:19.684 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2024-04-16T14:41:19.684 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2024-04-16T14:41:19.685 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 60 2024-04-16T14:41:19.685 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2024-04-16T14:41:19.685 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2024-04-16T14:41:19.685 INFO:teuthology.orchestra.run.smithi005.stdout:max_xattr_size 65536 2024-04-16T14:41:19.685 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2024-04-16T14:41:19.685 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2024-04-16T14:41:19.685 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 47 2024-04-16T14:41:19.685 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:41:19.685 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 2 2024-04-16T14:41:19.685 INFO:teuthology.orchestra.run.smithi005.stdout:in 0,1 2024-04-16T14:41:19.685 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=14484,1=24269} 2024-04-16T14:41:19.685 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2024-04-16T14:41:19.685 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2024-04-16T14:41:19.685 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 2024-04-16T14:41:19.686 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3] 2024-04-16T14:41:19.686 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2024-04-16T14:41:19.686 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2024-04-16T14:41:19.686 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2024-04-16T14:41:19.686 INFO:teuthology.orchestra.run.smithi005.stdout:bal_rank_mask -1 2024-04-16T14:41:19.686 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 1 2024-04-16T14:41:19.686 INFO:teuthology.orchestra.run.smithi005.stdout:qdb_cluster leader: 14484 members: 24269,14484 2024-04-16T14:41:19.686 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.wofqlz{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:41:19.686 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.byfytg{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.115:6824/1662994117,v1:172.21.15.115:6825/1662994117] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:41:19.686 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:41:19.686 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:41:19.686 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2024-04-16T14:41:19.686 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:41:19.686 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.vzoqdl{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.5:6826/187766809,v1:172.21.15.5:6827/187766809] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:41:19.687 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.trkaqh{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:41:19.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.687+0000 7f8258f15700 1 -- 172.21.15.5:0/372146284 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f823c06e140 msgr2=0x7f823c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:19.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.687+0000 7f8258f15700 1 --2- 172.21.15.5:0/372146284 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f823c06e140 0x7f823c0705f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8244000c00 tx=0x7f8244009e30 comp rx=0 tx=0).stop 2024-04-16T14:41:19.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.687+0000 7f8258f15700 1 -- 172.21.15.5:0/372146284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82540fcfa0 msgr2=0x7f825410e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:19.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.687+0000 7f8258f15700 1 --2- 172.21.15.5:0/372146284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82540fcfa0 0x7f825410e190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f824800b790 tx=0x7f8248009250 comp rx=0 tx=0).stop 2024-04-16T14:41:19.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.687+0000 7f8258f15700 1 -- 172.21.15.5:0/372146284 shutdown_connections 2024-04-16T14:41:19.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.687+0000 7f8258f15700 1 --2- 172.21.15.5:0/372146284 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f823c06e140 0x7f823c0705f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:19.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.687+0000 7f8258f15700 1 --2- 172.21.15.5:0/372146284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f82540fbcf0 0x7f825410dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:19.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.687+0000 7f8258f15700 1 --2- 172.21.15.5:0/372146284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f82540fcfa0 0x7f825410e190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:19.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.687+0000 7f8258f15700 1 -- 172.21.15.5:0/372146284 >> 172.21.15.5:0/372146284 conn(0x7f82540f7450 msgr2=0x7f8254066aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:19.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.687+0000 7f8258f15700 1 -- 172.21.15.5:0/372146284 shutdown_connections 2024-04-16T14:41:19.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.687+0000 7f8258f15700 1 -- 172.21.15.5:0/372146284 wait complete. 2024-04-16T14:41:19.688 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 22 2024-04-16T14:41:19.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.791+0000 7f81df3b1700 1 -- 172.21.15.5:0/3931465509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d80fbcf0 msgr2=0x7f81d80fc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:19.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.791+0000 7f81df3b1700 1 --2- 172.21.15.5:0/3931465509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d80fbcf0 0x7f81d80fc100 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f81d4004940 tx=0x7f81d4009e30 comp rx=0 tx=0).stop 2024-04-16T14:41:19.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.791+0000 7f81df3b1700 1 -- 172.21.15.5:0/3931465509 shutdown_connections 2024-04-16T14:41:19.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.791+0000 7f81df3b1700 1 --2- 172.21.15.5:0/3931465509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81d80fcfa0 0x7f81d80fd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:19.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.791+0000 7f81df3b1700 1 --2- 172.21.15.5:0/3931465509 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d80fbcf0 0x7f81d80fc100 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:19.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.791+0000 7f81df3b1700 1 -- 172.21.15.5:0/3931465509 >> 172.21.15.5:0/3931465509 conn(0x7f81d80f7450 msgr2=0x7f81d80f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:19.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.792+0000 7f81df3b1700 1 -- 172.21.15.5:0/3931465509 shutdown_connections 2024-04-16T14:41:19.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.792+0000 7f81df3b1700 1 -- 172.21.15.5:0/3931465509 wait complete. 2024-04-16T14:41:19.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.792+0000 7f81df3b1700 1 Processor -- start 2024-04-16T14:41:19.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.792+0000 7f81df3b1700 1 -- start start 2024-04-16T14:41:19.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.792+0000 7f81df3b1700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81d80fbcf0 0x7f81d810dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:19.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.792+0000 7f81df3b1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d80fcfa0 0x7f81d810e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:19.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.792+0000 7f81df3b1700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d810e860 con 0x7f81d80fcfa0 2024-04-16T14:41:19.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.792+0000 7f81df3b1700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d8113200 con 0x7f81d80fbcf0 2024-04-16T14:41:19.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.792+0000 7f81dc94c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d80fcfa0 0x7f81d810e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:19.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.792+0000 7f81dc94c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d80fcfa0 0x7f81d810e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47664/0 (socket says 172.21.15.5:47664) 2024-04-16T14:41:19.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.792+0000 7f81dc94c700 1 -- 172.21.15.5:0/3444958945 learned_addr learned my addr 172.21.15.5:0/3444958945 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:41:19.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.793+0000 7f81dd14d700 1 --2- 172.21.15.5:0/3444958945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81d80fbcf0 0x7f81d810dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:19.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.793+0000 7f81dc94c700 1 -- 172.21.15.5:0/3444958945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81d80fbcf0 msgr2=0x7f81d810dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:19.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.793+0000 7f81dc94c700 1 --2- 172.21.15.5:0/3444958945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81d80fbcf0 0x7f81d810dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:19.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.793+0000 7f81dc94c700 1 -- 172.21.15.5:0/3444958945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d4005040 con 0x7f81d80fcfa0 2024-04-16T14:41:19.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.793+0000 7f81dc94c700 1 --2- 172.21.15.5:0/3444958945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d80fcfa0 0x7f81d810e1e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f81c800c830 tx=0x7f81c8004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:19.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.793+0000 7f81cdffb700 1 -- 172.21.15.5:0/3444958945 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81c800a760 con 0x7f81d80fcfa0 2024-04-16T14:41:19.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.793+0000 7f81df3b1700 1 -- 172.21.15.5:0/3444958945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d8113400 con 0x7f81d80fcfa0 2024-04-16T14:41:19.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.793+0000 7f81cdffb700 1 -- 172.21.15.5:0/3444958945 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f81c800ad90 con 0x7f81d80fcfa0 2024-04-16T14:41:19.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.793+0000 7f81cdffb700 1 -- 172.21.15.5:0/3444958945 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81c80113a0 con 0x7f81d80fcfa0 2024-04-16T14:41:19.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.793+0000 7f81df3b1700 1 -- 172.21.15.5:0/3444958945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d8113970 con 0x7f81d80fcfa0 2024-04-16T14:41:19.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.794+0000 7f81df3b1700 1 -- 172.21.15.5:0/3444958945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d804c710 con 0x7f81d80fcfa0 2024-04-16T14:41:19.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.795+0000 7f81cdffb700 1 -- 172.21.15.5:0/3444958945 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f81c8012400 con 0x7f81d80fcfa0 2024-04-16T14:41:19.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.795+0000 7f81cdffb700 1 --2- 172.21.15.5:0/3444958945 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f81c406e140 0x7f81c40705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:19.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.795+0000 7f81cdffb700 1 -- 172.21.15.5:0/3444958945 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f81c808db90 con 0x7f81d80fcfa0 2024-04-16T14:41:19.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.795+0000 7f81dd14d700 1 --2- 172.21.15.5:0/3444958945 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f81c406e140 0x7f81c40705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:19.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.796+0000 7f81dd14d700 1 --2- 172.21.15.5:0/3444958945 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f81c406e140 0x7f81c40705f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f81d400b970 tx=0x7f81d4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:19.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:19.800+0000 7f81cdffb700 1 -- 172.21.15.5:0/3444958945 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f81c8056f90 con 0x7f81d80fcfa0 2024-04-16T14:41:20.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.031+0000 7f81df3b1700 1 -- 172.21.15.5:0/3444958945 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f81d80f9070 con 0x7f81c406e140 2024-04-16T14:41:20.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.032+0000 7f81cdffb700 1 -- 172.21.15.5:0/3444958945 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f81d80f9070 con 0x7f81c406e140 2024-04-16T14:41:20.034 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:41:20.034 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91", 2024-04-16T14:41:20.034 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-04-16T14:41:20.034 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-16T14:41:20.034 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [ 2024-04-16T14:41:20.034 INFO:teuthology.orchestra.run.smithi005.stdout: "mon", 2024-04-16T14:41:20.034 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr", 2024-04-16T14:41:20.034 INFO:teuthology.orchestra.run.smithi005.stdout: "crash" 2024-04-16T14:41:20.034 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-04-16T14:41:20.035 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "11/21 daemons upgraded", 2024-04-16T14:41:20.035 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading osd daemons", 2024-04-16T14:41:20.035 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-04-16T14:41:20.035 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:41:20.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.035+0000 7f81df3b1700 1 -- 172.21.15.5:0/3444958945 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f81c406e140 msgr2=0x7f81c40705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.035+0000 7f81df3b1700 1 --2- 172.21.15.5:0/3444958945 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f81c406e140 0x7f81c40705f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f81d400b970 tx=0x7f81d4009e30 comp rx=0 tx=0).stop 2024-04-16T14:41:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.035+0000 7f81df3b1700 1 -- 172.21.15.5:0/3444958945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d80fcfa0 msgr2=0x7f81d810e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.035+0000 7f81df3b1700 1 --2- 172.21.15.5:0/3444958945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d80fcfa0 0x7f81d810e1e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f81c800c830 tx=0x7f81c8004470 comp rx=0 tx=0).stop 2024-04-16T14:41:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.035+0000 7f81df3b1700 1 -- 172.21.15.5:0/3444958945 shutdown_connections 2024-04-16T14:41:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.035+0000 7f81df3b1700 1 --2- 172.21.15.5:0/3444958945 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f81c406e140 0x7f81c40705f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.035+0000 7f81df3b1700 1 --2- 172.21.15.5:0/3444958945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81d80fbcf0 0x7f81d810dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.035+0000 7f81df3b1700 1 --2- 172.21.15.5:0/3444958945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81d80fcfa0 0x7f81d810e1e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.035+0000 7f81df3b1700 1 -- 172.21.15.5:0/3444958945 >> 172.21.15.5:0/3444958945 conn(0x7f81d80f7450 msgr2=0x7f81d80f8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.035+0000 7f81df3b1700 1 -- 172.21.15.5:0/3444958945 shutdown_connections 2024-04-16T14:41:20.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.035+0000 7f81df3b1700 1 -- 172.21.15.5:0/3444958945 wait complete. 2024-04-16T14:41:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.138+0000 7f475b1d3700 1 -- 172.21.15.5:0/60727345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47540fff80 msgr2=0x7f4754102360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.138+0000 7f475b1d3700 1 --2- 172.21.15.5:0/60727345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47540fff80 0x7f4754102360 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4740004940 tx=0x7f4740009e30 comp rx=0 tx=0).stop 2024-04-16T14:41:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.138+0000 7f475b1d3700 1 -- 172.21.15.5:0/60727345 shutdown_connections 2024-04-16T14:41:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.138+0000 7f475b1d3700 1 --2- 172.21.15.5:0/60727345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47540fff80 0x7f4754102360 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.138+0000 7f475b1d3700 1 --2- 172.21.15.5:0/60727345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4754066f00 0x7f47540ffa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.138+0000 7f475b1d3700 1 -- 172.21.15.5:0/60727345 >> 172.21.15.5:0/60727345 conn(0x7f47540f7450 msgr2=0x7f47540f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.138+0000 7f475b1d3700 1 -- 172.21.15.5:0/60727345 shutdown_connections 2024-04-16T14:41:20.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.138+0000 7f475b1d3700 1 -- 172.21.15.5:0/60727345 wait complete. 2024-04-16T14:41:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.139+0000 7f475b1d3700 1 Processor -- start 2024-04-16T14:41:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.139+0000 7f475b1d3700 1 -- start start 2024-04-16T14:41:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.139+0000 7f475b1d3700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4754066f00 0x7f47540fd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.139+0000 7f475b1d3700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47540fff80 0x7f47540fb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.139+0000 7f475b1d3700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47540fd890 con 0x7f47540fff80 2024-04-16T14:41:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.139+0000 7f475b1d3700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47540fbe80 con 0x7f4754066f00 2024-04-16T14:41:20.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.139+0000 7f4753fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47540fff80 0x7f47540fb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.139+0000 7f4753fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47540fff80 0x7f47540fb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47696/0 (socket says 172.21.15.5:47696) 2024-04-16T14:41:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.139+0000 7f4753fff700 1 -- 172.21.15.5:0/3331052098 learned_addr learned my addr 172.21.15.5:0/3331052098 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:41:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.139+0000 7f4758f6f700 1 --2- 172.21.15.5:0/3331052098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4754066f00 0x7f47540fd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.140+0000 7f4753fff700 1 -- 172.21.15.5:0/3331052098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4754066f00 msgr2=0x7f47540fd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.140+0000 7f4753fff700 1 --2- 172.21.15.5:0/3331052098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4754066f00 0x7f47540fd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.140+0000 7f4753fff700 1 -- 172.21.15.5:0/3331052098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4740005040 con 0x7f47540fff80 2024-04-16T14:41:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.140+0000 7f4753fff700 1 --2- 172.21.15.5:0/3331052098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47540fff80 0x7f47540fb940 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f474000b970 tx=0x7f4740009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.140+0000 7f47517fa700 1 -- 172.21.15.5:0/3331052098 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f474000e040 con 0x7f47540fff80 2024-04-16T14:41:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.140+0000 7f475b1d3700 1 -- 172.21.15.5:0/3331052098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47540fc0d0 con 0x7f47540fff80 2024-04-16T14:41:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.140+0000 7f475b1d3700 1 -- 172.21.15.5:0/3331052098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47540fc690 con 0x7f47540fff80 2024-04-16T14:41:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.140+0000 7f47517fa700 1 -- 172.21.15.5:0/3331052098 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f474000bbf0 con 0x7f47540fff80 2024-04-16T14:41:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.140+0000 7f47517fa700 1 -- 172.21.15.5:0/3331052098 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f474001c630 con 0x7f47540fff80 2024-04-16T14:41:20.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.141+0000 7f475b1d3700 1 -- 172.21.15.5:0/3331052098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f475404c710 con 0x7f47540fff80 2024-04-16T14:41:20.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.142+0000 7f47517fa700 1 -- 172.21.15.5:0/3331052098 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f474000bd60 con 0x7f47540fff80 2024-04-16T14:41:20.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.142+0000 7f47517fa700 1 --2- 172.21.15.5:0/3331052098 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f474406e140 0x7f47440705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:20.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.142+0000 7f47517fa700 1 -- 172.21.15.5:0/3331052098 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f474008ed40 con 0x7f47540fff80 2024-04-16T14:41:20.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.142+0000 7f4758f6f700 1 --2- 172.21.15.5:0/3331052098 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f474406e140 0x7f47440705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:20.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.143+0000 7f4758f6f700 1 --2- 172.21.15.5:0/3331052098 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f474406e140 0x7f47440705f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4754066c40 tx=0x7f474800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:20.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.147+0000 7f47517fa700 1 -- 172.21.15.5:0/3331052098 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f474005bd10 con 0x7f47540fff80 2024-04-16T14:41:20.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.439+0000 7f475b1d3700 1 -- 172.21.15.5:0/3331052098 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f47540676c0 con 0x7f47540fff80 2024-04-16T14:41:20.438 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:20 smithi005 ceph-mon[93420]: pgmap v146: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:41:20.439 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:20 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/2444458434' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:20.439 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:20 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/372146284' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:41:20.439 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:20 smithi005 ceph-mon[93420]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:41:20.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.440+0000 7f47517fa700 1 -- 172.21.15.5:0/3331052098 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f474005b8a0 con 0x7f47540fff80 2024-04-16T14:41:20.439 INFO:teuthology.orchestra.run.smithi005.stdout:HEALTH_OK 2024-04-16T14:41:20.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.442+0000 7f475b1d3700 1 -- 172.21.15.5:0/3331052098 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f474406e140 msgr2=0x7f47440705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:20.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.442+0000 7f475b1d3700 1 --2- 172.21.15.5:0/3331052098 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f474406e140 0x7f47440705f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4754066c40 tx=0x7f474800b040 comp rx=0 tx=0).stop 2024-04-16T14:41:20.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.442+0000 7f475b1d3700 1 -- 172.21.15.5:0/3331052098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47540fff80 msgr2=0x7f47540fb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:20.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.442+0000 7f475b1d3700 1 --2- 172.21.15.5:0/3331052098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47540fff80 0x7f47540fb940 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f474000b970 tx=0x7f4740009e30 comp rx=0 tx=0).stop 2024-04-16T14:41:20.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.442+0000 7f475b1d3700 1 -- 172.21.15.5:0/3331052098 shutdown_connections 2024-04-16T14:41:20.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.442+0000 7f475b1d3700 1 --2- 172.21.15.5:0/3331052098 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f474406e140 0x7f47440705f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:20.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.442+0000 7f475b1d3700 1 --2- 172.21.15.5:0/3331052098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4754066f00 0x7f47540fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:20.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.442+0000 7f475b1d3700 1 --2- 172.21.15.5:0/3331052098 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f47540fff80 0x7f47540fb940 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:20.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.442+0000 7f475b1d3700 1 -- 172.21.15.5:0/3331052098 >> 172.21.15.5:0/3331052098 conn(0x7f47540f7450 msgr2=0x7f47540f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:20.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.442+0000 7f475b1d3700 1 -- 172.21.15.5:0/3331052098 shutdown_connections 2024-04-16T14:41:20.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:20.442+0000 7f475b1d3700 1 -- 172.21.15.5:0/3331052098 wait complete. 2024-04-16T14:41:20.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:20 smithi115 ceph-mon[83414]: pgmap v146: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:41:20.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:20 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/2444458434' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:20.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:20 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/372146284' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:41:20.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:20 smithi115 ceph-mon[83414]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:41:21.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:21 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/3331052098' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:41:21.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:21 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/3331052098' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:41:22.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:22 smithi005 ceph-mon[93420]: pgmap v147: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:41:22.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:22 smithi115 ceph-mon[83414]: pgmap v147: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:41:24.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:24 smithi115 ceph-mon[83414]: pgmap v148: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:41:24.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:24 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:24.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:24 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:41:24.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:24 smithi005 ceph-mon[93420]: pgmap v148: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:41:24.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:24.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:41:26.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:26 smithi115 ceph-mon[83414]: pgmap v149: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:41:26.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:26 smithi005 ceph-mon[93420]: pgmap v149: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:41:28.533 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:28 smithi115 ceph-mon[83414]: pgmap v150: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:41:28.534 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:28 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-16T14:41:28.534 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:28 smithi115 ceph-mon[83414]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-16T14:41:28.534 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:28 smithi115 ceph-mon[83414]: Upgrade: osd.5 is safe to restart 2024-04-16T14:41:28.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:28 smithi005 ceph-mon[93420]: pgmap v150: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:41:28.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:28 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-16T14:41:28.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:28 smithi005 ceph-mon[93420]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-16T14:41:28.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:28 smithi005 ceph-mon[93420]: Upgrade: osd.5 is safe to restart 2024-04-16T14:41:29.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:29 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:29.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:29 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:30.508 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:30 smithi115 ceph-mon[83414]: pgmap v151: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:41:30.508 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:30 smithi115 ceph-mon[83414]: Upgrade: Updating osd.5 2024-04-16T14:41:30.508 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:30 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:30.508 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:30 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-16T14:41:30.508 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:30 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:41:30.508 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:30 smithi115 ceph-mon[83414]: Deploying daemon osd.5 on smithi115 2024-04-16T14:41:30.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:30 smithi005 ceph-mon[93420]: pgmap v151: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:41:30.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:30 smithi005 ceph-mon[93420]: Upgrade: Updating osd.5 2024-04-16T14:41:30.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:30 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:30.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:30 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-16T14:41:30.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:30 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:41:30.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:30 smithi005 ceph-mon[93420]: Deploying daemon osd.5 on smithi115 2024-04-16T14:41:32.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:32 smithi115 ceph-mon[83414]: pgmap v152: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:41:32.682 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:32 smithi115 systemd[1]: Stopping Ceph osd.5 for 10609bfa-fbfd-11ee-bc90-c7b262605968... 2024-04-16T14:41:32.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:32 smithi005 ceph-mon[93420]: pgmap v152: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:41:33.181 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:32 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[56666]: 2024-04-16T14:41:32.855+0000 7f5c0510b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-16T14:41:33.182 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:32 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[56666]: 2024-04-16T14:41:32.855+0000 7f5c0510b700 -1 osd.5 75 *** Got signal Terminated *** 2024-04-16T14:41:33.182 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:32 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[56666]: 2024-04-16T14:41:32.855+0000 7f5c0510b700 -1 osd.5 75 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-16T14:41:33.641 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:33 smithi115 ceph-mon[83414]: osd.5 marked itself down and dead 2024-04-16T14:41:33.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:33 smithi005 ceph-mon[93420]: osd.5 marked itself down and dead 2024-04-16T14:41:33.931 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:33 smithi115 podman[102883]: 2024-04-16 14:41:33.72055795 +0000 UTC m=+1.121761700 container died 456fa074e45375fb4e280f8473c21cc9643952a95b72883403e18512371965f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:15b9a118425d53cc97d2f7bc08f63df1d8bfa1149df59d4de72a305b04501998, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, RELEASE=quincy-412a552) 2024-04-16T14:41:34.337 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:34 smithi115 podman[102883]: 2024-04-16 14:41:34.079782379 +0000 UTC m=+1.480986135 container cleanup 456fa074e45375fb4e280f8473c21cc9643952a95b72883403e18512371965f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:15b9a118425d53cc97d2f7bc08f63df1d8bfa1149df59d4de72a305b04501998, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=quincy-412a552, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-16T14:41:34.337 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:34 smithi115 bash[102883]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5 2024-04-16T14:41:34.681 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:34 smithi115 podman[102915]: 2024-04-16 14:41:34.339410653 +0000 UTC m=+0.622123238 container remove 456fa074e45375fb4e280f8473c21cc9643952a95b72883403e18512371965f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:15b9a118425d53cc97d2f7bc08f63df1d8bfa1149df59d4de72a305b04501998, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-412a552, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-16T14:41:34.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:34 smithi115 ceph-mon[83414]: pgmap v153: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:41:34.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:34 smithi115 ceph-mon[83414]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-16T14:41:34.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:34 smithi115 ceph-mon[83414]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-04-16T14:41:34.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:34 smithi115 ceph-mon[83414]: osdmap e76: 6 total, 5 up, 6 in 2024-04-16T14:41:34.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:34 smithi005 ceph-mon[93420]: pgmap v153: 65 pgs: 65 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:41:34.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:34 smithi005 ceph-mon[93420]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-16T14:41:34.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:34 smithi005 ceph-mon[93420]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-04-16T14:41:34.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:34 smithi005 ceph-mon[93420]: osdmap e76: 6 total, 5 up, 6 in 2024-04-16T14:41:34.940 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:34 smithi115 podman[103006]: 2024-04-16 14:41:34.593507018 +0000 UTC m=+0.017554951 image pull b1a78730e0db57f46162ae12211512856024b361a698c3ed431f6fbc73b484c3 quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 2024-04-16T14:41:34.940 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:34 smithi115 podman[103006]: 2024-04-16 14:41:34.70430523 +0000 UTC m=+0.128353199 container create 912c032f82ab776f198a0c78456742ab7e9d87d10e882aaadcebedf1cfbb43ce (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-16T14:41:34.940 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:34 smithi115 podman[103006]: 2024-04-16 14:41:34.942406447 +0000 UTC m=+0.366454371 container init 912c032f82ab776f198a0c78456742ab7e9d87d10e882aaadcebedf1cfbb43ce (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240409, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-04-16T14:41:35.231 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:34 smithi115 podman[103006]: 2024-04-16 14:41:34.946059556 +0000 UTC m=+0.370107481 container start 912c032f82ab776f198a0c78456742ab7e9d87d10e882aaadcebedf1cfbb43ce (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, ceph=True, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-04-16T14:41:35.231 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:35 smithi115 podman[103006]: 2024-04-16 14:41:35.025871768 +0000 UTC m=+0.449919694 container attach 912c032f82ab776f198a0c78456742ab7e9d87d10e882aaadcebedf1cfbb43ce (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409) 2024-04-16T14:41:35.527 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:35 smithi115 ceph-mon[83414]: osdmap e77: 6 total, 5 up, 6 in 2024-04-16T14:41:35.527 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:35 smithi115 podman[103006]: 2024-04-16 14:41:35.233919981 +0000 UTC m=+0.657967908 container died 912c032f82ab776f198a0c78456742ab7e9d87d10e882aaadcebedf1cfbb43ce (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-04-16T14:41:35.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:35 smithi005 ceph-mon[93420]: osdmap e77: 6 total, 5 up, 6 in 2024-04-16T14:41:36.181 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:35 smithi115 podman[103032]: 2024-04-16 14:41:35.829843948 +0000 UTC m=+0.590494415 container remove 912c032f82ab776f198a0c78456742ab7e9d87d10e882aaadcebedf1cfbb43ce (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.build-date=20240409, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-04-16T14:41:36.182 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:35 smithi115 systemd[1]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.5.service: Deactivated successfully. 2024-04-16T14:41:36.182 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:35 smithi115 systemd[1]: Stopped Ceph osd.5 for 10609bfa-fbfd-11ee-bc90-c7b262605968. 2024-04-16T14:41:36.182 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:35 smithi115 systemd[1]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.5.service: Consumed 57.135s CPU time. 2024-04-16T14:41:36.182 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:36 smithi115 systemd[1]: Starting Ceph osd.5 for 10609bfa-fbfd-11ee-bc90-c7b262605968... 2024-04-16T14:41:36.597 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:36 smithi115 ceph-mon[83414]: pgmap v156: 65 pgs: 3 peering, 11 stale+active+clean, 51 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:41:36.597 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:36 smithi115 ceph-mon[83414]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-04-16T14:41:36.598 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:36 smithi115 podman[103138]: 2024-04-16 14:41:36.178886343 +0000 UTC m=+0.018017406 image pull b1a78730e0db57f46162ae12211512856024b361a698c3ed431f6fbc73b484c3 quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 2024-04-16T14:41:36.598 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:36 smithi115 podman[103138]: 2024-04-16 14:41:36.280840729 +0000 UTC m=+0.119971784 container create 8d974f4b5a849e266e89385b8c4187d1a724e71f214e691b93752440bde67f9b (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5-activate, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-16T14:41:36.598 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:36 smithi115 podman[103138]: 2024-04-16 14:41:36.508378537 +0000 UTC m=+0.347509593 container init 8d974f4b5a849e266e89385b8c4187d1a724e71f214e691b93752440bde67f9b (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5-activate, io.buildah.version=1.33.5, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-16T14:41:36.598 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:36 smithi115 podman[103138]: 2024-04-16 14:41:36.511712096 +0000 UTC m=+0.350843157 container start 8d974f4b5a849e266e89385b8c4187d1a724e71f214e691b93752440bde67f9b (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-16T14:41:36.598 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:36 smithi115 podman[103138]: 2024-04-16 14:41:36.599980633 +0000 UTC m=+0.439111697 container attach 8d974f4b5a849e266e89385b8c4187d1a724e71f214e691b93752440bde67f9b (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5-activate, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-16T14:41:36.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:36 smithi005 ceph-mon[93420]: pgmap v156: 65 pgs: 3 peering, 11 stale+active+clean, 51 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:41:36.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:36 smithi005 ceph-mon[93420]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-04-16T14:41:37.285 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:36 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5-activate[103153]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-16T14:41:37.285 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:36 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5-activate[103153]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-16T14:41:37.285 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:36 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5-activate[103153]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-16T14:41:37.285 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:36 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5-activate[103153]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-16T14:41:37.285 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:36 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5-activate[103153]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-04-16T14:41:37.285 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:36 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5-activate[103153]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-16T14:41:37.285 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:36 smithi115 bash[103138]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-16T14:41:37.285 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:36 smithi115 bash[103138]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-16T14:41:37.285 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:36 smithi115 bash[103138]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-16T14:41:37.285 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:36 smithi115 bash[103138]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-16T14:41:37.286 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:36 smithi115 bash[103138]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-04-16T14:41:37.286 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:36 smithi115 bash[103138]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-16T14:41:37.286 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:36 smithi115 bash[103138]: --> ceph-volume raw activate successful for osd ID: 5 2024-04-16T14:41:37.286 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:36 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5-activate[103153]: --> ceph-volume raw activate successful for osd ID: 5 2024-04-16T14:41:37.286 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:36 smithi115 podman[103138]: 2024-04-16 14:41:36.986575403 +0000 UTC m=+0.825706459 container died 8d974f4b5a849e266e89385b8c4187d1a724e71f214e691b93752440bde67f9b (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5-activate, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_CLEAN=True, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-16T14:41:37.584 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:37 smithi115 ceph-mon[83414]: Health check failed: Degraded data redundancy: 23/354 objects degraded (6.497%), 8 pgs degraded (PG_DEGRADED) 2024-04-16T14:41:37.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:37 smithi005 ceph-mon[93420]: Health check failed: Degraded data redundancy: 23/354 objects degraded (6.497%), 8 pgs degraded (PG_DEGRADED) 2024-04-16T14:41:37.900 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:37 smithi115 podman[103288]: 2024-04-16 14:41:37.587402415 +0000 UTC m=+0.595401291 container remove 8d974f4b5a849e266e89385b8c4187d1a724e71f214e691b93752440bde67f9b (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5-activate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-16T14:41:37.900 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:37 smithi115 podman[103346]: 2024-04-16 14:41:37.79666068 +0000 UTC m=+0.111238189 container create 484bc7617d801a3f0bd3b758fdd80097f185add9c97ed384d9d6240713b4eaf0 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240409, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_CLEAN=True) 2024-04-16T14:41:37.901 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:37 smithi115 podman[103346]: 2024-04-16 14:41:37.703306832 +0000 UTC m=+0.017884323 image pull b1a78730e0db57f46162ae12211512856024b361a698c3ed431f6fbc73b484c3 quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 2024-04-16T14:41:38.181 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:37 smithi115 podman[103346]: 2024-04-16 14:41:37.99026058 +0000 UTC m=+0.304838047 container init 484bc7617d801a3f0bd3b758fdd80097f185add9c97ed384d9d6240713b4eaf0 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, GIT_BRANCH=HEAD, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5) 2024-04-16T14:41:38.181 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:37 smithi115 podman[103346]: 2024-04-16 14:41:37.993491805 +0000 UTC m=+0.308069275 container start 484bc7617d801a3f0bd3b758fdd80097f185add9c97ed384d9d6240713b4eaf0 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5) 2024-04-16T14:41:38.182 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:38 smithi115 ceph-osd[103365]: -- 172.21.15.115:0/851786854 <== mon.1 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564d98733680 con 0x564d986fd000 2024-04-16T14:41:38.182 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:38 smithi115 bash[103346]: 484bc7617d801a3f0bd3b758fdd80097f185add9c97ed384d9d6240713b4eaf0 2024-04-16T14:41:38.182 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:38 smithi115 systemd[1]: Started Ceph osd.5 for 10609bfa-fbfd-11ee-bc90-c7b262605968. 2024-04-16T14:41:38.931 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:38 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:41:38.534+0000 7f033565b7c0 -1 Falling back to public interface 2024-04-16T14:41:39.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:39 smithi115 ceph-mon[83414]: pgmap v157: 65 pgs: 8 active+undersized+degraded, 3 peering, 3 stale+active+clean, 7 active+undersized, 44 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 23/354 objects degraded (6.497%) 2024-04-16T14:41:39.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:39.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:39.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:41:39.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:39.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:41:39.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:39 smithi005 ceph-mon[93420]: pgmap v157: 65 pgs: 8 active+undersized+degraded, 3 peering, 3 stale+active+clean, 7 active+undersized, 44 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 23/354 objects degraded (6.497%) 2024-04-16T14:41:39.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:39.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:39.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:41:39.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:39.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:41:41.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:41 smithi115 ceph-mon[83414]: pgmap v158: 65 pgs: 14 active+undersized+degraded, 3 peering, 11 active+undersized, 37 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/354 objects degraded (15.254%) 2024-04-16T14:41:41.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:41 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:41.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:41 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:41.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:41 smithi005 ceph-mon[93420]: pgmap v158: 65 pgs: 14 active+undersized+degraded, 3 peering, 11 active+undersized, 37 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/354 objects degraded (15.254%) 2024-04-16T14:41:41.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:41 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:41.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:41 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:42.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:42 smithi005 ceph-mon[93420]: pgmap v159: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/354 objects degraded (15.254%) 2024-04-16T14:41:42.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:42 smithi005 ceph-mon[93420]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-04-16T14:41:42.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:42 smithi115 ceph-mon[83414]: pgmap v159: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 300 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/354 objects degraded (15.254%) 2024-04-16T14:41:42.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:42 smithi115 ceph-mon[83414]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-04-16T14:41:43.181 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:42 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:41:42.940+0000 7f033565b7c0 -1 osd.5 75 log_to_monitors true 2024-04-16T14:41:43.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:43 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:43.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:43 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:43.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:43 smithi005 ceph-mon[93420]: from='osd.5 [v2:172.21.15.115:6816/1604069545,v1:172.21.15.115:6817/1604069545]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-16T14:41:43.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:43 smithi005 ceph-mon[93420]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-16T14:41:43.545 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:43 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:43.545 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:43 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:43.545 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:43 smithi115 ceph-mon[83414]: from='osd.5 [v2:172.21.15.115:6816/1604069545,v1:172.21.15.115:6817/1604069545]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-16T14:41:43.546 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:43 smithi115 ceph-mon[83414]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-16T14:41:43.546 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:41:43 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:41:43.227+0000 7f0326ab3700 -1 osd.5 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T14:41:44.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:44 smithi115 ceph-mon[83414]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-16T14:41:44.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:44 smithi115 ceph-mon[83414]: osdmap e78: 6 total, 5 up, 6 in 2024-04-16T14:41:44.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:44 smithi115 ceph-mon[83414]: from='osd.5 [v2:172.21.15.115:6816/1604069545,v1:172.21.15.115:6817/1604069545]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-04-16T14:41:44.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:44 smithi115 ceph-mon[83414]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-04-16T14:41:44.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:44 smithi115 ceph-mon[83414]: pgmap v161: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 54/354 objects degraded (15.254%) 2024-04-16T14:41:44.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:44 smithi005 ceph-mon[93420]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-16T14:41:44.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:44 smithi005 ceph-mon[93420]: osdmap e78: 6 total, 5 up, 6 in 2024-04-16T14:41:44.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:44 smithi005 ceph-mon[93420]: from='osd.5 [v2:172.21.15.115:6816/1604069545,v1:172.21.15.115:6817/1604069545]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-04-16T14:41:44.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:44 smithi005 ceph-mon[93420]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-04-16T14:41:44.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:44 smithi005 ceph-mon[93420]: pgmap v161: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 54/354 objects degraded (15.254%) 2024-04-16T14:41:45.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:45 smithi005 ceph-mon[93420]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-16T14:41:45.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:45 smithi005 ceph-mon[93420]: osd.5 [v2:172.21.15.115:6816/1604069545,v1:172.21.15.115:6817/1604069545] boot 2024-04-16T14:41:45.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:45 smithi005 ceph-mon[93420]: osdmap e79: 6 total, 6 up, 6 in 2024-04-16T14:41:45.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:45 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-16T14:41:45.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:45 smithi005 ceph-mon[93420]: Health check update: Degraded data redundancy: 54/354 objects degraded (15.254%), 14 pgs degraded (PG_DEGRADED) 2024-04-16T14:41:45.628 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:45 smithi115 ceph-mon[83414]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-16T14:41:45.628 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:45 smithi115 ceph-mon[83414]: osd.5 [v2:172.21.15.115:6816/1604069545,v1:172.21.15.115:6817/1604069545] boot 2024-04-16T14:41:45.629 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:45 smithi115 ceph-mon[83414]: osdmap e79: 6 total, 6 up, 6 in 2024-04-16T14:41:45.629 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:45 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-16T14:41:45.629 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:45 smithi115 ceph-mon[83414]: Health check update: Degraded data redundancy: 54/354 objects degraded (15.254%), 14 pgs degraded (PG_DEGRADED) 2024-04-16T14:41:46.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: osdmap e80: 6 total, 6 up, 6 in 2024-04-16T14:41:46.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: pgmap v164: 65 pgs: 1 peering, 14 active+undersized+degraded, 13 active+undersized, 37 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 54/354 objects degraded (15.254%) 2024-04-16T14:41:46.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:46.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:46.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:41:46.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:41:46.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:46.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:41:46.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:46.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:46.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:46.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:46.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: Upgrade: Setting container_image for all osd 2024-04-16T14:41:46.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:46.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-16T14:41:46.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-16T14:41:46.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-16T14:41:46.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-16T14:41:46.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-16T14:41:46.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-16T14:41:46.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-16T14:41:46.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-16T14:41:46.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-16T14:41:46.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-16T14:41:46.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-16T14:41:46.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-16T14:41:46.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: Upgrade: Setting require_osd_release to 19 squid 2024-04-16T14:41:46.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-04-16T14:41:46.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: osdmap e80: 6 total, 6 up, 6 in 2024-04-16T14:41:46.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: pgmap v164: 65 pgs: 1 peering, 14 active+undersized+degraded, 13 active+undersized, 37 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 54/354 objects degraded (15.254%) 2024-04-16T14:41:46.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:46.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:46.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:41:46.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:41:46.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:46.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:41:46.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:46.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:46.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:46.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:46.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: Upgrade: Setting container_image for all osd 2024-04-16T14:41:46.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:46.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-16T14:41:46.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-16T14:41:46.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-16T14:41:46.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-16T14:41:46.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-16T14:41:46.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-16T14:41:46.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-16T14:41:46.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-16T14:41:46.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-16T14:41:46.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-16T14:41:46.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-16T14:41:46.726 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-16T14:41:46.727 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: Upgrade: Setting require_osd_release to 19 squid 2024-04-16T14:41:46.727 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-04-16T14:41:47.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:47 smithi115 ceph-mon[83414]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-04-16T14:41:47.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:47 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-04-16T14:41:47.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:47 smithi115 ceph-mon[83414]: osdmap e81: 6 total, 6 up, 6 in 2024-04-16T14:41:47.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:47 smithi115 ceph-mon[83414]: Upgrade: Scaling down filesystem cephfs 2024-04-16T14:41:47.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:47 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:47.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:47 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-16T14:41:47.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:47 smithi005 ceph-mon[93420]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-04-16T14:41:47.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:47 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-04-16T14:41:47.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:47 smithi005 ceph-mon[93420]: osdmap e81: 6 total, 6 up, 6 in 2024-04-16T14:41:47.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:47 smithi005 ceph-mon[93420]: Upgrade: Scaling down filesystem cephfs 2024-04-16T14:41:47.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:47 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:47.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:47 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-16T14:41:49.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:48 smithi115 ceph-mon[83414]: pgmap v166: 65 pgs: 1 peering, 10 active+undersized+degraded, 10 active+undersized, 44 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 44/354 objects degraded (12.429%) 2024-04-16T14:41:49.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:48 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-16T14:41:49.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:48 smithi115 ceph-mon[83414]: stopping daemon mds.cephfs.smithi115.byfytg 2024-04-16T14:41:49.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:48 smithi115 ceph-mon[83414]: fsmap cephfs:2 {0=cephfs.smithi005.wofqlz=up:active,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:41:49.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:48 smithi115 ceph-mon[83414]: fsmap cephfs:2 {0=cephfs.smithi005.wofqlz=up:active,1=cephfs.smithi115.byfytg=up:stopping} 2 up:standby 2024-04-16T14:41:49.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:48 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:41:49.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:48 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:41:49.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:48 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:41:49.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:48 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:49.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:48 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:41:49.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:48 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:49.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:48 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:49.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:48 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:49.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:48 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:49.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:48 smithi115 ceph-mon[83414]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-04-16T14:41:49.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:48 smithi005 ceph-mon[93420]: pgmap v166: 65 pgs: 1 peering, 10 active+undersized+degraded, 10 active+undersized, 44 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 44/354 objects degraded (12.429%) 2024-04-16T14:41:49.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:48 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-16T14:41:49.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:48 smithi005 ceph-mon[93420]: stopping daemon mds.cephfs.smithi115.byfytg 2024-04-16T14:41:49.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:48 smithi005 ceph-mon[93420]: fsmap cephfs:2 {0=cephfs.smithi005.wofqlz=up:active,1=cephfs.smithi115.byfytg=up:active} 2 up:standby 2024-04-16T14:41:49.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:48 smithi005 ceph-mon[93420]: fsmap cephfs:2 {0=cephfs.smithi005.wofqlz=up:active,1=cephfs.smithi115.byfytg=up:stopping} 2 up:standby 2024-04-16T14:41:49.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:48 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:41:49.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:48 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:41:49.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:48 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:41:49.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:48 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:49.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:48 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:41:49.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:48 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:49.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:48 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:49.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:48 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:49.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:48 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:49.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:48 smithi005 ceph-mon[93420]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-04-16T14:41:50.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:49 smithi115 ceph-mon[83414]: Health check update: Degraded data redundancy: 44/354 objects degraded (12.429%), 10 pgs degraded (PG_DEGRADED) 2024-04-16T14:41:50.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:49 smithi005 ceph-mon[93420]: Health check update: Degraded data redundancy: 44/354 objects degraded (12.429%), 10 pgs degraded (PG_DEGRADED) 2024-04-16T14:41:50.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.560+0000 7f5902fc9700 1 -- 172.21.15.5:0/4131963336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58fc0fdff0 msgr2=0x7f58fc0fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:50.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.560+0000 7f5902fc9700 1 --2- 172.21.15.5:0/4131963336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58fc0fdff0 0x7f58fc0fe460 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f58e8004940 tx=0x7f58e8009e30 comp rx=0 tx=0).stop 2024-04-16T14:41:50.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.560+0000 7f5902fc9700 1 -- 172.21.15.5:0/4131963336 shutdown_connections 2024-04-16T14:41:50.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.560+0000 7f5902fc9700 1 --2- 172.21.15.5:0/4131963336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58fc0fdff0 0x7f58fc0fe460 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:50.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.560+0000 7f5902fc9700 1 --2- 172.21.15.5:0/4131963336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58fc0fce80 0x7f58fc0fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:50.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.560+0000 7f5902fc9700 1 -- 172.21.15.5:0/4131963336 >> 172.21.15.5:0/4131963336 conn(0x7f58fc0f8580 msgr2=0x7f58fc0fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:50.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.560+0000 7f5902fc9700 1 -- 172.21.15.5:0/4131963336 shutdown_connections 2024-04-16T14:41:50.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.560+0000 7f5902fc9700 1 -- 172.21.15.5:0/4131963336 wait complete. 2024-04-16T14:41:50.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.561+0000 7f5902fc9700 1 Processor -- start 2024-04-16T14:41:50.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.561+0000 7f5902fc9700 1 -- start start 2024-04-16T14:41:50.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.561+0000 7f5902fc9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58fc0fce80 0x7f58fc10d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:50.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.561+0000 7f5902fc9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58fc0fdff0 0x7f58fc10de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:50.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.561+0000 7f5902fc9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc10e4f0 con 0x7f58fc0fdff0 2024-04-16T14:41:50.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.561+0000 7f5902fc9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc112e90 con 0x7f58fc0fce80 2024-04-16T14:41:50.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.561+0000 7f58fbfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58fc0fdff0 0x7f58fc10de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:50.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.562+0000 7f58fbfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58fc0fdff0 0x7f58fc10de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32768/0 (socket says 172.21.15.5:32768) 2024-04-16T14:41:50.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.562+0000 7f58fbfff700 1 -- 172.21.15.5:0/992705462 learned_addr learned my addr 172.21.15.5:0/992705462 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:41:50.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.562+0000 7f5900d65700 1 --2- 172.21.15.5:0/992705462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58fc0fce80 0x7f58fc10d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:50.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.562+0000 7f58fbfff700 1 -- 172.21.15.5:0/992705462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58fc0fce80 msgr2=0x7f58fc10d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:50.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.562+0000 7f58fbfff700 1 --2- 172.21.15.5:0/992705462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58fc0fce80 0x7f58fc10d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:50.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.562+0000 7f58fbfff700 1 -- 172.21.15.5:0/992705462 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e8005040 con 0x7f58fc0fdff0 2024-04-16T14:41:50.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.562+0000 7f58fbfff700 1 --2- 172.21.15.5:0/992705462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58fc0fdff0 0x7f58fc10de60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009150 tx=0x7f58e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:50.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.562+0000 7f58f97fa700 1 -- 172.21.15.5:0/992705462 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58e800e040 con 0x7f58fc0fdff0 2024-04-16T14:41:50.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.562+0000 7f5902fc9700 1 -- 172.21.15.5:0/992705462 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58fc113090 con 0x7f58fc0fdff0 2024-04-16T14:41:50.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.562+0000 7f58f97fa700 1 -- 172.21.15.5:0/992705462 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f58e800bbf0 con 0x7f58fc0fdff0 2024-04-16T14:41:50.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.562+0000 7f58f97fa700 1 -- 172.21.15.5:0/992705462 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58e801c630 con 0x7f58fc0fdff0 2024-04-16T14:41:50.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.562+0000 7f5902fc9700 1 -- 172.21.15.5:0/992705462 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58fc113600 con 0x7f58fc0fdff0 2024-04-16T14:41:50.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.563+0000 7f5902fc9700 1 -- 172.21.15.5:0/992705462 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58fc04c710 con 0x7f58fc0fdff0 2024-04-16T14:41:50.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.564+0000 7f58f97fa700 1 -- 172.21.15.5:0/992705462 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f58e800bd60 con 0x7f58fc0fdff0 2024-04-16T14:41:50.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.564+0000 7f58f97fa700 1 --2- 172.21.15.5:0/992705462 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f58ec06e140 0x7f58ec0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:50.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.564+0000 7f58f97fa700 1 -- 172.21.15.5:0/992705462 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f58e808efe0 con 0x7f58fc0fdff0 2024-04-16T14:41:50.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.564+0000 7f5900d65700 1 --2- 172.21.15.5:0/992705462 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f58ec06e140 0x7f58ec0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:50.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.565+0000 7f5900d65700 1 --2- 172.21.15.5:0/992705462 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f58ec06e140 0x7f58ec0705f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f58f0006fd0 tx=0x7f58f0008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:50.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.569+0000 7f58f97fa700 1 -- 172.21.15.5:0/992705462 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f58e80c3740 con 0x7f58fc0fdff0 2024-04-16T14:41:50.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.796+0000 7f5902fc9700 1 -- 172.21.15.5:0/992705462 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f58fc102290 con 0x7f58ec06e140 2024-04-16T14:41:50.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.798+0000 7f58f97fa700 1 -- 172.21.15.5:0/992705462 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f58fc102290 con 0x7f58ec06e140 2024-04-16T14:41:50.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.800+0000 7f5902fc9700 1 -- 172.21.15.5:0/992705462 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f58ec06e140 msgr2=0x7f58ec0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:50.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.800+0000 7f5902fc9700 1 --2- 172.21.15.5:0/992705462 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f58ec06e140 0x7f58ec0705f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f58f0006fd0 tx=0x7f58f0008040 comp rx=0 tx=0).stop 2024-04-16T14:41:50.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.800+0000 7f5902fc9700 1 -- 172.21.15.5:0/992705462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58fc0fdff0 msgr2=0x7f58fc10de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:50.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.800+0000 7f5902fc9700 1 --2- 172.21.15.5:0/992705462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58fc0fdff0 0x7f58fc10de60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009150 tx=0x7f58e8009e30 comp rx=0 tx=0).stop 2024-04-16T14:41:50.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.800+0000 7f5902fc9700 1 -- 172.21.15.5:0/992705462 shutdown_connections 2024-04-16T14:41:50.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.800+0000 7f5902fc9700 1 --2- 172.21.15.5:0/992705462 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f58ec06e140 0x7f58ec0705f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:50.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.800+0000 7f5902fc9700 1 --2- 172.21.15.5:0/992705462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58fc0fce80 0x7f58fc10d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:50.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.800+0000 7f5902fc9700 1 --2- 172.21.15.5:0/992705462 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f58fc0fdff0 0x7f58fc10de60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:50.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.800+0000 7f5902fc9700 1 -- 172.21.15.5:0/992705462 >> 172.21.15.5:0/992705462 conn(0x7f58fc0f8580 msgr2=0x7f58fc0f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:50.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.800+0000 7f5902fc9700 1 -- 172.21.15.5:0/992705462 shutdown_connections 2024-04-16T14:41:50.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.800+0000 7f5902fc9700 1 -- 172.21.15.5:0/992705462 wait complete. 2024-04-16T14:41:50.809 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-04-16T14:41:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.906+0000 7fece9aa7700 1 -- 172.21.15.5:0/3405729558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fece40fce40 msgr2=0x7fece40fd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.906+0000 7fece9aa7700 1 --2- 172.21.15.5:0/3405729558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fece40fce40 0x7fece40fd250 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fecd4004940 tx=0x7fecd4009e30 comp rx=0 tx=0).stop 2024-04-16T14:41:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.906+0000 7fece9aa7700 1 -- 172.21.15.5:0/3405729558 shutdown_connections 2024-04-16T14:41:50.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.906+0000 7fece9aa7700 1 --2- 172.21.15.5:0/3405729558 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fece40fe040 0x7fece40fe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.906+0000 7fece9aa7700 1 --2- 172.21.15.5:0/3405729558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fece40fce40 0x7fece40fd250 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.906+0000 7fece9aa7700 1 -- 172.21.15.5:0/3405729558 >> 172.21.15.5:0/3405729558 conn(0x7fece40f8570 msgr2=0x7fece40fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.906+0000 7fece9aa7700 1 -- 172.21.15.5:0/3405729558 shutdown_connections 2024-04-16T14:41:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.906+0000 7fece9aa7700 1 -- 172.21.15.5:0/3405729558 wait complete. 2024-04-16T14:41:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.906+0000 7fece9aa7700 1 Processor -- start 2024-04-16T14:41:50.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.907+0000 7fece9aa7700 1 -- start start 2024-04-16T14:41:50.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.907+0000 7fece9aa7700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fece40fce40 0x7fece410d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:50.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.907+0000 7fece9aa7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fece40fe040 0x7fece410df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:50.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.907+0000 7fece9aa7700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece410e510 con 0x7fece40fe040 2024-04-16T14:41:50.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.907+0000 7fece9aa7700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece410ed60 con 0x7fece40fce40 2024-04-16T14:41:50.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.907+0000 7fece2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fece40fe040 0x7fece410df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.907+0000 7fece2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fece40fe040 0x7fece410df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32788/0 (socket says 172.21.15.5:32788) 2024-04-16T14:41:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.907+0000 7fece2ffd700 1 -- 172.21.15.5:0/914151323 learned_addr learned my addr 172.21.15.5:0/914151323 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:41:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.907+0000 7fece37fe700 1 --2- 172.21.15.5:0/914151323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fece40fce40 0x7fece410d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.907+0000 7fece2ffd700 1 -- 172.21.15.5:0/914151323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fece40fce40 msgr2=0x7fece410d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.907+0000 7fece2ffd700 1 --2- 172.21.15.5:0/914151323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fece40fce40 0x7fece410d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.907+0000 7fece2ffd700 1 -- 172.21.15.5:0/914151323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd4005040 con 0x7fece40fe040 2024-04-16T14:41:50.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.907+0000 7fece2ffd700 1 --2- 172.21.15.5:0/914151323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fece40fe040 0x7fece410df10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fecd800eb40 tx=0x7fecd800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.908+0000 7feccbfff700 1 -- 172.21.15.5:0/914151323 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecd8007cc0 con 0x7fece40fe040 2024-04-16T14:41:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.908+0000 7feccbfff700 1 -- 172.21.15.5:0/914151323 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fecd800f040 con 0x7fece40fe040 2024-04-16T14:41:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.908+0000 7fece9aa7700 1 -- 172.21.15.5:0/914151323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece410efe0 con 0x7fece40fe040 2024-04-16T14:41:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.908+0000 7feccbfff700 1 -- 172.21.15.5:0/914151323 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecd800ca10 con 0x7fece40fe040 2024-04-16T14:41:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.908+0000 7fece9aa7700 1 -- 172.21.15.5:0/914151323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece410f520 con 0x7fece40fe040 2024-04-16T14:41:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.909+0000 7fece9aa7700 1 -- 172.21.15.5:0/914151323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece405f5f0 con 0x7fece40fe040 2024-04-16T14:41:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.909+0000 7feccbfff700 1 -- 172.21.15.5:0/914151323 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fecd800cc80 con 0x7fece40fe040 2024-04-16T14:41:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.910+0000 7feccbfff700 1 --2- 172.21.15.5:0/914151323 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7feccc06e150 0x7feccc070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.910+0000 7feccbfff700 1 -- 172.21.15.5:0/914151323 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fecd808d6f0 con 0x7fece40fe040 2024-04-16T14:41:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.910+0000 7fece37fe700 1 --2- 172.21.15.5:0/914151323 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7feccc06e150 0x7feccc070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.910+0000 7fece37fe700 1 --2- 172.21.15.5:0/914151323 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7feccc06e150 0x7feccc070600 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fecd4013870 tx=0x7fecd4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:50.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:50.914+0000 7feccbfff700 1 -- 172.21.15.5:0/914151323 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fecd805a650 con 0x7fece40fe040 2024-04-16T14:41:51.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.146+0000 7fece9aa7700 1 -- 172.21.15.5:0/914151323 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fece410f850 con 0x7feccc06e150 2024-04-16T14:41:51.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.147+0000 7feccbfff700 1 -- 172.21.15.5:0/914151323 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fece410f850 con 0x7feccc06e150 2024-04-16T14:41:51.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.150+0000 7fece9aa7700 1 -- 172.21.15.5:0/914151323 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7feccc06e150 msgr2=0x7feccc070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:51.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.150+0000 7fece9aa7700 1 --2- 172.21.15.5:0/914151323 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7feccc06e150 0x7feccc070600 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fecd4013870 tx=0x7fecd4009e30 comp rx=0 tx=0).stop 2024-04-16T14:41:51.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.150+0000 7fece9aa7700 1 -- 172.21.15.5:0/914151323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fece40fe040 msgr2=0x7fece410df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:51.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.150+0000 7fece9aa7700 1 --2- 172.21.15.5:0/914151323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fece40fe040 0x7fece410df10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fecd800eb40 tx=0x7fecd800b040 comp rx=0 tx=0).stop 2024-04-16T14:41:51.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.150+0000 7fece9aa7700 1 -- 172.21.15.5:0/914151323 shutdown_connections 2024-04-16T14:41:51.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.150+0000 7fece9aa7700 1 --2- 172.21.15.5:0/914151323 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7feccc06e150 0x7feccc070600 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:51.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.150+0000 7fece9aa7700 1 --2- 172.21.15.5:0/914151323 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fece40fce40 0x7fece410d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:51.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.150+0000 7fece9aa7700 1 --2- 172.21.15.5:0/914151323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fece40fe040 0x7fece410df10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:51.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.150+0000 7fece9aa7700 1 -- 172.21.15.5:0/914151323 >> 172.21.15.5:0/914151323 conn(0x7fece40f8570 msgr2=0x7fece40f9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:51.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.150+0000 7fece9aa7700 1 -- 172.21.15.5:0/914151323 shutdown_connections 2024-04-16T14:41:51.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.150+0000 7fece9aa7700 1 -- 172.21.15.5:0/914151323 wait complete. 2024-04-16T14:41:51.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:50 smithi115 ceph-mon[83414]: pgmap v167: 65 pgs: 1 peering, 64 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:41:51.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:50 smithi115 ceph-mon[83414]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 44/354 objects degraded (12.429%), 10 pgs degraded) 2024-04-16T14:41:51.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:50 smithi115 ceph-mon[83414]: Cluster is now healthy 2024-04-16T14:41:51.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:50 smithi005 ceph-mon[93420]: pgmap v167: 65 pgs: 1 peering, 64 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:41:51.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:50 smithi005 ceph-mon[93420]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 44/354 objects degraded (12.429%), 10 pgs degraded) 2024-04-16T14:41:51.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:50 smithi005 ceph-mon[93420]: Cluster is now healthy 2024-04-16T14:41:51.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.254+0000 7f2fdb2d9700 1 -- 172.21.15.5:0/1057172795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fd40fbd00 msgr2=0x7f2fd40fc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:51.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.254+0000 7f2fdb2d9700 1 --2- 172.21.15.5:0/1057172795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fd40fbd00 0x7f2fd40fc110 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0004940 tx=0x7f2fd0009e30 comp rx=0 tx=0).stop 2024-04-16T14:41:51.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.254+0000 7f2fdb2d9700 1 -- 172.21.15.5:0/1057172795 shutdown_connections 2024-04-16T14:41:51.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.254+0000 7f2fdb2d9700 1 --2- 172.21.15.5:0/1057172795 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fd40fcfb0 0x7f2fd40fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:51.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.254+0000 7f2fdb2d9700 1 --2- 172.21.15.5:0/1057172795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fd40fbd00 0x7f2fd40fc110 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:51.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.254+0000 7f2fdb2d9700 1 -- 172.21.15.5:0/1057172795 >> 172.21.15.5:0/1057172795 conn(0x7f2fd40f7480 msgr2=0x7f2fd40f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:51.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.254+0000 7f2fdb2d9700 1 -- 172.21.15.5:0/1057172795 shutdown_connections 2024-04-16T14:41:51.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.254+0000 7f2fdb2d9700 1 -- 172.21.15.5:0/1057172795 wait complete. 2024-04-16T14:41:51.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.254+0000 7f2fdb2d9700 1 Processor -- start 2024-04-16T14:41:51.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.254+0000 7f2fdb2d9700 1 -- start start 2024-04-16T14:41:51.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.254+0000 7f2fdb2d9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fd40fbd00 0x7f2fd4066d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.255+0000 7f2fdb2d9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fd40fcfb0 0x7f2fd41127c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.255+0000 7f2fdb2d9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd4112d00 con 0x7f2fd40fbd00 2024-04-16T14:41:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.255+0000 7f2fdb2d9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd4112e40 con 0x7f2fd40fcfb0 2024-04-16T14:41:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.255+0000 7f2fd9075700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fd40fbd00 0x7f2fd4066d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.255+0000 7f2fd9075700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fd40fbd00 0x7f2fd4066d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32808/0 (socket says 172.21.15.5:32808) 2024-04-16T14:41:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.255+0000 7f2fd9075700 1 -- 172.21.15.5:0/3347775889 learned_addr learned my addr 172.21.15.5:0/3347775889 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:41:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.255+0000 7f2fd9075700 1 -- 172.21.15.5:0/3347775889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fd40fcfb0 msgr2=0x7f2fd41127c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.255+0000 7f2fd9075700 1 --2- 172.21.15.5:0/3347775889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fd40fcfb0 0x7f2fd41127c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.255+0000 7f2fd9075700 1 -- 172.21.15.5:0/3347775889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd0005040 con 0x7f2fd40fbd00 2024-04-16T14:41:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.255+0000 7f2fd9075700 1 --2- 172.21.15.5:0/3347775889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fd40fbd00 0x7f2fd4066d00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0009fd0 tx=0x7f2fd0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.255+0000 7f2fc9ffb700 1 -- 172.21.15.5:0/3347775889 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fd000e040 con 0x7f2fd40fbd00 2024-04-16T14:41:51.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.255+0000 7f2fdb2d9700 1 -- 172.21.15.5:0/3347775889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd4113040 con 0x7f2fd40fbd00 2024-04-16T14:41:51.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.255+0000 7f2fc9ffb700 1 -- 172.21.15.5:0/3347775889 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2fd000bcc0 con 0x7f2fd40fbd00 2024-04-16T14:41:51.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.255+0000 7f2fc9ffb700 1 -- 172.21.15.5:0/3347775889 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fd001c630 con 0x7f2fd40fbd00 2024-04-16T14:41:51.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.256+0000 7f2fdb2d9700 1 -- 172.21.15.5:0/3347775889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd4113600 con 0x7f2fd40fbd00 2024-04-16T14:41:51.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.256+0000 7f2fdb2d9700 1 -- 172.21.15.5:0/3347775889 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd404c710 con 0x7f2fd40fbd00 2024-04-16T14:41:51.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.257+0000 7f2fc9ffb700 1 -- 172.21.15.5:0/3347775889 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f2fd0013980 con 0x7f2fd40fbd00 2024-04-16T14:41:51.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.257+0000 7f2fc9ffb700 1 --2- 172.21.15.5:0/3347775889 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f2fc006e140 0x7f2fc00705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:51.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.258+0000 7f2fc9ffb700 1 -- 172.21.15.5:0/3347775889 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f2fd008eec0 con 0x7f2fd40fbd00 2024-04-16T14:41:51.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.258+0000 7f2fd8874700 1 --2- 172.21.15.5:0/3347775889 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f2fc006e140 0x7f2fc00705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:51.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.258+0000 7f2fd8874700 1 --2- 172.21.15.5:0/3347775889 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f2fc006e140 0x7f2fc00705f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4004d00 tx=0x7f2fc4009ce0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:51.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.262+0000 7f2fc9ffb700 1 -- 172.21.15.5:0/3347775889 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f2fd005bcd0 con 0x7f2fd40fbd00 2024-04-16T14:41:51.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.476+0000 7f2fdb2d9700 1 -- 172.21.15.5:0/3347775889 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2fd41138e0 con 0x7f2fc006e140 2024-04-16T14:41:51.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.486+0000 7f2fc9ffb700 1 -- 172.21.15.5:0/3347775889 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f2fd41138e0 con 0x7f2fc006e140 2024-04-16T14:41:51.485 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-16T14:41:51.485 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.smithi005 smithi005 *:9093,9094 running (6m) 110s ago 14m 24.6M - 0.25.0 c8568f914cd2 f8aaa22ee70c 2024-04-16T14:41:51.485 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi005 smithi005 running (3m) 110s ago 14m 6656k - 19.0.0-2204-g36befe5d b1a78730e0db d6efa08e65e3 2024-04-16T14:41:51.485 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi115 smithi115 running (3m) 10s ago 13m 6660k - 19.0.0-2204-g36befe5d b1a78730e0db b2a2f2965e2a 2024-04-16T14:41:51.485 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.smithi005 smithi005 *:3000 running (5m) 110s ago 14m 85.9M - 9.4.7 954c08fa6188 9834229a010c 2024-04-16T14:41:51.485 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.vzoqdl smithi005 running (9m) 110s ago 9m 13.5M - 17.2.7-868-g412a5526 b04d96489b7c 84a74a406a1d 2024-04-16T14:41:51.485 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.wofqlz smithi005 running (8m) 110s ago 8m 133M - 17.2.7-868-g412a5526 b04d96489b7c d0e053ab2f72 2024-04-16T14:41:51.485 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.byfytg smithi115 running (8m) 10s ago 8m 118M - 17.2.7-868-g412a5526 b04d96489b7c 595cd0892f66 2024-04-16T14:41:51.485 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.trkaqh smithi115 running (8m) 10s ago 8m 14.5M - 17.2.7-868-g412a5526 b04d96489b7c 5b60cd2ad79b 2024-04-16T14:41:51.485 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi005.ipwdkc smithi005 *:8443,9283,8765 running (5m) 110s ago 15m 501M - 19.0.0-2204-g36befe5d b1a78730e0db 451192b4fc44 2024-04-16T14:41:51.485 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi115.brjkpo smithi115 *:8443,9283,8765 running (4m) 10s ago 13m 450M - 19.0.0-2204-g36befe5d b1a78730e0db 0d75f8211942 2024-04-16T14:41:51.485 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi005 smithi005 running (4m) 110s ago 16m 45.8M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3d0c00924867 2024-04-16T14:41:51.486 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi115 smithi115 running (4m) 10s ago 13m 43.8M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3b916a4928b2 2024-04-16T14:41:51.486 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi005 smithi005 *:9100 running (6m) 110s ago 14m 16.7M - 1.5.0 0da6a335fe13 c09bba584a42 2024-04-16T14:41:51.486 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi115 smithi115 *:9100 running (5m) 10s ago 13m 16.7M - 1.5.0 0da6a335fe13 78cc9cc150c0 2024-04-16T14:41:51.486 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (3m) 110s ago 12m 100M 1559M 19.0.0-2204-g36befe5d b1a78730e0db 91d9246d45e0 2024-04-16T14:41:51.486 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (2m) 110s ago 12m 100M 1559M 19.0.0-2204-g36befe5d b1a78730e0db d930ce515e3e 2024-04-16T14:41:51.486 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (116s) 110s ago 11m 12.7M 1559M 19.0.0-2204-g36befe5d b1a78730e0db fdc5fe68ac57 2024-04-16T14:41:51.486 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi115 running (80s) 10s ago 11m 104M 2581M 19.0.0-2204-g36befe5d b1a78730e0db 808ebb96c862 2024-04-16T14:41:51.486 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi115 running (47s) 10s ago 10m 95.0M 2581M 19.0.0-2204-g36befe5d b1a78730e0db 74d7d2ac5a6a 2024-04-16T14:41:51.486 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi115 running (13s) 10s ago 10m 11.5M 2581M 19.0.0-2204-g36befe5d b1a78730e0db 484bc7617d80 2024-04-16T14:41:51.486 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.smithi005 smithi005 *:9095 running (5m) 110s ago 13m 58.9M - 2.43.0 a07b618ecd1d dc784e58817c 2024-04-16T14:41:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.488+0000 7f2fdb2d9700 1 -- 172.21.15.5:0/3347775889 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f2fc006e140 msgr2=0x7f2fc00705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.488+0000 7f2fdb2d9700 1 --2- 172.21.15.5:0/3347775889 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f2fc006e140 0x7f2fc00705f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4004d00 tx=0x7f2fc4009ce0 comp rx=0 tx=0).stop 2024-04-16T14:41:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.488+0000 7f2fdb2d9700 1 -- 172.21.15.5:0/3347775889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fd40fbd00 msgr2=0x7f2fd4066d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.488+0000 7f2fdb2d9700 1 --2- 172.21.15.5:0/3347775889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fd40fbd00 0x7f2fd4066d00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0009fd0 tx=0x7f2fd0009e30 comp rx=0 tx=0).stop 2024-04-16T14:41:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.489+0000 7f2fdb2d9700 1 -- 172.21.15.5:0/3347775889 shutdown_connections 2024-04-16T14:41:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.489+0000 7f2fdb2d9700 1 --2- 172.21.15.5:0/3347775889 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f2fc006e140 0x7f2fc00705f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:51.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.489+0000 7f2fdb2d9700 1 --2- 172.21.15.5:0/3347775889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fd40fbd00 0x7f2fd4066d00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:51.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.489+0000 7f2fdb2d9700 1 --2- 172.21.15.5:0/3347775889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fd40fcfb0 0x7f2fd41127c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:51.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.489+0000 7f2fdb2d9700 1 -- 172.21.15.5:0/3347775889 >> 172.21.15.5:0/3347775889 conn(0x7f2fd40f7480 msgr2=0x7f2fd40f8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:51.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.489+0000 7f2fdb2d9700 1 -- 172.21.15.5:0/3347775889 shutdown_connections 2024-04-16T14:41:51.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.489+0000 7f2fdb2d9700 1 -- 172.21.15.5:0/3347775889 wait complete. 2024-04-16T14:41:51.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.590+0000 7fd84452d700 1 -- 172.21.15.5:0/2176184507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd83c0fcff0 msgr2=0x7fd83c0fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:51.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.590+0000 7fd84452d700 1 --2- 172.21.15.5:0/2176184507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd83c0fcff0 0x7fd83c0fd460 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd82c004940 tx=0x7fd82c009e30 comp rx=0 tx=0).stop 2024-04-16T14:41:51.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.591+0000 7fd84452d700 1 -- 172.21.15.5:0/2176184507 shutdown_connections 2024-04-16T14:41:51.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.591+0000 7fd84452d700 1 --2- 172.21.15.5:0/2176184507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd83c0fcff0 0x7fd83c0fd460 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:51.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.591+0000 7fd84452d700 1 --2- 172.21.15.5:0/2176184507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd83c0fbd40 0x7fd83c0fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:51.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.591+0000 7fd84452d700 1 -- 172.21.15.5:0/2176184507 >> 172.21.15.5:0/2176184507 conn(0x7fd83c0f74c0 msgr2=0x7fd83c0f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:51.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.591+0000 7fd84452d700 1 -- 172.21.15.5:0/2176184507 shutdown_connections 2024-04-16T14:41:51.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.591+0000 7fd84452d700 1 -- 172.21.15.5:0/2176184507 wait complete. 2024-04-16T14:41:51.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.591+0000 7fd84452d700 1 Processor -- start 2024-04-16T14:41:51.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.591+0000 7fd84452d700 1 -- start start 2024-04-16T14:41:51.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.591+0000 7fd84452d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd83c0fbd40 0x7fd83c110720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.591+0000 7fd84452d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd83c0fcff0 0x7fd83c112c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.591+0000 7fd84452d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c0663f0 con 0x7fd83c0fbd40 2024-04-16T14:41:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.591+0000 7fd84452d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c066530 con 0x7fd83c0fcff0 2024-04-16T14:41:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.591+0000 7fd8422c9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd83c0fbd40 0x7fd83c110720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.592+0000 7fd8422c9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd83c0fbd40 0x7fd83c110720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32822/0 (socket says 172.21.15.5:32822) 2024-04-16T14:41:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.592+0000 7fd8422c9700 1 -- 172.21.15.5:0/2793357783 learned_addr learned my addr 172.21.15.5:0/2793357783 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:41:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.592+0000 7fd841ac8700 1 --2- 172.21.15.5:0/2793357783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd83c0fcff0 0x7fd83c112c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.592+0000 7fd8422c9700 1 -- 172.21.15.5:0/2793357783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd83c0fcff0 msgr2=0x7fd83c112c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.592+0000 7fd8422c9700 1 --2- 172.21.15.5:0/2793357783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd83c0fcff0 0x7fd83c112c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.592+0000 7fd8422c9700 1 -- 172.21.15.5:0/2793357783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c005040 con 0x7fd83c0fbd40 2024-04-16T14:41:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.592+0000 7fd841ac8700 1 --2- 172.21.15.5:0/2793357783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd83c0fcff0 0x7fd83c112c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:41:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.592+0000 7fd8422c9700 1 --2- 172.21.15.5:0/2793357783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd83c0fbd40 0x7fd83c110720 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd83800b790 tx=0x7fd838009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:51.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.592+0000 7fd832ffd700 1 -- 172.21.15.5:0/2793357783 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd83800f770 con 0x7fd83c0fbd40 2024-04-16T14:41:51.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.592+0000 7fd84452d700 1 -- 172.21.15.5:0/2793357783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd83c1132d0 con 0x7fd83c0fbd40 2024-04-16T14:41:51.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.592+0000 7fd832ffd700 1 -- 172.21.15.5:0/2793357783 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd83800fda0 con 0x7fd83c0fbd40 2024-04-16T14:41:51.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.592+0000 7fd832ffd700 1 -- 172.21.15.5:0/2793357783 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd83800d310 con 0x7fd83c0fbd40 2024-04-16T14:41:51.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.592+0000 7fd84452d700 1 -- 172.21.15.5:0/2793357783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd83c113860 con 0x7fd83c0fbd40 2024-04-16T14:41:51.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.593+0000 7fd84452d700 1 -- 172.21.15.5:0/2793357783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd83c05f5f0 con 0x7fd83c0fbd40 2024-04-16T14:41:51.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.594+0000 7fd832ffd700 1 -- 172.21.15.5:0/2793357783 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fd838010420 con 0x7fd83c0fbd40 2024-04-16T14:41:51.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.594+0000 7fd832ffd700 1 --2- 172.21.15.5:0/2793357783 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fd82806e140 0x7fd8280705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:51.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.595+0000 7fd832ffd700 1 -- 172.21.15.5:0/2793357783 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fd83808db40 con 0x7fd83c0fbd40 2024-04-16T14:41:51.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.595+0000 7fd841ac8700 1 --2- 172.21.15.5:0/2793357783 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fd82806e140 0x7fd8280705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:51.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.595+0000 7fd841ac8700 1 --2- 172.21.15.5:0/2793357783 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fd82806e140 0x7fd8280705f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd82c000c00 tx=0x7fd82c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:51.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.599+0000 7fd832ffd700 1 -- 172.21.15.5:0/2793357783 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fd838056f40 con 0x7fd83c0fbd40 2024-04-16T14:41:51.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.896+0000 7fd84452d700 1 -- 172.21.15.5:0/2793357783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd83c113ae0 con 0x7fd83c0fbd40 2024-04-16T14:41:52.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.897+0000 7fd832ffd700 1 -- 172.21.15.5:0/2793357783 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7fd83805a600 con 0x7fd83c0fbd40 2024-04-16T14:41:52.030 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:41:52.030 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-04-16T14:41:52.030 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:41:52.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:41:52.030 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-04-16T14:41:52.030 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:41:52.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:41:52.030 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-04-16T14:41:52.030 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 6 2024-04-16T14:41:52.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:41:52.031 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-04-16T14:41:52.031 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 4 2024-04-16T14:41:52.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:41:52.031 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-04-16T14:41:52.031 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 4, 2024-04-16T14:41:52.031 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 10 2024-04-16T14:41:52.031 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-16T14:41:52.031 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:41:52.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.899+0000 7fd84452d700 1 -- 172.21.15.5:0/2793357783 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fd82806e140 msgr2=0x7fd8280705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.899+0000 7fd84452d700 1 --2- 172.21.15.5:0/2793357783 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fd82806e140 0x7fd8280705f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd82c000c00 tx=0x7fd82c009e30 comp rx=0 tx=0).stop 2024-04-16T14:41:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.899+0000 7fd84452d700 1 -- 172.21.15.5:0/2793357783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd83c0fbd40 msgr2=0x7fd83c110720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.899+0000 7fd84452d700 1 --2- 172.21.15.5:0/2793357783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd83c0fbd40 0x7fd83c110720 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd83800b790 tx=0x7fd838009250 comp rx=0 tx=0).stop 2024-04-16T14:41:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.899+0000 7fd84452d700 1 -- 172.21.15.5:0/2793357783 shutdown_connections 2024-04-16T14:41:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.899+0000 7fd84452d700 1 --2- 172.21.15.5:0/2793357783 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fd82806e140 0x7fd8280705f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.899+0000 7fd84452d700 1 --2- 172.21.15.5:0/2793357783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd83c0fbd40 0x7fd83c110720 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.899+0000 7fd84452d700 1 --2- 172.21.15.5:0/2793357783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd83c0fcff0 0x7fd83c112c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.899+0000 7fd84452d700 1 -- 172.21.15.5:0/2793357783 >> 172.21.15.5:0/2793357783 conn(0x7fd83c0f74c0 msgr2=0x7fd83c0f8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.899+0000 7fd84452d700 1 -- 172.21.15.5:0/2793357783 shutdown_connections 2024-04-16T14:41:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:51.899+0000 7fd84452d700 1 -- 172.21.15.5:0/2793357783 wait complete. 2024-04-16T14:41:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.003+0000 7f5442ec8700 1 -- 172.21.15.5:0/1550634607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f543c0fce80 msgr2=0x7f543c0fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.003+0000 7f5442ec8700 1 --2- 172.21.15.5:0/1550634607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f543c0fce80 0x7f543c0fd290 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5430004940 tx=0x7f5430009e30 comp rx=0 tx=0).stop 2024-04-16T14:41:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.003+0000 7f5442ec8700 1 -- 172.21.15.5:0/1550634607 shutdown_connections 2024-04-16T14:41:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.003+0000 7f5442ec8700 1 --2- 172.21.15.5:0/1550634607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f543c0fdff0 0x7f543c0fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.003+0000 7f5442ec8700 1 --2- 172.21.15.5:0/1550634607 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f543c0fce80 0x7f543c0fd290 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.003+0000 7f5442ec8700 1 -- 172.21.15.5:0/1550634607 >> 172.21.15.5:0/1550634607 conn(0x7f543c0f8580 msgr2=0x7f543c0fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.003+0000 7f5442ec8700 1 -- 172.21.15.5:0/1550634607 shutdown_connections 2024-04-16T14:41:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.003+0000 7f5442ec8700 1 -- 172.21.15.5:0/1550634607 wait complete. 2024-04-16T14:41:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.004+0000 7f5442ec8700 1 Processor -- start 2024-04-16T14:41:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.004+0000 7f5442ec8700 1 -- start start 2024-04-16T14:41:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.004+0000 7f5442ec8700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f543c0fce80 0x7f543c071c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.004+0000 7f5442ec8700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f543c0fdff0 0x7f543c070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.004+0000 7f5442ec8700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c072260 con 0x7f543c0fce80 2024-04-16T14:41:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.004+0000 7f5442ec8700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c070850 con 0x7f543c0fdff0 2024-04-16T14:41:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.004+0000 7f5440c64700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f543c0fce80 0x7f543c071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.004+0000 7f5440c64700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f543c0fce80 0x7f543c071c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32838/0 (socket says 172.21.15.5:32838) 2024-04-16T14:41:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.004+0000 7f5440c64700 1 -- 172.21.15.5:0/586156745 learned_addr learned my addr 172.21.15.5:0/586156745 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:41:52.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.004+0000 7f543bfff700 1 --2- 172.21.15.5:0/586156745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f543c0fdff0 0x7f543c070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.005+0000 7f5440c64700 1 -- 172.21.15.5:0/586156745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f543c0fdff0 msgr2=0x7f543c070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.005+0000 7f5440c64700 1 --2- 172.21.15.5:0/586156745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f543c0fdff0 0x7f543c070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.005+0000 7f5440c64700 1 -- 172.21.15.5:0/586156745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5430005040 con 0x7f543c0fce80 2024-04-16T14:41:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.005+0000 7f5440c64700 1 --2- 172.21.15.5:0/586156745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f543c0fce80 0x7f543c071c60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f543000b3b0 tx=0x7f5430009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.005+0000 7f54397fa700 1 -- 172.21.15.5:0/586156745 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f543000e040 con 0x7f543c0fce80 2024-04-16T14:41:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.005+0000 7f5442ec8700 1 -- 172.21.15.5:0/586156745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543c070aa0 con 0x7f543c0fce80 2024-04-16T14:41:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.005+0000 7f54397fa700 1 -- 172.21.15.5:0/586156745 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f543000bbf0 con 0x7f543c0fce80 2024-04-16T14:41:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.005+0000 7f54397fa700 1 -- 172.21.15.5:0/586156745 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f543001c630 con 0x7f543c0fce80 2024-04-16T14:41:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.005+0000 7f5442ec8700 1 -- 172.21.15.5:0/586156745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f543c071060 con 0x7f543c0fce80 2024-04-16T14:41:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.006+0000 7f5442ec8700 1 -- 172.21.15.5:0/586156745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f543c04c710 con 0x7f543c0fce80 2024-04-16T14:41:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.006+0000 7f54397fa700 1 -- 172.21.15.5:0/586156745 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f543000bd60 con 0x7f543c0fce80 2024-04-16T14:41:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.007+0000 7f54397fa700 1 --2- 172.21.15.5:0/586156745 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f542c06e140 0x7f542c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.007+0000 7f54397fa700 1 -- 172.21.15.5:0/586156745 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f543008e6e0 con 0x7f543c0fce80 2024-04-16T14:41:52.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.007+0000 7f543bfff700 1 --2- 172.21.15.5:0/586156745 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f542c06e140 0x7f542c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:52.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.007+0000 7f543bfff700 1 --2- 172.21.15.5:0/586156745 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f542c06e140 0x7f542c0705f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5428004f40 tx=0x7f542800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:52.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.012+0000 7f54397fa700 1 -- 172.21.15.5:0/586156745 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f543005b610 con 0x7f543c0fce80 2024-04-16T14:41:52.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:51 smithi115 ceph-mon[83414]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:41:52.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:51 smithi115 ceph-mon[83414]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:41:52.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:51 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/2793357783' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:52.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:51 smithi005 ceph-mon[93420]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:41:52.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:51 smithi005 ceph-mon[93420]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:41:52.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:51 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/2793357783' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.265+0000 7f5442ec8700 1 -- 172.21.15.5:0/586156745 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f543c115bf0 con 0x7f543c0fce80 2024-04-16T14:41:52.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.265+0000 7f54397fa700 1 -- 172.21.15.5:0/586156745 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) v1 ==== 76+0+1893 (secure 0 0 0) 0x7f543005b1a0 con 0x7f543c0fce80 2024-04-16T14:41:52.263 INFO:teuthology.orchestra.run.smithi005.stdout:e24 2024-04-16T14:41:52.264 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:41:52.264 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:41:52.264 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2024-04-16T14:41:52.264 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:41:52.264 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2024-04-16T14:41:52.264 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2024-04-16T14:41:52.264 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 24 2024-04-16T14:41:52.264 INFO:teuthology.orchestra.run.smithi005.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-16T14:41:52.264 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-16T14:32:45.270024+0000 2024-04-16T14:41:52.264 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-04-16T14:41:47.899227+0000 2024-04-16T14:41:52.264 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2024-04-16T14:41:52.264 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2024-04-16T14:41:52.264 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 60 2024-04-16T14:41:52.264 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2024-04-16T14:41:52.265 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2024-04-16T14:41:52.265 INFO:teuthology.orchestra.run.smithi005.stdout:max_xattr_size 65536 2024-04-16T14:41:52.265 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2024-04-16T14:41:52.265 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2024-04-16T14:41:52.265 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 47 2024-04-16T14:41:52.265 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:41:52.265 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 1 2024-04-16T14:41:52.265 INFO:teuthology.orchestra.run.smithi005.stdout:in 0,1 2024-04-16T14:41:52.265 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=14484,1=24269} 2024-04-16T14:41:52.265 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2024-04-16T14:41:52.265 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2024-04-16T14:41:52.265 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 2024-04-16T14:41:52.265 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3] 2024-04-16T14:41:52.265 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2024-04-16T14:41:52.266 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2024-04-16T14:41:52.266 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2024-04-16T14:41:52.266 INFO:teuthology.orchestra.run.smithi005.stdout:bal_rank_mask -1 2024-04-16T14:41:52.266 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 1 2024-04-16T14:41:52.266 INFO:teuthology.orchestra.run.smithi005.stdout:qdb_cluster leader: 14484 members: 14484 2024-04-16T14:41:52.266 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.wofqlz{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:41:52.266 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.byfytg{1:24269} state up:stopping seq 4 join_fscid=1 addr [v2:172.21.15.115:6824/1662994117,v1:172.21.15.115:6825/1662994117] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:41:52.266 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:41:52.266 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:41:52.266 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2024-04-16T14:41:52.266 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:41:52.266 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.vzoqdl{-1:14492} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.5:6826/187766809,v1:172.21.15.5:6827/187766809] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:41:52.266 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.trkaqh{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:41:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.267+0000 7f5442ec8700 1 -- 172.21.15.5:0/586156745 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f542c06e140 msgr2=0x7f542c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.267+0000 7f5442ec8700 1 --2- 172.21.15.5:0/586156745 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f542c06e140 0x7f542c0705f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5428004f40 tx=0x7f542800b040 comp rx=0 tx=0).stop 2024-04-16T14:41:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.267+0000 7f5442ec8700 1 -- 172.21.15.5:0/586156745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f543c0fce80 msgr2=0x7f543c071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.267+0000 7f5442ec8700 1 --2- 172.21.15.5:0/586156745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f543c0fce80 0x7f543c071c60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f543000b3b0 tx=0x7f5430009e30 comp rx=0 tx=0).stop 2024-04-16T14:41:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.267+0000 7f5442ec8700 1 -- 172.21.15.5:0/586156745 shutdown_connections 2024-04-16T14:41:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.267+0000 7f5442ec8700 1 --2- 172.21.15.5:0/586156745 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f542c06e140 0x7f542c0705f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.267+0000 7f5442ec8700 1 --2- 172.21.15.5:0/586156745 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f543c0fce80 0x7f543c071c60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:52.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.267+0000 7f5442ec8700 1 --2- 172.21.15.5:0/586156745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f543c0fdff0 0x7f543c070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:52.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.267+0000 7f5442ec8700 1 -- 172.21.15.5:0/586156745 >> 172.21.15.5:0/586156745 conn(0x7f543c0f8580 msgr2=0x7f543c0f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:52.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.267+0000 7f5442ec8700 1 -- 172.21.15.5:0/586156745 shutdown_connections 2024-04-16T14:41:52.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.267+0000 7f5442ec8700 1 -- 172.21.15.5:0/586156745 wait complete. 2024-04-16T14:41:52.268 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2024-04-16T14:41:52.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.372+0000 7f92df36e700 1 -- 172.21.15.5:0/3032206012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92d80fbd30 msgr2=0x7f92d80fc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:52.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.372+0000 7f92df36e700 1 --2- 172.21.15.5:0/3032206012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92d80fbd30 0x7f92d80fc140 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f92c8009ce0 tx=0x7f92c8004d10 comp rx=0 tx=0).stop 2024-04-16T14:41:52.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.372+0000 7f92df36e700 1 -- 172.21.15.5:0/3032206012 shutdown_connections 2024-04-16T14:41:52.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.372+0000 7f92df36e700 1 --2- 172.21.15.5:0/3032206012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92d80fcfe0 0x7f92d80fd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:52.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.372+0000 7f92df36e700 1 --2- 172.21.15.5:0/3032206012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92d80fbd30 0x7f92d80fc140 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:52.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.372+0000 7f92df36e700 1 -- 172.21.15.5:0/3032206012 >> 172.21.15.5:0/3032206012 conn(0x7f92d80f7490 msgr2=0x7f92d80f98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:52.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.372+0000 7f92df36e700 1 -- 172.21.15.5:0/3032206012 shutdown_connections 2024-04-16T14:41:52.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.372+0000 7f92df36e700 1 -- 172.21.15.5:0/3032206012 wait complete. 2024-04-16T14:41:52.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.372+0000 7f92df36e700 1 Processor -- start 2024-04-16T14:41:52.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.373+0000 7f92df36e700 1 -- start start 2024-04-16T14:41:52.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.373+0000 7f92df36e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92d80fbd30 0x7f92d8066ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:52.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.373+0000 7f92df36e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92d80fcfe0 0x7f92d8112b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:52.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.373+0000 7f92df36e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d81130a0 con 0x7f92d80fcfe0 2024-04-16T14:41:52.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.373+0000 7f92df36e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d81131e0 con 0x7f92d80fbd30 2024-04-16T14:41:52.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.373+0000 7f92dc909700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92d80fcfe0 0x7f92d8112b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:52.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.373+0000 7f92dc909700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92d80fcfe0 0x7f92d8112b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32864/0 (socket says 172.21.15.5:32864) 2024-04-16T14:41:52.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.373+0000 7f92dc909700 1 -- 172.21.15.5:0/745860252 learned_addr learned my addr 172.21.15.5:0/745860252 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:41:52.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.373+0000 7f92dd10a700 1 --2- 172.21.15.5:0/745860252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92d80fbd30 0x7f92d8066ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:52.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.373+0000 7f92dc909700 1 -- 172.21.15.5:0/745860252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92d80fbd30 msgr2=0x7f92d8066ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:52.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.373+0000 7f92dc909700 1 --2- 172.21.15.5:0/745860252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92d80fbd30 0x7f92d8066ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:52.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.373+0000 7f92dc909700 1 -- 172.21.15.5:0/745860252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c8009940 con 0x7f92d80fcfe0 2024-04-16T14:41:52.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.373+0000 7f92dd10a700 1 --2- 172.21.15.5:0/745860252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92d80fbd30 0x7f92d8066ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:41:52.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.373+0000 7f92dc909700 1 --2- 172.21.15.5:0/745860252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92d80fcfe0 0x7f92d8112b60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f92cc002a80 tx=0x7f92cc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:52.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.373+0000 7f92d5ffb700 1 -- 172.21.15.5:0/745860252 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92cc007cc0 con 0x7f92d80fcfe0 2024-04-16T14:41:52.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.374+0000 7f92df36e700 1 -- 172.21.15.5:0/745860252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d8113440 con 0x7f92d80fcfe0 2024-04-16T14:41:52.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.374+0000 7f92d5ffb700 1 -- 172.21.15.5:0/745860252 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f92cc00f040 con 0x7f92d80fcfe0 2024-04-16T14:41:52.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.374+0000 7f92d5ffb700 1 -- 172.21.15.5:0/745860252 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92cc0096f0 con 0x7f92d80fcfe0 2024-04-16T14:41:52.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.374+0000 7f92df36e700 1 -- 172.21.15.5:0/745860252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d8113a00 con 0x7f92d80fcfe0 2024-04-16T14:41:52.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.375+0000 7f92df36e700 1 -- 172.21.15.5:0/745860252 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d804c710 con 0x7f92d80fcfe0 2024-04-16T14:41:52.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.375+0000 7f92d5ffb700 1 -- 172.21.15.5:0/745860252 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f92cc00d690 con 0x7f92d80fcfe0 2024-04-16T14:41:52.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.375+0000 7f92d5ffb700 1 --2- 172.21.15.5:0/745860252 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f92c006e140 0x7f92c00705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:52.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.376+0000 7f92d5ffb700 1 -- 172.21.15.5:0/745860252 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f92cc08d2d0 con 0x7f92d80fcfe0 2024-04-16T14:41:52.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.376+0000 7f92dd10a700 1 --2- 172.21.15.5:0/745860252 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f92c006e140 0x7f92c00705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:52.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.376+0000 7f92dd10a700 1 --2- 172.21.15.5:0/745860252 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f92c006e140 0x7f92c00705f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f92c80095a0 tx=0x7f92c8004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:52.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.380+0000 7f92d5ffb700 1 -- 172.21.15.5:0/745860252 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f92cc05a180 con 0x7f92d80fcfe0 2024-04-16T14:41:52.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.617+0000 7f92df36e700 1 -- 172.21.15.5:0/745860252 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f92d8101280 con 0x7f92c006e140 2024-04-16T14:41:52.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.622+0000 7f92d5ffb700 1 -- 172.21.15.5:0/745860252 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f92d8101280 con 0x7f92c006e140 2024-04-16T14:41:52.620 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:41:52.620 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91", 2024-04-16T14:41:52.620 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-04-16T14:41:52.620 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-16T14:41:52.620 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [ 2024-04-16T14:41:52.621 INFO:teuthology.orchestra.run.smithi005.stdout: "mon", 2024-04-16T14:41:52.621 INFO:teuthology.orchestra.run.smithi005.stdout: "osd", 2024-04-16T14:41:52.621 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr", 2024-04-16T14:41:52.621 INFO:teuthology.orchestra.run.smithi005.stdout: "crash" 2024-04-16T14:41:52.621 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-04-16T14:41:52.621 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "12/21 daemons upgraded", 2024-04-16T14:41:52.621 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading osd daemons", 2024-04-16T14:41:52.621 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-04-16T14:41:52.621 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:41:52.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.629+0000 7f92df36e700 1 -- 172.21.15.5:0/745860252 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f92c006e140 msgr2=0x7f92c00705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:52.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.629+0000 7f92df36e700 1 --2- 172.21.15.5:0/745860252 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f92c006e140 0x7f92c00705f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f92c80095a0 tx=0x7f92c8004d10 comp rx=0 tx=0).stop 2024-04-16T14:41:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.629+0000 7f92df36e700 1 -- 172.21.15.5:0/745860252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92d80fcfe0 msgr2=0x7f92d8112b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:52.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.629+0000 7f92df36e700 1 --2- 172.21.15.5:0/745860252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92d80fcfe0 0x7f92d8112b60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f92cc002a80 tx=0x7f92cc0046b0 comp rx=0 tx=0).stop 2024-04-16T14:41:52.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.631+0000 7f92df36e700 1 -- 172.21.15.5:0/745860252 shutdown_connections 2024-04-16T14:41:52.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.631+0000 7f92df36e700 1 --2- 172.21.15.5:0/745860252 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f92c006e140 0x7f92c00705f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:52.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.631+0000 7f92df36e700 1 --2- 172.21.15.5:0/745860252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92d80fbd30 0x7f92d8066ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:52.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.631+0000 7f92df36e700 1 --2- 172.21.15.5:0/745860252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92d80fcfe0 0x7f92d8112b60 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:52.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.631+0000 7f92df36e700 1 -- 172.21.15.5:0/745860252 >> 172.21.15.5:0/745860252 conn(0x7f92d80f7490 msgr2=0x7f92d80f8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:52.633 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.635+0000 7f92df36e700 1 -- 172.21.15.5:0/745860252 shutdown_connections 2024-04-16T14:41:52.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.637+0000 7f92df36e700 1 -- 172.21.15.5:0/745860252 wait complete. 2024-04-16T14:41:52.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.769+0000 7f34921b5700 1 -- 172.21.15.5:0/2620640724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f348c0fdff0 msgr2=0x7f348c0fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:52.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.769+0000 7f34921b5700 1 --2- 172.21.15.5:0/2620640724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f348c0fdff0 0x7f348c0fe460 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3474004940 tx=0x7f3474009e30 comp rx=0 tx=0).stop 2024-04-16T14:41:52.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.769+0000 7f34921b5700 1 -- 172.21.15.5:0/2620640724 shutdown_connections 2024-04-16T14:41:52.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.769+0000 7f34921b5700 1 --2- 172.21.15.5:0/2620640724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f348c0fdff0 0x7f348c0fe460 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:52.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.769+0000 7f34921b5700 1 --2- 172.21.15.5:0/2620640724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f348c0fce80 0x7f348c0fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:52.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.769+0000 7f34921b5700 1 -- 172.21.15.5:0/2620640724 >> 172.21.15.5:0/2620640724 conn(0x7f348c0f8580 msgr2=0x7f348c0fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:52.768 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.769+0000 7f34921b5700 1 -- 172.21.15.5:0/2620640724 shutdown_connections 2024-04-16T14:41:52.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.769+0000 7f34921b5700 1 -- 172.21.15.5:0/2620640724 wait complete. 2024-04-16T14:41:52.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.770+0000 7f34921b5700 1 Processor -- start 2024-04-16T14:41:52.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.770+0000 7f34921b5700 1 -- start start 2024-04-16T14:41:52.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.770+0000 7f34921b5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f348c0fce80 0x7f348c10d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:52.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.770+0000 7f34921b5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f348c0fdff0 0x7f348c10dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:52.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.770+0000 7f34921b5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c10e3e0 con 0x7f348c0fce80 2024-04-16T14:41:52.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.770+0000 7f34921b5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c10e550 con 0x7f348c0fdff0 2024-04-16T14:41:52.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.770+0000 7f348b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f348c0fce80 0x7f348c10d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:52.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.770+0000 7f348b7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f348c0fce80 0x7f348c10d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:32890/0 (socket says 172.21.15.5:32890) 2024-04-16T14:41:52.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.770+0000 7f348b7fe700 1 -- 172.21.15.5:0/79393836 learned_addr learned my addr 172.21.15.5:0/79393836 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:41:52.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.770+0000 7f348affd700 1 --2- 172.21.15.5:0/79393836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f348c0fdff0 0x7f348c10dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:52.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.771+0000 7f348b7fe700 1 -- 172.21.15.5:0/79393836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f348c0fdff0 msgr2=0x7f348c10dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:52.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.771+0000 7f348b7fe700 1 --2- 172.21.15.5:0/79393836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f348c0fdff0 0x7f348c10dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:52.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.771+0000 7f348b7fe700 1 -- 172.21.15.5:0/79393836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3474005040 con 0x7f348c0fce80 2024-04-16T14:41:52.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.771+0000 7f348b7fe700 1 --2- 172.21.15.5:0/79393836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f348c0fce80 0x7f348c10d8a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f347c00ec90 tx=0x7f347c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:52.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.771+0000 7f3483fff700 1 -- 172.21.15.5:0/79393836 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f347c007b30 con 0x7f348c0fce80 2024-04-16T14:41:52.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.771+0000 7f34921b5700 1 -- 172.21.15.5:0/79393836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348c112fb0 con 0x7f348c0fce80 2024-04-16T14:41:52.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.771+0000 7f3483fff700 1 -- 172.21.15.5:0/79393836 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f347c00f040 con 0x7f348c0fce80 2024-04-16T14:41:52.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.771+0000 7f3483fff700 1 -- 172.21.15.5:0/79393836 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f347c00cc80 con 0x7f348c0fce80 2024-04-16T14:41:52.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.771+0000 7f34921b5700 1 -- 172.21.15.5:0/79393836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348c113460 con 0x7f348c0fce80 2024-04-16T14:41:52.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.772+0000 7f34921b5700 1 -- 172.21.15.5:0/79393836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f348c04c710 con 0x7f348c0fce80 2024-04-16T14:41:52.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.773+0000 7f3483fff700 1 -- 172.21.15.5:0/79393836 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f347c007c90 con 0x7f348c0fce80 2024-04-16T14:41:52.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.773+0000 7f3483fff700 1 --2- 172.21.15.5:0/79393836 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f347806e140 0x7f34780705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:41:52.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.773+0000 7f3483fff700 1 -- 172.21.15.5:0/79393836 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f347c08df90 con 0x7f348c0fce80 2024-04-16T14:41:52.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.773+0000 7f348affd700 1 --2- 172.21.15.5:0/79393836 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f347806e140 0x7f34780705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:41:52.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.773+0000 7f348affd700 1 --2- 172.21.15.5:0/79393836 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f347806e140 0x7f34780705f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3474009b30 tx=0x7f3474009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:41:52.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:52.778+0000 7f3483fff700 1 -- 172.21.15.5:0/79393836 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f347c05ae40 con 0x7f348c0fce80 2024-04-16T14:41:53.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:53.074+0000 7f34921b5700 1 -- 172.21.15.5:0/79393836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f348c113990 con 0x7f348c0fce80 2024-04-16T14:41:53.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:53.074+0000 7f3483fff700 1 -- 172.21.15.5:0/79393836 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f347c05a9d0 con 0x7f348c0fce80 2024-04-16T14:41:53.073 INFO:teuthology.orchestra.run.smithi005.stdout:HEALTH_OK 2024-04-16T14:41:53.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:53.076+0000 7f34921b5700 1 -- 172.21.15.5:0/79393836 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f347806e140 msgr2=0x7f34780705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:53.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:53.076+0000 7f34921b5700 1 --2- 172.21.15.5:0/79393836 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f347806e140 0x7f34780705f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3474009b30 tx=0x7f3474009e30 comp rx=0 tx=0).stop 2024-04-16T14:41:53.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:53.076+0000 7f34921b5700 1 -- 172.21.15.5:0/79393836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f348c0fce80 msgr2=0x7f348c10d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:41:53.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:53.076+0000 7f34921b5700 1 --2- 172.21.15.5:0/79393836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f348c0fce80 0x7f348c10d8a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f347c00ec90 tx=0x7f347c00b040 comp rx=0 tx=0).stop 2024-04-16T14:41:53.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:53.076+0000 7f34921b5700 1 -- 172.21.15.5:0/79393836 shutdown_connections 2024-04-16T14:41:53.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:53.076+0000 7f34921b5700 1 --2- 172.21.15.5:0/79393836 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f347806e140 0x7f34780705f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:53.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:53.076+0000 7f34921b5700 1 --2- 172.21.15.5:0/79393836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f348c0fce80 0x7f348c10d8a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:53.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:53.076+0000 7f34921b5700 1 --2- 172.21.15.5:0/79393836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f348c0fdff0 0x7f348c10dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:41:53.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:53.076+0000 7f34921b5700 1 -- 172.21.15.5:0/79393836 >> 172.21.15.5:0/79393836 conn(0x7f348c0f8580 msgr2=0x7f348c0f9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:41:53.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:53.076+0000 7f34921b5700 1 -- 172.21.15.5:0/79393836 shutdown_connections 2024-04-16T14:41:53.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:41:53.076+0000 7f34921b5700 1 -- 172.21.15.5:0/79393836 wait complete. 2024-04-16T14:41:53.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:52 smithi115 ceph-mon[83414]: pgmap v168: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:41:53.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:52 smithi115 ceph-mon[83414]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:41:53.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:52 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/586156745' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:41:53.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:52 smithi005 ceph-mon[93420]: pgmap v168: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-04-16T14:41:53.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:52 smithi005 ceph-mon[93420]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:41:53.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:52 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/586156745' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:41:54.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:53 smithi115 ceph-mon[83414]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:41:54.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:53 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/79393836' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:41:54.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:53 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:54.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:53 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:41:54.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:53 smithi005 ceph-mon[93420]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:41:54.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:53 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/79393836' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:41:54.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:53 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:54.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:53 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:41:55.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:54 smithi115 ceph-mon[83414]: pgmap v169: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 509 B/s wr, 0 op/s 2024-04-16T14:41:55.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:54 smithi005 ceph-mon[93420]: pgmap v169: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 509 B/s wr, 0 op/s 2024-04-16T14:41:57.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:56 smithi115 ceph-mon[83414]: pgmap v170: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 409 B/s wr, 0 op/s 2024-04-16T14:41:57.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:56 smithi005 ceph-mon[93420]: pgmap v170: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 409 B/s wr, 0 op/s 2024-04-16T14:41:59.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:58 smithi115 ceph-mon[83414]: pgmap v171: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 394 B/s wr, 0 op/s 2024-04-16T14:41:59.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:41:59.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:41:59.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:41:59.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:59.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:41:59.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:59.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:59.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:59.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:59.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:59.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:58 smithi005 ceph-mon[93420]: pgmap v171: 65 pgs: 65 active+clean; 300 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 394 B/s wr, 0 op/s 2024-04-16T14:41:59.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:41:59.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:41:59.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:41:59.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:41:59.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:41:59.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:59.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:59.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:59.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:41:59.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:00.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:41:59 smithi115 ceph-mon[83414]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-04-16T14:42:00.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:41:59 smithi005 ceph-mon[93420]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-04-16T14:42:01.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:00 smithi115 ceph-mon[83414]: pgmap v172: 65 pgs: 65 active+clean; 288 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 938 B/s wr, 4 op/s 2024-04-16T14:42:01.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:00 smithi005 ceph-mon[93420]: pgmap v172: 65 pgs: 65 active+clean; 288 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 938 B/s wr, 4 op/s 2024-04-16T14:42:03.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:02 smithi115 ceph-mon[83414]: pgmap v173: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 5 op/s 2024-04-16T14:42:03.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:02 smithi005 ceph-mon[93420]: pgmap v173: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 5 op/s 2024-04-16T14:42:05.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:04 smithi115 ceph-mon[83414]: pgmap v174: 65 pgs: 65 active+clean; 220 MiB data, 1012 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 7 op/s 2024-04-16T14:42:05.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:04 smithi005 ceph-mon[93420]: pgmap v174: 65 pgs: 65 active+clean; 220 MiB data, 1012 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 7 op/s 2024-04-16T14:42:07.227 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:06 smithi005 ceph-mon[93420]: pgmap v175: 65 pgs: 65 active+clean; 216 MiB data, 952 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 6 op/s 2024-04-16T14:42:07.254 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:06 smithi115 ceph-mon[83414]: pgmap v175: 65 pgs: 65 active+clean; 216 MiB data, 952 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 767 B/s wr, 6 op/s 2024-04-16T14:42:09.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:08 smithi005 ceph-mon[93420]: pgmap v176: 65 pgs: 65 active+clean; 168 MiB data, 796 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 853 B/s wr, 8 op/s 2024-04-16T14:42:09.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:08 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:42:09.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:08 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:42:09.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:08 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:42:09.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:08 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:42:09.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:08 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:09.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:08 smithi115 ceph-mon[83414]: pgmap v176: 65 pgs: 65 active+clean; 168 MiB data, 796 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 853 B/s wr, 8 op/s 2024-04-16T14:42:09.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:08 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:42:09.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:08 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:42:09.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:08 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:42:09.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:08 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:42:09.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:08 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:10.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:09 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:42:10.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:09 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:10.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:09 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:10.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:09 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:10.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:09 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:10.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:09 smithi005 ceph-mon[93420]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-04-16T14:42:10.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:09 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:42:10.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:09 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:10.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:09 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:10.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:09 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:10.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:09 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:10.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:09 smithi115 ceph-mon[83414]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-04-16T14:42:11.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:10 smithi005 ceph-mon[93420]: pgmap v177: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 8 op/s 2024-04-16T14:42:11.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:10 smithi115 ceph-mon[83414]: pgmap v177: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 8 op/s 2024-04-16T14:42:13.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:12 smithi005 ceph-mon[93420]: pgmap v178: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 511 B/s wr, 4 op/s 2024-04-16T14:42:13.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:12 smithi005 ceph-mon[93420]: daemon mds.cephfs.smithi115.byfytg finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-04-16T14:42:13.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:12 smithi115 ceph-mon[83414]: pgmap v178: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 511 B/s wr, 4 op/s 2024-04-16T14:42:13.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:12 smithi115 ceph-mon[83414]: daemon mds.cephfs.smithi115.byfytg finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-04-16T14:42:14.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:13 smithi005 ceph-mon[93420]: mds.1 [v2:172.21.15.115:6824/1662994117,v1:172.21.15.115:6825/1662994117] down:stopped 2024-04-16T14:42:14.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:13 smithi005 ceph-mon[93420]: fsmap cephfs:1 {0=cephfs.smithi005.wofqlz=up:active} 2 up:standby 2024-04-16T14:42:14.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:13 smithi115 ceph-mon[83414]: mds.1 [v2:172.21.15.115:6824/1662994117,v1:172.21.15.115:6825/1662994117] down:stopped 2024-04-16T14:42:14.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:13 smithi115 ceph-mon[83414]: fsmap cephfs:1 {0=cephfs.smithi005.wofqlz=up:active} 2 up:standby 2024-04-16T14:42:15.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:14 smithi005 ceph-mon[93420]: pgmap v179: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 2 op/s 2024-04-16T14:42:15.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:14 smithi005 ceph-mon[93420]: mds.? [v2:172.21.15.115:6824/1266846723,v1:172.21.15.115:6825/1266846723] up:boot 2024-04-16T14:42:15.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:14 smithi005 ceph-mon[93420]: fsmap cephfs:1 {0=cephfs.smithi005.wofqlz=up:active} 3 up:standby 2024-04-16T14:42:15.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:14 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.byfytg"}]: dispatch 2024-04-16T14:42:15.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:14 smithi115 ceph-mon[83414]: pgmap v179: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 2 op/s 2024-04-16T14:42:15.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:14 smithi115 ceph-mon[83414]: mds.? [v2:172.21.15.115:6824/1266846723,v1:172.21.15.115:6825/1266846723] up:boot 2024-04-16T14:42:15.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:14 smithi115 ceph-mon[83414]: fsmap cephfs:1 {0=cephfs.smithi005.wofqlz=up:active} 3 up:standby 2024-04-16T14:42:15.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:14 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.byfytg"}]: dispatch 2024-04-16T14:42:17.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:16 smithi005 ceph-mon[93420]: pgmap v180: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 1 op/s 2024-04-16T14:42:17.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:16 smithi115 ceph-mon[83414]: pgmap v180: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 1 op/s 2024-04-16T14:42:19.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:18 smithi005 ceph-mon[93420]: pgmap v181: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 1 op/s 2024-04-16T14:42:19.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:18 smithi115 ceph-mon[83414]: pgmap v181: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 1 op/s 2024-04-16T14:42:20.005 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:19 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:42:20.005 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:19 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:42:20.005 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:19 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:42:20.005 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:19 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:20.006 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:19 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:42:20.006 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:19 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:20.006 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:19 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:20.006 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:19 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:20.006 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:19 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:20.006 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:19 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi005.vzoqdl"]}]: dispatch 2024-04-16T14:42:20.007 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:19 smithi005 ceph-mon[93420]: Upgrade: It appears safe to stop mds.cephfs.smithi005.vzoqdl 2024-04-16T14:42:20.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:19 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:42:20.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:19 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:42:20.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:19 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:42:20.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:19 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:20.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:19 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:42:20.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:19 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:20.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:19 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:20.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:19 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:20.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:19 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:20.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:19 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi005.vzoqdl"]}]: dispatch 2024-04-16T14:42:20.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:19 smithi115 ceph-mon[83414]: Upgrade: It appears safe to stop mds.cephfs.smithi005.vzoqdl 2024-04-16T14:42:21.112 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:21 smithi005 ceph-mon[93420]: pgmap v182: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-16T14:42:21.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:21 smithi115 ceph-mon[83414]: pgmap v182: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-04-16T14:42:22.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:22 smithi115 ceph-mon[83414]: Upgrade: Updating mds.cephfs.smithi005.vzoqdl 2024-04-16T14:42:22.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:22 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:22.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:22 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi005.vzoqdl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-16T14:42:22.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:22 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:42:22.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:22 smithi115 ceph-mon[83414]: Deploying daemon mds.cephfs.smithi005.vzoqdl on smithi005 2024-04-16T14:42:22.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:22 smithi005 ceph-mon[93420]: Upgrade: Updating mds.cephfs.smithi005.vzoqdl 2024-04-16T14:42:22.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:22 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:22.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:22 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi005.vzoqdl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-16T14:42:22.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:22 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:42:22.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:22 smithi005 ceph-mon[93420]: Deploying daemon mds.cephfs.smithi005.vzoqdl on smithi005 2024-04-16T14:42:23.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.191+0000 7fad0d277700 1 -- 172.21.15.5:0/610132855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad08066f60 msgr2=0x7fad080ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:23.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.191+0000 7fad0d277700 1 --2- 172.21.15.5:0/610132855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad08066f60 0x7fad080ff9e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7facf8009ce0 tx=0x7facf8004d10 comp rx=0 tx=0).stop 2024-04-16T14:42:23.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.191+0000 7fad0d277700 1 -- 172.21.15.5:0/610132855 shutdown_connections 2024-04-16T14:42:23.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.191+0000 7fad0d277700 1 --2- 172.21.15.5:0/610132855 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad080fff20 0x7fad08102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:23.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.191+0000 7fad0d277700 1 --2- 172.21.15.5:0/610132855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad08066f60 0x7fad080ff9e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:23.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.191+0000 7fad0d277700 1 -- 172.21.15.5:0/610132855 >> 172.21.15.5:0/610132855 conn(0x7fad080f7450 msgr2=0x7fad080f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:23.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.191+0000 7fad0d277700 1 -- 172.21.15.5:0/610132855 shutdown_connections 2024-04-16T14:42:23.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.191+0000 7fad0d277700 1 -- 172.21.15.5:0/610132855 wait complete. 2024-04-16T14:42:23.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.192+0000 7fad0d277700 1 Processor -- start 2024-04-16T14:42:23.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.192+0000 7fad0d277700 1 -- start start 2024-04-16T14:42:23.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.192+0000 7fad0d277700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad08066f60 0x7fad0810de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:23.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.192+0000 7fad0d277700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad080fff20 0x7fad0810e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:23.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.192+0000 7fad0d277700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0810ea20 con 0x7fad080fff20 2024-04-16T14:42:23.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.192+0000 7fad0d277700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad081133c0 con 0x7fad08066f60 2024-04-16T14:42:23.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.192+0000 7fad067fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad080fff20 0x7fad0810e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:23.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.192+0000 7fad067fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad080fff20 0x7fad0810e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36098/0 (socket says 172.21.15.5:36098) 2024-04-16T14:42:23.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.192+0000 7fad067fc700 1 -- 172.21.15.5:0/1516174737 learned_addr learned my addr 172.21.15.5:0/1516174737 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:42:23.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.192+0000 7fad06ffd700 1 --2- 172.21.15.5:0/1516174737 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad08066f60 0x7fad0810de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:23.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.193+0000 7fad067fc700 1 -- 172.21.15.5:0/1516174737 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad08066f60 msgr2=0x7fad0810de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:23.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.193+0000 7fad067fc700 1 --2- 172.21.15.5:0/1516174737 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad08066f60 0x7fad0810de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:23.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.193+0000 7fad067fc700 1 -- 172.21.15.5:0/1516174737 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf8009940 con 0x7fad080fff20 2024-04-16T14:42:23.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.193+0000 7fad067fc700 1 --2- 172.21.15.5:0/1516174737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad080fff20 0x7fad0810e390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7facf000b790 tx=0x7facf0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:23.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.193+0000 7facff7fe700 1 -- 172.21.15.5:0/1516174737 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facf000f6f0 con 0x7fad080fff20 2024-04-16T14:42:23.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.193+0000 7fad0d277700 1 -- 172.21.15.5:0/1516174737 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad08113620 con 0x7fad080fff20 2024-04-16T14:42:23.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.193+0000 7facff7fe700 1 -- 172.21.15.5:0/1516174737 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7facf000fd20 con 0x7fad080fff20 2024-04-16T14:42:23.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.193+0000 7facff7fe700 1 -- 172.21.15.5:0/1516174737 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facf00103a0 con 0x7fad080fff20 2024-04-16T14:42:23.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.193+0000 7fad0d277700 1 -- 172.21.15.5:0/1516174737 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad08113b90 con 0x7fad080fff20 2024-04-16T14:42:23.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.194+0000 7fad0d277700 1 -- 172.21.15.5:0/1516174737 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0804c710 con 0x7fad080fff20 2024-04-16T14:42:23.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.194+0000 7facff7fe700 1 -- 172.21.15.5:0/1516174737 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7facf0011400 con 0x7fad080fff20 2024-04-16T14:42:23.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.195+0000 7facff7fe700 1 --2- 172.21.15.5:0/1516174737 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7facf406e140 0x7facf40705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:23.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.195+0000 7facff7fe700 1 -- 172.21.15.5:0/1516174737 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6410+0+0 (secure 0 0 0) 0x7facf008d910 con 0x7fad080fff20 2024-04-16T14:42:23.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.195+0000 7fad06ffd700 1 --2- 172.21.15.5:0/1516174737 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7facf406e140 0x7facf40705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:23.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.195+0000 7fad06ffd700 1 --2- 172.21.15.5:0/1516174737 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7facf406e140 0x7facf40705f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7facf8009470 tx=0x7facf8004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:23.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.200+0000 7facff7fe700 1 -- 172.21.15.5:0/1516174737 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7facf005a840 con 0x7fad080fff20 2024-04-16T14:42:23.275 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:23 smithi005 ceph-mon[93420]: pgmap v183: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:42:23.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:23 smithi115 ceph-mon[83414]: pgmap v183: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:42:23.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.433+0000 7fad0d277700 1 -- 172.21.15.5:0/1516174737 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fad08101b50 con 0x7facf406e140 2024-04-16T14:42:23.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.434+0000 7facff7fe700 1 -- 172.21.15.5:0/1516174737 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fad08101b50 con 0x7facf406e140 2024-04-16T14:42:23.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.436+0000 7fad0d277700 1 -- 172.21.15.5:0/1516174737 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7facf406e140 msgr2=0x7facf40705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:23.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.436+0000 7fad0d277700 1 --2- 172.21.15.5:0/1516174737 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7facf406e140 0x7facf40705f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7facf8009470 tx=0x7facf8004d10 comp rx=0 tx=0).stop 2024-04-16T14:42:23.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.436+0000 7fad0d277700 1 -- 172.21.15.5:0/1516174737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad080fff20 msgr2=0x7fad0810e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:23.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.436+0000 7fad0d277700 1 --2- 172.21.15.5:0/1516174737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad080fff20 0x7fad0810e390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7facf000b790 tx=0x7facf0009250 comp rx=0 tx=0).stop 2024-04-16T14:42:23.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.436+0000 7fad0d277700 1 -- 172.21.15.5:0/1516174737 shutdown_connections 2024-04-16T14:42:23.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.436+0000 7fad0d277700 1 --2- 172.21.15.5:0/1516174737 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7facf406e140 0x7facf40705f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:23.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.436+0000 7fad0d277700 1 --2- 172.21.15.5:0/1516174737 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fad08066f60 0x7fad0810de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:23.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.436+0000 7fad0d277700 1 --2- 172.21.15.5:0/1516174737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad080fff20 0x7fad0810e390 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:23.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.436+0000 7fad0d277700 1 -- 172.21.15.5:0/1516174737 >> 172.21.15.5:0/1516174737 conn(0x7fad080f7450 msgr2=0x7fad080f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:23.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.436+0000 7fad0d277700 1 -- 172.21.15.5:0/1516174737 shutdown_connections 2024-04-16T14:42:23.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.436+0000 7fad0d277700 1 -- 172.21.15.5:0/1516174737 wait complete. 2024-04-16T14:42:23.445 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-04-16T14:42:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.541+0000 7f0421b8d700 1 -- 172.21.15.5:0/1768049339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f041c0fff20 msgr2=0x7f041c102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.541+0000 7f0421b8d700 1 --2- 172.21.15.5:0/1768049339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f041c0fff20 0x7f041c102340 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0410004940 tx=0x7f0410009e30 comp rx=0 tx=0).stop 2024-04-16T14:42:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.541+0000 7f0421b8d700 1 -- 172.21.15.5:0/1768049339 shutdown_connections 2024-04-16T14:42:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.541+0000 7f0421b8d700 1 --2- 172.21.15.5:0/1768049339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f041c0fff20 0x7f041c102340 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.541+0000 7f0421b8d700 1 --2- 172.21.15.5:0/1768049339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f041c066f60 0x7f041c0ff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.541+0000 7f0421b8d700 1 -- 172.21.15.5:0/1768049339 >> 172.21.15.5:0/1768049339 conn(0x7f041c0f7450 msgr2=0x7f041c0f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:23.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.542+0000 7f0421b8d700 1 -- 172.21.15.5:0/1768049339 shutdown_connections 2024-04-16T14:42:23.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.542+0000 7f0421b8d700 1 -- 172.21.15.5:0/1768049339 wait complete. 2024-04-16T14:42:23.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.542+0000 7f0421b8d700 1 Processor -- start 2024-04-16T14:42:23.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.542+0000 7f0421b8d700 1 -- start start 2024-04-16T14:42:23.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.543+0000 7f0421b8d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f041c066f60 0x7f041c10dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:23.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.543+0000 7f0421b8d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f041c0fff20 0x7f041c10e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:23.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.543+0000 7f0421b8d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c10e910 con 0x7f041c0fff20 2024-04-16T14:42:23.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.543+0000 7f0421b8d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c113220 con 0x7f041c066f60 2024-04-16T14:42:23.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.543+0000 7f041affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f041c0fff20 0x7f041c10e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:23.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.543+0000 7f041affd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f041c0fff20 0x7f041c10e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36114/0 (socket says 172.21.15.5:36114) 2024-04-16T14:42:23.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.543+0000 7f041affd700 1 -- 172.21.15.5:0/2544756449 learned_addr learned my addr 172.21.15.5:0/2544756449 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:42:23.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.543+0000 7f041b7fe700 1 --2- 172.21.15.5:0/2544756449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f041c066f60 0x7f041c10dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:23.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.543+0000 7f041affd700 1 -- 172.21.15.5:0/2544756449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f041c066f60 msgr2=0x7f041c10dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:23.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.543+0000 7f041affd700 1 --2- 172.21.15.5:0/2544756449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f041c066f60 0x7f041c10dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:23.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.543+0000 7f041affd700 1 -- 172.21.15.5:0/2544756449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0410005040 con 0x7f041c0fff20 2024-04-16T14:42:23.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.543+0000 7f041affd700 1 --2- 172.21.15.5:0/2544756449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f041c0fff20 0x7f041c10e200 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f041000b3b0 tx=0x7f0410009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:23.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.544+0000 7f0403fff700 1 -- 172.21.15.5:0/2544756449 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f041000e040 con 0x7f041c0fff20 2024-04-16T14:42:23.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.544+0000 7f0403fff700 1 -- 172.21.15.5:0/2544756449 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f041000bcc0 con 0x7f041c0fff20 2024-04-16T14:42:23.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.544+0000 7f0421b8d700 1 -- 172.21.15.5:0/2544756449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f041c113420 con 0x7f041c0fff20 2024-04-16T14:42:23.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.544+0000 7f0403fff700 1 -- 172.21.15.5:0/2544756449 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f041001c630 con 0x7f041c0fff20 2024-04-16T14:42:23.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.544+0000 7f0421b8d700 1 -- 172.21.15.5:0/2544756449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041c1139b0 con 0x7f041c0fff20 2024-04-16T14:42:23.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.545+0000 7f0421b8d700 1 -- 172.21.15.5:0/2544756449 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f041c04c710 con 0x7f041c0fff20 2024-04-16T14:42:23.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.545+0000 7f0403fff700 1 -- 172.21.15.5:0/2544756449 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f0410013980 con 0x7f041c0fff20 2024-04-16T14:42:23.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.546+0000 7f0403fff700 1 --2- 172.21.15.5:0/2544756449 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f040406e140 0x7f04040705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:23.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.546+0000 7f041b7fe700 1 --2- 172.21.15.5:0/2544756449 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f040406e140 0x7f04040705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:23.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.546+0000 7f0403fff700 1 -- 172.21.15.5:0/2544756449 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f041008e770 con 0x7f041c0fff20 2024-04-16T14:42:23.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.546+0000 7f041b7fe700 1 --2- 172.21.15.5:0/2544756449 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f040406e140 0x7f04040705f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f040c006fd0 tx=0x7f040c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:23.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.551+0000 7f0403fff700 1 -- 172.21.15.5:0/2544756449 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f0410057b70 con 0x7f041c0fff20 2024-04-16T14:42:23.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.779+0000 7f0421b8d700 1 -- 172.21.15.5:0/2544756449 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f041c101b90 con 0x7f040406e140 2024-04-16T14:42:23.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.780+0000 7f0403fff700 1 -- 172.21.15.5:0/2544756449 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f041c101b90 con 0x7f040406e140 2024-04-16T14:42:23.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.782+0000 7f0421b8d700 1 -- 172.21.15.5:0/2544756449 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f040406e140 msgr2=0x7f04040705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:23.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.782+0000 7f0421b8d700 1 --2- 172.21.15.5:0/2544756449 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f040406e140 0x7f04040705f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f040c006fd0 tx=0x7f040c008040 comp rx=0 tx=0).stop 2024-04-16T14:42:23.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.782+0000 7f0421b8d700 1 -- 172.21.15.5:0/2544756449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f041c0fff20 msgr2=0x7f041c10e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:23.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.782+0000 7f0421b8d700 1 --2- 172.21.15.5:0/2544756449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f041c0fff20 0x7f041c10e200 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f041000b3b0 tx=0x7f0410009e30 comp rx=0 tx=0).stop 2024-04-16T14:42:23.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.782+0000 7f0421b8d700 1 -- 172.21.15.5:0/2544756449 shutdown_connections 2024-04-16T14:42:23.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.782+0000 7f0421b8d700 1 --2- 172.21.15.5:0/2544756449 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f040406e140 0x7f04040705f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:23.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.782+0000 7f0421b8d700 1 --2- 172.21.15.5:0/2544756449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f041c066f60 0x7f041c10dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:23.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.782+0000 7f0421b8d700 1 --2- 172.21.15.5:0/2544756449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f041c0fff20 0x7f041c10e200 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:23.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.782+0000 7f0421b8d700 1 -- 172.21.15.5:0/2544756449 >> 172.21.15.5:0/2544756449 conn(0x7f041c0f7450 msgr2=0x7f041c0f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:23.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.782+0000 7f0421b8d700 1 -- 172.21.15.5:0/2544756449 shutdown_connections 2024-04-16T14:42:23.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.782+0000 7f0421b8d700 1 -- 172.21.15.5:0/2544756449 wait complete. 2024-04-16T14:42:23.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.886+0000 7fe4aee45700 1 -- 172.21.15.5:0/564130715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4a80fcfa0 msgr2=0x7fe4a80fd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:23.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.886+0000 7fe4aee45700 1 --2- 172.21.15.5:0/564130715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4a80fcfa0 0x7fe4a80fd410 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe494004940 tx=0x7fe494009e30 comp rx=0 tx=0).stop 2024-04-16T14:42:23.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.886+0000 7fe4aee45700 1 -- 172.21.15.5:0/564130715 shutdown_connections 2024-04-16T14:42:23.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.886+0000 7fe4aee45700 1 --2- 172.21.15.5:0/564130715 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4a80fcfa0 0x7fe4a80fd410 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:23.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.886+0000 7fe4aee45700 1 --2- 172.21.15.5:0/564130715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4a80fbcf0 0x7fe4a80fc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:23.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.886+0000 7fe4aee45700 1 -- 172.21.15.5:0/564130715 >> 172.21.15.5:0/564130715 conn(0x7fe4a80f7450 msgr2=0x7fe4a80f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:23.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.886+0000 7fe4aee45700 1 -- 172.21.15.5:0/564130715 shutdown_connections 2024-04-16T14:42:23.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.886+0000 7fe4aee45700 1 -- 172.21.15.5:0/564130715 wait complete. 2024-04-16T14:42:23.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.886+0000 7fe4aee45700 1 Processor -- start 2024-04-16T14:42:23.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.886+0000 7fe4aee45700 1 -- start start 2024-04-16T14:42:23.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.887+0000 7fe4aee45700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4a80fbcf0 0x7fe4a810cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:23.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.887+0000 7fe4aee45700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4a80fcfa0 0x7fe4a810d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:23.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.887+0000 7fe4aee45700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a810d690 con 0x7fe4a80fbcf0 2024-04-16T14:42:23.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.887+0000 7fe4aee45700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a810d800 con 0x7fe4a80fcfa0 2024-04-16T14:42:23.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.887+0000 7fe4acbe1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4a80fbcf0 0x7fe4a810cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:23.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.887+0000 7fe4acbe1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4a80fbcf0 0x7fe4a810cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36130/0 (socket says 172.21.15.5:36130) 2024-04-16T14:42:23.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.887+0000 7fe4acbe1700 1 -- 172.21.15.5:0/287886357 learned_addr learned my addr 172.21.15.5:0/287886357 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:42:23.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.887+0000 7fe4a7fff700 1 --2- 172.21.15.5:0/287886357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4a80fcfa0 0x7fe4a810d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:23.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.887+0000 7fe4acbe1700 1 -- 172.21.15.5:0/287886357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4a80fcfa0 msgr2=0x7fe4a810d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:23.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.887+0000 7fe4acbe1700 1 --2- 172.21.15.5:0/287886357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4a80fcfa0 0x7fe4a810d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:23.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.887+0000 7fe4acbe1700 1 -- 172.21.15.5:0/287886357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe494005040 con 0x7fe4a80fbcf0 2024-04-16T14:42:23.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.887+0000 7fe4acbe1700 1 --2- 172.21.15.5:0/287886357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4a80fbcf0 0x7fe4a810cb50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe49c002a50 tx=0x7fe49c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:23.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.888+0000 7fe4a57fa700 1 -- 172.21.15.5:0/287886357 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe49c007cc0 con 0x7fe4a80fbcf0 2024-04-16T14:42:23.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.888+0000 7fe4a57fa700 1 -- 172.21.15.5:0/287886357 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe49c00f040 con 0x7fe4a80fbcf0 2024-04-16T14:42:23.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.888+0000 7fe4aee45700 1 -- 172.21.15.5:0/287886357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a8112260 con 0x7fe4a80fbcf0 2024-04-16T14:42:23.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.888+0000 7fe4a57fa700 1 -- 172.21.15.5:0/287886357 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe49c00da30 con 0x7fe4a80fbcf0 2024-04-16T14:42:23.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.888+0000 7fe4aee45700 1 -- 172.21.15.5:0/287886357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a8112820 con 0x7fe4a80fbcf0 2024-04-16T14:42:23.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.889+0000 7fe4aee45700 1 -- 172.21.15.5:0/287886357 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a804c710 con 0x7fe4a80fbcf0 2024-04-16T14:42:23.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.889+0000 7fe4a57fa700 1 -- 172.21.15.5:0/287886357 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fe49c00db90 con 0x7fe4a80fbcf0 2024-04-16T14:42:23.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.890+0000 7fe4a57fa700 1 --2- 172.21.15.5:0/287886357 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe49806e140 0x7fe4980705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:23.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.890+0000 7fe4a57fa700 1 -- 172.21.15.5:0/287886357 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fe49c08d7f0 con 0x7fe4a80fbcf0 2024-04-16T14:42:23.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.890+0000 7fe4a7fff700 1 --2- 172.21.15.5:0/287886357 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe49806e140 0x7fe4980705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:23.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.890+0000 7fe4a7fff700 1 --2- 172.21.15.5:0/287886357 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe49806e140 0x7fe4980705f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe49400b970 tx=0x7fe494009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:23.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:23.895+0000 7fe4a57fa700 1 -- 172.21.15.5:0/287886357 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fe49c05a720 con 0x7fe4a80fbcf0 2024-04-16T14:42:24.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.111+0000 7fe4aee45700 1 -- 172.21.15.5:0/287886357 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4a8101360 con 0x7fe49806e140 2024-04-16T14:42:24.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.121+0000 7fe4a57fa700 1 -- 172.21.15.5:0/287886357 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fe4a8101360 con 0x7fe49806e140 2024-04-16T14:42:24.119 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-16T14:42:24.119 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.smithi005 smithi005 *:9093,9094 running (6m) 2m ago 15m 24.6M - 0.25.0 c8568f914cd2 f8aaa22ee70c 2024-04-16T14:42:24.120 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi005 smithi005 running (4m) 2m ago 15m 6656k - 19.0.0-2204-g36befe5d b1a78730e0db d6efa08e65e3 2024-04-16T14:42:24.120 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi115 smithi115 running (4m) 43s ago 14m 6660k - 19.0.0-2204-g36befe5d b1a78730e0db b2a2f2965e2a 2024-04-16T14:42:24.120 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.smithi005 smithi005 *:3000 running (6m) 2m ago 14m 85.9M - 9.4.7 954c08fa6188 9834229a010c 2024-04-16T14:42:24.120 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.vzoqdl smithi005 running (9m) 2m ago 9m 13.5M - 17.2.7-868-g412a5526 b04d96489b7c 84a74a406a1d 2024-04-16T14:42:24.120 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.wofqlz smithi005 running (9m) 2m ago 9m 133M - 17.2.7-868-g412a5526 b04d96489b7c d0e053ab2f72 2024-04-16T14:42:24.120 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.byfytg smithi115 running (9m) 43s ago 9m 118M - 17.2.7-868-g412a5526 b04d96489b7c 595cd0892f66 2024-04-16T14:42:24.120 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.trkaqh smithi115 running (9m) 43s ago 9m 14.5M - 17.2.7-868-g412a5526 b04d96489b7c 5b60cd2ad79b 2024-04-16T14:42:24.120 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi005.ipwdkc smithi005 *:8443,9283,8765 running (6m) 2m ago 16m 501M - 19.0.0-2204-g36befe5d b1a78730e0db 451192b4fc44 2024-04-16T14:42:24.120 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi115.brjkpo smithi115 *:8443,9283,8765 running (5m) 43s ago 14m 450M - 19.0.0-2204-g36befe5d b1a78730e0db 0d75f8211942 2024-04-16T14:42:24.120 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi005 smithi005 running (5m) 2m ago 16m 45.8M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3d0c00924867 2024-04-16T14:42:24.120 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi115 smithi115 running (4m) 43s ago 13m 43.8M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3b916a4928b2 2024-04-16T14:42:24.120 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi005 smithi005 *:9100 running (7m) 2m ago 15m 16.7M - 1.5.0 0da6a335fe13 c09bba584a42 2024-04-16T14:42:24.120 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi115 smithi115 *:9100 running (6m) 43s ago 14m 16.7M - 1.5.0 0da6a335fe13 78cc9cc150c0 2024-04-16T14:42:24.120 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (3m) 2m ago 13m 100M 1559M 19.0.0-2204-g36befe5d b1a78730e0db 91d9246d45e0 2024-04-16T14:42:24.120 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (3m) 2m ago 12m 100M 1559M 19.0.0-2204-g36befe5d b1a78730e0db d930ce515e3e 2024-04-16T14:42:24.121 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (2m) 2m ago 12m 12.7M 1559M 19.0.0-2204-g36befe5d b1a78730e0db fdc5fe68ac57 2024-04-16T14:42:24.121 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi115 running (113s) 43s ago 11m 104M 2581M 19.0.0-2204-g36befe5d b1a78730e0db 808ebb96c862 2024-04-16T14:42:24.121 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi115 running (79s) 43s ago 11m 95.0M 2581M 19.0.0-2204-g36befe5d b1a78730e0db 74d7d2ac5a6a 2024-04-16T14:42:24.121 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi115 running (46s) 43s ago 11m 11.5M 2581M 19.0.0-2204-g36befe5d b1a78730e0db 484bc7617d80 2024-04-16T14:42:24.121 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.smithi005 smithi005 *:9095 running (5m) 2m ago 14m 58.9M - 2.43.0 a07b618ecd1d dc784e58817c 2024-04-16T14:42:24.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.123+0000 7fe4aee45700 1 -- 172.21.15.5:0/287886357 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe49806e140 msgr2=0x7fe4980705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:24.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.123+0000 7fe4aee45700 1 --2- 172.21.15.5:0/287886357 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe49806e140 0x7fe4980705f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe49400b970 tx=0x7fe494009e30 comp rx=0 tx=0).stop 2024-04-16T14:42:24.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.123+0000 7fe4aee45700 1 -- 172.21.15.5:0/287886357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4a80fbcf0 msgr2=0x7fe4a810cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:24.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.123+0000 7fe4aee45700 1 --2- 172.21.15.5:0/287886357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4a80fbcf0 0x7fe4a810cb50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe49c002a50 tx=0x7fe49c0046b0 comp rx=0 tx=0).stop 2024-04-16T14:42:24.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.123+0000 7fe4aee45700 1 -- 172.21.15.5:0/287886357 shutdown_connections 2024-04-16T14:42:24.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.123+0000 7fe4aee45700 1 --2- 172.21.15.5:0/287886357 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe49806e140 0x7fe4980705f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:24.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.123+0000 7fe4aee45700 1 --2- 172.21.15.5:0/287886357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe4a80fbcf0 0x7fe4a810cb50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:24.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.123+0000 7fe4aee45700 1 --2- 172.21.15.5:0/287886357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe4a80fcfa0 0x7fe4a810d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:24.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.123+0000 7fe4aee45700 1 -- 172.21.15.5:0/287886357 >> 172.21.15.5:0/287886357 conn(0x7fe4a80f7450 msgr2=0x7fe4a80f8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:24.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.123+0000 7fe4aee45700 1 -- 172.21.15.5:0/287886357 shutdown_connections 2024-04-16T14:42:24.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.123+0000 7fe4aee45700 1 -- 172.21.15.5:0/287886357 wait complete. 2024-04-16T14:42:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.227+0000 7f18336aa700 1 -- 172.21.15.5:0/1151682074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182c0fe450 msgr2=0x7f182c0fe860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.227+0000 7f18336aa700 1 --2- 172.21.15.5:0/1151682074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182c0fe450 0x7f182c0fe860 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f181c009ce0 tx=0x7f181c004d10 comp rx=0 tx=0).stop 2024-04-16T14:42:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.227+0000 7f18336aa700 1 -- 172.21.15.5:0/1151682074 shutdown_connections 2024-04-16T14:42:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.227+0000 7f18336aa700 1 --2- 172.21.15.5:0/1151682074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f182c0feda0 0x7f182c0faee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.227+0000 7f18336aa700 1 --2- 172.21.15.5:0/1151682074 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182c0fe450 0x7f182c0fe860 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.227+0000 7f18336aa700 1 -- 172.21.15.5:0/1151682074 >> 172.21.15.5:0/1151682074 conn(0x7f182c0f6bf0 msgr2=0x7f182c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.227+0000 7f18336aa700 1 -- 172.21.15.5:0/1151682074 shutdown_connections 2024-04-16T14:42:24.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.227+0000 7f18336aa700 1 -- 172.21.15.5:0/1151682074 wait complete. 2024-04-16T14:42:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.227+0000 7f18336aa700 1 Processor -- start 2024-04-16T14:42:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.227+0000 7f18336aa700 1 -- start start 2024-04-16T14:42:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.228+0000 7f18336aa700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f182c0fe450 0x7f182c10da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.228+0000 7f18336aa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182c0feda0 0x7f182c10dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.228+0000 7f18336aa700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182c10e650 con 0x7f182c0feda0 2024-04-16T14:42:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.228+0000 7f18336aa700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182c112ff0 con 0x7f182c0fe450 2024-04-16T14:42:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.228+0000 7f1830c45700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182c0feda0 0x7f182c10dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.228+0000 7f1830c45700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182c0feda0 0x7f182c10dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36134/0 (socket says 172.21.15.5:36134) 2024-04-16T14:42:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.228+0000 7f1830c45700 1 -- 172.21.15.5:0/171376624 learned_addr learned my addr 172.21.15.5:0/171376624 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:42:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.228+0000 7f1831446700 1 --2- 172.21.15.5:0/171376624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f182c0fe450 0x7f182c10da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.228+0000 7f1830c45700 1 -- 172.21.15.5:0/171376624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f182c0fe450 msgr2=0x7f182c10da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.228+0000 7f1830c45700 1 --2- 172.21.15.5:0/171376624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f182c0fe450 0x7f182c10da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.228+0000 7f1830c45700 1 -- 172.21.15.5:0/171376624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181c009940 con 0x7f182c0feda0 2024-04-16T14:42:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.228+0000 7f1830c45700 1 --2- 172.21.15.5:0/171376624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182c0feda0 0x7f182c10dfc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f182000b790 tx=0x7f1820009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:24.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.228+0000 7f1829ffb700 1 -- 172.21.15.5:0/171376624 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f182000f6f0 con 0x7f182c0feda0 2024-04-16T14:42:24.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.228+0000 7f1829ffb700 1 -- 172.21.15.5:0/171376624 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f182000fd20 con 0x7f182c0feda0 2024-04-16T14:42:24.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.228+0000 7f18336aa700 1 -- 172.21.15.5:0/171376624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f182c113250 con 0x7f182c0feda0 2024-04-16T14:42:24.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.229+0000 7f1829ffb700 1 -- 172.21.15.5:0/171376624 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18200103a0 con 0x7f182c0feda0 2024-04-16T14:42:24.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.229+0000 7f18336aa700 1 -- 172.21.15.5:0/171376624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f182c1137c0 con 0x7f182c0feda0 2024-04-16T14:42:24.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.230+0000 7f18336aa700 1 -- 172.21.15.5:0/171376624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f182c04c710 con 0x7f182c0feda0 2024-04-16T14:42:24.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.230+0000 7f1829ffb700 1 -- 172.21.15.5:0/171376624 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f1820011400 con 0x7f182c0feda0 2024-04-16T14:42:24.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.230+0000 7f1829ffb700 1 --2- 172.21.15.5:0/171376624 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f181406e140 0x7f18140705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:24.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.231+0000 7f1829ffb700 1 -- 172.21.15.5:0/171376624 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f182008d810 con 0x7f182c0feda0 2024-04-16T14:42:24.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.231+0000 7f1831446700 1 --2- 172.21.15.5:0/171376624 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f181406e140 0x7f18140705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:24.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.231+0000 7f1831446700 1 --2- 172.21.15.5:0/171376624 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f181406e140 0x7f18140705f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f181c015040 tx=0x7f181c004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:24.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.235+0000 7f1829ffb700 1 -- 172.21.15.5:0/171376624 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f182005a7e0 con 0x7f182c0feda0 2024-04-16T14:42:24.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:42:24.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.531+0000 7f18336aa700 1 -- 172.21.15.5:0/171376624 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f182c105980 con 0x7f182c0feda0 2024-04-16T14:42:24.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.532+0000 7f1829ffb700 1 -- 172.21.15.5:0/171376624 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+733 (secure 0 0 0) 0x7f182005a370 con 0x7f182c0feda0 2024-04-16T14:42:24.530 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:42:24.530 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-04-16T14:42:24.531 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:42:24.531 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:42:24.531 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-04-16T14:42:24.531 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:42:24.531 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:42:24.531 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-04-16T14:42:24.531 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 6 2024-04-16T14:42:24.531 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:42:24.531 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-04-16T14:42:24.531 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 3 2024-04-16T14:42:24.531 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:42:24.531 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-04-16T14:42:24.532 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 3, 2024-04-16T14:42:24.532 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 10 2024-04-16T14:42:24.532 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-16T14:42:24.532 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:42:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.534+0000 7f18336aa700 1 -- 172.21.15.5:0/171376624 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f181406e140 msgr2=0x7f18140705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.534+0000 7f18336aa700 1 --2- 172.21.15.5:0/171376624 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f181406e140 0x7f18140705f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f181c015040 tx=0x7f181c004d10 comp rx=0 tx=0).stop 2024-04-16T14:42:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.534+0000 7f18336aa700 1 -- 172.21.15.5:0/171376624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182c0feda0 msgr2=0x7f182c10dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.534+0000 7f18336aa700 1 --2- 172.21.15.5:0/171376624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182c0feda0 0x7f182c10dfc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f182000b790 tx=0x7f1820009250 comp rx=0 tx=0).stop 2024-04-16T14:42:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.534+0000 7f18336aa700 1 -- 172.21.15.5:0/171376624 shutdown_connections 2024-04-16T14:42:24.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.534+0000 7f18336aa700 1 --2- 172.21.15.5:0/171376624 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f181406e140 0x7f18140705f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.534+0000 7f18336aa700 1 --2- 172.21.15.5:0/171376624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f182c0fe450 0x7f182c10da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.534+0000 7f18336aa700 1 --2- 172.21.15.5:0/171376624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182c0feda0 0x7f182c10dfc0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.534+0000 7f18336aa700 1 -- 172.21.15.5:0/171376624 >> 172.21.15.5:0/171376624 conn(0x7f182c0f6bf0 msgr2=0x7f182c0f8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.534+0000 7f18336aa700 1 -- 172.21.15.5:0/171376624 shutdown_connections 2024-04-16T14:42:24.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.534+0000 7f18336aa700 1 -- 172.21.15.5:0/171376624 wait complete. 2024-04-16T14:42:24.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.638+0000 7f1e30f08700 1 -- 172.21.15.5:0/4247874107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e2c0fe040 msgr2=0x7f1e2c0fe4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:24.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.638+0000 7f1e30f08700 1 --2- 172.21.15.5:0/4247874107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e2c0fe040 0x7f1e2c0fe4b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1e20004940 tx=0x7f1e20009e30 comp rx=0 tx=0).stop 2024-04-16T14:42:24.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.638+0000 7f1e30f08700 1 -- 172.21.15.5:0/4247874107 shutdown_connections 2024-04-16T14:42:24.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.638+0000 7f1e30f08700 1 --2- 172.21.15.5:0/4247874107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e2c0fe040 0x7f1e2c0fe4b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:24.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.638+0000 7f1e30f08700 1 --2- 172.21.15.5:0/4247874107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e2c0fce40 0x7f1e2c0fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:24.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.638+0000 7f1e30f08700 1 -- 172.21.15.5:0/4247874107 >> 172.21.15.5:0/4247874107 conn(0x7f1e2c0f8530 msgr2=0x7f1e2c0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:24.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.638+0000 7f1e30f08700 1 -- 172.21.15.5:0/4247874107 shutdown_connections 2024-04-16T14:42:24.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.638+0000 7f1e30f08700 1 -- 172.21.15.5:0/4247874107 wait complete. 2024-04-16T14:42:24.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.639+0000 7f1e30f08700 1 Processor -- start 2024-04-16T14:42:24.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.639+0000 7f1e30f08700 1 -- start start 2024-04-16T14:42:24.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.639+0000 7f1e30f08700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e2c0fce40 0x7f1e2c10da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:24.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.639+0000 7f1e30f08700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e2c0fe040 0x7f1e2c10df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:24.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.639+0000 7f1e30f08700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c10e580 con 0x7f1e2c0fe040 2024-04-16T14:42:24.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.639+0000 7f1e30f08700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c10edd0 con 0x7f1e2c0fce40 2024-04-16T14:42:24.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.639+0000 7f1e29d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e2c0fe040 0x7f1e2c10df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:24.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.639+0000 7f1e29d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e2c0fe040 0x7f1e2c10df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36150/0 (socket says 172.21.15.5:36150) 2024-04-16T14:42:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.639+0000 7f1e29d9b700 1 -- 172.21.15.5:0/1996288394 learned_addr learned my addr 172.21.15.5:0/1996288394 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:42:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.639+0000 7f1e2a59c700 1 --2- 172.21.15.5:0/1996288394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e2c0fce40 0x7f1e2c10da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.639+0000 7f1e29d9b700 1 -- 172.21.15.5:0/1996288394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e2c0fce40 msgr2=0x7f1e2c10da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.639+0000 7f1e29d9b700 1 --2- 172.21.15.5:0/1996288394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e2c0fce40 0x7f1e2c10da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.639+0000 7f1e29d9b700 1 -- 172.21.15.5:0/1996288394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e20005040 con 0x7f1e2c0fe040 2024-04-16T14:42:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.639+0000 7f1e29d9b700 1 --2- 172.21.15.5:0/1996288394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e2c0fe040 0x7f1e2c10df80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1e2000b3b0 tx=0x7f1e20009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.640+0000 7f1e1affd700 1 -- 172.21.15.5:0/1996288394 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e2000e040 con 0x7f1e2c0fe040 2024-04-16T14:42:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.640+0000 7f1e1affd700 1 -- 172.21.15.5:0/1996288394 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1e2000bbf0 con 0x7f1e2c0fe040 2024-04-16T14:42:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.640+0000 7f1e30f08700 1 -- 172.21.15.5:0/1996288394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e2c10f050 con 0x7f1e2c0fe040 2024-04-16T14:42:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.640+0000 7f1e1affd700 1 -- 172.21.15.5:0/1996288394 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e2001c630 con 0x7f1e2c0fe040 2024-04-16T14:42:24.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.640+0000 7f1e30f08700 1 -- 172.21.15.5:0/1996288394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e2c10f590 con 0x7f1e2c0fe040 2024-04-16T14:42:24.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.641+0000 7f1e30f08700 1 -- 172.21.15.5:0/1996288394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e2c05f5f0 con 0x7f1e2c0fe040 2024-04-16T14:42:24.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.641+0000 7f1e1affd700 1 -- 172.21.15.5:0/1996288394 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f1e2000bd60 con 0x7f1e2c0fe040 2024-04-16T14:42:24.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.642+0000 7f1e1affd700 1 --2- 172.21.15.5:0/1996288394 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f1e1406e140 0x7f1e140705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:24.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.642+0000 7f1e1affd700 1 -- 172.21.15.5:0/1996288394 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f1e2008e6e0 con 0x7f1e2c0fe040 2024-04-16T14:42:24.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.642+0000 7f1e2a59c700 1 --2- 172.21.15.5:0/1996288394 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f1e1406e140 0x7f1e140705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:24.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.642+0000 7f1e2a59c700 1 --2- 172.21.15.5:0/1996288394 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f1e1406e140 0x7f1e140705f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0fdbb0 tx=0x7f1e1c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:24.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.647+0000 7f1e1affd700 1 -- 172.21.15.5:0/1996288394 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f1e2005b610 con 0x7f1e2c0fe040 2024-04-16T14:42:24.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:24 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:42:24.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.900+0000 7f1e30f08700 1 -- 172.21.15.5:0/1996288394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1e2c10f850 con 0x7f1e2c0fe040 2024-04-16T14:42:24.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.901+0000 7f1e1affd700 1 -- 172.21.15.5:0/1996288394 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+1712 (secure 0 0 0) 0x7f1e2005b1a0 con 0x7f1e2c0fe040 2024-04-16T14:42:24.900 INFO:teuthology.orchestra.run.smithi005.stdout:e27 2024-04-16T14:42:24.900 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:42:24.900 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:42:24.900 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2024-04-16T14:42:24.900 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:42:24.900 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2024-04-16T14:42:24.900 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2024-04-16T14:42:24.900 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 25 2024-04-16T14:42:24.901 INFO:teuthology.orchestra.run.smithi005.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-16T14:42:24.901 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-16T14:32:45.270024+0000 2024-04-16T14:42:24.901 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-04-16T14:42:12.602702+0000 2024-04-16T14:42:24.901 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2024-04-16T14:42:24.901 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2024-04-16T14:42:24.901 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 60 2024-04-16T14:42:24.901 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2024-04-16T14:42:24.901 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2024-04-16T14:42:24.901 INFO:teuthology.orchestra.run.smithi005.stdout:max_xattr_size 65536 2024-04-16T14:42:24.901 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2024-04-16T14:42:24.902 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2024-04-16T14:42:24.902 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 47 2024-04-16T14:42:24.902 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:42:24.902 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 1 2024-04-16T14:42:24.902 INFO:teuthology.orchestra.run.smithi005.stdout:in 0 2024-04-16T14:42:24.902 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=14484} 2024-04-16T14:42:24.902 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2024-04-16T14:42:24.902 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2024-04-16T14:42:24.902 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 1 2024-04-16T14:42:24.903 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3] 2024-04-16T14:42:24.903 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2024-04-16T14:42:24.903 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2024-04-16T14:42:24.903 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2024-04-16T14:42:24.903 INFO:teuthology.orchestra.run.smithi005.stdout:bal_rank_mask -1 2024-04-16T14:42:24.903 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 1 2024-04-16T14:42:24.903 INFO:teuthology.orchestra.run.smithi005.stdout:qdb_cluster leader: 14484 members: 14484 2024-04-16T14:42:24.903 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.wofqlz{0:14484} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.5:6828/402035291,v1:172.21.15.5:6829/402035291] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:42:24.903 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:42:24.903 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:42:24.903 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2024-04-16T14:42:24.904 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:42:24.904 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.trkaqh{-1:24275} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:42:24.904 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.byfytg{-1:44277} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.115:6824/1266846723,v1:172.21.15.115:6825/1266846723] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:42:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.904+0000 7f1e30f08700 1 -- 172.21.15.5:0/1996288394 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f1e1406e140 msgr2=0x7f1e140705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.904+0000 7f1e30f08700 1 --2- 172.21.15.5:0/1996288394 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f1e1406e140 0x7f1e140705f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0fdbb0 tx=0x7f1e1c00b040 comp rx=0 tx=0).stop 2024-04-16T14:42:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.904+0000 7f1e30f08700 1 -- 172.21.15.5:0/1996288394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e2c0fe040 msgr2=0x7f1e2c10df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.904+0000 7f1e30f08700 1 --2- 172.21.15.5:0/1996288394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e2c0fe040 0x7f1e2c10df80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1e2000b3b0 tx=0x7f1e20009e30 comp rx=0 tx=0).stop 2024-04-16T14:42:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.904+0000 7f1e30f08700 1 -- 172.21.15.5:0/1996288394 shutdown_connections 2024-04-16T14:42:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.904+0000 7f1e30f08700 1 --2- 172.21.15.5:0/1996288394 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f1e1406e140 0x7f1e140705f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.904+0000 7f1e30f08700 1 --2- 172.21.15.5:0/1996288394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1e2c0fce40 0x7f1e2c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.904+0000 7f1e30f08700 1 --2- 172.21.15.5:0/1996288394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1e2c0fe040 0x7f1e2c10df80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:24.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.904+0000 7f1e30f08700 1 -- 172.21.15.5:0/1996288394 >> 172.21.15.5:0/1996288394 conn(0x7f1e2c0f8530 msgr2=0x7f1e2c0f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:24.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.904+0000 7f1e30f08700 1 -- 172.21.15.5:0/1996288394 shutdown_connections 2024-04-16T14:42:24.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:24.904+0000 7f1e30f08700 1 -- 172.21.15.5:0/1996288394 wait complete. 2024-04-16T14:42:24.906 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 27 2024-04-16T14:42:25.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.010+0000 7f30f8436700 1 -- 172.21.15.5:0/3333838441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30f0066b80 msgr2=0x7f30f00ffa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:25.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.010+0000 7f30f8436700 1 --2- 172.21.15.5:0/3333838441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30f0066b80 0x7f30f00ffa70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f30e0009ce0 tx=0x7f30e0004d10 comp rx=0 tx=0).stop 2024-04-16T14:42:25.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.010+0000 7f30f8436700 1 -- 172.21.15.5:0/3333838441 shutdown_connections 2024-04-16T14:42:25.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.010+0000 7f30f8436700 1 --2- 172.21.15.5:0/3333838441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30f00fffb0 0x7f30f01023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:25.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.010+0000 7f30f8436700 1 --2- 172.21.15.5:0/3333838441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30f0066b80 0x7f30f00ffa70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:25.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.010+0000 7f30f8436700 1 -- 172.21.15.5:0/3333838441 >> 172.21.15.5:0/3333838441 conn(0x7f30f00f74e0 msgr2=0x7f30f00f9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:25.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.010+0000 7f30f8436700 1 -- 172.21.15.5:0/3333838441 shutdown_connections 2024-04-16T14:42:25.012 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.010+0000 7f30f8436700 1 -- 172.21.15.5:0/3333838441 wait complete. 2024-04-16T14:42:25.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.011+0000 7f30f8436700 1 Processor -- start 2024-04-16T14:42:25.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.011+0000 7f30f8436700 1 -- start start 2024-04-16T14:42:25.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.011+0000 7f30f8436700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30f0066b80 0x7f30f010dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:25.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.011+0000 7f30f8436700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30f00fffb0 0x7f30f010e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:25.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.011+0000 7f30f8436700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f010e740 con 0x7f30f00fffb0 2024-04-16T14:42:25.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.011+0000 7f30f8436700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f010ef90 con 0x7f30f0066b80 2024-04-16T14:42:25.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.011+0000 7f30f59d1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30f00fffb0 0x7f30f010e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:25.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.012+0000 7f30f59d1700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30f00fffb0 0x7f30f010e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36162/0 (socket says 172.21.15.5:36162) 2024-04-16T14:42:25.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.012+0000 7f30f59d1700 1 -- 172.21.15.5:0/1818449708 learned_addr learned my addr 172.21.15.5:0/1818449708 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:42:25.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.012+0000 7f30f61d2700 1 --2- 172.21.15.5:0/1818449708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30f0066b80 0x7f30f010dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:25.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.012+0000 7f30f59d1700 1 -- 172.21.15.5:0/1818449708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30f0066b80 msgr2=0x7f30f010dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:25.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.012+0000 7f30f59d1700 1 --2- 172.21.15.5:0/1818449708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30f0066b80 0x7f30f010dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:25.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.012+0000 7f30f59d1700 1 -- 172.21.15.5:0/1818449708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e0009940 con 0x7f30f00fffb0 2024-04-16T14:42:25.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.012+0000 7f30f59d1700 1 --2- 172.21.15.5:0/1818449708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30f00fffb0 0x7f30f010e140 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f30e400c830 tx=0x7f30e4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:25.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.012+0000 7f30eeffd700 1 -- 172.21.15.5:0/1818449708 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30e400a760 con 0x7f30f00fffb0 2024-04-16T14:42:25.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.012+0000 7f30f8436700 1 -- 172.21.15.5:0/1818449708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f010f270 con 0x7f30f00fffb0 2024-04-16T14:42:25.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.012+0000 7f30eeffd700 1 -- 172.21.15.5:0/1818449708 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f30e400ad90 con 0x7f30f00fffb0 2024-04-16T14:42:25.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.012+0000 7f30eeffd700 1 -- 172.21.15.5:0/1818449708 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30e40113a0 con 0x7f30f00fffb0 2024-04-16T14:42:25.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.012+0000 7f30f8436700 1 -- 172.21.15.5:0/1818449708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f010f7b0 con 0x7f30f00fffb0 2024-04-16T14:42:25.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.013+0000 7f30f8436700 1 -- 172.21.15.5:0/1818449708 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f005f5f0 con 0x7f30f00fffb0 2024-04-16T14:42:25.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.014+0000 7f30eeffd700 1 -- 172.21.15.5:0/1818449708 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f30e4012400 con 0x7f30f00fffb0 2024-04-16T14:42:25.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.014+0000 7f30eeffd700 1 --2- 172.21.15.5:0/1818449708 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f30d806e140 0x7f30d80705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:25.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.014+0000 7f30eeffd700 1 -- 172.21.15.5:0/1818449708 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f30e408dad0 con 0x7f30f00fffb0 2024-04-16T14:42:25.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.014+0000 7f30f61d2700 1 --2- 172.21.15.5:0/1818449708 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f30d806e140 0x7f30d80705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:25.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.015+0000 7f30f61d2700 1 --2- 172.21.15.5:0/1818449708 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f30d806e140 0x7f30d80705f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f30e0015040 tx=0x7f30e0004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:25.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.019+0000 7f30eeffd700 1 -- 172.21.15.5:0/1818449708 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f30e405aaa0 con 0x7f30f00fffb0 2024-04-16T14:42:25.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.254+0000 7f30f8436700 1 -- 172.21.15.5:0/1818449708 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f30f010fbe0 con 0x7f30d806e140 2024-04-16T14:42:25.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.255+0000 7f30eeffd700 1 -- 172.21.15.5:0/1818449708 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f30f010fbe0 con 0x7f30d806e140 2024-04-16T14:42:25.253 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:42:25.253 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91", 2024-04-16T14:42:25.253 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-04-16T14:42:25.254 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-16T14:42:25.254 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [ 2024-04-16T14:42:25.254 INFO:teuthology.orchestra.run.smithi005.stdout: "mon", 2024-04-16T14:42:25.254 INFO:teuthology.orchestra.run.smithi005.stdout: "osd", 2024-04-16T14:42:25.254 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr", 2024-04-16T14:42:25.254 INFO:teuthology.orchestra.run.smithi005.stdout: "crash" 2024-04-16T14:42:25.254 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-04-16T14:42:25.254 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "12/21 daemons upgraded", 2024-04-16T14:42:25.254 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading mds daemons", 2024-04-16T14:42:25.254 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-04-16T14:42:25.255 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:42:25.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.257+0000 7f30f8436700 1 -- 172.21.15.5:0/1818449708 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f30d806e140 msgr2=0x7f30d80705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:25.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.257+0000 7f30f8436700 1 --2- 172.21.15.5:0/1818449708 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f30d806e140 0x7f30d80705f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f30e0015040 tx=0x7f30e0004d10 comp rx=0 tx=0).stop 2024-04-16T14:42:25.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.257+0000 7f30f8436700 1 -- 172.21.15.5:0/1818449708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30f00fffb0 msgr2=0x7f30f010e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:25.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.257+0000 7f30f8436700 1 --2- 172.21.15.5:0/1818449708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30f00fffb0 0x7f30f010e140 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f30e400c830 tx=0x7f30e4004470 comp rx=0 tx=0).stop 2024-04-16T14:42:25.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.257+0000 7f30f8436700 1 -- 172.21.15.5:0/1818449708 shutdown_connections 2024-04-16T14:42:25.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.257+0000 7f30f8436700 1 --2- 172.21.15.5:0/1818449708 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f30d806e140 0x7f30d80705f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:25.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.257+0000 7f30f8436700 1 --2- 172.21.15.5:0/1818449708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30f0066b80 0x7f30f010dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:25.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.257+0000 7f30f8436700 1 --2- 172.21.15.5:0/1818449708 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f30f00fffb0 0x7f30f010e140 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:25.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.257+0000 7f30f8436700 1 -- 172.21.15.5:0/1818449708 >> 172.21.15.5:0/1818449708 conn(0x7f30f00f74e0 msgr2=0x7f30f00f7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:25.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.257+0000 7f30f8436700 1 -- 172.21.15.5:0/1818449708 shutdown_connections 2024-04-16T14:42:25.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.257+0000 7f30f8436700 1 -- 172.21.15.5:0/1818449708 wait complete. 2024-04-16T14:42:25.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.361+0000 7f45b95d6700 1 -- 172.21.15.5:0/174267248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45b40fbd00 msgr2=0x7f45b40fc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:25.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.361+0000 7f45b95d6700 1 --2- 172.21.15.5:0/174267248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45b40fbd00 0x7f45b40fc110 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f45a4009ce0 tx=0x7f45a4004d10 comp rx=0 tx=0).stop 2024-04-16T14:42:25.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.361+0000 7f45b95d6700 1 -- 172.21.15.5:0/174267248 shutdown_connections 2024-04-16T14:42:25.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.361+0000 7f45b95d6700 1 --2- 172.21.15.5:0/174267248 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45b40fcfb0 0x7f45b40fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:25.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.361+0000 7f45b95d6700 1 --2- 172.21.15.5:0/174267248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45b40fbd00 0x7f45b40fc110 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:25.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.361+0000 7f45b95d6700 1 -- 172.21.15.5:0/174267248 >> 172.21.15.5:0/174267248 conn(0x7f45b40f74a0 msgr2=0x7f45b40f98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:25.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.361+0000 7f45b95d6700 1 -- 172.21.15.5:0/174267248 shutdown_connections 2024-04-16T14:42:25.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.361+0000 7f45b95d6700 1 -- 172.21.15.5:0/174267248 wait complete. 2024-04-16T14:42:25.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.362+0000 7f45b95d6700 1 Processor -- start 2024-04-16T14:42:25.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.362+0000 7f45b95d6700 1 -- start start 2024-04-16T14:42:25.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.362+0000 7f45b95d6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45b40fbd00 0x7f45b40ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:25.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.362+0000 7f45b95d6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45b40fcfb0 0x7f45b40fe2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:25.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.362+0000 7f45b95d6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b4100280 con 0x7f45b40fbd00 2024-04-16T14:42:25.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.362+0000 7f45b95d6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b40fe860 con 0x7f45b40fcfb0 2024-04-16T14:42:25.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.362+0000 7f45b2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45b40fbd00 0x7f45b40ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:25.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.362+0000 7f45b2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45b40fbd00 0x7f45b40ffbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36180/0 (socket says 172.21.15.5:36180) 2024-04-16T14:42:25.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.362+0000 7f45b2ffd700 1 -- 172.21.15.5:0/4210590524 learned_addr learned my addr 172.21.15.5:0/4210590524 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:42:25.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.362+0000 7f45b2ffd700 1 -- 172.21.15.5:0/4210590524 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45b40fcfb0 msgr2=0x7f45b40fe2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:25.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.362+0000 7f45b2ffd700 1 --2- 172.21.15.5:0/4210590524 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45b40fcfb0 0x7f45b40fe2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:25.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.362+0000 7f45b2ffd700 1 -- 172.21.15.5:0/4210590524 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a4009940 con 0x7f45b40fbd00 2024-04-16T14:42:25.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.363+0000 7f45b2ffd700 1 --2- 172.21.15.5:0/4210590524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45b40fbd00 0x7f45b40ffbf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f45a4004740 tx=0x7f45a4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:25.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.363+0000 7f459b7fe700 1 -- 172.21.15.5:0/4210590524 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45a400e040 con 0x7f45b40fbd00 2024-04-16T14:42:25.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.363+0000 7f459b7fe700 1 -- 172.21.15.5:0/4210590524 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f45a40128e0 con 0x7f45b40fbd00 2024-04-16T14:42:25.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.363+0000 7f45b95d6700 1 -- 172.21.15.5:0/4210590524 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b40feae0 con 0x7f45b40fbd00 2024-04-16T14:42:25.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.363+0000 7f45b95d6700 1 -- 172.21.15.5:0/4210590524 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b40ff0a0 con 0x7f45b40fbd00 2024-04-16T14:42:25.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.363+0000 7f459b7fe700 1 -- 172.21.15.5:0/4210590524 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45a401ca80 con 0x7f45b40fbd00 2024-04-16T14:42:25.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.364+0000 7f45b95d6700 1 -- 172.21.15.5:0/4210590524 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b404c710 con 0x7f45b40fbd00 2024-04-16T14:42:25.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.364+0000 7f459b7fe700 1 -- 172.21.15.5:0/4210590524 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f45a4012a50 con 0x7f45b40fbd00 2024-04-16T14:42:25.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.365+0000 7f459b7fe700 1 --2- 172.21.15.5:0/4210590524 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f459c06e140 0x7f459c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:25.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.365+0000 7f459b7fe700 1 -- 172.21.15.5:0/4210590524 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f45a408f730 con 0x7f45b40fbd00 2024-04-16T14:42:25.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.365+0000 7f45b27fc700 1 --2- 172.21.15.5:0/4210590524 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f459c06e140 0x7f459c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:25.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.366+0000 7f45b27fc700 1 --2- 172.21.15.5:0/4210590524 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f459c06e140 0x7f459c0705f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f45a8006fd0 tx=0x7f45a8006db0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:25.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.370+0000 7f459b7fe700 1 -- 172.21.15.5:0/4210590524 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f45a405c660 con 0x7f45b40fbd00 2024-04-16T14:42:25.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:25 smithi005 ceph-mon[93420]: pgmap v184: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:42:25.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:25 smithi005 ceph-mon[93420]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:42:25.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:25 smithi005 ceph-mon[93420]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:42:25.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:25 smithi005 ceph-mon[93420]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:42:25.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:25 smithi005 ceph-mon[93420]: osdmap e82: 6 total, 6 up, 6 in 2024-04-16T14:42:25.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:25 smithi005 ceph-mon[93420]: fsmap cephfs:1 {0=cephfs.smithi005.wofqlz=up:active} 2 up:standby 2024-04-16T14:42:25.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:25 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi005.vzoqdl"}]: dispatch 2024-04-16T14:42:25.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:25 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/171376624' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:25.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:25 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/1996288394' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:42:25.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.679+0000 7f45b95d6700 1 -- 172.21.15.5:0/4210590524 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f45b4101b20 con 0x7f45b40fbd00 2024-04-16T14:42:25.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.679+0000 7f459b7fe700 1 -- 172.21.15.5:0/4210590524 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f45a405c1f0 con 0x7f45b40fbd00 2024-04-16T14:42:25.678 INFO:teuthology.orchestra.run.smithi005.stdout:HEALTH_OK 2024-04-16T14:42:25.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.681+0000 7f45b95d6700 1 -- 172.21.15.5:0/4210590524 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f459c06e140 msgr2=0x7f459c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:25.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.681+0000 7f45b95d6700 1 --2- 172.21.15.5:0/4210590524 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f459c06e140 0x7f459c0705f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f45a8006fd0 tx=0x7f45a8006db0 comp rx=0 tx=0).stop 2024-04-16T14:42:25.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.681+0000 7f45b95d6700 1 -- 172.21.15.5:0/4210590524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45b40fbd00 msgr2=0x7f45b40ffbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:25.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.681+0000 7f45b95d6700 1 --2- 172.21.15.5:0/4210590524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45b40fbd00 0x7f45b40ffbf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f45a4004740 tx=0x7f45a4004d10 comp rx=0 tx=0).stop 2024-04-16T14:42:25.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.681+0000 7f45b95d6700 1 -- 172.21.15.5:0/4210590524 shutdown_connections 2024-04-16T14:42:25.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.681+0000 7f45b95d6700 1 --2- 172.21.15.5:0/4210590524 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f459c06e140 0x7f459c0705f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:25.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.681+0000 7f45b95d6700 1 --2- 172.21.15.5:0/4210590524 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f45b40fbd00 0x7f45b40ffbf0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:25.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.681+0000 7f45b95d6700 1 --2- 172.21.15.5:0/4210590524 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45b40fcfb0 0x7f45b40fe2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:25.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.681+0000 7f45b95d6700 1 -- 172.21.15.5:0/4210590524 >> 172.21.15.5:0/4210590524 conn(0x7f45b40f74a0 msgr2=0x7f45b4066810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:25.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.682+0000 7f45b95d6700 1 -- 172.21.15.5:0/4210590524 shutdown_connections 2024-04-16T14:42:25.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:25.682+0000 7f45b95d6700 1 -- 172.21.15.5:0/4210590524 wait complete. 2024-04-16T14:42:25.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:25 smithi115 ceph-mon[83414]: pgmap v184: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:42:25.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:25 smithi115 ceph-mon[83414]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:42:25.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:25 smithi115 ceph-mon[83414]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:42:25.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:25 smithi115 ceph-mon[83414]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:42:25.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:25 smithi115 ceph-mon[83414]: osdmap e82: 6 total, 6 up, 6 in 2024-04-16T14:42:25.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:25 smithi115 ceph-mon[83414]: fsmap cephfs:1 {0=cephfs.smithi005.wofqlz=up:active} 2 up:standby 2024-04-16T14:42:25.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:25 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi005.vzoqdl"}]: dispatch 2024-04-16T14:42:25.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:25 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/171376624' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:25.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:25 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/1996288394' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:42:26.368 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:26 smithi005 ceph-mon[93420]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:42:26.369 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:26 smithi005 ceph-mon[93420]: pgmap v186: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:42:26.369 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:26 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/4210590524' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:42:26.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:26 smithi115 ceph-mon[83414]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:42:26.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:26 smithi115 ceph-mon[83414]: pgmap v186: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:42:26.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:26 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/4210590524' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:42:27.767 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:27 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:27.767 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:27 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:27.767 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:27 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:42:27.767 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:27 smithi005 ceph-mon[93420]: mds.? [v2:172.21.15.5:6826/3940274196,v1:172.21.15.5:6827/3940274196] up:boot 2024-04-16T14:42:27.767 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:27 smithi005 ceph-mon[93420]: fsmap cephfs:1 {0=cephfs.smithi005.wofqlz=up:active} 3 up:standby 2024-04-16T14:42:27.767 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:27 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi005.vzoqdl"}]: dispatch 2024-04-16T14:42:27.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:27 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:27.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:27 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:27.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:27 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:42:27.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:27 smithi115 ceph-mon[83414]: mds.? [v2:172.21.15.5:6826/3940274196,v1:172.21.15.5:6827/3940274196] up:boot 2024-04-16T14:42:27.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:27 smithi115 ceph-mon[83414]: fsmap cephfs:1 {0=cephfs.smithi005.wofqlz=up:active} 3 up:standby 2024-04-16T14:42:27.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:27 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi005.vzoqdl"}]: dispatch 2024-04-16T14:42:28.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:28 smithi115 ceph-mon[83414]: pgmap v187: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:42:28.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:28 smithi005 ceph-mon[93420]: pgmap v187: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:42:30.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:30 smithi115 ceph-mon[83414]: pgmap v188: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:42:30.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:30 smithi005 ceph-mon[93420]: pgmap v188: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:42:33.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:32 smithi115 ceph-mon[83414]: pgmap v189: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:42:33.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:33.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:33.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:32 smithi005 ceph-mon[93420]: pgmap v189: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:42:33.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:33.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:34.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:33 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:34.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:33 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:34.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:33 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:34.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:33 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:35.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:34 smithi115 ceph-mon[83414]: pgmap v190: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:42:35.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:34 smithi005 ceph-mon[93420]: pgmap v190: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:42:37.108 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:36 smithi005 ceph-mon[93420]: pgmap v191: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:42:37.109 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:36 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:37.109 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:36 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:37.109 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:36 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:42:37.109 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:36 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:42:37.109 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:36 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:37.109 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:36 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:42:37.109 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:36 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:37.109 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:36 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:37.109 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:36 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:37.109 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:36 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:37.110 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:36 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi005.wofqlz"]}]: dispatch 2024-04-16T14:42:37.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:36 smithi115 ceph-mon[83414]: pgmap v191: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:42:37.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:36 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:37.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:36 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:37.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:36 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:42:37.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:36 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:42:37.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:36 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:37.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:36 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:42:37.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:36 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:37.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:36 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:37.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:36 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:37.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:36 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:37.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:36 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi005.wofqlz"]}]: dispatch 2024-04-16T14:42:38.141 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:37 smithi005 ceph-mon[93420]: Detected new or changed devices on smithi005 2024-04-16T14:42:38.141 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:37 smithi005 ceph-mon[93420]: Upgrade: It appears safe to stop mds.cephfs.smithi005.wofqlz 2024-04-16T14:42:38.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:37 smithi115 ceph-mon[83414]: Detected new or changed devices on smithi005 2024-04-16T14:42:38.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:37 smithi115 ceph-mon[83414]: Upgrade: It appears safe to stop mds.cephfs.smithi005.wofqlz 2024-04-16T14:42:39.384 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:39 smithi005 ceph-mon[93420]: pgmap v192: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:42:39.384 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:39 smithi005 ceph-mon[93420]: Upgrade: Updating mds.cephfs.smithi005.wofqlz 2024-04-16T14:42:39.384 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:39.384 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi005.wofqlz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-16T14:42:39.384 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:42:39.385 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:39 smithi005 ceph-mon[93420]: Deploying daemon mds.cephfs.smithi005.wofqlz on smithi005 2024-04-16T14:42:39.385 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:42:39.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:39 smithi115 ceph-mon[83414]: pgmap v192: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:42:39.434 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:39 smithi115 ceph-mon[83414]: Upgrade: Updating mds.cephfs.smithi005.wofqlz 2024-04-16T14:42:39.434 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:39.434 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi005.wofqlz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-16T14:42:39.435 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:42:39.435 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:39 smithi115 ceph-mon[83414]: Deploying daemon mds.cephfs.smithi005.wofqlz on smithi005 2024-04-16T14:42:39.435 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:42:40.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:40 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi005[93411]: 2024-04-16T14:42:40.191+0000 7ff486045700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-16T14:42:41.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:41 smithi115 ceph-mon[83414]: pgmap v193: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:42:41.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:41 smithi115 ceph-mon[83414]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-16T14:42:41.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:41 smithi115 ceph-mon[83414]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-16T14:42:41.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:41 smithi115 ceph-mon[83414]: osdmap e83: 6 total, 6 up, 6 in 2024-04-16T14:42:41.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:41 smithi115 ceph-mon[83414]: Standby daemon mds.cephfs.smithi115.trkaqh assigned to filesystem cephfs as rank 0 2024-04-16T14:42:41.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:41 smithi115 ceph-mon[83414]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-16T14:42:41.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:41 smithi115 ceph-mon[83414]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-16T14:42:41.433 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:41 smithi115 ceph-mon[83414]: fsmap cephfs:1/1 {0=cephfs.smithi115.trkaqh=up:replay} 2 up:standby 2024-04-16T14:42:41.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:41 smithi005 ceph-mon[93420]: pgmap v193: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:42:41.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:41 smithi005 ceph-mon[93420]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-16T14:42:41.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:41 smithi005 ceph-mon[93420]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-16T14:42:41.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:41 smithi005 ceph-mon[93420]: osdmap e83: 6 total, 6 up, 6 in 2024-04-16T14:42:41.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:41 smithi005 ceph-mon[93420]: Standby daemon mds.cephfs.smithi115.trkaqh assigned to filesystem cephfs as rank 0 2024-04-16T14:42:41.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:41 smithi005 ceph-mon[93420]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-16T14:42:41.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:41 smithi005 ceph-mon[93420]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-16T14:42:41.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:41 smithi005 ceph-mon[93420]: fsmap cephfs:1/1 {0=cephfs.smithi115.trkaqh=up:replay} 2 up:standby 2024-04-16T14:42:43.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:43 smithi115 ceph-mon[83414]: pgmap v195: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 0 op/s 2024-04-16T14:42:43.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:43 smithi005 ceph-mon[93420]: pgmap v195: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 0 op/s 2024-04-16T14:42:45.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:45 smithi115 ceph-mon[83414]: pgmap v196: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 8.0 MiB/s rd, 3 op/s 2024-04-16T14:42:45.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:45 smithi005 ceph-mon[93420]: pgmap v196: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 8.0 MiB/s rd, 3 op/s 2024-04-16T14:42:47.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:47 smithi115 ceph-mon[83414]: pgmap v197: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 9.6 MiB/s rd, 3 op/s 2024-04-16T14:42:47.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:47 smithi005 ceph-mon[93420]: pgmap v197: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 9.6 MiB/s rd, 3 op/s 2024-04-16T14:42:48.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:48 smithi115 ceph-mon[83414]: reconnect by client.14536 v1:172.21.15.115:0/382738581 after 0 2024-04-16T14:42:48.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:48 smithi115 ceph-mon[83414]: reconnect by client.14530 v1:192.168.0.1:0/2074550415 after 0.000999981 2024-04-16T14:42:48.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:48 smithi115 ceph-mon[83414]: mds.? [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] up:reconnect 2024-04-16T14:42:48.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:48 smithi115 ceph-mon[83414]: fsmap cephfs:1/1 {0=cephfs.smithi115.trkaqh=up:reconnect} 2 up:standby 2024-04-16T14:42:48.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:48 smithi005 ceph-mon[93420]: reconnect by client.14536 v1:172.21.15.115:0/382738581 after 0 2024-04-16T14:42:48.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:48 smithi005 ceph-mon[93420]: reconnect by client.14530 v1:192.168.0.1:0/2074550415 after 0.000999981 2024-04-16T14:42:48.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:48 smithi005 ceph-mon[93420]: mds.? [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] up:reconnect 2024-04-16T14:42:48.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:48 smithi005 ceph-mon[93420]: fsmap cephfs:1/1 {0=cephfs.smithi115.trkaqh=up:reconnect} 2 up:standby 2024-04-16T14:42:49.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:49 smithi115 ceph-mon[83414]: pgmap v198: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-04-16T14:42:49.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:49 smithi115 ceph-mon[83414]: mds.? [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] up:rejoin 2024-04-16T14:42:49.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:49 smithi115 ceph-mon[83414]: fsmap cephfs:1/1 {0=cephfs.smithi115.trkaqh=up:rejoin} 2 up:standby 2024-04-16T14:42:49.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:49 smithi115 ceph-mon[83414]: daemon mds.cephfs.smithi115.trkaqh is now active in filesystem cephfs as rank 0 2024-04-16T14:42:49.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:49 smithi005 ceph-mon[93420]: pgmap v198: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-04-16T14:42:49.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:49 smithi005 ceph-mon[93420]: mds.? [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] up:rejoin 2024-04-16T14:42:49.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:49 smithi005 ceph-mon[93420]: fsmap cephfs:1/1 {0=cephfs.smithi115.trkaqh=up:rejoin} 2 up:standby 2024-04-16T14:42:49.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:49 smithi005 ceph-mon[93420]: daemon mds.cephfs.smithi115.trkaqh is now active in filesystem cephfs as rank 0 2024-04-16T14:42:50.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:50 smithi115 ceph-mon[83414]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-16T14:42:50.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:50 smithi115 ceph-mon[83414]: Cluster is now healthy 2024-04-16T14:42:50.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:50 smithi115 ceph-mon[83414]: mds.? [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] up:active 2024-04-16T14:42:50.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:50 smithi115 ceph-mon[83414]: fsmap cephfs:1 {0=cephfs.smithi115.trkaqh=up:active} 2 up:standby 2024-04-16T14:42:50.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:50 smithi005 ceph-mon[93420]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-16T14:42:50.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:50 smithi005 ceph-mon[93420]: Cluster is now healthy 2024-04-16T14:42:50.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:50 smithi005 ceph-mon[93420]: mds.? [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] up:active 2024-04-16T14:42:50.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:50 smithi005 ceph-mon[93420]: fsmap cephfs:1 {0=cephfs.smithi115.trkaqh=up:active} 2 up:standby 2024-04-16T14:42:51.291 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:51 smithi005 ceph-mon[93420]: pgmap v199: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-04-16T14:42:51.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:51 smithi115 ceph-mon[83414]: pgmap v199: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-04-16T14:42:52.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:52 smithi005 ceph-mon[93420]: pgmap v200: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 277 B/s wr, 7 op/s 2024-04-16T14:42:52.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:52 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:52.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:52 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:52.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:52 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:42:52.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:52 smithi005 ceph-mon[93420]: mds.? [v2:172.21.15.5:6828/3592708911,v1:172.21.15.5:6829/3592708911] up:boot 2024-04-16T14:42:52.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:52 smithi005 ceph-mon[93420]: fsmap cephfs:1 {0=cephfs.smithi115.trkaqh=up:active} 3 up:standby 2024-04-16T14:42:52.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:52 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi005.wofqlz"}]: dispatch 2024-04-16T14:42:53.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:52 smithi115 ceph-mon[83414]: pgmap v200: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 277 B/s wr, 7 op/s 2024-04-16T14:42:53.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:52 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:53.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:52 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:53.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:52 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:42:53.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:52 smithi115 ceph-mon[83414]: mds.? [v2:172.21.15.5:6828/3592708911,v1:172.21.15.5:6829/3592708911] up:boot 2024-04-16T14:42:53.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:52 smithi115 ceph-mon[83414]: fsmap cephfs:1 {0=cephfs.smithi115.trkaqh=up:active} 3 up:standby 2024-04-16T14:42:53.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:52 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi005.wofqlz"}]: dispatch 2024-04-16T14:42:53.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:53 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:42:54.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:53 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:42:54.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:54 smithi005 ceph-mon[93420]: pgmap v201: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 426 B/s wr, 7 op/s 2024-04-16T14:42:55.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:54 smithi115 ceph-mon[83414]: pgmap v201: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 426 B/s wr, 7 op/s 2024-04-16T14:42:55.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.791+0000 7fc1a17ac700 1 -- 172.21.15.5:0/1061703841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc19c0fe090 msgr2=0x7fc19c0fe500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:55.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.791+0000 7fc1a17ac700 1 --2- 172.21.15.5:0/1061703841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc19c0fe090 0x7fc19c0fe500 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc184004940 tx=0x7fc184009e30 comp rx=0 tx=0).stop 2024-04-16T14:42:55.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.791+0000 7fc1a17ac700 1 -- 172.21.15.5:0/1061703841 shutdown_connections 2024-04-16T14:42:55.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.791+0000 7fc1a17ac700 1 --2- 172.21.15.5:0/1061703841 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc19c0fe090 0x7fc19c0fe500 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:55.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.791+0000 7fc1a17ac700 1 --2- 172.21.15.5:0/1061703841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc19c0fcf20 0x7fc19c0fd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:55.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.791+0000 7fc1a17ac700 1 -- 172.21.15.5:0/1061703841 >> 172.21.15.5:0/1061703841 conn(0x7fc19c0f85c0 msgr2=0x7fc19c0faa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:55.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.791+0000 7fc1a17ac700 1 -- 172.21.15.5:0/1061703841 shutdown_connections 2024-04-16T14:42:55.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.791+0000 7fc1a17ac700 1 -- 172.21.15.5:0/1061703841 wait complete. 2024-04-16T14:42:55.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.792+0000 7fc1a17ac700 1 Processor -- start 2024-04-16T14:42:55.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.792+0000 7fc1a17ac700 1 -- start start 2024-04-16T14:42:55.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.792+0000 7fc1a17ac700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc19c0fcf20 0x7fc19c071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:55.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.792+0000 7fc1a17ac700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc19c0fe090 0x7fc19c070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:55.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.792+0000 7fc1a17ac700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c0708c0 con 0x7fc19c0fe090 2024-04-16T14:42:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.792+0000 7fc1a17ac700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c070a30 con 0x7fc19c0fcf20 2024-04-16T14:42:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.792+0000 7fc19a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc19c0fe090 0x7fc19c070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.792+0000 7fc19a7fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc19c0fe090 0x7fc19c070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37508/0 (socket says 172.21.15.5:37508) 2024-04-16T14:42:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.792+0000 7fc19a7fc700 1 -- 172.21.15.5:0/1117613842 learned_addr learned my addr 172.21.15.5:0/1117613842 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:42:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.792+0000 7fc19affd700 1 --2- 172.21.15.5:0/1117613842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc19c0fcf20 0x7fc19c071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.792+0000 7fc19a7fc700 1 -- 172.21.15.5:0/1117613842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc19c0fcf20 msgr2=0x7fc19c071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.792+0000 7fc19a7fc700 1 --2- 172.21.15.5:0/1117613842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc19c0fcf20 0x7fc19c071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.792+0000 7fc19a7fc700 1 -- 172.21.15.5:0/1117613842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc184005040 con 0x7fc19c0fe090 2024-04-16T14:42:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.792+0000 7fc19a7fc700 1 --2- 172.21.15.5:0/1117613842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc19c0fe090 0x7fc19c070310 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc18400b970 tx=0x7fc184009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.793+0000 7fc1937fe700 1 -- 172.21.15.5:0/1117613842 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc18400e040 con 0x7fc19c0fe090 2024-04-16T14:42:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.793+0000 7fc1937fe700 1 -- 172.21.15.5:0/1117613842 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc184004290 con 0x7fc19c0fe090 2024-04-16T14:42:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.793+0000 7fc1a17ac700 1 -- 172.21.15.5:0/1117613842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc19c070cb0 con 0x7fc19c0fe090 2024-04-16T14:42:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.793+0000 7fc1937fe700 1 -- 172.21.15.5:0/1117613842 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc18401c630 con 0x7fc19c0fe090 2024-04-16T14:42:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.793+0000 7fc1a17ac700 1 -- 172.21.15.5:0/1117613842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc19c115aa0 con 0x7fc19c0fe090 2024-04-16T14:42:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.794+0000 7fc1a17ac700 1 -- 172.21.15.5:0/1117613842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc19c05f5f0 con 0x7fc19c0fe090 2024-04-16T14:42:55.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.794+0000 7fc1937fe700 1 -- 172.21.15.5:0/1117613842 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fc1840139f0 con 0x7fc19c0fe090 2024-04-16T14:42:55.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.795+0000 7fc1937fe700 1 --2- 172.21.15.5:0/1117613842 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc18806e150 0x7fc188070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:55.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.795+0000 7fc1937fe700 1 -- 172.21.15.5:0/1117613842 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc18408eed0 con 0x7fc19c0fe090 2024-04-16T14:42:55.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.795+0000 7fc19affd700 1 --2- 172.21.15.5:0/1117613842 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc18806e150 0x7fc188070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:55.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.795+0000 7fc19affd700 1 --2- 172.21.15.5:0/1117613842 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc18806e150 0x7fc188070600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc18c004550 tx=0x7fc18c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:55.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:55.799+0000 7fc1937fe700 1 -- 172.21.15.5:0/1117613842 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fc184058280 con 0x7fc19c0fe090 2024-04-16T14:42:56.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.042+0000 7fc1a17ac700 1 -- 172.21.15.5:0/1117613842 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc19c1023f0 con 0x7fc18806e150 2024-04-16T14:42:56.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.044+0000 7fc1937fe700 1 -- 172.21.15.5:0/1117613842 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc19c1023f0 con 0x7fc18806e150 2024-04-16T14:42:56.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.046+0000 7fc1a17ac700 1 -- 172.21.15.5:0/1117613842 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc18806e150 msgr2=0x7fc188070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:56.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.046+0000 7fc1a17ac700 1 --2- 172.21.15.5:0/1117613842 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc18806e150 0x7fc188070600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc18c004550 tx=0x7fc18c009040 comp rx=0 tx=0).stop 2024-04-16T14:42:56.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.046+0000 7fc1a17ac700 1 -- 172.21.15.5:0/1117613842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc19c0fe090 msgr2=0x7fc19c070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:56.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.046+0000 7fc1a17ac700 1 --2- 172.21.15.5:0/1117613842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc19c0fe090 0x7fc19c070310 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc18400b970 tx=0x7fc184009e30 comp rx=0 tx=0).stop 2024-04-16T14:42:56.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.046+0000 7fc1a17ac700 1 -- 172.21.15.5:0/1117613842 shutdown_connections 2024-04-16T14:42:56.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.046+0000 7fc1a17ac700 1 --2- 172.21.15.5:0/1117613842 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc18806e150 0x7fc188070600 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:56.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.046+0000 7fc1a17ac700 1 --2- 172.21.15.5:0/1117613842 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc19c0fcf20 0x7fc19c071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:56.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.046+0000 7fc1a17ac700 1 --2- 172.21.15.5:0/1117613842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc19c0fe090 0x7fc19c070310 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:56.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.046+0000 7fc1a17ac700 1 -- 172.21.15.5:0/1117613842 >> 172.21.15.5:0/1117613842 conn(0x7fc19c0f85c0 msgr2=0x7fc19c0f9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:56.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.046+0000 7fc1a17ac700 1 -- 172.21.15.5:0/1117613842 shutdown_connections 2024-04-16T14:42:56.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.046+0000 7fc1a17ac700 1 -- 172.21.15.5:0/1117613842 wait complete. 2024-04-16T14:42:56.057 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-04-16T14:42:56.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.164+0000 7f2738a5d700 1 -- 172.21.15.5:0/3241985742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2734066270 msgr2=0x7f27340ffab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:56.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.164+0000 7f2738a5d700 1 --2- 172.21.15.5:0/3241985742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2734066270 0x7f27340ffab0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2724004940 tx=0x7f2724009e30 comp rx=0 tx=0).stop 2024-04-16T14:42:56.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.165+0000 7f2738a5d700 1 -- 172.21.15.5:0/3241985742 shutdown_connections 2024-04-16T14:42:56.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.165+0000 7f2738a5d700 1 --2- 172.21.15.5:0/3241985742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27340ffff0 0x7f27341023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:56.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.165+0000 7f2738a5d700 1 --2- 172.21.15.5:0/3241985742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2734066270 0x7f27340ffab0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:56.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.165+0000 7f2738a5d700 1 -- 172.21.15.5:0/3241985742 >> 172.21.15.5:0/3241985742 conn(0x7f27340f74c0 msgr2=0x7f27340f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:56.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.165+0000 7f2738a5d700 1 -- 172.21.15.5:0/3241985742 shutdown_connections 2024-04-16T14:42:56.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.165+0000 7f2738a5d700 1 -- 172.21.15.5:0/3241985742 wait complete. 2024-04-16T14:42:56.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.165+0000 7f2738a5d700 1 Processor -- start 2024-04-16T14:42:56.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.165+0000 7f2738a5d700 1 -- start start 2024-04-16T14:42:56.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.165+0000 7f2738a5d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2734066270 0x7f273410fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:56.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.165+0000 7f2738a5d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27340ffff0 0x7f2734110160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:56.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.165+0000 7f2738a5d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2734110760 con 0x7f2734066270 2024-04-16T14:42:56.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.165+0000 7f2738a5d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2734110fb0 con 0x7f27340ffff0 2024-04-16T14:42:56.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.166+0000 7f273259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2734066270 0x7f273410fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:56.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.166+0000 7f273259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2734066270 0x7f273410fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37522/0 (socket says 172.21.15.5:37522) 2024-04-16T14:42:56.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.166+0000 7f273259c700 1 -- 172.21.15.5:0/98631168 learned_addr learned my addr 172.21.15.5:0/98631168 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:42:56.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.166+0000 7f2731d9b700 1 --2- 172.21.15.5:0/98631168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27340ffff0 0x7f2734110160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:56.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.166+0000 7f273259c700 1 -- 172.21.15.5:0/98631168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27340ffff0 msgr2=0x7f2734110160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:56.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.166+0000 7f273259c700 1 --2- 172.21.15.5:0/98631168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27340ffff0 0x7f2734110160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:56.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.166+0000 7f273259c700 1 -- 172.21.15.5:0/98631168 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2724005040 con 0x7f2734066270 2024-04-16T14:42:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.166+0000 7f273259c700 1 --2- 172.21.15.5:0/98631168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2734066270 0x7f273410fc20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2724000c00 tx=0x7f2724009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.166+0000 7f2722ffd700 1 -- 172.21.15.5:0/98631168 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f272400e040 con 0x7f2734066270 2024-04-16T14:42:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.166+0000 7f2722ffd700 1 -- 172.21.15.5:0/98631168 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f272400bcc0 con 0x7f2734066270 2024-04-16T14:42:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.166+0000 7f2738a5d700 1 -- 172.21.15.5:0/98631168 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2734111230 con 0x7f2734066270 2024-04-16T14:42:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.166+0000 7f2722ffd700 1 -- 172.21.15.5:0/98631168 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f272401c630 con 0x7f2734066270 2024-04-16T14:42:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.166+0000 7f2738a5d700 1 -- 172.21.15.5:0/98631168 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2734111770 con 0x7f2734066270 2024-04-16T14:42:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.167+0000 7f2738a5d700 1 -- 172.21.15.5:0/98631168 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273405f5f0 con 0x7f2734066270 2024-04-16T14:42:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.168+0000 7f2722ffd700 1 -- 172.21.15.5:0/98631168 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f272401c790 con 0x7f2734066270 2024-04-16T14:42:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.168+0000 7f2722ffd700 1 --2- 172.21.15.5:0/98631168 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f271c06e140 0x7f271c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.168+0000 7f2722ffd700 1 -- 172.21.15.5:0/98631168 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f272408ee60 con 0x7f2734066270 2024-04-16T14:42:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.169+0000 7f2731d9b700 1 --2- 172.21.15.5:0/98631168 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f271c06e140 0x7f271c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.169+0000 7f2731d9b700 1 --2- 172.21.15.5:0/98631168 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f271c06e140 0x7f271c0705f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2728009fd0 tx=0x7f2728009f60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:56.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.173+0000 7f2722ffd700 1 -- 172.21.15.5:0/98631168 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f272405be00 con 0x7f2734066270 2024-04-16T14:42:56.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.403+0000 7f2738a5d700 1 -- 172.21.15.5:0/98631168 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2734111b40 con 0x7f271c06e140 2024-04-16T14:42:56.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.405+0000 7f2722ffd700 1 -- 172.21.15.5:0/98631168 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2734111b40 con 0x7f271c06e140 2024-04-16T14:42:56.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.407+0000 7f2738a5d700 1 -- 172.21.15.5:0/98631168 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f271c06e140 msgr2=0x7f271c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:56.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.407+0000 7f2738a5d700 1 --2- 172.21.15.5:0/98631168 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f271c06e140 0x7f271c0705f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2728009fd0 tx=0x7f2728009f60 comp rx=0 tx=0).stop 2024-04-16T14:42:56.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.407+0000 7f2738a5d700 1 -- 172.21.15.5:0/98631168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2734066270 msgr2=0x7f273410fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:56.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.407+0000 7f2738a5d700 1 --2- 172.21.15.5:0/98631168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2734066270 0x7f273410fc20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2724000c00 tx=0x7f2724009e30 comp rx=0 tx=0).stop 2024-04-16T14:42:56.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.407+0000 7f2738a5d700 1 -- 172.21.15.5:0/98631168 shutdown_connections 2024-04-16T14:42:56.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.407+0000 7f2738a5d700 1 --2- 172.21.15.5:0/98631168 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f271c06e140 0x7f271c0705f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:56.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.407+0000 7f2738a5d700 1 --2- 172.21.15.5:0/98631168 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2734066270 0x7f273410fc20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:56.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.407+0000 7f2738a5d700 1 --2- 172.21.15.5:0/98631168 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27340ffff0 0x7f2734110160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:56.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.407+0000 7f2738a5d700 1 -- 172.21.15.5:0/98631168 >> 172.21.15.5:0/98631168 conn(0x7f27340f74c0 msgr2=0x7f27340fbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:56.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.407+0000 7f2738a5d700 1 -- 172.21.15.5:0/98631168 shutdown_connections 2024-04-16T14:42:56.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.407+0000 7f2738a5d700 1 -- 172.21.15.5:0/98631168 wait complete. 2024-04-16T14:42:56.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.514+0000 7f140b623700 1 -- 172.21.15.5:0/1644468043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1404066250 msgr2=0x7f14040ffad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:56.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.514+0000 7f140b623700 1 --2- 172.21.15.5:0/1644468043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1404066250 0x7f14040ffad0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1400004940 tx=0x7f1400009e30 comp rx=0 tx=0).stop 2024-04-16T14:42:56.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.514+0000 7f140b623700 1 -- 172.21.15.5:0/1644468043 shutdown_connections 2024-04-16T14:42:56.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.514+0000 7f140b623700 1 --2- 172.21.15.5:0/1644468043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1404100010 0x7f14041023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:56.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.514+0000 7f140b623700 1 --2- 172.21.15.5:0/1644468043 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1404066250 0x7f14040ffad0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:56.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.514+0000 7f140b623700 1 -- 172.21.15.5:0/1644468043 >> 172.21.15.5:0/1644468043 conn(0x7f14040f74c0 msgr2=0x7f14040f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:56.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.514+0000 7f140b623700 1 -- 172.21.15.5:0/1644468043 shutdown_connections 2024-04-16T14:42:56.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.514+0000 7f140b623700 1 -- 172.21.15.5:0/1644468043 wait complete. 2024-04-16T14:42:56.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.515+0000 7f140b623700 1 Processor -- start 2024-04-16T14:42:56.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.515+0000 7f140b623700 1 -- start start 2024-04-16T14:42:56.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.515+0000 7f140b623700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1404066250 0x7f140410da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:56.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.515+0000 7f140b623700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1404100010 0x7f140410dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:56.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.515+0000 7f140b623700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140410e5b0 con 0x7f1404100010 2024-04-16T14:42:56.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.515+0000 7f140b623700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140410ee00 con 0x7f1404066250 2024-04-16T14:42:56.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.515+0000 7f1408bbe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1404100010 0x7f140410dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:56.518 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.515+0000 7f1408bbe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1404100010 0x7f140410dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37538/0 (socket says 172.21.15.5:37538) 2024-04-16T14:42:56.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.515+0000 7f1408bbe700 1 -- 172.21.15.5:0/437302384 learned_addr learned my addr 172.21.15.5:0/437302384 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:42:56.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.515+0000 7f14093bf700 1 --2- 172.21.15.5:0/437302384 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1404066250 0x7f140410da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:56.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.515+0000 7f1408bbe700 1 -- 172.21.15.5:0/437302384 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1404066250 msgr2=0x7f140410da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:56.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.515+0000 7f1408bbe700 1 --2- 172.21.15.5:0/437302384 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1404066250 0x7f140410da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:56.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.515+0000 7f1408bbe700 1 -- 172.21.15.5:0/437302384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1400005040 con 0x7f1404100010 2024-04-16T14:42:56.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.515+0000 7f14093bf700 1 --2- 172.21.15.5:0/437302384 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1404066250 0x7f140410da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:42:56.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.515+0000 7f1408bbe700 1 --2- 172.21.15.5:0/437302384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1404100010 0x7f140410dfb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f13f8002a50 tx=0x7f13f80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:56.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.516+0000 7f13f5ffb700 1 -- 172.21.15.5:0/437302384 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13f8007cc0 con 0x7f1404100010 2024-04-16T14:42:56.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.516+0000 7f13f5ffb700 1 -- 172.21.15.5:0/437302384 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f13f800f040 con 0x7f1404100010 2024-04-16T14:42:56.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.516+0000 7f140b623700 1 -- 172.21.15.5:0/437302384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f140410f0e0 con 0x7f1404100010 2024-04-16T14:42:56.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.516+0000 7f13f5ffb700 1 -- 172.21.15.5:0/437302384 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13f8009640 con 0x7f1404100010 2024-04-16T14:42:56.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.516+0000 7f140b623700 1 -- 172.21.15.5:0/437302384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140410f620 con 0x7f1404100010 2024-04-16T14:42:56.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.517+0000 7f140b623700 1 -- 172.21.15.5:0/437302384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f140405f5f0 con 0x7f1404100010 2024-04-16T14:42:56.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.518+0000 7f13f5ffb700 1 -- 172.21.15.5:0/437302384 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f13f80097a0 con 0x7f1404100010 2024-04-16T14:42:56.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.518+0000 7f13f5ffb700 1 --2- 172.21.15.5:0/437302384 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f13f006e140 0x7f13f00705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:56.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.518+0000 7f13f5ffb700 1 -- 172.21.15.5:0/437302384 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f13f808d8a0 con 0x7f1404100010 2024-04-16T14:42:56.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.518+0000 7f14093bf700 1 --2- 172.21.15.5:0/437302384 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f13f006e140 0x7f13f00705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:56.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.519+0000 7f14093bf700 1 --2- 172.21.15.5:0/437302384 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f13f006e140 0x7f13f00705f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f140000b3b0 tx=0x7f1400009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:56.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.523+0000 7f13f5ffb700 1 -- 172.21.15.5:0/437302384 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f13f805a780 con 0x7f1404100010 2024-04-16T14:42:56.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.742+0000 7f140b623700 1 -- 172.21.15.5:0/437302384 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f140410fa00 con 0x7f13f006e140 2024-04-16T14:42:56.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.753+0000 7f13f5ffb700 1 -- 172.21.15.5:0/437302384 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f140410fa00 con 0x7f13f006e140 2024-04-16T14:42:56.752 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-16T14:42:56.752 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.smithi005 smithi005 *:9093,9094 running (7m) 0s ago 15m 24.5M - 0.25.0 c8568f914cd2 f8aaa22ee70c 2024-04-16T14:42:56.752 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi005 smithi005 running (4m) 0s ago 15m 6656k - 19.0.0-2204-g36befe5d b1a78730e0db d6efa08e65e3 2024-04-16T14:42:56.752 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi115 smithi115 running (4m) 75s ago 14m 6660k - 19.0.0-2204-g36befe5d b1a78730e0db b2a2f2965e2a 2024-04-16T14:42:56.752 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.smithi005 smithi005 *:3000 running (7m) 0s ago 15m 84.9M - 9.4.7 954c08fa6188 9834229a010c 2024-04-16T14:42:56.752 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.vzoqdl smithi005 running (30s) 0s ago 10m 14.0M - 19.0.0-2204-g36befe5d b1a78730e0db acc0c83a4fd1 2024-04-16T14:42:56.752 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.wofqlz smithi005 running (5s) 0s ago 10m 13.8M - 19.0.0-2204-g36befe5d b1a78730e0db bff714c6004b 2024-04-16T14:42:56.752 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.byfytg smithi115 running (10m) 75s ago 10m 118M - 17.2.7-868-g412a5526 b04d96489b7c 595cd0892f66 2024-04-16T14:42:56.753 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.trkaqh smithi115 running (9m) 75s ago 9m 14.5M - 17.2.7-868-g412a5526 b04d96489b7c 5b60cd2ad79b 2024-04-16T14:42:56.753 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi005.ipwdkc smithi005 *:8443,9283,8765 running (6m) 0s ago 16m 509M - 19.0.0-2204-g36befe5d b1a78730e0db 451192b4fc44 2024-04-16T14:42:56.753 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi115.brjkpo smithi115 *:8443,9283,8765 running (5m) 75s ago 14m 450M - 19.0.0-2204-g36befe5d b1a78730e0db 0d75f8211942 2024-04-16T14:42:56.753 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi005 smithi005 running (5m) 0s ago 17m 49.7M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3d0c00924867 2024-04-16T14:42:56.753 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi115 smithi115 running (5m) 75s ago 14m 43.8M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3b916a4928b2 2024-04-16T14:42:56.753 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi005 smithi005 *:9100 running (7m) 0s ago 15m 16.6M - 1.5.0 0da6a335fe13 c09bba584a42 2024-04-16T14:42:56.753 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi115 smithi115 *:9100 running (6m) 75s ago 14m 16.7M - 1.5.0 0da6a335fe13 78cc9cc150c0 2024-04-16T14:42:56.753 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (4m) 0s ago 13m 111M 1559M 19.0.0-2204-g36befe5d b1a78730e0db 91d9246d45e0 2024-04-16T14:42:56.753 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (3m) 0s ago 13m 111M 1559M 19.0.0-2204-g36befe5d b1a78730e0db d930ce515e3e 2024-04-16T14:42:56.753 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (3m) 0s ago 12m 87.1M 1559M 19.0.0-2204-g36befe5d b1a78730e0db fdc5fe68ac57 2024-04-16T14:42:56.753 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi115 running (2m) 75s ago 12m 104M 2581M 19.0.0-2204-g36befe5d b1a78730e0db 808ebb96c862 2024-04-16T14:42:56.753 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi115 running (112s) 75s ago 12m 95.0M 2581M 19.0.0-2204-g36befe5d b1a78730e0db 74d7d2ac5a6a 2024-04-16T14:42:56.754 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi115 running (79s) 75s ago 11m 11.5M 2581M 19.0.0-2204-g36befe5d b1a78730e0db 484bc7617d80 2024-04-16T14:42:56.754 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.smithi005 smithi005 *:9095 running (6m) 0s ago 15m 58.2M - 2.43.0 a07b618ecd1d dc784e58817c 2024-04-16T14:42:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.755+0000 7f140b623700 1 -- 172.21.15.5:0/437302384 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f13f006e140 msgr2=0x7f13f00705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.755+0000 7f140b623700 1 --2- 172.21.15.5:0/437302384 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f13f006e140 0x7f13f00705f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f140000b3b0 tx=0x7f1400009e30 comp rx=0 tx=0).stop 2024-04-16T14:42:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.755+0000 7f140b623700 1 -- 172.21.15.5:0/437302384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1404100010 msgr2=0x7f140410dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:56.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.755+0000 7f140b623700 1 --2- 172.21.15.5:0/437302384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1404100010 0x7f140410dfb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f13f8002a50 tx=0x7f13f80046b0 comp rx=0 tx=0).stop 2024-04-16T14:42:56.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.755+0000 7f140b623700 1 -- 172.21.15.5:0/437302384 shutdown_connections 2024-04-16T14:42:56.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.755+0000 7f140b623700 1 --2- 172.21.15.5:0/437302384 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f13f006e140 0x7f13f00705f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:56.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.755+0000 7f140b623700 1 --2- 172.21.15.5:0/437302384 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1404066250 0x7f140410da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:56.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.755+0000 7f140b623700 1 --2- 172.21.15.5:0/437302384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1404100010 0x7f140410dfb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:56.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.755+0000 7f140b623700 1 -- 172.21.15.5:0/437302384 >> 172.21.15.5:0/437302384 conn(0x7f14040f74c0 msgr2=0x7f14040f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:56.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.755+0000 7f140b623700 1 -- 172.21.15.5:0/437302384 shutdown_connections 2024-04-16T14:42:56.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.755+0000 7f140b623700 1 -- 172.21.15.5:0/437302384 wait complete. 2024-04-16T14:42:56.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.862+0000 7f9ed1786700 1 -- 172.21.15.5:0/2866019587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ecc071e40 msgr2=0x7f9ecc070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:56.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.862+0000 7f9ed1786700 1 --2- 172.21.15.5:0/2866019587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ecc071e40 0x7f9ecc070350 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc009ce0 tx=0x7f9ebc004d10 comp rx=0 tx=0).stop 2024-04-16T14:42:56.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.862+0000 7f9ed1786700 1 -- 172.21.15.5:0/2866019587 shutdown_connections 2024-04-16T14:42:56.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.862+0000 7f9ed1786700 1 --2- 172.21.15.5:0/2866019587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ecc070890 0x7f9ecc070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:56.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.862+0000 7f9ed1786700 1 --2- 172.21.15.5:0/2866019587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ecc071e40 0x7f9ecc070350 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:56.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.862+0000 7f9ed1786700 1 -- 172.21.15.5:0/2866019587 >> 172.21.15.5:0/2866019587 conn(0x7f9ecc0f85e0 msgr2=0x7f9ecc0fa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:56.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.862+0000 7f9ed1786700 1 -- 172.21.15.5:0/2866019587 shutdown_connections 2024-04-16T14:42:56.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.862+0000 7f9ed1786700 1 -- 172.21.15.5:0/2866019587 wait complete. 2024-04-16T14:42:56.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.863+0000 7f9ed1786700 1 Processor -- start 2024-04-16T14:42:56.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.863+0000 7f9ed1786700 1 -- start start 2024-04-16T14:42:56.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.863+0000 7f9ed1786700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ecc070890 0x7f9ecc10fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:56.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.863+0000 7f9ed1786700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ecc071e40 0x7f9ecc110350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:56.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.863+0000 7f9ed1786700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc1110f0 con 0x7f9ecc070890 2024-04-16T14:42:56.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.863+0000 7f9ed1786700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc111260 con 0x7f9ecc071e40 2024-04-16T14:42:56.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.863+0000 7f9ecaffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ecc070890 0x7f9ecc10fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:56.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.864+0000 7f9ecaffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ecc070890 0x7f9ecc10fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37544/0 (socket says 172.21.15.5:37544) 2024-04-16T14:42:56.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.864+0000 7f9ecaffd700 1 -- 172.21.15.5:0/2401598036 learned_addr learned my addr 172.21.15.5:0/2401598036 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:42:56.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.864+0000 7f9ec27fc700 1 --2- 172.21.15.5:0/2401598036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ecc071e40 0x7f9ecc110350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:56.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.864+0000 7f9ecaffd700 1 -- 172.21.15.5:0/2401598036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ecc071e40 msgr2=0x7f9ecc110350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:56.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.864+0000 7f9ecaffd700 1 --2- 172.21.15.5:0/2401598036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ecc071e40 0x7f9ecc110350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:56.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.864+0000 7f9ecaffd700 1 -- 172.21.15.5:0/2401598036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ebc009940 con 0x7f9ecc070890 2024-04-16T14:42:56.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.864+0000 7f9ecaffd700 1 --2- 172.21.15.5:0/2401598036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ecc070890 0x7f9ecc10fe10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc0095d0 tx=0x7f9ebc004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:56.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.864+0000 7f9ec3fff700 1 -- 172.21.15.5:0/2401598036 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ebc00e040 con 0x7f9ecc070890 2024-04-16T14:42:56.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.864+0000 7f9ec3fff700 1 -- 172.21.15.5:0/2401598036 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ebc0128e0 con 0x7f9ecc070890 2024-04-16T14:42:56.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.864+0000 7f9ed1786700 1 -- 172.21.15.5:0/2401598036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ecc1114e0 con 0x7f9ecc070890 2024-04-16T14:42:56.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.864+0000 7f9ec3fff700 1 -- 172.21.15.5:0/2401598036 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ebc01c9a0 con 0x7f9ecc070890 2024-04-16T14:42:56.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.864+0000 7f9ed1786700 1 -- 172.21.15.5:0/2401598036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ecc111aa0 con 0x7f9ecc070890 2024-04-16T14:42:56.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.865+0000 7f9ed1786700 1 -- 172.21.15.5:0/2401598036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ecc108300 con 0x7f9ecc070890 2024-04-16T14:42:56.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.866+0000 7f9ec3fff700 1 -- 172.21.15.5:0/2401598036 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f9ebc012410 con 0x7f9ecc070890 2024-04-16T14:42:56.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.866+0000 7f9ec3fff700 1 --2- 172.21.15.5:0/2401598036 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f9eb806e140 0x7f9eb80705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:56.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.867+0000 7f9ec3fff700 1 -- 172.21.15.5:0/2401598036 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f9ebc08f790 con 0x7f9ecc070890 2024-04-16T14:42:56.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.867+0000 7f9ec27fc700 1 --2- 172.21.15.5:0/2401598036 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f9eb806e140 0x7f9eb80705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:56.867 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.867+0000 7f9ec27fc700 1 --2- 172.21.15.5:0/2401598036 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f9eb806e140 0x7f9eb80705f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc10fba0 tx=0x7f9eb400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:56.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:56.872+0000 7f9ec3fff700 1 -- 172.21.15.5:0/2401598036 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f9ebc058ac0 con 0x7f9ecc070890 2024-04-16T14:42:56.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:56 smithi005 ceph-mon[93420]: pgmap v202: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 6.8 MiB/s rd, 426 B/s wr, 5 op/s 2024-04-16T14:42:56.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:56 smithi005 ceph-mon[93420]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:42:56.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:56 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:56.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:56 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:57.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.178+0000 7f9ed1786700 1 -- 172.21.15.5:0/2401598036 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9ecc111d80 con 0x7f9ecc070890 2024-04-16T14:42:57.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.178+0000 7f9ec3fff700 1 -- 172.21.15.5:0/2401598036 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7f9ebc004e10 con 0x7f9ecc070890 2024-04-16T14:42:57.177 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:42:57.177 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-04-16T14:42:57.177 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:42:57.177 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:42:57.177 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-04-16T14:42:57.177 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:42:57.177 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:42:57.177 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-04-16T14:42:57.177 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 6 2024-04-16T14:42:57.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:42:57.178 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-04-16T14:42:57.178 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 2, 2024-04-16T14:42:57.178 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:42:57.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:42:57.178 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-04-16T14:42:57.178 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 17.2.7-868-g412a5526 (412a55265f2f22574094a21d5a03e20633d86ce0) quincy (stable)": 2, 2024-04-16T14:42:57.178 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 12 2024-04-16T14:42:57.178 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-16T14:42:57.178 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:42:57.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.181+0000 7f9ed1786700 1 -- 172.21.15.5:0/2401598036 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f9eb806e140 msgr2=0x7f9eb80705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:57.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.181+0000 7f9ed1786700 1 --2- 172.21.15.5:0/2401598036 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f9eb806e140 0x7f9eb80705f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc10fba0 tx=0x7f9eb400b040 comp rx=0 tx=0).stop 2024-04-16T14:42:57.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.181+0000 7f9ed1786700 1 -- 172.21.15.5:0/2401598036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ecc070890 msgr2=0x7f9ecc10fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:57.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.181+0000 7f9ed1786700 1 --2- 172.21.15.5:0/2401598036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ecc070890 0x7f9ecc10fe10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc0095d0 tx=0x7f9ebc004d10 comp rx=0 tx=0).stop 2024-04-16T14:42:57.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.181+0000 7f9ed1786700 1 -- 172.21.15.5:0/2401598036 shutdown_connections 2024-04-16T14:42:57.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.181+0000 7f9ed1786700 1 --2- 172.21.15.5:0/2401598036 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f9eb806e140 0x7f9eb80705f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:57.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.181+0000 7f9ed1786700 1 --2- 172.21.15.5:0/2401598036 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ecc070890 0x7f9ecc10fe10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:57.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.181+0000 7f9ed1786700 1 --2- 172.21.15.5:0/2401598036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ecc071e40 0x7f9ecc110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:57.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.181+0000 7f9ed1786700 1 -- 172.21.15.5:0/2401598036 >> 172.21.15.5:0/2401598036 conn(0x7f9ecc0f85e0 msgr2=0x7f9ecc0f9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:57.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.181+0000 7f9ed1786700 1 -- 172.21.15.5:0/2401598036 shutdown_connections 2024-04-16T14:42:57.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.181+0000 7f9ed1786700 1 -- 172.21.15.5:0/2401598036 wait complete. 2024-04-16T14:42:57.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:56 smithi115 ceph-mon[83414]: pgmap v202: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 6.8 MiB/s rd, 426 B/s wr, 5 op/s 2024-04-16T14:42:57.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:56 smithi115 ceph-mon[83414]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:42:57.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:56 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:57.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:56 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:57.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.290+0000 7fa92ef60700 1 -- 172.21.15.5:0/420707283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9280fbe20 msgr2=0x7fa9280fc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.290+0000 7fa92ef60700 1 --2- 172.21.15.5:0/420707283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9280fbe20 0x7fa9280fc230 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa91c004940 tx=0x7fa91c009e30 comp rx=0 tx=0).stop 2024-04-16T14:42:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.290+0000 7fa92ef60700 1 -- 172.21.15.5:0/420707283 shutdown_connections 2024-04-16T14:42:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.290+0000 7fa92ef60700 1 --2- 172.21.15.5:0/420707283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9280fcf90 0x7fa9280fd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.290+0000 7fa92ef60700 1 --2- 172.21.15.5:0/420707283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9280fbe20 0x7fa9280fc230 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:57.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.290+0000 7fa92ef60700 1 -- 172.21.15.5:0/420707283 >> 172.21.15.5:0/420707283 conn(0x7fa9280f74e0 msgr2=0x7fa9280f9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.290+0000 7fa92ef60700 1 -- 172.21.15.5:0/420707283 shutdown_connections 2024-04-16T14:42:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.290+0000 7fa92ef60700 1 -- 172.21.15.5:0/420707283 wait complete. 2024-04-16T14:42:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.291+0000 7fa92ef60700 1 Processor -- start 2024-04-16T14:42:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.291+0000 7fa92ef60700 1 -- start start 2024-04-16T14:42:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.291+0000 7fa92ef60700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9280fbe20 0x7fa92810dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.291+0000 7fa92ef60700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9280fcf90 0x7fa92810e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.291+0000 7fa92ef60700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92810e600 con 0x7fa9280fbe20 2024-04-16T14:42:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.291+0000 7fa92ef60700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92810ee00 con 0x7fa9280fcf90 2024-04-16T14:42:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.291+0000 7fa92ccfc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9280fbe20 0x7fa92810dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.291+0000 7fa92ccfc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9280fbe20 0x7fa92810dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37568/0 (socket says 172.21.15.5:37568) 2024-04-16T14:42:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.291+0000 7fa92ccfc700 1 -- 172.21.15.5:0/3479631306 learned_addr learned my addr 172.21.15.5:0/3479631306 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:42:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.291+0000 7fa927fff700 1 --2- 172.21.15.5:0/3479631306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9280fcf90 0x7fa92810e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.292+0000 7fa92ccfc700 1 -- 172.21.15.5:0/3479631306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9280fcf90 msgr2=0x7fa92810e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:57.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.292+0000 7fa92ccfc700 1 --2- 172.21.15.5:0/3479631306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9280fcf90 0x7fa92810e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.292+0000 7fa92ccfc700 1 -- 172.21.15.5:0/3479631306 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91c005040 con 0x7fa9280fbe20 2024-04-16T14:42:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.292+0000 7fa92ccfc700 1 --2- 172.21.15.5:0/3479631306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9280fbe20 0x7fa92810dac0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00b970 tx=0x7fa91c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.292+0000 7fa9257fa700 1 -- 172.21.15.5:0/3479631306 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa91c00e040 con 0x7fa9280fbe20 2024-04-16T14:42:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.292+0000 7fa9257fa700 1 -- 172.21.15.5:0/3479631306 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa91c00bbf0 con 0x7fa9280fbe20 2024-04-16T14:42:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.292+0000 7fa9257fa700 1 -- 172.21.15.5:0/3479631306 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa91c01c630 con 0x7fa9280fbe20 2024-04-16T14:42:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.292+0000 7fa92ef60700 1 -- 172.21.15.5:0/3479631306 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa92810f080 con 0x7fa9280fbe20 2024-04-16T14:42:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.292+0000 7fa92ef60700 1 -- 172.21.15.5:0/3479631306 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa92810f5c0 con 0x7fa9280fbe20 2024-04-16T14:42:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.293+0000 7fa92ef60700 1 -- 172.21.15.5:0/3479631306 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa928101b20 con 0x7fa9280fbe20 2024-04-16T14:42:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.294+0000 7fa9257fa700 1 -- 172.21.15.5:0/3479631306 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fa91c00bd60 con 0x7fa9280fbe20 2024-04-16T14:42:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.295+0000 7fa9257fa700 1 --2- 172.21.15.5:0/3479631306 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa91806e140 0x7fa9180705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.295+0000 7fa927fff700 1 --2- 172.21.15.5:0/3479631306 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa91806e140 0x7fa9180705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.295+0000 7fa9257fa700 1 -- 172.21.15.5:0/3479631306 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa91c08eef0 con 0x7fa9280fbe20 2024-04-16T14:42:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.295+0000 7fa927fff700 1 --2- 172.21.15.5:0/3479631306 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa91806e140 0x7fa9180705f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa914004f40 tx=0x7fa91400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:57.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.301+0000 7fa9257fa700 1 -- 172.21.15.5:0/3479631306 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fa91c05bdd0 con 0x7fa9280fbe20 2024-04-16T14:42:57.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.556+0000 7fa92ef60700 1 -- 172.21.15.5:0/3479631306 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa928101540 con 0x7fa9280fbe20 2024-04-16T14:42:57.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.557+0000 7fa9257fa700 1 -- 172.21.15.5:0/3479631306 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 34 v34) v1 ==== 76+0+1892 (secure 0 0 0) 0x7fa91c05b960 con 0x7fa9280fbe20 2024-04-16T14:42:57.558 INFO:teuthology.orchestra.run.smithi005.stdout:e34 2024-04-16T14:42:57.558 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:42:57.558 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:42:57.558 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2024-04-16T14:42:57.558 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:42:57.558 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2024-04-16T14:42:57.558 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2024-04-16T14:42:57.558 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 33 2024-04-16T14:42:57.559 INFO:teuthology.orchestra.run.smithi005.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-16T14:42:57.559 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-16T14:32:45.270024+0000 2024-04-16T14:42:57.559 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-04-16T14:42:49.154682+0000 2024-04-16T14:42:57.559 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2024-04-16T14:42:57.559 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2024-04-16T14:42:57.559 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 60 2024-04-16T14:42:57.559 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2024-04-16T14:42:57.559 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2024-04-16T14:42:57.559 INFO:teuthology.orchestra.run.smithi005.stdout:max_xattr_size 65536 2024-04-16T14:42:57.559 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2024-04-16T14:42:57.559 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2024-04-16T14:42:57.559 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 83 2024-04-16T14:42:57.559 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:42:57.560 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 1 2024-04-16T14:42:57.560 INFO:teuthology.orchestra.run.smithi005.stdout:in 0 2024-04-16T14:42:57.560 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=24275} 2024-04-16T14:42:57.560 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2024-04-16T14:42:57.560 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2024-04-16T14:42:57.560 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 1 2024-04-16T14:42:57.560 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3] 2024-04-16T14:42:57.560 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2024-04-16T14:42:57.560 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2024-04-16T14:42:57.560 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2024-04-16T14:42:57.561 INFO:teuthology.orchestra.run.smithi005.stdout:bal_rank_mask -1 2024-04-16T14:42:57.561 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 1 2024-04-16T14:42:57.561 INFO:teuthology.orchestra.run.smithi005.stdout:qdb_cluster leader: 24275 members: 24275 2024-04-16T14:42:57.561 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.trkaqh{0:24275} state up:active seq 151 join_fscid=1 addr [v2:172.21.15.115:6826/2476249308,v1:172.21.15.115:6827/2476249308] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:42:57.561 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:42:57.561 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:42:57.561 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2024-04-16T14:42:57.561 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:42:57.561 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.vzoqdl{-1:34434} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.5:6826/3940274196,v1:172.21.15.5:6827/3940274196] compat {c=[1],r=[1],i=[1fff]}] 2024-04-16T14:42:57.561 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.wofqlz{-1:34438} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.5:6828/3592708911,v1:172.21.15.5:6829/3592708911] compat {c=[1],r=[1],i=[1fff]}] 2024-04-16T14:42:57.561 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.byfytg{-1:44277} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.115:6824/1266846723,v1:172.21.15.115:6825/1266846723] compat {c=[1],r=[1],i=[7ff]}] 2024-04-16T14:42:57.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.559+0000 7fa92ef60700 1 -- 172.21.15.5:0/3479631306 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa91806e140 msgr2=0x7fa9180705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:57.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.559+0000 7fa92ef60700 1 --2- 172.21.15.5:0/3479631306 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa91806e140 0x7fa9180705f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa914004f40 tx=0x7fa91400b040 comp rx=0 tx=0).stop 2024-04-16T14:42:57.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.559+0000 7fa92ef60700 1 -- 172.21.15.5:0/3479631306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9280fbe20 msgr2=0x7fa92810dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:57.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.559+0000 7fa92ef60700 1 --2- 172.21.15.5:0/3479631306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9280fbe20 0x7fa92810dac0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa91c00b970 tx=0x7fa91c009e30 comp rx=0 tx=0).stop 2024-04-16T14:42:57.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.559+0000 7fa92ef60700 1 -- 172.21.15.5:0/3479631306 shutdown_connections 2024-04-16T14:42:57.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.559+0000 7fa92ef60700 1 --2- 172.21.15.5:0/3479631306 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa91806e140 0x7fa9180705f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:57.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.559+0000 7fa92ef60700 1 --2- 172.21.15.5:0/3479631306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa9280fbe20 0x7fa92810dac0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:57.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.559+0000 7fa92ef60700 1 --2- 172.21.15.5:0/3479631306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9280fcf90 0x7fa92810e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:57.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.559+0000 7fa92ef60700 1 -- 172.21.15.5:0/3479631306 >> 172.21.15.5:0/3479631306 conn(0x7fa9280f74e0 msgr2=0x7fa9280f8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:57.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.559+0000 7fa92ef60700 1 -- 172.21.15.5:0/3479631306 shutdown_connections 2024-04-16T14:42:57.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.559+0000 7fa92ef60700 1 -- 172.21.15.5:0/3479631306 wait complete. 2024-04-16T14:42:57.567 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 34 2024-04-16T14:42:57.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.666+0000 7f88a454e700 1 -- 172.21.15.5:0/1667514588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f889c0fce50 msgr2=0x7f889c0fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:57.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.666+0000 7f88a454e700 1 --2- 172.21.15.5:0/1667514588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f889c0fce50 0x7f889c0fd260 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8898004940 tx=0x7f8898009e30 comp rx=0 tx=0).stop 2024-04-16T14:42:57.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.666+0000 7f88a454e700 1 -- 172.21.15.5:0/1667514588 shutdown_connections 2024-04-16T14:42:57.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.666+0000 7f88a454e700 1 --2- 172.21.15.5:0/1667514588 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f889c0fe050 0x7f889c0fe4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:57.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.666+0000 7f88a454e700 1 --2- 172.21.15.5:0/1667514588 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f889c0fce50 0x7f889c0fd260 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.666+0000 7f88a454e700 1 -- 172.21.15.5:0/1667514588 >> 172.21.15.5:0/1667514588 conn(0x7f889c0f8580 msgr2=0x7f889c0fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.666+0000 7f88a454e700 1 -- 172.21.15.5:0/1667514588 shutdown_connections 2024-04-16T14:42:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.666+0000 7f88a454e700 1 -- 172.21.15.5:0/1667514588 wait complete. 2024-04-16T14:42:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.667+0000 7f88a454e700 1 Processor -- start 2024-04-16T14:42:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.667+0000 7f88a454e700 1 -- start start 2024-04-16T14:42:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.667+0000 7f88a454e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f889c0fce50 0x7f889c10fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.667+0000 7f88a454e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f889c0fe050 0x7f889c110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:57.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.667+0000 7f88a454e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c110890 con 0x7f889c0fce50 2024-04-16T14:42:57.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.667+0000 7f88a454e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c110fd0 con 0x7f889c0fe050 2024-04-16T14:42:57.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.667+0000 7f88a22ea700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f889c0fce50 0x7f889c10fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:57.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.667+0000 7f88a22ea700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f889c0fce50 0x7f889c10fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37578/0 (socket says 172.21.15.5:37578) 2024-04-16T14:42:57.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.667+0000 7f88a22ea700 1 -- 172.21.15.5:0/41763068 learned_addr learned my addr 172.21.15.5:0/41763068 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:42:57.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.667+0000 7f88a1ae9700 1 --2- 172.21.15.5:0/41763068 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f889c0fe050 0x7f889c110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:57.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.668+0000 7f88a22ea700 1 -- 172.21.15.5:0/41763068 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f889c0fe050 msgr2=0x7f889c110290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:57.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.668+0000 7f88a22ea700 1 --2- 172.21.15.5:0/41763068 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f889c0fe050 0x7f889c110290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:57.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.668+0000 7f88a22ea700 1 -- 172.21.15.5:0/41763068 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8898005040 con 0x7f889c0fce50 2024-04-16T14:42:57.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.668+0000 7f88a22ea700 1 --2- 172.21.15.5:0/41763068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f889c0fce50 0x7f889c10fd50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8898000c00 tx=0x7f8898009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:57.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.668+0000 7f888effd700 1 -- 172.21.15.5:0/41763068 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f889800e040 con 0x7f889c0fce50 2024-04-16T14:42:57.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.668+0000 7f88a454e700 1 -- 172.21.15.5:0/41763068 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f889c111250 con 0x7f889c0fce50 2024-04-16T14:42:57.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.668+0000 7f888effd700 1 -- 172.21.15.5:0/41763068 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f889800bbf0 con 0x7f889c0fce50 2024-04-16T14:42:57.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.668+0000 7f888effd700 1 -- 172.21.15.5:0/41763068 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f889801c630 con 0x7f889c0fce50 2024-04-16T14:42:57.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.668+0000 7f88a454e700 1 -- 172.21.15.5:0/41763068 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f889c111810 con 0x7f889c0fce50 2024-04-16T14:42:57.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.669+0000 7f88a454e700 1 -- 172.21.15.5:0/41763068 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889c1019e0 con 0x7f889c0fce50 2024-04-16T14:42:57.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.670+0000 7f888effd700 1 -- 172.21.15.5:0/41763068 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f889800bd60 con 0x7f889c0fce50 2024-04-16T14:42:57.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.670+0000 7f888effd700 1 --2- 172.21.15.5:0/41763068 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f888806e140 0x7f88880705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:57.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.671+0000 7f888effd700 1 -- 172.21.15.5:0/41763068 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f889808ede0 con 0x7f889c0fce50 2024-04-16T14:42:57.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.671+0000 7f88a1ae9700 1 --2- 172.21.15.5:0/41763068 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f888806e140 0x7f88880705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:57.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.671+0000 7f88a1ae9700 1 --2- 172.21.15.5:0/41763068 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f888806e140 0x7f88880705f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8890007fd0 tx=0x7f8890009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:57.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.675+0000 7f888effd700 1 -- 172.21.15.5:0/41763068 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f889805bcc0 con 0x7f889c0fce50 2024-04-16T14:42:57.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.919+0000 7f88a454e700 1 -- 172.21.15.5:0/41763068 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f889c111a80 con 0x7f888806e140 2024-04-16T14:42:57.918 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:57 smithi005 ceph-mon[93420]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:42:57.918 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:57 smithi005 ceph-mon[93420]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:42:57.918 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:57 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/2401598036' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:57.918 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:57 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:57.918 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:57 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:57.918 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:57 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/3479631306' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:42:57.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.920+0000 7f888effd700 1 -- 172.21.15.5:0/41763068 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f889c111a80 con 0x7f888806e140 2024-04-16T14:42:57.919 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:42:57.919 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91", 2024-04-16T14:42:57.919 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-04-16T14:42:57.919 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-16T14:42:57.919 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [ 2024-04-16T14:42:57.919 INFO:teuthology.orchestra.run.smithi005.stdout: "mon", 2024-04-16T14:42:57.920 INFO:teuthology.orchestra.run.smithi005.stdout: "osd", 2024-04-16T14:42:57.920 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr", 2024-04-16T14:42:57.920 INFO:teuthology.orchestra.run.smithi005.stdout: "crash" 2024-04-16T14:42:57.920 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-04-16T14:42:57.920 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "14/21 daemons upgraded", 2024-04-16T14:42:57.920 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading mds daemons", 2024-04-16T14:42:57.920 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-04-16T14:42:57.920 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:42:57.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.923+0000 7f88a454e700 1 -- 172.21.15.5:0/41763068 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f888806e140 msgr2=0x7f88880705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:57.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.923+0000 7f88a454e700 1 --2- 172.21.15.5:0/41763068 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f888806e140 0x7f88880705f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8890007fd0 tx=0x7f8890009040 comp rx=0 tx=0).stop 2024-04-16T14:42:57.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.923+0000 7f88a454e700 1 -- 172.21.15.5:0/41763068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f889c0fce50 msgr2=0x7f889c10fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:57.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.923+0000 7f88a454e700 1 --2- 172.21.15.5:0/41763068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f889c0fce50 0x7f889c10fd50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8898000c00 tx=0x7f8898009e30 comp rx=0 tx=0).stop 2024-04-16T14:42:57.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.923+0000 7f88a454e700 1 -- 172.21.15.5:0/41763068 shutdown_connections 2024-04-16T14:42:57.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.923+0000 7f88a454e700 1 --2- 172.21.15.5:0/41763068 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f888806e140 0x7f88880705f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:57.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.923+0000 7f88a454e700 1 --2- 172.21.15.5:0/41763068 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f889c0fce50 0x7f889c10fd50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:57.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.923+0000 7f88a454e700 1 --2- 172.21.15.5:0/41763068 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f889c0fe050 0x7f889c110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:57.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.923+0000 7f88a454e700 1 -- 172.21.15.5:0/41763068 >> 172.21.15.5:0/41763068 conn(0x7f889c0f8580 msgr2=0x7f889c0f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:57.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.923+0000 7f88a454e700 1 -- 172.21.15.5:0/41763068 shutdown_connections 2024-04-16T14:42:57.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:57.923+0000 7f88a454e700 1 -- 172.21.15.5:0/41763068 wait complete. 2024-04-16T14:42:58.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.029+0000 7f71b873e700 1 -- 172.21.15.5:0/3526539317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b00fcc90 msgr2=0x7f71b00fd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:58.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.029+0000 7f71b873e700 1 --2- 172.21.15.5:0/3526539317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b00fcc90 0x7f71b00fd100 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f71a4004940 tx=0x7f71a4009e30 comp rx=0 tx=0).stop 2024-04-16T14:42:58.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.029+0000 7f71b873e700 1 -- 172.21.15.5:0/3526539317 shutdown_connections 2024-04-16T14:42:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.029+0000 7f71b873e700 1 --2- 172.21.15.5:0/3526539317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b00fcc90 0x7f71b00fd100 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.029+0000 7f71b873e700 1 --2- 172.21.15.5:0/3526539317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b00fc340 0x7f71b00fc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.029+0000 7f71b873e700 1 -- 172.21.15.5:0/3526539317 >> 172.21.15.5:0/3526539317 conn(0x7f71b00f6c10 msgr2=0x7f71b00f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.030+0000 7f71b873e700 1 -- 172.21.15.5:0/3526539317 shutdown_connections 2024-04-16T14:42:58.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.030+0000 7f71b873e700 1 -- 172.21.15.5:0/3526539317 wait complete. 2024-04-16T14:42:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.030+0000 7f71b873e700 1 Processor -- start 2024-04-16T14:42:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.030+0000 7f71b873e700 1 -- start start 2024-04-16T14:42:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.030+0000 7f71b873e700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b00fc340 0x7f71b00ffcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.030+0000 7f71b873e700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b00fcc90 0x7f71b00fe440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.030+0000 7f71b873e700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b01002f0 con 0x7f71b00fcc90 2024-04-16T14:42:58.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.030+0000 7f71b873e700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b00fe980 con 0x7f71b00fc340 2024-04-16T14:42:58.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.030+0000 7f71b5cd9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b00fcc90 0x7f71b00fe440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:58.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.030+0000 7f71b5cd9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b00fcc90 0x7f71b00fe440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37596/0 (socket says 172.21.15.5:37596) 2024-04-16T14:42:58.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.030+0000 7f71b5cd9700 1 -- 172.21.15.5:0/3362959751 learned_addr learned my addr 172.21.15.5:0/3362959751 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:42:58.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.031+0000 7f71b64da700 1 --2- 172.21.15.5:0/3362959751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b00fc340 0x7f71b00ffcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:58.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.031+0000 7f71b5cd9700 1 -- 172.21.15.5:0/3362959751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b00fc340 msgr2=0x7f71b00ffcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:58.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.031+0000 7f71b5cd9700 1 --2- 172.21.15.5:0/3362959751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b00fc340 0x7f71b00ffcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:58.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.031+0000 7f71b5cd9700 1 -- 172.21.15.5:0/3362959751 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a4005040 con 0x7f71b00fcc90 2024-04-16T14:42:58.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.031+0000 7f71b5cd9700 1 --2- 172.21.15.5:0/3362959751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b00fcc90 0x7f71b00fe440 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009380 tx=0x7f71a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:58.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.031+0000 7f71aeffd700 1 -- 172.21.15.5:0/3362959751 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71a400e040 con 0x7f71b00fcc90 2024-04-16T14:42:58.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.031+0000 7f71b873e700 1 -- 172.21.15.5:0/3362959751 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b00fec00 con 0x7f71b00fcc90 2024-04-16T14:42:58.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.031+0000 7f71aeffd700 1 -- 172.21.15.5:0/3362959751 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f71a400bbf0 con 0x7f71b00fcc90 2024-04-16T14:42:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.031+0000 7f71b873e700 1 -- 172.21.15.5:0/3362959751 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b00ff1c0 con 0x7f71b00fcc90 2024-04-16T14:42:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.031+0000 7f71aeffd700 1 -- 172.21.15.5:0/3362959751 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71a4025400 con 0x7f71b00fcc90 2024-04-16T14:42:58.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.032+0000 7f71b873e700 1 -- 172.21.15.5:0/3362959751 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b0101c90 con 0x7f71b00fcc90 2024-04-16T14:42:58.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.033+0000 7f71aeffd700 1 -- 172.21.15.5:0/3362959751 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f71a400bd60 con 0x7f71b00fcc90 2024-04-16T14:42:58.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.033+0000 7f71aeffd700 1 --2- 172.21.15.5:0/3362959751 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f719806e140 0x7f71980705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:42:58.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.033+0000 7f71aeffd700 1 -- 172.21.15.5:0/3362959751 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f71a408ee50 con 0x7f71b00fcc90 2024-04-16T14:42:58.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.033+0000 7f71b64da700 1 --2- 172.21.15.5:0/3362959751 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f719806e140 0x7f71980705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:42:58.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.034+0000 7f71b64da700 1 --2- 172.21.15.5:0/3362959751 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f719806e140 0x7f71980705f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f71a0004fd0 tx=0x7f71a0009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:42:58.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.038+0000 7f71aeffd700 1 -- 172.21.15.5:0/3362959751 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f71a405bcb0 con 0x7f71b00fcc90 2024-04-16T14:42:58.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:57 smithi115 ceph-mon[83414]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:42:58.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:57 smithi115 ceph-mon[83414]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:42:58.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:57 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/2401598036' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:42:58.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:57 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:58.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:57 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:42:58.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:57 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/3479631306' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:42:58.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.341+0000 7f71b873e700 1 -- 172.21.15.5:0/3362959751 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f71b004c710 con 0x7f71b00fcc90 2024-04-16T14:42:58.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.341+0000 7f71aeffd700 1 -- 172.21.15.5:0/3362959751 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f71a405b840 con 0x7f71b00fcc90 2024-04-16T14:42:58.341 INFO:teuthology.orchestra.run.smithi005.stdout:HEALTH_OK 2024-04-16T14:42:58.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.343+0000 7f71b873e700 1 -- 172.21.15.5:0/3362959751 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f719806e140 msgr2=0x7f71980705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:58.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.343+0000 7f71b873e700 1 --2- 172.21.15.5:0/3362959751 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f719806e140 0x7f71980705f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f71a0004fd0 tx=0x7f71a0009040 comp rx=0 tx=0).stop 2024-04-16T14:42:58.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.343+0000 7f71b873e700 1 -- 172.21.15.5:0/3362959751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b00fcc90 msgr2=0x7f71b00fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:42:58.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.343+0000 7f71b873e700 1 --2- 172.21.15.5:0/3362959751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b00fcc90 0x7f71b00fe440 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009380 tx=0x7f71a4009e30 comp rx=0 tx=0).stop 2024-04-16T14:42:58.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.343+0000 7f71b873e700 1 -- 172.21.15.5:0/3362959751 shutdown_connections 2024-04-16T14:42:58.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.343+0000 7f71b873e700 1 --2- 172.21.15.5:0/3362959751 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f719806e140 0x7f71980705f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:58.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.343+0000 7f71b873e700 1 --2- 172.21.15.5:0/3362959751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b00fc340 0x7f71b00ffcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:58.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.343+0000 7f71b873e700 1 --2- 172.21.15.5:0/3362959751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71b00fcc90 0x7f71b00fe440 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:42:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.343+0000 7f71b873e700 1 -- 172.21.15.5:0/3362959751 >> 172.21.15.5:0/3362959751 conn(0x7f71b00f6c10 msgr2=0x7f71b00fb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:42:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.344+0000 7f71b873e700 1 -- 172.21.15.5:0/3362959751 shutdown_connections 2024-04-16T14:42:58.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:42:58.344+0000 7f71b873e700 1 -- 172.21.15.5:0/3362959751 wait complete. 2024-04-16T14:42:59.008 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:58 smithi005 ceph-mon[93420]: pgmap v203: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 5.5 MiB/s rd, 426 B/s wr, 5 op/s 2024-04-16T14:42:59.008 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:58 smithi005 ceph-mon[93420]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:42:59.008 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:42:58 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/3362959751' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:42:59.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:58 smithi115 ceph-mon[83414]: pgmap v203: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 5.5 MiB/s rd, 426 B/s wr, 5 op/s 2024-04-16T14:42:59.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:58 smithi115 ceph-mon[83414]: from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:42:59.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:42:58 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/3362959751' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:43:00.835 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:00 smithi005 ceph-mon[93420]: pgmap v204: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 4.6 KiB/s wr, 6 op/s 2024-04-16T14:43:01.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:00 smithi115 ceph-mon[83414]: pgmap v204: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 4.6 KiB/s wr, 6 op/s 2024-04-16T14:43:02.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:01 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:02.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:01 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:02.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:01 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:43:02.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:01 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:43:02.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:01 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:02.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:01 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:43:02.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:01 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:02.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:01 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:02.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:01 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:02.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:01 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:02.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:01 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi115.byfytg"]}]: dispatch 2024-04-16T14:43:02.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:01 smithi115 ceph-mon[83414]: Upgrade: It appears safe to stop mds.cephfs.smithi115.byfytg 2024-04-16T14:43:02.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:01 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:02.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:01 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:02.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:01 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:43:02.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:01 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:43:02.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:01 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:02.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:01 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:43:02.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:01 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:02.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:01 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:02.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:01 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:02.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:01 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:02.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:01 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi115.byfytg"]}]: dispatch 2024-04-16T14:43:02.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:01 smithi005 ceph-mon[93420]: Upgrade: It appears safe to stop mds.cephfs.smithi115.byfytg 2024-04-16T14:43:03.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:02 smithi115 ceph-mon[83414]: pgmap v205: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 4.6 KiB/s wr, 5 op/s 2024-04-16T14:43:03.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:02 smithi005 ceph-mon[93420]: pgmap v205: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 345 KiB/s rd, 4.6 KiB/s wr, 5 op/s 2024-04-16T14:43:04.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:03 smithi115 ceph-mon[83414]: Upgrade: Updating mds.cephfs.smithi115.byfytg 2024-04-16T14:43:04.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:03 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:04.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:03 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.byfytg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-16T14:43:04.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:03 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:43:04.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:03 smithi115 ceph-mon[83414]: Deploying daemon mds.cephfs.smithi115.byfytg on smithi115 2024-04-16T14:43:04.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:03 smithi005 ceph-mon[93420]: Upgrade: Updating mds.cephfs.smithi115.byfytg 2024-04-16T14:43:04.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:03 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:04.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:03 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.byfytg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-16T14:43:04.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:03 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:43:04.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:03 smithi005 ceph-mon[93420]: Deploying daemon mds.cephfs.smithi115.byfytg on smithi115 2024-04-16T14:43:05.023 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:04 smithi115 ceph-mon[83414]: pgmap v206: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 4.3 KiB/s wr, 3 op/s 2024-04-16T14:43:05.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:04 smithi005 ceph-mon[93420]: pgmap v206: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 4.3 KiB/s wr, 3 op/s 2024-04-16T14:43:07.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:06 smithi115 ceph-mon[83414]: pgmap v207: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 2 op/s 2024-04-16T14:43:07.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:06 smithi115 ceph-mon[83414]: osdmap e84: 6 total, 6 up, 6 in 2024-04-16T14:43:07.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:06 smithi115 ceph-mon[83414]: fsmap cephfs:1 {0=cephfs.smithi115.trkaqh=up:active} 2 up:standby 2024-04-16T14:43:07.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:06 smithi005 ceph-mon[93420]: pgmap v207: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 2 op/s 2024-04-16T14:43:07.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:06 smithi005 ceph-mon[93420]: osdmap e84: 6 total, 6 up, 6 in 2024-04-16T14:43:07.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:06 smithi005 ceph-mon[93420]: fsmap cephfs:1 {0=cephfs.smithi115.trkaqh=up:active} 2 up:standby 2024-04-16T14:43:09.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:08 smithi115 ceph-mon[83414]: pgmap v209: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 5.0 KiB/s wr, 2 op/s 2024-04-16T14:43:09.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:08 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:43:09.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:08 smithi005 ceph-mon[93420]: pgmap v209: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 5.0 KiB/s wr, 2 op/s 2024-04-16T14:43:09.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:08 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:43:10.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:09 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.byfytg"}]: dispatch 2024-04-16T14:43:10.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:09 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.byfytg"}]: dispatch 2024-04-16T14:43:11.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:10 smithi115 ceph-mon[83414]: pgmap v210: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:43:11.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:10 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:11.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:10 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:11.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:10 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:43:11.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:10 smithi005 ceph-mon[93420]: pgmap v210: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:43:11.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:10 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:11.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:10 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:11.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:10 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:43:12.212 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:11 smithi115 ceph-mon[83414]: mds.? [v2:172.21.15.115:6824/1461659094,v1:172.21.15.115:6825/1461659094] up:boot 2024-04-16T14:43:12.213 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:11 smithi115 ceph-mon[83414]: fsmap cephfs:1 {0=cephfs.smithi115.trkaqh=up:active} 3 up:standby 2024-04-16T14:43:12.213 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:11 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.byfytg"}]: dispatch 2024-04-16T14:43:12.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:11 smithi005 ceph-mon[93420]: mds.? [v2:172.21.15.115:6824/1461659094,v1:172.21.15.115:6825/1461659094] up:boot 2024-04-16T14:43:12.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:11 smithi005 ceph-mon[93420]: fsmap cephfs:1 {0=cephfs.smithi115.trkaqh=up:active} 3 up:standby 2024-04-16T14:43:12.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:11 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.byfytg"}]: dispatch 2024-04-16T14:43:13.188 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:12 smithi115 ceph-mon[83414]: pgmap v211: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:43:13.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:12 smithi005 ceph-mon[93420]: pgmap v211: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:43:14.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:14 smithi005 ceph-mon[93420]: pgmap v212: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:43:14.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:14 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:14.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:14 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:14.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:14 smithi115 ceph-mon[83414]: pgmap v212: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:43:14.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:14 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:14.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:14 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:15.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:15 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:15.933 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:15 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:15.978 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:15 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:15.978 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:15 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:16.756 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:16 smithi115 ceph-mon[83414]: pgmap v213: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:43:16.848 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:16 smithi005 ceph-mon[93420]: pgmap v213: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:43:19.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:19 smithi115 ceph-mon[83414]: pgmap v214: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:43:19.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:19 smithi115 ceph-mon[83414]: Detected new or changed devices on smithi115 2024-04-16T14:43:19.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:19 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:19.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:19 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:19.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:19 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:43:19.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:19 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:43:19.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:19 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:19.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:19 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:43:19.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:19 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:19.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:19 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:19.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:19 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:19.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:19 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:19.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:19 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi115.trkaqh"]}]: dispatch 2024-04-16T14:43:19.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:19 smithi005 ceph-mon[93420]: pgmap v214: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:43:19.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:19 smithi005 ceph-mon[93420]: Detected new or changed devices on smithi115 2024-04-16T14:43:19.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:19 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:19.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:19 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:19.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:19 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:43:19.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:19 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:43:19.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:19 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:19.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:19 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:43:19.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:19 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:19.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:19 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:19.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:19 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:19.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:19 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:19.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:19 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi115.trkaqh"]}]: dispatch 2024-04-16T14:43:20.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:20 smithi115 ceph-mon[83414]: Upgrade: It appears safe to stop mds.cephfs.smithi115.trkaqh 2024-04-16T14:43:20.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:20 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:20.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:20 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.trkaqh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-16T14:43:20.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:20 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:43:20.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:20 smithi005 ceph-mon[93420]: Upgrade: It appears safe to stop mds.cephfs.smithi115.trkaqh 2024-04-16T14:43:20.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:20 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:20.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:20 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi115.trkaqh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-16T14:43:20.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:20 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:43:21.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:21 smithi115 ceph-mon[83414]: pgmap v215: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:43:21.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:21 smithi115 ceph-mon[83414]: Upgrade: Updating mds.cephfs.smithi115.trkaqh 2024-04-16T14:43:21.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:21 smithi115 ceph-mon[83414]: Deploying daemon mds.cephfs.smithi115.trkaqh on smithi115 2024-04-16T14:43:21.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:21 smithi005 ceph-mon[93420]: pgmap v215: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:43:21.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:21 smithi005 ceph-mon[93420]: Upgrade: Updating mds.cephfs.smithi115.trkaqh 2024-04-16T14:43:21.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:21 smithi005 ceph-mon[93420]: Deploying daemon mds.cephfs.smithi115.trkaqh on smithi115 2024-04-16T14:43:22.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:22 smithi115 ceph-mon[83414]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-16T14:43:22.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:22 smithi115 ceph-mon[83414]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-16T14:43:22.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:22 smithi115 ceph-mon[83414]: osdmap e85: 6 total, 6 up, 6 in 2024-04-16T14:43:22.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:22 smithi115 ceph-mon[83414]: Standby daemon mds.cephfs.smithi005.vzoqdl assigned to filesystem cephfs as rank 0 2024-04-16T14:43:22.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:22 smithi115 ceph-mon[83414]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-16T14:43:22.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:22 smithi115 ceph-mon[83414]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-16T14:43:22.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:22 smithi115 ceph-mon[83414]: fsmap cephfs:1/1 {0=cephfs.smithi005.vzoqdl=up:replay} 2 up:standby 2024-04-16T14:43:22.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:22 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi005[93411]: 2024-04-16T14:43:22.064+0000 7ff486045700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-16T14:43:22.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:22 smithi005 ceph-mon[93420]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-16T14:43:22.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:22 smithi005 ceph-mon[93420]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-16T14:43:22.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:22 smithi005 ceph-mon[93420]: osdmap e85: 6 total, 6 up, 6 in 2024-04-16T14:43:22.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:22 smithi005 ceph-mon[93420]: Standby daemon mds.cephfs.smithi005.vzoqdl assigned to filesystem cephfs as rank 0 2024-04-16T14:43:22.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:22 smithi005 ceph-mon[93420]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-16T14:43:22.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:22 smithi005 ceph-mon[93420]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-16T14:43:22.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:22 smithi005 ceph-mon[93420]: fsmap cephfs:1/1 {0=cephfs.smithi005.vzoqdl=up:replay} 2 up:standby 2024-04-16T14:43:23.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:23 smithi115 ceph-mon[83414]: pgmap v216: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:43:23.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:23 smithi005 ceph-mon[93420]: pgmap v216: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:43:24.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:24 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:24.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:24 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:43:24.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:24 smithi115 ceph-mon[83414]: pgmap v218: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 4.4 MiB/s rd, 1 op/s 2024-04-16T14:43:24.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:24.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:43:24.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:24 smithi005 ceph-mon[93420]: pgmap v218: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 4.4 MiB/s rd, 1 op/s 2024-04-16T14:43:26.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:26 smithi115 ceph-mon[83414]: pgmap v219: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 5.6 MiB/s rd, 2 op/s 2024-04-16T14:43:26.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:26 smithi005 ceph-mon[93420]: pgmap v219: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 5.6 MiB/s rd, 2 op/s 2024-04-16T14:43:28.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.452+0000 7fc4475f5700 1 -- 172.21.15.5:0/3909082304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4400fc320 msgr2=0x7fc4400fc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:28.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.452+0000 7fc4475f5700 1 --2- 172.21.15.5:0/3909082304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4400fc320 0x7fc4400fc730 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc43c004940 tx=0x7fc43c009e30 comp rx=0 tx=0).stop 2024-04-16T14:43:28.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.452+0000 7fc4475f5700 1 -- 172.21.15.5:0/3909082304 shutdown_connections 2024-04-16T14:43:28.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.452+0000 7fc4475f5700 1 --2- 172.21.15.5:0/3909082304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4400fcc70 0x7fc4400fd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:28.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.452+0000 7fc4475f5700 1 --2- 172.21.15.5:0/3909082304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4400fc320 0x7fc4400fc730 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:28.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.452+0000 7fc4475f5700 1 -- 172.21.15.5:0/3909082304 >> 172.21.15.5:0/3909082304 conn(0x7fc4400f6bd0 msgr2=0x7fc4400f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:43:28.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.452+0000 7fc4475f5700 1 -- 172.21.15.5:0/3909082304 shutdown_connections 2024-04-16T14:43:28.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.452+0000 7fc4475f5700 1 -- 172.21.15.5:0/3909082304 wait complete. 2024-04-16T14:43:28.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.452+0000 7fc4475f5700 1 Processor -- start 2024-04-16T14:43:28.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.452+0000 7fc4475f5700 1 -- start start 2024-04-16T14:43:28.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.453+0000 7fc4475f5700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4400fc320 0x7fc44010c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:43:28.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.453+0000 7fc4475f5700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4400fcc70 0x7fc44010ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:43:28.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.453+0000 7fc4475f5700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44010d450 con 0x7fc4400fc320 2024-04-16T14:43:28.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.453+0000 7fc4475f5700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44010dca0 con 0x7fc4400fcc70 2024-04-16T14:43:28.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.453+0000 7fc445391700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4400fc320 0x7fc44010c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:43:28.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.453+0000 7fc445391700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4400fc320 0x7fc44010c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49514/0 (socket says 172.21.15.5:49514) 2024-04-16T14:43:28.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.453+0000 7fc445391700 1 -- 172.21.15.5:0/3819088223 learned_addr learned my addr 172.21.15.5:0/3819088223 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:43:28.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.453+0000 7fc444b90700 1 --2- 172.21.15.5:0/3819088223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4400fcc70 0x7fc44010ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:43:28.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.453+0000 7fc445391700 1 -- 172.21.15.5:0/3819088223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4400fcc70 msgr2=0x7fc44010ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:28.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.453+0000 7fc445391700 1 --2- 172.21.15.5:0/3819088223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4400fcc70 0x7fc44010ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:28.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.453+0000 7fc445391700 1 -- 172.21.15.5:0/3819088223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c005040 con 0x7fc4400fc320 2024-04-16T14:43:28.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.453+0000 7fc445391700 1 --2- 172.21.15.5:0/3819088223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4400fc320 0x7fc44010c910 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00b3b0 tx=0x7fc43c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:43:28.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.454+0000 7fc435ffb700 1 -- 172.21.15.5:0/3819088223 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc43c00e040 con 0x7fc4400fc320 2024-04-16T14:43:28.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.454+0000 7fc435ffb700 1 -- 172.21.15.5:0/3819088223 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc43c004290 con 0x7fc4400fc320 2024-04-16T14:43:28.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.454+0000 7fc4475f5700 1 -- 172.21.15.5:0/3819088223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc44010df20 con 0x7fc4400fc320 2024-04-16T14:43:28.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.454+0000 7fc435ffb700 1 -- 172.21.15.5:0/3819088223 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc43c01c3f0 con 0x7fc4400fc320 2024-04-16T14:43:28.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.454+0000 7fc4475f5700 1 -- 172.21.15.5:0/3819088223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc44010e460 con 0x7fc4400fc320 2024-04-16T14:43:28.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.455+0000 7fc4475f5700 1 -- 172.21.15.5:0/3819088223 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc44005f5f0 con 0x7fc4400fc320 2024-04-16T14:43:28.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.456+0000 7fc435ffb700 1 -- 172.21.15.5:0/3819088223 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fc43c00bbf0 con 0x7fc4400fc320 2024-04-16T14:43:28.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.457+0000 7fc435ffb700 1 --2- 172.21.15.5:0/3819088223 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc42c06e150 0x7fc42c070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:43:28.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.457+0000 7fc435ffb700 1 -- 172.21.15.5:0/3819088223 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fc43c08ef40 con 0x7fc4400fc320 2024-04-16T14:43:28.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.457+0000 7fc444b90700 1 --2- 172.21.15.5:0/3819088223 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc42c06e150 0x7fc42c070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:43:28.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.457+0000 7fc444b90700 1 --2- 172.21.15.5:0/3819088223 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc42c06e150 0x7fc42c070600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc430007fd0 tx=0x7fc430009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:43:28.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.462+0000 7fc435ffb700 1 -- 172.21.15.5:0/3819088223 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fc43c05bd20 con 0x7fc4400fc320 2024-04-16T14:43:28.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:28 smithi115 ceph-mon[83414]: pgmap v220: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 9.2 MiB/s rd, 3 op/s 2024-04-16T14:43:28.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.717+0000 7fc4475f5700 1 -- 172.21.15.5:0/3819088223 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc44010e7b0 con 0x7fc42c06e150 2024-04-16T14:43:28.716 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:28 smithi005 ceph-mon[93420]: pgmap v220: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 9.2 MiB/s rd, 3 op/s 2024-04-16T14:43:28.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.718+0000 7fc435ffb700 1 -- 172.21.15.5:0/3819088223 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc44010e7b0 con 0x7fc42c06e150 2024-04-16T14:43:28.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.720+0000 7fc4475f5700 1 -- 172.21.15.5:0/3819088223 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc42c06e150 msgr2=0x7fc42c070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:28.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.720+0000 7fc4475f5700 1 --2- 172.21.15.5:0/3819088223 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc42c06e150 0x7fc42c070600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc430007fd0 tx=0x7fc430009040 comp rx=0 tx=0).stop 2024-04-16T14:43:28.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.720+0000 7fc4475f5700 1 -- 172.21.15.5:0/3819088223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4400fc320 msgr2=0x7fc44010c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:28.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.720+0000 7fc4475f5700 1 --2- 172.21.15.5:0/3819088223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4400fc320 0x7fc44010c910 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00b3b0 tx=0x7fc43c009e30 comp rx=0 tx=0).stop 2024-04-16T14:43:28.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.721+0000 7fc4475f5700 1 -- 172.21.15.5:0/3819088223 shutdown_connections 2024-04-16T14:43:28.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.721+0000 7fc4475f5700 1 --2- 172.21.15.5:0/3819088223 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc42c06e150 0x7fc42c070600 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:28.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.721+0000 7fc4475f5700 1 --2- 172.21.15.5:0/3819088223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4400fc320 0x7fc44010c910 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:28.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.721+0000 7fc4475f5700 1 --2- 172.21.15.5:0/3819088223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc4400fcc70 0x7fc44010ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:28.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.721+0000 7fc4475f5700 1 -- 172.21.15.5:0/3819088223 >> 172.21.15.5:0/3819088223 conn(0x7fc4400f6bd0 msgr2=0x7fc4400f82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:43:28.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.721+0000 7fc4475f5700 1 -- 172.21.15.5:0/3819088223 shutdown_connections 2024-04-16T14:43:28.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.721+0000 7fc4475f5700 1 -- 172.21.15.5:0/3819088223 wait complete. 2024-04-16T14:43:28.730 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-04-16T14:43:28.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.826+0000 7f83ff7dc700 1 -- 172.21.15.5:0/2434570630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83f80ff070 msgr2=0x7f83f80ff480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:28.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.826+0000 7f83ff7dc700 1 --2- 172.21.15.5:0/2434570630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83f80ff070 0x7f83f80ff480 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f83f4004940 tx=0x7f83f4009e30 comp rx=0 tx=0).stop 2024-04-16T14:43:28.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.827+0000 7f83ff7dc700 1 -- 172.21.15.5:0/2434570630 shutdown_connections 2024-04-16T14:43:28.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.827+0000 7f83ff7dc700 1 --2- 172.21.15.5:0/2434570630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83f8100320 0x7f83f8100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:28.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.827+0000 7f83ff7dc700 1 --2- 172.21.15.5:0/2434570630 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83f80ff070 0x7f83f80ff480 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:28.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.827+0000 7f83ff7dc700 1 -- 172.21.15.5:0/2434570630 >> 172.21.15.5:0/2434570630 conn(0x7f83f80fa950 msgr2=0x7f83f80fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:43:28.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.827+0000 7f83ff7dc700 1 -- 172.21.15.5:0/2434570630 shutdown_connections 2024-04-16T14:43:28.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.827+0000 7f83ff7dc700 1 -- 172.21.15.5:0/2434570630 wait complete. 2024-04-16T14:43:28.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.827+0000 7f83ff7dc700 1 Processor -- start 2024-04-16T14:43:28.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.827+0000 7f83ff7dc700 1 -- start start 2024-04-16T14:43:28.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.828+0000 7f83ff7dc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83f80ff070 0x7f83f810fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:43:28.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.828+0000 7f83ff7dc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83f8100320 0x7f83f8110150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:43:28.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.828+0000 7f83ff7dc700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f8110750 con 0x7f83f80ff070 2024-04-16T14:43:28.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.828+0000 7f83ff7dc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f8110fa0 con 0x7f83f8100320 2024-04-16T14:43:28.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.828+0000 7f83fd578700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83f80ff070 0x7f83f810fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:43:28.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.828+0000 7f83fd578700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83f80ff070 0x7f83f810fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35446/0 (socket says 172.21.15.5:35446) 2024-04-16T14:43:28.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.828+0000 7f83fd578700 1 -- 172.21.15.5:0/1571231776 learned_addr learned my addr 172.21.15.5:0/1571231776 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:43:28.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.828+0000 7f83fcd77700 1 --2- 172.21.15.5:0/1571231776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83f8100320 0x7f83f8110150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:43:28.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.828+0000 7f83fd578700 1 -- 172.21.15.5:0/1571231776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83f8100320 msgr2=0x7f83f8110150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:28.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.828+0000 7f83fd578700 1 --2- 172.21.15.5:0/1571231776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83f8100320 0x7f83f8110150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:28.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.828+0000 7f83fd578700 1 -- 172.21.15.5:0/1571231776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f4005040 con 0x7f83f80ff070 2024-04-16T14:43:28.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.828+0000 7f83fd578700 1 --2- 172.21.15.5:0/1571231776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83f80ff070 0x7f83f810fc10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f83f4009150 tx=0x7f83f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:43:28.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.829+0000 7f83edffb700 1 -- 172.21.15.5:0/1571231776 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83f400e040 con 0x7f83f80ff070 2024-04-16T14:43:28.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.829+0000 7f83edffb700 1 -- 172.21.15.5:0/1571231776 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f83f4004290 con 0x7f83f80ff070 2024-04-16T14:43:28.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.829+0000 7f83edffb700 1 -- 172.21.15.5:0/1571231776 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83f401c630 con 0x7f83f80ff070 2024-04-16T14:43:28.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.829+0000 7f83ff7dc700 1 -- 172.21.15.5:0/1571231776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f8111220 con 0x7f83f80ff070 2024-04-16T14:43:28.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.830+0000 7f83ff7dc700 1 -- 172.21.15.5:0/1571231776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f81116e0 con 0x7f83f80ff070 2024-04-16T14:43:28.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.831+0000 7f83ff7dc700 1 -- 172.21.15.5:0/1571231776 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f805f5f0 con 0x7f83f80ff070 2024-04-16T14:43:28.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.831+0000 7f83edffb700 1 -- 172.21.15.5:0/1571231776 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f83f400bbf0 con 0x7f83f80ff070 2024-04-16T14:43:28.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.832+0000 7f83edffb700 1 --2- 172.21.15.5:0/1571231776 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f83e406df40 0x7f83e40703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:43:28.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.832+0000 7f83edffb700 1 -- 172.21.15.5:0/1571231776 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f83f408e6a0 con 0x7f83f80ff070 2024-04-16T14:43:28.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.832+0000 7f83fcd77700 1 --2- 172.21.15.5:0/1571231776 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f83e406df40 0x7f83e40703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:43:28.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.832+0000 7f83fcd77700 1 --2- 172.21.15.5:0/1571231776 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f83e406df40 0x7f83e40703f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f83e8004f40 tx=0x7f83e800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:43:28.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:28.836+0000 7f83edffb700 1 -- 172.21.15.5:0/1571231776 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f83f405b520 con 0x7f83f80ff070 2024-04-16T14:43:29.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.081+0000 7f83ff7dc700 1 -- 172.21.15.5:0/1571231776 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f83f8111990 con 0x7f83e406df40 2024-04-16T14:43:29.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.082+0000 7f83edffb700 1 -- 172.21.15.5:0/1571231776 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f83f8111990 con 0x7f83e406df40 2024-04-16T14:43:29.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.084+0000 7f83ff7dc700 1 -- 172.21.15.5:0/1571231776 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f83e406df40 msgr2=0x7f83e40703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:29.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.084+0000 7f83ff7dc700 1 --2- 172.21.15.5:0/1571231776 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f83e406df40 0x7f83e40703f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f83e8004f40 tx=0x7f83e800b040 comp rx=0 tx=0).stop 2024-04-16T14:43:29.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.084+0000 7f83ff7dc700 1 -- 172.21.15.5:0/1571231776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83f80ff070 msgr2=0x7f83f810fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:29.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.084+0000 7f83ff7dc700 1 --2- 172.21.15.5:0/1571231776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83f80ff070 0x7f83f810fc10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f83f4009150 tx=0x7f83f4009e30 comp rx=0 tx=0).stop 2024-04-16T14:43:29.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.085+0000 7f83ff7dc700 1 -- 172.21.15.5:0/1571231776 shutdown_connections 2024-04-16T14:43:29.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.085+0000 7f83ff7dc700 1 --2- 172.21.15.5:0/1571231776 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f83e406df40 0x7f83e40703f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:29.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.085+0000 7f83ff7dc700 1 --2- 172.21.15.5:0/1571231776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f83f80ff070 0x7f83f810fc10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:29.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.085+0000 7f83ff7dc700 1 --2- 172.21.15.5:0/1571231776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83f8100320 0x7f83f8110150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:29.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.085+0000 7f83ff7dc700 1 -- 172.21.15.5:0/1571231776 >> 172.21.15.5:0/1571231776 conn(0x7f83f80fa950 msgr2=0x7f83f80fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:43:29.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.085+0000 7f83ff7dc700 1 -- 172.21.15.5:0/1571231776 shutdown_connections 2024-04-16T14:43:29.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.085+0000 7f83ff7dc700 1 -- 172.21.15.5:0/1571231776 wait complete. 2024-04-16T14:43:29.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.190+0000 7fb10159a700 1 -- 172.21.15.5:0/966523329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0fc0fcfa0 msgr2=0x7fb0fc0fd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:29.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.190+0000 7fb10159a700 1 --2- 172.21.15.5:0/966523329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0fc0fcfa0 0x7fb0fc0fd410 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0004940 tx=0x7fb0f0009e30 comp rx=0 tx=0).stop 2024-04-16T14:43:29.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.190+0000 7fb10159a700 1 -- 172.21.15.5:0/966523329 shutdown_connections 2024-04-16T14:43:29.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.190+0000 7fb10159a700 1 --2- 172.21.15.5:0/966523329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0fc0fcfa0 0x7fb0fc0fd410 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:29.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.190+0000 7fb10159a700 1 --2- 172.21.15.5:0/966523329 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0fc0fbcf0 0x7fb0fc0fc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:29.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.190+0000 7fb10159a700 1 -- 172.21.15.5:0/966523329 >> 172.21.15.5:0/966523329 conn(0x7fb0fc0f7450 msgr2=0x7fb0fc0f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:43:29.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.190+0000 7fb10159a700 1 -- 172.21.15.5:0/966523329 shutdown_connections 2024-04-16T14:43:29.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.190+0000 7fb10159a700 1 -- 172.21.15.5:0/966523329 wait complete. 2024-04-16T14:43:29.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.191+0000 7fb10159a700 1 Processor -- start 2024-04-16T14:43:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.191+0000 7fb10159a700 1 -- start start 2024-04-16T14:43:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.191+0000 7fb10159a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0fc0fbcf0 0x7fb0fc10dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:43:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.191+0000 7fb10159a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0fc0fcfa0 0x7fb0fc10e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:43:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.191+0000 7fb10159a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc10e820 con 0x7fb0fc0fbcf0 2024-04-16T14:43:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.191+0000 7fb10159a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc1131c0 con 0x7fb0fc0fcfa0 2024-04-16T14:43:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.191+0000 7fb0faffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0fc0fbcf0 0x7fb0fc10dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:43:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.191+0000 7fb0faffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0fc0fbcf0 0x7fb0fc10dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35462/0 (socket says 172.21.15.5:35462) 2024-04-16T14:43:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.191+0000 7fb0faffd700 1 -- 172.21.15.5:0/2764759423 learned_addr learned my addr 172.21.15.5:0/2764759423 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:43:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.191+0000 7fb0faffd700 1 -- 172.21.15.5:0/2764759423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0fc0fcfa0 msgr2=0x7fb0fc10e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.191+0000 7fb0fa7fc700 1 --2- 172.21.15.5:0/2764759423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0fc0fcfa0 0x7fb0fc10e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:43:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.191+0000 7fb0faffd700 1 --2- 172.21.15.5:0/2764759423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0fc0fcfa0 0x7fb0fc10e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.191+0000 7fb0faffd700 1 -- 172.21.15.5:0/2764759423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f0005040 con 0x7fb0fc0fbcf0 2024-04-16T14:43:29.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.192+0000 7fb0faffd700 1 --2- 172.21.15.5:0/2764759423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0fc0fbcf0 0x7fb0fc10dc90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec002a50 tx=0x7fb0ec0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:43:29.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.192+0000 7fb0e37fe700 1 -- 172.21.15.5:0/2764759423 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0ec007cc0 con 0x7fb0fc0fbcf0 2024-04-16T14:43:29.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.192+0000 7fb0e37fe700 1 -- 172.21.15.5:0/2764759423 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb0ec00f040 con 0x7fb0fc0fbcf0 2024-04-16T14:43:29.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.192+0000 7fb10159a700 1 -- 172.21.15.5:0/2764759423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0fc113360 con 0x7fb0fc0fbcf0 2024-04-16T14:43:29.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.192+0000 7fb0e37fe700 1 -- 172.21.15.5:0/2764759423 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0ec0095e0 con 0x7fb0fc0fbcf0 2024-04-16T14:43:29.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.192+0000 7fb10159a700 1 -- 172.21.15.5:0/2764759423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0fc113920 con 0x7fb0fc0fbcf0 2024-04-16T14:43:29.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.193+0000 7fb10159a700 1 -- 172.21.15.5:0/2764759423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0fc04c710 con 0x7fb0fc0fbcf0 2024-04-16T14:43:29.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.193+0000 7fb0e37fe700 1 -- 172.21.15.5:0/2764759423 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fb0ec009740 con 0x7fb0fc0fbcf0 2024-04-16T14:43:29.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.194+0000 7fb0e37fe700 1 --2- 172.21.15.5:0/2764759423 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fb0e406e140 0x7fb0e40705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:43:29.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.194+0000 7fb0fa7fc700 1 --2- 172.21.15.5:0/2764759423 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fb0e406e140 0x7fb0e40705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:43:29.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.194+0000 7fb0e37fe700 1 -- 172.21.15.5:0/2764759423 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb0ec08d9a0 con 0x7fb0fc0fbcf0 2024-04-16T14:43:29.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.195+0000 7fb0fa7fc700 1 --2- 172.21.15.5:0/2764759423 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fb0e406e140 0x7fb0e40705f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0000c00 tx=0x7fb0f0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:43:29.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.199+0000 7fb0e37fe700 1 -- 172.21.15.5:0/2764759423 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fb0ec056c70 con 0x7fb0fc0fbcf0 2024-04-16T14:43:29.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.417+0000 7fb10159a700 1 -- 172.21.15.5:0/2764759423 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0fc0f9090 con 0x7fb0e406e140 2024-04-16T14:43:29.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.427+0000 7fb0e37fe700 1 -- 172.21.15.5:0/2764759423 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fb0fc0f9090 con 0x7fb0e406e140 2024-04-16T14:43:29.426 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-16T14:43:29.426 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.smithi005 smithi005 *:9093,9094 running (7m) 33s ago 16m 24.5M - 0.25.0 c8568f914cd2 f8aaa22ee70c 2024-04-16T14:43:29.426 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi005 smithi005 running (5m) 33s ago 16m 6656k - 19.0.0-2204-g36befe5d b1a78730e0db d6efa08e65e3 2024-04-16T14:43:29.426 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi115 smithi115 running (5m) 15s ago 15m 6660k - 19.0.0-2204-g36befe5d b1a78730e0db b2a2f2965e2a 2024-04-16T14:43:29.426 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.smithi005 smithi005 *:3000 running (7m) 33s ago 15m 84.9M - 9.4.7 954c08fa6188 9834229a010c 2024-04-16T14:43:29.426 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.vzoqdl smithi005 running (63s) 33s ago 10m 14.0M - 19.0.0-2204-g36befe5d b1a78730e0db acc0c83a4fd1 2024-04-16T14:43:29.426 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.wofqlz smithi005 running (38s) 33s ago 10m 13.8M - 19.0.0-2204-g36befe5d b1a78730e0db bff714c6004b 2024-04-16T14:43:29.427 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.byfytg smithi115 running (19s) 15s ago 10m 11.6M - 19.0.0-2204-g36befe5d b1a78730e0db 62f8399079cd 2024-04-16T14:43:29.427 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.trkaqh smithi115 running (10m) 15s ago 10m 69.0M - 17.2.7-868-g412a5526 b04d96489b7c 5b60cd2ad79b 2024-04-16T14:43:29.427 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi005.ipwdkc smithi005 *:8443,9283,8765 running (7m) 33s ago 17m 509M - 19.0.0-2204-g36befe5d b1a78730e0db 451192b4fc44 2024-04-16T14:43:29.427 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi115.brjkpo smithi115 *:8443,9283,8765 running (6m) 15s ago 15m 451M - 19.0.0-2204-g36befe5d b1a78730e0db 0d75f8211942 2024-04-16T14:43:29.427 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi005 smithi005 running (6m) 33s ago 17m 49.7M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3d0c00924867 2024-04-16T14:43:29.427 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi115 smithi115 running (5m) 15s ago 15m 42.1M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3b916a4928b2 2024-04-16T14:43:29.427 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi005 smithi005 *:9100 running (8m) 33s ago 16m 16.6M - 1.5.0 0da6a335fe13 c09bba584a42 2024-04-16T14:43:29.427 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi115 smithi115 *:9100 running (7m) 15s ago 15m 17.3M - 1.5.0 0da6a335fe13 78cc9cc150c0 2024-04-16T14:43:29.427 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (4m) 33s ago 14m 111M 1559M 19.0.0-2204-g36befe5d b1a78730e0db 91d9246d45e0 2024-04-16T14:43:29.427 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (4m) 33s ago 13m 111M 1559M 19.0.0-2204-g36befe5d b1a78730e0db d930ce515e3e 2024-04-16T14:43:29.427 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (3m) 33s ago 13m 87.1M 1559M 19.0.0-2204-g36befe5d b1a78730e0db fdc5fe68ac57 2024-04-16T14:43:29.427 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi115 running (2m) 15s ago 13m 114M 2581M 19.0.0-2204-g36befe5d b1a78730e0db 808ebb96c862 2024-04-16T14:43:29.427 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi115 running (2m) 15s ago 12m 102M 2581M 19.0.0-2204-g36befe5d b1a78730e0db 74d7d2ac5a6a 2024-04-16T14:43:29.427 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi115 running (111s) 15s ago 12m 90.2M 2581M 19.0.0-2204-g36befe5d b1a78730e0db 484bc7617d80 2024-04-16T14:43:29.428 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.smithi005 smithi005 *:9095 running (6m) 33s ago 15m 58.2M - 2.43.0 a07b618ecd1d dc784e58817c 2024-04-16T14:43:29.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.429+0000 7fb10159a700 1 -- 172.21.15.5:0/2764759423 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fb0e406e140 msgr2=0x7fb0e40705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:29.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.429+0000 7fb10159a700 1 --2- 172.21.15.5:0/2764759423 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fb0e406e140 0x7fb0e40705f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0000c00 tx=0x7fb0f0009e30 comp rx=0 tx=0).stop 2024-04-16T14:43:29.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.429+0000 7fb10159a700 1 -- 172.21.15.5:0/2764759423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0fc0fbcf0 msgr2=0x7fb0fc10dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:29.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.429+0000 7fb10159a700 1 --2- 172.21.15.5:0/2764759423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0fc0fbcf0 0x7fb0fc10dc90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec002a50 tx=0x7fb0ec0046b0 comp rx=0 tx=0).stop 2024-04-16T14:43:29.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.429+0000 7fb10159a700 1 -- 172.21.15.5:0/2764759423 shutdown_connections 2024-04-16T14:43:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.429+0000 7fb10159a700 1 --2- 172.21.15.5:0/2764759423 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fb0e406e140 0x7fb0e40705f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.429+0000 7fb10159a700 1 --2- 172.21.15.5:0/2764759423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0fc0fbcf0 0x7fb0fc10dc90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.429+0000 7fb10159a700 1 --2- 172.21.15.5:0/2764759423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0fc0fcfa0 0x7fb0fc10e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.429+0000 7fb10159a700 1 -- 172.21.15.5:0/2764759423 >> 172.21.15.5:0/2764759423 conn(0x7fb0fc0f7450 msgr2=0x7fb0fc0f8980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:43:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.430+0000 7fb10159a700 1 -- 172.21.15.5:0/2764759423 shutdown_connections 2024-04-16T14:43:29.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.430+0000 7fb10159a700 1 -- 172.21.15.5:0/2764759423 wait complete. 2024-04-16T14:43:29.519 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:29 smithi115 ceph-mon[83414]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:43:29.519 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:29 smithi115 ceph-mon[83414]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:43:29.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.531+0000 7f2304a6c700 1 -- 172.21.15.5:0/2061796106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23000fcc40 msgr2=0x7f23000fd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:29.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.531+0000 7f2304a6c700 1 --2- 172.21.15.5:0/2061796106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23000fcc40 0x7f23000fd0b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f22f4004940 tx=0x7f22f4009e30 comp rx=0 tx=0).stop 2024-04-16T14:43:29.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.531+0000 7f2304a6c700 1 -- 172.21.15.5:0/2061796106 shutdown_connections 2024-04-16T14:43:29.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.531+0000 7f2304a6c700 1 --2- 172.21.15.5:0/2061796106 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23000fcc40 0x7f23000fd0b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:29.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.531+0000 7f2304a6c700 1 --2- 172.21.15.5:0/2061796106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23000fc2f0 0x7f23000fc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:29.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.531+0000 7f2304a6c700 1 -- 172.21.15.5:0/2061796106 >> 172.21.15.5:0/2061796106 conn(0x7f23000f6be0 msgr2=0x7f23000f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:43:29.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.531+0000 7f2304a6c700 1 -- 172.21.15.5:0/2061796106 shutdown_connections 2024-04-16T14:43:29.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.531+0000 7f2304a6c700 1 -- 172.21.15.5:0/2061796106 wait complete. 2024-04-16T14:43:29.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.532+0000 7f2304a6c700 1 Processor -- start 2024-04-16T14:43:29.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.532+0000 7f2304a6c700 1 -- start start 2024-04-16T14:43:29.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.532+0000 7f2304a6c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23000fc2f0 0x7f230010d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:43:29.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.532+0000 7f2304a6c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23000fcc40 0x7f230010df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:43:29.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.532+0000 7f2304a6c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230010e500 con 0x7f23000fc2f0 2024-04-16T14:43:29.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.532+0000 7f2304a6c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230010e670 con 0x7f23000fcc40 2024-04-16T14:43:29.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.532+0000 7f22fe59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23000fc2f0 0x7f230010d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:43:29.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.532+0000 7f22fe59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23000fc2f0 0x7f230010d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35482/0 (socket says 172.21.15.5:35482) 2024-04-16T14:43:29.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.532+0000 7f22fe59c700 1 -- 172.21.15.5:0/1375495592 learned_addr learned my addr 172.21.15.5:0/1375495592 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:43:29.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.532+0000 7f22fdd9b700 1 --2- 172.21.15.5:0/1375495592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23000fcc40 0x7f230010df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:43:29.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.533+0000 7f22fe59c700 1 -- 172.21.15.5:0/1375495592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23000fcc40 msgr2=0x7f230010df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:29.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.533+0000 7f22fe59c700 1 --2- 172.21.15.5:0/1375495592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23000fcc40 0x7f230010df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:29.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.533+0000 7f22fe59c700 1 -- 172.21.15.5:0/1375495592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f4005040 con 0x7f23000fc2f0 2024-04-16T14:43:29.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.533+0000 7f22fe59c700 1 --2- 172.21.15.5:0/1375495592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23000fc2f0 0x7f230010d9c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f22f0002a80 tx=0x7f22f0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:43:29.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.533+0000 7f22eeffd700 1 -- 172.21.15.5:0/1375495592 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22f0007cc0 con 0x7f23000fc2f0 2024-04-16T14:43:29.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.533+0000 7f22eeffd700 1 -- 172.21.15.5:0/1375495592 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f22f000f040 con 0x7f23000fc2f0 2024-04-16T14:43:29.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.533+0000 7f2304a6c700 1 -- 172.21.15.5:0/1375495592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2300113080 con 0x7f23000fc2f0 2024-04-16T14:43:29.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.533+0000 7f22eeffd700 1 -- 172.21.15.5:0/1375495592 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22f000da30 con 0x7f23000fc2f0 2024-04-16T14:43:29.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.533+0000 7f2304a6c700 1 -- 172.21.15.5:0/1375495592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2300113640 con 0x7f23000fc2f0 2024-04-16T14:43:29.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.534+0000 7f2304a6c700 1 -- 172.21.15.5:0/1375495592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2300101c40 con 0x7f23000fc2f0 2024-04-16T14:43:29.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.535+0000 7f22eeffd700 1 -- 172.21.15.5:0/1375495592 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f22f000db90 con 0x7f23000fc2f0 2024-04-16T14:43:29.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.535+0000 7f22eeffd700 1 --2- 172.21.15.5:0/1375495592 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f22e806e140 0x7f22e80705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:43:29.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.535+0000 7f22eeffd700 1 -- 172.21.15.5:0/1375495592 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f22f008d970 con 0x7f23000fc2f0 2024-04-16T14:43:29.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.535+0000 7f22fdd9b700 1 --2- 172.21.15.5:0/1375495592 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f22e806e140 0x7f22e80705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:43:29.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.535+0000 7f22fdd9b700 1 --2- 172.21.15.5:0/1375495592 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f22e806e140 0x7f22e80705f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f22f400b3b0 tx=0x7f22f4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:43:29.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.540+0000 7f22eeffd700 1 -- 172.21.15.5:0/1375495592 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f22f005a770 con 0x7f23000fc2f0 2024-04-16T14:43:29.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:29 smithi005 ceph-mon[93420]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:43:29.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:29 smithi005 ceph-mon[93420]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:43:29.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.837+0000 7f2304a6c700 1 -- 172.21.15.5:0/1375495592 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f230002b340 con 0x7f23000fc2f0 2024-04-16T14:43:29.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.837+0000 7f22eeffd700 1 -- 172.21.15.5:0/1375495592 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f22f005a300 con 0x7f23000fc2f0 2024-04-16T14:43:29.836 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:43:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-04-16T14:43:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:43:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:43:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-04-16T14:43:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:43:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:43:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-04-16T14:43:29.836 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 6 2024-04-16T14:43:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:43:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-04-16T14:43:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 3 2024-04-16T14:43:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:43:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-04-16T14:43:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 13 2024-04-16T14:43:29.837 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-16T14:43:29.837 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:43:29.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.839+0000 7f2304a6c700 1 -- 172.21.15.5:0/1375495592 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f22e806e140 msgr2=0x7f22e80705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:29.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.839+0000 7f2304a6c700 1 --2- 172.21.15.5:0/1375495592 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f22e806e140 0x7f22e80705f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f22f400b3b0 tx=0x7f22f4009e30 comp rx=0 tx=0).stop 2024-04-16T14:43:29.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.839+0000 7f2304a6c700 1 -- 172.21.15.5:0/1375495592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23000fc2f0 msgr2=0x7f230010d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:29.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.839+0000 7f2304a6c700 1 --2- 172.21.15.5:0/1375495592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23000fc2f0 0x7f230010d9c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f22f0002a80 tx=0x7f22f0004600 comp rx=0 tx=0).stop 2024-04-16T14:43:29.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.839+0000 7f2304a6c700 1 -- 172.21.15.5:0/1375495592 shutdown_connections 2024-04-16T14:43:29.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.840+0000 7f2304a6c700 1 --2- 172.21.15.5:0/1375495592 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f22e806e140 0x7f22e80705f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:29.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.840+0000 7f2304a6c700 1 --2- 172.21.15.5:0/1375495592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f23000fc2f0 0x7f230010d9c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:29.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.840+0000 7f2304a6c700 1 --2- 172.21.15.5:0/1375495592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23000fcc40 0x7f230010df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:29.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.840+0000 7f2304a6c700 1 -- 172.21.15.5:0/1375495592 >> 172.21.15.5:0/1375495592 conn(0x7f23000f6be0 msgr2=0x7f23000fb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:43:29.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.840+0000 7f2304a6c700 1 -- 172.21.15.5:0/1375495592 shutdown_connections 2024-04-16T14:43:29.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.840+0000 7f2304a6c700 1 -- 172.21.15.5:0/1375495592 wait complete. 2024-04-16T14:43:29.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.943+0000 7faf29c58700 1 -- 172.21.15.5:0/334136698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf240fdff0 msgr2=0x7faf240fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:29.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.943+0000 7faf29c58700 1 --2- 172.21.15.5:0/334136698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf240fdff0 0x7faf240fe460 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faf0c004940 tx=0x7faf0c009e30 comp rx=0 tx=0).stop 2024-04-16T14:43:29.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.943+0000 7faf29c58700 1 -- 172.21.15.5:0/334136698 shutdown_connections 2024-04-16T14:43:29.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.943+0000 7faf29c58700 1 --2- 172.21.15.5:0/334136698 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf240fdff0 0x7faf240fe460 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:29.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.943+0000 7faf29c58700 1 --2- 172.21.15.5:0/334136698 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf240fce80 0x7faf240fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:29.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.943+0000 7faf29c58700 1 -- 172.21.15.5:0/334136698 >> 172.21.15.5:0/334136698 conn(0x7faf240f8580 msgr2=0x7faf240fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:43:29.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.943+0000 7faf29c58700 1 -- 172.21.15.5:0/334136698 shutdown_connections 2024-04-16T14:43:29.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.943+0000 7faf29c58700 1 -- 172.21.15.5:0/334136698 wait complete. 2024-04-16T14:43:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.943+0000 7faf29c58700 1 Processor -- start 2024-04-16T14:43:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.943+0000 7faf29c58700 1 -- start start 2024-04-16T14:43:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.944+0000 7faf29c58700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf240fce80 0x7faf2410d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:43:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.944+0000 7faf29c58700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf240fdff0 0x7faf2410dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:43:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.944+0000 7faf29c58700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2410e3e0 con 0x7faf240fce80 2024-04-16T14:43:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.944+0000 7faf29c58700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2410e550 con 0x7faf240fdff0 2024-04-16T14:43:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.944+0000 7faf237fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf240fce80 0x7faf2410d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:43:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.944+0000 7faf237fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf240fce80 0x7faf2410d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35496/0 (socket says 172.21.15.5:35496) 2024-04-16T14:43:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.944+0000 7faf237fe700 1 -- 172.21.15.5:0/676201516 learned_addr learned my addr 172.21.15.5:0/676201516 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:43:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.944+0000 7faf22ffd700 1 --2- 172.21.15.5:0/676201516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf240fdff0 0x7faf2410dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:43:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.944+0000 7faf237fe700 1 -- 172.21.15.5:0/676201516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf240fdff0 msgr2=0x7faf2410dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.944+0000 7faf237fe700 1 --2- 172.21.15.5:0/676201516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf240fdff0 0x7faf2410dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.944+0000 7faf237fe700 1 -- 172.21.15.5:0/676201516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0c005040 con 0x7faf240fce80 2024-04-16T14:43:29.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.944+0000 7faf237fe700 1 --2- 172.21.15.5:0/676201516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf240fce80 0x7faf2410d8a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00eb40 tx=0x7faf1c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:43:29.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.944+0000 7faf1bfff700 1 -- 172.21.15.5:0/676201516 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf1c007cc0 con 0x7faf240fce80 2024-04-16T14:43:29.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.944+0000 7faf1bfff700 1 -- 172.21.15.5:0/676201516 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faf1c00f040 con 0x7faf240fce80 2024-04-16T14:43:29.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.944+0000 7faf29c58700 1 -- 172.21.15.5:0/676201516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf24112f50 con 0x7faf240fce80 2024-04-16T14:43:29.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.944+0000 7faf1bfff700 1 -- 172.21.15.5:0/676201516 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf1c00ca10 con 0x7faf240fce80 2024-04-16T14:43:29.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.944+0000 7faf29c58700 1 -- 172.21.15.5:0/676201516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf241133b0 con 0x7faf240fce80 2024-04-16T14:43:29.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.945+0000 7faf29c58700 1 -- 172.21.15.5:0/676201516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf2404c710 con 0x7faf240fce80 2024-04-16T14:43:29.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.946+0000 7faf1bfff700 1 -- 172.21.15.5:0/676201516 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7faf1c00cc80 con 0x7faf240fce80 2024-04-16T14:43:29.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.946+0000 7faf1bfff700 1 --2- 172.21.15.5:0/676201516 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7faf1006e140 0x7faf100705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:43:29.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.946+0000 7faf1bfff700 1 -- 172.21.15.5:0/676201516 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7faf1c08d750 con 0x7faf240fce80 2024-04-16T14:43:29.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.946+0000 7faf22ffd700 1 --2- 172.21.15.5:0/676201516 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7faf1006e140 0x7faf100705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:43:29.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.947+0000 7faf22ffd700 1 --2- 172.21.15.5:0/676201516 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7faf1006e140 0x7faf100705f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7faf0c009b30 tx=0x7faf0c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:43:29.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:29.951+0000 7faf1bfff700 1 -- 172.21.15.5:0/676201516 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7faf1c05a600 con 0x7faf240fce80 2024-04-16T14:43:30.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.200+0000 7faf29c58700 1 -- 172.21.15.5:0/676201516 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faf24113940 con 0x7faf240fce80 2024-04-16T14:43:30.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.200+0000 7faf1bfff700 1 -- 172.21.15.5:0/676201516 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 39 v39) v1 ==== 76+0+1752 (secure 0 0 0) 0x7faf1c05a190 con 0x7faf240fce80 2024-04-16T14:43:30.199 INFO:teuthology.orchestra.run.smithi005.stdout:e39 2024-04-16T14:43:30.199 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:43:30.199 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:43:30.199 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2024-04-16T14:43:30.199 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:43:30.199 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2024-04-16T14:43:30.199 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2024-04-16T14:43:30.199 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 39 2024-04-16T14:43:30.199 INFO:teuthology.orchestra.run.smithi005.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-16T14:43:30.199 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-16T14:32:45.270024+0000 2024-04-16T14:43:30.199 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-04-16T14:43:28.963681+0000 2024-04-16T14:43:30.199 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2024-04-16T14:43:30.200 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2024-04-16T14:43:30.200 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 60 2024-04-16T14:43:30.200 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2024-04-16T14:43:30.200 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2024-04-16T14:43:30.200 INFO:teuthology.orchestra.run.smithi005.stdout:max_xattr_size 65536 2024-04-16T14:43:30.200 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2024-04-16T14:43:30.200 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2024-04-16T14:43:30.200 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 85 2024-04-16T14:43:30.200 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-16T14:43:30.200 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 1 2024-04-16T14:43:30.200 INFO:teuthology.orchestra.run.smithi005.stdout:in 0 2024-04-16T14:43:30.200 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=34434} 2024-04-16T14:43:30.200 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2024-04-16T14:43:30.200 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2024-04-16T14:43:30.200 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 1 2024-04-16T14:43:30.201 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3] 2024-04-16T14:43:30.201 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2024-04-16T14:43:30.201 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2024-04-16T14:43:30.201 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2024-04-16T14:43:30.201 INFO:teuthology.orchestra.run.smithi005.stdout:bal_rank_mask -1 2024-04-16T14:43:30.201 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 1 2024-04-16T14:43:30.201 INFO:teuthology.orchestra.run.smithi005.stdout:qdb_cluster leader: 0 members: 2024-04-16T14:43:30.201 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.vzoqdl{0:34434} state up:reconnect seq 17 join_fscid=1 addr [v2:172.21.15.5:6826/3940274196,v1:172.21.15.5:6827/3940274196] compat {c=[1],r=[1],i=[1fff]}] 2024-04-16T14:43:30.201 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:43:30.201 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:43:30.201 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2024-04-16T14:43:30.201 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:43:30.201 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.wofqlz{-1:34438} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.5:6828/3592708911,v1:172.21.15.5:6829/3592708911] compat {c=[1],r=[1],i=[1fff]}] 2024-04-16T14:43:30.201 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.byfytg{-1:44317} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.115:6824/1461659094,v1:172.21.15.115:6825/1461659094] compat {c=[1],r=[1],i=[1fff]}] 2024-04-16T14:43:30.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.203+0000 7faf29c58700 1 -- 172.21.15.5:0/676201516 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7faf1006e140 msgr2=0x7faf100705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:30.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.203+0000 7faf29c58700 1 --2- 172.21.15.5:0/676201516 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7faf1006e140 0x7faf100705f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7faf0c009b30 tx=0x7faf0c009e30 comp rx=0 tx=0).stop 2024-04-16T14:43:30.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.203+0000 7faf29c58700 1 -- 172.21.15.5:0/676201516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf240fce80 msgr2=0x7faf2410d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:30.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.203+0000 7faf29c58700 1 --2- 172.21.15.5:0/676201516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf240fce80 0x7faf2410d8a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00eb40 tx=0x7faf1c00b040 comp rx=0 tx=0).stop 2024-04-16T14:43:30.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.203+0000 7faf29c58700 1 -- 172.21.15.5:0/676201516 shutdown_connections 2024-04-16T14:43:30.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.203+0000 7faf29c58700 1 --2- 172.21.15.5:0/676201516 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7faf1006e140 0x7faf100705f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:30.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.203+0000 7faf29c58700 1 --2- 172.21.15.5:0/676201516 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faf240fce80 0x7faf2410d8a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:30.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.203+0000 7faf29c58700 1 --2- 172.21.15.5:0/676201516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf240fdff0 0x7faf2410dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:30.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.203+0000 7faf29c58700 1 -- 172.21.15.5:0/676201516 >> 172.21.15.5:0/676201516 conn(0x7faf240f8580 msgr2=0x7faf240f9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:43:30.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.203+0000 7faf29c58700 1 -- 172.21.15.5:0/676201516 shutdown_connections 2024-04-16T14:43:30.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.204+0000 7faf29c58700 1 -- 172.21.15.5:0/676201516 wait complete. 2024-04-16T14:43:30.203 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 39 2024-04-16T14:43:30.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.309+0000 7f278b039700 1 -- 172.21.15.5:0/981772815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27840fcfe0 msgr2=0x7f27840fd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:30.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.309+0000 7f278b039700 1 --2- 172.21.15.5:0/981772815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27840fcfe0 0x7f27840fd450 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2770004940 tx=0x7f2770009e30 comp rx=0 tx=0).stop 2024-04-16T14:43:30.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.309+0000 7f278b039700 1 -- 172.21.15.5:0/981772815 shutdown_connections 2024-04-16T14:43:30.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.309+0000 7f278b039700 1 --2- 172.21.15.5:0/981772815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27840fcfe0 0x7f27840fd450 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:30.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.309+0000 7f278b039700 1 --2- 172.21.15.5:0/981772815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27840fbd30 0x7f27840fc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:30.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.309+0000 7f278b039700 1 -- 172.21.15.5:0/981772815 >> 172.21.15.5:0/981772815 conn(0x7f27840f7490 msgr2=0x7f27840f98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:43:30.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.309+0000 7f278b039700 1 -- 172.21.15.5:0/981772815 shutdown_connections 2024-04-16T14:43:30.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.309+0000 7f278b039700 1 -- 172.21.15.5:0/981772815 wait complete. 2024-04-16T14:43:30.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.310+0000 7f278b039700 1 Processor -- start 2024-04-16T14:43:30.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.310+0000 7f278b039700 1 -- start start 2024-04-16T14:43:30.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.310+0000 7f278b039700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27840fbd30 0x7f278410fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:43:30.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.311+0000 7f278b039700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27840fcfe0 0x7f2784110410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:43:30.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.311+0000 7f278b039700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2784110aa0 con 0x7f27840fcfe0 2024-04-16T14:43:30.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.311+0000 7f278b039700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27841153f0 con 0x7f27840fbd30 2024-04-16T14:43:30.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.311+0000 7f2783fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27840fcfe0 0x7f2784110410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:43:30.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.311+0000 7f2783fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27840fcfe0 0x7f2784110410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35520/0 (socket says 172.21.15.5:35520) 2024-04-16T14:43:30.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.311+0000 7f2783fff700 1 -- 172.21.15.5:0/3006373712 learned_addr learned my addr 172.21.15.5:0/3006373712 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:43:30.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.311+0000 7f2788dd5700 1 --2- 172.21.15.5:0/3006373712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27840fbd30 0x7f278410fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:43:30.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.311+0000 7f2783fff700 1 -- 172.21.15.5:0/3006373712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27840fbd30 msgr2=0x7f278410fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:30.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.311+0000 7f2783fff700 1 --2- 172.21.15.5:0/3006373712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27840fbd30 0x7f278410fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:30.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.311+0000 7f2783fff700 1 -- 172.21.15.5:0/3006373712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2770005040 con 0x7f27840fcfe0 2024-04-16T14:43:30.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.311+0000 7f2783fff700 1 --2- 172.21.15.5:0/3006373712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27840fcfe0 0x7f2784110410 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f277000b3b0 tx=0x7f2770009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:43:30.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.311+0000 7f27817fa700 1 -- 172.21.15.5:0/3006373712 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f277000e040 con 0x7f27840fcfe0 2024-04-16T14:43:30.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.311+0000 7f27817fa700 1 -- 172.21.15.5:0/3006373712 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f277000bbf0 con 0x7f27840fcfe0 2024-04-16T14:43:30.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.311+0000 7f278b039700 1 -- 172.21.15.5:0/3006373712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27841155f0 con 0x7f27840fcfe0 2024-04-16T14:43:30.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.311+0000 7f27817fa700 1 -- 172.21.15.5:0/3006373712 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f277001c630 con 0x7f27840fcfe0 2024-04-16T14:43:30.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.311+0000 7f278b039700 1 -- 172.21.15.5:0/3006373712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2784115b60 con 0x7f27840fcfe0 2024-04-16T14:43:30.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.312+0000 7f278b039700 1 -- 172.21.15.5:0/3006373712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2784101970 con 0x7f27840fcfe0 2024-04-16T14:43:30.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.313+0000 7f27817fa700 1 -- 172.21.15.5:0/3006373712 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f277000bd60 con 0x7f27840fcfe0 2024-04-16T14:43:30.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.314+0000 7f27817fa700 1 --2- 172.21.15.5:0/3006373712 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f277406e140 0x7f27740705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:43:30.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.314+0000 7f2788dd5700 1 --2- 172.21.15.5:0/3006373712 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f277406e140 0x7f27740705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:43:30.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.314+0000 7f27817fa700 1 -- 172.21.15.5:0/3006373712 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f277008e810 con 0x7f27840fcfe0 2024-04-16T14:43:30.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.314+0000 7f2788dd5700 1 --2- 172.21.15.5:0/3006373712 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f277406e140 0x7f27740705f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2778009bf0 tx=0x7f27780091a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:43:30.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.319+0000 7f27817fa700 1 -- 172.21.15.5:0/3006373712 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f277005b630 con 0x7f27840fcfe0 2024-04-16T14:43:30.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:30 smithi005 ceph-mon[93420]: pgmap v221: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-16T14:43:30.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:30 smithi005 ceph-mon[93420]: reconnect by client.14530 v1:192.168.0.1:0/2074550415 after 0 2024-04-16T14:43:30.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:30 smithi005 ceph-mon[93420]: mds.? [v2:172.21.15.5:6826/3940274196,v1:172.21.15.5:6827/3940274196] up:reconnect 2024-04-16T14:43:30.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:30 smithi005 ceph-mon[93420]: fsmap cephfs:1/1 {0=cephfs.smithi005.vzoqdl=up:reconnect} 2 up:standby 2024-04-16T14:43:30.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:30 smithi005 ceph-mon[93420]: reconnect by client.14536 v1:172.21.15.115:0/382738581 after 0.00399992 2024-04-16T14:43:30.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:30 smithi005 ceph-mon[93420]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:43:30.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:30 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/1375495592' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:30.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:30 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/676201516' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:43:30.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.549+0000 7f278b039700 1 -- 172.21.15.5:0/3006373712 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f27840008d0 con 0x7f277406e140 2024-04-16T14:43:30.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.550+0000 7f27817fa700 1 -- 172.21.15.5:0/3006373712 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f27840008d0 con 0x7f277406e140 2024-04-16T14:43:30.549 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:43:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91", 2024-04-16T14:43:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-04-16T14:43:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-16T14:43:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [ 2024-04-16T14:43:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "mon", 2024-04-16T14:43:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "osd", 2024-04-16T14:43:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr", 2024-04-16T14:43:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "crash" 2024-04-16T14:43:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-04-16T14:43:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "15/21 daemons upgraded", 2024-04-16T14:43:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading mds daemons", 2024-04-16T14:43:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-04-16T14:43:30.549 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:43:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.552+0000 7f278b039700 1 -- 172.21.15.5:0/3006373712 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f277406e140 msgr2=0x7f27740705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.552+0000 7f278b039700 1 --2- 172.21.15.5:0/3006373712 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f277406e140 0x7f27740705f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2778009bf0 tx=0x7f27780091a0 comp rx=0 tx=0).stop 2024-04-16T14:43:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.553+0000 7f278b039700 1 -- 172.21.15.5:0/3006373712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27840fcfe0 msgr2=0x7f2784110410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.553+0000 7f278b039700 1 --2- 172.21.15.5:0/3006373712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27840fcfe0 0x7f2784110410 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f277000b3b0 tx=0x7f2770009e30 comp rx=0 tx=0).stop 2024-04-16T14:43:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.553+0000 7f278b039700 1 -- 172.21.15.5:0/3006373712 shutdown_connections 2024-04-16T14:43:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.553+0000 7f278b039700 1 --2- 172.21.15.5:0/3006373712 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f277406e140 0x7f27740705f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.553+0000 7f278b039700 1 --2- 172.21.15.5:0/3006373712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f27840fbd30 0x7f278410fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:30.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.553+0000 7f278b039700 1 --2- 172.21.15.5:0/3006373712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f27840fcfe0 0x7f2784110410 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.553+0000 7f278b039700 1 -- 172.21.15.5:0/3006373712 >> 172.21.15.5:0/3006373712 conn(0x7f27840f7490 msgr2=0x7f2784066a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:43:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.553+0000 7f278b039700 1 -- 172.21.15.5:0/3006373712 shutdown_connections 2024-04-16T14:43:30.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.553+0000 7f278b039700 1 -- 172.21.15.5:0/3006373712 wait complete. 2024-04-16T14:43:30.652 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:30 smithi115 ceph-mon[83414]: pgmap v221: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-04-16T14:43:30.652 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:30 smithi115 ceph-mon[83414]: reconnect by client.14530 v1:192.168.0.1:0/2074550415 after 0 2024-04-16T14:43:30.652 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:30 smithi115 ceph-mon[83414]: mds.? [v2:172.21.15.5:6826/3940274196,v1:172.21.15.5:6827/3940274196] up:reconnect 2024-04-16T14:43:30.652 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:30 smithi115 ceph-mon[83414]: fsmap cephfs:1/1 {0=cephfs.smithi005.vzoqdl=up:reconnect} 2 up:standby 2024-04-16T14:43:30.652 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:30 smithi115 ceph-mon[83414]: reconnect by client.14536 v1:172.21.15.115:0/382738581 after 0.00399992 2024-04-16T14:43:30.652 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:30 smithi115 ceph-mon[83414]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:43:30.652 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:30 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/1375495592' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:30.652 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:30 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/676201516' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:43:30.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.656+0000 7f2240be4700 1 -- 172.21.15.5:0/3238176888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f223c0fcfa0 msgr2=0x7f223c0fd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:30.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.656+0000 7f2240be4700 1 --2- 172.21.15.5:0/3238176888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f223c0fcfa0 0x7f223c0fd410 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2224004940 tx=0x7f2224009e30 comp rx=0 tx=0).stop 2024-04-16T14:43:30.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.656+0000 7f2240be4700 1 -- 172.21.15.5:0/3238176888 shutdown_connections 2024-04-16T14:43:30.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.656+0000 7f2240be4700 1 --2- 172.21.15.5:0/3238176888 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f223c0fcfa0 0x7f223c0fd410 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:30.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.656+0000 7f2240be4700 1 --2- 172.21.15.5:0/3238176888 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f223c0fbcf0 0x7f223c0fc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:30.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.656+0000 7f2240be4700 1 -- 172.21.15.5:0/3238176888 >> 172.21.15.5:0/3238176888 conn(0x7f223c0f7450 msgr2=0x7f223c0f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:43:30.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.656+0000 7f2240be4700 1 -- 172.21.15.5:0/3238176888 shutdown_connections 2024-04-16T14:43:30.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.656+0000 7f2240be4700 1 -- 172.21.15.5:0/3238176888 wait complete. 2024-04-16T14:43:30.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.656+0000 7f2240be4700 1 Processor -- start 2024-04-16T14:43:30.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.656+0000 7f2240be4700 1 -- start start 2024-04-16T14:43:30.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.657+0000 7f2240be4700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f223c0fbcf0 0x7f223c0ffb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:43:30.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.657+0000 7f2240be4700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f223c0fcfa0 0x7f223c0fe2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:43:30.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.657+0000 7f2240be4700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c100200 con 0x7f223c0fcfa0 2024-04-16T14:43:30.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.657+0000 7f2240be4700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c0fe820 con 0x7f223c0fbcf0 2024-04-16T14:43:30.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.657+0000 7f2239d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f223c0fcfa0 0x7f223c0fe2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:43:30.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.657+0000 7f2239d9b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f223c0fcfa0 0x7f223c0fe2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35536/0 (socket says 172.21.15.5:35536) 2024-04-16T14:43:30.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.657+0000 7f2239d9b700 1 -- 172.21.15.5:0/436530852 learned_addr learned my addr 172.21.15.5:0/436530852 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:43:30.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.657+0000 7f223a59c700 1 --2- 172.21.15.5:0/436530852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f223c0fbcf0 0x7f223c0ffb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:43:30.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.657+0000 7f2239d9b700 1 -- 172.21.15.5:0/436530852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f223c0fbcf0 msgr2=0x7f223c0ffb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:30.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.657+0000 7f2239d9b700 1 --2- 172.21.15.5:0/436530852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f223c0fbcf0 0x7f223c0ffb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:30.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.657+0000 7f2239d9b700 1 -- 172.21.15.5:0/436530852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2224005040 con 0x7f223c0fcfa0 2024-04-16T14:43:30.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.657+0000 7f2239d9b700 1 --2- 172.21.15.5:0/436530852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f223c0fcfa0 0x7f223c0fe2e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f222400b970 tx=0x7f2224009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:43:30.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.657+0000 7f2232ffd700 1 -- 172.21.15.5:0/436530852 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f222400e040 con 0x7f223c0fcfa0 2024-04-16T14:43:30.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.657+0000 7f2240be4700 1 -- 172.21.15.5:0/436530852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223c0fea40 con 0x7f223c0fcfa0 2024-04-16T14:43:30.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.657+0000 7f2232ffd700 1 -- 172.21.15.5:0/436530852 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f222400bbf0 con 0x7f223c0fcfa0 2024-04-16T14:43:30.657 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.657+0000 7f2232ffd700 1 -- 172.21.15.5:0/436530852 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f222401c630 con 0x7f223c0fcfa0 2024-04-16T14:43:30.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.658+0000 7f2240be4700 1 -- 172.21.15.5:0/436530852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223c0ff000 con 0x7f223c0fcfa0 2024-04-16T14:43:30.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.659+0000 7f2240be4700 1 -- 172.21.15.5:0/436530852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f223c04c710 con 0x7f223c0fcfa0 2024-04-16T14:43:30.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.659+0000 7f2232ffd700 1 -- 172.21.15.5:0/436530852 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f222400bd60 con 0x7f223c0fcfa0 2024-04-16T14:43:30.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.660+0000 7f2232ffd700 1 --2- 172.21.15.5:0/436530852 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f222806e140 0x7f22280705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:43:30.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.660+0000 7f2232ffd700 1 -- 172.21.15.5:0/436530852 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f222408ebe0 con 0x7f223c0fcfa0 2024-04-16T14:43:30.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.660+0000 7f223a59c700 1 --2- 172.21.15.5:0/436530852 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f222806e140 0x7f22280705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:43:30.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.660+0000 7f223a59c700 1 --2- 172.21.15.5:0/436530852 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f222806e140 0x7f22280705f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f222c009bf0 tx=0x7f222c0091a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:43:30.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.664+0000 7f2232ffd700 1 -- 172.21.15.5:0/436530852 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f222405bb00 con 0x7f223c0fcfa0 2024-04-16T14:43:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.960+0000 7f2240be4700 1 -- 172.21.15.5:0/436530852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f223c101ad0 con 0x7f223c0fcfa0 2024-04-16T14:43:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.960+0000 7f2232ffd700 1 -- 172.21.15.5:0/436530852 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+107 (secure 0 0 0) 0x7f222405b690 con 0x7f223c0fcfa0 2024-04-16T14:43:30.959 INFO:teuthology.orchestra.run.smithi005.stdout:HEALTH_WARN 1 filesystem is degraded 2024-04-16T14:43:30.959 INFO:teuthology.orchestra.run.smithi005.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-04-16T14:43:30.959 INFO:teuthology.orchestra.run.smithi005.stdout: fs cephfs is degraded 2024-04-16T14:43:30.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.962+0000 7f2240be4700 1 -- 172.21.15.5:0/436530852 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f222806e140 msgr2=0x7f22280705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:30.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.962+0000 7f2240be4700 1 --2- 172.21.15.5:0/436530852 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f222806e140 0x7f22280705f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f222c009bf0 tx=0x7f222c0091a0 comp rx=0 tx=0).stop 2024-04-16T14:43:30.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.962+0000 7f2240be4700 1 -- 172.21.15.5:0/436530852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f223c0fcfa0 msgr2=0x7f223c0fe2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:43:30.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.962+0000 7f2240be4700 1 --2- 172.21.15.5:0/436530852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f223c0fcfa0 0x7f223c0fe2e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f222400b970 tx=0x7f2224009e30 comp rx=0 tx=0).stop 2024-04-16T14:43:30.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.962+0000 7f2240be4700 1 -- 172.21.15.5:0/436530852 shutdown_connections 2024-04-16T14:43:30.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.962+0000 7f2240be4700 1 --2- 172.21.15.5:0/436530852 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f222806e140 0x7f22280705f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:30.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.962+0000 7f2240be4700 1 --2- 172.21.15.5:0/436530852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f223c0fbcf0 0x7f223c0ffb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:30.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.962+0000 7f2240be4700 1 --2- 172.21.15.5:0/436530852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f223c0fcfa0 0x7f223c0fe2e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:43:30.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.962+0000 7f2240be4700 1 -- 172.21.15.5:0/436530852 >> 172.21.15.5:0/436530852 conn(0x7f223c0f7450 msgr2=0x7f223c066830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:43:30.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.962+0000 7f2240be4700 1 -- 172.21.15.5:0/436530852 shutdown_connections 2024-04-16T14:43:30.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:43:30.962+0000 7f2240be4700 1 -- 172.21.15.5:0/436530852 wait complete. 2024-04-16T14:43:31.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:31 smithi115 ceph-mon[83414]: mds.? [v2:172.21.15.5:6826/3940274196,v1:172.21.15.5:6827/3940274196] up:rejoin 2024-04-16T14:43:31.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:31 smithi115 ceph-mon[83414]: fsmap cephfs:1/1 {0=cephfs.smithi005.vzoqdl=up:rejoin} 2 up:standby 2024-04-16T14:43:31.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:31 smithi115 ceph-mon[83414]: daemon mds.cephfs.smithi005.vzoqdl is now active in filesystem cephfs as rank 0 2024-04-16T14:43:31.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:31 smithi115 ceph-mon[83414]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:43:31.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:31 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:31.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:31 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:31.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:31 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:43:31.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:31 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/436530852' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:43:31.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:31 smithi005 ceph-mon[93420]: mds.? [v2:172.21.15.5:6826/3940274196,v1:172.21.15.5:6827/3940274196] up:rejoin 2024-04-16T14:43:31.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:31 smithi005 ceph-mon[93420]: fsmap cephfs:1/1 {0=cephfs.smithi005.vzoqdl=up:rejoin} 2 up:standby 2024-04-16T14:43:31.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:31 smithi005 ceph-mon[93420]: daemon mds.cephfs.smithi005.vzoqdl is now active in filesystem cephfs as rank 0 2024-04-16T14:43:31.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:31 smithi005 ceph-mon[93420]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:43:31.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:31 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:31.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:31 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:31.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:31 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:43:31.725 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:31 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/436530852' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:43:32.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:32 smithi005 ceph-mon[93420]: pgmap v222: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-04-16T14:43:32.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:32 smithi005 ceph-mon[93420]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-16T14:43:32.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:32 smithi005 ceph-mon[93420]: Cluster is now healthy 2024-04-16T14:43:32.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:32 smithi005 ceph-mon[93420]: mds.? [v2:172.21.15.5:6826/3940274196,v1:172.21.15.5:6827/3940274196] up:active 2024-04-16T14:43:32.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:32 smithi005 ceph-mon[93420]: mds.? [v2:172.21.15.115:6826/3171302428,v1:172.21.15.115:6827/3171302428] up:boot 2024-04-16T14:43:32.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:32 smithi005 ceph-mon[93420]: fsmap cephfs:1 {0=cephfs.smithi005.vzoqdl=up:active} 3 up:standby 2024-04-16T14:43:32.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.trkaqh"}]: dispatch 2024-04-16T14:43:32.528 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:32 smithi115 ceph-mon[83414]: pgmap v222: 65 pgs: 65 active+clean; 168 MiB data, 720 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-04-16T14:43:32.528 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:32 smithi115 ceph-mon[83414]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-16T14:43:32.528 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:32 smithi115 ceph-mon[83414]: Cluster is now healthy 2024-04-16T14:43:32.528 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:32 smithi115 ceph-mon[83414]: mds.? [v2:172.21.15.5:6826/3940274196,v1:172.21.15.5:6827/3940274196] up:active 2024-04-16T14:43:32.528 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:32 smithi115 ceph-mon[83414]: mds.? [v2:172.21.15.115:6826/3171302428,v1:172.21.15.115:6827/3171302428] up:boot 2024-04-16T14:43:32.528 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:32 smithi115 ceph-mon[83414]: fsmap cephfs:1 {0=cephfs.smithi005.vzoqdl=up:active} 3 up:standby 2024-04-16T14:43:32.528 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi115.trkaqh"}]: dispatch 2024-04-16T14:43:34.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:34 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:34.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:34 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:34.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:34 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:34.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:34 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:35.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:35 smithi115 ceph-mon[83414]: pgmap v223: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4.5 KiB/s wr, 7 op/s 2024-04-16T14:43:35.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:35 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:35.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:35 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:35.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:35 smithi005 ceph-mon[93420]: pgmap v223: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4.5 KiB/s wr, 7 op/s 2024-04-16T14:43:35.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:35 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:35.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:35 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:36.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:36 smithi115 ceph-mon[83414]: pgmap v224: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 9.8 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-16T14:43:36.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:36 smithi005 ceph-mon[93420]: pgmap v224: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 9.8 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-16T14:43:39.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:38 smithi115 ceph-mon[83414]: pgmap v225: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-04-16T14:43:39.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:39.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:39.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:43:39.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:43:39.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:39.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:43:39.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:39.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:39.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:39.184 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:39.184 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:39.184 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:38 smithi115 ceph-mon[83414]: Upgrade: Setting container_image for all mds 2024-04-16T14:43:39.184 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:39.184 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi005.vzoqdl"}]: dispatch 2024-04-16T14:43:39.184 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi005.vzoqdl"}]': finished 2024-04-16T14:43:39.184 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi005.wofqlz"}]: dispatch 2024-04-16T14:43:39.184 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi005.wofqlz"}]': finished 2024-04-16T14:43:39.184 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi115.byfytg"}]: dispatch 2024-04-16T14:43:39.185 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi115.byfytg"}]': finished 2024-04-16T14:43:39.185 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi115.trkaqh"}]: dispatch 2024-04-16T14:43:39.185 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi115.trkaqh"}]': finished 2024-04-16T14:43:39.185 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:38 smithi115 ceph-mon[83414]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-04-16T14:43:39.185 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-04-16T14:43:39.185 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:39.185 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:43:39.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:38 smithi005 ceph-mon[93420]: pgmap v225: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-04-16T14:43:39.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:39.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:39.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:43:39.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:43:39.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:39.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:43:39.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:39.226 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:39.226 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:39.226 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:39.226 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:39.226 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:38 smithi005 ceph-mon[93420]: Upgrade: Setting container_image for all mds 2024-04-16T14:43:39.226 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:39.226 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi005.vzoqdl"}]: dispatch 2024-04-16T14:43:39.226 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi005.vzoqdl"}]': finished 2024-04-16T14:43:39.226 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi005.wofqlz"}]: dispatch 2024-04-16T14:43:39.227 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi005.wofqlz"}]': finished 2024-04-16T14:43:39.227 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi115.byfytg"}]: dispatch 2024-04-16T14:43:39.227 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi115.byfytg"}]': finished 2024-04-16T14:43:39.227 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi115.trkaqh"}]: dispatch 2024-04-16T14:43:39.227 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi115.trkaqh"}]': finished 2024-04-16T14:43:39.227 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:38 smithi005 ceph-mon[93420]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-04-16T14:43:39.227 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-04-16T14:43:39.227 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:39.227 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:43:39.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-16T14:43:39.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-04-16T14:43:39.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: daemon mds.cephfs.smithi005.wofqlz assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-16T14:43:39.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-16T14:43:39.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: Cluster is now healthy 2024-04-16T14:43:39.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: fsmap cephfs:1 {0=cephfs.smithi005.vzoqdl=up:active} 3 up:standby 2024-04-16T14:43:39.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: fsmap cephfs:2 {0=cephfs.smithi005.vzoqdl=up:active,1=cephfs.smithi005.wofqlz=up:starting} 2 up:standby 2024-04-16T14:43:39.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:39.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:39.975 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: Upgrade: Setting container_image for all rgw 2024-04-16T14:43:39.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:39.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: daemon mds.cephfs.smithi005.wofqlz is now active in filesystem cephfs as rank 1 2024-04-16T14:43:39.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:39.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: Upgrade: Setting container_image for all rbd-mirror 2024-04-16T14:43:39.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:39.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:39.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:39.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: Upgrade: Setting container_image for all ceph-exporter 2024-04-16T14:43:39.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:39.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:39.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: Upgrade: Setting container_image for all iscsi 2024-04-16T14:43:39.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:39.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:39.976 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: Upgrade: Setting container_image for all nfs 2024-04-16T14:43:39.977 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:39.977 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:39.977 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: Upgrade: Setting container_image for all nvmeof 2024-04-16T14:43:39.977 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:40.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-16T14:43:40.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-04-16T14:43:40.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: daemon mds.cephfs.smithi005.wofqlz assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-16T14:43:40.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-16T14:43:40.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: Cluster is now healthy 2024-04-16T14:43:40.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: fsmap cephfs:1 {0=cephfs.smithi005.vzoqdl=up:active} 3 up:standby 2024-04-16T14:43:40.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: fsmap cephfs:2 {0=cephfs.smithi005.vzoqdl=up:active,1=cephfs.smithi005.wofqlz=up:starting} 2 up:standby 2024-04-16T14:43:40.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:40.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:40.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: Upgrade: Setting container_image for all rgw 2024-04-16T14:43:40.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:40.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: daemon mds.cephfs.smithi005.wofqlz is now active in filesystem cephfs as rank 1 2024-04-16T14:43:40.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:40.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: Upgrade: Setting container_image for all rbd-mirror 2024-04-16T14:43:40.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:40.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:40.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:40.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: Upgrade: Setting container_image for all ceph-exporter 2024-04-16T14:43:40.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:40.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:40.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: Upgrade: Setting container_image for all iscsi 2024-04-16T14:43:40.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:40.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:40.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: Upgrade: Setting container_image for all nfs 2024-04-16T14:43:40.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:40.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:40.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: Upgrade: Setting container_image for all nvmeof 2024-04-16T14:43:40.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:41.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:40 smithi005 ceph-mon[93420]: pgmap v226: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 5.8 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-16T14:43:41.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:40 smithi005 ceph-mon[93420]: mds.? [v2:172.21.15.5:6828/3592708911,v1:172.21.15.5:6829/3592708911] up:active 2024-04-16T14:43:41.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:40 smithi005 ceph-mon[93420]: fsmap cephfs:2 {0=cephfs.smithi005.vzoqdl=up:active,1=cephfs.smithi005.wofqlz=up:active} 2 up:standby 2024-04-16T14:43:41.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:40 smithi115 ceph-mon[83414]: pgmap v226: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 5.8 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-16T14:43:41.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:40 smithi115 ceph-mon[83414]: mds.? [v2:172.21.15.5:6828/3592708911,v1:172.21.15.5:6829/3592708911] up:active 2024-04-16T14:43:41.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:40 smithi115 ceph-mon[83414]: fsmap cephfs:2 {0=cephfs.smithi005.vzoqdl=up:active,1=cephfs.smithi005.wofqlz=up:active} 2 up:standby 2024-04-16T14:43:42.087 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:41 smithi005 ceph-mon[93420]: Upgrade: Updating node-exporter.smithi005 (1/2) 2024-04-16T14:43:42.087 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:41 smithi005 ceph-mon[93420]: Deploying daemon node-exporter.smithi005 on smithi005 2024-04-16T14:43:42.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:41 smithi115 ceph-mon[83414]: Upgrade: Updating node-exporter.smithi005 (1/2) 2024-04-16T14:43:42.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:41 smithi115 ceph-mon[83414]: Deploying daemon node-exporter.smithi005 on smithi005 2024-04-16T14:43:43.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:42 smithi005 ceph-mon[93420]: pgmap v227: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-04-16T14:43:43.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:42 smithi115 ceph-mon[83414]: pgmap v227: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.2 KiB/s wr, 7 op/s 2024-04-16T14:43:45.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:44 smithi115 ceph-mon[83414]: pgmap v228: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 8.9 KiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-04-16T14:43:45.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:44 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:45.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:44 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:45.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:44 smithi005 ceph-mon[93420]: pgmap v228: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 8.9 KiB/s rd, 4.3 KiB/s wr, 10 op/s 2024-04-16T14:43:45.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:44 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:45.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:44 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:47.058 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:46 smithi115 ceph-mon[83414]: pgmap v229: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 8.7 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-16T14:43:47.058 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:46 smithi115 ceph-mon[83414]: Upgrade: Updating node-exporter.smithi115 (2/2) 2024-04-16T14:43:47.059 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:46 smithi115 ceph-mon[83414]: Deploying daemon node-exporter.smithi115 on smithi115 2024-04-16T14:43:47.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:46 smithi005 ceph-mon[93420]: pgmap v229: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 8.7 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-16T14:43:47.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:46 smithi005 ceph-mon[93420]: Upgrade: Updating node-exporter.smithi115 (2/2) 2024-04-16T14:43:47.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:46 smithi005 ceph-mon[93420]: Deploying daemon node-exporter.smithi115 on smithi115 2024-04-16T14:43:49.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:49 smithi115 ceph-mon[83414]: pgmap v230: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 7.9 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-16T14:43:49.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:49 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:49.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:49 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:49.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:49 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:43:49.403 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:49 smithi005 ceph-mon[93420]: pgmap v230: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 7.9 KiB/s rd, 170 B/s wr, 8 op/s 2024-04-16T14:43:49.403 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:49 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:49.403 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:49 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:49.403 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:49 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:43:51.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:51 smithi115 ceph-mon[83414]: pgmap v231: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-16T14:43:51.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:51 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:51.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:51 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:51.445 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:51 smithi005 ceph-mon[93420]: pgmap v231: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-16T14:43:51.446 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:51 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:51.446 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:51 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:52.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:52 smithi115 ceph-mon[83414]: pgmap v232: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-16T14:43:52.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:52 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:52.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:52 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:52.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:52 smithi005 ceph-mon[93420]: pgmap v232: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-16T14:43:52.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:52 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:52.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:52 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:54.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:53 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:54.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:53 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:54.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:53 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:43:54.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:53 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:54.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:53 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:54.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:53 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:43:55.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:55 smithi115 ceph-mon[83414]: pgmap v233: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-04-16T14:43:55.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:55 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:55.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:55 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:55.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:55 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:55.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:55 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:55.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:55 smithi005 ceph-mon[93420]: pgmap v233: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 4 op/s 2024-04-16T14:43:55.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:55 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:55.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:55 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:55.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:55 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:55.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:55 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:57.099 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:57 smithi005 ceph-mon[93420]: pgmap v234: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 0 op/s 2024-04-16T14:43:57.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:57 smithi115 ceph-mon[83414]: pgmap v234: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 0 op/s 2024-04-16T14:43:58.570 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:58 smithi005 ceph-mon[93420]: pgmap v235: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:43:58.571 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:58.571 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:58.571 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:43:58.571 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:43:58.572 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:58.572 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:43:58.572 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:58.572 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:58.572 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:58.572 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:58.573 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:58.573 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:58.573 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:58.573 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:58.573 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:58.573 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:58.574 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:58.574 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:58.574 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:43:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:58.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:58 smithi115 ceph-mon[83414]: pgmap v235: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:43:58.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:58.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:58.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:43:58.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:43:58.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:43:58.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:43:58.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:58.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:58.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:58.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:58.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:58.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:58.933 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:58.933 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:58.933 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:58.933 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:58.933 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:58.933 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:43:58.933 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:43:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:00.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:00 smithi005 ceph-mon[93420]: Upgrade: Updating prometheus.smithi005 2024-04-16T14:44:00.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:00 smithi005 ceph-mon[93420]: pgmap v236: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:00.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:00 smithi005 ceph-mon[93420]: Deploying daemon prometheus.smithi005 on smithi005 2024-04-16T14:44:00.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:00 smithi115 ceph-mon[83414]: Upgrade: Updating prometheus.smithi005 2024-04-16T14:44:00.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:00 smithi115 ceph-mon[83414]: pgmap v236: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:00.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:00 smithi115 ceph-mon[83414]: Deploying daemon prometheus.smithi005 on smithi005 2024-04-16T14:44:01.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.077+0000 7f0a2269b700 1 -- 172.21.15.5:0/723606012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1c0fcef0 msgr2=0x7f0a1c0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.077+0000 7f0a2269b700 1 --2- 172.21.15.5:0/723606012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1c0fcef0 0x7f0a1c0fd320 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c004940 tx=0x7f0a0c009e30 comp rx=0 tx=0).stop 2024-04-16T14:44:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.078+0000 7f0a2269b700 1 -- 172.21.15.5:0/723606012 shutdown_connections 2024-04-16T14:44:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.078+0000 7f0a2269b700 1 --2- 172.21.15.5:0/723606012 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a1c0fe0e0 0x7f0a1c0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.078+0000 7f0a2269b700 1 --2- 172.21.15.5:0/723606012 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1c0fcef0 0x7f0a1c0fd320 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.078+0000 7f0a2269b700 1 -- 172.21.15.5:0/723606012 >> 172.21.15.5:0/723606012 conn(0x7f0a1c0f8530 msgr2=0x7f0a1c0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.078+0000 7f0a2269b700 1 -- 172.21.15.5:0/723606012 shutdown_connections 2024-04-16T14:44:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.078+0000 7f0a2269b700 1 -- 172.21.15.5:0/723606012 wait complete. 2024-04-16T14:44:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.078+0000 7f0a2269b700 1 Processor -- start 2024-04-16T14:44:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.079+0000 7f0a2269b700 1 -- start start 2024-04-16T14:44:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.079+0000 7f0a2269b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1c0fcef0 0x7f0a1c071e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.079+0000 7f0a2269b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a1c0fe0e0 0x7f0a1c070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:01.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.079+0000 7f0a2269b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c0708c0 con 0x7f0a1c0fcef0 2024-04-16T14:44:01.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.079+0000 7f0a2269b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c070a30 con 0x7f0a1c0fe0e0 2024-04-16T14:44:01.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.079+0000 7f0a1bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1c0fcef0 0x7f0a1c071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:01.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.079+0000 7f0a1bfff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1c0fcef0 0x7f0a1c071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49402/0 (socket says 172.21.15.5:49402) 2024-04-16T14:44:01.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.079+0000 7f0a1bfff700 1 -- 172.21.15.5:0/2756230545 learned_addr learned my addr 172.21.15.5:0/2756230545 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:44:01.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.079+0000 7f0a13fff700 1 --2- 172.21.15.5:0/2756230545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a1c0fe0e0 0x7f0a1c070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:01.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.079+0000 7f0a1bfff700 1 -- 172.21.15.5:0/2756230545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a1c0fe0e0 msgr2=0x7f0a1c070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:01.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.079+0000 7f0a1bfff700 1 --2- 172.21.15.5:0/2756230545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a1c0fe0e0 0x7f0a1c070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:01.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.079+0000 7f0a1bfff700 1 -- 172.21.15.5:0/2756230545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c005040 con 0x7f0a1c0fcef0 2024-04-16T14:44:01.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.079+0000 7f0a13fff700 1 --2- 172.21.15.5:0/2756230545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a1c0fe0e0 0x7f0a1c070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T14:44:01.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.079+0000 7f0a1bfff700 1 --2- 172.21.15.5:0/2756230545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1c0fcef0 0x7f0a1c071e40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c000c00 tx=0x7f0a0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:01.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.080+0000 7f0a197fa700 1 -- 172.21.15.5:0/2756230545 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a0c00e040 con 0x7f0a1c0fcef0 2024-04-16T14:44:01.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.080+0000 7f0a197fa700 1 -- 172.21.15.5:0/2756230545 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0a0c00bcc0 con 0x7f0a1c0fcef0 2024-04-16T14:44:01.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.080+0000 7f0a2269b700 1 -- 172.21.15.5:0/2756230545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1c070cb0 con 0x7f0a1c0fcef0 2024-04-16T14:44:01.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.080+0000 7f0a197fa700 1 -- 172.21.15.5:0/2756230545 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a0c01c630 con 0x7f0a1c0fcef0 2024-04-16T14:44:01.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.080+0000 7f0a2269b700 1 -- 172.21.15.5:0/2756230545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1c115a10 con 0x7f0a1c0fcef0 2024-04-16T14:44:01.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.081+0000 7f0a2269b700 1 -- 172.21.15.5:0/2756230545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a1c05f5f0 con 0x7f0a1c0fcef0 2024-04-16T14:44:01.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.081+0000 7f0a197fa700 1 -- 172.21.15.5:0/2756230545 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f0a0c013980 con 0x7f0a1c0fcef0 2024-04-16T14:44:01.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.082+0000 7f0a197fa700 1 --2- 172.21.15.5:0/2756230545 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f0a0806e140 0x7f0a080705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:01.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.082+0000 7f0a197fa700 1 -- 172.21.15.5:0/2756230545 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f0a0c08eea0 con 0x7f0a1c0fcef0 2024-04-16T14:44:01.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.082+0000 7f0a13fff700 1 --2- 172.21.15.5:0/2756230545 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f0a0806e140 0x7f0a080705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:01.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.082+0000 7f0a13fff700 1 --2- 172.21.15.5:0/2756230545 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f0a0806e140 0x7f0a080705f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0a040095c0 tx=0x7f0a04007ab0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:01.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.087+0000 7f0a197fa700 1 -- 172.21.15.5:0/2756230545 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f0a0c058290 con 0x7f0a1c0fcef0 2024-04-16T14:44:01.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.318+0000 7f0a2269b700 1 -- 172.21.15.5:0/2756230545 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a1c102450 con 0x7f0a0806e140 2024-04-16T14:44:01.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.319+0000 7f0a197fa700 1 -- 172.21.15.5:0/2756230545 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+438 (secure 0 0 0) 0x7f0a1c102450 con 0x7f0a0806e140 2024-04-16T14:44:01.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.321+0000 7f0a2269b700 1 -- 172.21.15.5:0/2756230545 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f0a0806e140 msgr2=0x7f0a080705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:01.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.321+0000 7f0a2269b700 1 --2- 172.21.15.5:0/2756230545 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f0a0806e140 0x7f0a080705f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0a040095c0 tx=0x7f0a04007ab0 comp rx=0 tx=0).stop 2024-04-16T14:44:01.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.321+0000 7f0a2269b700 1 -- 172.21.15.5:0/2756230545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1c0fcef0 msgr2=0x7f0a1c071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.321+0000 7f0a2269b700 1 --2- 172.21.15.5:0/2756230545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1c0fcef0 0x7f0a1c071e40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c000c00 tx=0x7f0a0c009e30 comp rx=0 tx=0).stop 2024-04-16T14:44:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.321+0000 7f0a2269b700 1 -- 172.21.15.5:0/2756230545 shutdown_connections 2024-04-16T14:44:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.321+0000 7f0a2269b700 1 --2- 172.21.15.5:0/2756230545 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f0a0806e140 0x7f0a080705f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.321+0000 7f0a2269b700 1 --2- 172.21.15.5:0/2756230545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0a1c0fcef0 0x7f0a1c071e40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.321+0000 7f0a2269b700 1 --2- 172.21.15.5:0/2756230545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a1c0fe0e0 0x7f0a1c070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.321+0000 7f0a2269b700 1 -- 172.21.15.5:0/2756230545 >> 172.21.15.5:0/2756230545 conn(0x7f0a1c0f8530 msgr2=0x7f0a1c0f9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.321+0000 7f0a2269b700 1 -- 172.21.15.5:0/2756230545 shutdown_connections 2024-04-16T14:44:01.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.321+0000 7f0a2269b700 1 -- 172.21.15.5:0/2756230545 wait complete. 2024-04-16T14:44:01.330 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-04-16T14:44:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.428+0000 7f48b99f9700 1 -- 172.21.15.5:0/3821113936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48b4102380 msgr2=0x7f48b4104760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.428+0000 7f48b99f9700 1 --2- 172.21.15.5:0/3821113936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48b4102380 0x7f48b4104760 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f48a8004940 tx=0x7f48a8009e30 comp rx=0 tx=0).stop 2024-04-16T14:44:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.428+0000 7f48b99f9700 1 -- 172.21.15.5:0/3821113936 shutdown_connections 2024-04-16T14:44:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.428+0000 7f48b99f9700 1 --2- 172.21.15.5:0/3821113936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48b4102380 0x7f48b4104760 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.428+0000 7f48b99f9700 1 --2- 172.21.15.5:0/3821113936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48b4066f00 0x7f48b4101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.428+0000 7f48b99f9700 1 -- 172.21.15.5:0/3821113936 >> 172.21.15.5:0/3821113936 conn(0x7f48b40f7450 msgr2=0x7f48b40f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.428+0000 7f48b99f9700 1 -- 172.21.15.5:0/3821113936 shutdown_connections 2024-04-16T14:44:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.428+0000 7f48b99f9700 1 -- 172.21.15.5:0/3821113936 wait complete. 2024-04-16T14:44:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.429+0000 7f48b99f9700 1 Processor -- start 2024-04-16T14:44:01.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.429+0000 7f48b99f9700 1 -- start start 2024-04-16T14:44:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.429+0000 7f48b99f9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48b4066f00 0x7f48b410fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.429+0000 7f48b99f9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48b4102380 0x7f48b4110390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.429+0000 7f48b99f9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b4110990 con 0x7f48b4066f00 2024-04-16T14:44:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.429+0000 7f48b99f9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b4110b00 con 0x7f48b4102380 2024-04-16T14:44:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.429+0000 7f48b2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48b4066f00 0x7f48b410fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.429+0000 7f48b2ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48b4066f00 0x7f48b410fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49418/0 (socket says 172.21.15.5:49418) 2024-04-16T14:44:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.429+0000 7f48b2ffd700 1 -- 172.21.15.5:0/475838661 learned_addr learned my addr 172.21.15.5:0/475838661 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:44:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.430+0000 7f48b27fc700 1 --2- 172.21.15.5:0/475838661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48b4102380 0x7f48b4110390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.430+0000 7f48b2ffd700 1 -- 172.21.15.5:0/475838661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48b4102380 msgr2=0x7f48b4110390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.430+0000 7f48b2ffd700 1 --2- 172.21.15.5:0/475838661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48b4102380 0x7f48b4110390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:01.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.430+0000 7f48b2ffd700 1 -- 172.21.15.5:0/475838661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a8005040 con 0x7f48b4066f00 2024-04-16T14:44:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.430+0000 7f48b2ffd700 1 --2- 172.21.15.5:0/475838661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48b4066f00 0x7f48b410fe50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f48a4002a80 tx=0x7f48a4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.430+0000 7f489b7fe700 1 -- 172.21.15.5:0/475838661 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48a4007cc0 con 0x7f48b4066f00 2024-04-16T14:44:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.430+0000 7f48b99f9700 1 -- 172.21.15.5:0/475838661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b4115560 con 0x7f48b4066f00 2024-04-16T14:44:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.430+0000 7f489b7fe700 1 -- 172.21.15.5:0/475838661 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f48a400f040 con 0x7f48b4066f00 2024-04-16T14:44:01.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.430+0000 7f489b7fe700 1 -- 172.21.15.5:0/475838661 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48a400da30 con 0x7f48b4066f00 2024-04-16T14:44:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.430+0000 7f48b99f9700 1 -- 172.21.15.5:0/475838661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b4115b20 con 0x7f48b4066f00 2024-04-16T14:44:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.431+0000 7f48b99f9700 1 -- 172.21.15.5:0/475838661 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b404c710 con 0x7f48b4066f00 2024-04-16T14:44:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.432+0000 7f489b7fe700 1 -- 172.21.15.5:0/475838661 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f48a400db90 con 0x7f48b4066f00 2024-04-16T14:44:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.432+0000 7f489b7fe700 1 --2- 172.21.15.5:0/475838661 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f489c06e140 0x7f489c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.432+0000 7f489b7fe700 1 -- 172.21.15.5:0/475838661 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f48a408d8b0 con 0x7f48b4066f00 2024-04-16T14:44:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.432+0000 7f48b27fc700 1 --2- 172.21.15.5:0/475838661 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f489c06e140 0x7f489c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:01.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.433+0000 7f48b27fc700 1 --2- 172.21.15.5:0/475838661 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f489c06e140 0x7f489c0705f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f48a8009fd0 tx=0x7f48a8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:01.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.437+0000 7f489b7fe700 1 -- 172.21.15.5:0/475838661 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f48a405a730 con 0x7f48b4066f00 2024-04-16T14:44:01.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.668+0000 7f48b99f9700 1 -- 172.21.15.5:0/475838661 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f48b4103f90 con 0x7f489c06e140 2024-04-16T14:44:01.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.670+0000 7f489b7fe700 1 -- 172.21.15.5:0/475838661 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+438 (secure 0 0 0) 0x7f48b4103f90 con 0x7f489c06e140 2024-04-16T14:44:01.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.672+0000 7f48b99f9700 1 -- 172.21.15.5:0/475838661 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f489c06e140 msgr2=0x7f489c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:01.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.672+0000 7f48b99f9700 1 --2- 172.21.15.5:0/475838661 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f489c06e140 0x7f489c0705f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f48a8009fd0 tx=0x7f48a8009e30 comp rx=0 tx=0).stop 2024-04-16T14:44:01.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.672+0000 7f48b99f9700 1 -- 172.21.15.5:0/475838661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48b4066f00 msgr2=0x7f48b410fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:01.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.672+0000 7f48b99f9700 1 --2- 172.21.15.5:0/475838661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48b4066f00 0x7f48b410fe50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f48a4002a80 tx=0x7f48a4004600 comp rx=0 tx=0).stop 2024-04-16T14:44:01.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.672+0000 7f48b99f9700 1 -- 172.21.15.5:0/475838661 shutdown_connections 2024-04-16T14:44:01.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.672+0000 7f48b99f9700 1 --2- 172.21.15.5:0/475838661 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f489c06e140 0x7f489c0705f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:01.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.672+0000 7f48b99f9700 1 --2- 172.21.15.5:0/475838661 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f48b4066f00 0x7f48b410fe50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:01.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.672+0000 7f48b99f9700 1 --2- 172.21.15.5:0/475838661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48b4102380 0x7f48b4110390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:01.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.672+0000 7f48b99f9700 1 -- 172.21.15.5:0/475838661 >> 172.21.15.5:0/475838661 conn(0x7f48b40f7450 msgr2=0x7f48b40f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:01.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.672+0000 7f48b99f9700 1 -- 172.21.15.5:0/475838661 shutdown_connections 2024-04-16T14:44:01.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.672+0000 7f48b99f9700 1 -- 172.21.15.5:0/475838661 wait complete. 2024-04-16T14:44:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.776+0000 7f94ee3cc700 1 -- 172.21.15.5:0/1336420621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e80fc760 msgr2=0x7f94e80fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.776+0000 7f94ee3cc700 1 --2- 172.21.15.5:0/1336420621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e80fc760 0x7f94e80fcbd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f94d0004940 tx=0x7f94d0009e30 comp rx=0 tx=0).stop 2024-04-16T14:44:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.776+0000 7f94ee3cc700 1 -- 172.21.15.5:0/1336420621 shutdown_connections 2024-04-16T14:44:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.776+0000 7f94ee3cc700 1 --2- 172.21.15.5:0/1336420621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e80fc760 0x7f94e80fcbd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.776+0000 7f94ee3cc700 1 --2- 172.21.15.5:0/1336420621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94e80fb4b0 0x7f94e80fb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.776+0000 7f94ee3cc700 1 -- 172.21.15.5:0/1336420621 >> 172.21.15.5:0/1336420621 conn(0x7f94e80f6c10 msgr2=0x7f94e80f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.776+0000 7f94ee3cc700 1 -- 172.21.15.5:0/1336420621 shutdown_connections 2024-04-16T14:44:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.776+0000 7f94ee3cc700 1 -- 172.21.15.5:0/1336420621 wait complete. 2024-04-16T14:44:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.777+0000 7f94ee3cc700 1 Processor -- start 2024-04-16T14:44:01.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.777+0000 7f94ee3cc700 1 -- start start 2024-04-16T14:44:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.777+0000 7f94ee3cc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94e80fb4b0 0x7f94e810cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.777+0000 7f94ee3cc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e80fc760 0x7f94e810b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.777+0000 7f94ee3cc700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e810d4f0 con 0x7f94e80fc760 2024-04-16T14:44:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.777+0000 7f94ee3cc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e810bae0 con 0x7f94e80fb4b0 2024-04-16T14:44:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.777+0000 7f94dffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e80fc760 0x7f94e810b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.777+0000 7f94dffff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e80fc760 0x7f94e810b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49446/0 (socket says 172.21.15.5:49446) 2024-04-16T14:44:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.777+0000 7f94dffff700 1 -- 172.21.15.5:0/3732451972 learned_addr learned my addr 172.21.15.5:0/3732451972 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:44:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.777+0000 7f94e7fff700 1 --2- 172.21.15.5:0/3732451972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94e80fb4b0 0x7f94e810cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.777+0000 7f94dffff700 1 -- 172.21.15.5:0/3732451972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94e80fb4b0 msgr2=0x7f94e810cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.777+0000 7f94dffff700 1 --2- 172.21.15.5:0/3732451972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94e80fb4b0 0x7f94e810cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.777+0000 7f94dffff700 1 -- 172.21.15.5:0/3732451972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d0005040 con 0x7f94e80fc760 2024-04-16T14:44:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.777+0000 7f94dffff700 1 --2- 172.21.15.5:0/3732451972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e80fc760 0x7f94e810b5a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009fd0 tx=0x7f94d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.778+0000 7f94e57fa700 1 -- 172.21.15.5:0/3732451972 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94d000e040 con 0x7f94e80fc760 2024-04-16T14:44:01.777 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.778+0000 7f94e57fa700 1 -- 172.21.15.5:0/3732451972 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f94d000bcc0 con 0x7f94e80fc760 2024-04-16T14:44:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.778+0000 7f94ee3cc700 1 -- 172.21.15.5:0/3732451972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e810bd30 con 0x7f94e80fc760 2024-04-16T14:44:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.778+0000 7f94e57fa700 1 -- 172.21.15.5:0/3732451972 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94d001c630 con 0x7f94e80fc760 2024-04-16T14:44:01.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.778+0000 7f94ee3cc700 1 -- 172.21.15.5:0/3732451972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e810c2f0 con 0x7f94e80fc760 2024-04-16T14:44:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.779+0000 7f94ee3cc700 1 -- 172.21.15.5:0/3732451972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e804c710 con 0x7f94e80fc760 2024-04-16T14:44:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.779+0000 7f94e57fa700 1 -- 172.21.15.5:0/3732451972 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f94d0013980 con 0x7f94e80fc760 2024-04-16T14:44:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.780+0000 7f94e57fa700 1 --2- 172.21.15.5:0/3732451972 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f94d406e140 0x7f94d40705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.780+0000 7f94e57fa700 1 -- 172.21.15.5:0/3732451972 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f94d008eea0 con 0x7f94e80fc760 2024-04-16T14:44:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.780+0000 7f94e7fff700 1 --2- 172.21.15.5:0/3732451972 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f94d406e140 0x7f94d40705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:01.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.780+0000 7f94e7fff700 1 --2- 172.21.15.5:0/3732451972 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f94d406e140 0x7f94d40705f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f94d8004ac0 tx=0x7f94d8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:01.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:01.784+0000 7f94e57fa700 1 -- 172.21.15.5:0/3732451972 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f94d005bc80 con 0x7f94e80fc760 2024-04-16T14:44:02.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.015+0000 7f94ee3cc700 1 -- 172.21.15.5:0/3732451972 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f94e8100ad0 con 0x7f94d406e140 2024-04-16T14:44:02.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.025+0000 7f94e57fa700 1 -- 172.21.15.5:0/3732451972 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f94e8100ad0 con 0x7f94d406e140 2024-04-16T14:44:02.024 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-16T14:44:02.024 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.smithi005 smithi005 *:9093,9094 running (8m) 9s ago 16m 24.2M - 0.25.0 c8568f914cd2 f8aaa22ee70c 2024-04-16T14:44:02.024 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi005 smithi005 running (5m) 9s ago 16m 6656k - 19.0.0-2204-g36befe5d b1a78730e0db d6efa08e65e3 2024-04-16T14:44:02.024 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi115 smithi115 running (5m) 11s ago 15m 6660k - 19.0.0-2204-g36befe5d b1a78730e0db b2a2f2965e2a 2024-04-16T14:44:02.024 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.smithi005 smithi005 *:3000 running (8m) 9s ago 16m 84.5M - 9.4.7 954c08fa6188 9834229a010c 2024-04-16T14:44:02.024 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.vzoqdl smithi005 running (95s) 9s ago 11m 68.7M - 19.0.0-2204-g36befe5d b1a78730e0db acc0c83a4fd1 2024-04-16T14:44:02.024 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.wofqlz smithi005 running (70s) 9s ago 11m 16.5M - 19.0.0-2204-g36befe5d b1a78730e0db bff714c6004b 2024-04-16T14:44:02.024 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.byfytg smithi115 running (51s) 11s ago 11m 11.9M - 19.0.0-2204-g36befe5d b1a78730e0db 62f8399079cd 2024-04-16T14:44:02.024 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.trkaqh smithi115 running (31s) 11s ago 11m 12.6M - 19.0.0-2204-g36befe5d b1a78730e0db fa8483ab2bba 2024-04-16T14:44:02.024 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi005.ipwdkc smithi005 *:8443,9283,8765 running (7m) 9s ago 18m 511M - 19.0.0-2204-g36befe5d b1a78730e0db 451192b4fc44 2024-04-16T14:44:02.024 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi115.brjkpo smithi115 *:8443,9283,8765 running (7m) 11s ago 15m 451M - 19.0.0-2204-g36befe5d b1a78730e0db 0d75f8211942 2024-04-16T14:44:02.024 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi005 smithi005 running (6m) 9s ago 18m 50.7M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3d0c00924867 2024-04-16T14:44:02.024 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi115 smithi115 running (6m) 11s ago 15m 42.5M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3b916a4928b2 2024-04-16T14:44:02.025 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi005 smithi005 *:9100 running (18s) 9s ago 16m 8078k - 1.5.0 0da6a335fe13 6e9cf5cfe8eb 2024-04-16T14:44:02.025 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi115 smithi115 *:9100 running (14s) 11s ago 15m 3607k - 1.5.0 0da6a335fe13 6f12a64c98fc 2024-04-16T14:44:02.025 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (5m) 9s ago 14m 113M 1559M 19.0.0-2204-g36befe5d b1a78730e0db 91d9246d45e0 2024-04-16T14:44:02.025 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (4m) 9s ago 14m 112M 1559M 19.0.0-2204-g36befe5d b1a78730e0db d930ce515e3e 2024-04-16T14:44:02.025 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (4m) 9s ago 13m 88.1M 1559M 19.0.0-2204-g36befe5d b1a78730e0db fdc5fe68ac57 2024-04-16T14:44:02.025 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi115 running (3m) 11s ago 13m 116M 2581M 19.0.0-2204-g36befe5d b1a78730e0db 808ebb96c862 2024-04-16T14:44:02.025 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi115 running (2m) 11s ago 13m 103M 2581M 19.0.0-2204-g36befe5d b1a78730e0db 74d7d2ac5a6a 2024-04-16T14:44:02.025 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi115 running (2m) 11s ago 12m 91.9M 2581M 19.0.0-2204-g36befe5d b1a78730e0db 484bc7617d80 2024-04-16T14:44:02.025 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.smithi005 smithi005 *:9095 running (7m) 9s ago 16m 58.4M - 2.43.0 a07b618ecd1d dc784e58817c 2024-04-16T14:44:02.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.027+0000 7f94ee3cc700 1 -- 172.21.15.5:0/3732451972 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f94d406e140 msgr2=0x7f94d40705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:02.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.027+0000 7f94ee3cc700 1 --2- 172.21.15.5:0/3732451972 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f94d406e140 0x7f94d40705f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f94d8004ac0 tx=0x7f94d8009040 comp rx=0 tx=0).stop 2024-04-16T14:44:02.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.027+0000 7f94ee3cc700 1 -- 172.21.15.5:0/3732451972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e80fc760 msgr2=0x7f94e810b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:02.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.027+0000 7f94ee3cc700 1 --2- 172.21.15.5:0/3732451972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e80fc760 0x7f94e810b5a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009fd0 tx=0x7f94d0009e30 comp rx=0 tx=0).stop 2024-04-16T14:44:02.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.027+0000 7f94ee3cc700 1 -- 172.21.15.5:0/3732451972 shutdown_connections 2024-04-16T14:44:02.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.027+0000 7f94ee3cc700 1 --2- 172.21.15.5:0/3732451972 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f94d406e140 0x7f94d40705f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:02.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.027+0000 7f94ee3cc700 1 --2- 172.21.15.5:0/3732451972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94e80fb4b0 0x7f94e810cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:02.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.027+0000 7f94ee3cc700 1 --2- 172.21.15.5:0/3732451972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94e80fc760 0x7f94e810b5a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:02.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.027+0000 7f94ee3cc700 1 -- 172.21.15.5:0/3732451972 >> 172.21.15.5:0/3732451972 conn(0x7f94e80f6c10 msgr2=0x7f94e80f8350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:02.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.027+0000 7f94ee3cc700 1 -- 172.21.15.5:0/3732451972 shutdown_connections 2024-04-16T14:44:02.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.028+0000 7f94ee3cc700 1 -- 172.21.15.5:0/3732451972 wait complete. 2024-04-16T14:44:02.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.130+0000 7f8fd1304700 1 -- 172.21.15.5:0/361710649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fcc071ea0 msgr2=0x7f8fcc0703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:02.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.130+0000 7f8fd1304700 1 --2- 172.21.15.5:0/361710649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fcc071ea0 0x7f8fcc0703b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc004940 tx=0x7f8fbc009e30 comp rx=0 tx=0).stop 2024-04-16T14:44:02.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.130+0000 7f8fd1304700 1 -- 172.21.15.5:0/361710649 shutdown_connections 2024-04-16T14:44:02.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.130+0000 7f8fd1304700 1 --2- 172.21.15.5:0/361710649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fcc0708f0 0x7f8fcc070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:02.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.130+0000 7f8fd1304700 1 --2- 172.21.15.5:0/361710649 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fcc071ea0 0x7f8fcc0703b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:02.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.130+0000 7f8fd1304700 1 -- 172.21.15.5:0/361710649 >> 172.21.15.5:0/361710649 conn(0x7f8fcc0f8580 msgr2=0x7f8fcc0fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:02.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.131+0000 7f8fd1304700 1 -- 172.21.15.5:0/361710649 shutdown_connections 2024-04-16T14:44:02.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.131+0000 7f8fd1304700 1 -- 172.21.15.5:0/361710649 wait complete. 2024-04-16T14:44:02.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.131+0000 7f8fd1304700 1 Processor -- start 2024-04-16T14:44:02.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.131+0000 7f8fd1304700 1 -- start start 2024-04-16T14:44:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.131+0000 7f8fd1304700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fcc0708f0 0x7f8fcc10fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.131+0000 7f8fd1304700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fcc071ea0 0x7f8fcc110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.131+0000 7f8fd1304700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc110850 con 0x7f8fcc071ea0 2024-04-16T14:44:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.131+0000 7f8fd1304700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc110f90 con 0x7f8fcc0708f0 2024-04-16T14:44:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.131+0000 7f8fc3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fcc071ea0 0x7f8fcc110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.131+0000 7f8fc3fff700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fcc071ea0 0x7f8fcc110250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49478/0 (socket says 172.21.15.5:49478) 2024-04-16T14:44:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.131+0000 7f8fc3fff700 1 -- 172.21.15.5:0/4129538797 learned_addr learned my addr 172.21.15.5:0/4129538797 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:44:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.132+0000 7f8fcaffd700 1 --2- 172.21.15.5:0/4129538797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fcc0708f0 0x7f8fcc10fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.132+0000 7f8fc3fff700 1 -- 172.21.15.5:0/4129538797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fcc0708f0 msgr2=0x7f8fcc10fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.132+0000 7f8fc3fff700 1 --2- 172.21.15.5:0/4129538797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fcc0708f0 0x7f8fcc10fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.132+0000 7f8fc3fff700 1 -- 172.21.15.5:0/4129538797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fbc005040 con 0x7f8fcc071ea0 2024-04-16T14:44:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.132+0000 7f8fc3fff700 1 --2- 172.21.15.5:0/4129538797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fcc071ea0 0x7f8fcc110250 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4002a50 tx=0x7f8fb40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.132+0000 7f8fc37fe700 1 -- 172.21.15.5:0/4129538797 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fb4007cc0 con 0x7f8fcc071ea0 2024-04-16T14:44:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.132+0000 7f8fd1304700 1 -- 172.21.15.5:0/4129538797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fcc111270 con 0x7f8fcc071ea0 2024-04-16T14:44:02.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.132+0000 7f8fc37fe700 1 -- 172.21.15.5:0/4129538797 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8fb400f040 con 0x7f8fcc071ea0 2024-04-16T14:44:02.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.132+0000 7f8fc37fe700 1 -- 172.21.15.5:0/4129538797 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fb400da30 con 0x7f8fcc071ea0 2024-04-16T14:44:02.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.132+0000 7f8fd1304700 1 -- 172.21.15.5:0/4129538797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fcc111830 con 0x7f8fcc071ea0 2024-04-16T14:44:02.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.133+0000 7f8fd1304700 1 -- 172.21.15.5:0/4129538797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fcc05f5f0 con 0x7f8fcc071ea0 2024-04-16T14:44:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.134+0000 7f8fc37fe700 1 -- 172.21.15.5:0/4129538797 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f8fb400db90 con 0x7f8fcc071ea0 2024-04-16T14:44:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.134+0000 7f8fc37fe700 1 --2- 172.21.15.5:0/4129538797 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f8fb806e150 0x7f8fb8070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.134+0000 7f8fc37fe700 1 -- 172.21.15.5:0/4129538797 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f8fb408d970 con 0x7f8fcc071ea0 2024-04-16T14:44:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.134+0000 7f8fcaffd700 1 --2- 172.21.15.5:0/4129538797 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f8fb806e150 0x7f8fb8070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:02.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.135+0000 7f8fcaffd700 1 --2- 172.21.15.5:0/4129538797 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f8fb806e150 0x7f8fb8070600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc000c00 tx=0x7f8fbc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:02.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.139+0000 7f8fc37fe700 1 -- 172.21.15.5:0/4129538797 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f8fb405a770 con 0x7f8fcc071ea0 2024-04-16T14:44:02.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.437+0000 7f8fd1304700 1 -- 172.21.15.5:0/4129538797 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8fcc111af0 con 0x7f8fcc071ea0 2024-04-16T14:44:02.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.438+0000 7f8fc37fe700 1 -- 172.21.15.5:0/4129538797 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f8fb405a300 con 0x7f8fcc071ea0 2024-04-16T14:44:02.436 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:44:02.436 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-04-16T14:44:02.436 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:44:02.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:44:02.437 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-04-16T14:44:02.437 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:44:02.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:44:02.437 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-04-16T14:44:02.437 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 6 2024-04-16T14:44:02.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:44:02.437 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-04-16T14:44:02.437 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 4 2024-04-16T14:44:02.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:44:02.437 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-04-16T14:44:02.437 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 14 2024-04-16T14:44:02.437 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-16T14:44:02.437 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:44:02.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.440+0000 7f8fd1304700 1 -- 172.21.15.5:0/4129538797 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f8fb806e150 msgr2=0x7f8fb8070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:02.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.440+0000 7f8fd1304700 1 --2- 172.21.15.5:0/4129538797 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f8fb806e150 0x7f8fb8070600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc000c00 tx=0x7f8fbc009e30 comp rx=0 tx=0).stop 2024-04-16T14:44:02.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.440+0000 7f8fd1304700 1 -- 172.21.15.5:0/4129538797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fcc071ea0 msgr2=0x7f8fcc110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:02.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.440+0000 7f8fd1304700 1 --2- 172.21.15.5:0/4129538797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fcc071ea0 0x7f8fcc110250 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4002a50 tx=0x7f8fb40046b0 comp rx=0 tx=0).stop 2024-04-16T14:44:02.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.440+0000 7f8fd1304700 1 -- 172.21.15.5:0/4129538797 shutdown_connections 2024-04-16T14:44:02.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.440+0000 7f8fd1304700 1 --2- 172.21.15.5:0/4129538797 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f8fb806e150 0x7f8fb8070600 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:02.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.440+0000 7f8fd1304700 1 --2- 172.21.15.5:0/4129538797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fcc0708f0 0x7f8fcc10fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:02.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.440+0000 7f8fd1304700 1 --2- 172.21.15.5:0/4129538797 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8fcc071ea0 0x7f8fcc110250 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:02.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.440+0000 7f8fd1304700 1 -- 172.21.15.5:0/4129538797 >> 172.21.15.5:0/4129538797 conn(0x7f8fcc0f8580 msgr2=0x7f8fcc0f9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:02.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.440+0000 7f8fd1304700 1 -- 172.21.15.5:0/4129538797 shutdown_connections 2024-04-16T14:44:02.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.440+0000 7f8fd1304700 1 -- 172.21.15.5:0/4129538797 wait complete. 2024-04-16T14:44:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.546+0000 7fdd161cc700 1 -- 172.21.15.5:0/598307016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd100fce80 msgr2=0x7fdd100fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.546+0000 7fdd161cc700 1 --2- 172.21.15.5:0/598307016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd100fce80 0x7fdd100fd290 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdd00004940 tx=0x7fdd00009e30 comp rx=0 tx=0).stop 2024-04-16T14:44:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.546+0000 7fdd161cc700 1 -- 172.21.15.5:0/598307016 shutdown_connections 2024-04-16T14:44:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.546+0000 7fdd161cc700 1 --2- 172.21.15.5:0/598307016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd100fdff0 0x7fdd100fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.546+0000 7fdd161cc700 1 --2- 172.21.15.5:0/598307016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd100fce80 0x7fdd100fd290 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.546+0000 7fdd161cc700 1 -- 172.21.15.5:0/598307016 >> 172.21.15.5:0/598307016 conn(0x7fdd100f8580 msgr2=0x7fdd100fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.547+0000 7fdd161cc700 1 -- 172.21.15.5:0/598307016 shutdown_connections 2024-04-16T14:44:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.547+0000 7fdd161cc700 1 -- 172.21.15.5:0/598307016 wait complete. 2024-04-16T14:44:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.547+0000 7fdd161cc700 1 Processor -- start 2024-04-16T14:44:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.547+0000 7fdd161cc700 1 -- start start 2024-04-16T14:44:02.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.547+0000 7fdd161cc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd100fce80 0x7fdd1010d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.547+0000 7fdd161cc700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd100fdff0 0x7fdd1010dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.547+0000 7fdd161cc700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1010e4a0 con 0x7fdd100fce80 2024-04-16T14:44:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.547+0000 7fdd161cc700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1010e610 con 0x7fdd100fdff0 2024-04-16T14:44:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.548+0000 7fdd0f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd100fce80 0x7fdd1010d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.548+0000 7fdd0f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd100fce80 0x7fdd1010d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49496/0 (socket says 172.21.15.5:49496) 2024-04-16T14:44:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.548+0000 7fdd0f7fe700 1 -- 172.21.15.5:0/2281909621 learned_addr learned my addr 172.21.15.5:0/2281909621 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:44:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.548+0000 7fdd0effd700 1 --2- 172.21.15.5:0/2281909621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd100fdff0 0x7fdd1010dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.548+0000 7fdd0f7fe700 1 -- 172.21.15.5:0/2281909621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd100fdff0 msgr2=0x7fdd1010dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.548+0000 7fdd0f7fe700 1 --2- 172.21.15.5:0/2281909621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd100fdff0 0x7fdd1010dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.548+0000 7fdd0f7fe700 1 -- 172.21.15.5:0/2281909621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd00005040 con 0x7fdd100fce80 2024-04-16T14:44:02.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.548+0000 7fdd0effd700 1 --2- 172.21.15.5:0/2281909621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd100fdff0 0x7fdd1010dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:44:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.548+0000 7fdd0f7fe700 1 --2- 172.21.15.5:0/2281909621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd100fce80 0x7fdd1010d960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdd00009150 tx=0x7fdd00009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.548+0000 7fdcf7fff700 1 -- 172.21.15.5:0/2281909621 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd0000e040 con 0x7fdd100fce80 2024-04-16T14:44:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.548+0000 7fdd161cc700 1 -- 172.21.15.5:0/2281909621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd10113010 con 0x7fdd100fce80 2024-04-16T14:44:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.548+0000 7fdcf7fff700 1 -- 172.21.15.5:0/2281909621 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdd0000bcc0 con 0x7fdd100fce80 2024-04-16T14:44:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.548+0000 7fdcf7fff700 1 -- 172.21.15.5:0/2281909621 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd0001c630 con 0x7fdd100fce80 2024-04-16T14:44:02.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.548+0000 7fdd161cc700 1 -- 172.21.15.5:0/2281909621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd101135d0 con 0x7fdd100fce80 2024-04-16T14:44:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.549+0000 7fdd161cc700 1 -- 172.21.15.5:0/2281909621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd1004c710 con 0x7fdd100fce80 2024-04-16T14:44:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.550+0000 7fdcf7fff700 1 -- 172.21.15.5:0/2281909621 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fdd00013420 con 0x7fdd100fce80 2024-04-16T14:44:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.550+0000 7fdcf7fff700 1 --2- 172.21.15.5:0/2281909621 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fdcf806e140 0x7fdcf80705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.551+0000 7fdcf7fff700 1 -- 172.21.15.5:0/2281909621 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fdd0008e8a0 con 0x7fdd100fce80 2024-04-16T14:44:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.551+0000 7fdd0effd700 1 --2- 172.21.15.5:0/2281909621 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fdcf806e140 0x7fdcf80705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:02.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.551+0000 7fdd0effd700 1 --2- 172.21.15.5:0/2281909621 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fdcf806e140 0x7fdcf80705f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdd04004f00 tx=0x7fdd04009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:02.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.555+0000 7fdcf7fff700 1 -- 172.21.15.5:0/2281909621 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fdd0005b720 con 0x7fdd100fce80 2024-04-16T14:44:02.713 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:02 smithi005 ceph-mon[93420]: pgmap v237: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:02.714 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:02 smithi005 ceph-mon[93420]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:44:02.714 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:02 smithi005 ceph-mon[93420]: from='client.34508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:44:02.714 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:02 smithi005 ceph-mon[93420]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:44:02.714 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:02 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/4129538797' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:02.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.809+0000 7fdd161cc700 1 -- 172.21.15.5:0/2281909621 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdd101138b0 con 0x7fdd100fce80 2024-04-16T14:44:02.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.810+0000 7fdcf7fff700 1 -- 172.21.15.5:0/2281909621 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 44 v44) v1 ==== 76+0+1951 (secure 0 0 0) 0x7fdd0005b2b0 con 0x7fdd100fce80 2024-04-16T14:44:02.814 INFO:teuthology.orchestra.run.smithi005.stdout:e44 2024-04-16T14:44:02.814 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:44:02.814 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:44:02.814 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2024-04-16T14:44:02.814 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:44:02.814 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2024-04-16T14:44:02.814 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2024-04-16T14:44:02.814 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 44 2024-04-16T14:44:02.815 INFO:teuthology.orchestra.run.smithi005.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-16T14:44:02.815 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-16T14:32:45.270024+0000 2024-04-16T14:44:02.815 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-04-16T14:43:39.966885+0000 2024-04-16T14:44:02.815 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2024-04-16T14:44:02.815 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2024-04-16T14:44:02.815 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 60 2024-04-16T14:44:02.815 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2024-04-16T14:44:02.815 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2024-04-16T14:44:02.815 INFO:teuthology.orchestra.run.smithi005.stdout:max_xattr_size 65536 2024-04-16T14:44:02.815 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2024-04-16T14:44:02.815 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2024-04-16T14:44:02.815 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 85 2024-04-16T14:44:02.815 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-16T14:44:02.815 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 2 2024-04-16T14:44:02.816 INFO:teuthology.orchestra.run.smithi005.stdout:in 0,1 2024-04-16T14:44:02.816 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=34434,1=34438} 2024-04-16T14:44:02.816 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2024-04-16T14:44:02.816 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2024-04-16T14:44:02.816 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 2024-04-16T14:44:02.816 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3] 2024-04-16T14:44:02.816 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2024-04-16T14:44:02.816 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2024-04-16T14:44:02.816 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2024-04-16T14:44:02.816 INFO:teuthology.orchestra.run.smithi005.stdout:bal_rank_mask -1 2024-04-16T14:44:02.816 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 1 2024-04-16T14:44:02.816 INFO:teuthology.orchestra.run.smithi005.stdout:qdb_cluster leader: 34434 members: 34434,34438 2024-04-16T14:44:02.816 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.vzoqdl{0:34434} state up:active seq 19 join_fscid=1 addr [v2:172.21.15.5:6826/3940274196,v1:172.21.15.5:6827/3940274196] compat {c=[1],r=[1],i=[1fff]}] 2024-04-16T14:44:02.817 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.wofqlz{1:34438} state up:active seq 13 join_fscid=1 addr [v2:172.21.15.5:6828/3592708911,v1:172.21.15.5:6829/3592708911] compat {c=[1],r=[1],i=[1fff]}] 2024-04-16T14:44:02.817 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:44:02.817 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:44:02.817 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2024-04-16T14:44:02.817 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:44:02.817 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.byfytg{-1:44317} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.115:6824/1461659094,v1:172.21.15.115:6825/1461659094] compat {c=[1],r=[1],i=[1fff]}] 2024-04-16T14:44:02.817 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.trkaqh{-1:44341} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/3171302428,v1:172.21.15.115:6827/3171302428] compat {c=[1],r=[1],i=[1fff]}] 2024-04-16T14:44:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.813+0000 7fdd161cc700 1 -- 172.21.15.5:0/2281909621 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fdcf806e140 msgr2=0x7fdcf80705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.813+0000 7fdd161cc700 1 --2- 172.21.15.5:0/2281909621 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fdcf806e140 0x7fdcf80705f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdd04004f00 tx=0x7fdd04009040 comp rx=0 tx=0).stop 2024-04-16T14:44:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.813+0000 7fdd161cc700 1 -- 172.21.15.5:0/2281909621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd100fce80 msgr2=0x7fdd1010d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.813+0000 7fdd161cc700 1 --2- 172.21.15.5:0/2281909621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd100fce80 0x7fdd1010d960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdd00009150 tx=0x7fdd00009e30 comp rx=0 tx=0).stop 2024-04-16T14:44:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.813+0000 7fdd161cc700 1 -- 172.21.15.5:0/2281909621 shutdown_connections 2024-04-16T14:44:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.813+0000 7fdd161cc700 1 --2- 172.21.15.5:0/2281909621 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fdcf806e140 0x7fdcf80705f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.813+0000 7fdd161cc700 1 --2- 172.21.15.5:0/2281909621 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd100fce80 0x7fdd1010d960 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.813+0000 7fdd161cc700 1 --2- 172.21.15.5:0/2281909621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd100fdff0 0x7fdd1010dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.813+0000 7fdd161cc700 1 -- 172.21.15.5:0/2281909621 >> 172.21.15.5:0/2281909621 conn(0x7fdd100f8580 msgr2=0x7fdd100f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.813+0000 7fdd161cc700 1 -- 172.21.15.5:0/2281909621 shutdown_connections 2024-04-16T14:44:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.813+0000 7fdd161cc700 1 -- 172.21.15.5:0/2281909621 wait complete. 2024-04-16T14:44:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 44 2024-04-16T14:44:02.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.918+0000 7ff165387700 1 -- 172.21.15.5:0/578623817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1600fce50 msgr2=0x7ff1600fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:02.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.918+0000 7ff165387700 1 --2- 172.21.15.5:0/578623817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1600fce50 0x7ff1600fd260 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff150004940 tx=0x7ff150009e30 comp rx=0 tx=0).stop 2024-04-16T14:44:02.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.918+0000 7ff165387700 1 -- 172.21.15.5:0/578623817 shutdown_connections 2024-04-16T14:44:02.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.918+0000 7ff165387700 1 --2- 172.21.15.5:0/578623817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1600fe050 0x7ff1600fe4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:02.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.918+0000 7ff165387700 1 --2- 172.21.15.5:0/578623817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1600fce50 0x7ff1600fd260 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:02.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.918+0000 7ff165387700 1 -- 172.21.15.5:0/578623817 >> 172.21.15.5:0/578623817 conn(0x7ff1600f8580 msgr2=0x7ff1600fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:02.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.919+0000 7ff165387700 1 -- 172.21.15.5:0/578623817 shutdown_connections 2024-04-16T14:44:02.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.919+0000 7ff165387700 1 -- 172.21.15.5:0/578623817 wait complete. 2024-04-16T14:44:02.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.919+0000 7ff165387700 1 Processor -- start 2024-04-16T14:44:02.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.919+0000 7ff165387700 1 -- start start 2024-04-16T14:44:02.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.919+0000 7ff165387700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1600fce50 0x7ff16010fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:02.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.919+0000 7ff165387700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1600fe050 0x7ff1601100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:02.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.919+0000 7ff165387700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1601106e0 con 0x7ff1600fce50 2024-04-16T14:44:02.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.919+0000 7ff165387700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff160110850 con 0x7ff1600fe050 2024-04-16T14:44:02.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.919+0000 7ff15effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1600fce50 0x7ff16010fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:02.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.919+0000 7ff15effd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1600fce50 0x7ff16010fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49508/0 (socket says 172.21.15.5:49508) 2024-04-16T14:44:02.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.919+0000 7ff15effd700 1 -- 172.21.15.5:0/301448753 learned_addr learned my addr 172.21.15.5:0/301448753 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:44:02.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.919+0000 7ff157fff700 1 --2- 172.21.15.5:0/301448753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1600fe050 0x7ff1601100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:02.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.920+0000 7ff15effd700 1 -- 172.21.15.5:0/301448753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1600fe050 msgr2=0x7ff1601100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:02.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.920+0000 7ff15effd700 1 --2- 172.21.15.5:0/301448753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1600fe050 0x7ff1601100e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:02.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.920+0000 7ff15effd700 1 -- 172.21.15.5:0/301448753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff150005040 con 0x7ff1600fce50 2024-04-16T14:44:02.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.920+0000 7ff15effd700 1 --2- 172.21.15.5:0/301448753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1600fce50 0x7ff16010fba0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff15000b970 tx=0x7ff150009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:02.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.920+0000 7ff1577fe700 1 -- 172.21.15.5:0/301448753 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff15000e040 con 0x7ff1600fce50 2024-04-16T14:44:02.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.920+0000 7ff1577fe700 1 -- 172.21.15.5:0/301448753 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff150004290 con 0x7ff1600fce50 2024-04-16T14:44:02.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.920+0000 7ff165387700 1 -- 172.21.15.5:0/301448753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff160115250 con 0x7ff1600fce50 2024-04-16T14:44:02.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.920+0000 7ff1577fe700 1 -- 172.21.15.5:0/301448753 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff15001c3f0 con 0x7ff1600fce50 2024-04-16T14:44:02.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.920+0000 7ff165387700 1 -- 172.21.15.5:0/301448753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff160115810 con 0x7ff1600fce50 2024-04-16T14:44:02.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.921+0000 7ff165387700 1 -- 172.21.15.5:0/301448753 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1601019e0 con 0x7ff1600fce50 2024-04-16T14:44:02.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.922+0000 7ff1577fe700 1 -- 172.21.15.5:0/301448753 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7ff15000bbf0 con 0x7ff1600fce50 2024-04-16T14:44:02.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.922+0000 7ff1577fe700 1 --2- 172.21.15.5:0/301448753 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff14c06e140 0x7ff14c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:02.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.922+0000 7ff1577fe700 1 -- 172.21.15.5:0/301448753 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7ff15008ee80 con 0x7ff1600fce50 2024-04-16T14:44:02.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.922+0000 7ff157fff700 1 --2- 172.21.15.5:0/301448753 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff14c06e140 0x7ff14c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:02.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.923+0000 7ff157fff700 1 --2- 172.21.15.5:0/301448753 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff14c06e140 0x7ff14c0705f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff148004f40 tx=0x7ff14800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:02.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:02.927+0000 7ff1577fe700 1 -- 172.21.15.5:0/301448753 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7ff15005bd00 con 0x7ff1600fce50 2024-04-16T14:44:02.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:02 smithi115 ceph-mon[83414]: pgmap v237: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:02.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:02 smithi115 ceph-mon[83414]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:44:02.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:02 smithi115 ceph-mon[83414]: from='client.34508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:44:02.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:02 smithi115 ceph-mon[83414]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:44:02.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:02 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/4129538797' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:03.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.166+0000 7ff165387700 1 -- 172.21.15.5:0/301448753 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff16002b340 con 0x7ff14c06e140 2024-04-16T14:44:03.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.167+0000 7ff1577fe700 1 -- 172.21.15.5:0/301448753 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+438 (secure 0 0 0) 0x7ff16002b340 con 0x7ff14c06e140 2024-04-16T14:44:03.166 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:44:03.166 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91", 2024-04-16T14:44:03.167 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-04-16T14:44:03.167 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-16T14:44:03.167 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [ 2024-04-16T14:44:03.167 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr", 2024-04-16T14:44:03.167 INFO:teuthology.orchestra.run.smithi005.stdout: "osd", 2024-04-16T14:44:03.167 INFO:teuthology.orchestra.run.smithi005.stdout: "mds", 2024-04-16T14:44:03.167 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2024-04-16T14:44:03.168 INFO:teuthology.orchestra.run.smithi005.stdout: "mon" 2024-04-16T14:44:03.168 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-04-16T14:44:03.168 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "16/21 daemons upgraded", 2024-04-16T14:44:03.168 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading prometheus daemons", 2024-04-16T14:44:03.168 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-04-16T14:44:03.168 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:44:03.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.169+0000 7ff165387700 1 -- 172.21.15.5:0/301448753 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff14c06e140 msgr2=0x7ff14c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:03.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.169+0000 7ff165387700 1 --2- 172.21.15.5:0/301448753 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff14c06e140 0x7ff14c0705f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff148004f40 tx=0x7ff14800b040 comp rx=0 tx=0).stop 2024-04-16T14:44:03.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.169+0000 7ff165387700 1 -- 172.21.15.5:0/301448753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1600fce50 msgr2=0x7ff16010fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:03.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.169+0000 7ff165387700 1 --2- 172.21.15.5:0/301448753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1600fce50 0x7ff16010fba0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff15000b970 tx=0x7ff150009e30 comp rx=0 tx=0).stop 2024-04-16T14:44:03.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.170+0000 7ff165387700 1 -- 172.21.15.5:0/301448753 shutdown_connections 2024-04-16T14:44:03.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.170+0000 7ff165387700 1 --2- 172.21.15.5:0/301448753 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff14c06e140 0x7ff14c0705f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:03.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.170+0000 7ff165387700 1 --2- 172.21.15.5:0/301448753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1600fce50 0x7ff16010fba0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:03.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.170+0000 7ff165387700 1 --2- 172.21.15.5:0/301448753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1600fe050 0x7ff1601100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:03.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.170+0000 7ff165387700 1 -- 172.21.15.5:0/301448753 >> 172.21.15.5:0/301448753 conn(0x7ff1600f8580 msgr2=0x7ff1600f9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:03.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.170+0000 7ff165387700 1 -- 172.21.15.5:0/301448753 shutdown_connections 2024-04-16T14:44:03.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.170+0000 7ff165387700 1 -- 172.21.15.5:0/301448753 wait complete. 2024-04-16T14:44:03.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.281+0000 7f18fdf38700 1 -- 172.21.15.5:0/2880534545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18f80fbcf0 msgr2=0x7f18f80fc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:03.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.281+0000 7f18fdf38700 1 --2- 172.21.15.5:0/2880534545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18f80fbcf0 0x7f18f80fc100 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f18e8004940 tx=0x7f18e8009e30 comp rx=0 tx=0).stop 2024-04-16T14:44:03.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.281+0000 7f18fdf38700 1 -- 172.21.15.5:0/2880534545 shutdown_connections 2024-04-16T14:44:03.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.281+0000 7f18fdf38700 1 --2- 172.21.15.5:0/2880534545 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18f80fcfa0 0x7f18f80fd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:03.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.281+0000 7f18fdf38700 1 --2- 172.21.15.5:0/2880534545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18f80fbcf0 0x7f18f80fc100 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:03.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.281+0000 7f18fdf38700 1 -- 172.21.15.5:0/2880534545 >> 172.21.15.5:0/2880534545 conn(0x7f18f80f7450 msgr2=0x7f18f80f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:03.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.281+0000 7f18fdf38700 1 -- 172.21.15.5:0/2880534545 shutdown_connections 2024-04-16T14:44:03.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.282+0000 7f18fdf38700 1 -- 172.21.15.5:0/2880534545 wait complete. 2024-04-16T14:44:03.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.282+0000 7f18fdf38700 1 Processor -- start 2024-04-16T14:44:03.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.282+0000 7f18fdf38700 1 -- start start 2024-04-16T14:44:03.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.283+0000 7f18fdf38700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18f80fbcf0 0x7f18f81106d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:03.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.283+0000 7f18fdf38700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18f80fcfa0 0x7f18f8112c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:03.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.283+0000 7f18fdf38700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f8066bf0 con 0x7f18f80fcfa0 2024-04-16T14:44:03.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.283+0000 7f18fdf38700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f8066d30 con 0x7f18f80fbcf0 2024-04-16T14:44:03.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.283+0000 7f18f6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18f80fcfa0 0x7f18f8112c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:03.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.283+0000 7f18f6ffd700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18f80fcfa0 0x7f18f8112c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49528/0 (socket says 172.21.15.5:49528) 2024-04-16T14:44:03.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.283+0000 7f18f6ffd700 1 -- 172.21.15.5:0/4179490980 learned_addr learned my addr 172.21.15.5:0/4179490980 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:44:03.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.283+0000 7f18f77fe700 1 --2- 172.21.15.5:0/4179490980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18f80fbcf0 0x7f18f81106d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:03.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.283+0000 7f18f6ffd700 1 -- 172.21.15.5:0/4179490980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18f80fbcf0 msgr2=0x7f18f81106d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:03.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.283+0000 7f18f6ffd700 1 --2- 172.21.15.5:0/4179490980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18f80fbcf0 0x7f18f81106d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:03.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.283+0000 7f18f6ffd700 1 -- 172.21.15.5:0/4179490980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e8005040 con 0x7f18f80fcfa0 2024-04-16T14:44:03.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.283+0000 7f18f6ffd700 1 --2- 172.21.15.5:0/4179490980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18f80fcfa0 0x7f18f8112c20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f18ec00eb40 tx=0x7f18ec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:03.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.284+0000 7f18dffff700 1 -- 172.21.15.5:0/4179490980 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18ec007cc0 con 0x7f18f80fcfa0 2024-04-16T14:44:03.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.284+0000 7f18fdf38700 1 -- 172.21.15.5:0/4179490980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f8113160 con 0x7f18f80fcfa0 2024-04-16T14:44:03.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.284+0000 7f18dffff700 1 -- 172.21.15.5:0/4179490980 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f18ec00f040 con 0x7f18f80fcfa0 2024-04-16T14:44:03.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.284+0000 7f18dffff700 1 -- 172.21.15.5:0/4179490980 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18ec009620 con 0x7f18f80fcfa0 2024-04-16T14:44:03.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.284+0000 7f18fdf38700 1 -- 172.21.15.5:0/4179490980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f81136a0 con 0x7f18f80fcfa0 2024-04-16T14:44:03.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.285+0000 7f18fdf38700 1 -- 172.21.15.5:0/4179490980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f805f5f0 con 0x7f18f80fcfa0 2024-04-16T14:44:03.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.285+0000 7f18dffff700 1 -- 172.21.15.5:0/4179490980 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f18ec009780 con 0x7f18f80fcfa0 2024-04-16T14:44:03.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.286+0000 7f18dffff700 1 --2- 172.21.15.5:0/4179490980 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f18e006e150 0x7f18e0070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:03.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.286+0000 7f18dffff700 1 -- 172.21.15.5:0/4179490980 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f18ec08d890 con 0x7f18f80fcfa0 2024-04-16T14:44:03.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.286+0000 7f18f77fe700 1 --2- 172.21.15.5:0/4179490980 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f18e006e150 0x7f18e0070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:03.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.286+0000 7f18f77fe700 1 --2- 172.21.15.5:0/4179490980 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f18e006e150 0x7f18e0070600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f18e8013870 tx=0x7f18e8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:03.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.291+0000 7f18dffff700 1 -- 172.21.15.5:0/4179490980 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f18ec056c10 con 0x7f18f80fcfa0 2024-04-16T14:44:03.591 INFO:teuthology.orchestra.run.smithi005.stdout:HEALTH_OK 2024-04-16T14:44:03.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.589+0000 7f18fdf38700 1 -- 172.21.15.5:0/4179490980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f18f8113960 con 0x7f18f80fcfa0 2024-04-16T14:44:03.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.589+0000 7f18dffff700 1 -- 172.21.15.5:0/4179490980 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f18ec05a2d0 con 0x7f18f80fcfa0 2024-04-16T14:44:03.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.591+0000 7f18fdf38700 1 -- 172.21.15.5:0/4179490980 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f18e006e150 msgr2=0x7f18e0070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:03.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.591+0000 7f18fdf38700 1 --2- 172.21.15.5:0/4179490980 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f18e006e150 0x7f18e0070600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f18e8013870 tx=0x7f18e8009e30 comp rx=0 tx=0).stop 2024-04-16T14:44:03.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.591+0000 7f18fdf38700 1 -- 172.21.15.5:0/4179490980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18f80fcfa0 msgr2=0x7f18f8112c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:03.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.591+0000 7f18fdf38700 1 --2- 172.21.15.5:0/4179490980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18f80fcfa0 0x7f18f8112c20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f18ec00eb40 tx=0x7f18ec00b040 comp rx=0 tx=0).stop 2024-04-16T14:44:03.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.591+0000 7f18fdf38700 1 -- 172.21.15.5:0/4179490980 shutdown_connections 2024-04-16T14:44:03.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.591+0000 7f18fdf38700 1 --2- 172.21.15.5:0/4179490980 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f18e006e150 0x7f18e0070600 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:03.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.592+0000 7f18fdf38700 1 --2- 172.21.15.5:0/4179490980 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18f80fbcf0 0x7f18f81106d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:03.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.592+0000 7f18fdf38700 1 --2- 172.21.15.5:0/4179490980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f18f80fcfa0 0x7f18f8112c20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:03.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.592+0000 7f18fdf38700 1 -- 172.21.15.5:0/4179490980 >> 172.21.15.5:0/4179490980 conn(0x7f18f80f7450 msgr2=0x7f18f80f8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:03.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.592+0000 7f18fdf38700 1 -- 172.21.15.5:0/4179490980 shutdown_connections 2024-04-16T14:44:03.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:03.592+0000 7f18fdf38700 1 -- 172.21.15.5:0/4179490980 wait complete. 2024-04-16T14:44:03.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:03 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/2281909621' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:44:03.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:03 smithi005 ceph-mon[93420]: from='client.34524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:44:03.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:03 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/2281909621' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:44:03.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:03 smithi115 ceph-mon[83414]: from='client.34524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:44:04.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:04 smithi005 ceph-mon[93420]: pgmap v238: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:04.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:04 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/4179490980' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:44:04.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:04 smithi115 ceph-mon[83414]: pgmap v238: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:04.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:04 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/4179490980' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:44:06.179 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:06 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:06.179 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:06 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:06.179 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:06 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:44:06.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:06 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:06.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:06 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:06.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:06 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:44:07.333 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:07 smithi115 ceph-mon[83414]: pgmap v239: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:07.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:07 smithi005 ceph-mon[93420]: pgmap v239: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:09.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:09 smithi005 ceph-mon[93420]: pgmap v240: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:09.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:09 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:44:09.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:09 smithi115 ceph-mon[83414]: pgmap v240: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:09.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:09 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:44:10.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:10 smithi115 ceph-mon[83414]: pgmap v241: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:10.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:10 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:10.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:10 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:10.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:10 smithi005 ceph-mon[93420]: pgmap v241: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:10.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:10 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:10.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:10 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:11.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:11 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:11.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:11 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:11.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:11 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:11.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:11 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:12.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:12 smithi005 ceph-mon[93420]: pgmap v242: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:13.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:12 smithi115 ceph-mon[83414]: pgmap v242: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:14.969 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:14 smithi005 ceph-mon[93420]: pgmap v243: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:14.969 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:14 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:14.969 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:14 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:14.969 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:14 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:44:14.969 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:14 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:44:14.969 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:14 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:14.970 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:14 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-16T14:44:14.970 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:14 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:44:14.970 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:14 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:14.970 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:14 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:14.970 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:14 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:14.970 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:14 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:14.970 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:14 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:14.970 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:14 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:14.970 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:14 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:14.970 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:14 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:14.970 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:14 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:14.970 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:14 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:14.970 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:14 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:14.971 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:14 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:14.971 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:14 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:14.971 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:14 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:15.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:14 smithi115 ceph-mon[83414]: pgmap v243: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:15.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:14 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:15.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:14 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:15.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:14 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:44:15.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:14 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:44:15.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:14 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:15.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:14 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-16T14:44:15.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:14 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:44:15.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:14 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:15.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:14 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:15.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:14 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:15.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:14 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:15.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:14 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:15.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:14 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:15.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:14 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:15.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:14 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:15.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:14 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:15.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:14 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:15.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:14 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:15.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:14 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:15.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:14 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:15.183 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:14 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:15.972 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:15 smithi005 ceph-mon[93420]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-16T14:44:16.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:15 smithi115 ceph-mon[83414]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-16T14:44:16.953 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:16 smithi005 ceph-mon[93420]: pgmap v244: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:16.954 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:16 smithi005 ceph-mon[93420]: Upgrade: Updating alertmanager.smithi005 2024-04-16T14:44:16.954 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:16 smithi005 ceph-mon[93420]: Deploying daemon alertmanager.smithi005 on smithi005 2024-04-16T14:44:17.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:16 smithi115 ceph-mon[83414]: pgmap v244: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:17.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:16 smithi115 ceph-mon[83414]: Upgrade: Updating alertmanager.smithi005 2024-04-16T14:44:17.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:16 smithi115 ceph-mon[83414]: Deploying daemon alertmanager.smithi005 on smithi005 2024-04-16T14:44:18.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:18 smithi115 ceph-mon[83414]: pgmap v245: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:18.969 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:18 smithi005 ceph-mon[93420]: pgmap v245: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:20.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:20 smithi005 ceph-mon[93420]: pgmap v246: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:21.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:20 smithi115 ceph-mon[83414]: pgmap v246: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:23.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:23 smithi005 ceph-mon[93420]: pgmap v247: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:23.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:23 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:23.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:23 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:23.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:23 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:44:23.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:23 smithi115 ceph-mon[83414]: pgmap v247: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:23.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:23 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:23.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:23 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:23.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:23 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:44:24.372 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:44:24.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:24 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:44:25.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:25 smithi115 ceph-mon[83414]: pgmap v248: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:25.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:25 smithi005 ceph-mon[93420]: pgmap v248: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:27.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:27 smithi005 ceph-mon[93420]: pgmap v249: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:27.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:27 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:27.225 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:27 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:27.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:27 smithi115 ceph-mon[83414]: pgmap v249: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:27.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:27 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:27.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:27 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:28.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:28 smithi115 ceph-mon[83414]: pgmap v250: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:28.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:28 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:28.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:28 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:28.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:28 smithi005 ceph-mon[93420]: pgmap v250: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:28.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:28 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:28.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:28 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:30.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:30 smithi005 ceph-mon[93420]: pgmap v251: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:31.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:30 smithi115 ceph-mon[83414]: pgmap v251: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:32.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:32 smithi005 ceph-mon[93420]: pgmap v252: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:32.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:32.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:32.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:44:32.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:44:32.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:32.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-16T14:44:32.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:32 smithi005 ceph-mon[93420]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-16T14:44:32.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:44:32.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:32 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:32 smithi115 ceph-mon[83414]: pgmap v252: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:32.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:32.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:32.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:44:32.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:44:32.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:32.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-16T14:44:32.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:32 smithi115 ceph-mon[83414]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-16T14:44:32.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:44:32.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:32.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:32 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:33.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:33 smithi115 ceph-mon[83414]: Upgrade: Updating grafana.smithi005 2024-04-16T14:44:33.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:33 smithi115 ceph-mon[83414]: Deploying daemon grafana.smithi005 on smithi005 2024-04-16T14:44:33.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.706+0000 7fd24728c700 1 -- 172.21.15.5:0/2076066397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2400fff70 msgr2=0x7fd240102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:33.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.706+0000 7fd24728c700 1 --2- 172.21.15.5:0/2076066397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2400fff70 0x7fd240102390 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd234004940 tx=0x7fd234009e30 comp rx=0 tx=0).stop 2024-04-16T14:44:33.705 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:33 smithi005 ceph-mon[93420]: Upgrade: Updating grafana.smithi005 2024-04-16T14:44:33.705 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:33 smithi005 ceph-mon[93420]: Deploying daemon grafana.smithi005 on smithi005 2024-04-16T14:44:33.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.706+0000 7fd24728c700 1 -- 172.21.15.5:0/2076066397 shutdown_connections 2024-04-16T14:44:33.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.706+0000 7fd24728c700 1 --2- 172.21.15.5:0/2076066397 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2400fff70 0x7fd240102390 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:33.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.706+0000 7fd24728c700 1 --2- 172.21.15.5:0/2076066397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2400662f0 0x7fd2400ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:33.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.706+0000 7fd24728c700 1 -- 172.21.15.5:0/2076066397 >> 172.21.15.5:0/2076066397 conn(0x7fd2400f74c0 msgr2=0x7fd2400f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:33.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.707+0000 7fd24728c700 1 -- 172.21.15.5:0/2076066397 shutdown_connections 2024-04-16T14:44:33.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.707+0000 7fd24728c700 1 -- 172.21.15.5:0/2076066397 wait complete. 2024-04-16T14:44:33.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.707+0000 7fd24728c700 1 Processor -- start 2024-04-16T14:44:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.707+0000 7fd24728c700 1 -- start start 2024-04-16T14:44:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.708+0000 7fd24728c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2400662f0 0x7fd2400fd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.708+0000 7fd24728c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2400fff70 0x7fd2400fb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.708+0000 7fd24728c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2400fbee0 con 0x7fd2400fff70 2024-04-16T14:44:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.708+0000 7fd24728c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2400fc050 con 0x7fd2400662f0 2024-04-16T14:44:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.708+0000 7fd244827700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2400fff70 0x7fd2400fb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.708+0000 7fd244827700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2400fff70 0x7fd2400fb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39782/0 (socket says 172.21.15.5:39782) 2024-04-16T14:44:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.708+0000 7fd244827700 1 -- 172.21.15.5:0/3621201574 learned_addr learned my addr 172.21.15.5:0/3621201574 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:44:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.708+0000 7fd245028700 1 --2- 172.21.15.5:0/3621201574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2400662f0 0x7fd2400fd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.708+0000 7fd244827700 1 -- 172.21.15.5:0/3621201574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2400662f0 msgr2=0x7fd2400fd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.708+0000 7fd244827700 1 --2- 172.21.15.5:0/3621201574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2400662f0 0x7fd2400fd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.708+0000 7fd244827700 1 -- 172.21.15.5:0/3621201574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd234005040 con 0x7fd2400fff70 2024-04-16T14:44:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.708+0000 7fd244827700 1 --2- 172.21.15.5:0/3621201574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2400fff70 0x7fd2400fb930 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd23400b3b0 tx=0x7fd234009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.708+0000 7fd231ffb700 1 -- 172.21.15.5:0/3621201574 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd23400e040 con 0x7fd2400fff70 2024-04-16T14:44:33.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.708+0000 7fd24728c700 1 -- 172.21.15.5:0/3621201574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2400fc2d0 con 0x7fd2400fff70 2024-04-16T14:44:33.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.708+0000 7fd231ffb700 1 -- 172.21.15.5:0/3621201574 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd23400bbf0 con 0x7fd2400fff70 2024-04-16T14:44:33.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.708+0000 7fd231ffb700 1 -- 172.21.15.5:0/3621201574 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd23401c630 con 0x7fd2400fff70 2024-04-16T14:44:33.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.709+0000 7fd24728c700 1 -- 172.21.15.5:0/3621201574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd240115a90 con 0x7fd2400fff70 2024-04-16T14:44:33.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.710+0000 7fd24728c700 1 -- 172.21.15.5:0/3621201574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd24005f5f0 con 0x7fd2400fff70 2024-04-16T14:44:33.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.710+0000 7fd231ffb700 1 -- 172.21.15.5:0/3621201574 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fd23400bd60 con 0x7fd2400fff70 2024-04-16T14:44:33.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.711+0000 7fd231ffb700 1 --2- 172.21.15.5:0/3621201574 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fd22c06e140 0x7fd22c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:33.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.711+0000 7fd231ffb700 1 -- 172.21.15.5:0/3621201574 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fd23408e850 con 0x7fd2400fff70 2024-04-16T14:44:33.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.711+0000 7fd245028700 1 --2- 172.21.15.5:0/3621201574 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fd22c06e140 0x7fd22c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:33.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.711+0000 7fd245028700 1 --2- 172.21.15.5:0/3621201574 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fd22c06e140 0x7fd22c0705f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd2400fd1f0 tx=0x7fd23c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:33.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.715+0000 7fd231ffb700 1 -- 172.21.15.5:0/3621201574 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fd234057b00 con 0x7fd2400fff70 2024-04-16T14:44:33.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.942+0000 7fd24728c700 1 -- 172.21.15.5:0/3621201574 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2400f8fb0 con 0x7fd22c06e140 2024-04-16T14:44:33.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.943+0000 7fd231ffb700 1 -- 172.21.15.5:0/3621201574 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7fd2400f8fb0 con 0x7fd22c06e140 2024-04-16T14:44:33.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.945+0000 7fd24728c700 1 -- 172.21.15.5:0/3621201574 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fd22c06e140 msgr2=0x7fd22c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:33.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.945+0000 7fd24728c700 1 --2- 172.21.15.5:0/3621201574 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fd22c06e140 0x7fd22c0705f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd2400fd1f0 tx=0x7fd23c00b040 comp rx=0 tx=0).stop 2024-04-16T14:44:33.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.945+0000 7fd24728c700 1 -- 172.21.15.5:0/3621201574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2400fff70 msgr2=0x7fd2400fb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:33.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.945+0000 7fd24728c700 1 --2- 172.21.15.5:0/3621201574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2400fff70 0x7fd2400fb930 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd23400b3b0 tx=0x7fd234009e30 comp rx=0 tx=0).stop 2024-04-16T14:44:33.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.945+0000 7fd24728c700 1 -- 172.21.15.5:0/3621201574 shutdown_connections 2024-04-16T14:44:33.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.945+0000 7fd24728c700 1 --2- 172.21.15.5:0/3621201574 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fd22c06e140 0x7fd22c0705f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:33.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.945+0000 7fd24728c700 1 --2- 172.21.15.5:0/3621201574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2400662f0 0x7fd2400fd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:33.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.945+0000 7fd24728c700 1 --2- 172.21.15.5:0/3621201574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2400fff70 0x7fd2400fb930 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:33.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.945+0000 7fd24728c700 1 -- 172.21.15.5:0/3621201574 >> 172.21.15.5:0/3621201574 conn(0x7fd2400f74c0 msgr2=0x7fd2400f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:33.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.945+0000 7fd24728c700 1 -- 172.21.15.5:0/3621201574 shutdown_connections 2024-04-16T14:44:33.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:33.946+0000 7fd24728c700 1 -- 172.21.15.5:0/3621201574 wait complete. 2024-04-16T14:44:33.954 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-04-16T14:44:34.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.050+0000 7fe50fcad700 1 -- 172.21.15.5:0/1821783016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5080fbcf0 msgr2=0x7fe5080fc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:34.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.050+0000 7fe50fcad700 1 --2- 172.21.15.5:0/1821783016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5080fbcf0 0x7fe5080fc100 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe504004940 tx=0x7fe504009e30 comp rx=0 tx=0).stop 2024-04-16T14:44:34.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.050+0000 7fe50fcad700 1 -- 172.21.15.5:0/1821783016 shutdown_connections 2024-04-16T14:44:34.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.050+0000 7fe50fcad700 1 --2- 172.21.15.5:0/1821783016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5080fcfa0 0x7fe5080fd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:34.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.050+0000 7fe50fcad700 1 --2- 172.21.15.5:0/1821783016 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5080fbcf0 0x7fe5080fc100 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:34.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.050+0000 7fe50fcad700 1 -- 172.21.15.5:0/1821783016 >> 172.21.15.5:0/1821783016 conn(0x7fe5080f7450 msgr2=0x7fe5080f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:34.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.051+0000 7fe50fcad700 1 -- 172.21.15.5:0/1821783016 shutdown_connections 2024-04-16T14:44:34.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.051+0000 7fe50fcad700 1 -- 172.21.15.5:0/1821783016 wait complete. 2024-04-16T14:44:34.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.051+0000 7fe50fcad700 1 Processor -- start 2024-04-16T14:44:34.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.051+0000 7fe50fcad700 1 -- start start 2024-04-16T14:44:34.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.051+0000 7fe50fcad700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5080fbcf0 0x7fe5080ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:34.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.051+0000 7fe50fcad700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5080fcfa0 0x7fe5080fe2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:34.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.051+0000 7fe50fcad700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe508100230 con 0x7fe5080fbcf0 2024-04-16T14:44:34.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.051+0000 7fe50fcad700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5080fe820 con 0x7fe5080fcfa0 2024-04-16T14:44:34.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.051+0000 7fe50da49700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5080fbcf0 0x7fe5080ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:34.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.051+0000 7fe50da49700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5080fbcf0 0x7fe5080ffc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39808/0 (socket says 172.21.15.5:39808) 2024-04-16T14:44:34.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.051+0000 7fe50da49700 1 -- 172.21.15.5:0/2663926507 learned_addr learned my addr 172.21.15.5:0/2663926507 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:44:34.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.052+0000 7fe50d248700 1 --2- 172.21.15.5:0/2663926507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5080fcfa0 0x7fe5080fe2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:34.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.052+0000 7fe50da49700 1 -- 172.21.15.5:0/2663926507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5080fcfa0 msgr2=0x7fe5080fe2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:34.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.052+0000 7fe50da49700 1 --2- 172.21.15.5:0/2663926507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5080fcfa0 0x7fe5080fe2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:34.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.052+0000 7fe50da49700 1 -- 172.21.15.5:0/2663926507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe504005040 con 0x7fe5080fbcf0 2024-04-16T14:44:34.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.052+0000 7fe50da49700 1 --2- 172.21.15.5:0/2663926507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5080fbcf0 0x7fe5080ffc30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe504009150 tx=0x7fe504009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:34.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.052+0000 7fe4fe7fc700 1 -- 172.21.15.5:0/2663926507 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe50400e040 con 0x7fe5080fbcf0 2024-04-16T14:44:34.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.052+0000 7fe50fcad700 1 -- 172.21.15.5:0/2663926507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5080fea70 con 0x7fe5080fbcf0 2024-04-16T14:44:34.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.052+0000 7fe4fe7fc700 1 -- 172.21.15.5:0/2663926507 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe50400bbf0 con 0x7fe5080fbcf0 2024-04-16T14:44:34.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.052+0000 7fe4fe7fc700 1 -- 172.21.15.5:0/2663926507 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe50401c630 con 0x7fe5080fbcf0 2024-04-16T14:44:34.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.052+0000 7fe50fcad700 1 -- 172.21.15.5:0/2663926507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5080ff030 con 0x7fe5080fbcf0 2024-04-16T14:44:34.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.053+0000 7fe50fcad700 1 -- 172.21.15.5:0/2663926507 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe50804c710 con 0x7fe5080fbcf0 2024-04-16T14:44:34.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.053+0000 7fe4fe7fc700 1 -- 172.21.15.5:0/2663926507 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fe50400bd60 con 0x7fe5080fbcf0 2024-04-16T14:44:34.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.054+0000 7fe4fe7fc700 1 --2- 172.21.15.5:0/2663926507 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe4f406e140 0x7fe4f40705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:34.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.054+0000 7fe4fe7fc700 1 -- 172.21.15.5:0/2663926507 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fe50408ef90 con 0x7fe5080fbcf0 2024-04-16T14:44:34.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.054+0000 7fe50d248700 1 --2- 172.21.15.5:0/2663926507 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe4f406e140 0x7fe4f40705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:34.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.054+0000 7fe50d248700 1 --2- 172.21.15.5:0/2663926507 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe4f406e140 0x7fe4f40705f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8004990 tx=0x7fe4f8009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:34.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.059+0000 7fe4fe7fc700 1 -- 172.21.15.5:0/2663926507 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fe50405be10 con 0x7fe5080fbcf0 2024-04-16T14:44:34.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.293+0000 7fe50fcad700 1 -- 172.21.15.5:0/2663926507 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5080f9070 con 0x7fe4f406e140 2024-04-16T14:44:34.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.294+0000 7fe4fe7fc700 1 -- 172.21.15.5:0/2663926507 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7fe5080f9070 con 0x7fe4f406e140 2024-04-16T14:44:34.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.296+0000 7fe50fcad700 1 -- 172.21.15.5:0/2663926507 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe4f406e140 msgr2=0x7fe4f40705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:34.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.296+0000 7fe50fcad700 1 --2- 172.21.15.5:0/2663926507 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe4f406e140 0x7fe4f40705f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8004990 tx=0x7fe4f8009ee0 comp rx=0 tx=0).stop 2024-04-16T14:44:34.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.296+0000 7fe50fcad700 1 -- 172.21.15.5:0/2663926507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5080fbcf0 msgr2=0x7fe5080ffc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:34.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.296+0000 7fe50fcad700 1 --2- 172.21.15.5:0/2663926507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5080fbcf0 0x7fe5080ffc30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe504009150 tx=0x7fe504009e30 comp rx=0 tx=0).stop 2024-04-16T14:44:34.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.296+0000 7fe50fcad700 1 -- 172.21.15.5:0/2663926507 shutdown_connections 2024-04-16T14:44:34.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.296+0000 7fe50fcad700 1 --2- 172.21.15.5:0/2663926507 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe4f406e140 0x7fe4f40705f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:34.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.296+0000 7fe50fcad700 1 --2- 172.21.15.5:0/2663926507 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5080fbcf0 0x7fe5080ffc30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:34.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.296+0000 7fe50fcad700 1 --2- 172.21.15.5:0/2663926507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5080fcfa0 0x7fe5080fe2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:34.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.296+0000 7fe50fcad700 1 -- 172.21.15.5:0/2663926507 >> 172.21.15.5:0/2663926507 conn(0x7fe5080f7450 msgr2=0x7fe5080f8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:34.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.296+0000 7fe50fcad700 1 -- 172.21.15.5:0/2663926507 shutdown_connections 2024-04-16T14:44:34.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.296+0000 7fe50fcad700 1 -- 172.21.15.5:0/2663926507 wait complete. 2024-04-16T14:44:34.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.403+0000 7f0623756700 1 -- 172.21.15.5:0/2295784660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f061c0fc2c0 msgr2=0x7f061c0fc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:34.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.403+0000 7f0623756700 1 --2- 172.21.15.5:0/2295784660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f061c0fc2c0 0x7f061c0fc6d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0618004940 tx=0x7f0618009e30 comp rx=0 tx=0).stop 2024-04-16T14:44:34.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.403+0000 7f0623756700 1 -- 172.21.15.5:0/2295784660 shutdown_connections 2024-04-16T14:44:34.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.403+0000 7f0623756700 1 --2- 172.21.15.5:0/2295784660 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f061c0fcc10 0x7f061c0fd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:34.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.403+0000 7f0623756700 1 --2- 172.21.15.5:0/2295784660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f061c0fc2c0 0x7f061c0fc6d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:34.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.403+0000 7f0623756700 1 -- 172.21.15.5:0/2295784660 >> 172.21.15.5:0/2295784660 conn(0x7f061c0f6bd0 msgr2=0x7f061c0f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:34.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.403+0000 7f0623756700 1 -- 172.21.15.5:0/2295784660 shutdown_connections 2024-04-16T14:44:34.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.403+0000 7f0623756700 1 -- 172.21.15.5:0/2295784660 wait complete. 2024-04-16T14:44:34.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.404+0000 7f0623756700 1 Processor -- start 2024-04-16T14:44:34.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.404+0000 7f0623756700 1 -- start start 2024-04-16T14:44:34.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.404+0000 7f0623756700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f061c0fc2c0 0x7f061c10dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:34.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.404+0000 7f0623756700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f061c0fcc10 0x7f061c10e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:34.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.404+0000 7f0623756700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061c10e600 con 0x7f061c0fc2c0 2024-04-16T14:44:34.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.404+0000 7f0623756700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061c10ee00 con 0x7f061c0fcc10 2024-04-16T14:44:34.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.404+0000 7f06214f2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f061c0fc2c0 0x7f061c10dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:34.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.404+0000 7f06214f2700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f061c0fc2c0 0x7f061c10dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39824/0 (socket says 172.21.15.5:39824) 2024-04-16T14:44:34.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.404+0000 7f06214f2700 1 -- 172.21.15.5:0/951118027 learned_addr learned my addr 172.21.15.5:0/951118027 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:44:34.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.404+0000 7f0620cf1700 1 --2- 172.21.15.5:0/951118027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f061c0fcc10 0x7f061c10e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:34.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.405+0000 7f06214f2700 1 -- 172.21.15.5:0/951118027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f061c0fcc10 msgr2=0x7f061c10e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:34.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.405+0000 7f06214f2700 1 --2- 172.21.15.5:0/951118027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f061c0fcc10 0x7f061c10e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:34.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.405+0000 7f06214f2700 1 -- 172.21.15.5:0/951118027 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0618005040 con 0x7f061c0fc2c0 2024-04-16T14:44:34.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.405+0000 7f06214f2700 1 --2- 172.21.15.5:0/951118027 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f061c0fc2c0 0x7f061c10dac0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0618000c00 tx=0x7f0618009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:34.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.405+0000 7f0611ffb700 1 -- 172.21.15.5:0/951118027 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f061800e040 con 0x7f061c0fc2c0 2024-04-16T14:44:34.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.405+0000 7f0623756700 1 -- 172.21.15.5:0/951118027 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f061c10f080 con 0x7f061c0fc2c0 2024-04-16T14:44:34.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.405+0000 7f0611ffb700 1 -- 172.21.15.5:0/951118027 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f061800bbf0 con 0x7f061c0fc2c0 2024-04-16T14:44:34.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.405+0000 7f0611ffb700 1 -- 172.21.15.5:0/951118027 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f061801c630 con 0x7f061c0fc2c0 2024-04-16T14:44:34.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.405+0000 7f0623756700 1 -- 172.21.15.5:0/951118027 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f061c10f5c0 con 0x7f061c0fc2c0 2024-04-16T14:44:34.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.406+0000 7f0623756700 1 -- 172.21.15.5:0/951118027 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f061c101c10 con 0x7f061c0fc2c0 2024-04-16T14:44:34.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.407+0000 7f0611ffb700 1 -- 172.21.15.5:0/951118027 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f061800bd60 con 0x7f061c0fc2c0 2024-04-16T14:44:34.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.407+0000 7f0611ffb700 1 --2- 172.21.15.5:0/951118027 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f060806e140 0x7f06080705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:34.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.407+0000 7f0611ffb700 1 -- 172.21.15.5:0/951118027 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f061808eeb0 con 0x7f061c0fc2c0 2024-04-16T14:44:34.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.408+0000 7f0620cf1700 1 --2- 172.21.15.5:0/951118027 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f060806e140 0x7f06080705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:34.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.408+0000 7f0620cf1700 1 --2- 172.21.15.5:0/951118027 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f060806e140 0x7f06080705f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f060c0041d0 tx=0x7f060c0043c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:34.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.412+0000 7f0611ffb700 1 -- 172.21.15.5:0/951118027 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f061805bd30 con 0x7f061c0fc2c0 2024-04-16T14:44:34.615 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:34 smithi005 ceph-mon[93420]: pgmap v253: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:34.615 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:34 smithi005 ceph-mon[93420]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:44:34.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.629+0000 7f0623756700 1 -- 172.21.15.5:0/951118027 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f061c1048f0 con 0x7f060806e140 2024-04-16T14:44:34.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.640+0000 7f0611ffb700 1 -- 172.21.15.5:0/951118027 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f061c1048f0 con 0x7f060806e140 2024-04-16T14:44:34.638 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-16T14:44:34.639 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.smithi005 smithi005 *:9093,9094 running (13s) 8s ago 17m 15.0M - 0.25.0 c8568f914cd2 12f156211f1c 2024-04-16T14:44:34.639 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi005 smithi005 running (6m) 8s ago 17m 6656k - 19.0.0-2204-g36befe5d b1a78730e0db d6efa08e65e3 2024-04-16T14:44:34.639 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi115 smithi115 running (6m) 44s ago 16m 6660k - 19.0.0-2204-g36befe5d b1a78730e0db b2a2f2965e2a 2024-04-16T14:44:34.639 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.smithi005 smithi005 *:3000 running (8m) 8s ago 16m 86.1M - 9.4.7 954c08fa6188 9834229a010c 2024-04-16T14:44:34.639 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.vzoqdl smithi005 running (2m) 8s ago 11m 68.8M - 19.0.0-2204-g36befe5d b1a78730e0db acc0c83a4fd1 2024-04-16T14:44:34.639 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.wofqlz smithi005 running (103s) 8s ago 11m 17.5M - 19.0.0-2204-g36befe5d b1a78730e0db bff714c6004b 2024-04-16T14:44:34.639 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.byfytg smithi115 running (84s) 44s ago 11m 11.9M - 19.0.0-2204-g36befe5d b1a78730e0db 62f8399079cd 2024-04-16T14:44:34.639 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.trkaqh smithi115 running (64s) 44s ago 11m 12.6M - 19.0.0-2204-g36befe5d b1a78730e0db fa8483ab2bba 2024-04-16T14:44:34.639 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi005.ipwdkc smithi005 *:8443,9283,8765 running (8m) 8s ago 18m 512M - 19.0.0-2204-g36befe5d b1a78730e0db 451192b4fc44 2024-04-16T14:44:34.639 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi115.brjkpo smithi115 *:8443,9283,8765 running (7m) 44s ago 16m 451M - 19.0.0-2204-g36befe5d b1a78730e0db 0d75f8211942 2024-04-16T14:44:34.639 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi005 smithi005 running (7m) 8s ago 18m 53.3M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3d0c00924867 2024-04-16T14:44:34.640 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi115 smithi115 running (6m) 44s ago 16m 42.5M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3b916a4928b2 2024-04-16T14:44:34.640 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi005 smithi005 *:9100 running (51s) 8s ago 17m 7972k - 1.5.0 0da6a335fe13 6e9cf5cfe8eb 2024-04-16T14:44:34.640 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi115 smithi115 *:9100 running (47s) 44s ago 16m 3607k - 1.5.0 0da6a335fe13 6f12a64c98fc 2024-04-16T14:44:34.640 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (5m) 8s ago 15m 113M 1559M 19.0.0-2204-g36befe5d b1a78730e0db 91d9246d45e0 2024-04-16T14:44:34.640 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (5m) 8s ago 14m 112M 1559M 19.0.0-2204-g36befe5d b1a78730e0db d930ce515e3e 2024-04-16T14:44:34.640 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (4m) 8s ago 14m 88.3M 1559M 19.0.0-2204-g36befe5d b1a78730e0db fdc5fe68ac57 2024-04-16T14:44:34.640 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi115 running (4m) 44s ago 14m 116M 2581M 19.0.0-2204-g36befe5d b1a78730e0db 808ebb96c862 2024-04-16T14:44:34.640 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi115 running (3m) 44s ago 13m 103M 2581M 19.0.0-2204-g36befe5d b1a78730e0db 74d7d2ac5a6a 2024-04-16T14:44:34.640 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi115 running (2m) 44s ago 13m 91.9M 2581M 19.0.0-2204-g36befe5d b1a78730e0db 484bc7617d80 2024-04-16T14:44:34.640 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.smithi005 smithi005 *:9095 running (30s) 8s ago 16m 49.1M - 2.43.0 a07b618ecd1d e3579e77bc89 2024-04-16T14:44:34.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.642+0000 7f0623756700 1 -- 172.21.15.5:0/951118027 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f060806e140 msgr2=0x7f06080705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:34.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.642+0000 7f0623756700 1 --2- 172.21.15.5:0/951118027 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f060806e140 0x7f06080705f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f060c0041d0 tx=0x7f060c0043c0 comp rx=0 tx=0).stop 2024-04-16T14:44:34.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.642+0000 7f0623756700 1 -- 172.21.15.5:0/951118027 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f061c0fc2c0 msgr2=0x7f061c10dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:34.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.642+0000 7f0623756700 1 --2- 172.21.15.5:0/951118027 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f061c0fc2c0 0x7f061c10dac0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0618000c00 tx=0x7f0618009e30 comp rx=0 tx=0).stop 2024-04-16T14:44:34.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.642+0000 7f0623756700 1 -- 172.21.15.5:0/951118027 shutdown_connections 2024-04-16T14:44:34.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.642+0000 7f0623756700 1 --2- 172.21.15.5:0/951118027 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f060806e140 0x7f06080705f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:34.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.642+0000 7f0623756700 1 --2- 172.21.15.5:0/951118027 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f061c0fc2c0 0x7f061c10dac0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:34.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.642+0000 7f0623756700 1 --2- 172.21.15.5:0/951118027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f061c0fcc10 0x7f061c10e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:34.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.642+0000 7f0623756700 1 -- 172.21.15.5:0/951118027 >> 172.21.15.5:0/951118027 conn(0x7f061c0f6bd0 msgr2=0x7f061c0fb630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:34.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.642+0000 7f0623756700 1 -- 172.21.15.5:0/951118027 shutdown_connections 2024-04-16T14:44:34.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.642+0000 7f0623756700 1 -- 172.21.15.5:0/951118027 wait complete. 2024-04-16T14:44:34.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:34 smithi115 ceph-mon[83414]: pgmap v253: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:34.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:34 smithi115 ceph-mon[83414]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:44:34.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.750+0000 7f33b461d700 1 -- 172.21.15.5:0/507438586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ac0fce40 msgr2=0x7f33ac0fd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:34.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.750+0000 7f33b461d700 1 --2- 172.21.15.5:0/507438586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ac0fce40 0x7f33ac0fd250 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f33a8004940 tx=0x7f33a8009e30 comp rx=0 tx=0).stop 2024-04-16T14:44:34.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.751+0000 7f33b461d700 1 -- 172.21.15.5:0/507438586 shutdown_connections 2024-04-16T14:44:34.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.751+0000 7f33b461d700 1 --2- 172.21.15.5:0/507438586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33ac0fe040 0x7f33ac0fe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:34.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.751+0000 7f33b461d700 1 --2- 172.21.15.5:0/507438586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ac0fce40 0x7f33ac0fd250 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:34.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.751+0000 7f33b461d700 1 -- 172.21.15.5:0/507438586 >> 172.21.15.5:0/507438586 conn(0x7f33ac0f8530 msgr2=0x7f33ac0fa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:34.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.751+0000 7f33b461d700 1 -- 172.21.15.5:0/507438586 shutdown_connections 2024-04-16T14:44:34.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.751+0000 7f33b461d700 1 -- 172.21.15.5:0/507438586 wait complete. 2024-04-16T14:44:34.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.751+0000 7f33b461d700 1 Processor -- start 2024-04-16T14:44:34.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.751+0000 7f33b461d700 1 -- start start 2024-04-16T14:44:34.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.752+0000 7f33b461d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ac0fce40 0x7f33ac10da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:34.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.752+0000 7f33b461d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33ac0fe040 0x7f33ac10dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:34.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.752+0000 7f33b461d700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac10e5b0 con 0x7f33ac0fce40 2024-04-16T14:44:34.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.752+0000 7f33b461d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac10ee00 con 0x7f33ac0fe040 2024-04-16T14:44:34.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.752+0000 7f33b23b9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ac0fce40 0x7f33ac10da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:34.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.752+0000 7f33b23b9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ac0fce40 0x7f33ac10da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39844/0 (socket says 172.21.15.5:39844) 2024-04-16T14:44:34.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.752+0000 7f33b23b9700 1 -- 172.21.15.5:0/129590667 learned_addr learned my addr 172.21.15.5:0/129590667 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:44:34.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.752+0000 7f33b1bb8700 1 --2- 172.21.15.5:0/129590667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33ac0fe040 0x7f33ac10dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:34.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.752+0000 7f33b23b9700 1 -- 172.21.15.5:0/129590667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33ac0fe040 msgr2=0x7f33ac10dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:34.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.752+0000 7f33b23b9700 1 --2- 172.21.15.5:0/129590667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33ac0fe040 0x7f33ac10dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:34.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.752+0000 7f33b23b9700 1 -- 172.21.15.5:0/129590667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a8005040 con 0x7f33ac0fce40 2024-04-16T14:44:34.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.752+0000 7f33b23b9700 1 --2- 172.21.15.5:0/129590667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ac0fce40 0x7f33ac10da70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f33a800b3b0 tx=0x7f33a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:34.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.753+0000 7f33a2ffd700 1 -- 172.21.15.5:0/129590667 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33a800e040 con 0x7f33ac0fce40 2024-04-16T14:44:34.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.753+0000 7f33a2ffd700 1 -- 172.21.15.5:0/129590667 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f33a800bcc0 con 0x7f33ac0fce40 2024-04-16T14:44:34.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.753+0000 7f33b461d700 1 -- 172.21.15.5:0/129590667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33ac10f080 con 0x7f33ac0fce40 2024-04-16T14:44:34.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.753+0000 7f33a2ffd700 1 -- 172.21.15.5:0/129590667 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33a801c630 con 0x7f33ac0fce40 2024-04-16T14:44:34.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.753+0000 7f33b461d700 1 -- 172.21.15.5:0/129590667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33ac10f500 con 0x7f33ac0fce40 2024-04-16T14:44:34.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.754+0000 7f33b461d700 1 -- 172.21.15.5:0/129590667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ac05f5f0 con 0x7f33ac0fce40 2024-04-16T14:44:34.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.755+0000 7f33a2ffd700 1 -- 172.21.15.5:0/129590667 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f33a80139f0 con 0x7f33ac0fce40 2024-04-16T14:44:34.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.756+0000 7f33a2ffd700 1 --2- 172.21.15.5:0/129590667 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f339806e140 0x7f33980705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:34.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.756+0000 7f33a2ffd700 1 -- 172.21.15.5:0/129590667 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f33a808e790 con 0x7f33ac0fce40 2024-04-16T14:44:34.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.756+0000 7f33b1bb8700 1 --2- 172.21.15.5:0/129590667 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f339806e140 0x7f33980705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:34.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.757+0000 7f33b1bb8700 1 --2- 172.21.15.5:0/129590667 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f339806e140 0x7f33980705f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f339c004990 tx=0x7f339c009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:34.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:34.762+0000 7f33a2ffd700 1 -- 172.21.15.5:0/129590667 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f33a805b6b0 con 0x7f33ac0fce40 2024-04-16T14:44:35.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.107+0000 7f33b461d700 1 -- 172.21.15.5:0/129590667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f33ac10f8d0 con 0x7f33ac0fce40 2024-04-16T14:44:35.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.107+0000 7f33a2ffd700 1 -- 172.21.15.5:0/129590667 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f33a805b240 con 0x7f33ac0fce40 2024-04-16T14:44:35.106 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:44:35.106 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-04-16T14:44:35.106 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:44:35.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:44:35.107 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-04-16T14:44:35.107 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:44:35.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:44:35.107 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-04-16T14:44:35.107 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 6 2024-04-16T14:44:35.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:44:35.107 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-04-16T14:44:35.107 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 4 2024-04-16T14:44:35.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:44:35.107 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-04-16T14:44:35.107 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 14 2024-04-16T14:44:35.107 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-16T14:44:35.107 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:44:35.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.110+0000 7f33b461d700 1 -- 172.21.15.5:0/129590667 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f339806e140 msgr2=0x7f33980705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:35.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.110+0000 7f33b461d700 1 --2- 172.21.15.5:0/129590667 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f339806e140 0x7f33980705f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f339c004990 tx=0x7f339c009ee0 comp rx=0 tx=0).stop 2024-04-16T14:44:35.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.110+0000 7f33b461d700 1 -- 172.21.15.5:0/129590667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ac0fce40 msgr2=0x7f33ac10da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:35.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.110+0000 7f33b461d700 1 --2- 172.21.15.5:0/129590667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ac0fce40 0x7f33ac10da70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f33a800b3b0 tx=0x7f33a8009e30 comp rx=0 tx=0).stop 2024-04-16T14:44:35.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.110+0000 7f33b461d700 1 -- 172.21.15.5:0/129590667 shutdown_connections 2024-04-16T14:44:35.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.110+0000 7f33b461d700 1 --2- 172.21.15.5:0/129590667 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f339806e140 0x7f33980705f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:35.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.110+0000 7f33b461d700 1 --2- 172.21.15.5:0/129590667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f33ac0fce40 0x7f33ac10da70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:35.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.110+0000 7f33b461d700 1 --2- 172.21.15.5:0/129590667 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33ac0fe040 0x7f33ac10dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:35.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.110+0000 7f33b461d700 1 -- 172.21.15.5:0/129590667 >> 172.21.15.5:0/129590667 conn(0x7f33ac0f8530 msgr2=0x7f33ac0f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:35.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.110+0000 7f33b461d700 1 -- 172.21.15.5:0/129590667 shutdown_connections 2024-04-16T14:44:35.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.110+0000 7f33b461d700 1 -- 172.21.15.5:0/129590667 wait complete. 2024-04-16T14:44:35.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.221+0000 7f3ae118f700 1 -- 172.21.15.5:0/3437242639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3adc0fb450 msgr2=0x7f3adc0fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:35.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.221+0000 7f3ae118f700 1 --2- 172.21.15.5:0/3437242639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3adc0fb450 0x7f3adc0fb860 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3acc004a50 tx=0x7f3acc00af40 comp rx=0 tx=0).stop 2024-04-16T14:44:35.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.221+0000 7f3ae118f700 1 -- 172.21.15.5:0/3437242639 shutdown_connections 2024-04-16T14:44:35.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.221+0000 7f3ae118f700 1 --2- 172.21.15.5:0/3437242639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3adc0fc700 0x7f3adc0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:35.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.221+0000 7f3ae118f700 1 --2- 172.21.15.5:0/3437242639 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3adc0fb450 0x7f3adc0fb860 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:35.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.221+0000 7f3ae118f700 1 -- 172.21.15.5:0/3437242639 >> 172.21.15.5:0/3437242639 conn(0x7f3adc0f6bd0 msgr2=0x7f3adc0f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:35.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.221+0000 7f3ae118f700 1 -- 172.21.15.5:0/3437242639 shutdown_connections 2024-04-16T14:44:35.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.221+0000 7f3ae118f700 1 -- 172.21.15.5:0/3437242639 wait complete. 2024-04-16T14:44:35.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.222+0000 7f3ae118f700 1 Processor -- start 2024-04-16T14:44:35.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.222+0000 7f3ae118f700 1 -- start start 2024-04-16T14:44:35.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.222+0000 7f3ae118f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3adc0fb450 0x7f3adc10da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.222+0000 7f3ae118f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3adc0fc700 0x7f3adc10df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.222+0000 7f3ae118f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc10e540 con 0x7f3adc0fc700 2024-04-16T14:44:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.222+0000 7f3ae118f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc10ed90 con 0x7f3adc0fb450 2024-04-16T14:44:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.222+0000 7f3ada59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3adc0fc700 0x7f3adc10df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.222+0000 7f3ada59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3adc0fc700 0x7f3adc10df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39852/0 (socket says 172.21.15.5:39852) 2024-04-16T14:44:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.222+0000 7f3ada59c700 1 -- 172.21.15.5:0/794615018 learned_addr learned my addr 172.21.15.5:0/794615018 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:44:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.223+0000 7f3adad9d700 1 --2- 172.21.15.5:0/794615018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3adc0fb450 0x7f3adc10da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.223+0000 7f3ada59c700 1 -- 172.21.15.5:0/794615018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3adc0fb450 msgr2=0x7f3adc10da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.223+0000 7f3ada59c700 1 --2- 172.21.15.5:0/794615018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3adc0fb450 0x7f3adc10da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.223+0000 7f3ada59c700 1 -- 172.21.15.5:0/794615018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3acc005040 con 0x7f3adc0fc700 2024-04-16T14:44:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.223+0000 7f3ada59c700 1 --2- 172.21.15.5:0/794615018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3adc0fc700 0x7f3adc10df40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000c830 tx=0x7f3ad0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.223+0000 7f3ac37fe700 1 -- 172.21.15.5:0/794615018 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ad00106f0 con 0x7f3adc0fc700 2024-04-16T14:44:35.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.223+0000 7f3ac37fe700 1 -- 172.21.15.5:0/794615018 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ad0010d20 con 0x7f3adc0fc700 2024-04-16T14:44:35.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.223+0000 7f3ac37fe700 1 -- 172.21.15.5:0/794615018 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ad00113a0 con 0x7f3adc0fc700 2024-04-16T14:44:35.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.223+0000 7f3ae118f700 1 -- 172.21.15.5:0/794615018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3adc10f070 con 0x7f3adc0fc700 2024-04-16T14:44:35.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.223+0000 7f3ae118f700 1 -- 172.21.15.5:0/794615018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3adc10f550 con 0x7f3adc0fc700 2024-04-16T14:44:35.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.224+0000 7f3ae118f700 1 -- 172.21.15.5:0/794615018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3adc05f5f0 con 0x7f3adc0fc700 2024-04-16T14:44:35.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.225+0000 7f3ac37fe700 1 -- 172.21.15.5:0/794615018 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f3ad0012400 con 0x7f3adc0fc700 2024-04-16T14:44:35.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.226+0000 7f3ac37fe700 1 --2- 172.21.15.5:0/794615018 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3ac406e140 0x7f3ac40705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:35.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.226+0000 7f3adad9d700 1 --2- 172.21.15.5:0/794615018 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3ac406e140 0x7f3ac40705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:35.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.226+0000 7f3ac37fe700 1 -- 172.21.15.5:0/794615018 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f3ad008da60 con 0x7f3adc0fc700 2024-04-16T14:44:35.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.227+0000 7f3adad9d700 1 --2- 172.21.15.5:0/794615018 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3ac406e140 0x7f3ac40705f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3acc00c3b0 tx=0x7f3acc00af40 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:35.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.232+0000 7f3ac37fe700 1 -- 172.21.15.5:0/794615018 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f3ad005a980 con 0x7f3adc0fc700 2024-04-16T14:44:35.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:35 smithi005 ceph-mon[93420]: from='client.34536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:44:35.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:35 smithi005 ceph-mon[93420]: from='client.34540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:44:35.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:35 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/129590667' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:35.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.550+0000 7f3ae118f700 1 -- 172.21.15.5:0/794615018 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3adc04bed0 con 0x7f3adc0fc700 2024-04-16T14:44:35.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.550+0000 7f3ac37fe700 1 -- 172.21.15.5:0/794615018 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 44 v44) v1 ==== 76+0+1951 (secure 0 0 0) 0x7f3ad005a510 con 0x7f3adc0fc700 2024-04-16T14:44:35.549 INFO:teuthology.orchestra.run.smithi005.stdout:e44 2024-04-16T14:44:35.549 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:44:35.549 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:44:35.549 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2024-04-16T14:44:35.549 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:44:35.549 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2024-04-16T14:44:35.549 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2024-04-16T14:44:35.549 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 44 2024-04-16T14:44:35.550 INFO:teuthology.orchestra.run.smithi005.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-16T14:44:35.550 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-16T14:32:45.270024+0000 2024-04-16T14:44:35.550 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-04-16T14:43:39.966885+0000 2024-04-16T14:44:35.550 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2024-04-16T14:44:35.550 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2024-04-16T14:44:35.550 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 60 2024-04-16T14:44:35.550 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2024-04-16T14:44:35.550 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2024-04-16T14:44:35.550 INFO:teuthology.orchestra.run.smithi005.stdout:max_xattr_size 65536 2024-04-16T14:44:35.550 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2024-04-16T14:44:35.550 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2024-04-16T14:44:35.550 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 85 2024-04-16T14:44:35.550 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-16T14:44:35.551 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 2 2024-04-16T14:44:35.551 INFO:teuthology.orchestra.run.smithi005.stdout:in 0,1 2024-04-16T14:44:35.551 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=34434,1=34438} 2024-04-16T14:44:35.551 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2024-04-16T14:44:35.551 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2024-04-16T14:44:35.551 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 2024-04-16T14:44:35.551 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3] 2024-04-16T14:44:35.551 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2024-04-16T14:44:35.551 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2024-04-16T14:44:35.551 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2024-04-16T14:44:35.551 INFO:teuthology.orchestra.run.smithi005.stdout:bal_rank_mask -1 2024-04-16T14:44:35.551 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 1 2024-04-16T14:44:35.551 INFO:teuthology.orchestra.run.smithi005.stdout:qdb_cluster leader: 34434 members: 34434,34438 2024-04-16T14:44:35.551 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.vzoqdl{0:34434} state up:active seq 19 join_fscid=1 addr [v2:172.21.15.5:6826/3940274196,v1:172.21.15.5:6827/3940274196] compat {c=[1],r=[1],i=[1fff]}] 2024-04-16T14:44:35.551 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.wofqlz{1:34438} state up:active seq 13 join_fscid=1 addr [v2:172.21.15.5:6828/3592708911,v1:172.21.15.5:6829/3592708911] compat {c=[1],r=[1],i=[1fff]}] 2024-04-16T14:44:35.552 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:44:35.552 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:44:35.552 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2024-04-16T14:44:35.552 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:44:35.552 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.byfytg{-1:44317} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.115:6824/1461659094,v1:172.21.15.115:6825/1461659094] compat {c=[1],r=[1],i=[1fff]}] 2024-04-16T14:44:35.552 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.trkaqh{-1:44341} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/3171302428,v1:172.21.15.115:6827/3171302428] compat {c=[1],r=[1],i=[1fff]}] 2024-04-16T14:44:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.553+0000 7f3ae118f700 1 -- 172.21.15.5:0/794615018 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3ac406e140 msgr2=0x7f3ac40705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.553+0000 7f3ae118f700 1 --2- 172.21.15.5:0/794615018 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3ac406e140 0x7f3ac40705f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3acc00c3b0 tx=0x7f3acc00af40 comp rx=0 tx=0).stop 2024-04-16T14:44:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.553+0000 7f3ae118f700 1 -- 172.21.15.5:0/794615018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3adc0fc700 msgr2=0x7f3adc10df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.553+0000 7f3ae118f700 1 --2- 172.21.15.5:0/794615018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3adc0fc700 0x7f3adc10df40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3ad000c830 tx=0x7f3ad0004470 comp rx=0 tx=0).stop 2024-04-16T14:44:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.553+0000 7f3ae118f700 1 -- 172.21.15.5:0/794615018 shutdown_connections 2024-04-16T14:44:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.553+0000 7f3ae118f700 1 --2- 172.21.15.5:0/794615018 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3ac406e140 0x7f3ac40705f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.553+0000 7f3ae118f700 1 --2- 172.21.15.5:0/794615018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3adc0fb450 0x7f3adc10da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.553+0000 7f3ae118f700 1 --2- 172.21.15.5:0/794615018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3adc0fc700 0x7f3adc10df40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.554+0000 7f3ae118f700 1 -- 172.21.15.5:0/794615018 >> 172.21.15.5:0/794615018 conn(0x7f3adc0f6bd0 msgr2=0x7f3adc0f82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:35.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.554+0000 7f3ae118f700 1 -- 172.21.15.5:0/794615018 shutdown_connections 2024-04-16T14:44:35.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.554+0000 7f3ae118f700 1 -- 172.21.15.5:0/794615018 wait complete. 2024-04-16T14:44:35.554 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 44 2024-04-16T14:44:35.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.676+0000 7fa89de4a700 1 -- 172.21.15.5:0/972498173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa898066270 msgr2=0x7fa8980ffab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:35.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.676+0000 7fa89de4a700 1 --2- 172.21.15.5:0/972498173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa898066270 0x7fa8980ffab0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa888004940 tx=0x7fa888009e30 comp rx=0 tx=0).stop 2024-04-16T14:44:35.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.676+0000 7fa89de4a700 1 -- 172.21.15.5:0/972498173 shutdown_connections 2024-04-16T14:44:35.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.676+0000 7fa89de4a700 1 --2- 172.21.15.5:0/972498173 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8980ffff0 0x7fa8981023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:35.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.676+0000 7fa89de4a700 1 --2- 172.21.15.5:0/972498173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa898066270 0x7fa8980ffab0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:35.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.676+0000 7fa89de4a700 1 -- 172.21.15.5:0/972498173 >> 172.21.15.5:0/972498173 conn(0x7fa8980f74c0 msgr2=0x7fa8980f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:35.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.676+0000 7fa89de4a700 1 -- 172.21.15.5:0/972498173 shutdown_connections 2024-04-16T14:44:35.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.676+0000 7fa89de4a700 1 -- 172.21.15.5:0/972498173 wait complete. 2024-04-16T14:44:35.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.677+0000 7fa89de4a700 1 Processor -- start 2024-04-16T14:44:35.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.677+0000 7fa89de4a700 1 -- start start 2024-04-16T14:44:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.677+0000 7fa89de4a700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa898066270 0x7fa8980fd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.677+0000 7fa89de4a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8980ffff0 0x7fa8980fb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.677+0000 7fa89de4a700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8980fbf60 con 0x7fa898066270 2024-04-16T14:44:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.677+0000 7fa89de4a700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8980fc0d0 con 0x7fa8980ffff0 2024-04-16T14:44:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.677+0000 7fa8977fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa898066270 0x7fa8980fd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.677+0000 7fa8977fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa898066270 0x7fa8980fd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39868/0 (socket says 172.21.15.5:39868) 2024-04-16T14:44:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.677+0000 7fa8977fe700 1 -- 172.21.15.5:0/1739707072 learned_addr learned my addr 172.21.15.5:0/1739707072 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:44:35.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.677+0000 7fa896ffd700 1 --2- 172.21.15.5:0/1739707072 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8980ffff0 0x7fa8980fb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:35.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.678+0000 7fa8977fe700 1 -- 172.21.15.5:0/1739707072 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8980ffff0 msgr2=0x7fa8980fb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:35.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.678+0000 7fa8977fe700 1 --2- 172.21.15.5:0/1739707072 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8980ffff0 0x7fa8980fb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:35.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.678+0000 7fa8977fe700 1 -- 172.21.15.5:0/1739707072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa888005040 con 0x7fa898066270 2024-04-16T14:44:35.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.678+0000 7fa8977fe700 1 --2- 172.21.15.5:0/1739707072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa898066270 0x7fa8980fd4e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa88800b970 tx=0x7fa888009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:35.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.678+0000 7fa87ffff700 1 -- 172.21.15.5:0/1739707072 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa88800e040 con 0x7fa898066270 2024-04-16T14:44:35.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.678+0000 7fa89de4a700 1 -- 172.21.15.5:0/1739707072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8980fc350 con 0x7fa898066270 2024-04-16T14:44:35.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.678+0000 7fa89de4a700 1 -- 172.21.15.5:0/1739707072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa898115a90 con 0x7fa898066270 2024-04-16T14:44:35.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.678+0000 7fa87ffff700 1 -- 172.21.15.5:0/1739707072 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa888004290 con 0x7fa898066270 2024-04-16T14:44:35.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.678+0000 7fa87ffff700 1 -- 172.21.15.5:0/1739707072 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa88801c630 con 0x7fa898066270 2024-04-16T14:44:35.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.680+0000 7fa89de4a700 1 -- 172.21.15.5:0/1739707072 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8840052e0 con 0x7fa898066270 2024-04-16T14:44:35.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.680+0000 7fa87ffff700 1 -- 172.21.15.5:0/1739707072 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fa888013420 con 0x7fa898066270 2024-04-16T14:44:35.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.681+0000 7fa87ffff700 1 --2- 172.21.15.5:0/1739707072 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa88006e150 0x7fa880070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:35.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.681+0000 7fa87ffff700 1 -- 172.21.15.5:0/1739707072 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa88808ecb0 con 0x7fa898066270 2024-04-16T14:44:35.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.681+0000 7fa896ffd700 1 --2- 172.21.15.5:0/1739707072 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa88006e150 0x7fa880070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:35.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.682+0000 7fa896ffd700 1 --2- 172.21.15.5:0/1739707072 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa88006e150 0x7fa880070600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa88c007fd0 tx=0x7fa88c009f60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:35.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:35 smithi115 ceph-mon[83414]: from='client.34536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:44:35.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:35 smithi115 ceph-mon[83414]: from='client.34540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:44:35.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:35 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/129590667' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:35.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.686+0000 7fa87ffff700 1 -- 172.21.15.5:0/1739707072 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fa8880580a0 con 0x7fa898066270 2024-04-16T14:44:35.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.970+0000 7fa89de4a700 1 -- 172.21.15.5:0/1739707072 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa884000bf0 con 0x7fa88006e150 2024-04-16T14:44:35.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.972+0000 7fa87ffff700 1 -- 172.21.15.5:0/1739707072 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7fa884000bf0 con 0x7fa88006e150 2024-04-16T14:44:35.970 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:44:35.970 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91", 2024-04-16T14:44:35.970 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-04-16T14:44:35.970 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-16T14:44:35.970 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [ 2024-04-16T14:44:35.970 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr", 2024-04-16T14:44:35.971 INFO:teuthology.orchestra.run.smithi005.stdout: "osd", 2024-04-16T14:44:35.971 INFO:teuthology.orchestra.run.smithi005.stdout: "mds", 2024-04-16T14:44:35.971 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2024-04-16T14:44:35.971 INFO:teuthology.orchestra.run.smithi005.stdout: "mon" 2024-04-16T14:44:35.971 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-04-16T14:44:35.971 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "16/21 daemons upgraded", 2024-04-16T14:44:35.971 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading grafana daemons", 2024-04-16T14:44:35.971 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-04-16T14:44:35.971 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:44:35.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.974+0000 7fa89de4a700 1 -- 172.21.15.5:0/1739707072 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa88006e150 msgr2=0x7fa880070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:35.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.974+0000 7fa89de4a700 1 --2- 172.21.15.5:0/1739707072 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa88006e150 0x7fa880070600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa88c007fd0 tx=0x7fa88c009f60 comp rx=0 tx=0).stop 2024-04-16T14:44:35.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.974+0000 7fa89de4a700 1 -- 172.21.15.5:0/1739707072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa898066270 msgr2=0x7fa8980fd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:35.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.974+0000 7fa89de4a700 1 --2- 172.21.15.5:0/1739707072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa898066270 0x7fa8980fd4e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa88800b970 tx=0x7fa888009e30 comp rx=0 tx=0).stop 2024-04-16T14:44:35.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.974+0000 7fa89de4a700 1 -- 172.21.15.5:0/1739707072 shutdown_connections 2024-04-16T14:44:35.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.974+0000 7fa89de4a700 1 --2- 172.21.15.5:0/1739707072 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa88006e150 0x7fa880070600 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:35.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.974+0000 7fa89de4a700 1 --2- 172.21.15.5:0/1739707072 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa898066270 0x7fa8980fd4e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:35.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.974+0000 7fa89de4a700 1 --2- 172.21.15.5:0/1739707072 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8980ffff0 0x7fa8980fb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:35.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.974+0000 7fa89de4a700 1 -- 172.21.15.5:0/1739707072 >> 172.21.15.5:0/1739707072 conn(0x7fa8980f74c0 msgr2=0x7fa8980f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:35.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.975+0000 7fa89de4a700 1 -- 172.21.15.5:0/1739707072 shutdown_connections 2024-04-16T14:44:35.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:35.975+0000 7fa89de4a700 1 -- 172.21.15.5:0/1739707072 wait complete. 2024-04-16T14:44:36.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.086+0000 7f8a6989f700 1 -- 172.21.15.5:0/3114986746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a640fe450 msgr2=0x7f8a640fe860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:36.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.086+0000 7f8a6989f700 1 --2- 172.21.15.5:0/3114986746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a640fe450 0x7f8a640fe860 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8a54004940 tx=0x7f8a54009e30 comp rx=0 tx=0).stop 2024-04-16T14:44:36.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.086+0000 7f8a6989f700 1 -- 172.21.15.5:0/3114986746 shutdown_connections 2024-04-16T14:44:36.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.086+0000 7f8a6989f700 1 --2- 172.21.15.5:0/3114986746 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a640feda0 0x7f8a640faee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:36.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.086+0000 7f8a6989f700 1 --2- 172.21.15.5:0/3114986746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a640fe450 0x7f8a640fe860 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:36.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.086+0000 7f8a6989f700 1 -- 172.21.15.5:0/3114986746 >> 172.21.15.5:0/3114986746 conn(0x7f8a640f6bf0 msgr2=0x7f8a640f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:36.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.086+0000 7f8a6989f700 1 -- 172.21.15.5:0/3114986746 shutdown_connections 2024-04-16T14:44:36.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.086+0000 7f8a6989f700 1 -- 172.21.15.5:0/3114986746 wait complete. 2024-04-16T14:44:36.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.087+0000 7f8a6989f700 1 Processor -- start 2024-04-16T14:44:36.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.087+0000 7f8a6989f700 1 -- start start 2024-04-16T14:44:36.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.087+0000 7f8a6989f700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a640fe450 0x7f8a6410d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:36.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.087+0000 7f8a6989f700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a640feda0 0x7f8a6410de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:36.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.087+0000 7f8a6989f700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6410e400 con 0x7f8a640feda0 2024-04-16T14:44:36.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.087+0000 7f8a6989f700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6410e570 con 0x7f8a640fe450 2024-04-16T14:44:36.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.087+0000 7f8a627fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a640feda0 0x7f8a6410de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:36.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.087+0000 7f8a627fc700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a640feda0 0x7f8a6410de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39884/0 (socket says 172.21.15.5:39884) 2024-04-16T14:44:36.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.087+0000 7f8a627fc700 1 -- 172.21.15.5:0/2863406356 learned_addr learned my addr 172.21.15.5:0/2863406356 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:44:36.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.087+0000 7f8a62ffd700 1 --2- 172.21.15.5:0/2863406356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a640fe450 0x7f8a6410d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:36.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.088+0000 7f8a627fc700 1 -- 172.21.15.5:0/2863406356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a640fe450 msgr2=0x7f8a6410d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:36.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.088+0000 7f8a627fc700 1 --2- 172.21.15.5:0/2863406356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a640fe450 0x7f8a6410d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:36.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.088+0000 7f8a627fc700 1 -- 172.21.15.5:0/2863406356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a54005040 con 0x7f8a640feda0 2024-04-16T14:44:36.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.088+0000 7f8a627fc700 1 --2- 172.21.15.5:0/2863406356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a640feda0 0x7f8a6410de00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800eb40 tx=0x7f8a5800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:36.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.088+0000 7f8a4b7fe700 1 -- 172.21.15.5:0/2863406356 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a58007cc0 con 0x7f8a640feda0 2024-04-16T14:44:36.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.088+0000 7f8a6989f700 1 -- 172.21.15.5:0/2863406356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a64112f70 con 0x7f8a640feda0 2024-04-16T14:44:36.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.088+0000 7f8a4b7fe700 1 -- 172.21.15.5:0/2863406356 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a5800f040 con 0x7f8a640feda0 2024-04-16T14:44:36.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.088+0000 7f8a4b7fe700 1 -- 172.21.15.5:0/2863406356 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a5800ca10 con 0x7f8a640feda0 2024-04-16T14:44:36.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.088+0000 7f8a6989f700 1 -- 172.21.15.5:0/2863406356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a64113480 con 0x7f8a640feda0 2024-04-16T14:44:36.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.090+0000 7f8a6989f700 1 -- 172.21.15.5:0/2863406356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a6404c710 con 0x7f8a640feda0 2024-04-16T14:44:36.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.090+0000 7f8a4b7fe700 1 -- 172.21.15.5:0/2863406356 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f8a5800cc80 con 0x7f8a640feda0 2024-04-16T14:44:36.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.090+0000 7f8a4b7fe700 1 --2- 172.21.15.5:0/2863406356 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f8a4c06e140 0x7f8a4c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:44:36.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.091+0000 7f8a4b7fe700 1 -- 172.21.15.5:0/2863406356 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f8a5808d7c0 con 0x7f8a640feda0 2024-04-16T14:44:36.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.091+0000 7f8a62ffd700 1 --2- 172.21.15.5:0/2863406356 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f8a4c06e140 0x7f8a4c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:44:36.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.091+0000 7f8a62ffd700 1 --2- 172.21.15.5:0/2863406356 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f8a4c06e140 0x7f8a4c0705f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8a54009b30 tx=0x7f8a54009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:44:36.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.096+0000 7f8a4b7fe700 1 -- 172.21.15.5:0/2863406356 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f8a5805a670 con 0x7f8a640feda0 2024-04-16T14:44:36.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.445+0000 7f8a6989f700 1 -- 172.21.15.5:0/2863406356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8a64105900 con 0x7f8a640feda0 2024-04-16T14:44:36.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.445+0000 7f8a4b7fe700 1 -- 172.21.15.5:0/2863406356 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f8a5805a200 con 0x7f8a640feda0 2024-04-16T14:44:36.444 INFO:teuthology.orchestra.run.smithi005.stdout:HEALTH_OK 2024-04-16T14:44:36.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.448+0000 7f8a6989f700 1 -- 172.21.15.5:0/2863406356 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f8a4c06e140 msgr2=0x7f8a4c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:36.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.448+0000 7f8a6989f700 1 --2- 172.21.15.5:0/2863406356 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f8a4c06e140 0x7f8a4c0705f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8a54009b30 tx=0x7f8a54009e30 comp rx=0 tx=0).stop 2024-04-16T14:44:36.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.448+0000 7f8a6989f700 1 -- 172.21.15.5:0/2863406356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a640feda0 msgr2=0x7f8a6410de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:44:36.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.448+0000 7f8a6989f700 1 --2- 172.21.15.5:0/2863406356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a640feda0 0x7f8a6410de00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800eb40 tx=0x7f8a5800b040 comp rx=0 tx=0).stop 2024-04-16T14:44:36.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.448+0000 7f8a6989f700 1 -- 172.21.15.5:0/2863406356 shutdown_connections 2024-04-16T14:44:36.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.448+0000 7f8a6989f700 1 --2- 172.21.15.5:0/2863406356 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f8a4c06e140 0x7f8a4c0705f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:36.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.448+0000 7f8a6989f700 1 --2- 172.21.15.5:0/2863406356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a640fe450 0x7f8a6410d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:36.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.448+0000 7f8a6989f700 1 --2- 172.21.15.5:0/2863406356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a640feda0 0x7f8a6410de00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:44:36.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.448+0000 7f8a6989f700 1 -- 172.21.15.5:0/2863406356 >> 172.21.15.5:0/2863406356 conn(0x7f8a640f6bf0 msgr2=0x7f8a640f81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:44:36.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.448+0000 7f8a6989f700 1 -- 172.21.15.5:0/2863406356 shutdown_connections 2024-04-16T14:44:36.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:44:36.448+0000 7f8a6989f700 1 -- 172.21.15.5:0/2863406356 wait complete. 2024-04-16T14:44:36.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:36 smithi115 ceph-mon[83414]: pgmap v254: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:36.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:36 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/794615018' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:44:36.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:36 smithi115 ceph-mon[83414]: from='client.34552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:44:36.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:36 smithi005 ceph-mon[93420]: pgmap v254: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:36.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:36 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/794615018' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:44:36.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:36 smithi005 ceph-mon[93420]: from='client.34552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:44:37.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:37 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/2863406356' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:44:37.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:37 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/2863406356' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:44:38.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:38 smithi115 ceph-mon[83414]: pgmap v255: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:38.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:44:38.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:38 smithi005 ceph-mon[93420]: pgmap v255: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:38.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:44:40.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:40 smithi115 ceph-mon[83414]: pgmap v256: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:40.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:40 smithi005 ceph-mon[93420]: pgmap v256: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:42.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:42 smithi115 ceph-mon[83414]: pgmap v257: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:42.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:42 smithi005 ceph-mon[93420]: pgmap v257: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:44.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:44 smithi115 ceph-mon[83414]: pgmap v258: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:44.704 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:44 smithi005 ceph-mon[93420]: pgmap v258: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:46.353 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:46 smithi005 ceph-mon[93420]: pgmap v259: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:46.353 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:46.353 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:46.353 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:46 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:44:46.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:46 smithi115 ceph-mon[83414]: pgmap v259: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:46.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:46.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:46.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:46 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:44:48.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:48 smithi115 ceph-mon[83414]: pgmap v260: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:48.697 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:48 smithi005 ceph-mon[93420]: pgmap v260: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:51.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:51 smithi115 ceph-mon[83414]: pgmap v261: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:51.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:51 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:51.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:51 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:51.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:51 smithi005 ceph-mon[93420]: pgmap v261: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:51.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:51 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:51.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:51 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:52.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:52 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:52.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:52 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:52.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:52 smithi005 ceph-mon[93420]: pgmap v262: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:52.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:52 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:52.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:52 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:52.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:52 smithi115 ceph-mon[83414]: pgmap v262: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:53.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:53 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:44:53.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:53 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:44:54.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:54 smithi115 ceph-mon[83414]: pgmap v263: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:54.694 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:54 smithi005 ceph-mon[93420]: pgmap v263: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:56.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:56 smithi115 ceph-mon[83414]: pgmap v264: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:56.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:56 smithi005 ceph-mon[93420]: pgmap v264: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:58.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:58.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:58.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:44:58.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:44:58.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:58.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: pgmap v265: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:58.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-16T14:44:58.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-16T14:44:58.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:44:58.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.476 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.477 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.477 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.477 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.477 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.477 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.477 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.477 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: Upgrade: Finalizing container_image settings 2024-04-16T14:44:58.477 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:58.477 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-16T14:44:58.477 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-16T14:44:58.477 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-16T14:44:58.477 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-16T14:44:58.477 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-16T14:44:58.478 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-16T14:44:58.478 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-16T14:44:58.478 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-16T14:44:58.478 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-16T14:44:58.478 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-16T14:44:58.478 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-16T14:44:58.478 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-16T14:44:58.478 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-16T14:44:58.478 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-16T14:44:58.478 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-16T14:44:58.478 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-16T14:44:58.478 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-16T14:44:58.478 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-16T14:44:58.478 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-16T14:44:58.479 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-16T14:44:58.479 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-16T14:44:58.479 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-16T14:44:58.479 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-16T14:44:58.479 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-16T14:44:58.479 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-16T14:44:58.479 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-16T14:44:58.479 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-16T14:44:58.479 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-16T14:44:58.479 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-16T14:44:58.479 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: Upgrade: Complete! 2024-04-16T14:44:58.479 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-16T14:44:58.479 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-16T14:44:58.479 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:44:58.480 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:44:58.480 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:44:58.480 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:58.480 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:44:58.480 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:44:58.480 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:44:58.480 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:58.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:58.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:58.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:44:58.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:44:58.682 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:58.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: pgmap v265: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:44:58.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-16T14:44:58.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-16T14:44:58.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:44:58.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.683 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:44:58.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: Upgrade: Finalizing container_image settings 2024-04-16T14:44:58.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:58.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-16T14:44:58.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-16T14:44:58.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-16T14:44:58.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-16T14:44:58.684 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-16T14:44:58.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-16T14:44:58.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-16T14:44:58.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-16T14:44:58.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-16T14:44:58.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-16T14:44:58.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-16T14:44:58.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-16T14:44:58.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-16T14:44:58.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-16T14:44:58.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-16T14:44:58.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-16T14:44:58.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-16T14:44:58.685 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-16T14:44:58.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-16T14:44:58.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-16T14:44:58.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-16T14:44:58.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-16T14:44:58.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-16T14:44:58.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-16T14:44:58.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-16T14:44:58.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-16T14:44:58.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-16T14:44:58.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-16T14:44:58.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-16T14:44:58.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: Upgrade: Complete! 2024-04-16T14:44:58.686 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-16T14:44:58.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-16T14:44:58.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:44:58.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:44:58.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:44:58.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:58.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:44:58.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:44:58.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:44:58.687 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:59.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:44:59 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:44:59.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:44:59 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:45:00.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:00 smithi115 ceph-mon[83414]: pgmap v266: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:00.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:00 smithi005 ceph-mon[93420]: pgmap v266: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:02.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:02 smithi115 ceph-mon[83414]: pgmap v267: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:02.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:02 smithi005 ceph-mon[93420]: pgmap v267: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:04.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:04 smithi115 ceph-mon[83414]: pgmap v268: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:04.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:04 smithi005 ceph-mon[93420]: pgmap v268: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:06.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.562+0000 7f3c364fa700 1 -- 172.21.15.5:0/2712508324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c300fcfa0 msgr2=0x7f3c300fd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:45:06.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.562+0000 7f3c364fa700 1 --2- 172.21.15.5:0/2712508324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c300fcfa0 0x7f3c300fd410 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3c24004940 tx=0x7f3c24009e30 comp rx=0 tx=0).stop 2024-04-16T14:45:06.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.563+0000 7f3c364fa700 1 -- 172.21.15.5:0/2712508324 shutdown_connections 2024-04-16T14:45:06.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.563+0000 7f3c364fa700 1 --2- 172.21.15.5:0/2712508324 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c300fcfa0 0x7f3c300fd410 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:06.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.563+0000 7f3c364fa700 1 --2- 172.21.15.5:0/2712508324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c300fbcf0 0x7f3c300fc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:06.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.563+0000 7f3c364fa700 1 -- 172.21.15.5:0/2712508324 >> 172.21.15.5:0/2712508324 conn(0x7f3c300f7450 msgr2=0x7f3c300f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:45:06.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.563+0000 7f3c364fa700 1 -- 172.21.15.5:0/2712508324 shutdown_connections 2024-04-16T14:45:06.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.563+0000 7f3c364fa700 1 -- 172.21.15.5:0/2712508324 wait complete. 2024-04-16T14:45:06.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.563+0000 7f3c364fa700 1 Processor -- start 2024-04-16T14:45:06.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.563+0000 7f3c364fa700 1 -- start start 2024-04-16T14:45:06.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.563+0000 7f3c364fa700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c300fbcf0 0x7f3c3010dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:45:06.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.563+0000 7f3c364fa700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c300fcfa0 0x7f3c3010e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:45:06.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.564+0000 7f3c364fa700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3010e800 con 0x7f3c300fcfa0 2024-04-16T14:45:06.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.564+0000 7f3c364fa700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c301131a0 con 0x7f3c300fbcf0 2024-04-16T14:45:06.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.564+0000 7f3c2f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c300fcfa0 0x7f3c3010e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:45:06.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.564+0000 7f3c2f7fe700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c300fcfa0 0x7f3c3010e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36350/0 (socket says 172.21.15.5:36350) 2024-04-16T14:45:06.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.564+0000 7f3c2f7fe700 1 -- 172.21.15.5:0/2953884694 learned_addr learned my addr 172.21.15.5:0/2953884694 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:45:06.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.564+0000 7f3c2ffff700 1 --2- 172.21.15.5:0/2953884694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c300fbcf0 0x7f3c3010dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:45:06.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.564+0000 7f3c2f7fe700 1 -- 172.21.15.5:0/2953884694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c300fbcf0 msgr2=0x7f3c3010dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:45:06.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.564+0000 7f3c2f7fe700 1 --2- 172.21.15.5:0/2953884694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c300fbcf0 0x7f3c3010dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:06.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.564+0000 7f3c2f7fe700 1 -- 172.21.15.5:0/2953884694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c24005040 con 0x7f3c300fcfa0 2024-04-16T14:45:06.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.564+0000 7f3c2f7fe700 1 --2- 172.21.15.5:0/2953884694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c300fcfa0 0x7f3c3010e1b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400b3b0 tx=0x7f3c24009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:45:06.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.564+0000 7f3c2cff9700 1 -- 172.21.15.5:0/2953884694 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c2400e040 con 0x7f3c300fcfa0 2024-04-16T14:45:06.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.564+0000 7f3c2cff9700 1 -- 172.21.15.5:0/2953884694 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3c2400bbf0 con 0x7f3c300fcfa0 2024-04-16T14:45:06.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.564+0000 7f3c364fa700 1 -- 172.21.15.5:0/2953884694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c301132e0 con 0x7f3c300fcfa0 2024-04-16T14:45:06.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.564+0000 7f3c2cff9700 1 -- 172.21.15.5:0/2953884694 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c2401c630 con 0x7f3c300fcfa0 2024-04-16T14:45:06.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.564+0000 7f3c364fa700 1 -- 172.21.15.5:0/2953884694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c30113840 con 0x7f3c300fcfa0 2024-04-16T14:45:06.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.565+0000 7f3c364fa700 1 -- 172.21.15.5:0/2953884694 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c3004c710 con 0x7f3c300fcfa0 2024-04-16T14:45:06.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.566+0000 7f3c2cff9700 1 -- 172.21.15.5:0/2953884694 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f3c2400bd60 con 0x7f3c300fcfa0 2024-04-16T14:45:06.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.566+0000 7f3c2cff9700 1 --2- 172.21.15.5:0/2953884694 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3c1806e140 0x7f3c180705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:45:06.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.567+0000 7f3c2cff9700 1 -- 172.21.15.5:0/2953884694 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f3c2408e760 con 0x7f3c300fcfa0 2024-04-16T14:45:06.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.567+0000 7f3c2ffff700 1 --2- 172.21.15.5:0/2953884694 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3c1806e140 0x7f3c180705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:45:06.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.567+0000 7f3c2ffff700 1 --2- 172.21.15.5:0/2953884694 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3c1806e140 0x7f3c180705f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3c3010f110 tx=0x7f3c2000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:45:06.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.571+0000 7f3c2cff9700 1 -- 172.21.15.5:0/2953884694 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f3c24057b50 con 0x7f3c300fcfa0 2024-04-16T14:45:06.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.798+0000 7f3c364fa700 1 -- 172.21.15.5:0/2953884694 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c30101360 con 0x7f3c1806e140 2024-04-16T14:45:06.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.799+0000 7f3c2cff9700 1 -- 172.21.15.5:0/2953884694 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f3c30101360 con 0x7f3c1806e140 2024-04-16T14:45:06.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.801+0000 7f3c364fa700 1 -- 172.21.15.5:0/2953884694 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3c1806e140 msgr2=0x7f3c180705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:45:06.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.801+0000 7f3c364fa700 1 --2- 172.21.15.5:0/2953884694 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3c1806e140 0x7f3c180705f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3c3010f110 tx=0x7f3c2000b040 comp rx=0 tx=0).stop 2024-04-16T14:45:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.801+0000 7f3c364fa700 1 -- 172.21.15.5:0/2953884694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c300fcfa0 msgr2=0x7f3c3010e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:45:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.801+0000 7f3c364fa700 1 --2- 172.21.15.5:0/2953884694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c300fcfa0 0x7f3c3010e1b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400b3b0 tx=0x7f3c24009e30 comp rx=0 tx=0).stop 2024-04-16T14:45:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.801+0000 7f3c364fa700 1 -- 172.21.15.5:0/2953884694 shutdown_connections 2024-04-16T14:45:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.801+0000 7f3c364fa700 1 --2- 172.21.15.5:0/2953884694 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3c1806e140 0x7f3c180705f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.801+0000 7f3c364fa700 1 --2- 172.21.15.5:0/2953884694 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c300fbcf0 0x7f3c3010dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.801+0000 7f3c364fa700 1 --2- 172.21.15.5:0/2953884694 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c300fcfa0 0x7f3c3010e1b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.801+0000 7f3c364fa700 1 -- 172.21.15.5:0/2953884694 >> 172.21.15.5:0/2953884694 conn(0x7f3c300f7450 msgr2=0x7f3c300f8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:45:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.801+0000 7f3c364fa700 1 -- 172.21.15.5:0/2953884694 shutdown_connections 2024-04-16T14:45:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:06.801+0000 7f3c364fa700 1 -- 172.21.15.5:0/2953884694 wait complete. 2024-04-16T14:45:06.849 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:06 smithi005 ceph-mon[93420]: pgmap v269: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:06.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:06 smithi115 ceph-mon[83414]: pgmap v269: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:07.559 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -e sha1=36befe5d41ee8a6ea2e60983e763134278d506cf -- bash -c 'ceph orch ps' 2024-04-16T14:45:07.871 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:45:07.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:07 smithi115 ceph-mon[83414]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:45:07.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:07 smithi005 ceph-mon[93420]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:45:08.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:08 smithi115 ceph-mon[83414]: pgmap v270: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:08.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:08 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:45:08.970 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:08 smithi005 ceph-mon[93420]: pgmap v270: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:08.971 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:08 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:45:09.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.497+0000 7f673490c700 1 -- 172.21.15.5:0/2435838034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67300fe830 msgr2=0x7f6730106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:45:09.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.497+0000 7f673490c700 1 --2- 172.21.15.5:0/2435838034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67300fe830 0x7f6730106e70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6724004940 tx=0x7f6724009e30 comp rx=0 tx=0).stop 2024-04-16T14:45:09.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.497+0000 7f673490c700 1 -- 172.21.15.5:0/2435838034 shutdown_connections 2024-04-16T14:45:09.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.497+0000 7f673490c700 1 --2- 172.21.15.5:0/2435838034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67300fe830 0x7f6730106e70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.497+0000 7f673490c700 1 --2- 172.21.15.5:0/2435838034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67300fde90 0x7f67300fe260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.497+0000 7f673490c700 1 -- 172.21.15.5:0/2435838034 >> 172.21.15.5:0/2435838034 conn(0x7f67300f7900 msgr2=0x7f67300f9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:45:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.497+0000 7f673490c700 1 -- 172.21.15.5:0/2435838034 shutdown_connections 2024-04-16T14:45:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.497+0000 7f673490c700 1 -- 172.21.15.5:0/2435838034 wait complete. 2024-04-16T14:45:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.497+0000 7f673490c700 1 Processor -- start 2024-04-16T14:45:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.497+0000 7f673490c700 1 -- start start 2024-04-16T14:45:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.498+0000 7f673490c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67300fde90 0x7f6730113940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:45:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.498+0000 7f673490c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67300fe830 0x7f6730113e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:45:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.498+0000 7f673490c700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67301144d0 con 0x7f67300fde90 2024-04-16T14:45:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.498+0000 7f673490c700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673010dad0 con 0x7f67300fe830 2024-04-16T14:45:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.498+0000 7f672e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67300fde90 0x7f6730113940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:45:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.498+0000 7f672e59c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67300fde90 0x7f6730113940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50002/0 (socket says 172.21.15.5:50002) 2024-04-16T14:45:09.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.498+0000 7f672e59c700 1 -- 172.21.15.5:0/4164900836 learned_addr learned my addr 172.21.15.5:0/4164900836 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:45:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.498+0000 7f672e59c700 1 -- 172.21.15.5:0/4164900836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67300fe830 msgr2=0x7f6730113e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:45:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.498+0000 7f672dd9b700 1 --2- 172.21.15.5:0/4164900836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67300fe830 0x7f6730113e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:45:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.498+0000 7f672e59c700 1 --2- 172.21.15.5:0/4164900836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67300fe830 0x7f6730113e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.498+0000 7f672e59c700 1 -- 172.21.15.5:0/4164900836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6724005040 con 0x7f67300fde90 2024-04-16T14:45:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.498+0000 7f672dd9b700 1 --2- 172.21.15.5:0/4164900836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67300fe830 0x7f6730113e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:45:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.498+0000 7f672e59c700 1 --2- 172.21.15.5:0/4164900836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67300fde90 0x7f6730113940 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6720002a50 tx=0x7f67200046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:45:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.498+0000 7f671effd700 1 -- 172.21.15.5:0/4164900836 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6720007cc0 con 0x7f67300fde90 2024-04-16T14:45:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.498+0000 7f671effd700 1 -- 172.21.15.5:0/4164900836 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f672000f040 con 0x7f67300fde90 2024-04-16T14:45:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.498+0000 7f673490c700 1 -- 172.21.15.5:0/4164900836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f673010ddb0 con 0x7f67300fde90 2024-04-16T14:45:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.498+0000 7f671effd700 1 -- 172.21.15.5:0/4164900836 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6720009640 con 0x7f67300fde90 2024-04-16T14:45:09.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.498+0000 7f673490c700 1 -- 172.21.15.5:0/4164900836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f673010e2f0 con 0x7f67300fde90 2024-04-16T14:45:09.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.499+0000 7f673490c700 1 -- 172.21.15.5:0/4164900836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6730066b60 con 0x7f67300fde90 2024-04-16T14:45:09.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.500+0000 7f671effd700 1 -- 172.21.15.5:0/4164900836 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f67200097a0 con 0x7f67300fde90 2024-04-16T14:45:09.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.500+0000 7f671effd700 1 --2- 172.21.15.5:0/4164900836 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f671806e140 0x7f67180705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:45:09.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.500+0000 7f671effd700 1 -- 172.21.15.5:0/4164900836 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f672008da90 con 0x7f67300fde90 2024-04-16T14:45:09.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.500+0000 7f672dd9b700 1 --2- 172.21.15.5:0/4164900836 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f671806e140 0x7f67180705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:45:09.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.501+0000 7f672dd9b700 1 --2- 172.21.15.5:0/4164900836 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f671806e140 0x7f67180705f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f672400b3b0 tx=0x7f6724009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:45:09.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.505+0000 7f671effd700 1 -- 172.21.15.5:0/4164900836 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f672005a7f0 con 0x7f67300fde90 2024-04-16T14:45:09.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.722+0000 7f673490c700 1 -- 172.21.15.5:0/4164900836 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6730109f20 con 0x7f671806e140 2024-04-16T14:45:09.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.734+0000 7f671effd700 1 -- 172.21.15.5:0/4164900836 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f6730109f20 con 0x7f671806e140 2024-04-16T14:45:09.733 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-16T14:45:09.733 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.smithi005 smithi005 *:9093,9094 running (48s) 19s ago 17m 15.0M - 0.25.0 c8568f914cd2 12f156211f1c 2024-04-16T14:45:09.733 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi005 smithi005 running (6m) 19s ago 18m 6656k - 19.0.0-2204-g36befe5d b1a78730e0db d6efa08e65e3 2024-04-16T14:45:09.733 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi115 smithi115 running (6m) 79s ago 16m 6660k - 19.0.0-2204-g36befe5d b1a78730e0db b2a2f2965e2a 2024-04-16T14:45:09.733 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.smithi005 smithi005 *:3000 running (24s) 19s ago 17m 52.9M - 9.4.12 2bacad6d85d8 615801193fb5 2024-04-16T14:45:09.733 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.vzoqdl smithi005 running (2m) 19s ago 12m 68.8M - 19.0.0-2204-g36befe5d b1a78730e0db acc0c83a4fd1 2024-04-16T14:45:09.733 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.wofqlz smithi005 running (2m) 19s ago 12m 18.2M - 19.0.0-2204-g36befe5d b1a78730e0db bff714c6004b 2024-04-16T14:45:09.733 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.byfytg smithi115 running (119s) 79s ago 12m 11.9M - 19.0.0-2204-g36befe5d b1a78730e0db 62f8399079cd 2024-04-16T14:45:09.733 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.trkaqh smithi115 running (99s) 79s ago 12m 12.6M - 19.0.0-2204-g36befe5d b1a78730e0db fa8483ab2bba 2024-04-16T14:45:09.733 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi005.ipwdkc smithi005 *:8443,9283,8765 running (9m) 19s ago 19m 519M - 19.0.0-2204-g36befe5d b1a78730e0db 451192b4fc44 2024-04-16T14:45:09.734 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi115.brjkpo smithi115 *:8443,9283,8765 running (8m) 79s ago 16m 451M - 19.0.0-2204-g36befe5d b1a78730e0db 0d75f8211942 2024-04-16T14:45:09.734 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi005 smithi005 running (7m) 19s ago 19m 54.6M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3d0c00924867 2024-04-16T14:45:09.734 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi115 smithi115 running (7m) 79s ago 16m 42.5M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3b916a4928b2 2024-04-16T14:45:09.734 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi005 smithi005 *:9100 running (86s) 19s ago 17m 8422k - 1.5.0 0da6a335fe13 6e9cf5cfe8eb 2024-04-16T14:45:09.734 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi115 smithi115 *:9100 running (82s) 79s ago 16m 3607k - 1.5.0 0da6a335fe13 6f12a64c98fc 2024-04-16T14:45:09.734 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (6m) 19s ago 16m 113M 1559M 19.0.0-2204-g36befe5d b1a78730e0db 91d9246d45e0 2024-04-16T14:45:09.734 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (5m) 19s ago 15m 112M 1559M 19.0.0-2204-g36befe5d b1a78730e0db d930ce515e3e 2024-04-16T14:45:09.734 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (5m) 19s ago 15m 88.4M 1559M 19.0.0-2204-g36befe5d b1a78730e0db fdc5fe68ac57 2024-04-16T14:45:09.734 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi115 running (4m) 79s ago 14m 116M 2581M 19.0.0-2204-g36befe5d b1a78730e0db 808ebb96c862 2024-04-16T14:45:09.734 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi115 running (4m) 79s ago 14m 103M 2581M 19.0.0-2204-g36befe5d b1a78730e0db 74d7d2ac5a6a 2024-04-16T14:45:09.734 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi115 running (3m) 79s ago 13m 91.9M 2581M 19.0.0-2204-g36befe5d b1a78730e0db 484bc7617d80 2024-04-16T14:45:09.734 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.smithi005 smithi005 *:9095 running (65s) 19s ago 17m 49.3M - 2.43.0 a07b618ecd1d e3579e77bc89 2024-04-16T14:45:09.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.737+0000 7f673490c700 1 -- 172.21.15.5:0/4164900836 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f671806e140 msgr2=0x7f67180705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:45:09.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.737+0000 7f673490c700 1 --2- 172.21.15.5:0/4164900836 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f671806e140 0x7f67180705f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f672400b3b0 tx=0x7f6724009e30 comp rx=0 tx=0).stop 2024-04-16T14:45:09.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.737+0000 7f673490c700 1 -- 172.21.15.5:0/4164900836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67300fde90 msgr2=0x7f6730113940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:45:09.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.737+0000 7f673490c700 1 --2- 172.21.15.5:0/4164900836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67300fde90 0x7f6730113940 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6720002a50 tx=0x7f67200046b0 comp rx=0 tx=0).stop 2024-04-16T14:45:09.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.737+0000 7f673490c700 1 -- 172.21.15.5:0/4164900836 shutdown_connections 2024-04-16T14:45:09.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.737+0000 7f673490c700 1 --2- 172.21.15.5:0/4164900836 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f671806e140 0x7f67180705f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:09.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.737+0000 7f673490c700 1 --2- 172.21.15.5:0/4164900836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67300fde90 0x7f6730113940 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:09.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.737+0000 7f673490c700 1 --2- 172.21.15.5:0/4164900836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67300fe830 0x7f6730113e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:09.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.737+0000 7f673490c700 1 -- 172.21.15.5:0/4164900836 >> 172.21.15.5:0/4164900836 conn(0x7f67300f7900 msgr2=0x7f6730103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:45:09.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.737+0000 7f673490c700 1 -- 172.21.15.5:0/4164900836 shutdown_connections 2024-04-16T14:45:09.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:09.737+0000 7f673490c700 1 -- 172.21.15.5:0/4164900836 wait complete. 2024-04-16T14:45:10.398 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -e sha1=36befe5d41ee8a6ea2e60983e763134278d506cf -- bash -c 'ceph orch upgrade status' 2024-04-16T14:45:10.668 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:45:10.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:10 smithi005 ceph-mon[93420]: pgmap v271: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:10.724 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:10 smithi005 ceph-mon[93420]: from='client.34564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:45:10.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:10 smithi115 ceph-mon[83414]: pgmap v271: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:10.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:10 smithi115 ceph-mon[83414]: from='client.34564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:45:12.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.314+0000 7f5116e91700 1 -- 172.21.15.5:0/2736573436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51101037c0 msgr2=0x7f51100fce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:45:12.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.314+0000 7f5116e91700 1 --2- 172.21.15.5:0/2736573436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51101037c0 0x7f51100fce30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f50fc004940 tx=0x7f50fc009e30 comp rx=0 tx=0).stop 2024-04-16T14:45:12.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.314+0000 7f5116e91700 1 -- 172.21.15.5:0/2736573436 shutdown_connections 2024-04-16T14:45:12.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.314+0000 7f5116e91700 1 --2- 172.21.15.5:0/2736573436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51101037c0 0x7f51100fce30 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:12.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.314+0000 7f5116e91700 1 --2- 172.21.15.5:0/2736573436 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5110102e20 0x7f51101031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:12.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.314+0000 7f5116e91700 1 -- 172.21.15.5:0/2736573436 >> 172.21.15.5:0/2736573436 conn(0x7f51100f89b0 msgr2=0x7f51100fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:45:12.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.314+0000 7f5116e91700 1 -- 172.21.15.5:0/2736573436 shutdown_connections 2024-04-16T14:45:12.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.314+0000 7f5116e91700 1 -- 172.21.15.5:0/2736573436 wait complete. 2024-04-16T14:45:12.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.314+0000 7f5116e91700 1 Processor -- start 2024-04-16T14:45:12.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.314+0000 7f5116e91700 1 -- start start 2024-04-16T14:45:12.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.315+0000 7f5116e91700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5110102e20 0x7f51101139a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:45:12.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.315+0000 7f5116e91700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51101037c0 0x7f5110113ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:45:12.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.315+0000 7f5116e91700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5110114530 con 0x7f5110102e20 2024-04-16T14:45:12.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.315+0000 7f5116e91700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511010db50 con 0x7f51101037c0 2024-04-16T14:45:12.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.315+0000 7f5114c2d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5110102e20 0x7f51101139a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:45:12.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.315+0000 7f5114c2d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5110102e20 0x7f51101139a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50018/0 (socket says 172.21.15.5:50018) 2024-04-16T14:45:12.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.315+0000 7f5114c2d700 1 -- 172.21.15.5:0/171886372 learned_addr learned my addr 172.21.15.5:0/171886372 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:45:12.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.315+0000 7f510ffff700 1 --2- 172.21.15.5:0/171886372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51101037c0 0x7f5110113ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:45:12.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.315+0000 7f5114c2d700 1 -- 172.21.15.5:0/171886372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51101037c0 msgr2=0x7f5110113ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:45:12.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.315+0000 7f5114c2d700 1 --2- 172.21.15.5:0/171886372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51101037c0 0x7f5110113ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:12.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.315+0000 7f5114c2d700 1 -- 172.21.15.5:0/171886372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50fc005040 con 0x7f5110102e20 2024-04-16T14:45:12.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.315+0000 7f510ffff700 1 --2- 172.21.15.5:0/171886372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51101037c0 0x7f5110113ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:45:12.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.316+0000 7f5114c2d700 1 --2- 172.21.15.5:0/171886372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5110102e20 0x7f51101139a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5104002a50 tx=0x7f51040046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:45:12.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.316+0000 7f510d7fa700 1 -- 172.21.15.5:0/171886372 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5104007cc0 con 0x7f5110102e20 2024-04-16T14:45:12.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.316+0000 7f510d7fa700 1 -- 172.21.15.5:0/171886372 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f510400f040 con 0x7f5110102e20 2024-04-16T14:45:12.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.316+0000 7f510d7fa700 1 -- 172.21.15.5:0/171886372 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5104009640 con 0x7f5110102e20 2024-04-16T14:45:12.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.316+0000 7f5116e91700 1 -- 172.21.15.5:0/171886372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f511010de30 con 0x7f5110102e20 2024-04-16T14:45:12.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.316+0000 7f5116e91700 1 -- 172.21.15.5:0/171886372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511010e3f0 con 0x7f5110102e20 2024-04-16T14:45:12.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.317+0000 7f5116e91700 1 -- 172.21.15.5:0/171886372 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51101052f0 con 0x7f5110102e20 2024-04-16T14:45:12.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.317+0000 7f510d7fa700 1 -- 172.21.15.5:0/171886372 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f51040097a0 con 0x7f5110102e20 2024-04-16T14:45:12.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.318+0000 7f510d7fa700 1 --2- 172.21.15.5:0/171886372 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f510006e140 0x7f51000705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:45:12.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.318+0000 7f510d7fa700 1 -- 172.21.15.5:0/171886372 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f510408d9f0 con 0x7f5110102e20 2024-04-16T14:45:12.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.318+0000 7f510ffff700 1 --2- 172.21.15.5:0/171886372 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f510006e140 0x7f51000705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:45:12.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.318+0000 7f510ffff700 1 --2- 172.21.15.5:0/171886372 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f510006e140 0x7f51000705f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009fd0 tx=0x7f50fc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:45:12.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.323+0000 7f510d7fa700 1 -- 172.21.15.5:0/171886372 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f510408fe60 con 0x7f5110102e20 2024-04-16T14:45:12.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.550+0000 7f5116e91700 1 -- 172.21.15.5:0/171886372 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5110109f70 con 0x7f510006e140 2024-04-16T14:45:12.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.552+0000 7f510d7fa700 1 -- 172.21.15.5:0/171886372 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f5110109f70 con 0x7f510006e140 2024-04-16T14:45:12.550 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:45:12.550 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": null, 2024-04-16T14:45:12.550 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": false, 2024-04-16T14:45:12.550 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "", 2024-04-16T14:45:12.550 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [], 2024-04-16T14:45:12.550 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": null, 2024-04-16T14:45:12.550 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "", 2024-04-16T14:45:12.550 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-04-16T14:45:12.551 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:45:12.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.554+0000 7f5116e91700 1 -- 172.21.15.5:0/171886372 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f510006e140 msgr2=0x7f51000705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:45:12.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.554+0000 7f5116e91700 1 --2- 172.21.15.5:0/171886372 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f510006e140 0x7f51000705f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009fd0 tx=0x7f50fc009e30 comp rx=0 tx=0).stop 2024-04-16T14:45:12.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.554+0000 7f5116e91700 1 -- 172.21.15.5:0/171886372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5110102e20 msgr2=0x7f51101139a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:45:12.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.554+0000 7f5116e91700 1 --2- 172.21.15.5:0/171886372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5110102e20 0x7f51101139a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5104002a50 tx=0x7f51040046b0 comp rx=0 tx=0).stop 2024-04-16T14:45:12.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.554+0000 7f5116e91700 1 -- 172.21.15.5:0/171886372 shutdown_connections 2024-04-16T14:45:12.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.554+0000 7f5116e91700 1 --2- 172.21.15.5:0/171886372 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f510006e140 0x7f51000705f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:12.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.554+0000 7f5116e91700 1 --2- 172.21.15.5:0/171886372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5110102e20 0x7f51101139a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:12.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.554+0000 7f5116e91700 1 --2- 172.21.15.5:0/171886372 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51101037c0 0x7f5110113ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:12.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.554+0000 7f5116e91700 1 -- 172.21.15.5:0/171886372 >> 172.21.15.5:0/171886372 conn(0x7f51100f89b0 msgr2=0x7f51101021e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:45:12.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.554+0000 7f5116e91700 1 -- 172.21.15.5:0/171886372 shutdown_connections 2024-04-16T14:45:12.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:12.554+0000 7f5116e91700 1 -- 172.21.15.5:0/171886372 wait complete. 2024-04-16T14:45:12.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:12 smithi115 ceph-mon[83414]: pgmap v272: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:12.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:12 smithi005 ceph-mon[93420]: pgmap v272: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:13.128 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -e sha1=36befe5d41ee8a6ea2e60983e763134278d506cf -- bash -c 'ceph health detail' 2024-04-16T14:45:13.401 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:45:13.863 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:13 smithi005 ceph-mon[93420]: from='client.34568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:45:13.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:13 smithi115 ceph-mon[83414]: from='client.34568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:45:14.761 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:14 smithi005 ceph-mon[93420]: pgmap v273: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:14.933 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:14 smithi115 ceph-mon[83414]: pgmap v273: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:15.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.015+0000 7fb36505b700 1 -- 172.21.15.5:0/2728726618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb360070c10 msgr2=0x7fb360109190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:45:15.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.015+0000 7fb36505b700 1 --2- 172.21.15.5:0/2728726618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb360070c10 0x7fb360109190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb354004970 tx=0x7fb354009e30 comp rx=0 tx=0).stop 2024-04-16T14:45:15.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.015+0000 7fb36505b700 1 -- 172.21.15.5:0/2728726618 shutdown_connections 2024-04-16T14:45:15.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.015+0000 7fb36505b700 1 --2- 172.21.15.5:0/2728726618 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb360070c10 0x7fb360109190 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:15.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.015+0000 7fb36505b700 1 --2- 172.21.15.5:0/2728726618 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb360070300 0x7fb3600706d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:15.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.016+0000 7fb36505b700 1 -- 172.21.15.5:0/2728726618 >> 172.21.15.5:0/2728726618 conn(0x7fb3600f89b0 msgr2=0x7fb3600fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:45:15.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.016+0000 7fb36505b700 1 -- 172.21.15.5:0/2728726618 shutdown_connections 2024-04-16T14:45:15.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.016+0000 7fb36505b700 1 -- 172.21.15.5:0/2728726618 wait complete. 2024-04-16T14:45:15.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.016+0000 7fb36505b700 1 Processor -- start 2024-04-16T14:45:15.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.016+0000 7fb36505b700 1 -- start start 2024-04-16T14:45:15.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.017+0000 7fb36505b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb360070300 0x7fb360115b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:45:15.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.017+0000 7fb36505b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb360070c10 0x7fb360116090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:45:15.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.017+0000 7fb36505b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3601166e0 con 0x7fb360070300 2024-04-16T14:45:15.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.017+0000 7fb36505b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36010fd00 con 0x7fb360070c10 2024-04-16T14:45:15.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.017+0000 7fb35ed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb360070300 0x7fb360115b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:45:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.017+0000 7fb35ed9d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb360070300 0x7fb360115b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50038/0 (socket says 172.21.15.5:50038) 2024-04-16T14:45:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.017+0000 7fb35ed9d700 1 -- 172.21.15.5:0/4004719230 learned_addr learned my addr 172.21.15.5:0/4004719230 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:45:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.017+0000 7fb35e59c700 1 --2- 172.21.15.5:0/4004719230 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb360070c10 0x7fb360116090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:45:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.017+0000 7fb35ed9d700 1 -- 172.21.15.5:0/4004719230 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb360070c10 msgr2=0x7fb360116090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:45:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.017+0000 7fb35ed9d700 1 --2- 172.21.15.5:0/4004719230 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb360070c10 0x7fb360116090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.017+0000 7fb35ed9d700 1 -- 172.21.15.5:0/4004719230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb354005040 con 0x7fb360070300 2024-04-16T14:45:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.017+0000 7fb35ed9d700 1 --2- 172.21.15.5:0/4004719230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb360070300 0x7fb360115b50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb350002a50 tx=0x7fb3500046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:45:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.018+0000 7fb3477fe700 1 -- 172.21.15.5:0/4004719230 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb350007cc0 con 0x7fb360070300 2024-04-16T14:45:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.018+0000 7fb3477fe700 1 -- 172.21.15.5:0/4004719230 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb35000f040 con 0x7fb360070300 2024-04-16T14:45:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.018+0000 7fb36505b700 1 -- 172.21.15.5:0/4004719230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb36010ffe0 con 0x7fb360070300 2024-04-16T14:45:15.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.018+0000 7fb3477fe700 1 -- 172.21.15.5:0/4004719230 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb350009640 con 0x7fb360070300 2024-04-16T14:45:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.018+0000 7fb36505b700 1 -- 172.21.15.5:0/4004719230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3601104f0 con 0x7fb360070300 2024-04-16T14:45:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.019+0000 7fb36505b700 1 -- 172.21.15.5:0/4004719230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb360071a40 con 0x7fb360070300 2024-04-16T14:45:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.019+0000 7fb3477fe700 1 -- 172.21.15.5:0/4004719230 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fb3500097a0 con 0x7fb360070300 2024-04-16T14:45:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.020+0000 7fb3477fe700 1 --2- 172.21.15.5:0/4004719230 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fb34806e140 0x7fb3480705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:45:15.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.020+0000 7fb3477fe700 1 -- 172.21.15.5:0/4004719230 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb35008d910 con 0x7fb360070300 2024-04-16T14:45:15.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.020+0000 7fb35e59c700 1 --2- 172.21.15.5:0/4004719230 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fb34806e140 0x7fb3480705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:45:15.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.020+0000 7fb35e59c700 1 --2- 172.21.15.5:0/4004719230 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fb34806e140 0x7fb3480705f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb354009fd0 tx=0x7fb354009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:45:15.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.025+0000 7fb3477fe700 1 -- 172.21.15.5:0/4004719230 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fb350056c60 con 0x7fb360070300 2024-04-16T14:45:15.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.318+0000 7fb36505b700 1 -- 172.21.15.5:0/4004719230 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb3601111e0 con 0x7fb360070300 2024-04-16T14:45:15.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.319+0000 7fb3477fe700 1 -- 172.21.15.5:0/4004719230 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fb35005a320 con 0x7fb360070300 2024-04-16T14:45:15.317 INFO:teuthology.orchestra.run.smithi005.stdout:HEALTH_OK 2024-04-16T14:45:15.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.321+0000 7fb36505b700 1 -- 172.21.15.5:0/4004719230 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fb34806e140 msgr2=0x7fb3480705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:45:15.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.321+0000 7fb36505b700 1 --2- 172.21.15.5:0/4004719230 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fb34806e140 0x7fb3480705f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb354009fd0 tx=0x7fb354009e30 comp rx=0 tx=0).stop 2024-04-16T14:45:15.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.321+0000 7fb36505b700 1 -- 172.21.15.5:0/4004719230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb360070300 msgr2=0x7fb360115b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:45:15.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.321+0000 7fb36505b700 1 --2- 172.21.15.5:0/4004719230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb360070300 0x7fb360115b50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb350002a50 tx=0x7fb3500046b0 comp rx=0 tx=0).stop 2024-04-16T14:45:15.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.321+0000 7fb36505b700 1 -- 172.21.15.5:0/4004719230 shutdown_connections 2024-04-16T14:45:15.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.321+0000 7fb36505b700 1 --2- 172.21.15.5:0/4004719230 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fb34806e140 0x7fb3480705f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:15.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.321+0000 7fb36505b700 1 --2- 172.21.15.5:0/4004719230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb360070300 0x7fb360115b50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:15.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.321+0000 7fb36505b700 1 --2- 172.21.15.5:0/4004719230 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb360070c10 0x7fb360116090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:15.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.321+0000 7fb36505b700 1 -- 172.21.15.5:0/4004719230 >> 172.21.15.5:0/4004719230 conn(0x7fb3600f89b0 msgr2=0x7fb3600f9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:45:15.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.321+0000 7fb36505b700 1 -- 172.21.15.5:0/4004719230 shutdown_connections 2024-04-16T14:45:15.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:15.321+0000 7fb36505b700 1 -- 172.21.15.5:0/4004719230 wait complete. 2024-04-16T14:45:15.883 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:15 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/4004719230' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:45:15.909 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -e sha1=36befe5d41ee8a6ea2e60983e763134278d506cf -- bash -c 'ceph versions' 2024-04-16T14:45:15.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:15 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/4004719230' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-16T14:45:16.174 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:45:16.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:16 smithi115 ceph-mon[83414]: pgmap v274: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:16.965 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:16 smithi005 ceph-mon[93420]: pgmap v274: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:17.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.908+0000 7f5718af6700 1 -- 172.21.15.5:0/930560191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57141037b0 msgr2=0x7f57140fce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:45:17.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.908+0000 7f5718af6700 1 --2- 172.21.15.5:0/930560191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57141037b0 0x7f57140fce20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f56fc004940 tx=0x7f56fc009e30 comp rx=0 tx=0).stop 2024-04-16T14:45:17.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.909+0000 7f5718af6700 1 -- 172.21.15.5:0/930560191 shutdown_connections 2024-04-16T14:45:17.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.909+0000 7f5718af6700 1 --2- 172.21.15.5:0/930560191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57141037b0 0x7f57140fce20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:17.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.909+0000 7f5718af6700 1 --2- 172.21.15.5:0/930560191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5714102e10 0x7f57141031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:17.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.909+0000 7f5718af6700 1 -- 172.21.15.5:0/930560191 >> 172.21.15.5:0/930560191 conn(0x7f57140f8980 msgr2=0x7f57140fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:45:17.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.909+0000 7f5718af6700 1 -- 172.21.15.5:0/930560191 shutdown_connections 2024-04-16T14:45:17.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.909+0000 7f5718af6700 1 -- 172.21.15.5:0/930560191 wait complete. 2024-04-16T14:45:17.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.909+0000 7f5718af6700 1 Processor -- start 2024-04-16T14:45:17.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.909+0000 7f5718af6700 1 -- start start 2024-04-16T14:45:17.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.909+0000 7f5718af6700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5714102e10 0x7f5714113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:45:17.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.909+0000 7f5718af6700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57141037b0 0x7f57141140d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:45:17.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.909+0000 7f5718af6700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57141147b0 con 0x7f5714102e10 2024-04-16T14:45:17.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.909+0000 7f5718af6700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571410db10 con 0x7f57141037b0 2024-04-16T14:45:17.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.909+0000 7f571259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5714102e10 0x7f5714113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:45:17.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.910+0000 7f571259c700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5714102e10 0x7f5714113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50054/0 (socket says 172.21.15.5:50054) 2024-04-16T14:45:17.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.910+0000 7f571259c700 1 -- 172.21.15.5:0/17624651 learned_addr learned my addr 172.21.15.5:0/17624651 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:45:17.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.910+0000 7f5711d9b700 1 --2- 172.21.15.5:0/17624651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57141037b0 0x7f57141140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:45:17.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.910+0000 7f571259c700 1 -- 172.21.15.5:0/17624651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57141037b0 msgr2=0x7f57141140d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:45:17.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.910+0000 7f571259c700 1 --2- 172.21.15.5:0/17624651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57141037b0 0x7f57141140d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:17.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.910+0000 7f571259c700 1 -- 172.21.15.5:0/17624651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56fc005040 con 0x7f5714102e10 2024-04-16T14:45:17.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.910+0000 7f571259c700 1 --2- 172.21.15.5:0/17624651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5714102e10 0x7f5714113b90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f570400b790 tx=0x7f5704009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:45:17.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.910+0000 7f570affd700 1 -- 172.21.15.5:0/17624651 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f570400f770 con 0x7f5714102e10 2024-04-16T14:45:17.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.910+0000 7f570affd700 1 -- 172.21.15.5:0/17624651 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f570400fda0 con 0x7f5714102e10 2024-04-16T14:45:17.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.910+0000 7f570affd700 1 -- 172.21.15.5:0/17624651 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f570400d310 con 0x7f5714102e10 2024-04-16T14:45:17.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.910+0000 7f5718af6700 1 -- 172.21.15.5:0/17624651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f571410ddf0 con 0x7f5714102e10 2024-04-16T14:45:17.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.910+0000 7f5718af6700 1 -- 172.21.15.5:0/17624651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f571410e3b0 con 0x7f5714102e10 2024-04-16T14:45:17.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.911+0000 7f5718af6700 1 -- 172.21.15.5:0/17624651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57140fe560 con 0x7f5714102e10 2024-04-16T14:45:17.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.912+0000 7f570affd700 1 -- 172.21.15.5:0/17624651 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f5704010420 con 0x7f5714102e10 2024-04-16T14:45:17.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.912+0000 7f570affd700 1 --2- 172.21.15.5:0/17624651 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f570006e140 0x7f57000705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:45:17.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.912+0000 7f570affd700 1 -- 172.21.15.5:0/17624651 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f570408dbc0 con 0x7f5714102e10 2024-04-16T14:45:17.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.912+0000 7f5711d9b700 1 --2- 172.21.15.5:0/17624651 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f570006e140 0x7f57000705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:45:17.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.913+0000 7f5711d9b700 1 --2- 172.21.15.5:0/17624651 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f570006e140 0x7f57000705f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f571410ecd0 tx=0x7f56fc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:45:17.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:17.917+0000 7f570affd700 1 -- 172.21.15.5:0/17624651 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f570405aa20 con 0x7f5714102e10 2024-04-16T14:45:18.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:18.209+0000 7f5718af6700 1 -- 172.21.15.5:0/17624651 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5714109f60 con 0x7f5714102e10 2024-04-16T14:45:18.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:18.209+0000 7f570affd700 1 -- 172.21.15.5:0/17624651 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f570408be60 con 0x7f5714102e10 2024-04-16T14:45:18.208 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:45:18.208 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-04-16T14:45:18.208 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:45:18.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:45:18.208 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-04-16T14:45:18.208 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:45:18.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:45:18.208 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-04-16T14:45:18.209 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 6 2024-04-16T14:45:18.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:45:18.209 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-04-16T14:45:18.209 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 4 2024-04-16T14:45:18.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:45:18.209 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-04-16T14:45:18.209 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 14 2024-04-16T14:45:18.209 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-16T14:45:18.209 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:45:18.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:18.211+0000 7f5718af6700 1 -- 172.21.15.5:0/17624651 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f570006e140 msgr2=0x7f57000705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:45:18.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:18.211+0000 7f5718af6700 1 --2- 172.21.15.5:0/17624651 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f570006e140 0x7f57000705f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f571410ecd0 tx=0x7f56fc009e30 comp rx=0 tx=0).stop 2024-04-16T14:45:18.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:18.211+0000 7f5718af6700 1 -- 172.21.15.5:0/17624651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5714102e10 msgr2=0x7f5714113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:45:18.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:18.211+0000 7f5718af6700 1 --2- 172.21.15.5:0/17624651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5714102e10 0x7f5714113b90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f570400b790 tx=0x7f5704009250 comp rx=0 tx=0).stop 2024-04-16T14:45:18.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:18.212+0000 7f5718af6700 1 -- 172.21.15.5:0/17624651 shutdown_connections 2024-04-16T14:45:18.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:18.212+0000 7f5718af6700 1 --2- 172.21.15.5:0/17624651 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f570006e140 0x7f57000705f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:18.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:18.212+0000 7f5718af6700 1 --2- 172.21.15.5:0/17624651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5714102e10 0x7f5714113b90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:18.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:18.212+0000 7f5718af6700 1 --2- 172.21.15.5:0/17624651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f57141037b0 0x7f57141140d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:45:18.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:18.212+0000 7f5718af6700 1 -- 172.21.15.5:0/17624651 >> 172.21.15.5:0/17624651 conn(0x7f57140f8980 msgr2=0x7f57140f98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:45:18.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:18.212+0000 7f5718af6700 1 -- 172.21.15.5:0/17624651 shutdown_connections 2024-04-16T14:45:18.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:45:18.212+0000 7f5718af6700 1 -- 172.21.15.5:0/17624651 wait complete. 2024-04-16T14:45:18.861 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:18 smithi005 ceph-mon[93420]: pgmap v275: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:18.861 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:18 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/17624651' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:45:18.886 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -e sha1=36befe5d41ee8a6ea2e60983e763134278d506cf -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-04-16T14:45:18.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:18 smithi115 ceph-mon[83414]: pgmap v275: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:18.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:18 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/17624651' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:45:19.156 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:45:20.809 INFO:teuthology.orchestra.run.smithi005.stdout:wait for servicemap items w/ changing names to refresh 2024-04-16T14:45:20.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:20 smithi115 ceph-mon[83414]: pgmap v276: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:20.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:20 smithi005 ceph-mon[93420]: pgmap v276: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:21.417 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -e sha1=36befe5d41ee8a6ea2e60983e763134278d506cf -- bash -c 'sleep 60' 2024-04-16T14:45:21.686 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:45:22.871 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:22 smithi005 ceph-mon[93420]: pgmap v277: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:22.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:22 smithi115 ceph-mon[83414]: pgmap v277: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:23.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:23 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:45:23.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:23 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:45:24.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:24 smithi115 ceph-mon[83414]: pgmap v278: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:24.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:24 smithi005 ceph-mon[93420]: pgmap v278: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:26.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:26 smithi115 ceph-mon[83414]: pgmap v279: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:26.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:26 smithi005 ceph-mon[93420]: pgmap v279: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:28.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:28 smithi115 ceph-mon[83414]: pgmap v280: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:28.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:28 smithi005 ceph-mon[93420]: pgmap v280: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:30.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:30 smithi115 ceph-mon[83414]: pgmap v281: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:30.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:30 smithi005 ceph-mon[93420]: pgmap v281: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:32.934 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:32 smithi115 ceph-mon[83414]: pgmap v282: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:32.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:32 smithi005 ceph-mon[93420]: pgmap v282: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:34.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:34 smithi115 ceph-mon[83414]: pgmap v283: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:34.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:34 smithi005 ceph-mon[93420]: pgmap v283: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:36.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:36 smithi115 ceph-mon[83414]: pgmap v284: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:36.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:36 smithi005 ceph-mon[93420]: pgmap v284: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:38.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:38 smithi115 ceph-mon[83414]: pgmap v285: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:38.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:38 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:45:38.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:38 smithi005 ceph-mon[93420]: pgmap v285: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:38.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:38 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:45:40.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:40 smithi115 ceph-mon[83414]: pgmap v286: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:40.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:40 smithi005 ceph-mon[93420]: pgmap v286: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:42.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:42 smithi115 ceph-mon[83414]: pgmap v287: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:42.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:42 smithi005 ceph-mon[93420]: pgmap v287: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:44.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:44 smithi115 ceph-mon[83414]: pgmap v288: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:44.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:44 smithi005 ceph-mon[93420]: pgmap v288: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:46.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:46 smithi115 ceph-mon[83414]: pgmap v289: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:46.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:46 smithi005 ceph-mon[93420]: pgmap v289: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:48.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:48 smithi115 ceph-mon[83414]: pgmap v290: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:48.974 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:48 smithi005 ceph-mon[93420]: pgmap v290: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:51.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:50 smithi115 ceph-mon[83414]: pgmap v291: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:51.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:50 smithi005 ceph-mon[93420]: pgmap v291: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:53.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:52 smithi115 ceph-mon[83414]: pgmap v292: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:53.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:52 smithi005 ceph-mon[93420]: pgmap v292: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:54.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:53 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:45:54.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:53 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:45:55.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:54 smithi115 ceph-mon[83414]: pgmap v293: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:55.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:54 smithi005 ceph-mon[93420]: pgmap v293: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:57.182 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:56 smithi115 ceph-mon[83414]: pgmap v294: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:57.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:56 smithi005 ceph-mon[93420]: pgmap v294: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:59.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:58 smithi115 ceph-mon[83414]: pgmap v295: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:59.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:58 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:45:59.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:58 smithi005 ceph-mon[93420]: pgmap v295: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:45:59.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:58 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-16T14:46:00.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:59 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:46:00.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:59 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:46:00.181 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:45:59 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:46:00.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:59 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-16T14:46:00.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:59 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-16T14:46:00.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:45:59 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' 2024-04-16T14:46:01.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:01 smithi115 ceph-mon[83414]: pgmap v296: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:01.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:01 smithi005 ceph-mon[93420]: pgmap v296: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:03.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:03 smithi115 ceph-mon[83414]: pgmap v297: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:03.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:03 smithi005 ceph-mon[93420]: pgmap v297: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:05.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:05 smithi115 ceph-mon[83414]: pgmap v298: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:05.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:05 smithi005 ceph-mon[93420]: pgmap v298: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:07.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:07 smithi005 ceph-mon[93420]: pgmap v299: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:07.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:07 smithi115 ceph-mon[83414]: pgmap v299: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:09.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:09 smithi115 ceph-mon[83414]: pgmap v300: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:09.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:09 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:46:09.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:09 smithi005 ceph-mon[93420]: pgmap v300: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:09.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:09 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:46:11.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:11 smithi115 ceph-mon[83414]: pgmap v301: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:11.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:11 smithi005 ceph-mon[93420]: pgmap v301: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:13.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:13 smithi115 ceph-mon[83414]: pgmap v302: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:13.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:13 smithi005 ceph-mon[93420]: pgmap v302: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:15.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:15 smithi115 ceph-mon[83414]: pgmap v303: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:15.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:15 smithi005 ceph-mon[93420]: pgmap v303: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:17.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:17 smithi005 ceph-mon[93420]: pgmap v304: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:17.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:17 smithi115 ceph-mon[83414]: pgmap v304: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:19.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:19 smithi115 ceph-mon[83414]: pgmap v305: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:19.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:19 smithi005 ceph-mon[93420]: pgmap v305: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:21.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:21 smithi115 ceph-mon[83414]: pgmap v306: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:21.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:21 smithi005 ceph-mon[93420]: pgmap v306: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:23.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:23 smithi115 ceph-mon[83414]: pgmap v307: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:23.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:23 smithi005 ceph-mon[93420]: pgmap v307: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:24.031 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -e sha1=36befe5d41ee8a6ea2e60983e763134278d506cf -- bash -c 'ceph orch ps' 2024-04-16T14:46:24.304 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:46:24.427 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:24 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:46:24.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:24 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:46:25.408 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:25 smithi005 ceph-mon[93420]: pgmap v308: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:25.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:25 smithi115 ceph-mon[83414]: pgmap v308: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:26.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.106+0000 7fc427381700 1 -- 172.21.15.5:0/1136602402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4200708a0 msgr2=0x7fc420070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:26.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.106+0000 7fc427381700 1 --2- 172.21.15.5:0/1136602402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4200708a0 0x7fc420070d10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc410004970 tx=0x7fc410009e30 comp rx=0 tx=0).stop 2024-04-16T14:46:26.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.106+0000 7fc427381700 1 -- 172.21.15.5:0/1136602402 shutdown_connections 2024-04-16T14:46:26.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.106+0000 7fc427381700 1 --2- 172.21.15.5:0/1136602402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4200708a0 0x7fc420070d10 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:26.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.106+0000 7fc427381700 1 --2- 172.21.15.5:0/1136602402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc420071f90 0x7fc420070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:26.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.106+0000 7fc427381700 1 -- 172.21.15.5:0/1136602402 >> 172.21.15.5:0/1136602402 conn(0x7fc4200f89b0 msgr2=0x7fc4200fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:26.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.106+0000 7fc427381700 1 -- 172.21.15.5:0/1136602402 shutdown_connections 2024-04-16T14:46:26.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.106+0000 7fc427381700 1 -- 172.21.15.5:0/1136602402 wait complete. 2024-04-16T14:46:26.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.106+0000 7fc427381700 1 Processor -- start 2024-04-16T14:46:26.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.106+0000 7fc427381700 1 -- start start 2024-04-16T14:46:26.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.107+0000 7fc427381700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4200708a0 0x7fc420119fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:26.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.107+0000 7fc427381700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc420071f90 0x7fc42011a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:26.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.107+0000 7fc427381700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42011ab40 con 0x7fc4200708a0 2024-04-16T14:46:26.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.107+0000 7fc427381700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc420114120 con 0x7fc420071f90 2024-04-16T14:46:26.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.107+0000 7fc42511d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4200708a0 0x7fc420119fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:26.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.107+0000 7fc42511d700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4200708a0 0x7fc420119fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48172/0 (socket says 172.21.15.5:48172) 2024-04-16T14:46:26.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.107+0000 7fc42511d700 1 -- 172.21.15.5:0/1272135315 learned_addr learned my addr 172.21.15.5:0/1272135315 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:26.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.107+0000 7fc42491c700 1 --2- 172.21.15.5:0/1272135315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc420071f90 0x7fc42011a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:26.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.107+0000 7fc42511d700 1 -- 172.21.15.5:0/1272135315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc420071f90 msgr2=0x7fc42011a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:26.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.107+0000 7fc42511d700 1 --2- 172.21.15.5:0/1272135315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc420071f90 0x7fc42011a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:26.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.107+0000 7fc42511d700 1 -- 172.21.15.5:0/1272135315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc410005040 con 0x7fc4200708a0 2024-04-16T14:46:26.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.107+0000 7fc42511d700 1 --2- 172.21.15.5:0/1272135315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4200708a0 0x7fc420119fb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc41c00c810 tx=0x7fc41c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:26.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.107+0000 7fc415ffb700 1 -- 172.21.15.5:0/1272135315 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc41c012810 con 0x7fc4200708a0 2024-04-16T14:46:26.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.108+0000 7fc415ffb700 1 -- 172.21.15.5:0/1272135315 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc41c012e40 con 0x7fc4200708a0 2024-04-16T14:46:26.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.108+0000 7fc415ffb700 1 -- 172.21.15.5:0/1272135315 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc41c0102e0 con 0x7fc4200708a0 2024-04-16T14:46:26.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.108+0000 7fc427381700 1 -- 172.21.15.5:0/1272135315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc420114400 con 0x7fc4200708a0 2024-04-16T14:46:26.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.108+0000 7fc427381700 1 -- 172.21.15.5:0/1272135315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc420114910 con 0x7fc4200708a0 2024-04-16T14:46:26.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.109+0000 7fc427381700 1 -- 172.21.15.5:0/1272135315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc420071aa0 con 0x7fc4200708a0 2024-04-16T14:46:26.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.109+0000 7fc415ffb700 1 -- 172.21.15.5:0/1272135315 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fc41c011380 con 0x7fc4200708a0 2024-04-16T14:46:26.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.110+0000 7fc415ffb700 1 --2- 172.21.15.5:0/1272135315 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc40c06e140 0x7fc40c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:26.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.110+0000 7fc415ffb700 1 -- 172.21.15.5:0/1272135315 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fc41c08ded0 con 0x7fc4200708a0 2024-04-16T14:46:26.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.110+0000 7fc42491c700 1 --2- 172.21.15.5:0/1272135315 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc40c06e140 0x7fc40c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:26.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.110+0000 7fc42491c700 1 --2- 172.21.15.5:0/1272135315 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc40c06e140 0x7fc40c0705f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc41000b370 tx=0x7fc410009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:26.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.115+0000 7fc415ffb700 1 -- 172.21.15.5:0/1272135315 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fc41c05ad50 con 0x7fc4200708a0 2024-04-16T14:46:26.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.331+0000 7fc427381700 1 -- 172.21.15.5:0/1272135315 --> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc420115670 con 0x7fc40c06e140 2024-04-16T14:46:26.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.341+0000 7fc415ffb700 1 -- 172.21.15.5:0/1272135315 <== mgr.34104 v2:172.21.15.5:6800/1193938793 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fc420115670 con 0x7fc40c06e140 2024-04-16T14:46:26.339 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-16T14:46:26.339 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.smithi005 smithi005 *:9093,9094 running (2m) 96s ago 19m 15.0M - 0.25.0 c8568f914cd2 12f156211f1c 2024-04-16T14:46:26.340 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi005 smithi005 running (8m) 96s ago 19m 6656k - 19.0.0-2204-g36befe5d b1a78730e0db d6efa08e65e3 2024-04-16T14:46:26.340 INFO:teuthology.orchestra.run.smithi005.stdout:crash.smithi115 smithi115 running (8m) 2m ago 18m 6660k - 19.0.0-2204-g36befe5d b1a78730e0db b2a2f2965e2a 2024-04-16T14:46:26.340 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.smithi005 smithi005 *:3000 running (101s) 96s ago 18m 52.9M - 9.4.12 2bacad6d85d8 615801193fb5 2024-04-16T14:46:26.340 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.vzoqdl smithi005 running (4m) 96s ago 13m 68.8M - 19.0.0-2204-g36befe5d b1a78730e0db acc0c83a4fd1 2024-04-16T14:46:26.340 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi005.wofqlz smithi005 running (3m) 96s ago 13m 18.2M - 19.0.0-2204-g36befe5d b1a78730e0db bff714c6004b 2024-04-16T14:46:26.340 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.byfytg smithi115 running (3m) 2m ago 13m 11.9M - 19.0.0-2204-g36befe5d b1a78730e0db 62f8399079cd 2024-04-16T14:46:26.340 INFO:teuthology.orchestra.run.smithi005.stdout:mds.cephfs.smithi115.trkaqh smithi115 running (2m) 2m ago 13m 12.6M - 19.0.0-2204-g36befe5d b1a78730e0db fa8483ab2bba 2024-04-16T14:46:26.340 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi005.ipwdkc smithi005 *:8443,9283,8765 running (10m) 96s ago 20m 519M - 19.0.0-2204-g36befe5d b1a78730e0db 451192b4fc44 2024-04-16T14:46:26.340 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.smithi115.brjkpo smithi115 *:8443,9283,8765 running (9m) 2m ago 18m 451M - 19.0.0-2204-g36befe5d b1a78730e0db 0d75f8211942 2024-04-16T14:46:26.340 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi005 smithi005 running (9m) 96s ago 20m 54.6M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3d0c00924867 2024-04-16T14:46:26.340 INFO:teuthology.orchestra.run.smithi005.stdout:mon.smithi115 smithi115 running (8m) 2m ago 18m 42.5M 2048M 19.0.0-2204-g36befe5d b1a78730e0db 3b916a4928b2 2024-04-16T14:46:26.340 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi005 smithi005 *:9100 running (2m) 96s ago 19m 8422k - 1.5.0 0da6a335fe13 6e9cf5cfe8eb 2024-04-16T14:46:26.340 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.smithi115 smithi115 *:9100 running (2m) 2m ago 18m 3607k - 1.5.0 0da6a335fe13 6f12a64c98fc 2024-04-16T14:46:26.341 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (7m) 96s ago 17m 113M 1559M 19.0.0-2204-g36befe5d b1a78730e0db 91d9246d45e0 2024-04-16T14:46:26.341 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (7m) 96s ago 16m 112M 1559M 19.0.0-2204-g36befe5d b1a78730e0db d930ce515e3e 2024-04-16T14:46:26.341 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (6m) 96s ago 16m 88.4M 1559M 19.0.0-2204-g36befe5d b1a78730e0db fdc5fe68ac57 2024-04-16T14:46:26.341 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi115 running (5m) 2m ago 15m 116M 2581M 19.0.0-2204-g36befe5d b1a78730e0db 808ebb96c862 2024-04-16T14:46:26.341 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi115 running (5m) 2m ago 15m 103M 2581M 19.0.0-2204-g36befe5d b1a78730e0db 74d7d2ac5a6a 2024-04-16T14:46:26.341 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi115 running (4m) 2m ago 15m 91.9M 2581M 19.0.0-2204-g36befe5d b1a78730e0db 484bc7617d80 2024-04-16T14:46:26.341 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.smithi005 smithi005 *:9095 running (2m) 96s ago 18m 49.3M - 2.43.0 a07b618ecd1d e3579e77bc89 2024-04-16T14:46:26.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.343+0000 7fc427381700 1 -- 172.21.15.5:0/1272135315 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc40c06e140 msgr2=0x7fc40c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:26.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.343+0000 7fc427381700 1 --2- 172.21.15.5:0/1272135315 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc40c06e140 0x7fc40c0705f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc41000b370 tx=0x7fc410009e30 comp rx=0 tx=0).stop 2024-04-16T14:46:26.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.343+0000 7fc427381700 1 -- 172.21.15.5:0/1272135315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4200708a0 msgr2=0x7fc420119fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:26.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.343+0000 7fc427381700 1 --2- 172.21.15.5:0/1272135315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4200708a0 0x7fc420119fb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc41c00c810 tx=0x7fc41c004470 comp rx=0 tx=0).stop 2024-04-16T14:46:26.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.343+0000 7fc427381700 1 -- 172.21.15.5:0/1272135315 shutdown_connections 2024-04-16T14:46:26.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.343+0000 7fc427381700 1 --2- 172.21.15.5:0/1272135315 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc40c06e140 0x7fc40c0705f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:26.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.343+0000 7fc427381700 1 --2- 172.21.15.5:0/1272135315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc4200708a0 0x7fc420119fb0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:26.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.343+0000 7fc427381700 1 --2- 172.21.15.5:0/1272135315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc420071f90 0x7fc42011a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:26.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.343+0000 7fc427381700 1 -- 172.21.15.5:0/1272135315 >> 172.21.15.5:0/1272135315 conn(0x7fc4200f89b0 msgr2=0x7fc4200f9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:26.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.343+0000 7fc427381700 1 -- 172.21.15.5:0/1272135315 shutdown_connections 2024-04-16T14:46:26.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:26.343+0000 7fc427381700 1 -- 172.21.15.5:0/1272135315 wait complete. 2024-04-16T14:46:26.974 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -e sha1=36befe5d41ee8a6ea2e60983e763134278d506cf -- bash -c 'ceph versions' 2024-04-16T14:46:27.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:27 smithi005 ceph-mon[93420]: pgmap v309: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:27.252 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:46:27.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:27 smithi115 ceph-mon[83414]: pgmap v309: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:28.332 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:28 smithi005 ceph-mon[93420]: from='client.34580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:46:28.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:28 smithi115 ceph-mon[83414]: from='client.34580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-16T14:46:28.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.896+0000 7fccfaab9700 1 -- 172.21.15.5:0/738151306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf41037c0 msgr2=0x7fccf40fce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:28.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.896+0000 7fccfaab9700 1 --2- 172.21.15.5:0/738151306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf41037c0 0x7fccf40fce30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009ce0 tx=0x7fcce4004d10 comp rx=0 tx=0).stop 2024-04-16T14:46:28.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.896+0000 7fccfaab9700 1 -- 172.21.15.5:0/738151306 shutdown_connections 2024-04-16T14:46:28.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.896+0000 7fccfaab9700 1 --2- 172.21.15.5:0/738151306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf41037c0 0x7fccf40fce30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:28.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.896+0000 7fccfaab9700 1 --2- 172.21.15.5:0/738151306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccf4102e20 0x7fccf41031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:28.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.896+0000 7fccfaab9700 1 -- 172.21.15.5:0/738151306 >> 172.21.15.5:0/738151306 conn(0x7fccf40f89b0 msgr2=0x7fccf40fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:28.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.897+0000 7fccfaab9700 1 -- 172.21.15.5:0/738151306 shutdown_connections 2024-04-16T14:46:28.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.897+0000 7fccfaab9700 1 -- 172.21.15.5:0/738151306 wait complete. 2024-04-16T14:46:28.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.897+0000 7fccfaab9700 1 Processor -- start 2024-04-16T14:46:28.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.897+0000 7fccfaab9700 1 -- start start 2024-04-16T14:46:28.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.898+0000 7fccfaab9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf4102e20 0x7fccf4113b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:28.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.898+0000 7fccfaab9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccf41037c0 0x7fccf4114060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:28.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.898+0000 7fccfaab9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf41146b0 con 0x7fccf4102e20 2024-04-16T14:46:28.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.898+0000 7fccfaab9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf410dc90 con 0x7fccf41037c0 2024-04-16T14:46:28.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.898+0000 7fccf8855700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf4102e20 0x7fccf4113b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:28.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.898+0000 7fccf8855700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf4102e20 0x7fccf4113b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46390/0 (socket says 172.21.15.5:46390) 2024-04-16T14:46:28.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.898+0000 7fccf8855700 1 -- 172.21.15.5:0/2780775791 learned_addr learned my addr 172.21.15.5:0/2780775791 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:28.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.898+0000 7fccf3fff700 1 --2- 172.21.15.5:0/2780775791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccf41037c0 0x7fccf4114060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:28.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.898+0000 7fccf8855700 1 -- 172.21.15.5:0/2780775791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccf41037c0 msgr2=0x7fccf4114060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:28.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.898+0000 7fccf8855700 1 --2- 172.21.15.5:0/2780775791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccf41037c0 0x7fccf4114060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:28.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.898+0000 7fccf8855700 1 -- 172.21.15.5:0/2780775791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce4009940 con 0x7fccf4102e20 2024-04-16T14:46:28.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.898+0000 7fccf8855700 1 --2- 172.21.15.5:0/2780775791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf4102e20 0x7fccf4113b20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fccdc002a50 tx=0x7fccdc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:28.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.898+0000 7fccf17fa700 1 -- 172.21.15.5:0/2780775791 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccdc007cc0 con 0x7fccf4102e20 2024-04-16T14:46:28.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.898+0000 7fccfaab9700 1 -- 172.21.15.5:0/2780775791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf410df70 con 0x7fccf4102e20 2024-04-16T14:46:28.898 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.898+0000 7fccf17fa700 1 -- 172.21.15.5:0/2780775791 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fccdc00f040 con 0x7fccf4102e20 2024-04-16T14:46:28.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.898+0000 7fccf17fa700 1 -- 172.21.15.5:0/2780775791 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccdc009640 con 0x7fccf4102e20 2024-04-16T14:46:28.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.898+0000 7fccfaab9700 1 -- 172.21.15.5:0/2780775791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf410e530 con 0x7fccf4102e20 2024-04-16T14:46:28.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.899+0000 7fccfaab9700 1 -- 172.21.15.5:0/2780775791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf41052f0 con 0x7fccf4102e20 2024-04-16T14:46:28.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.900+0000 7fccf17fa700 1 -- 172.21.15.5:0/2780775791 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fccdc0097a0 con 0x7fccf4102e20 2024-04-16T14:46:28.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.901+0000 7fccf17fa700 1 --2- 172.21.15.5:0/2780775791 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fcce006e140 0x7fcce00705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:28.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.901+0000 7fccf17fa700 1 -- 172.21.15.5:0/2780775791 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fccdc08d9f0 con 0x7fccf4102e20 2024-04-16T14:46:28.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.901+0000 7fccf3fff700 1 --2- 172.21.15.5:0/2780775791 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fcce006e140 0x7fcce00705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:28.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.901+0000 7fccf3fff700 1 --2- 172.21.15.5:0/2780775791 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fcce006e140 0x7fcce00705f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fccf410f3c0 tx=0x7fcce4004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:28.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:28.905+0000 7fccf17fa700 1 -- 172.21.15.5:0/2780775791 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fccdc08fe60 con 0x7fccf4102e20 2024-04-16T14:46:29.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:29.202+0000 7fccfaab9700 1 -- 172.21.15.5:0/2780775791 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fccf4109f00 con 0x7fccf4102e20 2024-04-16T14:46:29.201 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:29 smithi005 ceph-mon[93420]: pgmap v310: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:29.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:29.203+0000 7fccf17fa700 1 -- 172.21.15.5:0/2780775791 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fccdc05a7f0 con 0x7fccf4102e20 2024-04-16T14:46:29.202 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-04-16T14:46:29.202 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-04-16T14:46:29.202 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:46:29.202 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:46:29.202 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-04-16T14:46:29.202 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 2 2024-04-16T14:46:29.202 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:46:29.202 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-04-16T14:46:29.202 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 6 2024-04-16T14:46:29.202 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:46:29.202 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": { 2024-04-16T14:46:29.203 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 4 2024-04-16T14:46:29.203 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-04-16T14:46:29.203 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-04-16T14:46:29.203 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)": 14 2024-04-16T14:46:29.203 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-04-16T14:46:29.203 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-04-16T14:46:29.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:29.205+0000 7fccfaab9700 1 -- 172.21.15.5:0/2780775791 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fcce006e140 msgr2=0x7fcce00705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:29.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:29.205+0000 7fccfaab9700 1 --2- 172.21.15.5:0/2780775791 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fcce006e140 0x7fcce00705f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fccf410f3c0 tx=0x7fcce4004d10 comp rx=0 tx=0).stop 2024-04-16T14:46:29.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:29.205+0000 7fccfaab9700 1 -- 172.21.15.5:0/2780775791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf4102e20 msgr2=0x7fccf4113b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:29.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:29.205+0000 7fccfaab9700 1 --2- 172.21.15.5:0/2780775791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf4102e20 0x7fccf4113b20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fccdc002a50 tx=0x7fccdc0046b0 comp rx=0 tx=0).stop 2024-04-16T14:46:29.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:29.205+0000 7fccfaab9700 1 -- 172.21.15.5:0/2780775791 shutdown_connections 2024-04-16T14:46:29.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:29.205+0000 7fccfaab9700 1 --2- 172.21.15.5:0/2780775791 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fcce006e140 0x7fcce00705f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:29.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:29.205+0000 7fccfaab9700 1 --2- 172.21.15.5:0/2780775791 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccf4102e20 0x7fccf4113b20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:29.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:29.205+0000 7fccfaab9700 1 --2- 172.21.15.5:0/2780775791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccf41037c0 0x7fccf4114060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:29.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:29.205+0000 7fccfaab9700 1 -- 172.21.15.5:0/2780775791 >> 172.21.15.5:0/2780775791 conn(0x7fccf40f89b0 msgr2=0x7fccf41021e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:29.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:29.205+0000 7fccfaab9700 1 -- 172.21.15.5:0/2780775791 shutdown_connections 2024-04-16T14:46:29.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:29.205+0000 7fccfaab9700 1 -- 172.21.15.5:0/2780775791 wait complete. 2024-04-16T14:46:29.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:29 smithi115 ceph-mon[83414]: pgmap v310: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:29.933 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -e sha1=36befe5d41ee8a6ea2e60983e763134278d506cf -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-04-16T14:46:30.204 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:46:30.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:30 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/2780775791' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:46:30.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:30 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/2780775791' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:46:31.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:31 smithi115 ceph-mon[83414]: pgmap v311: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:31.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:31 smithi005 ceph-mon[93420]: pgmap v311: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:31.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.984+0000 7fe38852b700 1 -- 172.21.15.5:0/2121339894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe380101d10 msgr2=0x7fe3801020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:31.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.984+0000 7fe38852b700 1 --2- 172.21.15.5:0/2121339894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe380101d10 0x7fe3801020e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe37c004940 tx=0x7fe37c009e30 comp rx=0 tx=0).stop 2024-04-16T14:46:31.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.984+0000 7fe38852b700 1 -- 172.21.15.5:0/2121339894 shutdown_connections 2024-04-16T14:46:31.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.984+0000 7fe38852b700 1 --2- 172.21.15.5:0/2121339894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3801026b0 0x7fe3800fbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:31.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.984+0000 7fe38852b700 1 --2- 172.21.15.5:0/2121339894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe380101d10 0x7fe3801020e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:31.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.984+0000 7fe38852b700 1 -- 172.21.15.5:0/2121339894 >> 172.21.15.5:0/2121339894 conn(0x7fe380072bc0 msgr2=0x7fe380072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:31.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.984+0000 7fe38852b700 1 -- 172.21.15.5:0/2121339894 shutdown_connections 2024-04-16T14:46:31.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.984+0000 7fe38852b700 1 -- 172.21.15.5:0/2121339894 wait complete. 2024-04-16T14:46:31.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.984+0000 7fe38852b700 1 Processor -- start 2024-04-16T14:46:31.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.985+0000 7fe38852b700 1 -- start start 2024-04-16T14:46:31.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.985+0000 7fe38852b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe380101d10 0x7fe380113b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:31.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.985+0000 7fe38852b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3801026b0 0x7fe380114070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:31.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.985+0000 7fe38852b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3801146c0 con 0x7fe380101d10 2024-04-16T14:46:31.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.985+0000 7fe38852b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38010dab0 con 0x7fe3801026b0 2024-04-16T14:46:31.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.985+0000 7fe3862c7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe380101d10 0x7fe380113b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:31.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.985+0000 7fe3862c7700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe380101d10 0x7fe380113b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46410/0 (socket says 172.21.15.5:46410) 2024-04-16T14:46:31.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.985+0000 7fe3862c7700 1 -- 172.21.15.5:0/3869358337 learned_addr learned my addr 172.21.15.5:0/3869358337 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:31.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.985+0000 7fe3862c7700 1 -- 172.21.15.5:0/3869358337 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3801026b0 msgr2=0x7fe380114070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:31.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.985+0000 7fe3862c7700 1 --2- 172.21.15.5:0/3869358337 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3801026b0 0x7fe380114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:31.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.985+0000 7fe3862c7700 1 -- 172.21.15.5:0/3869358337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37c005040 con 0x7fe380101d10 2024-04-16T14:46:31.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.985+0000 7fe3862c7700 1 --2- 172.21.15.5:0/3869358337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe380101d10 0x7fe380113b30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe37c009180 tx=0x7fe37c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:31.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.985+0000 7fe372ffd700 1 -- 172.21.15.5:0/3869358337 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe37c00e040 con 0x7fe380101d10 2024-04-16T14:46:31.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.986+0000 7fe372ffd700 1 -- 172.21.15.5:0/3869358337 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe37c00bbc0 con 0x7fe380101d10 2024-04-16T14:46:31.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.986+0000 7fe38852b700 1 -- 172.21.15.5:0/3869358337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe38010dd30 con 0x7fe380101d10 2024-04-16T14:46:31.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.986+0000 7fe372ffd700 1 -- 172.21.15.5:0/3869358337 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe37c01c630 con 0x7fe380101d10 2024-04-16T14:46:31.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.986+0000 7fe38852b700 1 -- 172.21.15.5:0/3869358337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe38010e2f0 con 0x7fe380101d10 2024-04-16T14:46:31.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.987+0000 7fe38852b700 1 -- 172.21.15.5:0/3869358337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3800ff020 con 0x7fe380101d10 2024-04-16T14:46:31.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.987+0000 7fe372ffd700 1 -- 172.21.15.5:0/3869358337 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fe37c00bd30 con 0x7fe380101d10 2024-04-16T14:46:31.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.987+0000 7fe372ffd700 1 --2- 172.21.15.5:0/3869358337 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe36c06e150 0x7fe36c070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:31.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.988+0000 7fe372ffd700 1 -- 172.21.15.5:0/3869358337 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fe37c08eff0 con 0x7fe380101d10 2024-04-16T14:46:31.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.988+0000 7fe385ac6700 1 --2- 172.21.15.5:0/3869358337 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe36c06e150 0x7fe36c070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:31.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.988+0000 7fe385ac6700 1 --2- 172.21.15.5:0/3869358337 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe36c06e150 0x7fe36c070600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe38010ec70 tx=0x7fe374007cc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:31.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:31.993+0000 7fe372ffd700 1 -- 172.21.15.5:0/3869358337 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fe37c05be70 con 0x7fe380101d10 2024-04-16T14:46:32.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:32.291+0000 7fe38852b700 1 -- 172.21.15.5:0/3869358337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe38010f180 con 0x7fe380101d10 2024-04-16T14:46:32.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:32.292+0000 7fe372ffd700 1 -- 172.21.15.5:0/3869358337 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fe37c05ba00 con 0x7fe380101d10 2024-04-16T14:46:32.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:32.294+0000 7fe38852b700 1 -- 172.21.15.5:0/3869358337 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe36c06e150 msgr2=0x7fe36c070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:32.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:32.294+0000 7fe38852b700 1 --2- 172.21.15.5:0/3869358337 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe36c06e150 0x7fe36c070600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe38010ec70 tx=0x7fe374007cc0 comp rx=0 tx=0).stop 2024-04-16T14:46:32.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:32.294+0000 7fe38852b700 1 -- 172.21.15.5:0/3869358337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe380101d10 msgr2=0x7fe380113b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:32.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:32.294+0000 7fe38852b700 1 --2- 172.21.15.5:0/3869358337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe380101d10 0x7fe380113b30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe37c009180 tx=0x7fe37c009e30 comp rx=0 tx=0).stop 2024-04-16T14:46:32.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:32.294+0000 7fe38852b700 1 -- 172.21.15.5:0/3869358337 shutdown_connections 2024-04-16T14:46:32.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:32.294+0000 7fe38852b700 1 --2- 172.21.15.5:0/3869358337 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe36c06e150 0x7fe36c070600 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:32.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:32.294+0000 7fe38852b700 1 --2- 172.21.15.5:0/3869358337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe380101d10 0x7fe380113b30 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:32.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:32.294+0000 7fe38852b700 1 --2- 172.21.15.5:0/3869358337 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3801026b0 0x7fe380114070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:32.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:32.294+0000 7fe38852b700 1 -- 172.21.15.5:0/3869358337 >> 172.21.15.5:0/3869358337 conn(0x7fe380072bc0 msgr2=0x7fe3800fb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:32.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:32.294+0000 7fe38852b700 1 -- 172.21.15.5:0/3869358337 shutdown_connections 2024-04-16T14:46:32.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:32.294+0000 7fe38852b700 1 -- 172.21.15.5:0/3869358337 wait complete. 2024-04-16T14:46:32.303 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-04-16T14:46:32.997 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -e sha1=36befe5d41ee8a6ea2e60983e763134278d506cf -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-04-16T14:46:33.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:33 smithi005 ceph-mon[93420]: pgmap v312: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:33.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:33 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/3869358337' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:46:33.269 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:46:33.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:33 smithi115 ceph-mon[83414]: pgmap v312: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:33.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:33 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/3869358337' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:46:34.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.868+0000 7f90d337b700 1 -- 172.21.15.5:0/3712036470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90cc102e60 msgr2=0x7f90cc103230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:34.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.868+0000 7f90d337b700 1 --2- 172.21.15.5:0/3712036470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90cc102e60 0x7f90cc103230 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f90c8004940 tx=0x7f90c8009e30 comp rx=0 tx=0).stop 2024-04-16T14:46:34.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.868+0000 7f90d337b700 1 -- 172.21.15.5:0/3712036470 shutdown_connections 2024-04-16T14:46:34.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.868+0000 7f90d337b700 1 --2- 172.21.15.5:0/3712036470 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90cc0656b0 0x7f90cc065b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:34.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.868+0000 7f90d337b700 1 --2- 172.21.15.5:0/3712036470 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90cc102e60 0x7f90cc103230 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:34.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.868+0000 7f90d337b700 1 -- 172.21.15.5:0/3712036470 >> 172.21.15.5:0/3712036470 conn(0x7f90cc072bc0 msgr2=0x7f90cc072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:34.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.868+0000 7f90d337b700 1 -- 172.21.15.5:0/3712036470 shutdown_connections 2024-04-16T14:46:34.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.868+0000 7f90d337b700 1 -- 172.21.15.5:0/3712036470 wait complete. 2024-04-16T14:46:34.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.869+0000 7f90d337b700 1 Processor -- start 2024-04-16T14:46:34.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.869+0000 7f90d337b700 1 -- start start 2024-04-16T14:46:34.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.869+0000 7f90d337b700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90cc0656b0 0x7f90cc113b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:34.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.869+0000 7f90d337b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90cc102e60 0x7f90cc114090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:34.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.869+0000 7f90d337b700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc1146e0 con 0x7f90cc0656b0 2024-04-16T14:46:34.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.869+0000 7f90d337b700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc10dad0 con 0x7f90cc102e60 2024-04-16T14:46:34.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.869+0000 7f90d1117700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90cc0656b0 0x7f90cc113b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:34.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.869+0000 7f90d1117700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90cc0656b0 0x7f90cc113b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46424/0 (socket says 172.21.15.5:46424) 2024-04-16T14:46:34.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.869+0000 7f90d1117700 1 -- 172.21.15.5:0/3917823293 learned_addr learned my addr 172.21.15.5:0/3917823293 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:34.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.869+0000 7f90d0916700 1 --2- 172.21.15.5:0/3917823293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90cc102e60 0x7f90cc114090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:34.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.869+0000 7f90d1117700 1 -- 172.21.15.5:0/3917823293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90cc102e60 msgr2=0x7f90cc114090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:34.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.869+0000 7f90d1117700 1 --2- 172.21.15.5:0/3917823293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90cc102e60 0x7f90cc114090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:34.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.869+0000 7f90d1117700 1 -- 172.21.15.5:0/3917823293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c8005040 con 0x7f90cc0656b0 2024-04-16T14:46:34.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.869+0000 7f90d0916700 1 --2- 172.21.15.5:0/3917823293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90cc102e60 0x7f90cc114090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:46:34.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.869+0000 7f90d1117700 1 --2- 172.21.15.5:0/3917823293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90cc0656b0 0x7f90cc113b50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f90c8009150 tx=0x7f90c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:34.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.870+0000 7f90c1ffb700 1 -- 172.21.15.5:0/3917823293 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90c800e040 con 0x7f90cc0656b0 2024-04-16T14:46:34.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.870+0000 7f90c1ffb700 1 -- 172.21.15.5:0/3917823293 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f90c8013420 con 0x7f90cc0656b0 2024-04-16T14:46:34.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.870+0000 7f90d337b700 1 -- 172.21.15.5:0/3917823293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90cc10dd50 con 0x7f90cc0656b0 2024-04-16T14:46:34.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.870+0000 7f90c1ffb700 1 -- 172.21.15.5:0/3917823293 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90c801c630 con 0x7f90cc0656b0 2024-04-16T14:46:34.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.870+0000 7f90d337b700 1 -- 172.21.15.5:0/3917823293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90cc10e310 con 0x7f90cc0656b0 2024-04-16T14:46:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.871+0000 7f90d337b700 1 -- 172.21.15.5:0/3917823293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90cc100130 con 0x7f90cc0656b0 2024-04-16T14:46:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.871+0000 7f90c1ffb700 1 -- 172.21.15.5:0/3917823293 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f90c8013590 con 0x7f90cc0656b0 2024-04-16T14:46:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.872+0000 7f90c1ffb700 1 --2- 172.21.15.5:0/3917823293 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f90b806e150 0x7f90b8070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.872+0000 7f90c1ffb700 1 -- 172.21.15.5:0/3917823293 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f90c808eef0 con 0x7f90cc0656b0 2024-04-16T14:46:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.872+0000 7f90d0916700 1 --2- 172.21.15.5:0/3917823293 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f90b806e150 0x7f90b8070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:34.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.873+0000 7f90d0916700 1 --2- 172.21.15.5:0/3917823293 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f90b806e150 0x7f90b8070600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009fd0 tx=0x7f90bc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:34.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:34.877+0000 7f90c1ffb700 1 -- 172.21.15.5:0/3917823293 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f90c805bcd0 con 0x7f90cc0656b0 2024-04-16T14:46:35.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:35.180+0000 7f90d337b700 1 -- 172.21.15.5:0/3917823293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f90cc10f1a0 con 0x7f90cc0656b0 2024-04-16T14:46:35.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:35.181+0000 7f90c1ffb700 1 -- 172.21.15.5:0/3917823293 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f90c805b860 con 0x7f90cc0656b0 2024-04-16T14:46:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:35.183+0000 7f90d337b700 1 -- 172.21.15.5:0/3917823293 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f90b806e150 msgr2=0x7f90b8070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:35.183+0000 7f90d337b700 1 --2- 172.21.15.5:0/3917823293 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f90b806e150 0x7f90b8070600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009fd0 tx=0x7f90bc00b040 comp rx=0 tx=0).stop 2024-04-16T14:46:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:35.183+0000 7f90d337b700 1 -- 172.21.15.5:0/3917823293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90cc0656b0 msgr2=0x7f90cc113b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:35.183+0000 7f90d337b700 1 --2- 172.21.15.5:0/3917823293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90cc0656b0 0x7f90cc113b50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f90c8009150 tx=0x7f90c8009e30 comp rx=0 tx=0).stop 2024-04-16T14:46:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:35.183+0000 7f90d337b700 1 -- 172.21.15.5:0/3917823293 shutdown_connections 2024-04-16T14:46:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:35.183+0000 7f90d337b700 1 --2- 172.21.15.5:0/3917823293 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f90b806e150 0x7f90b8070600 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:35.183+0000 7f90d337b700 1 --2- 172.21.15.5:0/3917823293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f90cc0656b0 0x7f90cc113b50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:35.183+0000 7f90d337b700 1 --2- 172.21.15.5:0/3917823293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f90cc102e60 0x7f90cc114090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:35.183+0000 7f90d337b700 1 -- 172.21.15.5:0/3917823293 >> 172.21.15.5:0/3917823293 conn(0x7f90cc072bc0 msgr2=0x7f90cc0fafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:35.183+0000 7f90d337b700 1 -- 172.21.15.5:0/3917823293 shutdown_connections 2024-04-16T14:46:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:35.183+0000 7f90d337b700 1 -- 172.21.15.5:0/3917823293 wait complete. 2024-04-16T14:46:35.191 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 19.0.0-2204-g36befe5d (36befe5d41ee8a6ea2e60983e763134278d506cf) squid (dev)" 2024-04-16T14:46:35.193 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:35 smithi005 ceph-mon[93420]: pgmap v313: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:35.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:35 smithi115 ceph-mon[83414]: pgmap v313: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:35.840 DEBUG:teuthology.parallel:result is None 2024-04-16T14:46:35.840 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-16T14:46:35.854 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi005.front.sepia.ceph.com 2024-04-16T14:46:35.854 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-16T14:46:36.125 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/mon.smithi005/config 2024-04-16T14:46:36.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:36 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/3917823293' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:46:36.447 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:36 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/3917823293' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-16T14:46:37.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:37 smithi115 ceph-mon[83414]: pgmap v314: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:37.457 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:37 smithi005 ceph-mon[93420]: pgmap v314: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:37.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.679+0000 7f4fb37f9700 1 -- 172.21.15.5:0/1574409712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fac0fc500 msgr2=0x7f4fac109260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:37.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.679+0000 7f4fb37f9700 1 --2- 172.21.15.5:0/1574409712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fac0fc500 0x7f4fac109260 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c004940 tx=0x7f4f9c009e30 comp rx=0 tx=0).stop 2024-04-16T14:46:37.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.679+0000 7f4fb37f9700 1 -- 172.21.15.5:0/1574409712 shutdown_connections 2024-04-16T14:46:37.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.679+0000 7f4fb37f9700 1 --2- 172.21.15.5:0/1574409712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fac0fc500 0x7f4fac109260 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:37.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.679+0000 7f4fb37f9700 1 --2- 172.21.15.5:0/1574409712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4fac0fbbf0 0x7f4fac0fbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:37.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.679+0000 7f4fb37f9700 1 -- 172.21.15.5:0/1574409712 >> 172.21.15.5:0/1574409712 conn(0x7f4fac0f7900 msgr2=0x7f4fac0f9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:37.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.679+0000 7f4fb37f9700 1 -- 172.21.15.5:0/1574409712 shutdown_connections 2024-04-16T14:46:37.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.679+0000 7f4fb37f9700 1 -- 172.21.15.5:0/1574409712 wait complete. 2024-04-16T14:46:37.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.679+0000 7f4fb37f9700 1 Processor -- start 2024-04-16T14:46:37.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.679+0000 7f4fb37f9700 1 -- start start 2024-04-16T14:46:37.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.680+0000 7f4fb37f9700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fac0fbbf0 0x7f4fac115b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:37.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.680+0000 7f4fb37f9700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4fac0fc500 0x7f4fac116060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:37.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.680+0000 7f4fb37f9700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac1166b0 con 0x7f4fac0fbbf0 2024-04-16T14:46:37.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.680+0000 7f4fb37f9700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac10fc90 con 0x7f4fac0fc500 2024-04-16T14:46:37.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.680+0000 7f4fb1595700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fac0fbbf0 0x7f4fac115b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:37.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.680+0000 7f4fb1595700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fac0fbbf0 0x7f4fac115b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46456/0 (socket says 172.21.15.5:46456) 2024-04-16T14:46:37.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.680+0000 7f4fb1595700 1 -- 172.21.15.5:0/1985827226 learned_addr learned my addr 172.21.15.5:0/1985827226 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:37.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.680+0000 7f4fb1595700 1 -- 172.21.15.5:0/1985827226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4fac0fc500 msgr2=0x7f4fac116060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:37.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.680+0000 7f4fb1595700 1 --2- 172.21.15.5:0/1985827226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4fac0fc500 0x7f4fac116060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:37.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.680+0000 7f4fb1595700 1 -- 172.21.15.5:0/1985827226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9c005040 con 0x7f4fac0fbbf0 2024-04-16T14:46:37.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.680+0000 7f4fb1595700 1 --2- 172.21.15.5:0/1985827226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fac0fbbf0 0x7f4fac115b20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8002a50 tx=0x7f4fa80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:37.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.680+0000 7f4fa1ffb700 1 -- 172.21.15.5:0/1985827226 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fa8007cc0 con 0x7f4fac0fbbf0 2024-04-16T14:46:37.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.680+0000 7f4fb37f9700 1 -- 172.21.15.5:0/1985827226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fac10ff70 con 0x7f4fac0fbbf0 2024-04-16T14:46:37.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.680+0000 7f4fa1ffb700 1 -- 172.21.15.5:0/1985827226 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4fa800f040 con 0x7f4fac0fbbf0 2024-04-16T14:46:37.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.680+0000 7f4fa1ffb700 1 -- 172.21.15.5:0/1985827226 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fa8009640 con 0x7f4fac0fbbf0 2024-04-16T14:46:37.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.681+0000 7f4fb37f9700 1 -- 172.21.15.5:0/1985827226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fac110530 con 0x7f4fac0fbbf0 2024-04-16T14:46:37.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.682+0000 7f4fb37f9700 1 -- 172.21.15.5:0/1985827226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fac1070a0 con 0x7f4fac0fbbf0 2024-04-16T14:46:37.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.682+0000 7f4fa1ffb700 1 -- 172.21.15.5:0/1985827226 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f4fa80097a0 con 0x7f4fac0fbbf0 2024-04-16T14:46:37.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.683+0000 7f4fa1ffb700 1 --2- 172.21.15.5:0/1985827226 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f4f9806e140 0x7f4f980705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:37.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.683+0000 7f4fb0d94700 1 --2- 172.21.15.5:0/1985827226 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f4f9806e140 0x7f4f980705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:37.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.683+0000 7f4fa1ffb700 1 -- 172.21.15.5:0/1985827226 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f4fa808d9f0 con 0x7f4fac0fbbf0 2024-04-16T14:46:37.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.683+0000 7f4fb0d94700 1 --2- 172.21.15.5:0/1985827226 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f4f9806e140 0x7f4f980705f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c004540 tx=0x7f4f9c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:37.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.688+0000 7f4fa1ffb700 1 -- 172.21.15.5:0/1985827226 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f4fa808fe60 con 0x7f4fac0fbbf0 2024-04-16T14:46:37.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.937+0000 7f4fb37f9700 1 -- 172.21.15.5:0/1985827226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4fac10c120 con 0x7f4fac0fbbf0 2024-04-16T14:46:37.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.937+0000 7f4fa1ffb700 1 -- 172.21.15.5:0/1985827226 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 44 v44) v1 ==== 76+0+1951 (secure 0 0 0) 0x7f4fa805a7f0 con 0x7f4fac0fbbf0 2024-04-16T14:46:37.936 INFO:teuthology.orchestra.run.smithi005.stdout:e44 2024-04-16T14:46:37.936 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-16T14:46:37.936 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-16T14:46:37.936 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2024-04-16T14:46:37.936 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:37.936 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2024-04-16T14:46:37.936 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2024-04-16T14:46:37.937 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 44 2024-04-16T14:46:37.937 INFO:teuthology.orchestra.run.smithi005.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-16T14:46:37.937 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-04-16T14:32:45.270024+0000 2024-04-16T14:46:37.937 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-04-16T14:43:39.966885+0000 2024-04-16T14:46:37.937 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2024-04-16T14:46:37.937 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2024-04-16T14:46:37.937 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 60 2024-04-16T14:46:37.937 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2024-04-16T14:46:37.937 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2024-04-16T14:46:37.937 INFO:teuthology.orchestra.run.smithi005.stdout:max_xattr_size 65536 2024-04-16T14:46:37.937 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2024-04-16T14:46:37.937 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2024-04-16T14:46:37.937 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 85 2024-04-16T14:46:37.937 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-16T14:46:37.938 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 2 2024-04-16T14:46:37.938 INFO:teuthology.orchestra.run.smithi005.stdout:in 0,1 2024-04-16T14:46:37.938 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=34434,1=34438} 2024-04-16T14:46:37.938 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2024-04-16T14:46:37.938 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2024-04-16T14:46:37.938 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 2024-04-16T14:46:37.938 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3] 2024-04-16T14:46:37.938 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2024-04-16T14:46:37.938 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2024-04-16T14:46:37.938 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2024-04-16T14:46:37.938 INFO:teuthology.orchestra.run.smithi005.stdout:bal_rank_mask -1 2024-04-16T14:46:37.938 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 1 2024-04-16T14:46:37.939 INFO:teuthology.orchestra.run.smithi005.stdout:qdb_cluster leader: 34434 members: 34434,34438 2024-04-16T14:46:37.939 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.vzoqdl{0:34434} state up:active seq 19 join_fscid=1 addr [v2:172.21.15.5:6826/3940274196,v1:172.21.15.5:6827/3940274196] compat {c=[1],r=[1],i=[1fff]}] 2024-04-16T14:46:37.939 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi005.wofqlz{1:34438} state up:active seq 13 join_fscid=1 addr [v2:172.21.15.5:6828/3592708911,v1:172.21.15.5:6829/3592708911] compat {c=[1],r=[1],i=[1fff]}] 2024-04-16T14:46:37.939 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:37.939 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:37.939 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2024-04-16T14:46:37.939 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:37.939 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.byfytg{-1:44317} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.115:6824/1461659094,v1:172.21.15.115:6825/1461659094] compat {c=[1],r=[1],i=[1fff]}] 2024-04-16T14:46:37.939 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.cephfs.smithi115.trkaqh{-1:44341} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.115:6826/3171302428,v1:172.21.15.115:6827/3171302428] compat {c=[1],r=[1],i=[1fff]}] 2024-04-16T14:46:37.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.940+0000 7f4fb37f9700 1 -- 172.21.15.5:0/1985827226 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f4f9806e140 msgr2=0x7f4f980705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:37.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.940+0000 7f4fb37f9700 1 --2- 172.21.15.5:0/1985827226 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f4f9806e140 0x7f4f980705f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c004540 tx=0x7f4f9c009e30 comp rx=0 tx=0).stop 2024-04-16T14:46:37.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.940+0000 7f4fb37f9700 1 -- 172.21.15.5:0/1985827226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fac0fbbf0 msgr2=0x7f4fac115b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:37.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.940+0000 7f4fb37f9700 1 --2- 172.21.15.5:0/1985827226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fac0fbbf0 0x7f4fac115b20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8002a50 tx=0x7f4fa80046b0 comp rx=0 tx=0).stop 2024-04-16T14:46:37.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.940+0000 7f4fb37f9700 1 -- 172.21.15.5:0/1985827226 shutdown_connections 2024-04-16T14:46:37.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.940+0000 7f4fb37f9700 1 --2- 172.21.15.5:0/1985827226 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f4f9806e140 0x7f4f980705f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:37.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.940+0000 7f4fb37f9700 1 --2- 172.21.15.5:0/1985827226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4fac0fbbf0 0x7f4fac115b20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:37.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.940+0000 7f4fb37f9700 1 --2- 172.21.15.5:0/1985827226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4fac0fc500 0x7f4fac116060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:37.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.940+0000 7f4fb37f9700 1 -- 172.21.15.5:0/1985827226 >> 172.21.15.5:0/1985827226 conn(0x7f4fac0f7900 msgr2=0x7f4fac104220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:37.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.940+0000 7f4fb37f9700 1 -- 172.21.15.5:0/1985827226 shutdown_connections 2024-04-16T14:46:37.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:37.940+0000 7f4fb37f9700 1 -- 172.21.15.5:0/1985827226 wait complete. 2024-04-16T14:46:37.941 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 44 2024-04-16T14:46:38.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:38 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/1985827226' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:46:38.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:38 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/1985827226' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-16T14:46:38.533 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-04-16T14:46:38.546 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T14:46:38.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.652+0000 7f2129a18640 1 -- 172.21.15.5:0/888158725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2124102b50 msgr2=0x7f21240fc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:38.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.652+0000 7f2129a18640 1 --2- 172.21.15.5:0/888158725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2124102b50 0x7f21240fc1e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f210c0048d0 tx=0x7f210c009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:38.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.652+0000 7f2129a18640 1 -- 172.21.15.5:0/888158725 shutdown_connections 2024-04-16T14:46:38.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.652+0000 7f2129a18640 1 --2- 172.21.15.5:0/888158725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2124102b50 0x7f21240fc1e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:38.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.652+0000 7f2129a18640 1 --2- 172.21.15.5:0/888158725 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21241021b0 0x7f2124102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:38.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.652+0000 7f2129a18640 1 -- 172.21.15.5:0/888158725 >> 172.21.15.5:0/888158725 conn(0x7f21240f7d40 msgr2=0x7f21240fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:38.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.652+0000 7f2129a18640 1 -- 172.21.15.5:0/888158725 shutdown_connections 2024-04-16T14:46:38.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.652+0000 7f2129a18640 1 -- 172.21.15.5:0/888158725 wait complete. 2024-04-16T14:46:38.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.652+0000 7f2129a18640 1 Processor -- start 2024-04-16T14:46:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.653+0000 7f2129a18640 1 -- start start 2024-04-16T14:46:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.653+0000 7f2129a18640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21241021b0 0x7f2124112d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.653+0000 7f2129a18640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2124102b50 0x7f2124113260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.653+0000 7f2129a18640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2124113860 con 0x7f21241021b0 2024-04-16T14:46:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.653+0000 7f2129a18640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212410ceb0 con 0x7f2124102b50 2024-04-16T14:46:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.653+0000 7f2122ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21241021b0 0x7f2124112d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.653+0000 7f2122ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21241021b0 0x7f2124112d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53548/0 (socket says 172.21.15.5:53548) 2024-04-16T14:46:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.653+0000 7f2122ffd640 1 -- 172.21.15.5:0/1687768185 learned_addr learned my addr 172.21.15.5:0/1687768185 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.653+0000 7f2122ffd640 1 -- 172.21.15.5:0/1687768185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2124102b50 msgr2=0x7f2124113260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.653+0000 7f2122ffd640 1 --2- 172.21.15.5:0/1687768185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2124102b50 0x7f2124113260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.653+0000 7f2122ffd640 1 -- 172.21.15.5:0/1687768185 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f210c005040 con 0x7f21241021b0 2024-04-16T14:46:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.653+0000 7f2122ffd640 1 --2- 172.21.15.5:0/1687768185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21241021b0 0x7f2124112d20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f211400cb10 tx=0x7f2114007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.653+0000 7f211b7fe640 1 -- 172.21.15.5:0/1687768185 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2114004200 con 0x7f21241021b0 2024-04-16T14:46:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.653+0000 7f211b7fe640 1 -- 172.21.15.5:0/1687768185 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f211400acf0 con 0x7f21241021b0 2024-04-16T14:46:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.653+0000 7f2129a18640 1 -- 172.21.15.5:0/1687768185 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212410d190 con 0x7f21241021b0 2024-04-16T14:46:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.653+0000 7f211b7fe640 1 -- 172.21.15.5:0/1687768185 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2114003e40 con 0x7f21241021b0 2024-04-16T14:46:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.654+0000 7f2129a18640 1 -- 172.21.15.5:0/1687768185 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212410d6b0 con 0x7f21241021b0 2024-04-16T14:46:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.655+0000 7f2129a18640 1 -- 172.21.15.5:0/1687768185 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21240fd920 con 0x7f21241021b0 2024-04-16T14:46:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.655+0000 7f211b7fe640 1 -- 172.21.15.5:0/1687768185 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f211400a820 con 0x7f21241021b0 2024-04-16T14:46:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.655+0000 7f211b7fe640 1 --2- 172.21.15.5:0/1687768185 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f211006e050 0x7f2110070500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.655+0000 7f211b7fe640 1 -- 172.21.15.5:0/1687768185 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f211408e320 con 0x7f21241021b0 2024-04-16T14:46:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.655+0000 7f21227fc640 1 --2- 172.21.15.5:0/1687768185 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f211006e050 0x7f2110070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.656+0000 7f21227fc640 1 --2- 172.21.15.5:0/1687768185 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f211006e050 0x7f2110070500 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f210c02bda0 tx=0x7f210c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:38.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.660+0000 7f211b7fe640 1 -- 172.21.15.5:0/1687768185 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f21140575f0 con 0x7f21241021b0 2024-04-16T14:46:38.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.844+0000 7f2129a18640 1 -- 172.21.15.5:0/1687768185 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f212404bcc0 con 0x7f21241021b0 2024-04-16T14:46:38.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.845+0000 7f211b7fe640 1 -- 172.21.15.5:0/1687768185 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16703 (secure 0 0 0) 0x7f211405acb0 con 0x7f21241021b0 2024-04-16T14:46:38.844 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:38.844 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":85,"fsid":"10609bfa-fbfd-11ee-bc90-c7b262605968","created":"2024-04-16T14:25:45.190718+0000","modified":"2024-04-16T14:43:22.064592+0000","last_up_change":"2024-04-16T14:41:44.210800+0000","last_in_change":"2024-04-16T14:31:07.952511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T14:30:12.985367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-16T14:32:44.205257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-16T14:32:44.506945+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa9fa9e4-bdd2-42c5-ba51-8d141fa9c4c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":79,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1335449550},{"type":"v1","addr":"172.21.15.5:6803","nonce":1335449550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1335449550},{"type":"v1","addr":"172.21.15.5:6805","nonce":1335449550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1335449550},{"type":"v1","addr":"172.21.15.5:6809","nonce":1335449550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1335449550},{"type":"v1","addr":"172.21.15.5:6807","nonce":1335449550}]},"public_addr":"172.21.15.5:6803/1335449550","cluster_addr":"172.21.15.5:6805/1335449550","heartbeat_back_addr":"172.21.15.5:6809/1335449550","heartbeat_front_addr":"172.21.15.5:6807/1335449550","state":["exists","up"]},{"osd":1,"uuid":"d4074765-a246-412a-8b68-8da402adc7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":59,"up_thru":79,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2244573810},{"type":"v1","addr":"172.21.15.5:6811","nonce":2244573810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2244573810},{"type":"v1","addr":"172.21.15.5:6813","nonce":2244573810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2244573810},{"type":"v1","addr":"172.21.15.5:6817","nonce":2244573810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2244573810},{"type":"v1","addr":"172.21.15.5:6815","nonce":2244573810}]},"public_addr":"172.21.15.5:6811/2244573810","cluster_addr":"172.21.15.5:6813/2244573810","heartbeat_back_addr":"172.21.15.5:6817/2244573810","heartbeat_front_addr":"172.21.15.5:6815/2244573810","state":["exists","up"]},{"osd":2,"uuid":"1851758c-0015-4f54-b4b8-30c1424394ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":60,"up_from":64,"up_thru":79,"down_at":61,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":643342483},{"type":"v1","addr":"172.21.15.5:6819","nonce":643342483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":643342483},{"type":"v1","addr":"172.21.15.5:6821","nonce":643342483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":643342483},{"type":"v1","addr":"172.21.15.5:6825","nonce":643342483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":643342483},{"type":"v1","addr":"172.21.15.5:6823","nonce":643342483}]},"public_addr":"172.21.15.5:6819/643342483","cluster_addr":"172.21.15.5:6821/643342483","heartbeat_back_addr":"172.21.15.5:6825/643342483","heartbeat_front_addr":"172.21.15.5:6823/643342483","state":["exists","up"]},{"osd":3,"uuid":"ab6404e2-5cef-4a8a-8b93-a24914c67fc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":65,"up_from":69,"up_thru":79,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":4263407632},{"type":"v1","addr":"172.21.15.115:6801","nonce":4263407632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":4263407632},{"type":"v1","addr":"172.21.15.115:6803","nonce":4263407632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":4263407632},{"type":"v1","addr":"172.21.15.115:6807","nonce":4263407632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":4263407632},{"type":"v1","addr":"172.21.15.115:6805","nonce":4263407632}]},"public_addr":"172.21.15.115:6801/4263407632","cluster_addr":"172.21.15.115:6803/4263407632","heartbeat_back_addr":"172.21.15.115:6807/4263407632","heartbeat_front_addr":"172.21.15.115:6805/4263407632","state":["exists","up"]},{"osd":4,"uuid":"4252814c-6811-4b53-a8be-cd65d7aa39a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":70,"up_from":74,"up_thru":79,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":139500214},{"type":"v1","addr":"172.21.15.115:6809","nonce":139500214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":139500214},{"type":"v1","addr":"172.21.15.115:6811","nonce":139500214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":139500214},{"type":"v1","addr":"172.21.15.115:6815","nonce":139500214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":139500214},{"type":"v1","addr":"172.21.15.115:6813","nonce":139500214}]},"public_addr":"172.21.15.115:6809/139500214","cluster_addr":"172.21.15.115:6811/139500214","heartbeat_back_addr":"172.21.15.115:6815/139500214","heartbeat_front_addr":"172.21.15.115:6813/139500214","state":["exists","up"]},{"osd":5,"uuid":"124732a1-f6a0-462e-bd5e-2bcd743ab2a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":75,"up_from":79,"up_thru":79,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":1604069545},{"type":"v1","addr":"172.21.15.115:6817","nonce":1604069545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":1604069545},{"type":"v1","addr":"172.21.15.115:6819","nonce":1604069545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":1604069545},{"type":"v1","addr":"172.21.15.115:6823","nonce":1604069545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":1604069545},{"type":"v1","addr":"172.21.15.115:6821","nonce":1604069545}]},"public_addr":"172.21.15.115:6817/1604069545","cluster_addr":"172.21.15.115:6819/1604069545","heartbeat_back_addr":"172.21.15.115:6823/1604069545","heartbeat_front_addr":"172.21.15.115:6821/1604069545","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:29:14.299546+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:29:41.658611+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:30:10.127883+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:30:33.310873+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:30:59.158923+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:31:24.898158+0000","dead_epoch":75}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:6827/2476249308":"2024-04-17T14:43:22.064543+0000","172.21.15.115:6826/2476249308":"2024-04-17T14:43:22.064543+0000","172.21.15.5:6829/402035291":"2024-04-17T14:42:40.192043+0000","172.21.15.5:6828/402035291":"2024-04-17T14:42:40.192043+0000","172.21.15.5:6800/4176454319":"2024-04-17T14:28:02.662455+0000","172.21.15.5:0/2384405072":"2024-04-17T14:26:17.425567+0000","172.21.15.5:6801/1956301653":"2024-04-17T14:37:23.186462+0000","172.21.15.5:0/801827499":"2024-04-17T14:26:48.930147+0000","172.21.15.5:0/2010393498":"2024-04-17T14:34:55.944821+0000","172.21.15.5:6800/3841652776":"2024-04-17T14:34:55.944821+0000","172.21.15.115:6828/460631486":"2024-04-17T14:36:31.676822+0000","172.21.15.5:0/1109429271":"2024-04-17T14:37:23.186462+0000","172.21.15.5:0/4125351321":"2024-04-17T14:34:55.944821+0000","172.21.15.5:6800/1086445367":"2024-04-17T14:26:17.425567+0000","172.21.15.115:0/1842350799":"2024-04-17T14:36:31.676822+0000","172.21.15.5:0/2653432440":"2024-04-17T14:28:02.662455+0000","172.21.15.5:0/861562298":"2024-04-17T14:37:23.186462+0000","172.21.15.5:0/3710869010":"2024-04-17T14:26:17.425567+0000","172.21.15.5:6801/3841652776":"2024-04-17T14:34:55.944821+0000","172.21.15.5:0/3602505234":"2024-04-17T14:34:55.944821+0000","172.21.15.5:0/2013882368":"2024-04-17T14:26:48.930147+0000","172.21.15.5:0/1548281910":"2024-04-17T14:28:02.662455+0000","172.21.15.5:6801/1086445367":"2024-04-17T14:26:17.425567+0000","172.21.15.115:0/861197783":"2024-04-17T14:36:31.676822+0000","172.21.15.5:0/3891215761":"2024-04-17T14:37:23.186462+0000","172.21.15.5:6827/3000067296":"2024-04-17T14:33:00.804392+0000","172.21.15.5:0/3767913866":"2024-04-17T14:28:02.662455+0000","172.21.15.5:0/3063530168":"2024-04-17T14:34:55.944821+0000","172.21.15.115:0/3056216034":"2024-04-17T14:36:31.676822+0000","172.21.15.115:6829/460631486":"2024-04-17T14:36:31.676822+0000","172.21.15.5:0/3364969045":"2024-04-17T14:26:48.930147+0000","172.21.15.5:6800/4088193218":"2024-04-17T14:26:48.930147+0000","172.21.15.5:6801/4088193218":"2024-04-17T14:26:48.930147+0000","172.21.15.5:0/726821609":"2024-04-17T14:37:23.186462+0000","172.21.15.5:6826/3000067296":"2024-04-17T14:33:00.804392+0000","172.21.15.5:6800/1956301653":"2024-04-17T14:37:23.186462+0000","172.21.15.5:0/3196662527":"2024-04-17T14:37:23.186462+0000","172.21.15.5:6801/4176454319":"2024-04-17T14:28:02.662455+0000","172.21.15.5:0/2015079913":"2024-04-17T14:26:17.425567+0000","172.21.15.115:0/1736155115":"2024-04-17T14:36:31.676822+0000","172.21.15.5:0/2335924356":"2024-04-17T14:37:23.186462+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T14:46:38.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.847+0000 7f2129a18640 1 -- 172.21.15.5:0/1687768185 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f211006e050 msgr2=0x7f2110070500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:38.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.847+0000 7f2129a18640 1 --2- 172.21.15.5:0/1687768185 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f211006e050 0x7f2110070500 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f210c02bda0 tx=0x7f210c009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:38.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.847+0000 7f2129a18640 1 -- 172.21.15.5:0/1687768185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21241021b0 msgr2=0x7f2124112d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:38.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.847+0000 7f2129a18640 1 --2- 172.21.15.5:0/1687768185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21241021b0 0x7f2124112d20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f211400cb10 tx=0x7f2114007ee0 comp rx=0 tx=0).stop 2024-04-16T14:46:38.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.847+0000 7f2129a18640 1 -- 172.21.15.5:0/1687768185 shutdown_connections 2024-04-16T14:46:38.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.847+0000 7f2129a18640 1 --2- 172.21.15.5:0/1687768185 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f211006e050 0x7f2110070500 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:38.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.847+0000 7f2129a18640 1 --2- 172.21.15.5:0/1687768185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2124102b50 0x7f2124113260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:38.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.847+0000 7f2129a18640 1 --2- 172.21.15.5:0/1687768185 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21241021b0 0x7f2124112d20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:38.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.847+0000 7f2129a18640 1 -- 172.21.15.5:0/1687768185 >> 172.21.15.5:0/1687768185 conn(0x7f21240f7d40 msgr2=0x7f21240f8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:38.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.847+0000 7f2129a18640 1 -- 172.21.15.5:0/1687768185 shutdown_connections 2024-04-16T14:46:38.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.847+0000 7f2129a18640 1 -- 172.21.15.5:0/1687768185 wait complete. 2024-04-16T14:46:38.857 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T14:30:12.985367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-16T14:32:44.205257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-16T14:32:44.506945+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T14:46:38.858 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T14:46:38.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.963+0000 7f9c99207640 1 -- 172.21.15.5:0/706491788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c94101c80 msgr2=0x7f9c940fb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:38.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.963+0000 7f9c99207640 1 --2- 172.21.15.5:0/706491788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c94101c80 0x7f9c940fb310 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c0048d0 tx=0x7f9c7c009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:38.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.963+0000 7f9c99207640 1 -- 172.21.15.5:0/706491788 shutdown_connections 2024-04-16T14:46:38.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.963+0000 7f9c99207640 1 --2- 172.21.15.5:0/706491788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c94101c80 0x7f9c940fb310 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:38.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.963+0000 7f9c99207640 1 --2- 172.21.15.5:0/706491788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c941012e0 0x7f9c941016b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:38.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.963+0000 7f9c99207640 1 -- 172.21.15.5:0/706491788 >> 172.21.15.5:0/706491788 conn(0x7f9c940f6eb0 msgr2=0x7f9c940f92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.964+0000 7f9c99207640 1 -- 172.21.15.5:0/706491788 shutdown_connections 2024-04-16T14:46:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.964+0000 7f9c99207640 1 -- 172.21.15.5:0/706491788 wait complete. 2024-04-16T14:46:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.964+0000 7f9c99207640 1 Processor -- start 2024-04-16T14:46:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.964+0000 7f9c99207640 1 -- start start 2024-04-16T14:46:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.964+0000 7f9c99207640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c941012e0 0x7f9c94112f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.964+0000 7f9c99207640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c94101c80 0x7f9c94113450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.964+0000 7f9c99207640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c94113a50 con 0x7f9c941012e0 2024-04-16T14:46:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.964+0000 7f9c99207640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9410d0f0 con 0x7f9c94101c80 2024-04-16T14:46:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.964+0000 7f9c92d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c941012e0 0x7f9c94112f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.965+0000 7f9c92d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c941012e0 0x7f9c94112f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53558/0 (socket says 172.21.15.5:53558) 2024-04-16T14:46:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.965+0000 7f9c92d9d640 1 -- 172.21.15.5:0/474958623 learned_addr learned my addr 172.21.15.5:0/474958623 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.965+0000 7f9c9259c640 1 --2- 172.21.15.5:0/474958623 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c94101c80 0x7f9c94113450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.965+0000 7f9c92d9d640 1 -- 172.21.15.5:0/474958623 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c94101c80 msgr2=0x7f9c94113450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.965+0000 7f9c92d9d640 1 --2- 172.21.15.5:0/474958623 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c94101c80 0x7f9c94113450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.965+0000 7f9c92d9d640 1 -- 172.21.15.5:0/474958623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7c005040 con 0x7f9c941012e0 2024-04-16T14:46:38.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.965+0000 7f9c92d9d640 1 --2- 172.21.15.5:0/474958623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c941012e0 0x7f9c94112f10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400ece0 tx=0x7f9c8400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:38.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.965+0000 7f9c8b7fe640 1 -- 172.21.15.5:0/474958623 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c8400ee40 con 0x7f9c941012e0 2024-04-16T14:46:38.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.965+0000 7f9c99207640 1 -- 172.21.15.5:0/474958623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c9410d3d0 con 0x7f9c941012e0 2024-04-16T14:46:38.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.965+0000 7f9c8b7fe640 1 -- 172.21.15.5:0/474958623 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9c8400f040 con 0x7f9c941012e0 2024-04-16T14:46:38.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.965+0000 7f9c8b7fe640 1 -- 172.21.15.5:0/474958623 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c84009750 con 0x7f9c941012e0 2024-04-16T14:46:38.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.965+0000 7f9c99207640 1 -- 172.21.15.5:0/474958623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c9410d8c0 con 0x7f9c941012e0 2024-04-16T14:46:38.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.966+0000 7f9c99207640 1 -- 172.21.15.5:0/474958623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c940fca50 con 0x7f9c941012e0 2024-04-16T14:46:38.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.967+0000 7f9c8b7fe640 1 -- 172.21.15.5:0/474958623 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f9c84007890 con 0x7f9c941012e0 2024-04-16T14:46:38.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.967+0000 7f9c8b7fe640 1 --2- 172.21.15.5:0/474958623 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f9c8006e0b0 0x7f9c80070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:38.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.967+0000 7f9c8b7fe640 1 -- 172.21.15.5:0/474958623 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f9c8408e440 con 0x7f9c941012e0 2024-04-16T14:46:38.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.967+0000 7f9c9259c640 1 --2- 172.21.15.5:0/474958623 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f9c8006e0b0 0x7f9c80070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:38.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.968+0000 7f9c9259c640 1 --2- 172.21.15.5:0/474958623 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f9c8006e0b0 0x7f9c80070560 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9c94066660 tx=0x7f9c7c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:38.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:38.972+0000 7f9c8b7fe640 1 -- 172.21.15.5:0/474958623 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f9c84057710 con 0x7f9c941012e0 2024-04-16T14:46:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.156+0000 7f9c99207640 1 -- 172.21.15.5:0/474958623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9c94108440 con 0x7f9c941012e0 2024-04-16T14:46:39.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.156+0000 7f9c8b7fe640 1 -- 172.21.15.5:0/474958623 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9c8405add0 con 0x7f9c941012e0 2024-04-16T14:46:39.155 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-16T14:46:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.158+0000 7f9c99207640 1 -- 172.21.15.5:0/474958623 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f9c8006e0b0 msgr2=0x7f9c80070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.158+0000 7f9c99207640 1 --2- 172.21.15.5:0/474958623 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f9c8006e0b0 0x7f9c80070560 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9c94066660 tx=0x7f9c7c009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.158+0000 7f9c99207640 1 -- 172.21.15.5:0/474958623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c941012e0 msgr2=0x7f9c94112f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.158+0000 7f9c99207640 1 --2- 172.21.15.5:0/474958623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c941012e0 0x7f9c94112f10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400ece0 tx=0x7f9c8400b040 comp rx=0 tx=0).stop 2024-04-16T14:46:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.158+0000 7f9c99207640 1 -- 172.21.15.5:0/474958623 shutdown_connections 2024-04-16T14:46:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.158+0000 7f9c99207640 1 --2- 172.21.15.5:0/474958623 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f9c8006e0b0 0x7f9c80070560 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.158+0000 7f9c99207640 1 --2- 172.21.15.5:0/474958623 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c94101c80 0x7f9c94113450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.158+0000 7f9c99207640 1 --2- 172.21.15.5:0/474958623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c941012e0 0x7f9c94112f10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.158+0000 7f9c99207640 1 -- 172.21.15.5:0/474958623 >> 172.21.15.5:0/474958623 conn(0x7f9c940f6eb0 msgr2=0x7f9c940f7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.158+0000 7f9c99207640 1 -- 172.21.15.5:0/474958623 shutdown_connections 2024-04-16T14:46:39.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.158+0000 7f9c99207640 1 -- 172.21.15.5:0/474958623 wait complete. 2024-04-16T14:46:39.168 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-16T14:46:39.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.273+0000 7faa4ab9d640 1 -- 172.21.15.5:0/411497163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa441010f0 msgr2=0x7faa441014c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:39.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.273+0000 7faa4ab9d640 1 --2- 172.21.15.5:0/411497163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa441010f0 0x7faa441014c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7faa380048d0 tx=0x7faa38009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:39.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.273+0000 7faa4ab9d640 1 -- 172.21.15.5:0/411497163 shutdown_connections 2024-04-16T14:46:39.273 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.273+0000 7faa4ab9d640 1 --2- 172.21.15.5:0/411497163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa44101a90 0x7faa440fb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.273+0000 7faa4ab9d640 1 --2- 172.21.15.5:0/411497163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa441010f0 0x7faa441014c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.273+0000 7faa4ab9d640 1 -- 172.21.15.5:0/411497163 >> 172.21.15.5:0/411497163 conn(0x7faa440f6d00 msgr2=0x7faa440f9110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.273+0000 7faa4ab9d640 1 -- 172.21.15.5:0/411497163 shutdown_connections 2024-04-16T14:46:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.273+0000 7faa4ab9d640 1 -- 172.21.15.5:0/411497163 wait complete. 2024-04-16T14:46:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.273+0000 7faa4ab9d640 1 Processor -- start 2024-04-16T14:46:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.274+0000 7faa4ab9d640 1 -- start start 2024-04-16T14:46:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.274+0000 7faa4ab9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa441010f0 0x7faa4410de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.274+0000 7faa4ab9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa44101a90 0x7faa4410e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.274+0000 7faa4ab9d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa44066560 con 0x7faa441010f0 2024-04-16T14:46:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.274+0000 7faa4ab9d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4410e940 con 0x7faa44101a90 2024-04-16T14:46:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.274+0000 7faa48939640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa441010f0 0x7faa4410de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.274+0000 7faa48939640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa441010f0 0x7faa4410de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53584/0 (socket says 172.21.15.5:53584) 2024-04-16T14:46:39.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.274+0000 7faa48939640 1 -- 172.21.15.5:0/4165151828 learned_addr learned my addr 172.21.15.5:0/4165151828 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:39.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.274+0000 7faa43fff640 1 --2- 172.21.15.5:0/4165151828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa44101a90 0x7faa4410e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:39.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.274+0000 7faa48939640 1 -- 172.21.15.5:0/4165151828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa44101a90 msgr2=0x7faa4410e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:39.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.274+0000 7faa48939640 1 --2- 172.21.15.5:0/4165151828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa44101a90 0x7faa4410e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:39.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.274+0000 7faa48939640 1 -- 172.21.15.5:0/4165151828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa38005040 con 0x7faa441010f0 2024-04-16T14:46:39.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.274+0000 7faa48939640 1 --2- 172.21.15.5:0/4165151828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa441010f0 0x7faa4410de90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faa38004930 tx=0x7faa38009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:39.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.275+0000 7faa417fa640 1 -- 172.21.15.5:0/4165151828 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa380094c0 con 0x7faa441010f0 2024-04-16T14:46:39.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.275+0000 7faa417fa640 1 -- 172.21.15.5:0/4165151828 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faa38032e50 con 0x7faa441010f0 2024-04-16T14:46:39.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.275+0000 7faa417fa640 1 -- 172.21.15.5:0/4165151828 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa380433b0 con 0x7faa441010f0 2024-04-16T14:46:39.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.275+0000 7faa4ab9d640 1 -- 172.21.15.5:0/4165151828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa4410ebc0 con 0x7faa441010f0 2024-04-16T14:46:39.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.275+0000 7faa4ab9d640 1 -- 172.21.15.5:0/4165151828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa441170f0 con 0x7faa441010f0 2024-04-16T14:46:39.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.276+0000 7faa4ab9d640 1 -- 172.21.15.5:0/4165151828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa440fc860 con 0x7faa441010f0 2024-04-16T14:46:39.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.276+0000 7faa417fa640 1 -- 172.21.15.5:0/4165151828 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7faa3802f070 con 0x7faa441010f0 2024-04-16T14:46:39.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.277+0000 7faa417fa640 1 --2- 172.21.15.5:0/4165151828 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7faa3406e0b0 0x7faa34070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:39.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.277+0000 7faa417fa640 1 -- 172.21.15.5:0/4165151828 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7faa380af910 con 0x7faa441010f0 2024-04-16T14:46:39.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.277+0000 7faa43fff640 1 --2- 172.21.15.5:0/4165151828 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7faa3406e0b0 0x7faa34070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:39.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.277+0000 7faa43fff640 1 --2- 172.21.15.5:0/4165151828 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7faa3406e0b0 0x7faa34070560 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faa44065db0 tx=0x7faa3000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:39.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.281+0000 7faa417fa640 1 -- 172.21.15.5:0/4165151828 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7faa38078c90 con 0x7faa441010f0 2024-04-16T14:46:39.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:39 smithi115 ceph-mon[83414]: pgmap v315: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:39.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:39 smithi115 ceph-mon[83414]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:46:39.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:39 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/1687768185' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-16T14:46:39.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.465+0000 7faa4ab9d640 1 -- 172.21.15.5:0/4165151828 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7faa4404bcc0 con 0x7faa441010f0 2024-04-16T14:46:39.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.466+0000 7faa417fa640 1 -- 172.21.15.5:0/4165151828 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7faa3807c350 con 0x7faa441010f0 2024-04-16T14:46:39.464 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-16T14:46:39.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.468+0000 7faa4ab9d640 1 -- 172.21.15.5:0/4165151828 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7faa3406e0b0 msgr2=0x7faa34070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:39.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.468+0000 7faa4ab9d640 1 --2- 172.21.15.5:0/4165151828 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7faa3406e0b0 0x7faa34070560 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faa44065db0 tx=0x7faa3000b040 comp rx=0 tx=0).stop 2024-04-16T14:46:39.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.468+0000 7faa4ab9d640 1 -- 172.21.15.5:0/4165151828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa441010f0 msgr2=0x7faa4410de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:39.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.468+0000 7faa4ab9d640 1 --2- 172.21.15.5:0/4165151828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa441010f0 0x7faa4410de90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faa38004930 tx=0x7faa38009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:39.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.468+0000 7faa4ab9d640 1 -- 172.21.15.5:0/4165151828 shutdown_connections 2024-04-16T14:46:39.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.468+0000 7faa4ab9d640 1 --2- 172.21.15.5:0/4165151828 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7faa3406e0b0 0x7faa34070560 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:39.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.468+0000 7faa4ab9d640 1 --2- 172.21.15.5:0/4165151828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa44101a90 0x7faa4410e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:39.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.468+0000 7faa4ab9d640 1 --2- 172.21.15.5:0/4165151828 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa441010f0 0x7faa4410de90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:39.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.468+0000 7faa4ab9d640 1 -- 172.21.15.5:0/4165151828 >> 172.21.15.5:0/4165151828 conn(0x7faa440f6d00 msgr2=0x7faa440f7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:39.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.468+0000 7faa4ab9d640 1 -- 172.21.15.5:0/4165151828 shutdown_connections 2024-04-16T14:46:39.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.468+0000 7faa4ab9d640 1 -- 172.21.15.5:0/4165151828 wait complete. 2024-04-16T14:46:39.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:39 smithi005 ceph-mon[93420]: pgmap v315: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:39.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:39 smithi005 ceph-mon[93420]: from='mgr.34104 172.21.15.5:0/626469540' entity='mgr.smithi005.ipwdkc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-16T14:46:39.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:39 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/1687768185' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-16T14:46:39.477 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-16T14:46:39.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.583+0000 7f5e6a658640 1 -- 172.21.15.5:0/2493902055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e64102b70 msgr2=0x7f5e640fc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:39.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.583+0000 7f5e6a658640 1 --2- 172.21.15.5:0/2493902055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e64102b70 0x7f5e640fc200 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c0048d0 tx=0x7f5e4c009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:39.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.583+0000 7f5e6a658640 1 -- 172.21.15.5:0/2493902055 shutdown_connections 2024-04-16T14:46:39.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.583+0000 7f5e6a658640 1 --2- 172.21.15.5:0/2493902055 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e64102b70 0x7f5e640fc200 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:39.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.583+0000 7f5e6a658640 1 --2- 172.21.15.5:0/2493902055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e641021d0 0x7f5e641025a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:39.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.583+0000 7f5e6a658640 1 -- 172.21.15.5:0/2493902055 >> 172.21.15.5:0/2493902055 conn(0x7f5e640f7dc0 msgr2=0x7f5e640fa1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:39.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.583+0000 7f5e6a658640 1 -- 172.21.15.5:0/2493902055 shutdown_connections 2024-04-16T14:46:39.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.583+0000 7f5e6a658640 1 -- 172.21.15.5:0/2493902055 wait complete. 2024-04-16T14:46:39.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.583+0000 7f5e6a658640 1 Processor -- start 2024-04-16T14:46:39.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.583+0000 7f5e6a658640 1 -- start start 2024-04-16T14:46:39.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.584+0000 7f5e6a658640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e641021d0 0x7f5e64112cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:39.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.584+0000 7f5e6a658640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e64102b70 0x7f5e64113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:39.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.584+0000 7f5e6a658640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e64113830 con 0x7f5e641021d0 2024-04-16T14:46:39.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.584+0000 7f5e6a658640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6410ce80 con 0x7f5e64102b70 2024-04-16T14:46:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.584+0000 7f5e63fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e641021d0 0x7f5e64112cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.584+0000 7f5e63fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e641021d0 0x7f5e64112cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53598/0 (socket says 172.21.15.5:53598) 2024-04-16T14:46:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.584+0000 7f5e63fff640 1 -- 172.21.15.5:0/2748606922 learned_addr learned my addr 172.21.15.5:0/2748606922 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.584+0000 7f5e5bfff640 1 --2- 172.21.15.5:0/2748606922 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e64102b70 0x7f5e64113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.584+0000 7f5e63fff640 1 -- 172.21.15.5:0/2748606922 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e64102b70 msgr2=0x7f5e64113230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.584+0000 7f5e63fff640 1 --2- 172.21.15.5:0/2748606922 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e64102b70 0x7f5e64113230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.584+0000 7f5e63fff640 1 -- 172.21.15.5:0/2748606922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4c005040 con 0x7f5e641021d0 2024-04-16T14:46:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.584+0000 7f5e5bfff640 1 --2- 172.21.15.5:0/2748606922 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e64102b70 0x7f5e64113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:46:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.584+0000 7f5e63fff640 1 --2- 172.21.15.5:0/2748606922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e641021d0 0x7f5e64112cf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5e54002a50 tx=0x7f5e54004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.584+0000 7f5e617fa640 1 -- 172.21.15.5:0/2748606922 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e54007c30 con 0x7f5e641021d0 2024-04-16T14:46:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.584+0000 7f5e6a658640 1 -- 172.21.15.5:0/2748606922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e6410d160 con 0x7f5e641021d0 2024-04-16T14:46:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.584+0000 7f5e617fa640 1 -- 172.21.15.5:0/2748606922 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5e5400f040 con 0x7f5e641021d0 2024-04-16T14:46:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.584+0000 7f5e6a658640 1 -- 172.21.15.5:0/2748606922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e6410d680 con 0x7f5e641021d0 2024-04-16T14:46:39.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.584+0000 7f5e617fa640 1 -- 172.21.15.5:0/2748606922 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e5400db10 con 0x7f5e641021d0 2024-04-16T14:46:39.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.585+0000 7f5e6a658640 1 -- 172.21.15.5:0/2748606922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e640fd940 con 0x7f5e641021d0 2024-04-16T14:46:39.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.586+0000 7f5e617fa640 1 -- 172.21.15.5:0/2748606922 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f5e5400dc90 con 0x7f5e641021d0 2024-04-16T14:46:39.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.586+0000 7f5e617fa640 1 --2- 172.21.15.5:0/2748606922 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f5e5006e0b0 0x7f5e50070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:39.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.586+0000 7f5e617fa640 1 -- 172.21.15.5:0/2748606922 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f5e5408d480 con 0x7f5e641021d0 2024-04-16T14:46:39.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.586+0000 7f5e5bfff640 1 --2- 172.21.15.5:0/2748606922 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f5e5006e0b0 0x7f5e50070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:39.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.587+0000 7f5e5bfff640 1 --2- 172.21.15.5:0/2748606922 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f5e5006e0b0 0x7f5e50070560 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c000c00 tx=0x7f5e4c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:39.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.591+0000 7f5e617fa640 1 -- 172.21.15.5:0/2748606922 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f5e54056750 con 0x7f5e641021d0 2024-04-16T14:46:39.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.774+0000 7f5e6a658640 1 -- 172.21.15.5:0/2748606922 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f5e64109330 con 0x7f5e641021d0 2024-04-16T14:46:39.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.775+0000 7f5e617fa640 1 -- 172.21.15.5:0/2748606922 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f5e54059e10 con 0x7f5e641021d0 2024-04-16T14:46:39.773 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-16T14:46:39.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.777+0000 7f5e6a658640 1 -- 172.21.15.5:0/2748606922 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f5e5006e0b0 msgr2=0x7f5e50070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:39.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.777+0000 7f5e6a658640 1 --2- 172.21.15.5:0/2748606922 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f5e5006e0b0 0x7f5e50070560 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c000c00 tx=0x7f5e4c009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:39.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.777+0000 7f5e6a658640 1 -- 172.21.15.5:0/2748606922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e641021d0 msgr2=0x7f5e64112cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:39.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.777+0000 7f5e6a658640 1 --2- 172.21.15.5:0/2748606922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e641021d0 0x7f5e64112cf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5e54002a50 tx=0x7f5e54004600 comp rx=0 tx=0).stop 2024-04-16T14:46:39.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.777+0000 7f5e6a658640 1 -- 172.21.15.5:0/2748606922 shutdown_connections 2024-04-16T14:46:39.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.777+0000 7f5e6a658640 1 --2- 172.21.15.5:0/2748606922 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f5e5006e0b0 0x7f5e50070560 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:39.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.777+0000 7f5e6a658640 1 --2- 172.21.15.5:0/2748606922 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e64102b70 0x7f5e64113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:39.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.777+0000 7f5e6a658640 1 --2- 172.21.15.5:0/2748606922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e641021d0 0x7f5e64112cf0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:39.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.777+0000 7f5e6a658640 1 -- 172.21.15.5:0/2748606922 >> 172.21.15.5:0/2748606922 conn(0x7f5e640f7dc0 msgr2=0x7f5e640f8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:39.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.777+0000 7f5e6a658640 1 -- 172.21.15.5:0/2748606922 shutdown_connections 2024-04-16T14:46:39.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.777+0000 7f5e6a658640 1 -- 172.21.15.5:0/2748606922 wait complete. 2024-04-16T14:46:39.786 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-16T14:46:39.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.888+0000 7efe1e55d640 1 -- 172.21.15.5:0/26424642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe18101af0 msgr2=0x7efe180fb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:39.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.888+0000 7efe1e55d640 1 --2- 172.21.15.5:0/26424642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe18101af0 0x7efe180fb180 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0048d0 tx=0x7efe0c009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:39.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.888+0000 7efe1e55d640 1 -- 172.21.15.5:0/26424642 shutdown_connections 2024-04-16T14:46:39.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.888+0000 7efe1e55d640 1 --2- 172.21.15.5:0/26424642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe18101af0 0x7efe180fb180 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:39.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.888+0000 7efe1e55d640 1 --2- 172.21.15.5:0/26424642 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe18101150 0x7efe18101520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:39.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.888+0000 7efe1e55d640 1 -- 172.21.15.5:0/26424642 >> 172.21.15.5:0/26424642 conn(0x7efe180f6ce0 msgr2=0x7efe180f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:39.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.888+0000 7efe1e55d640 1 -- 172.21.15.5:0/26424642 shutdown_connections 2024-04-16T14:46:39.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.888+0000 7efe1e55d640 1 -- 172.21.15.5:0/26424642 wait complete. 2024-04-16T14:46:39.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.889+0000 7efe1e55d640 1 Processor -- start 2024-04-16T14:46:39.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.889+0000 7efe1e55d640 1 -- start start 2024-04-16T14:46:39.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.889+0000 7efe1e55d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe18101150 0x7efe18113030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:39.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.889+0000 7efe1e55d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe18101af0 0x7efe18113570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:39.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.889+0000 7efe1e55d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe18113b70 con 0x7efe18101af0 2024-04-16T14:46:39.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.889+0000 7efe1e55d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1810d1c0 con 0x7efe18101150 2024-04-16T14:46:39.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.889+0000 7efe177fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe18101af0 0x7efe18113570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:39.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.889+0000 7efe177fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe18101af0 0x7efe18113570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53620/0 (socket says 172.21.15.5:53620) 2024-04-16T14:46:39.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.890+0000 7efe177fe640 1 -- 172.21.15.5:0/1189327775 learned_addr learned my addr 172.21.15.5:0/1189327775 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:39.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.890+0000 7efe17fff640 1 --2- 172.21.15.5:0/1189327775 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe18101150 0x7efe18113030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:39.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.890+0000 7efe177fe640 1 -- 172.21.15.5:0/1189327775 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe18101150 msgr2=0x7efe18113030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:39.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.890+0000 7efe177fe640 1 --2- 172.21.15.5:0/1189327775 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe18101150 0x7efe18113030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:39.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.890+0000 7efe177fe640 1 -- 172.21.15.5:0/1189327775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c005040 con 0x7efe18101af0 2024-04-16T14:46:39.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.890+0000 7efe177fe640 1 --2- 172.21.15.5:0/1189327775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe18101af0 0x7efe18113570 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efe0c004930 tx=0x7efe0c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:39.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.890+0000 7efe14ff9640 1 -- 172.21.15.5:0/1189327775 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe0c0094c0 con 0x7efe18101af0 2024-04-16T14:46:39.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.890+0000 7efe1e55d640 1 -- 172.21.15.5:0/1189327775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe1810d440 con 0x7efe18101af0 2024-04-16T14:46:39.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.890+0000 7efe14ff9640 1 -- 172.21.15.5:0/1189327775 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe0c032e50 con 0x7efe18101af0 2024-04-16T14:46:39.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.890+0000 7efe14ff9640 1 -- 172.21.15.5:0/1189327775 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe0c0433b0 con 0x7efe18101af0 2024-04-16T14:46:39.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.890+0000 7efe1e55d640 1 -- 172.21.15.5:0/1189327775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe1810d900 con 0x7efe18101af0 2024-04-16T14:46:39.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.891+0000 7efe1e55d640 1 -- 172.21.15.5:0/1189327775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe180fc8c0 con 0x7efe18101af0 2024-04-16T14:46:39.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.892+0000 7efe14ff9640 1 -- 172.21.15.5:0/1189327775 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7efe0c02f070 con 0x7efe18101af0 2024-04-16T14:46:39.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.892+0000 7efe14ff9640 1 --2- 172.21.15.5:0/1189327775 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7efe0006e0b0 0x7efe00070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:39.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.892+0000 7efe14ff9640 1 -- 172.21.15.5:0/1189327775 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7efe0c0af9f0 con 0x7efe18101af0 2024-04-16T14:46:39.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.892+0000 7efe17fff640 1 --2- 172.21.15.5:0/1189327775 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7efe0006e0b0 0x7efe00070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:39.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.893+0000 7efe17fff640 1 --2- 172.21.15.5:0/1189327775 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7efe0006e0b0 0x7efe00070560 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efe08004ed0 tx=0x7efe0800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:39.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:39.897+0000 7efe14ff9640 1 -- 172.21.15.5:0/1189327775 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7efe0c0b1e60 con 0x7efe18101af0 2024-04-16T14:46:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.123+0000 7efe1e55d640 1 -- 172.21.15.5:0/1189327775 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe1804bcc0 con 0x7efe18101af0 2024-04-16T14:46:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.123+0000 7efe14ff9640 1 -- 172.21.15.5:0/1189327775 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+5230 (secure 0 0 0) 0x7efe0c078d70 con 0x7efe18101af0 2024-04-16T14:46:40.122 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:40.123 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44317,"name":"cephfs.smithi115.byfytg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6825/1461659094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1461659094},{"type":"v1","addr":"172.21.15.115:6825","nonce":1461659094}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44341,"name":"cephfs.smithi115.trkaqh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6827/3171302428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":3171302428},{"type":"v1","addr":"172.21.15.115:6827","nonce":3171302428}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T14:32:45.270024+0000","modified":"2024-04-16T14:43:39.966885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34434,"mds_1":34438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34434":{"gid":34434,"name":"cephfs.smithi005.vzoqdl","rank":0,"incarnation":38,"state":"up:active","state_seq":19,"addr":"172.21.15.5:6827/3940274196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3940274196},{"type":"v1","addr":"172.21.15.5:6827","nonce":3940274196}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34438":{"gid":34438,"name":"cephfs.smithi005.wofqlz","rank":1,"incarnation":43,"state":"up:active","state_seq":13,"addr":"172.21.15.5:6829/3592708911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3592708911},{"type":"v1","addr":"172.21.15.5:6829","nonce":3592708911}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34434,"qdb_cluster":[34434,34438]},"id":1}]} 2024-04-16T14:46:40.123 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 44 2024-04-16T14:46:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.126+0000 7efe1e55d640 1 -- 172.21.15.5:0/1189327775 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7efe0006e0b0 msgr2=0x7efe00070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.126+0000 7efe1e55d640 1 --2- 172.21.15.5:0/1189327775 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7efe0006e0b0 0x7efe00070560 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efe08004ed0 tx=0x7efe0800b040 comp rx=0 tx=0).stop 2024-04-16T14:46:40.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.126+0000 7efe1e55d640 1 -- 172.21.15.5:0/1189327775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe18101af0 msgr2=0x7efe18113570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:40.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.126+0000 7efe1e55d640 1 --2- 172.21.15.5:0/1189327775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe18101af0 0x7efe18113570 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efe0c004930 tx=0x7efe0c009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:40.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.126+0000 7efe1e55d640 1 -- 172.21.15.5:0/1189327775 shutdown_connections 2024-04-16T14:46:40.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.126+0000 7efe1e55d640 1 --2- 172.21.15.5:0/1189327775 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7efe0006e0b0 0x7efe00070560 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:40.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.126+0000 7efe1e55d640 1 --2- 172.21.15.5:0/1189327775 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efe18101af0 0x7efe18113570 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:40.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.126+0000 7efe1e55d640 1 --2- 172.21.15.5:0/1189327775 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe18101150 0x7efe18113030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:40.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.126+0000 7efe1e55d640 1 -- 172.21.15.5:0/1189327775 >> 172.21.15.5:0/1189327775 conn(0x7efe180f6ce0 msgr2=0x7efe18065dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:40.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.126+0000 7efe1e55d640 1 -- 172.21.15.5:0/1189327775 shutdown_connections 2024-04-16T14:46:40.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.126+0000 7efe1e55d640 1 -- 172.21.15.5:0/1189327775 wait complete. 2024-04-16T14:46:40.135 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 18, 'max_mds': 2, 'flags': 18} 2024-04-16T14:46:40.135 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-04-16T14:46:40.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.241+0000 7fe56399d640 1 -- 172.21.15.5:0/2139047198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe55c0fd400 msgr2=0x7fe55c0fd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:40.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.241+0000 7fe56399d640 1 --2- 172.21.15.5:0/2139047198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe55c0fd400 0x7fe55c0fd7d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe54c009c50 tx=0x7fe54c004d10 comp rx=0 tx=0).stop 2024-04-16T14:46:40.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.241+0000 7fe56399d640 1 -- 172.21.15.5:0/2139047198 shutdown_connections 2024-04-16T14:46:40.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.241+0000 7fe56399d640 1 --2- 172.21.15.5:0/2139047198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe55c0fdd10 0x7fe55c1063e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:40.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.241+0000 7fe56399d640 1 --2- 172.21.15.5:0/2139047198 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe55c0fd400 0x7fe55c0fd7d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:40.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.241+0000 7fe56399d640 1 -- 172.21.15.5:0/2139047198 >> 172.21.15.5:0/2139047198 conn(0x7fe55c0f6eb0 msgr2=0x7fe55c0f92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:40.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.241+0000 7fe56399d640 1 -- 172.21.15.5:0/2139047198 shutdown_connections 2024-04-16T14:46:40.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.241+0000 7fe56399d640 1 -- 172.21.15.5:0/2139047198 wait complete. 2024-04-16T14:46:40.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.241+0000 7fe56399d640 1 Processor -- start 2024-04-16T14:46:40.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.241+0000 7fe56399d640 1 -- start start 2024-04-16T14:46:40.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.242+0000 7fe56399d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe55c0fd400 0x7fe55c112f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:40.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.242+0000 7fe56399d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe55c0fdd10 0x7fe55c1134a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:40.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.242+0000 7fe56399d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c113aa0 con 0x7fe55c0fdd10 2024-04-16T14:46:40.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.242+0000 7fe56399d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c10d0f0 con 0x7fe55c0fd400 2024-04-16T14:46:40.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.242+0000 7fe560f38640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe55c0fdd10 0x7fe55c1134a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:40.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.242+0000 7fe560f38640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe55c0fdd10 0x7fe55c1134a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53640/0 (socket says 172.21.15.5:53640) 2024-04-16T14:46:40.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.242+0000 7fe560f38640 1 -- 172.21.15.5:0/2031381626 learned_addr learned my addr 172.21.15.5:0/2031381626 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:40.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.242+0000 7fe561739640 1 --2- 172.21.15.5:0/2031381626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe55c0fd400 0x7fe55c112f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:40.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.242+0000 7fe560f38640 1 -- 172.21.15.5:0/2031381626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe55c0fd400 msgr2=0x7fe55c112f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:40.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.242+0000 7fe560f38640 1 --2- 172.21.15.5:0/2031381626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe55c0fd400 0x7fe55c112f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:40.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.242+0000 7fe560f38640 1 -- 172.21.15.5:0/2031381626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54c0098b0 con 0x7fe55c0fdd10 2024-04-16T14:46:40.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.242+0000 7fe560f38640 1 --2- 172.21.15.5:0/2031381626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe55c0fdd10 0x7fe55c1134a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe55000eb70 tx=0x7fe55000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:40.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.242+0000 7fe559ffb640 1 -- 172.21.15.5:0/2031381626 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe550007c30 con 0x7fe55c0fdd10 2024-04-16T14:46:40.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.242+0000 7fe559ffb640 1 -- 172.21.15.5:0/2031381626 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe55000f040 con 0x7fe55c0fdd10 2024-04-16T14:46:40.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.242+0000 7fe56399d640 1 -- 172.21.15.5:0/2031381626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe55c10d370 con 0x7fe55c0fdd10 2024-04-16T14:46:40.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.242+0000 7fe559ffb640 1 -- 172.21.15.5:0/2031381626 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5500095b0 con 0x7fe55c0fdd10 2024-04-16T14:46:40.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.243+0000 7fe56399d640 1 -- 172.21.15.5:0/2031381626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55c10d890 con 0x7fe55c0fdd10 2024-04-16T14:46:40.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.244+0000 7fe56399d640 1 -- 172.21.15.5:0/2031381626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe55c065e60 con 0x7fe55c0fdd10 2024-04-16T14:46:40.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.244+0000 7fe559ffb640 1 -- 172.21.15.5:0/2031381626 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fe550009730 con 0x7fe55c0fdd10 2024-04-16T14:46:40.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.244+0000 7fe559ffb640 1 --2- 172.21.15.5:0/2031381626 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe54406e0b0 0x7fe544070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:40.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.244+0000 7fe559ffb640 1 -- 172.21.15.5:0/2031381626 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fe55008d960 con 0x7fe55c0fdd10 2024-04-16T14:46:40.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.245+0000 7fe561739640 1 --2- 172.21.15.5:0/2031381626 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe54406e0b0 0x7fe544070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:40.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.245+0000 7fe561739640 1 --2- 172.21.15.5:0/2031381626 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe54406e0b0 0x7fe544070560 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe54c009c20 tx=0x7fe54c037040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:40.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.249+0000 7fe559ffb640 1 -- 172.21.15.5:0/2031381626 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fe550056c40 con 0x7fe55c0fdd10 2024-04-16T14:46:40.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:40 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/474958623' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-16T14:46:40.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:40 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/4165151828' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-16T14:46:40.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:40 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/2748606922' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-16T14:46:40.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:40 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/1189327775' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-16T14:46:40.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.475+0000 7fe56399d640 1 -- 172.21.15.5:0/2031381626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7fe55c109560 con 0x7fe55c0fdd10 2024-04-16T14:46:40.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:40 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/474958623' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-16T14:46:40.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:40 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/4165151828' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-16T14:46:40.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:40 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/2748606922' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-16T14:46:40.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:40 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/1189327775' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-16T14:46:40.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.476+0000 7fe559ffb640 1 -- 172.21.15.5:0/2031381626 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v44) v1 ==== 107+0+4867 (secure 0 0 0) 0x7fe55005a300 con 0x7fe55c0fdd10 2024-04-16T14:46:40.475 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:40.475 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14492,"name":"cephfs.smithi005.vzoqdl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6827/187766809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":187766809},{"type":"v1","addr":"172.21.15.5:6827","nonce":187766809}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24275,"name":"cephfs.smithi115.trkaqh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.115:6827/2476249308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2476249308},{"type":"v1","addr":"172.21.15.115:6827","nonce":2476249308}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T14:32:45.270024+0000","modified":"2024-04-16T14:35:01.805796+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14484,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi005.wofqlz","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.5:6829/402035291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":402035291},{"type":"v1","addr":"172.21.15.5:6829","nonce":402035291}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi115.byfytg","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6825/1662994117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1662994117},{"type":"v1","addr":"172.21.15.115:6825","nonce":1662994117}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-16T14:46:40.475 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 19 2024-04-16T14:46:40.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.478+0000 7fe56399d640 1 -- 172.21.15.5:0/2031381626 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe54406e0b0 msgr2=0x7fe544070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:40.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.478+0000 7fe56399d640 1 --2- 172.21.15.5:0/2031381626 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe54406e0b0 0x7fe544070560 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe54c009c20 tx=0x7fe54c037040 comp rx=0 tx=0).stop 2024-04-16T14:46:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.478+0000 7fe56399d640 1 -- 172.21.15.5:0/2031381626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe55c0fdd10 msgr2=0x7fe55c1134a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.478+0000 7fe56399d640 1 --2- 172.21.15.5:0/2031381626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe55c0fdd10 0x7fe55c1134a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe55000eb70 tx=0x7fe55000b040 comp rx=0 tx=0).stop 2024-04-16T14:46:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.478+0000 7fe56399d640 1 -- 172.21.15.5:0/2031381626 shutdown_connections 2024-04-16T14:46:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.478+0000 7fe56399d640 1 --2- 172.21.15.5:0/2031381626 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe54406e0b0 0x7fe544070560 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.478+0000 7fe56399d640 1 --2- 172.21.15.5:0/2031381626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe55c0fdd10 0x7fe55c1134a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.478+0000 7fe56399d640 1 --2- 172.21.15.5:0/2031381626 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe55c0fd400 0x7fe55c112f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.478+0000 7fe56399d640 1 -- 172.21.15.5:0/2031381626 >> 172.21.15.5:0/2031381626 conn(0x7fe55c0f6eb0 msgr2=0x7fe55c0f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.478+0000 7fe56399d640 1 -- 172.21.15.5:0/2031381626 shutdown_connections 2024-04-16T14:46:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.478+0000 7fe56399d640 1 -- 172.21.15.5:0/2031381626 wait complete. 2024-04-16T14:46:40.487 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-04-16T14:46:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.592+0000 7f02bff5d640 1 -- 172.21.15.5:0/3006761944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02b8101100 msgr2=0x7f02b81014d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.592+0000 7f02bff5d640 1 --2- 172.21.15.5:0/3006761944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02b8101100 0x7f02b81014d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f02b40048d0 tx=0x7f02b4009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.592+0000 7f02bff5d640 1 -- 172.21.15.5:0/3006761944 shutdown_connections 2024-04-16T14:46:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.592+0000 7f02bff5d640 1 --2- 172.21.15.5:0/3006761944 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02b8101aa0 0x7f02b80fb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.592+0000 7f02bff5d640 1 --2- 172.21.15.5:0/3006761944 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02b8101100 0x7f02b81014d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.592+0000 7f02bff5d640 1 -- 172.21.15.5:0/3006761944 >> 172.21.15.5:0/3006761944 conn(0x7f02b80f6cd0 msgr2=0x7f02b80f90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.592+0000 7f02bff5d640 1 -- 172.21.15.5:0/3006761944 shutdown_connections 2024-04-16T14:46:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.592+0000 7f02bff5d640 1 -- 172.21.15.5:0/3006761944 wait complete. 2024-04-16T14:46:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.592+0000 7f02bff5d640 1 Processor -- start 2024-04-16T14:46:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.592+0000 7f02bff5d640 1 -- start start 2024-04-16T14:46:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.593+0000 7f02bff5d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02b8101100 0x7f02b8111ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.593+0000 7f02bff5d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02b8101aa0 0x7f02b8112220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.593+0000 7f02bff5d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b81128b0 con 0x7f02b8101aa0 2024-04-16T14:46:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.593+0000 7f02bff5d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b810be70 con 0x7f02b8101100 2024-04-16T14:46:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.593+0000 7f02bd4f8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02b8101aa0 0x7f02b8112220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.593+0000 7f02bd4f8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02b8101aa0 0x7f02b8112220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53664/0 (socket says 172.21.15.5:53664) 2024-04-16T14:46:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.593+0000 7f02bd4f8640 1 -- 172.21.15.5:0/366462077 learned_addr learned my addr 172.21.15.5:0/366462077 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.593+0000 7f02bdcf9640 1 --2- 172.21.15.5:0/366462077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02b8101100 0x7f02b8111ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.593+0000 7f02bd4f8640 1 -- 172.21.15.5:0/366462077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02b8101100 msgr2=0x7f02b8111ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.593+0000 7f02bd4f8640 1 --2- 172.21.15.5:0/366462077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02b8101100 0x7f02b8111ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.593+0000 7f02bd4f8640 1 -- 172.21.15.5:0/366462077 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b4005040 con 0x7f02b8101aa0 2024-04-16T14:46:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.593+0000 7f02bd4f8640 1 --2- 172.21.15.5:0/366462077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02b8101aa0 0x7f02b8112220 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f02a800b790 tx=0x7f02a80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.593+0000 7f02ae7fc640 1 -- 172.21.15.5:0/366462077 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02a800c700 con 0x7f02b8101aa0 2024-04-16T14:46:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.593+0000 7f02ae7fc640 1 -- 172.21.15.5:0/366462077 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f02a800cd30 con 0x7f02b8101aa0 2024-04-16T14:46:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.593+0000 7f02bff5d640 1 -- 172.21.15.5:0/366462077 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b810c150 con 0x7f02b8101aa0 2024-04-16T14:46:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.593+0000 7f02ae7fc640 1 -- 172.21.15.5:0/366462077 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02a8013370 con 0x7f02b8101aa0 2024-04-16T14:46:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.593+0000 7f02bff5d640 1 -- 172.21.15.5:0/366462077 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b810c670 con 0x7f02b8101aa0 2024-04-16T14:46:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.594+0000 7f02bff5d640 1 -- 172.21.15.5:0/366462077 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b80fc870 con 0x7f02b8101aa0 2024-04-16T14:46:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.595+0000 7f02ae7fc640 1 -- 172.21.15.5:0/366462077 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f02a8012070 con 0x7f02b8101aa0 2024-04-16T14:46:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.595+0000 7f02ae7fc640 1 --2- 172.21.15.5:0/366462077 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f02a406e0b0 0x7f02a4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.596+0000 7f02ae7fc640 1 -- 172.21.15.5:0/366462077 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f02a808d820 con 0x7f02b8101aa0 2024-04-16T14:46:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.596+0000 7f02bdcf9640 1 --2- 172.21.15.5:0/366462077 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f02a406e0b0 0x7f02a4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:40.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.596+0000 7f02bdcf9640 1 --2- 172.21.15.5:0/366462077 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f02a406e0b0 0x7f02a4070560 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f02b4000c00 tx=0x7f02b4009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.600+0000 7f02ae7fc640 1 -- 172.21.15.5:0/366462077 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f02a8056af0 con 0x7f02b8101aa0 2024-04-16T14:46:40.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.822+0000 7f02bff5d640 1 -- 172.21.15.5:0/366462077 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f02b804bcc0 con 0x7f02b8101aa0 2024-04-16T14:46:40.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.822+0000 7f02ae7fc640 1 -- 172.21.15.5:0/366462077 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v44) v1 ==== 107+0+4868 (secure 0 0 0) 0x7f02a805a1b0 con 0x7f02b8101aa0 2024-04-16T14:46:40.821 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:40.821 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14492,"name":"cephfs.smithi005.vzoqdl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6827/187766809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":187766809},{"type":"v1","addr":"172.21.15.5:6827","nonce":187766809}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24275,"name":"cephfs.smithi115.trkaqh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.115:6827/2476249308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2476249308},{"type":"v1","addr":"172.21.15.115:6827","nonce":2476249308}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T14:32:45.270024+0000","modified":"2024-04-16T14:35:42.742829+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14484,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi005.wofqlz","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.5:6829/402035291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":402035291},{"type":"v1","addr":"172.21.15.5:6829","nonce":402035291}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi115.byfytg","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6825/1662994117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1662994117},{"type":"v1","addr":"172.21.15.115:6825","nonce":1662994117}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-16T14:46:40.821 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 20 2024-04-16T14:46:40.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.824+0000 7f02bff5d640 1 -- 172.21.15.5:0/366462077 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f02a406e0b0 msgr2=0x7f02a4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:40.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.824+0000 7f02bff5d640 1 --2- 172.21.15.5:0/366462077 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f02a406e0b0 0x7f02a4070560 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f02b4000c00 tx=0x7f02b4009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:40.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.824+0000 7f02bff5d640 1 -- 172.21.15.5:0/366462077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02b8101aa0 msgr2=0x7f02b8112220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:40.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.824+0000 7f02bff5d640 1 --2- 172.21.15.5:0/366462077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02b8101aa0 0x7f02b8112220 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f02a800b790 tx=0x7f02a80091d0 comp rx=0 tx=0).stop 2024-04-16T14:46:40.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.824+0000 7f02bff5d640 1 -- 172.21.15.5:0/366462077 shutdown_connections 2024-04-16T14:46:40.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.824+0000 7f02bff5d640 1 --2- 172.21.15.5:0/366462077 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f02a406e0b0 0x7f02a4070560 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:40.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.824+0000 7f02bff5d640 1 --2- 172.21.15.5:0/366462077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f02b8101aa0 0x7f02b8112220 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:40.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.824+0000 7f02bff5d640 1 --2- 172.21.15.5:0/366462077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02b8101100 0x7f02b8111ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:40.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.824+0000 7f02bff5d640 1 -- 172.21.15.5:0/366462077 >> 172.21.15.5:0/366462077 conn(0x7f02b80f6cd0 msgr2=0x7f02b80f7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:40.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.824+0000 7f02bff5d640 1 -- 172.21.15.5:0/366462077 shutdown_connections 2024-04-16T14:46:40.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.824+0000 7f02bff5d640 1 -- 172.21.15.5:0/366462077 wait complete. 2024-04-16T14:46:40.834 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-04-16T14:46:40.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.940+0000 7fecd7b9d640 1 -- 172.21.15.5:0/974759877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecd0101c80 msgr2=0x7fecd00fb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:40.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.940+0000 7fecd7b9d640 1 --2- 172.21.15.5:0/974759877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecd0101c80 0x7fecd00fb310 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fecc00048d0 tx=0x7fecc0009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:40.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.940+0000 7fecd7b9d640 1 -- 172.21.15.5:0/974759877 shutdown_connections 2024-04-16T14:46:40.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.940+0000 7fecd7b9d640 1 --2- 172.21.15.5:0/974759877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecd0101c80 0x7fecd00fb310 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:40.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.940+0000 7fecd7b9d640 1 --2- 172.21.15.5:0/974759877 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecd01012e0 0x7fecd01016b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:40.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.940+0000 7fecd7b9d640 1 -- 172.21.15.5:0/974759877 >> 172.21.15.5:0/974759877 conn(0x7fecd00f6eb0 msgr2=0x7fecd00f92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:40.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.940+0000 7fecd7b9d640 1 -- 172.21.15.5:0/974759877 shutdown_connections 2024-04-16T14:46:40.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.940+0000 7fecd7b9d640 1 -- 172.21.15.5:0/974759877 wait complete. 2024-04-16T14:46:40.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.940+0000 7fecd7b9d640 1 Processor -- start 2024-04-16T14:46:40.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.940+0000 7fecd7b9d640 1 -- start start 2024-04-16T14:46:40.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.941+0000 7fecd7b9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecd01012e0 0x7fecd010e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:40.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.941+0000 7fecd7b9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecd0101c80 0x7fecd010e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:40.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.941+0000 7fecd7b9d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd010ebb0 con 0x7fecd0101c80 2024-04-16T14:46:40.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.941+0000 7fecd7b9d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd010ed20 con 0x7fecd01012e0 2024-04-16T14:46:40.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.941+0000 7fecd5138640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecd0101c80 0x7fecd010e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:40.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.941+0000 7fecd5138640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecd0101c80 0x7fecd010e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53682/0 (socket says 172.21.15.5:53682) 2024-04-16T14:46:40.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.941+0000 7fecd5138640 1 -- 172.21.15.5:0/740670226 learned_addr learned my addr 172.21.15.5:0/740670226 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:40.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.941+0000 7fecd5138640 1 -- 172.21.15.5:0/740670226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecd01012e0 msgr2=0x7fecd010e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:40.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.941+0000 7fecd5138640 1 --2- 172.21.15.5:0/740670226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecd01012e0 0x7fecd010e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:40.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.941+0000 7fecd5138640 1 -- 172.21.15.5:0/740670226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc0005040 con 0x7fecd0101c80 2024-04-16T14:46:40.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.941+0000 7fecd5138640 1 --2- 172.21.15.5:0/740670226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecd0101c80 0x7fecd010e670 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fecc0004930 tx=0x7fecc0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:40.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.941+0000 7fecc67fc640 1 -- 172.21.15.5:0/740670226 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecc00094c0 con 0x7fecd0101c80 2024-04-16T14:46:40.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.941+0000 7fecc67fc640 1 -- 172.21.15.5:0/740670226 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fecc0032e50 con 0x7fecd0101c80 2024-04-16T14:46:40.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.941+0000 7fecd7b9d640 1 -- 172.21.15.5:0/740670226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd010efa0 con 0x7fecd0101c80 2024-04-16T14:46:40.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.941+0000 7fecc67fc640 1 -- 172.21.15.5:0/740670226 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecc00433b0 con 0x7fecd0101c80 2024-04-16T14:46:40.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.941+0000 7fecd7b9d640 1 -- 172.21.15.5:0/740670226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd01173f0 con 0x7fecd0101c80 2024-04-16T14:46:40.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.942+0000 7fecd7b9d640 1 -- 172.21.15.5:0/740670226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd00fca50 con 0x7fecd0101c80 2024-04-16T14:46:40.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.943+0000 7fecc67fc640 1 -- 172.21.15.5:0/740670226 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fecc002f070 con 0x7fecd0101c80 2024-04-16T14:46:40.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.943+0000 7fecc67fc640 1 --2- 172.21.15.5:0/740670226 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fecbc06e0b0 0x7fecbc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:40.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.943+0000 7fecc67fc640 1 -- 172.21.15.5:0/740670226 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fecc00afa30 con 0x7fecd0101c80 2024-04-16T14:46:40.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.943+0000 7fecd5939640 1 --2- 172.21.15.5:0/740670226 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fecbc06e0b0 0x7fecbc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:40.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.944+0000 7fecd5939640 1 --2- 172.21.15.5:0/740670226 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fecbc06e0b0 0x7fecbc070560 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7feccc0097e0 tx=0x7feccc006d20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:40.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:40.948+0000 7fecc67fc640 1 -- 172.21.15.5:0/740670226 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fecc0078d00 con 0x7fecd0101c80 2024-04-16T14:46:41.150 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:41 smithi005 ceph-mon[93420]: pgmap v316: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:41.150 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:41 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/2031381626' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-16T14:46:41.150 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:41 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/366462077' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-16T14:46:41.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.173+0000 7fecd7b9d640 1 -- 172.21.15.5:0/740670226 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7fecd010efa0 con 0x7fecd0101c80 2024-04-16T14:46:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.174+0000 7fecc67fc640 1 -- 172.21.15.5:0/740670226 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v44) v1 ==== 107+0+4882 (secure 0 0 0) 0x7fecd010efa0 con 0x7fecd0101c80 2024-04-16T14:46:41.172 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:41.172 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14492,"name":"cephfs.smithi005.vzoqdl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6827/187766809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":187766809},{"type":"v1","addr":"172.21.15.5:6827","nonce":187766809}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24275,"name":"cephfs.smithi115.trkaqh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.115:6827/2476249308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2476249308},{"type":"v1","addr":"172.21.15.115:6827","nonce":2476249308}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T14:32:45.270024+0000","modified":"2024-04-16T14:39:37.155127+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14484,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi005.wofqlz","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.5:6829/402035291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":402035291},{"type":"v1","addr":"172.21.15.5:6829","nonce":402035291}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi115.byfytg","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6825/1662994117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1662994117},{"type":"v1","addr":"172.21.15.115:6825","nonce":1662994117}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14484,"qdb_cluster":[14484,24269]},"id":1}]} 2024-04-16T14:46:41.172 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 21 2024-04-16T14:46:41.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.176+0000 7fecd7b9d640 1 -- 172.21.15.5:0/740670226 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fecbc06e0b0 msgr2=0x7fecbc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.176+0000 7fecd7b9d640 1 --2- 172.21.15.5:0/740670226 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fecbc06e0b0 0x7fecbc070560 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7feccc0097e0 tx=0x7feccc006d20 comp rx=0 tx=0).stop 2024-04-16T14:46:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.176+0000 7fecd7b9d640 1 -- 172.21.15.5:0/740670226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecd0101c80 msgr2=0x7fecd010e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.176+0000 7fecd7b9d640 1 --2- 172.21.15.5:0/740670226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecd0101c80 0x7fecd010e670 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fecc0004930 tx=0x7fecc0009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.176+0000 7fecd7b9d640 1 -- 172.21.15.5:0/740670226 shutdown_connections 2024-04-16T14:46:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.176+0000 7fecd7b9d640 1 --2- 172.21.15.5:0/740670226 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fecbc06e0b0 0x7fecbc070560 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.176+0000 7fecd7b9d640 1 --2- 172.21.15.5:0/740670226 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecd0101c80 0x7fecd010e670 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.176+0000 7fecd7b9d640 1 --2- 172.21.15.5:0/740670226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecd01012e0 0x7fecd010e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.176+0000 7fecd7b9d640 1 -- 172.21.15.5:0/740670226 >> 172.21.15.5:0/740670226 conn(0x7fecd00f6eb0 msgr2=0x7fecd00f7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.176+0000 7fecd7b9d640 1 -- 172.21.15.5:0/740670226 shutdown_connections 2024-04-16T14:46:41.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.176+0000 7fecd7b9d640 1 -- 172.21.15.5:0/740670226 wait complete. 2024-04-16T14:46:41.185 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-04-16T14:46:41.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.290+0000 7ff98eeae640 1 -- 172.21.15.5:0/593568091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9880fd200 msgr2=0x7ff9880fd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:41.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.290+0000 7ff98eeae640 1 --2- 172.21.15.5:0/593568091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9880fd200 0x7ff9880fd5d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff984009c80 tx=0x7ff984004d10 comp rx=0 tx=0).stop 2024-04-16T14:46:41.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.290+0000 7ff98eeae640 1 -- 172.21.15.5:0/593568091 shutdown_connections 2024-04-16T14:46:41.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.290+0000 7ff98eeae640 1 --2- 172.21.15.5:0/593568091 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9880fdba0 0x7ff988106270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:41.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.290+0000 7ff98eeae640 1 --2- 172.21.15.5:0/593568091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9880fd200 0x7ff9880fd5d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:41.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.290+0000 7ff98eeae640 1 -- 172.21.15.5:0/593568091 >> 172.21.15.5:0/593568091 conn(0x7ff9880f6cc0 msgr2=0x7ff9880f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:41.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.290+0000 7ff98eeae640 1 -- 172.21.15.5:0/593568091 shutdown_connections 2024-04-16T14:46:41.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.290+0000 7ff98eeae640 1 -- 172.21.15.5:0/593568091 wait complete. 2024-04-16T14:46:41.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.291+0000 7ff98eeae640 1 Processor -- start 2024-04-16T14:46:41.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.291+0000 7ff98eeae640 1 -- start start 2024-04-16T14:46:41.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.291+0000 7ff98eeae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9880fd200 0x7ff988112df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:41.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.291+0000 7ff98eeae640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9880fdba0 0x7ff988113330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:41.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.291+0000 7ff98eeae640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9881139c0 con 0x7ff9880fd200 2024-04-16T14:46:41.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.291+0000 7ff98eeae640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98810cf80 con 0x7ff9880fdba0 2024-04-16T14:46:41.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.291+0000 7ff98cc4a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9880fd200 0x7ff988112df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:41.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.291+0000 7ff98cc4a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9880fd200 0x7ff988112df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53696/0 (socket says 172.21.15.5:53696) 2024-04-16T14:46:41.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.291+0000 7ff98cc4a640 1 -- 172.21.15.5:0/286764570 learned_addr learned my addr 172.21.15.5:0/286764570 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:41.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.292+0000 7ff97ffff640 1 --2- 172.21.15.5:0/286764570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9880fdba0 0x7ff988113330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:41.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.292+0000 7ff98cc4a640 1 -- 172.21.15.5:0/286764570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9880fdba0 msgr2=0x7ff988113330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:41.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.292+0000 7ff98cc4a640 1 --2- 172.21.15.5:0/286764570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9880fdba0 0x7ff988113330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:41.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.292+0000 7ff98cc4a640 1 -- 172.21.15.5:0/286764570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9840098b0 con 0x7ff9880fd200 2024-04-16T14:46:41.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.292+0000 7ff97ffff640 1 --2- 172.21.15.5:0/286764570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9880fdba0 0x7ff988113330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:46:41.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.292+0000 7ff98cc4a640 1 --2- 172.21.15.5:0/286764570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9880fd200 0x7ff988112df0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff984003400 tx=0x7ff984004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:41.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.292+0000 7ff97d7fa640 1 -- 172.21.15.5:0/286764570 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff98403a070 con 0x7ff9880fd200 2024-04-16T14:46:41.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.292+0000 7ff97d7fa640 1 -- 172.21.15.5:0/286764570 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff984035b20 con 0x7ff9880fd200 2024-04-16T14:46:41.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.292+0000 7ff98eeae640 1 -- 172.21.15.5:0/286764570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff98810d200 con 0x7ff9880fd200 2024-04-16T14:46:41.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.292+0000 7ff97d7fa640 1 -- 172.21.15.5:0/286764570 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff98403eab0 con 0x7ff9880fd200 2024-04-16T14:46:41.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.292+0000 7ff98eeae640 1 -- 172.21.15.5:0/286764570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff98810d6c0 con 0x7ff9880fd200 2024-04-16T14:46:41.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.293+0000 7ff98eeae640 1 -- 172.21.15.5:0/286764570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff988065de0 con 0x7ff9880fd200 2024-04-16T14:46:41.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.293+0000 7ff97d7fa640 1 -- 172.21.15.5:0/286764570 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7ff984032070 con 0x7ff9880fd200 2024-04-16T14:46:41.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.294+0000 7ff97d7fa640 1 --2- 172.21.15.5:0/286764570 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff97006e0b0 0x7ff970070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:41.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.294+0000 7ff97d7fa640 1 -- 172.21.15.5:0/286764570 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7ff9840afe10 con 0x7ff9880fd200 2024-04-16T14:46:41.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.294+0000 7ff97ffff640 1 --2- 172.21.15.5:0/286764570 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff97006e0b0 0x7ff970070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:41.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.294+0000 7ff97ffff640 1 --2- 172.21.15.5:0/286764570 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff97006e0b0 0x7ff970070560 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff978006fd0 tx=0x7ff978008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:41.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.299+0000 7ff97d7fa640 1 -- 172.21.15.5:0/286764570 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7ff984079200 con 0x7ff9880fd200 2024-04-16T14:46:41.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:41 smithi115 ceph-mon[83414]: pgmap v316: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:41.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:41 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/2031381626' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-16T14:46:41.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:41 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/366462077' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-16T14:46:41.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.525+0000 7ff98eeae640 1 -- 172.21.15.5:0/286764570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7ff98810d990 con 0x7ff9880fd200 2024-04-16T14:46:41.524 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.526+0000 7ff97d7fa640 1 -- 172.21.15.5:0/286764570 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v44) v1 ==== 107+0+4881 (secure 0 0 0) 0x7ff98407c8c0 con 0x7ff9880fd200 2024-04-16T14:46:41.524 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:41.524 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14492,"name":"cephfs.smithi005.vzoqdl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6827/187766809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":187766809},{"type":"v1","addr":"172.21.15.5:6827","nonce":187766809}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24275,"name":"cephfs.smithi115.trkaqh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.115:6827/2476249308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2476249308},{"type":"v1","addr":"172.21.15.115:6827","nonce":2476249308}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T14:32:45.270024+0000","modified":"2024-04-16T14:39:57.598894+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14484,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi005.wofqlz","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.5:6829/402035291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":402035291},{"type":"v1","addr":"172.21.15.5:6829","nonce":402035291}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi115.byfytg","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6825/1662994117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1662994117},{"type":"v1","addr":"172.21.15.115:6825","nonce":1662994117}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14484,"qdb_cluster":[24269,14484]},"id":1}]} 2024-04-16T14:46:41.525 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 22 2024-04-16T14:46:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.528+0000 7ff98eeae640 1 -- 172.21.15.5:0/286764570 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff97006e0b0 msgr2=0x7ff970070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.528+0000 7ff98eeae640 1 --2- 172.21.15.5:0/286764570 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff97006e0b0 0x7ff970070560 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff978006fd0 tx=0x7ff978008040 comp rx=0 tx=0).stop 2024-04-16T14:46:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.528+0000 7ff98eeae640 1 -- 172.21.15.5:0/286764570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9880fd200 msgr2=0x7ff988112df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.528+0000 7ff98eeae640 1 --2- 172.21.15.5:0/286764570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9880fd200 0x7ff988112df0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff984003400 tx=0x7ff984004d10 comp rx=0 tx=0).stop 2024-04-16T14:46:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.528+0000 7ff98eeae640 1 -- 172.21.15.5:0/286764570 shutdown_connections 2024-04-16T14:46:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.528+0000 7ff98eeae640 1 --2- 172.21.15.5:0/286764570 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff97006e0b0 0x7ff970070560 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.528+0000 7ff98eeae640 1 --2- 172.21.15.5:0/286764570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9880fdba0 0x7ff988113330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.528+0000 7ff98eeae640 1 --2- 172.21.15.5:0/286764570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff9880fd200 0x7ff988112df0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.528+0000 7ff98eeae640 1 -- 172.21.15.5:0/286764570 >> 172.21.15.5:0/286764570 conn(0x7ff9880f6cc0 msgr2=0x7ff988105550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.528+0000 7ff98eeae640 1 -- 172.21.15.5:0/286764570 shutdown_connections 2024-04-16T14:46:41.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.528+0000 7ff98eeae640 1 -- 172.21.15.5:0/286764570 wait complete. 2024-04-16T14:46:41.537 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-04-16T14:46:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.640+0000 7f794c02e640 1 -- 172.21.15.5:0/3172661753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79441012e0 msgr2=0x7f79441016b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.640+0000 7f794c02e640 1 --2- 172.21.15.5:0/3172661753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79441012e0 0x7f79441016b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f79400048d0 tx=0x7f7940009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.641+0000 7f794c02e640 1 -- 172.21.15.5:0/3172661753 shutdown_connections 2024-04-16T14:46:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.641+0000 7f794c02e640 1 --2- 172.21.15.5:0/3172661753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7944101c80 0x7f79440fb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.641+0000 7f794c02e640 1 --2- 172.21.15.5:0/3172661753 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79441012e0 0x7f79441016b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.641+0000 7f794c02e640 1 -- 172.21.15.5:0/3172661753 >> 172.21.15.5:0/3172661753 conn(0x7f79440f6eb0 msgr2=0x7f79440f92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.641+0000 7f794c02e640 1 -- 172.21.15.5:0/3172661753 shutdown_connections 2024-04-16T14:46:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.641+0000 7f794c02e640 1 -- 172.21.15.5:0/3172661753 wait complete. 2024-04-16T14:46:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.641+0000 7f794c02e640 1 Processor -- start 2024-04-16T14:46:41.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.641+0000 7f794c02e640 1 -- start start 2024-04-16T14:46:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.641+0000 7f794c02e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79441012e0 0x7f7944112ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.641+0000 7f794c02e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7944101c80 0x7f7944113410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.641+0000 7f794c02e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7944113a10 con 0x7f79441012e0 2024-04-16T14:46:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.641+0000 7f794c02e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794410d060 con 0x7f7944101c80 2024-04-16T14:46:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.642+0000 7f7949dca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79441012e0 0x7f7944112ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.642+0000 7f7949dca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79441012e0 0x7f7944112ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53720/0 (socket says 172.21.15.5:53720) 2024-04-16T14:46:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.642+0000 7f7949dca640 1 -- 172.21.15.5:0/1674533409 learned_addr learned my addr 172.21.15.5:0/1674533409 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.642+0000 7f79495c9640 1 --2- 172.21.15.5:0/1674533409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7944101c80 0x7f7944113410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.642+0000 7f7949dca640 1 -- 172.21.15.5:0/1674533409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7944101c80 msgr2=0x7f7944113410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.642+0000 7f7949dca640 1 --2- 172.21.15.5:0/1674533409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7944101c80 0x7f7944113410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.642+0000 7f7949dca640 1 -- 172.21.15.5:0/1674533409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7940005040 con 0x7f79441012e0 2024-04-16T14:46:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.642+0000 7f79495c9640 1 --2- 172.21.15.5:0/1674533409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7944101c80 0x7f7944113410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:46:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.642+0000 7f7949dca640 1 --2- 172.21.15.5:0/1674533409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79441012e0 0x7f7944112ed0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7940004930 tx=0x7f7940009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:41.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.642+0000 7f793a7fc640 1 -- 172.21.15.5:0/1674533409 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79400094c0 con 0x7f79441012e0 2024-04-16T14:46:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.642+0000 7f794c02e640 1 -- 172.21.15.5:0/1674533409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f794410d2e0 con 0x7f79441012e0 2024-04-16T14:46:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.642+0000 7f793a7fc640 1 -- 172.21.15.5:0/1674533409 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7940032e50 con 0x7f79441012e0 2024-04-16T14:46:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.642+0000 7f793a7fc640 1 -- 172.21.15.5:0/1674533409 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79400433b0 con 0x7f79441012e0 2024-04-16T14:46:41.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.642+0000 7f794c02e640 1 -- 172.21.15.5:0/1674533409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f794410d7a0 con 0x7f79441012e0 2024-04-16T14:46:41.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.643+0000 7f794c02e640 1 -- 172.21.15.5:0/1674533409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79440fca50 con 0x7f79441012e0 2024-04-16T14:46:41.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.644+0000 7f793a7fc640 1 -- 172.21.15.5:0/1674533409 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f794002f070 con 0x7f79441012e0 2024-04-16T14:46:41.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.644+0000 7f793a7fc640 1 --2- 172.21.15.5:0/1674533409 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f793006e0b0 0x7f7930070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:41.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.644+0000 7f793a7fc640 1 -- 172.21.15.5:0/1674533409 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f79400afbf0 con 0x7f79441012e0 2024-04-16T14:46:41.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.644+0000 7f79495c9640 1 --2- 172.21.15.5:0/1674533409 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f793006e0b0 0x7f7930070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:41.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.645+0000 7f79495c9640 1 --2- 172.21.15.5:0/1674533409 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f793006e0b0 0x7f7930070560 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f794410e790 tx=0x7f7934009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:41.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.649+0000 7f793a7fc640 1 -- 172.21.15.5:0/1674533409 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f7940078ec0 con 0x7f79441012e0 2024-04-16T14:46:41.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.872+0000 7f794c02e640 1 -- 172.21.15.5:0/1674533409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f794404bcc0 con 0x7f79441012e0 2024-04-16T14:46:41.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.873+0000 7f793a7fc640 1 -- 172.21.15.5:0/1674533409 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v44) v1 ==== 107+0+4881 (secure 0 0 0) 0x7f794007c580 con 0x7f79441012e0 2024-04-16T14:46:41.871 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:41.871 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14492,"name":"cephfs.smithi005.vzoqdl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6827/187766809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":187766809},{"type":"v1","addr":"172.21.15.5:6827","nonce":187766809}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24275,"name":"cephfs.smithi115.trkaqh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.115:6827/2476249308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2476249308},{"type":"v1","addr":"172.21.15.115:6827","nonce":2476249308}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T14:32:45.270024+0000","modified":"2024-04-16T14:41:46.898157+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14484,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi005.wofqlz","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.5:6829/402035291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":402035291},{"type":"v1","addr":"172.21.15.5:6829","nonce":402035291}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi115.byfytg","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6825/1662994117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1662994117},{"type":"v1","addr":"172.21.15.115:6825","nonce":1662994117}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14484,"qdb_cluster":[14484,24269]},"id":1}]} 2024-04-16T14:46:41.871 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 23 2024-04-16T14:46:41.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.874+0000 7f794c02e640 1 -- 172.21.15.5:0/1674533409 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f793006e0b0 msgr2=0x7f7930070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:41.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.874+0000 7f794c02e640 1 --2- 172.21.15.5:0/1674533409 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f793006e0b0 0x7f7930070560 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f794410e790 tx=0x7f7934009040 comp rx=0 tx=0).stop 2024-04-16T14:46:41.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.874+0000 7f794c02e640 1 -- 172.21.15.5:0/1674533409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79441012e0 msgr2=0x7f7944112ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:41.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.874+0000 7f794c02e640 1 --2- 172.21.15.5:0/1674533409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79441012e0 0x7f7944112ed0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7940004930 tx=0x7f7940009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:41.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.875+0000 7f794c02e640 1 -- 172.21.15.5:0/1674533409 shutdown_connections 2024-04-16T14:46:41.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.875+0000 7f794c02e640 1 --2- 172.21.15.5:0/1674533409 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f793006e0b0 0x7f7930070560 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:41.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.875+0000 7f794c02e640 1 --2- 172.21.15.5:0/1674533409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7944101c80 0x7f7944113410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:41.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.875+0000 7f794c02e640 1 --2- 172.21.15.5:0/1674533409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79441012e0 0x7f7944112ed0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:41.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.875+0000 7f794c02e640 1 -- 172.21.15.5:0/1674533409 >> 172.21.15.5:0/1674533409 conn(0x7f79440f6eb0 msgr2=0x7f79440f8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:41.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.875+0000 7f794c02e640 1 -- 172.21.15.5:0/1674533409 shutdown_connections 2024-04-16T14:46:41.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.875+0000 7f794c02e640 1 -- 172.21.15.5:0/1674533409 wait complete. 2024-04-16T14:46:41.884 DEBUG:tasks.fs:max_mds reduced in epoch 23 2024-04-16T14:46:41.884 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-04-16T14:46:41.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.988+0000 7f20ad39d640 1 -- 172.21.15.5:0/869021223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20a8102da0 msgr2=0x7f20a80fc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:41.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.988+0000 7f20ad39d640 1 --2- 172.21.15.5:0/869021223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20a8102da0 0x7f20a80fc430 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f20900048d0 tx=0x7f2090009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:41.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.988+0000 7f20ad39d640 1 -- 172.21.15.5:0/869021223 shutdown_connections 2024-04-16T14:46:41.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.988+0000 7f20ad39d640 1 --2- 172.21.15.5:0/869021223 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20a8102da0 0x7f20a80fc430 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:41.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.988+0000 7f20ad39d640 1 --2- 172.21.15.5:0/869021223 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20a8102400 0x7f20a81027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:41.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.988+0000 7f20ad39d640 1 -- 172.21.15.5:0/869021223 >> 172.21.15.5:0/869021223 conn(0x7f20a80f7fb0 msgr2=0x7f20a80fa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:41.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.988+0000 7f20ad39d640 1 -- 172.21.15.5:0/869021223 shutdown_connections 2024-04-16T14:46:41.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.988+0000 7f20ad39d640 1 -- 172.21.15.5:0/869021223 wait complete. 2024-04-16T14:46:41.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.988+0000 7f20ad39d640 1 Processor -- start 2024-04-16T14:46:41.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.989+0000 7f20ad39d640 1 -- start start 2024-04-16T14:46:41.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.989+0000 7f20ad39d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20a8102400 0x7f20a8112fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:41.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.989+0000 7f20ad39d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20a8102da0 0x7f20a81134f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:41.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.989+0000 7f20ad39d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a8113b80 con 0x7f20a8102da0 2024-04-16T14:46:41.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.989+0000 7f20ad39d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a810d140 con 0x7f20a8102400 2024-04-16T14:46:41.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.989+0000 7f209e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20a8102da0 0x7f20a81134f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:41.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.989+0000 7f209e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20a8102da0 0x7f20a81134f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53734/0 (socket says 172.21.15.5:53734) 2024-04-16T14:46:41.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.989+0000 7f209e7fc640 1 -- 172.21.15.5:0/2955726982 learned_addr learned my addr 172.21.15.5:0/2955726982 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:41.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.989+0000 7f20a6ffd640 1 --2- 172.21.15.5:0/2955726982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20a8102400 0x7f20a8112fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:41.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.989+0000 7f209e7fc640 1 -- 172.21.15.5:0/2955726982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20a8102400 msgr2=0x7f20a8112fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:41.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.989+0000 7f209e7fc640 1 --2- 172.21.15.5:0/2955726982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20a8102400 0x7f20a8112fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:41.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.989+0000 7f209e7fc640 1 -- 172.21.15.5:0/2955726982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2090005040 con 0x7f20a8102da0 2024-04-16T14:46:41.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.989+0000 7f209e7fc640 1 --2- 172.21.15.5:0/2955726982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20a8102da0 0x7f20a81134f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2090004930 tx=0x7f2090009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:41.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.990+0000 7f209ffff640 1 -- 172.21.15.5:0/2955726982 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20900094c0 con 0x7f20a8102da0 2024-04-16T14:46:41.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.990+0000 7f209ffff640 1 -- 172.21.15.5:0/2955726982 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2090032e50 con 0x7f20a8102da0 2024-04-16T14:46:41.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.990+0000 7f20ad39d640 1 -- 172.21.15.5:0/2955726982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a810d3c0 con 0x7f20a8102da0 2024-04-16T14:46:41.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.990+0000 7f209ffff640 1 -- 172.21.15.5:0/2955726982 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20900433b0 con 0x7f20a8102da0 2024-04-16T14:46:41.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.990+0000 7f20ad39d640 1 -- 172.21.15.5:0/2955726982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a810d880 con 0x7f20a8102da0 2024-04-16T14:46:41.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.991+0000 7f20ad39d640 1 -- 172.21.15.5:0/2955726982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a80fdb70 con 0x7f20a8102da0 2024-04-16T14:46:41.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.991+0000 7f209ffff640 1 -- 172.21.15.5:0/2955726982 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f209002f070 con 0x7f20a8102da0 2024-04-16T14:46:41.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.992+0000 7f209ffff640 1 --2- 172.21.15.5:0/2955726982 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f209406e0b0 0x7f2094070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:41.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.992+0000 7f20a6ffd640 1 --2- 172.21.15.5:0/2955726982 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f209406e0b0 0x7f2094070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:41.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.992+0000 7f209ffff640 1 -- 172.21.15.5:0/2955726982 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f20900afac0 con 0x7f20a8102da0 2024-04-16T14:46:41.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.992+0000 7f20a6ffd640 1 --2- 172.21.15.5:0/2955726982 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f209406e0b0 0x7f2094070560 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f209800a900 tx=0x7f2098008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:41.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:41.997+0000 7f209ffff640 1 -- 172.21.15.5:0/2955726982 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f2090078d90 con 0x7f20a8102da0 2024-04-16T14:46:42.220 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.222+0000 7f20ad39d640 1 -- 172.21.15.5:0/2955726982 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f20a8109620 con 0x7f20a8102da0 2024-04-16T14:46:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.222+0000 7f209ffff640 1 -- 172.21.15.5:0/2955726982 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v44) v1 ==== 107+0+4877 (secure 0 0 0) 0x7f209007c450 con 0x7f20a8102da0 2024-04-16T14:46:42.221 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:42.221 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14492,"name":"cephfs.smithi005.vzoqdl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6827/187766809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":187766809},{"type":"v1","addr":"172.21.15.5:6827","nonce":187766809}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24275,"name":"cephfs.smithi115.trkaqh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.115:6827/2476249308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2476249308},{"type":"v1","addr":"172.21.15.115:6827","nonce":2476249308}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T14:32:45.270024+0000","modified":"2024-04-16T14:41:47.899227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14484,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi005.wofqlz","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.5:6829/402035291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":402035291},{"type":"v1","addr":"172.21.15.5:6829","nonce":402035291}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi115.byfytg","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.115:6825/1662994117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1662994117},{"type":"v1","addr":"172.21.15.115:6825","nonce":1662994117}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14484,"qdb_cluster":[14484]},"id":1}]} 2024-04-16T14:46:42.221 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2024-04-16T14:46:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.224+0000 7f20ad39d640 1 -- 172.21.15.5:0/2955726982 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f209406e0b0 msgr2=0x7f2094070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.224+0000 7f20ad39d640 1 --2- 172.21.15.5:0/2955726982 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f209406e0b0 0x7f2094070560 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f209800a900 tx=0x7f2098008040 comp rx=0 tx=0).stop 2024-04-16T14:46:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.224+0000 7f20ad39d640 1 -- 172.21.15.5:0/2955726982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20a8102da0 msgr2=0x7f20a81134f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.224+0000 7f20ad39d640 1 --2- 172.21.15.5:0/2955726982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20a8102da0 0x7f20a81134f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2090004930 tx=0x7f2090009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.224+0000 7f20ad39d640 1 -- 172.21.15.5:0/2955726982 shutdown_connections 2024-04-16T14:46:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.224+0000 7f20ad39d640 1 --2- 172.21.15.5:0/2955726982 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f209406e0b0 0x7f2094070560 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.224+0000 7f20ad39d640 1 --2- 172.21.15.5:0/2955726982 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20a8102da0 0x7f20a81134f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.224+0000 7f20ad39d640 1 --2- 172.21.15.5:0/2955726982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20a8102400 0x7f20a8112fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:42.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.224+0000 7f20ad39d640 1 -- 172.21.15.5:0/2955726982 >> 172.21.15.5:0/2955726982 conn(0x7f20a80f7fb0 msgr2=0x7f20a80f8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:42.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.224+0000 7f20ad39d640 1 -- 172.21.15.5:0/2955726982 shutdown_connections 2024-04-16T14:46:42.224 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.224+0000 7f20ad39d640 1 -- 172.21.15.5:0/2955726982 wait complete. 2024-04-16T14:46:42.234 DEBUG:tasks.fs:max_mds reduced in epoch 24 2024-04-16T14:46:42.234 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-04-16T14:46:42.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.338+0000 7f470c22e640 1 -- 172.21.15.5:0/2167772382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4704102400 msgr2=0x7f47041027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:42.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.338+0000 7f470c22e640 1 --2- 172.21.15.5:0/2167772382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4704102400 0x7f47041027d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f47000048d0 tx=0x7f4700009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:42.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.338+0000 7f470c22e640 1 -- 172.21.15.5:0/2167772382 shutdown_connections 2024-04-16T14:46:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.338+0000 7f470c22e640 1 --2- 172.21.15.5:0/2167772382 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4704102da0 0x7f47040fc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.338+0000 7f470c22e640 1 --2- 172.21.15.5:0/2167772382 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4704102400 0x7f47041027d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.338+0000 7f470c22e640 1 -- 172.21.15.5:0/2167772382 >> 172.21.15.5:0/2167772382 conn(0x7f47040f7fb0 msgr2=0x7f47040fa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.338+0000 7f470c22e640 1 -- 172.21.15.5:0/2167772382 shutdown_connections 2024-04-16T14:46:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.338+0000 7f470c22e640 1 -- 172.21.15.5:0/2167772382 wait complete. 2024-04-16T14:46:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.338+0000 7f470c22e640 1 Processor -- start 2024-04-16T14:46:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.339+0000 7f470c22e640 1 -- start start 2024-04-16T14:46:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.339+0000 7f470c22e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4704102400 0x7f4704115190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.339+0000 7f470c22e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4704102da0 0x7f47041156d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.339+0000 7f470c22e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4704115cd0 con 0x7f4704102400 2024-04-16T14:46:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.339+0000 7f470c22e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4704115e40 con 0x7f4704102da0 2024-04-16T14:46:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.339+0000 7f4709fca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4704102400 0x7f4704115190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:42.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.339+0000 7f4709fca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4704102400 0x7f4704115190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53758/0 (socket says 172.21.15.5:53758) 2024-04-16T14:46:42.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.339+0000 7f4709fca640 1 -- 172.21.15.5:0/1268199530 learned_addr learned my addr 172.21.15.5:0/1268199530 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:42.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.339+0000 7f47097c9640 1 --2- 172.21.15.5:0/1268199530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4704102da0 0x7f47041156d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:42.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.339+0000 7f4709fca640 1 -- 172.21.15.5:0/1268199530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4704102da0 msgr2=0x7f47041156d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:42.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.339+0000 7f4709fca640 1 --2- 172.21.15.5:0/1268199530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4704102da0 0x7f47041156d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:42.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.339+0000 7f4709fca640 1 -- 172.21.15.5:0/1268199530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4700005040 con 0x7f4704102400 2024-04-16T14:46:42.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.339+0000 7f4709fca640 1 --2- 172.21.15.5:0/1268199530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4704102400 0x7f4704115190 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f47000047f0 tx=0x7f4700009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:42.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.340+0000 7f46fa7fc640 1 -- 172.21.15.5:0/1268199530 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47000094c0 con 0x7f4704102400 2024-04-16T14:46:42.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.340+0000 7f46fa7fc640 1 -- 172.21.15.5:0/1268199530 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4700032e50 con 0x7f4704102400 2024-04-16T14:46:42.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.340+0000 7f470c22e640 1 -- 172.21.15.5:0/1268199530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f470410f470 con 0x7f4704102400 2024-04-16T14:46:42.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.340+0000 7f46fa7fc640 1 -- 172.21.15.5:0/1268199530 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47000433b0 con 0x7f4704102400 2024-04-16T14:46:42.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.340+0000 7f470c22e640 1 -- 172.21.15.5:0/1268199530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470410f930 con 0x7f4704102400 2024-04-16T14:46:42.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.341+0000 7f470c22e640 1 -- 172.21.15.5:0/1268199530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47040fdb70 con 0x7f4704102400 2024-04-16T14:46:42.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.341+0000 7f46fa7fc640 1 -- 172.21.15.5:0/1268199530 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f470002f070 con 0x7f4704102400 2024-04-16T14:46:42.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.342+0000 7f46fa7fc640 1 --2- 172.21.15.5:0/1268199530 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f46f006e0c0 0x7f46f0070570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:42.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.342+0000 7f47097c9640 1 --2- 172.21.15.5:0/1268199530 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f46f006e0c0 0x7f46f0070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:42.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.342+0000 7f46fa7fc640 1 -- 172.21.15.5:0/1268199530 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f47000af9c0 con 0x7f4704102400 2024-04-16T14:46:42.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.342+0000 7f47097c9640 1 --2- 172.21.15.5:0/1268199530 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f46f006e0c0 0x7f46f0070570 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4704110a90 tx=0x7f46f400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:42.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.347+0000 7f46fa7fc640 1 -- 172.21.15.5:0/1268199530 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f4700078ca0 con 0x7f4704102400 2024-04-16T14:46:42.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:42 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/740670226' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-16T14:46:42.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:42 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/286764570' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-16T14:46:42.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:42 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/1674533409' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-16T14:46:42.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:42 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/740670226' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-16T14:46:42.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:42 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/286764570' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-16T14:46:42.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:42 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/1674533409' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-16T14:46:42.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.573+0000 7f470c22e640 1 -- 172.21.15.5:0/1268199530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f47040638d0 con 0x7f4704102400 2024-04-16T14:46:42.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.573+0000 7f46fa7fc640 1 -- 172.21.15.5:0/1268199530 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v44) v1 ==== 107+0+4079 (secure 0 0 0) 0x7f470007c360 con 0x7f4704102400 2024-04-16T14:46:42.572 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:42.572 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14492,"name":"cephfs.smithi005.vzoqdl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6827/187766809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":187766809},{"type":"v1","addr":"172.21.15.5:6827","nonce":187766809}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24275,"name":"cephfs.smithi115.trkaqh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.115:6827/2476249308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2476249308},{"type":"v1","addr":"172.21.15.115:6827","nonce":2476249308}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T14:32:45.270024+0000","modified":"2024-04-16T14:42:12.602702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14484},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi005.wofqlz","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.5:6829/402035291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":402035291},{"type":"v1","addr":"172.21.15.5:6829","nonce":402035291}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14484,"qdb_cluster":[14484]},"id":1}]} 2024-04-16T14:46:42.572 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 25 2024-04-16T14:46:42.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.576+0000 7f470c22e640 1 -- 172.21.15.5:0/1268199530 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f46f006e0c0 msgr2=0x7f46f0070570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:42.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.576+0000 7f470c22e640 1 --2- 172.21.15.5:0/1268199530 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f46f006e0c0 0x7f46f0070570 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4704110a90 tx=0x7f46f400b040 comp rx=0 tx=0).stop 2024-04-16T14:46:42.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.576+0000 7f470c22e640 1 -- 172.21.15.5:0/1268199530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4704102400 msgr2=0x7f4704115190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:42.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.576+0000 7f470c22e640 1 --2- 172.21.15.5:0/1268199530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4704102400 0x7f4704115190 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f47000047f0 tx=0x7f4700009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:42.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.576+0000 7f470c22e640 1 -- 172.21.15.5:0/1268199530 shutdown_connections 2024-04-16T14:46:42.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.576+0000 7f470c22e640 1 --2- 172.21.15.5:0/1268199530 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f46f006e0c0 0x7f46f0070570 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:42.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.576+0000 7f470c22e640 1 --2- 172.21.15.5:0/1268199530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4704102da0 0x7f47041156d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:42.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.576+0000 7f470c22e640 1 --2- 172.21.15.5:0/1268199530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4704102400 0x7f4704115190 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:42.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.576+0000 7f470c22e640 1 -- 172.21.15.5:0/1268199530 >> 172.21.15.5:0/1268199530 conn(0x7f47040f7fb0 msgr2=0x7f4704071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:42.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.576+0000 7f470c22e640 1 -- 172.21.15.5:0/1268199530 shutdown_connections 2024-04-16T14:46:42.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.576+0000 7f470c22e640 1 -- 172.21.15.5:0/1268199530 wait complete. 2024-04-16T14:46:42.585 DEBUG:tasks.fs:max_mds reduced in epoch 25 2024-04-16T14:46:42.586 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-04-16T14:46:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.689+0000 7f44b3314640 1 -- 172.21.15.5:0/1783281665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac101a50 msgr2=0x7f44ac0fb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.689+0000 7f44b3314640 1 --2- 172.21.15.5:0/1783281665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac101a50 0x7f44ac0fb9e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f44a00048d0 tx=0x7f44a0009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.689+0000 7f44b3314640 1 -- 172.21.15.5:0/1783281665 shutdown_connections 2024-04-16T14:46:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.689+0000 7f44b3314640 1 --2- 172.21.15.5:0/1783281665 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac101a50 0x7f44ac0fb9e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.689+0000 7f44b3314640 1 --2- 172.21.15.5:0/1783281665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44ac101140 0x7f44ac101510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.689+0000 7f44b3314640 1 -- 172.21.15.5:0/1783281665 >> 172.21.15.5:0/1783281665 conn(0x7f44ac0708f0 msgr2=0x7f44ac070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.690+0000 7f44b3314640 1 -- 172.21.15.5:0/1783281665 shutdown_connections 2024-04-16T14:46:42.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.690+0000 7f44b3314640 1 -- 172.21.15.5:0/1783281665 wait complete. 2024-04-16T14:46:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.690+0000 7f44b3314640 1 Processor -- start 2024-04-16T14:46:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.690+0000 7f44b3314640 1 -- start start 2024-04-16T14:46:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.690+0000 7f44b3314640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac101140 0x7f44ac111c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.690+0000 7f44b3314640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44ac101a50 0x7f44ac1121c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.690+0000 7f44b3314640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac1127c0 con 0x7f44ac101140 2024-04-16T14:46:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.690+0000 7f44b3314640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac10be10 con 0x7f44ac101a50 2024-04-16T14:46:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.690+0000 7f44b10b0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac101140 0x7f44ac111c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.690+0000 7f44b10b0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac101140 0x7f44ac111c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53782/0 (socket says 172.21.15.5:53782) 2024-04-16T14:46:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.690+0000 7f44b10b0640 1 -- 172.21.15.5:0/3249547292 learned_addr learned my addr 172.21.15.5:0/3249547292 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.691+0000 7f44b10b0640 1 -- 172.21.15.5:0/3249547292 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44ac101a50 msgr2=0x7f44ac1121c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.691+0000 7f44b08af640 1 --2- 172.21.15.5:0/3249547292 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44ac101a50 0x7f44ac1121c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.691+0000 7f44b10b0640 1 --2- 172.21.15.5:0/3249547292 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44ac101a50 0x7f44ac1121c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.691+0000 7f44b10b0640 1 -- 172.21.15.5:0/3249547292 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a0005040 con 0x7f44ac101140 2024-04-16T14:46:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.691+0000 7f44b10b0640 1 --2- 172.21.15.5:0/3249547292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac101140 0x7f44ac111c80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f44a400c790 tx=0x7f44a40043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:42.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.691+0000 7f44a9ffb640 1 -- 172.21.15.5:0/3249547292 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44a400a820 con 0x7f44ac101140 2024-04-16T14:46:42.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.691+0000 7f44b3314640 1 -- 172.21.15.5:0/3249547292 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44ac10c0f0 con 0x7f44ac101140 2024-04-16T14:46:42.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.691+0000 7f44a9ffb640 1 -- 172.21.15.5:0/3249547292 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f44a400ae50 con 0x7f44ac101140 2024-04-16T14:46:42.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.691+0000 7f44a9ffb640 1 -- 172.21.15.5:0/3249547292 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44a40115e0 con 0x7f44ac101140 2024-04-16T14:46:42.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.691+0000 7f44b3314640 1 -- 172.21.15.5:0/3249547292 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44ac10c610 con 0x7f44ac101140 2024-04-16T14:46:42.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.692+0000 7f44b3314640 1 -- 172.21.15.5:0/3249547292 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44ac0fc9f0 con 0x7f44ac101140 2024-04-16T14:46:42.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.692+0000 7f44a9ffb640 1 -- 172.21.15.5:0/3249547292 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f44a4012400 con 0x7f44ac101140 2024-04-16T14:46:42.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.693+0000 7f44a9ffb640 1 --2- 172.21.15.5:0/3249547292 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f449406e0b0 0x7f4494070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:42.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.693+0000 7f44a9ffb640 1 -- 172.21.15.5:0/3249547292 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f44a408dd90 con 0x7f44ac101140 2024-04-16T14:46:42.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.693+0000 7f44b08af640 1 --2- 172.21.15.5:0/3249547292 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f449406e0b0 0x7f4494070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:42.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.693+0000 7f44b08af640 1 --2- 172.21.15.5:0/3249547292 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f449406e0b0 0x7f4494070560 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f44a0000c00 tx=0x7f44a0009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:42.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.697+0000 7f44a9ffb640 1 -- 172.21.15.5:0/3249547292 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f44a40570e0 con 0x7f44ac101140 2024-04-16T14:46:42.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.919+0000 7f44b3314640 1 -- 172.21.15.5:0/3249547292 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f44ac04bcc0 con 0x7f44ac101140 2024-04-16T14:46:42.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.920+0000 7f44a9ffb640 1 -- 172.21.15.5:0/3249547292 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v44) v1 ==== 107+0+4861 (secure 0 0 0) 0x7f44a405a7a0 con 0x7f44ac101140 2024-04-16T14:46:42.919 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:42.919 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14492,"name":"cephfs.smithi005.vzoqdl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6827/187766809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":187766809},{"type":"v1","addr":"172.21.15.5:6827","nonce":187766809}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":24275,"name":"cephfs.smithi115.trkaqh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.115:6827/2476249308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2476249308},{"type":"v1","addr":"172.21.15.115:6827","nonce":2476249308}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":44277,"name":"cephfs.smithi115.byfytg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6825/1266846723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1266846723},{"type":"v1","addr":"172.21.15.115:6825","nonce":1266846723}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T14:32:45.270024+0000","modified":"2024-04-16T14:42:12.602702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14484},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi005.wofqlz","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.5:6829/402035291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":402035291},{"type":"v1","addr":"172.21.15.5:6829","nonce":402035291}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14484,"qdb_cluster":[14484]},"id":1}]} 2024-04-16T14:46:42.919 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 26 2024-04-16T14:46:42.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.922+0000 7f44b3314640 1 -- 172.21.15.5:0/3249547292 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f449406e0b0 msgr2=0x7f4494070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:42.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.922+0000 7f44b3314640 1 --2- 172.21.15.5:0/3249547292 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f449406e0b0 0x7f4494070560 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f44a0000c00 tx=0x7f44a0009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:42.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.922+0000 7f44b3314640 1 -- 172.21.15.5:0/3249547292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac101140 msgr2=0x7f44ac111c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:42.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.922+0000 7f44b3314640 1 --2- 172.21.15.5:0/3249547292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac101140 0x7f44ac111c80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f44a400c790 tx=0x7f44a40043c0 comp rx=0 tx=0).stop 2024-04-16T14:46:42.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.922+0000 7f44b3314640 1 -- 172.21.15.5:0/3249547292 shutdown_connections 2024-04-16T14:46:42.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.922+0000 7f44b3314640 1 --2- 172.21.15.5:0/3249547292 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f449406e0b0 0x7f4494070560 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:42.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.922+0000 7f44b3314640 1 --2- 172.21.15.5:0/3249547292 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f44ac101a50 0x7f44ac1121c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:42.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.922+0000 7f44b3314640 1 --2- 172.21.15.5:0/3249547292 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f44ac101140 0x7f44ac111c80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:42.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.922+0000 7f44b3314640 1 -- 172.21.15.5:0/3249547292 >> 172.21.15.5:0/3249547292 conn(0x7f44ac0708f0 msgr2=0x7f44ac0f8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:42.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.922+0000 7f44b3314640 1 -- 172.21.15.5:0/3249547292 shutdown_connections 2024-04-16T14:46:42.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:42.922+0000 7f44b3314640 1 -- 172.21.15.5:0/3249547292 wait complete. 2024-04-16T14:46:42.931 DEBUG:tasks.fs:max_mds reduced in epoch 26 2024-04-16T14:46:42.932 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-04-16T14:46:43.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.035+0000 7fe39699d640 1 -- 172.21.15.5:0/2578290583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe390101c80 msgr2=0x7fe3900fb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:43.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.035+0000 7fe39699d640 1 --2- 172.21.15.5:0/2578290583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe390101c80 0x7fe3900fb310 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe3840048d0 tx=0x7fe384009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:43.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.035+0000 7fe39699d640 1 -- 172.21.15.5:0/2578290583 shutdown_connections 2024-04-16T14:46:43.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.035+0000 7fe39699d640 1 --2- 172.21.15.5:0/2578290583 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe390101c80 0x7fe3900fb310 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:43.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.035+0000 7fe39699d640 1 --2- 172.21.15.5:0/2578290583 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3901012e0 0x7fe3901016b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:43.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.035+0000 7fe39699d640 1 -- 172.21.15.5:0/2578290583 >> 172.21.15.5:0/2578290583 conn(0x7fe3900f6eb0 msgr2=0x7fe3900f92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:43.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.035+0000 7fe39699d640 1 -- 172.21.15.5:0/2578290583 shutdown_connections 2024-04-16T14:46:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.035+0000 7fe39699d640 1 -- 172.21.15.5:0/2578290583 wait complete. 2024-04-16T14:46:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.035+0000 7fe39699d640 1 Processor -- start 2024-04-16T14:46:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.036+0000 7fe39699d640 1 -- start start 2024-04-16T14:46:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.036+0000 7fe39699d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3901012e0 0x7fe39010e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.036+0000 7fe39699d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe390101c80 0x7fe39010e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.036+0000 7fe39699d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe390066540 con 0x7fe3901012e0 2024-04-16T14:46:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.036+0000 7fe39699d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39010eb60 con 0x7fe390101c80 2024-04-16T14:46:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.036+0000 7fe38ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3901012e0 0x7fe39010e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.036+0000 7fe38ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3901012e0 0x7fe39010e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53810/0 (socket says 172.21.15.5:53810) 2024-04-16T14:46:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.036+0000 7fe38ffff640 1 -- 172.21.15.5:0/2462096728 learned_addr learned my addr 172.21.15.5:0/2462096728 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.036+0000 7fe38ffff640 1 -- 172.21.15.5:0/2462096728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe390101c80 msgr2=0x7fe39010e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.036+0000 7fe38ffff640 1 --2- 172.21.15.5:0/2462096728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe390101c80 0x7fe39010e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.036+0000 7fe38ffff640 1 -- 172.21.15.5:0/2462096728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe384005040 con 0x7fe3901012e0 2024-04-16T14:46:43.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.036+0000 7fe38ffff640 1 --2- 172.21.15.5:0/2462096728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3901012e0 0x7fe39010e0b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe38000c830 tx=0x7fe380004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.036+0000 7fe38cff9640 1 -- 172.21.15.5:0/2462096728 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe38000a850 con 0x7fe3901012e0 2024-04-16T14:46:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.036+0000 7fe39699d640 1 -- 172.21.15.5:0/2462096728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe39010ee40 con 0x7fe3901012e0 2024-04-16T14:46:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.036+0000 7fe38cff9640 1 -- 172.21.15.5:0/2462096728 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe38000ae80 con 0x7fe3901012e0 2024-04-16T14:46:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.036+0000 7fe38cff9640 1 -- 172.21.15.5:0/2462096728 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe380012ea0 con 0x7fe3901012e0 2024-04-16T14:46:43.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.036+0000 7fe39699d640 1 -- 172.21.15.5:0/2462096728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3901173d0 con 0x7fe3901012e0 2024-04-16T14:46:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.037+0000 7fe39699d640 1 -- 172.21.15.5:0/2462096728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3900fca50 con 0x7fe3901012e0 2024-04-16T14:46:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.038+0000 7fe38cff9640 1 -- 172.21.15.5:0/2462096728 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fe380012400 con 0x7fe3901012e0 2024-04-16T14:46:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.038+0000 7fe38cff9640 1 --2- 172.21.15.5:0/2462096728 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe37806e0b0 0x7fe378070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.039+0000 7fe38cff9640 1 -- 172.21.15.5:0/2462096728 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fe38008de30 con 0x7fe3901012e0 2024-04-16T14:46:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.039+0000 7fe38f7fe640 1 --2- 172.21.15.5:0/2462096728 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe37806e0b0 0x7fe378070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:43.038 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.039+0000 7fe38f7fe640 1 --2- 172.21.15.5:0/2462096728 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe37806e0b0 0x7fe378070560 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe3840043d0 tx=0x7fe384009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:43.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.043+0000 7fe38cff9640 1 -- 172.21.15.5:0/2462096728 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fe380057180 con 0x7fe3901012e0 2024-04-16T14:46:43.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:43 smithi005 ceph-mon[93420]: pgmap v317: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:43.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:43 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/2955726982' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-16T14:46:43.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:43 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/1268199530' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-16T14:46:43.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:43 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/3249547292' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-16T14:46:43.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.268+0000 7fe39699d640 1 -- 172.21.15.5:0/2462096728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7fe39004bcc0 con 0x7fe3901012e0 2024-04-16T14:46:43.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.269+0000 7fe38cff9640 1 -- 172.21.15.5:0/2462096728 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v44) v1 ==== 107+0+4088 (secure 0 0 0) 0x7fe3800126b0 con 0x7fe3901012e0 2024-04-16T14:46:43.267 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:43.267 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24275,"name":"cephfs.smithi115.trkaqh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.115:6827/2476249308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2476249308},{"type":"v1","addr":"172.21.15.115:6827","nonce":2476249308}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":44277,"name":"cephfs.smithi115.byfytg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6825/1266846723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1266846723},{"type":"v1","addr":"172.21.15.115:6825","nonce":1266846723}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T14:32:45.270024+0000","modified":"2024-04-16T14:42:12.602702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14484},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi005.wofqlz","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.5:6829/402035291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":402035291},{"type":"v1","addr":"172.21.15.5:6829","nonce":402035291}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14484,"qdb_cluster":[14484]},"id":1}]} 2024-04-16T14:46:43.268 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 27 2024-04-16T14:46:43.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.270+0000 7fe39699d640 1 -- 172.21.15.5:0/2462096728 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe37806e0b0 msgr2=0x7fe378070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:43.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.270+0000 7fe39699d640 1 --2- 172.21.15.5:0/2462096728 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe37806e0b0 0x7fe378070560 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe3840043d0 tx=0x7fe384009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:43.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.270+0000 7fe39699d640 1 -- 172.21.15.5:0/2462096728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3901012e0 msgr2=0x7fe39010e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:43.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.270+0000 7fe39699d640 1 --2- 172.21.15.5:0/2462096728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3901012e0 0x7fe39010e0b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe38000c830 tx=0x7fe380004430 comp rx=0 tx=0).stop 2024-04-16T14:46:43.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.271+0000 7fe39699d640 1 -- 172.21.15.5:0/2462096728 shutdown_connections 2024-04-16T14:46:43.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.271+0000 7fe39699d640 1 --2- 172.21.15.5:0/2462096728 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fe37806e0b0 0x7fe378070560 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:43.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.271+0000 7fe39699d640 1 --2- 172.21.15.5:0/2462096728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe390101c80 0x7fe39010e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:43.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.271+0000 7fe39699d640 1 --2- 172.21.15.5:0/2462096728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3901012e0 0x7fe39010e0b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:43.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.271+0000 7fe39699d640 1 -- 172.21.15.5:0/2462096728 >> 172.21.15.5:0/2462096728 conn(0x7fe3900f6eb0 msgr2=0x7fe3900f7eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:43.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.271+0000 7fe39699d640 1 -- 172.21.15.5:0/2462096728 shutdown_connections 2024-04-16T14:46:43.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.271+0000 7fe39699d640 1 -- 172.21.15.5:0/2462096728 wait complete. 2024-04-16T14:46:43.280 DEBUG:tasks.fs:max_mds reduced in epoch 27 2024-04-16T14:46:43.280 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-04-16T14:46:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.384+0000 7f9b06aae640 1 -- 172.21.15.5:0/4086693777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b00101100 msgr2=0x7f9b001014d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.384+0000 7f9b06aae640 1 --2- 172.21.15.5:0/4086693777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b00101100 0x7f9b001014d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9afc0048d0 tx=0x7f9afc009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.384+0000 7f9b06aae640 1 -- 172.21.15.5:0/4086693777 shutdown_connections 2024-04-16T14:46:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.384+0000 7f9b06aae640 1 --2- 172.21.15.5:0/4086693777 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b00101aa0 0x7f9b000fb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.384+0000 7f9b06aae640 1 --2- 172.21.15.5:0/4086693777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b00101100 0x7f9b001014d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.384+0000 7f9b06aae640 1 -- 172.21.15.5:0/4086693777 >> 172.21.15.5:0/4086693777 conn(0x7f9b000f6cd0 msgr2=0x7f9b000f90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.384+0000 7f9b06aae640 1 -- 172.21.15.5:0/4086693777 shutdown_connections 2024-04-16T14:46:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.384+0000 7f9b06aae640 1 -- 172.21.15.5:0/4086693777 wait complete. 2024-04-16T14:46:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.385+0000 7f9b06aae640 1 Processor -- start 2024-04-16T14:46:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.385+0000 7f9b06aae640 1 -- start start 2024-04-16T14:46:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.385+0000 7f9b06aae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b00101100 0x7f9b0010dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:43.385 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.385+0000 7f9b06aae640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b00101aa0 0x7f9b0010e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:43.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.385+0000 7f9b06aae640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b00066500 con 0x7f9b00101100 2024-04-16T14:46:43.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.385+0000 7f9b06aae640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0010e940 con 0x7f9b00101aa0 2024-04-16T14:46:43.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.385+0000 7f9b0484a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b00101100 0x7f9b0010dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:43.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.385+0000 7f9b0484a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b00101100 0x7f9b0010dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53834/0 (socket says 172.21.15.5:53834) 2024-04-16T14:46:43.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.385+0000 7f9b0484a640 1 -- 172.21.15.5:0/2228400172 learned_addr learned my addr 172.21.15.5:0/2228400172 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:43.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.385+0000 7f9af7fff640 1 --2- 172.21.15.5:0/2228400172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b00101aa0 0x7f9b0010e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:43.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.386+0000 7f9b0484a640 1 -- 172.21.15.5:0/2228400172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b00101aa0 msgr2=0x7f9b0010e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:43.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.386+0000 7f9b0484a640 1 --2- 172.21.15.5:0/2228400172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b00101aa0 0x7f9b0010e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:43.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.386+0000 7f9b0484a640 1 -- 172.21.15.5:0/2228400172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9afc005040 con 0x7f9b00101100 2024-04-16T14:46:43.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.386+0000 7f9af7fff640 1 --2- 172.21.15.5:0/2228400172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b00101aa0 0x7f9b0010e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:46:43.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.386+0000 7f9b0484a640 1 --2- 172.21.15.5:0/2228400172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b00101100 0x7f9b0010dec0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9afc004930 tx=0x7f9afc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:43.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.386+0000 7f9af57fa640 1 -- 172.21.15.5:0/2228400172 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9afc0094c0 con 0x7f9b00101100 2024-04-16T14:46:43.386 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.386+0000 7f9af57fa640 1 -- 172.21.15.5:0/2228400172 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9afc032e50 con 0x7f9b00101100 2024-04-16T14:46:43.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.386+0000 7f9b06aae640 1 -- 172.21.15.5:0/2228400172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b0010ebc0 con 0x7f9b00101100 2024-04-16T14:46:43.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.386+0000 7f9af57fa640 1 -- 172.21.15.5:0/2228400172 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9afc0433b0 con 0x7f9b00101100 2024-04-16T14:46:43.387 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.386+0000 7f9b06aae640 1 -- 172.21.15.5:0/2228400172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b00117120 con 0x7f9b00101100 2024-04-16T14:46:43.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.387+0000 7f9b06aae640 1 -- 172.21.15.5:0/2228400172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b000fc870 con 0x7f9b00101100 2024-04-16T14:46:43.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.388+0000 7f9af57fa640 1 -- 172.21.15.5:0/2228400172 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f9afc02f070 con 0x7f9b00101100 2024-04-16T14:46:43.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.388+0000 7f9af57fa640 1 --2- 172.21.15.5:0/2228400172 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f9ae806e0b0 0x7f9ae8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:43.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.388+0000 7f9af57fa640 1 -- 172.21.15.5:0/2228400172 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f9afc0afbf0 con 0x7f9b00101100 2024-04-16T14:46:43.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.388+0000 7f9af7fff640 1 --2- 172.21.15.5:0/2228400172 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f9ae806e0b0 0x7f9ae8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:43.388 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.388+0000 7f9af7fff640 1 --2- 172.21.15.5:0/2228400172 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f9ae806e0b0 0x7f9ae8070560 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9b00065d50 tx=0x7f9af0009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:43.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.393+0000 7f9af57fa640 1 -- 172.21.15.5:0/2228400172 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f9afc078ec0 con 0x7f9b00101100 2024-04-16T14:46:43.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:43 smithi115 ceph-mon[83414]: pgmap v317: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:43.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:43 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/2955726982' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-16T14:46:43.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:43 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/1268199530' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-16T14:46:43.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:43 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/3249547292' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-16T14:46:43.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.615+0000 7f9b06aae640 1 -- 172.21.15.5:0/2228400172 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f9b00117310 con 0x7f9b00101100 2024-04-16T14:46:43.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.616+0000 7f9af57fa640 1 -- 172.21.15.5:0/2228400172 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v44) v1 ==== 107+0+4932 (secure 0 0 0) 0x7f9afc07c580 con 0x7f9b00101100 2024-04-16T14:46:43.614 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:43.615 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24275,"name":"cephfs.smithi115.trkaqh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.115:6827/2476249308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2476249308},{"type":"v1","addr":"172.21.15.115:6827","nonce":2476249308}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34434,"name":"cephfs.smithi005.vzoqdl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6827/3940274196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3940274196},{"type":"v1","addr":"172.21.15.5:6827","nonce":3940274196}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44277,"name":"cephfs.smithi115.byfytg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6825/1266846723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1266846723},{"type":"v1","addr":"172.21.15.115:6825","nonce":1266846723}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T14:32:45.270024+0000","modified":"2024-04-16T14:42:12.602702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14484},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi005.wofqlz","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.5:6829/402035291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":402035291},{"type":"v1","addr":"172.21.15.5:6829","nonce":402035291}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14484,"qdb_cluster":[14484]},"id":1}]} 2024-04-16T14:46:43.615 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 28 2024-04-16T14:46:43.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.617+0000 7f9b06aae640 1 -- 172.21.15.5:0/2228400172 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f9ae806e0b0 msgr2=0x7f9ae8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:43.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.617+0000 7f9b06aae640 1 --2- 172.21.15.5:0/2228400172 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f9ae806e0b0 0x7f9ae8070560 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9b00065d50 tx=0x7f9af0009040 comp rx=0 tx=0).stop 2024-04-16T14:46:43.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.617+0000 7f9b06aae640 1 -- 172.21.15.5:0/2228400172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b00101100 msgr2=0x7f9b0010dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:43.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.617+0000 7f9b06aae640 1 --2- 172.21.15.5:0/2228400172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b00101100 0x7f9b0010dec0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9afc004930 tx=0x7f9afc009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:43.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.618+0000 7f9b06aae640 1 -- 172.21.15.5:0/2228400172 shutdown_connections 2024-04-16T14:46:43.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.618+0000 7f9b06aae640 1 --2- 172.21.15.5:0/2228400172 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f9ae806e0b0 0x7f9ae8070560 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:43.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.618+0000 7f9b06aae640 1 --2- 172.21.15.5:0/2228400172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9b00101aa0 0x7f9b0010e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:43.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.618+0000 7f9b06aae640 1 --2- 172.21.15.5:0/2228400172 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b00101100 0x7f9b0010dec0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:43.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.618+0000 7f9b06aae640 1 -- 172.21.15.5:0/2228400172 >> 172.21.15.5:0/2228400172 conn(0x7f9b000f6cd0 msgr2=0x7f9b000f7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:43.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.618+0000 7f9b06aae640 1 -- 172.21.15.5:0/2228400172 shutdown_connections 2024-04-16T14:46:43.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.618+0000 7f9b06aae640 1 -- 172.21.15.5:0/2228400172 wait complete. 2024-04-16T14:46:43.627 DEBUG:tasks.fs:max_mds reduced in epoch 28 2024-04-16T14:46:43.627 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-04-16T14:46:43.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.732+0000 7f755955d640 1 -- 172.21.15.5:0/1341672933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75540fd3d0 msgr2=0x7f75540fd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:43.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.732+0000 7f755955d640 1 --2- 172.21.15.5:0/1341672933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75540fd3d0 0x7f75540fd7a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f754c0048d0 tx=0x7f754c009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:43.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.733+0000 7f755955d640 1 -- 172.21.15.5:0/1341672933 shutdown_connections 2024-04-16T14:46:43.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.733+0000 7f755955d640 1 --2- 172.21.15.5:0/1341672933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75540fdce0 0x7f7554106440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:43.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.733+0000 7f755955d640 1 --2- 172.21.15.5:0/1341672933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75540fd3d0 0x7f75540fd7a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:43.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.733+0000 7f755955d640 1 -- 172.21.15.5:0/1341672933 >> 172.21.15.5:0/1341672933 conn(0x7f75540f6e90 msgr2=0x7f75540f92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:43.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.733+0000 7f755955d640 1 -- 172.21.15.5:0/1341672933 shutdown_connections 2024-04-16T14:46:43.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.733+0000 7f755955d640 1 -- 172.21.15.5:0/1341672933 wait complete. 2024-04-16T14:46:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.733+0000 7f755955d640 1 Processor -- start 2024-04-16T14:46:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.733+0000 7f755955d640 1 -- start start 2024-04-16T14:46:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.733+0000 7f755955d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75540fd3d0 0x7f7554112fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.734+0000 7f755955d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75540fdce0 0x7f7554113500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.734+0000 7f755955d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7554113b00 con 0x7f75540fdce0 2024-04-16T14:46:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.734+0000 7f755955d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755410d150 con 0x7f75540fd3d0 2024-04-16T14:46:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.734+0000 7f75527fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75540fdce0 0x7f7554113500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.734+0000 7f75527fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75540fdce0 0x7f7554113500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53850/0 (socket says 172.21.15.5:53850) 2024-04-16T14:46:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.734+0000 7f75527fc640 1 -- 172.21.15.5:0/662734045 learned_addr learned my addr 172.21.15.5:0/662734045 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.734+0000 7f7552ffd640 1 --2- 172.21.15.5:0/662734045 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75540fd3d0 0x7f7554112fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.734+0000 7f75527fc640 1 -- 172.21.15.5:0/662734045 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75540fd3d0 msgr2=0x7f7554112fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.734+0000 7f75527fc640 1 --2- 172.21.15.5:0/662734045 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75540fd3d0 0x7f7554112fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.734+0000 7f75527fc640 1 -- 172.21.15.5:0/662734045 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754c005040 con 0x7f75540fdce0 2024-04-16T14:46:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.734+0000 7f7552ffd640 1 --2- 172.21.15.5:0/662734045 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75540fd3d0 0x7f7554112fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:46:43.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.734+0000 7f75527fc640 1 --2- 172.21.15.5:0/662734045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75540fdce0 0x7f7554113500 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f753c00c790 tx=0x7f753c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.734+0000 7f754b7fe640 1 -- 172.21.15.5:0/662734045 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f753c00a820 con 0x7f75540fdce0 2024-04-16T14:46:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.734+0000 7f755955d640 1 -- 172.21.15.5:0/662734045 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755410d430 con 0x7f75540fdce0 2024-04-16T14:46:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.734+0000 7f754b7fe640 1 -- 172.21.15.5:0/662734045 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f753c00ae50 con 0x7f75540fdce0 2024-04-16T14:46:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.734+0000 7f754b7fe640 1 -- 172.21.15.5:0/662734045 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f753c0115e0 con 0x7f75540fdce0 2024-04-16T14:46:43.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.734+0000 7f755955d640 1 -- 172.21.15.5:0/662734045 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755410d950 con 0x7f75540fdce0 2024-04-16T14:46:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.735+0000 7f755955d640 1 -- 172.21.15.5:0/662734045 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7554065e00 con 0x7f75540fdce0 2024-04-16T14:46:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.736+0000 7f754b7fe640 1 -- 172.21.15.5:0/662734045 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f753c012400 con 0x7f75540fdce0 2024-04-16T14:46:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.736+0000 7f754b7fe640 1 --2- 172.21.15.5:0/662734045 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f754006e0b0 0x7f7540070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.736+0000 7f754b7fe640 1 -- 172.21.15.5:0/662734045 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f753c08dd90 con 0x7f75540fdce0 2024-04-16T14:46:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.736+0000 7f7552ffd640 1 --2- 172.21.15.5:0/662734045 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f754006e0b0 0x7f7540070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:43.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.737+0000 7f7552ffd640 1 --2- 172.21.15.5:0/662734045 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f754006e0b0 0x7f7540070560 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f754c000c00 tx=0x7f754c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:43.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.741+0000 7f754b7fe640 1 -- 172.21.15.5:0/662734045 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f753c0570e0 con 0x7f75540fdce0 2024-04-16T14:46:43.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.963+0000 7f755955d640 1 -- 172.21.15.5:0/662734045 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f7554109550 con 0x7f75540fdce0 2024-04-16T14:46:43.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.963+0000 7f754b7fe640 1 -- 172.21.15.5:0/662734045 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v44) v1 ==== 107+0+4139 (secure 0 0 0) 0x7f753c05a7a0 con 0x7f75540fdce0 2024-04-16T14:46:43.962 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:43.962 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24275,"name":"cephfs.smithi115.trkaqh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.115:6827/2476249308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2476249308},{"type":"v1","addr":"172.21.15.115:6827","nonce":2476249308}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34434,"name":"cephfs.smithi005.vzoqdl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6827/3940274196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3940274196},{"type":"v1","addr":"172.21.15.5:6827","nonce":3940274196}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44277,"name":"cephfs.smithi115.byfytg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6825/1266846723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1266846723},{"type":"v1","addr":"172.21.15.115:6825","nonce":1266846723}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T14:32:45.270024+0000","modified":"2024-04-16T14:42:40.192240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-16T14:46:43.962 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 29 2024-04-16T14:46:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.965+0000 7f755955d640 1 -- 172.21.15.5:0/662734045 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f754006e0b0 msgr2=0x7f7540070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.965+0000 7f755955d640 1 --2- 172.21.15.5:0/662734045 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f754006e0b0 0x7f7540070560 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f754c000c00 tx=0x7f754c009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.965+0000 7f755955d640 1 -- 172.21.15.5:0/662734045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75540fdce0 msgr2=0x7f7554113500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.965+0000 7f755955d640 1 --2- 172.21.15.5:0/662734045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75540fdce0 0x7f7554113500 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f753c00c790 tx=0x7f753c0043c0 comp rx=0 tx=0).stop 2024-04-16T14:46:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.965+0000 7f755955d640 1 -- 172.21.15.5:0/662734045 shutdown_connections 2024-04-16T14:46:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.965+0000 7f755955d640 1 --2- 172.21.15.5:0/662734045 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f754006e0b0 0x7f7540070560 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.965+0000 7f755955d640 1 --2- 172.21.15.5:0/662734045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75540fdce0 0x7f7554113500 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.965+0000 7f755955d640 1 --2- 172.21.15.5:0/662734045 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75540fd3d0 0x7f7554112fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.965+0000 7f755955d640 1 -- 172.21.15.5:0/662734045 >> 172.21.15.5:0/662734045 conn(0x7f75540f6e90 msgr2=0x7f75540f83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:43.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.965+0000 7f755955d640 1 -- 172.21.15.5:0/662734045 shutdown_connections 2024-04-16T14:46:43.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:43.965+0000 7f755955d640 1 -- 172.21.15.5:0/662734045 wait complete. 2024-04-16T14:46:43.975 DEBUG:tasks.fs:max_mds reduced in epoch 29 2024-04-16T14:46:43.975 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-04-16T14:46:44.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.078+0000 7fd60911d640 1 -- 172.21.15.5:0/1014731853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd604101a90 msgr2=0x7fd6040fb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:44.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.078+0000 7fd60911d640 1 --2- 172.21.15.5:0/1014731853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd604101a90 0x7fd6040fb120 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec0048d0 tx=0x7fd5ec009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.078+0000 7fd60911d640 1 -- 172.21.15.5:0/1014731853 shutdown_connections 2024-04-16T14:46:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.078+0000 7fd60911d640 1 --2- 172.21.15.5:0/1014731853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd604101a90 0x7fd6040fb120 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.078+0000 7fd60911d640 1 --2- 172.21.15.5:0/1014731853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6041010f0 0x7fd6041014c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.078+0000 7fd60911d640 1 -- 172.21.15.5:0/1014731853 >> 172.21.15.5:0/1014731853 conn(0x7fd6040f6cc0 msgr2=0x7fd6040f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.078+0000 7fd60911d640 1 -- 172.21.15.5:0/1014731853 shutdown_connections 2024-04-16T14:46:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.078+0000 7fd60911d640 1 -- 172.21.15.5:0/1014731853 wait complete. 2024-04-16T14:46:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.079+0000 7fd60911d640 1 Processor -- start 2024-04-16T14:46:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.079+0000 7fd60911d640 1 -- start start 2024-04-16T14:46:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.079+0000 7fd60911d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6041010f0 0x7fd60410dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.079+0000 7fd60911d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd604101a90 0x7fd60410e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.079+0000 7fd60911d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd604066520 con 0x7fd6041010f0 2024-04-16T14:46:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.079+0000 7fd60911d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60410e940 con 0x7fd604101a90 2024-04-16T14:46:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.079+0000 7fd602d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6041010f0 0x7fd60410dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:44.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.079+0000 7fd602d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6041010f0 0x7fd60410dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53860/0 (socket says 172.21.15.5:53860) 2024-04-16T14:46:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.079+0000 7fd602d9d640 1 -- 172.21.15.5:0/368454233 learned_addr learned my addr 172.21.15.5:0/368454233 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.079+0000 7fd60259c640 1 --2- 172.21.15.5:0/368454233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd604101a90 0x7fd60410e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.079+0000 7fd602d9d640 1 -- 172.21.15.5:0/368454233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd604101a90 msgr2=0x7fd60410e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.079+0000 7fd602d9d640 1 --2- 172.21.15.5:0/368454233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd604101a90 0x7fd60410e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.079+0000 7fd602d9d640 1 -- 172.21.15.5:0/368454233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ec005040 con 0x7fd6041010f0 2024-04-16T14:46:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.079+0000 7fd60259c640 1 --2- 172.21.15.5:0/368454233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd604101a90 0x7fd60410e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:46:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.079+0000 7fd602d9d640 1 --2- 172.21.15.5:0/368454233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6041010f0 0x7fd60410dec0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc00cb10 tx=0x7fd5fc007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.080+0000 7fd5fb7fe640 1 -- 172.21.15.5:0/368454233 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5fc004200 con 0x7fd6041010f0 2024-04-16T14:46:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.080+0000 7fd60911d640 1 -- 172.21.15.5:0/368454233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd60410ec20 con 0x7fd6041010f0 2024-04-16T14:46:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.080+0000 7fd5fb7fe640 1 -- 172.21.15.5:0/368454233 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd5fc00acf0 con 0x7fd6041010f0 2024-04-16T14:46:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.080+0000 7fd5fb7fe640 1 -- 172.21.15.5:0/368454233 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5fc003e40 con 0x7fd6041010f0 2024-04-16T14:46:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.080+0000 7fd60911d640 1 -- 172.21.15.5:0/368454233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6041171e0 con 0x7fd6041010f0 2024-04-16T14:46:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.081+0000 7fd60911d640 1 -- 172.21.15.5:0/368454233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6040fc860 con 0x7fd6041010f0 2024-04-16T14:46:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.081+0000 7fd5fb7fe640 1 -- 172.21.15.5:0/368454233 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fd5fc00a820 con 0x7fd6041010f0 2024-04-16T14:46:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.081+0000 7fd5fb7fe640 1 --2- 172.21.15.5:0/368454233 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fd5f006e060 0x7fd5f0070510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.082+0000 7fd5fb7fe640 1 -- 172.21.15.5:0/368454233 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fd5fc08e2f0 con 0x7fd6041010f0 2024-04-16T14:46:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.082+0000 7fd60259c640 1 --2- 172.21.15.5:0/368454233 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fd5f006e060 0x7fd5f0070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:44.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.082+0000 7fd60259c640 1 --2- 172.21.15.5:0/368454233 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fd5f006e060 0x7fd5f0070510 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec000c00 tx=0x7fd5ec009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:44.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.086+0000 7fd5fb7fe640 1 -- 172.21.15.5:0/368454233 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fd5fc0575c0 con 0x7fd6041010f0 2024-04-16T14:46:44.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:44 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/2462096728' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-16T14:46:44.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:44 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/2228400172' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-16T14:46:44.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:44 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/662734045' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-04-16T14:46:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.309+0000 7fd60911d640 1 -- 172.21.15.5:0/368454233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7fd60404bcc0 con 0x7fd6041010f0 2024-04-16T14:46:44.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.310+0000 7fd5fb7fe640 1 -- 172.21.15.5:0/368454233 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v44) v1 ==== 107+0+4150 (secure 0 0 0) 0x7fd5fc05ac80 con 0x7fd6041010f0 2024-04-16T14:46:44.309 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:44.309 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34434,"name":"cephfs.smithi005.vzoqdl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6827/3940274196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3940274196},{"type":"v1","addr":"172.21.15.5:6827","nonce":3940274196}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44277,"name":"cephfs.smithi115.byfytg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6825/1266846723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1266846723},{"type":"v1","addr":"172.21.15.115:6825","nonce":1266846723}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T14:32:45.270024+0000","modified":"2024-04-16T14:42:40.196375+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24275},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24275":{"gid":24275,"name":"cephfs.smithi115.trkaqh","rank":0,"incarnation":30,"state":"up:replay","state_seq":2,"addr":"172.21.15.115:6827/2476249308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2476249308},{"type":"v1","addr":"172.21.15.115:6827","nonce":2476249308}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-16T14:46:44.309 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 30 2024-04-16T14:46:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.312+0000 7fd60911d640 1 -- 172.21.15.5:0/368454233 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fd5f006e060 msgr2=0x7fd5f0070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.312+0000 7fd60911d640 1 --2- 172.21.15.5:0/368454233 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fd5f006e060 0x7fd5f0070510 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec000c00 tx=0x7fd5ec009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.312+0000 7fd60911d640 1 -- 172.21.15.5:0/368454233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6041010f0 msgr2=0x7fd60410dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.312+0000 7fd60911d640 1 --2- 172.21.15.5:0/368454233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6041010f0 0x7fd60410dec0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc00cb10 tx=0x7fd5fc007ee0 comp rx=0 tx=0).stop 2024-04-16T14:46:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.312+0000 7fd60911d640 1 -- 172.21.15.5:0/368454233 shutdown_connections 2024-04-16T14:46:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.312+0000 7fd60911d640 1 --2- 172.21.15.5:0/368454233 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fd5f006e060 0x7fd5f0070510 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.312+0000 7fd60911d640 1 --2- 172.21.15.5:0/368454233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd604101a90 0x7fd60410e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.312+0000 7fd60911d640 1 --2- 172.21.15.5:0/368454233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6041010f0 0x7fd60410dec0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.312+0000 7fd60911d640 1 -- 172.21.15.5:0/368454233 >> 172.21.15.5:0/368454233 conn(0x7fd6040f6cc0 msgr2=0x7fd6040f7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.312+0000 7fd60911d640 1 -- 172.21.15.5:0/368454233 shutdown_connections 2024-04-16T14:46:44.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.312+0000 7fd60911d640 1 -- 172.21.15.5:0/368454233 wait complete. 2024-04-16T14:46:44.322 DEBUG:tasks.fs:max_mds reduced in epoch 30 2024-04-16T14:46:44.322 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-04-16T14:46:44.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.426+0000 7f71d84ae640 1 -- 172.21.15.5:0/826724672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71d0101c90 msgr2=0x7f71d00fb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:44.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.426+0000 7f71d84ae640 1 --2- 172.21.15.5:0/826724672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71d0101c90 0x7f71d00fb320 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f71c00048d0 tx=0x7f71c0009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:44.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.426+0000 7f71d84ae640 1 -- 172.21.15.5:0/826724672 shutdown_connections 2024-04-16T14:46:44.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.426+0000 7f71d84ae640 1 --2- 172.21.15.5:0/826724672 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71d0101c90 0x7f71d00fb320 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:44.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.426+0000 7f71d84ae640 1 --2- 172.21.15.5:0/826724672 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71d01012f0 0x7f71d01016c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:44.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.426+0000 7f71d84ae640 1 -- 172.21.15.5:0/826724672 >> 172.21.15.5:0/826724672 conn(0x7f71d00f6e80 msgr2=0x7f71d00f9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:44.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.426+0000 7f71d84ae640 1 -- 172.21.15.5:0/826724672 shutdown_connections 2024-04-16T14:46:44.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.426+0000 7f71d84ae640 1 -- 172.21.15.5:0/826724672 wait complete. 2024-04-16T14:46:44.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.426+0000 7f71d84ae640 1 Processor -- start 2024-04-16T14:46:44.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.426+0000 7f71d84ae640 1 -- start start 2024-04-16T14:46:44.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.426+0000 7f71d84ae640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71d01012f0 0x7f71d010bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:44.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.426+0000 7f71d84ae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71d0101c90 0x7f71d010c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:44.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.426+0000 7f71d84ae640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d00663d0 con 0x7f71d0101c90 2024-04-16T14:46:44.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.426+0000 7f71d84ae640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d0066510 con 0x7f71d01012f0 2024-04-16T14:46:44.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.427+0000 7f71d5a49640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71d0101c90 0x7f71d010c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:44.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.427+0000 7f71d5a49640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71d0101c90 0x7f71d010c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53872/0 (socket says 172.21.15.5:53872) 2024-04-16T14:46:44.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.427+0000 7f71d5a49640 1 -- 172.21.15.5:0/1873789156 learned_addr learned my addr 172.21.15.5:0/1873789156 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:44.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.427+0000 7f71d624a640 1 --2- 172.21.15.5:0/1873789156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71d01012f0 0x7f71d010bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:44.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.427+0000 7f71d5a49640 1 -- 172.21.15.5:0/1873789156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71d01012f0 msgr2=0x7f71d010bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:44.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.427+0000 7f71d5a49640 1 --2- 172.21.15.5:0/1873789156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71d01012f0 0x7f71d010bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:44.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.427+0000 7f71d5a49640 1 -- 172.21.15.5:0/1873789156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c0005040 con 0x7f71d0101c90 2024-04-16T14:46:44.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.427+0000 7f71d624a640 1 --2- 172.21.15.5:0/1873789156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71d01012f0 0x7f71d010bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T14:46:44.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.427+0000 7f71d5a49640 1 --2- 172.21.15.5:0/1873789156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71d0101c90 0x7f71d010c460 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f71c0034040 tx=0x7f71c0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:44.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.427+0000 7f71c6ffd640 1 -- 172.21.15.5:0/1873789156 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71c00092b0 con 0x7f71d0101c90 2024-04-16T14:46:44.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.427+0000 7f71c6ffd640 1 -- 172.21.15.5:0/1873789156 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f71c003b400 con 0x7f71d0101c90 2024-04-16T14:46:44.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.427+0000 7f71d84ae640 1 -- 172.21.15.5:0/1873789156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d010ca90 con 0x7f71d0101c90 2024-04-16T14:46:44.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.427+0000 7f71c6ffd640 1 -- 172.21.15.5:0/1873789156 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71c00435d0 con 0x7f71d0101c90 2024-04-16T14:46:44.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.427+0000 7f71d84ae640 1 -- 172.21.15.5:0/1873789156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d0119730 con 0x7f71d0101c90 2024-04-16T14:46:44.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.428+0000 7f71d84ae640 1 -- 172.21.15.5:0/1873789156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d00fca60 con 0x7f71d0101c90 2024-04-16T14:46:44.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.429+0000 7f71c6ffd640 1 -- 172.21.15.5:0/1873789156 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f71c002f070 con 0x7f71d0101c90 2024-04-16T14:46:44.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.429+0000 7f71c6ffd640 1 --2- 172.21.15.5:0/1873789156 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f71bc06e0b0 0x7f71bc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:44.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.429+0000 7f71c6ffd640 1 -- 172.21.15.5:0/1873789156 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f71c00af840 con 0x7f71d0101c90 2024-04-16T14:46:44.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.429+0000 7f71d624a640 1 --2- 172.21.15.5:0/1873789156 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f71bc06e0b0 0x7f71bc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:44.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.430+0000 7f71d624a640 1 --2- 172.21.15.5:0/1873789156 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f71bc06e0b0 0x7f71bc070560 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f71cc004ab0 tx=0x7f71cc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:44.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:44 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/2462096728' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-16T14:46:44.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:44 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/2228400172' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-16T14:46:44.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:44 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/662734045' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-04-16T14:46:44.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.434+0000 7f71c6ffd640 1 -- 172.21.15.5:0/1873789156 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f71c0078b90 con 0x7f71d0101c90 2024-04-16T14:46:44.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.657+0000 7f71d84ae640 1 -- 172.21.15.5:0/1873789156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f71d0108450 con 0x7f71d0101c90 2024-04-16T14:46:44.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.658+0000 7f71c6ffd640 1 -- 172.21.15.5:0/1873789156 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v44) v1 ==== 107+0+4155 (secure 0 0 0) 0x7f71c007c250 con 0x7f71d0101c90 2024-04-16T14:46:44.656 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:44.656 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34434,"name":"cephfs.smithi005.vzoqdl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6827/3940274196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3940274196},{"type":"v1","addr":"172.21.15.5:6827","nonce":3940274196}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44277,"name":"cephfs.smithi115.byfytg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6825/1266846723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1266846723},{"type":"v1","addr":"172.21.15.115:6825","nonce":1266846723}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T14:32:45.270024+0000","modified":"2024-04-16T14:42:47.024835+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24275},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24275":{"gid":24275,"name":"cephfs.smithi115.trkaqh","rank":0,"incarnation":30,"state":"up:reconnect","state_seq":149,"addr":"172.21.15.115:6827/2476249308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2476249308},{"type":"v1","addr":"172.21.15.115:6827","nonce":2476249308}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-16T14:46:44.657 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 31 2024-04-16T14:46:44.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.660+0000 7f71d84ae640 1 -- 172.21.15.5:0/1873789156 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f71bc06e0b0 msgr2=0x7f71bc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:44.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.660+0000 7f71d84ae640 1 --2- 172.21.15.5:0/1873789156 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f71bc06e0b0 0x7f71bc070560 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f71cc004ab0 tx=0x7f71cc00b040 comp rx=0 tx=0).stop 2024-04-16T14:46:44.658 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.660+0000 7f71d84ae640 1 -- 172.21.15.5:0/1873789156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71d0101c90 msgr2=0x7f71d010c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.660+0000 7f71d84ae640 1 --2- 172.21.15.5:0/1873789156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71d0101c90 0x7f71d010c460 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f71c0034040 tx=0x7f71c0009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.660+0000 7f71d84ae640 1 -- 172.21.15.5:0/1873789156 shutdown_connections 2024-04-16T14:46:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.660+0000 7f71d84ae640 1 --2- 172.21.15.5:0/1873789156 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f71bc06e0b0 0x7f71bc070560 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.660+0000 7f71d84ae640 1 --2- 172.21.15.5:0/1873789156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71d0101c90 0x7f71d010c460 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.660+0000 7f71d84ae640 1 --2- 172.21.15.5:0/1873789156 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71d01012f0 0x7f71d010bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.660+0000 7f71d84ae640 1 -- 172.21.15.5:0/1873789156 >> 172.21.15.5:0/1873789156 conn(0x7f71d00f6e80 msgr2=0x7f71d00f7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.660+0000 7f71d84ae640 1 -- 172.21.15.5:0/1873789156 shutdown_connections 2024-04-16T14:46:44.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.660+0000 7f71d84ae640 1 -- 172.21.15.5:0/1873789156 wait complete. 2024-04-16T14:46:44.669 DEBUG:tasks.fs:max_mds reduced in epoch 31 2024-04-16T14:46:44.669 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-04-16T14:46:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.773+0000 7fa84bd1d640 1 -- 172.21.15.5:0/2858319887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa844101150 msgr2=0x7fa844101520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.773+0000 7fa84bd1d640 1 --2- 172.21.15.5:0/2858319887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa844101150 0x7fa844101520 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa8400048d0 tx=0x7fa840009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.773+0000 7fa84bd1d640 1 -- 172.21.15.5:0/2858319887 shutdown_connections 2024-04-16T14:46:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.773+0000 7fa84bd1d640 1 --2- 172.21.15.5:0/2858319887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8440fb120 0x7fa8440fb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.773+0000 7fa84bd1d640 1 --2- 172.21.15.5:0/2858319887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa844101150 0x7fa844101520 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:44.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.773+0000 7fa84bd1d640 1 -- 172.21.15.5:0/2858319887 >> 172.21.15.5:0/2858319887 conn(0x7fa8440710c0 msgr2=0x7fa8440714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.773+0000 7fa84bd1d640 1 -- 172.21.15.5:0/2858319887 shutdown_connections 2024-04-16T14:46:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.773+0000 7fa84bd1d640 1 -- 172.21.15.5:0/2858319887 wait complete. 2024-04-16T14:46:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.773+0000 7fa84bd1d640 1 Processor -- start 2024-04-16T14:46:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.773+0000 7fa84bd1d640 1 -- start start 2024-04-16T14:46:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.773+0000 7fa84bd1d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8440fb120 0x7fa84410de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.773+0000 7fa84bd1d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa844101150 0x7fa84410e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.773+0000 7fa84bd1d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa844065340 con 0x7fa8440fb120 2024-04-16T14:46:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.773+0000 7fa84bd1d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84410e920 con 0x7fa844101150 2024-04-16T14:46:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.774+0000 7fa849ab9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8440fb120 0x7fa84410de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.774+0000 7fa849ab9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8440fb120 0x7fa84410de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53880/0 (socket says 172.21.15.5:53880) 2024-04-16T14:46:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.774+0000 7fa849ab9640 1 -- 172.21.15.5:0/1330310361 learned_addr learned my addr 172.21.15.5:0/1330310361 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.774+0000 7fa8492b8640 1 --2- 172.21.15.5:0/1330310361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa844101150 0x7fa84410e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:44.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.774+0000 7fa849ab9640 1 -- 172.21.15.5:0/1330310361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa844101150 msgr2=0x7fa84410e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.774+0000 7fa849ab9640 1 --2- 172.21.15.5:0/1330310361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa844101150 0x7fa84410e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.774+0000 7fa849ab9640 1 -- 172.21.15.5:0/1330310361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa840005040 con 0x7fa8440fb120 2024-04-16T14:46:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.774+0000 7fa8492b8640 1 --2- 172.21.15.5:0/1330310361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa844101150 0x7fa84410e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T14:46:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.774+0000 7fa849ab9640 1 --2- 172.21.15.5:0/1330310361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8440fb120 0x7fa84410de70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa8400041d0 tx=0x7fa840009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.774+0000 7fa83a7fc640 1 -- 172.21.15.5:0/1330310361 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa840030870 con 0x7fa8440fb120 2024-04-16T14:46:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.774+0000 7fa83a7fc640 1 -- 172.21.15.5:0/1330310361 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa8400092e0 con 0x7fa8440fb120 2024-04-16T14:46:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.774+0000 7fa84bd1d640 1 -- 172.21.15.5:0/1330310361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa84410eba0 con 0x7fa8440fb120 2024-04-16T14:46:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.774+0000 7fa83a7fc640 1 -- 172.21.15.5:0/1330310361 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa840043400 con 0x7fa8440fb120 2024-04-16T14:46:44.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.774+0000 7fa84bd1d640 1 -- 172.21.15.5:0/1330310361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa844117130 con 0x7fa8440fb120 2024-04-16T14:46:44.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.775+0000 7fa84bd1d640 1 -- 172.21.15.5:0/1330310361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8440fc810 con 0x7fa8440fb120 2024-04-16T14:46:44.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.776+0000 7fa83a7fc640 1 -- 172.21.15.5:0/1330310361 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fa84003b420 con 0x7fa8440fb120 2024-04-16T14:46:44.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.776+0000 7fa83a7fc640 1 --2- 172.21.15.5:0/1330310361 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa83006e0b0 0x7fa830070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:44.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.776+0000 7fa83a7fc640 1 -- 172.21.15.5:0/1330310361 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa8400b08b0 con 0x7fa8440fb120 2024-04-16T14:46:44.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.776+0000 7fa8492b8640 1 --2- 172.21.15.5:0/1330310361 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa83006e0b0 0x7fa830070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:44.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.777+0000 7fa8492b8640 1 --2- 172.21.15.5:0/1330310361 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa83006e0b0 0x7fa830070560 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa834009fd0 tx=0x7fa834009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:44.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:44.781+0000 7fa83a7fc640 1 -- 172.21.15.5:0/1330310361 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fa840079ca0 con 0x7fa8440fb120 2024-04-16T14:46:45.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.002+0000 7fa84bd1d640 1 -- 172.21.15.5:0/1330310361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7fa84404bcc0 con 0x7fa8440fb120 2024-04-16T14:46:45.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.003+0000 7fa83a7fc640 1 -- 172.21.15.5:0/1330310361 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v44) v1 ==== 107+0+4152 (secure 0 0 0) 0x7fa84007d360 con 0x7fa8440fb120 2024-04-16T14:46:45.001 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:45.002 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34434,"name":"cephfs.smithi005.vzoqdl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6827/3940274196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3940274196},{"type":"v1","addr":"172.21.15.5:6827","nonce":3940274196}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44277,"name":"cephfs.smithi115.byfytg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6825/1266846723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1266846723},{"type":"v1","addr":"172.21.15.115:6825","nonce":1266846723}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T14:32:45.270024+0000","modified":"2024-04-16T14:42:47.152619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24275},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24275":{"gid":24275,"name":"cephfs.smithi115.trkaqh","rank":0,"incarnation":30,"state":"up:rejoin","state_seq":150,"addr":"172.21.15.115:6827/2476249308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2476249308},{"type":"v1","addr":"172.21.15.115:6827","nonce":2476249308}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-16T14:46:45.002 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 32 2024-04-16T14:46:45.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.005+0000 7fa84bd1d640 1 -- 172.21.15.5:0/1330310361 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa83006e0b0 msgr2=0x7fa830070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:45.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.005+0000 7fa84bd1d640 1 --2- 172.21.15.5:0/1330310361 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa83006e0b0 0x7fa830070560 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa834009fd0 tx=0x7fa834009e50 comp rx=0 tx=0).stop 2024-04-16T14:46:45.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.005+0000 7fa84bd1d640 1 -- 172.21.15.5:0/1330310361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8440fb120 msgr2=0x7fa84410de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:45.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.005+0000 7fa84bd1d640 1 --2- 172.21.15.5:0/1330310361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8440fb120 0x7fa84410de70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa8400041d0 tx=0x7fa840009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:45.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.005+0000 7fa84bd1d640 1 -- 172.21.15.5:0/1330310361 shutdown_connections 2024-04-16T14:46:45.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.005+0000 7fa84bd1d640 1 --2- 172.21.15.5:0/1330310361 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa83006e0b0 0x7fa830070560 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:45.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.005+0000 7fa84bd1d640 1 --2- 172.21.15.5:0/1330310361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa844101150 0x7fa84410e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:45.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.005+0000 7fa84bd1d640 1 --2- 172.21.15.5:0/1330310361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8440fb120 0x7fa84410de70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:45.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.005+0000 7fa84bd1d640 1 -- 172.21.15.5:0/1330310361 >> 172.21.15.5:0/1330310361 conn(0x7fa8440710c0 msgr2=0x7fa8440f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:45.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.005+0000 7fa84bd1d640 1 -- 172.21.15.5:0/1330310361 shutdown_connections 2024-04-16T14:46:45.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.005+0000 7fa84bd1d640 1 -- 172.21.15.5:0/1330310361 wait complete. 2024-04-16T14:46:45.014 DEBUG:tasks.fs:max_mds reduced in epoch 32 2024-04-16T14:46:45.014 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-04-16T14:46:45.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.118+0000 7f448439d640 1 -- 172.21.15.5:0/4188292302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c102da0 msgr2=0x7f447c0fc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:45.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.118+0000 7f448439d640 1 --2- 172.21.15.5:0/4188292302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c102da0 0x7f447c0fc430 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f446c0048d0 tx=0x7f446c009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:45.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.118+0000 7f448439d640 1 -- 172.21.15.5:0/4188292302 shutdown_connections 2024-04-16T14:46:45.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.118+0000 7f448439d640 1 --2- 172.21.15.5:0/4188292302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c102da0 0x7f447c0fc430 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:45.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.118+0000 7f448439d640 1 --2- 172.21.15.5:0/4188292302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f447c102400 0x7f447c1027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:45.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.118+0000 7f448439d640 1 -- 172.21.15.5:0/4188292302 >> 172.21.15.5:0/4188292302 conn(0x7f447c0f7fb0 msgr2=0x7f447c0fa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:45.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.118+0000 7f448439d640 1 -- 172.21.15.5:0/4188292302 shutdown_connections 2024-04-16T14:46:45.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.118+0000 7f448439d640 1 -- 172.21.15.5:0/4188292302 wait complete. 2024-04-16T14:46:45.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.119+0000 7f448439d640 1 Processor -- start 2024-04-16T14:46:45.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.119+0000 7f448439d640 1 -- start start 2024-04-16T14:46:45.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.119+0000 7f448439d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c102400 0x7f447c112f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:45.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.119+0000 7f448439d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f447c102da0 0x7f447c113490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:45.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.119+0000 7f448439d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447c113a90 con 0x7f447c102400 2024-04-16T14:46:45.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.119+0000 7f448439d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447c10d0e0 con 0x7f447c102da0 2024-04-16T14:46:45.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.119+0000 7f4482139640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c102400 0x7f447c112f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:45.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.119+0000 7f4482139640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c102400 0x7f447c112f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53902/0 (socket says 172.21.15.5:53902) 2024-04-16T14:46:45.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.119+0000 7f4482139640 1 -- 172.21.15.5:0/4221110128 learned_addr learned my addr 172.21.15.5:0/4221110128 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:45.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.119+0000 7f4481938640 1 --2- 172.21.15.5:0/4221110128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f447c102da0 0x7f447c113490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:45.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.119+0000 7f4482139640 1 -- 172.21.15.5:0/4221110128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f447c102da0 msgr2=0x7f447c113490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.119+0000 7f4482139640 1 --2- 172.21.15.5:0/4221110128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f447c102da0 0x7f447c113490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.119+0000 7f4482139640 1 -- 172.21.15.5:0/4221110128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c005040 con 0x7f447c102400 2024-04-16T14:46:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.119+0000 7f4482139640 1 --2- 172.21.15.5:0/4221110128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c102400 0x7f447c112f50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4478002a50 tx=0x7f4478004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.120+0000 7f4472ffd640 1 -- 172.21.15.5:0/4221110128 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4478007c30 con 0x7f447c102400 2024-04-16T14:46:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.120+0000 7f448439d640 1 -- 172.21.15.5:0/4221110128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f447c10d3c0 con 0x7f447c102400 2024-04-16T14:46:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.120+0000 7f4472ffd640 1 -- 172.21.15.5:0/4221110128 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f447800f040 con 0x7f447c102400 2024-04-16T14:46:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.120+0000 7f4472ffd640 1 -- 172.21.15.5:0/4221110128 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f447800db60 con 0x7f447c102400 2024-04-16T14:46:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.120+0000 7f448439d640 1 -- 172.21.15.5:0/4221110128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f447c10d8b0 con 0x7f447c102400 2024-04-16T14:46:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.120+0000 7f448439d640 1 -- 172.21.15.5:0/4221110128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f447c0fdb70 con 0x7f447c102400 2024-04-16T14:46:45.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.121+0000 7f4472ffd640 1 -- 172.21.15.5:0/4221110128 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f447800dcc0 con 0x7f447c102400 2024-04-16T14:46:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.121+0000 7f4472ffd640 1 --2- 172.21.15.5:0/4221110128 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f446806e0c0 0x7f4468070570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.122+0000 7f4472ffd640 1 -- 172.21.15.5:0/4221110128 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f447808db40 con 0x7f447c102400 2024-04-16T14:46:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.122+0000 7f4481938640 1 --2- 172.21.15.5:0/4221110128 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f446806e0c0 0x7f4468070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:45.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.122+0000 7f4481938640 1 --2- 172.21.15.5:0/4221110128 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f446806e0c0 0x7f4468070570 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f446c0048a0 tx=0x7f446c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:45.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.126+0000 7f4472ffd640 1 -- 172.21.15.5:0/4221110128 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f4478056e10 con 0x7f447c102400 2024-04-16T14:46:45.267 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:45 smithi005 ceph-mon[93420]: pgmap v318: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:45.268 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:45 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/368454233' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-04-16T14:46:45.268 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:45 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/1873789156' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-04-16T14:46:45.268 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:45 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/1330310361' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-04-16T14:46:45.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.352+0000 7f448439d640 1 -- 172.21.15.5:0/4221110128 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f447c063900 con 0x7f447c102400 2024-04-16T14:46:45.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.352+0000 7f4472ffd640 1 -- 172.21.15.5:0/4221110128 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v44) v1 ==== 107+0+4161 (secure 0 0 0) 0x7f447805a4d0 con 0x7f447c102400 2024-04-16T14:46:45.351 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:45.351 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34434,"name":"cephfs.smithi005.vzoqdl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6827/3940274196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3940274196},{"type":"v1","addr":"172.21.15.5:6827","nonce":3940274196}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44277,"name":"cephfs.smithi115.byfytg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6825/1266846723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1266846723},{"type":"v1","addr":"172.21.15.115:6825","nonce":1266846723}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T14:32:45.270024+0000","modified":"2024-04-16T14:42:49.154682+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24275},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24275":{"gid":24275,"name":"cephfs.smithi115.trkaqh","rank":0,"incarnation":30,"state":"up:active","state_seq":151,"addr":"172.21.15.115:6827/2476249308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2476249308},{"type":"v1","addr":"172.21.15.115:6827","nonce":2476249308}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24275,"qdb_cluster":[24275]},"id":1}]} 2024-04-16T14:46:45.351 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 33 2024-04-16T14:46:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.354+0000 7f448439d640 1 -- 172.21.15.5:0/4221110128 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f446806e0c0 msgr2=0x7f4468070570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.354+0000 7f448439d640 1 --2- 172.21.15.5:0/4221110128 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f446806e0c0 0x7f4468070570 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f446c0048a0 tx=0x7f446c009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.354+0000 7f448439d640 1 -- 172.21.15.5:0/4221110128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c102400 msgr2=0x7f447c112f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.354+0000 7f448439d640 1 --2- 172.21.15.5:0/4221110128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c102400 0x7f447c112f50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4478002a50 tx=0x7f4478004600 comp rx=0 tx=0).stop 2024-04-16T14:46:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.354+0000 7f448439d640 1 -- 172.21.15.5:0/4221110128 shutdown_connections 2024-04-16T14:46:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.354+0000 7f448439d640 1 --2- 172.21.15.5:0/4221110128 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f446806e0c0 0x7f4468070570 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.354+0000 7f448439d640 1 --2- 172.21.15.5:0/4221110128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f447c102da0 0x7f447c113490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.354+0000 7f448439d640 1 --2- 172.21.15.5:0/4221110128 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f447c102400 0x7f447c112f50 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.354+0000 7f448439d640 1 -- 172.21.15.5:0/4221110128 >> 172.21.15.5:0/4221110128 conn(0x7f447c0f7fb0 msgr2=0x7f447c0f8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.354+0000 7f448439d640 1 -- 172.21.15.5:0/4221110128 shutdown_connections 2024-04-16T14:46:45.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.354+0000 7f448439d640 1 -- 172.21.15.5:0/4221110128 wait complete. 2024-04-16T14:46:45.363 DEBUG:tasks.fs:max_mds reduced in epoch 33 2024-04-16T14:46:45.363 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2024-04-16T14:46:45.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:45 smithi115 ceph-mon[83414]: pgmap v318: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:45.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:45 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/368454233' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-04-16T14:46:45.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:45 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/1873789156' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-04-16T14:46:45.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:45 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/1330310361' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-04-16T14:46:45.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.468+0000 7f22c815d640 1 -- 172.21.15.5:0/801303511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22c0102da0 msgr2=0x7f22c00fc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:45.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.468+0000 7f22c815d640 1 --2- 172.21.15.5:0/801303511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22c0102da0 0x7f22c00fc430 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f22b40048d0 tx=0x7f22b4009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:45.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.468+0000 7f22c815d640 1 -- 172.21.15.5:0/801303511 shutdown_connections 2024-04-16T14:46:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.468+0000 7f22c815d640 1 --2- 172.21.15.5:0/801303511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22c0102da0 0x7f22c00fc430 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.468+0000 7f22c815d640 1 --2- 172.21.15.5:0/801303511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22c0102400 0x7f22c01027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.468+0000 7f22c815d640 1 -- 172.21.15.5:0/801303511 >> 172.21.15.5:0/801303511 conn(0x7f22c00f7fb0 msgr2=0x7f22c00fa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.468+0000 7f22c815d640 1 -- 172.21.15.5:0/801303511 shutdown_connections 2024-04-16T14:46:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.468+0000 7f22c815d640 1 -- 172.21.15.5:0/801303511 wait complete. 2024-04-16T14:46:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.469+0000 7f22c815d640 1 Processor -- start 2024-04-16T14:46:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.469+0000 7f22c815d640 1 -- start start 2024-04-16T14:46:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.469+0000 7f22c815d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22c0102400 0x7f22c0112f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.469+0000 7f22c815d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22c0102da0 0x7f22c01134b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.469+0000 7f22c815d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c0113ab0 con 0x7f22c0102400 2024-04-16T14:46:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.469+0000 7f22c815d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c010d100 con 0x7f22c0102da0 2024-04-16T14:46:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.469+0000 7f22c5ef9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22c0102400 0x7f22c0112f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:45.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.469+0000 7f22c5ef9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22c0102400 0x7f22c0112f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53930/0 (socket says 172.21.15.5:53930) 2024-04-16T14:46:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.469+0000 7f22c5ef9640 1 -- 172.21.15.5:0/153619007 learned_addr learned my addr 172.21.15.5:0/153619007 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.469+0000 7f22c56f8640 1 --2- 172.21.15.5:0/153619007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22c0102da0 0x7f22c01134b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.469+0000 7f22c5ef9640 1 -- 172.21.15.5:0/153619007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22c0102da0 msgr2=0x7f22c01134b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.469+0000 7f22c5ef9640 1 --2- 172.21.15.5:0/153619007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22c0102da0 0x7f22c01134b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.469+0000 7f22c5ef9640 1 -- 172.21.15.5:0/153619007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b4005040 con 0x7f22c0102400 2024-04-16T14:46:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.469+0000 7f22c5ef9640 1 --2- 172.21.15.5:0/153619007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22c0102400 0x7f22c0112f70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f22b000db00 tx=0x7f22b0004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.469+0000 7f22be7fc640 1 -- 172.21.15.5:0/153619007 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22b0017070 con 0x7f22c0102400 2024-04-16T14:46:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.469+0000 7f22be7fc640 1 -- 172.21.15.5:0/153619007 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f22b000f040 con 0x7f22c0102400 2024-04-16T14:46:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.469+0000 7f22c815d640 1 -- 172.21.15.5:0/153619007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c010d3e0 con 0x7f22c0102400 2024-04-16T14:46:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.469+0000 7f22be7fc640 1 -- 172.21.15.5:0/153619007 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22b0003ae0 con 0x7f22c0102400 2024-04-16T14:46:45.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.469+0000 7f22c815d640 1 -- 172.21.15.5:0/153619007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c010d8d0 con 0x7f22c0102400 2024-04-16T14:46:45.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.470+0000 7f22c815d640 1 -- 172.21.15.5:0/153619007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22c00fdb70 con 0x7f22c0102400 2024-04-16T14:46:45.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.471+0000 7f22be7fc640 1 -- 172.21.15.5:0/153619007 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f22b0003c40 con 0x7f22c0102400 2024-04-16T14:46:45.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.471+0000 7f22be7fc640 1 --2- 172.21.15.5:0/153619007 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f22a806e0b0 0x7f22a8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:45.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.471+0000 7f22be7fc640 1 -- 172.21.15.5:0/153619007 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f22b008dd20 con 0x7f22c0102400 2024-04-16T14:46:45.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.471+0000 7f22c56f8640 1 --2- 172.21.15.5:0/153619007 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f22a806e0b0 0x7f22a8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:45.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.472+0000 7f22c56f8640 1 --2- 172.21.15.5:0/153619007 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f22a806e0b0 0x7f22a8070560 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f22c00fdff0 tx=0x7f22b4009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:45.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.476+0000 7f22be7fc640 1 -- 172.21.15.5:0/153619007 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f22b0056fd0 con 0x7f22c0102400 2024-04-16T14:46:45.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.700+0000 7f22c815d640 1 -- 172.21.15.5:0/153619007 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f22c00638d0 con 0x7f22c0102400 2024-04-16T14:46:45.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.700+0000 7f22be7fc640 1 -- 172.21.15.5:0/153619007 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v44) v1 ==== 107+0+5005 (secure 0 0 0) 0x7f22b005a690 con 0x7f22c0102400 2024-04-16T14:46:45.699 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:45.699 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34434,"name":"cephfs.smithi005.vzoqdl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6827/3940274196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3940274196},{"type":"v1","addr":"172.21.15.5:6827","nonce":3940274196}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":34438,"name":"cephfs.smithi005.wofqlz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6829/3592708911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3592708911},{"type":"v1","addr":"172.21.15.5:6829","nonce":3592708911}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44277,"name":"cephfs.smithi115.byfytg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6825/1266846723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1266846723},{"type":"v1","addr":"172.21.15.115:6825","nonce":1266846723}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T14:32:45.270024+0000","modified":"2024-04-16T14:42:49.154682+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24275},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24275":{"gid":24275,"name":"cephfs.smithi115.trkaqh","rank":0,"incarnation":30,"state":"up:active","state_seq":151,"addr":"172.21.15.115:6827/2476249308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2476249308},{"type":"v1","addr":"172.21.15.115:6827","nonce":2476249308}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24275,"qdb_cluster":[24275]},"id":1}]} 2024-04-16T14:46:45.699 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 34 2024-04-16T14:46:45.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.703+0000 7f22c815d640 1 -- 172.21.15.5:0/153619007 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f22a806e0b0 msgr2=0x7f22a8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:45.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.703+0000 7f22c815d640 1 --2- 172.21.15.5:0/153619007 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f22a806e0b0 0x7f22a8070560 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f22c00fdff0 tx=0x7f22b4009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:45.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.703+0000 7f22c815d640 1 -- 172.21.15.5:0/153619007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22c0102400 msgr2=0x7f22c0112f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:45.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.703+0000 7f22c815d640 1 --2- 172.21.15.5:0/153619007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22c0102400 0x7f22c0112f70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f22b000db00 tx=0x7f22b0004e60 comp rx=0 tx=0).stop 2024-04-16T14:46:45.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.703+0000 7f22c815d640 1 -- 172.21.15.5:0/153619007 shutdown_connections 2024-04-16T14:46:45.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.703+0000 7f22c815d640 1 --2- 172.21.15.5:0/153619007 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f22a806e0b0 0x7f22a8070560 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:45.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.703+0000 7f22c815d640 1 --2- 172.21.15.5:0/153619007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22c0102da0 0x7f22c01134b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:45.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.703+0000 7f22c815d640 1 --2- 172.21.15.5:0/153619007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f22c0102400 0x7f22c0112f70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:45.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.703+0000 7f22c815d640 1 -- 172.21.15.5:0/153619007 >> 172.21.15.5:0/153619007 conn(0x7f22c00f7fb0 msgr2=0x7f22c00f8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:45.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.703+0000 7f22c815d640 1 -- 172.21.15.5:0/153619007 shutdown_connections 2024-04-16T14:46:45.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.703+0000 7f22c815d640 1 -- 172.21.15.5:0/153619007 wait complete. 2024-04-16T14:46:45.712 DEBUG:tasks.fs:max_mds reduced in epoch 34 2024-04-16T14:46:45.712 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 35 2024-04-16T14:46:45.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.816+0000 7f198671d640 1 -- 172.21.15.5:0/3515301013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19801022a0 msgr2=0x7f1980102670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:45.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.816+0000 7f198671d640 1 --2- 172.21.15.5:0/3515301013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19801022a0 0x7f1980102670 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f19700048d0 tx=0x7f1970009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.816+0000 7f198671d640 1 -- 172.21.15.5:0/3515301013 shutdown_connections 2024-04-16T14:46:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.816+0000 7f198671d640 1 --2- 172.21.15.5:0/3515301013 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19800fa8a0 0x7f19800fad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.816+0000 7f198671d640 1 --2- 172.21.15.5:0/3515301013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19801022a0 0x7f1980102670 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.816+0000 7f198671d640 1 -- 172.21.15.5:0/3515301013 >> 172.21.15.5:0/3515301013 conn(0x7f1980071760 msgr2=0x7f1980071b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.816+0000 7f198671d640 1 -- 172.21.15.5:0/3515301013 shutdown_connections 2024-04-16T14:46:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.816+0000 7f198671d640 1 -- 172.21.15.5:0/3515301013 wait complete. 2024-04-16T14:46:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.817+0000 7f198671d640 1 Processor -- start 2024-04-16T14:46:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.817+0000 7f198671d640 1 -- start start 2024-04-16T14:46:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.817+0000 7f198671d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19800fa8a0 0x7f19800fba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.817+0000 7f198671d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19801022a0 0x7f19800fbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.817+0000 7f198671d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19800fd960 con 0x7f19801022a0 2024-04-16T14:46:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.817+0000 7f198671d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19800fc500 con 0x7f19800fa8a0 2024-04-16T14:46:45.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.817+0000 7f197f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19801022a0 0x7f19800fbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:45.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.817+0000 7f197f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19801022a0 0x7f19800fbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53948/0 (socket says 172.21.15.5:53948) 2024-04-16T14:46:45.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.817+0000 7f197f7fe640 1 -- 172.21.15.5:0/2734983049 learned_addr learned my addr 172.21.15.5:0/2734983049 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:45.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.817+0000 7f197ffff640 1 --2- 172.21.15.5:0/2734983049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19800fa8a0 0x7f19800fba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:45.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.817+0000 7f197f7fe640 1 -- 172.21.15.5:0/2734983049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19800fa8a0 msgr2=0x7f19800fba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:45.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.817+0000 7f197f7fe640 1 --2- 172.21.15.5:0/2734983049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19800fa8a0 0x7f19800fba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:45.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.817+0000 7f197f7fe640 1 -- 172.21.15.5:0/2734983049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1970005040 con 0x7f19801022a0 2024-04-16T14:46:45.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.818+0000 7f197f7fe640 1 --2- 172.21.15.5:0/2734983049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19801022a0 0x7f19800fbfc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f197400eb70 tx=0x7f197400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:45.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.818+0000 7f197cff9640 1 -- 172.21.15.5:0/2734983049 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1974007c30 con 0x7f19801022a0 2024-04-16T14:46:45.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.818+0000 7f197cff9640 1 -- 172.21.15.5:0/2734983049 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f197400f040 con 0x7f19801022a0 2024-04-16T14:46:45.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.818+0000 7f198671d640 1 -- 172.21.15.5:0/2734983049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19800fc780 con 0x7f19801022a0 2024-04-16T14:46:45.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.818+0000 7f197cff9640 1 -- 172.21.15.5:0/2734983049 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19740095b0 con 0x7f19801022a0 2024-04-16T14:46:45.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.818+0000 7f198671d640 1 -- 172.21.15.5:0/2734983049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1980119490 con 0x7f19801022a0 2024-04-16T14:46:45.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.819+0000 7f198671d640 1 -- 172.21.15.5:0/2734983049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1980065340 con 0x7f19801022a0 2024-04-16T14:46:45.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.819+0000 7f197cff9640 1 -- 172.21.15.5:0/2734983049 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f1974009730 con 0x7f19801022a0 2024-04-16T14:46:45.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.820+0000 7f197cff9640 1 --2- 172.21.15.5:0/2734983049 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f196806e0b0 0x7f1968070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:45.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.820+0000 7f197cff9640 1 -- 172.21.15.5:0/2734983049 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f197408d8a0 con 0x7f19801022a0 2024-04-16T14:46:45.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.820+0000 7f197ffff640 1 --2- 172.21.15.5:0/2734983049 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f196806e0b0 0x7f1968070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:45.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.820+0000 7f197ffff640 1 --2- 172.21.15.5:0/2734983049 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f196806e0b0 0x7f1968070560 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1970000c00 tx=0x7f1970009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:45.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:45.824+0000 7f197cff9640 1 -- 172.21.15.5:0/2734983049 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f1974056c20 con 0x7f19801022a0 2024-04-16T14:46:46.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.046+0000 7f198671d640 1 -- 172.21.15.5:0/2734983049 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7f198004bcc0 con 0x7f19801022a0 2024-04-16T14:46:46.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.047+0000 7f197cff9640 1 -- 172.21.15.5:0/2734983049 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v44) v1 ==== 107+0+4223 (secure 0 0 0) 0x7f197405a2e0 con 0x7f19801022a0 2024-04-16T14:46:46.046 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:46.046 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34434,"name":"cephfs.smithi005.vzoqdl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6827/3940274196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3940274196},{"type":"v1","addr":"172.21.15.5:6827","nonce":3940274196}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":34438,"name":"cephfs.smithi005.wofqlz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6829/3592708911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3592708911},{"type":"v1","addr":"172.21.15.5:6829","nonce":3592708911}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T14:32:45.270024+0000","modified":"2024-04-16T14:42:49.154682+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24275},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24275":{"gid":24275,"name":"cephfs.smithi115.trkaqh","rank":0,"incarnation":30,"state":"up:active","state_seq":151,"addr":"172.21.15.115:6827/2476249308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2476249308},{"type":"v1","addr":"172.21.15.115:6827","nonce":2476249308}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24275,"qdb_cluster":[24275]},"id":1}]} 2024-04-16T14:46:46.046 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 35 2024-04-16T14:46:46.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.049+0000 7f198671d640 1 -- 172.21.15.5:0/2734983049 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f196806e0b0 msgr2=0x7f1968070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:46.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.049+0000 7f198671d640 1 --2- 172.21.15.5:0/2734983049 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f196806e0b0 0x7f1968070560 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1970000c00 tx=0x7f1970009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:46.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.049+0000 7f198671d640 1 -- 172.21.15.5:0/2734983049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19801022a0 msgr2=0x7f19800fbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:46.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.049+0000 7f198671d640 1 --2- 172.21.15.5:0/2734983049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19801022a0 0x7f19800fbfc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f197400eb70 tx=0x7f197400b040 comp rx=0 tx=0).stop 2024-04-16T14:46:46.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.049+0000 7f198671d640 1 -- 172.21.15.5:0/2734983049 shutdown_connections 2024-04-16T14:46:46.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.049+0000 7f198671d640 1 --2- 172.21.15.5:0/2734983049 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f196806e0b0 0x7f1968070560 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:46.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.049+0000 7f198671d640 1 --2- 172.21.15.5:0/2734983049 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f19801022a0 0x7f19800fbfc0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:46.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.049+0000 7f198671d640 1 --2- 172.21.15.5:0/2734983049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19800fa8a0 0x7f19800fba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:46.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.049+0000 7f198671d640 1 -- 172.21.15.5:0/2734983049 >> 172.21.15.5:0/2734983049 conn(0x7f1980071760 msgr2=0x7f19800f9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:46.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.049+0000 7f198671d640 1 -- 172.21.15.5:0/2734983049 shutdown_connections 2024-04-16T14:46:46.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.050+0000 7f198671d640 1 -- 172.21.15.5:0/2734983049 wait complete. 2024-04-16T14:46:46.059 DEBUG:tasks.fs:max_mds reduced in epoch 35 2024-04-16T14:46:46.059 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 36 2024-04-16T14:46:46.162 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.163+0000 7f477306e640 1 -- 172.21.15.5:0/4011247531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f476c101c80 msgr2=0x7f476c0fb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:46.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.163+0000 7f477306e640 1 --2- 172.21.15.5:0/4011247531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f476c101c80 0x7f476c0fb310 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4754009c50 tx=0x7f4754004d10 comp rx=0 tx=0).stop 2024-04-16T14:46:46.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.164+0000 7f477306e640 1 -- 172.21.15.5:0/4011247531 shutdown_connections 2024-04-16T14:46:46.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.164+0000 7f477306e640 1 --2- 172.21.15.5:0/4011247531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f476c101c80 0x7f476c0fb310 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:46.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.164+0000 7f477306e640 1 --2- 172.21.15.5:0/4011247531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f476c1012e0 0x7f476c1016b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:46.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.164+0000 7f477306e640 1 -- 172.21.15.5:0/4011247531 >> 172.21.15.5:0/4011247531 conn(0x7f476c0f6eb0 msgr2=0x7f476c0f92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:46.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.164+0000 7f477306e640 1 -- 172.21.15.5:0/4011247531 shutdown_connections 2024-04-16T14:46:46.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.164+0000 7f477306e640 1 -- 172.21.15.5:0/4011247531 wait complete. 2024-04-16T14:46:46.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.164+0000 7f477306e640 1 Processor -- start 2024-04-16T14:46:46.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.164+0000 7f477306e640 1 -- start start 2024-04-16T14:46:46.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.165+0000 7f477306e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f476c1012e0 0x7f476c111e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:46.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.165+0000 7f477306e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f476c101c80 0x7f476c112340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:46.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.165+0000 7f477306e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476c112940 con 0x7f476c1012e0 2024-04-16T14:46:46.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.165+0000 7f477306e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476c10bf90 con 0x7f476c101c80 2024-04-16T14:46:46.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.165+0000 7f4770e0a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f476c1012e0 0x7f476c111e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:46.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.165+0000 7f4770e0a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f476c1012e0 0x7f476c111e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53974/0 (socket says 172.21.15.5:53974) 2024-04-16T14:46:46.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.165+0000 7f4770e0a640 1 -- 172.21.15.5:0/1714702490 learned_addr learned my addr 172.21.15.5:0/1714702490 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:46.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.165+0000 7f476bfff640 1 --2- 172.21.15.5:0/1714702490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f476c101c80 0x7f476c112340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:46.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.165+0000 7f4770e0a640 1 -- 172.21.15.5:0/1714702490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f476c101c80 msgr2=0x7f476c112340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:46.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.165+0000 7f4770e0a640 1 --2- 172.21.15.5:0/1714702490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f476c101c80 0x7f476c112340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:46.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.165+0000 7f4770e0a640 1 -- 172.21.15.5:0/1714702490 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47540098b0 con 0x7f476c1012e0 2024-04-16T14:46:46.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.165+0000 7f4770e0a640 1 --2- 172.21.15.5:0/1714702490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f476c1012e0 0x7f476c111e00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4764002a50 tx=0x7f4764004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:46.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.166+0000 7f47697fa640 1 -- 172.21.15.5:0/1714702490 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4764007c30 con 0x7f476c1012e0 2024-04-16T14:46:46.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.166+0000 7f47697fa640 1 -- 172.21.15.5:0/1714702490 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f476400f040 con 0x7f476c1012e0 2024-04-16T14:46:46.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.166+0000 7f47697fa640 1 -- 172.21.15.5:0/1714702490 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f476400db50 con 0x7f476c1012e0 2024-04-16T14:46:46.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.166+0000 7f477306e640 1 -- 172.21.15.5:0/1714702490 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f476c10c270 con 0x7f476c1012e0 2024-04-16T14:46:46.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.166+0000 7f477306e640 1 -- 172.21.15.5:0/1714702490 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f476c10c7e0 con 0x7f476c1012e0 2024-04-16T14:46:46.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.167+0000 7f477306e640 1 -- 172.21.15.5:0/1714702490 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f476c0fca50 con 0x7f476c1012e0 2024-04-16T14:46:46.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.168+0000 7f47697fa640 1 -- 172.21.15.5:0/1714702490 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f476400dcf0 con 0x7f476c1012e0 2024-04-16T14:46:46.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.168+0000 7f47697fa640 1 --2- 172.21.15.5:0/1714702490 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f475806e0b0 0x7f4758070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:46.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.168+0000 7f47697fa640 1 -- 172.21.15.5:0/1714702490 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f476408d350 con 0x7f476c1012e0 2024-04-16T14:46:46.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.168+0000 7f476bfff640 1 --2- 172.21.15.5:0/1714702490 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f475806e0b0 0x7f4758070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:46.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.169+0000 7f476bfff640 1 --2- 172.21.15.5:0/1714702490 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f475806e0b0 0x7f4758070560 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4754004a30 tx=0x7f4754037040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:46.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.174+0000 7f47697fa640 1 -- 172.21.15.5:0/1714702490 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f4764056750 con 0x7f476c1012e0 2024-04-16T14:46:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.398+0000 7f477306e640 1 -- 172.21.15.5:0/1714702490 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7f476c0638d0 con 0x7f476c1012e0 2024-04-16T14:46:46.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.398+0000 7f47697fa640 1 -- 172.21.15.5:0/1714702490 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v44) v1 ==== 107+0+5073 (secure 0 0 0) 0x7f4764059e10 con 0x7f476c1012e0 2024-04-16T14:46:46.397 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:46.397 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34434,"name":"cephfs.smithi005.vzoqdl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6827/3940274196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3940274196},{"type":"v1","addr":"172.21.15.5:6827","nonce":3940274196}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":34438,"name":"cephfs.smithi005.wofqlz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6829/3592708911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3592708911},{"type":"v1","addr":"172.21.15.5:6829","nonce":3592708911}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44317,"name":"cephfs.smithi115.byfytg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6825/1461659094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1461659094},{"type":"v1","addr":"172.21.15.115:6825","nonce":1461659094}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T14:32:45.270024+0000","modified":"2024-04-16T14:42:49.154682+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24275},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_24275":{"gid":24275,"name":"cephfs.smithi115.trkaqh","rank":0,"incarnation":30,"state":"up:active","state_seq":151,"addr":"172.21.15.115:6827/2476249308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2476249308},{"type":"v1","addr":"172.21.15.115:6827","nonce":2476249308}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24275,"qdb_cluster":[24275]},"id":1}]} 2024-04-16T14:46:46.397 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 36 2024-04-16T14:46:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.400+0000 7f477306e640 1 -- 172.21.15.5:0/1714702490 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f475806e0b0 msgr2=0x7f4758070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.400+0000 7f477306e640 1 --2- 172.21.15.5:0/1714702490 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f475806e0b0 0x7f4758070560 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4754004a30 tx=0x7f4754037040 comp rx=0 tx=0).stop 2024-04-16T14:46:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.400+0000 7f477306e640 1 -- 172.21.15.5:0/1714702490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f476c1012e0 msgr2=0x7f476c111e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.400+0000 7f477306e640 1 --2- 172.21.15.5:0/1714702490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f476c1012e0 0x7f476c111e00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4764002a50 tx=0x7f4764004600 comp rx=0 tx=0).stop 2024-04-16T14:46:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.400+0000 7f477306e640 1 -- 172.21.15.5:0/1714702490 shutdown_connections 2024-04-16T14:46:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.400+0000 7f477306e640 1 --2- 172.21.15.5:0/1714702490 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f475806e0b0 0x7f4758070560 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.400+0000 7f477306e640 1 --2- 172.21.15.5:0/1714702490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f476c101c80 0x7f476c112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.400+0000 7f477306e640 1 --2- 172.21.15.5:0/1714702490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f476c1012e0 0x7f476c111e00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.400+0000 7f477306e640 1 -- 172.21.15.5:0/1714702490 >> 172.21.15.5:0/1714702490 conn(0x7f476c0f6eb0 msgr2=0x7f476c0f7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.400+0000 7f477306e640 1 -- 172.21.15.5:0/1714702490 shutdown_connections 2024-04-16T14:46:46.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.400+0000 7f477306e640 1 -- 172.21.15.5:0/1714702490 wait complete. 2024-04-16T14:46:46.409 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:46 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/4221110128' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-04-16T14:46:46.409 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:46 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/153619007' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-04-16T14:46:46.409 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:46 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/2734983049' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-04-16T14:46:46.410 DEBUG:tasks.fs:max_mds reduced in epoch 36 2024-04-16T14:46:46.410 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 37 2024-04-16T14:46:46.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:46 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/4221110128' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-04-16T14:46:46.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:46 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/153619007' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-04-16T14:46:46.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:46 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/2734983049' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-04-16T14:46:46.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.513+0000 7fbb8531d640 1 -- 172.21.15.5:0/2365651843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb800643b0 msgr2=0x7fbb800647e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:46.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.513+0000 7fbb8531d640 1 --2- 172.21.15.5:0/2365651843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb800643b0 0x7fbb800647e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbb680048d0 tx=0x7fbb68009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:46.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.513+0000 7fbb8531d640 1 -- 172.21.15.5:0/2365651843 shutdown_connections 2024-04-16T14:46:46.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.513+0000 7fbb8531d640 1 --2- 172.21.15.5:0/2365651843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb800643b0 0x7fbb800647e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:46.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.513+0000 7fbb8531d640 1 --2- 172.21.15.5:0/2365651843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb80102250 0x7fbb80102620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:46.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.513+0000 7fbb8531d640 1 -- 172.21.15.5:0/2365651843 >> 172.21.15.5:0/2365651843 conn(0x7fbb800710c0 msgr2=0x7fbb800714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:46.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.513+0000 7fbb8531d640 1 -- 172.21.15.5:0/2365651843 shutdown_connections 2024-04-16T14:46:46.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.513+0000 7fbb8531d640 1 -- 172.21.15.5:0/2365651843 wait complete. 2024-04-16T14:46:46.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.514+0000 7fbb8531d640 1 Processor -- start 2024-04-16T14:46:46.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.514+0000 7fbb8531d640 1 -- start start 2024-04-16T14:46:46.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.514+0000 7fbb8531d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb800643b0 0x7fbb80112ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:46.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.514+0000 7fbb8531d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb80102250 0x7fbb80113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:46.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.514+0000 7fbb8531d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb80113820 con 0x7fbb800643b0 2024-04-16T14:46:46.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.514+0000 7fbb8531d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8010ce70 con 0x7fbb80102250 2024-04-16T14:46:46.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.514+0000 7fbb7effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb800643b0 0x7fbb80112ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:46.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.514+0000 7fbb7effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb800643b0 0x7fbb80112ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53990/0 (socket says 172.21.15.5:53990) 2024-04-16T14:46:46.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.514+0000 7fbb7effd640 1 -- 172.21.15.5:0/1593544338 learned_addr learned my addr 172.21.15.5:0/1593544338 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.514+0000 7fbb7e7fc640 1 --2- 172.21.15.5:0/1593544338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb80102250 0x7fbb80113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.515+0000 7fbb7effd640 1 -- 172.21.15.5:0/1593544338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb80102250 msgr2=0x7fbb80113220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.515+0000 7fbb7effd640 1 --2- 172.21.15.5:0/1593544338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb80102250 0x7fbb80113220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.515+0000 7fbb7effd640 1 -- 172.21.15.5:0/1593544338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb68005040 con 0x7fbb800643b0 2024-04-16T14:46:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.515+0000 7fbb7effd640 1 --2- 172.21.15.5:0/1593544338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb800643b0 0x7fbb80112ce0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbb7800eb70 tx=0x7fbb7800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.515+0000 7fbb777fe640 1 -- 172.21.15.5:0/1593544338 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb78007c30 con 0x7fbb800643b0 2024-04-16T14:46:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.515+0000 7fbb8531d640 1 -- 172.21.15.5:0/1593544338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb8010d0f0 con 0x7fbb800643b0 2024-04-16T14:46:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.515+0000 7fbb777fe640 1 -- 172.21.15.5:0/1593544338 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbb7800f040 con 0x7fbb800643b0 2024-04-16T14:46:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.515+0000 7fbb777fe640 1 -- 172.21.15.5:0/1593544338 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb780095b0 con 0x7fbb800643b0 2024-04-16T14:46:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.515+0000 7fbb8531d640 1 -- 172.21.15.5:0/1593544338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb8010d5e0 con 0x7fbb800643b0 2024-04-16T14:46:46.516 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.516+0000 7fbb8531d640 1 -- 172.21.15.5:0/1593544338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb800fd950 con 0x7fbb800643b0 2024-04-16T14:46:46.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.516+0000 7fbb777fe640 1 -- 172.21.15.5:0/1593544338 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fbb78009730 con 0x7fbb800643b0 2024-04-16T14:46:46.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.517+0000 7fbb777fe640 1 --2- 172.21.15.5:0/1593544338 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fbb6c06e0b0 0x7fbb6c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:46.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.517+0000 7fbb777fe640 1 -- 172.21.15.5:0/1593544338 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fbb7808d8c0 con 0x7fbb800643b0 2024-04-16T14:46:46.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.517+0000 7fbb7e7fc640 1 --2- 172.21.15.5:0/1593544338 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fbb6c06e0b0 0x7fbb6c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:46.517 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.517+0000 7fbb7e7fc640 1 --2- 172.21.15.5:0/1593544338 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fbb6c06e0b0 0x7fbb6c070560 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbb800faff0 tx=0x7fbb68009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:46.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.521+0000 7fbb777fe640 1 -- 172.21.15.5:0/1593544338 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fbb78056c40 con 0x7fbb800643b0 2024-04-16T14:46:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.744+0000 7fbb8531d640 1 -- 172.21.15.5:0/1593544338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7fbb8010e350 con 0x7fbb800643b0 2024-04-16T14:46:46.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.745+0000 7fbb777fe640 1 -- 172.21.15.5:0/1593544338 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v44) v1 ==== 107+0+4269 (secure 0 0 0) 0x7fbb7805a300 con 0x7fbb800643b0 2024-04-16T14:46:46.743 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:46.744 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34434,"name":"cephfs.smithi005.vzoqdl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6827/3940274196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3940274196},{"type":"v1","addr":"172.21.15.5:6827","nonce":3940274196}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":34438,"name":"cephfs.smithi005.wofqlz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6829/3592708911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3592708911},{"type":"v1","addr":"172.21.15.5:6829","nonce":3592708911}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44317,"name":"cephfs.smithi115.byfytg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6825/1461659094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1461659094},{"type":"v1","addr":"172.21.15.115:6825","nonce":1461659094}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T14:32:45.270024+0000","modified":"2024-04-16T14:43:22.064907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-16T14:46:46.744 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 37 2024-04-16T14:46:46.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.747+0000 7fbb8531d640 1 -- 172.21.15.5:0/1593544338 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fbb6c06e0b0 msgr2=0x7fbb6c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:46.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.747+0000 7fbb8531d640 1 --2- 172.21.15.5:0/1593544338 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fbb6c06e0b0 0x7fbb6c070560 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbb800faff0 tx=0x7fbb68009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:46.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.747+0000 7fbb8531d640 1 -- 172.21.15.5:0/1593544338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb800643b0 msgr2=0x7fbb80112ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:46.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.747+0000 7fbb8531d640 1 --2- 172.21.15.5:0/1593544338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb800643b0 0x7fbb80112ce0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbb7800eb70 tx=0x7fbb7800b040 comp rx=0 tx=0).stop 2024-04-16T14:46:46.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.747+0000 7fbb8531d640 1 -- 172.21.15.5:0/1593544338 shutdown_connections 2024-04-16T14:46:46.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.747+0000 7fbb8531d640 1 --2- 172.21.15.5:0/1593544338 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fbb6c06e0b0 0x7fbb6c070560 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:46.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.747+0000 7fbb8531d640 1 --2- 172.21.15.5:0/1593544338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbb80102250 0x7fbb80113220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:46.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.747+0000 7fbb8531d640 1 --2- 172.21.15.5:0/1593544338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb800643b0 0x7fbb80112ce0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:46.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.747+0000 7fbb8531d640 1 -- 172.21.15.5:0/1593544338 >> 172.21.15.5:0/1593544338 conn(0x7fbb800710c0 msgr2=0x7fbb800f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:46.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.747+0000 7fbb8531d640 1 -- 172.21.15.5:0/1593544338 shutdown_connections 2024-04-16T14:46:46.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.747+0000 7fbb8531d640 1 -- 172.21.15.5:0/1593544338 wait complete. 2024-04-16T14:46:46.756 DEBUG:tasks.fs:max_mds reduced in epoch 37 2024-04-16T14:46:46.757 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 38 2024-04-16T14:46:46.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.861+0000 7f3e0ec6e640 1 -- 172.21.15.5:0/2740813230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e081012f0 msgr2=0x7f3e081016c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:46.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.861+0000 7f3e0ec6e640 1 --2- 172.21.15.5:0/2740813230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e081012f0 0x7f3e081016c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc0048d0 tx=0x7f3dfc009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:46.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.861+0000 7f3e0ec6e640 1 -- 172.21.15.5:0/2740813230 shutdown_connections 2024-04-16T14:46:46.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.861+0000 7f3e0ec6e640 1 --2- 172.21.15.5:0/2740813230 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e08101c90 0x7f3e080fb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:46.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.861+0000 7f3e0ec6e640 1 --2- 172.21.15.5:0/2740813230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e081012f0 0x7f3e081016c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:46.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.861+0000 7f3e0ec6e640 1 -- 172.21.15.5:0/2740813230 >> 172.21.15.5:0/2740813230 conn(0x7f3e080f6ec0 msgr2=0x7f3e080f92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:46.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.861+0000 7f3e0ec6e640 1 -- 172.21.15.5:0/2740813230 shutdown_connections 2024-04-16T14:46:46.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.861+0000 7f3e0ec6e640 1 -- 172.21.15.5:0/2740813230 wait complete. 2024-04-16T14:46:46.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.862+0000 7f3e0ec6e640 1 Processor -- start 2024-04-16T14:46:46.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.862+0000 7f3e0ec6e640 1 -- start start 2024-04-16T14:46:46.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.862+0000 7f3e0ec6e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e081012f0 0x7f3e08112f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:46.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.862+0000 7f3e0ec6e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e08101c90 0x7f3e081134a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:46.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.862+0000 7f3e0ec6e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e08113aa0 con 0x7f3e081012f0 2024-04-16T14:46:46.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.862+0000 7f3e0ec6e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0810d0f0 con 0x7f3e08101c90 2024-04-16T14:46:46.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.862+0000 7f3e0ca0a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e081012f0 0x7f3e08112f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:46.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.862+0000 7f3e0ca0a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e081012f0 0x7f3e08112f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54008/0 (socket says 172.21.15.5:54008) 2024-04-16T14:46:46.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.862+0000 7f3e0ca0a640 1 -- 172.21.15.5:0/3143365762 learned_addr learned my addr 172.21.15.5:0/3143365762 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:46.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.862+0000 7f3e07fff640 1 --2- 172.21.15.5:0/3143365762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e08101c90 0x7f3e081134a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:46.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.862+0000 7f3e0ca0a640 1 -- 172.21.15.5:0/3143365762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e08101c90 msgr2=0x7f3e081134a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:46.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.862+0000 7f3e0ca0a640 1 --2- 172.21.15.5:0/3143365762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e08101c90 0x7f3e081134a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:46.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.862+0000 7f3e0ca0a640 1 -- 172.21.15.5:0/3143365762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dfc005040 con 0x7f3e081012f0 2024-04-16T14:46:46.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.862+0000 7f3e07fff640 1 --2- 172.21.15.5:0/3143365762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e08101c90 0x7f3e081134a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-16T14:46:46.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.863+0000 7f3e0ca0a640 1 --2- 172.21.15.5:0/3143365762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e081012f0 0x7f3e08112f60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc004930 tx=0x7f3dfc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:46.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.863+0000 7f3e057fa640 1 -- 172.21.15.5:0/3143365762 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dfc0094c0 con 0x7f3e081012f0 2024-04-16T14:46:46.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.863+0000 7f3e057fa640 1 -- 172.21.15.5:0/3143365762 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3dfc032e50 con 0x7f3e081012f0 2024-04-16T14:46:46.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.863+0000 7f3e0ec6e640 1 -- 172.21.15.5:0/3143365762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e0810d370 con 0x7f3e081012f0 2024-04-16T14:46:46.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.863+0000 7f3e057fa640 1 -- 172.21.15.5:0/3143365762 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dfc0433b0 con 0x7f3e081012f0 2024-04-16T14:46:46.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.863+0000 7f3e0ec6e640 1 -- 172.21.15.5:0/3143365762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e0810d830 con 0x7f3e081012f0 2024-04-16T14:46:46.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.864+0000 7f3e0ec6e640 1 -- 172.21.15.5:0/3143365762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e080fca60 con 0x7f3e081012f0 2024-04-16T14:46:46.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.864+0000 7f3e057fa640 1 -- 172.21.15.5:0/3143365762 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f3dfc02f070 con 0x7f3e081012f0 2024-04-16T14:46:46.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.865+0000 7f3e057fa640 1 --2- 172.21.15.5:0/3143365762 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3df806e0b0 0x7f3df8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:46.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.865+0000 7f3e057fa640 1 -- 172.21.15.5:0/3143365762 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f3dfc0afb40 con 0x7f3e081012f0 2024-04-16T14:46:46.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.865+0000 7f3e07fff640 1 --2- 172.21.15.5:0/3143365762 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3df806e0b0 0x7f3df8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:46.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.865+0000 7f3e07fff640 1 --2- 172.21.15.5:0/3143365762 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3df806e0b0 0x7f3df8070560 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3df4007fd0 tx=0x7f3df4009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:46.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:46.870+0000 7f3e057fa640 1 -- 172.21.15.5:0/3143365762 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f3dfc078d70 con 0x7f3e081012f0 2024-04-16T14:46:47.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.090+0000 7f3e0ec6e640 1 -- 172.21.15.5:0/3143365762 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) v1 -- 0x7f3e0804bcc0 con 0x7f3e081012f0 2024-04-16T14:46:47.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.091+0000 7f3e057fa640 1 -- 172.21.15.5:0/3143365762 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v44) v1 ==== 107+0+4348 (secure 0 0 0) 0x7f3dfc07c430 con 0x7f3e081012f0 2024-04-16T14:46:47.090 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:47.090 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34438,"name":"cephfs.smithi005.wofqlz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6829/3592708911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3592708911},{"type":"v1","addr":"172.21.15.5:6829","nonce":3592708911}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44317,"name":"cephfs.smithi115.byfytg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6825/1461659094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1461659094},{"type":"v1","addr":"172.21.15.115:6825","nonce":1461659094}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T14:32:45.270024+0000","modified":"2024-04-16T14:43:22.070417+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34434},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34434":{"gid":34434,"name":"cephfs.smithi005.vzoqdl","rank":0,"incarnation":38,"state":"up:replay","state_seq":1,"addr":"172.21.15.5:6827/3940274196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3940274196},{"type":"v1","addr":"172.21.15.5:6827","nonce":3940274196}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-16T14:46:47.090 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 38 2024-04-16T14:46:47.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.093+0000 7f3e0ec6e640 1 -- 172.21.15.5:0/3143365762 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3df806e0b0 msgr2=0x7f3df8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:47.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.093+0000 7f3e0ec6e640 1 --2- 172.21.15.5:0/3143365762 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3df806e0b0 0x7f3df8070560 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3df4007fd0 tx=0x7f3df4009e90 comp rx=0 tx=0).stop 2024-04-16T14:46:47.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.093+0000 7f3e0ec6e640 1 -- 172.21.15.5:0/3143365762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e081012f0 msgr2=0x7f3e08112f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:47.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.093+0000 7f3e0ec6e640 1 --2- 172.21.15.5:0/3143365762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e081012f0 0x7f3e08112f60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc004930 tx=0x7f3dfc009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:47.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.093+0000 7f3e0ec6e640 1 -- 172.21.15.5:0/3143365762 shutdown_connections 2024-04-16T14:46:47.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.093+0000 7f3e0ec6e640 1 --2- 172.21.15.5:0/3143365762 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3df806e0b0 0x7f3df8070560 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:47.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.093+0000 7f3e0ec6e640 1 --2- 172.21.15.5:0/3143365762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e08101c90 0x7f3e081134a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:47.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.093+0000 7f3e0ec6e640 1 --2- 172.21.15.5:0/3143365762 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e081012f0 0x7f3e08112f60 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:47.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.093+0000 7f3e0ec6e640 1 -- 172.21.15.5:0/3143365762 >> 172.21.15.5:0/3143365762 conn(0x7f3e080f6ec0 msgr2=0x7f3e080f7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:47.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.093+0000 7f3e0ec6e640 1 -- 172.21.15.5:0/3143365762 shutdown_connections 2024-04-16T14:46:47.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.093+0000 7f3e0ec6e640 1 -- 172.21.15.5:0/3143365762 wait complete. 2024-04-16T14:46:47.103 DEBUG:tasks.fs:max_mds reduced in epoch 38 2024-04-16T14:46:47.103 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 39 2024-04-16T14:46:47.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.206+0000 7f03e5d5d640 1 -- 172.21.15.5:0/2990946751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e00643b0 msgr2=0x7f03e00647e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:47.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.206+0000 7f03e5d5d640 1 --2- 172.21.15.5:0/2990946751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e00643b0 0x7f03e00647e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f03d40048d0 tx=0x7f03d4009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:47.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.206+0000 7f03e5d5d640 1 -- 172.21.15.5:0/2990946751 shutdown_connections 2024-04-16T14:46:47.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.206+0000 7f03e5d5d640 1 --2- 172.21.15.5:0/2990946751 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e00643b0 0x7f03e00647e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:47.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.206+0000 7f03e5d5d640 1 --2- 172.21.15.5:0/2990946751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03e0102250 0x7f03e0102620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:47.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.206+0000 7f03e5d5d640 1 -- 172.21.15.5:0/2990946751 >> 172.21.15.5:0/2990946751 conn(0x7f03e00710c0 msgr2=0x7f03e00714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:47.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.206+0000 7f03e5d5d640 1 -- 172.21.15.5:0/2990946751 shutdown_connections 2024-04-16T14:46:47.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.206+0000 7f03e5d5d640 1 -- 172.21.15.5:0/2990946751 wait complete. 2024-04-16T14:46:47.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.207+0000 7f03e5d5d640 1 Processor -- start 2024-04-16T14:46:47.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.207+0000 7f03e5d5d640 1 -- start start 2024-04-16T14:46:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.207+0000 7f03e5d5d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e00643b0 0x7f03e0112ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.207+0000 7f03e5d5d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03e0102250 0x7f03e0113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.207+0000 7f03e5d5d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e0113820 con 0x7f03e00643b0 2024-04-16T14:46:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.207+0000 7f03e5d5d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e010ce70 con 0x7f03e0102250 2024-04-16T14:46:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.207+0000 7f03df7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e00643b0 0x7f03e0112ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.207+0000 7f03df7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e00643b0 0x7f03e0112ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54016/0 (socket says 172.21.15.5:54016) 2024-04-16T14:46:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.207+0000 7f03df7fe640 1 -- 172.21.15.5:0/1935934174 learned_addr learned my addr 172.21.15.5:0/1935934174 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.208+0000 7f03deffd640 1 --2- 172.21.15.5:0/1935934174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03e0102250 0x7f03e0113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.208+0000 7f03df7fe640 1 -- 172.21.15.5:0/1935934174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03e0102250 msgr2=0x7f03e0113220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.208+0000 7f03df7fe640 1 --2- 172.21.15.5:0/1935934174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03e0102250 0x7f03e0113220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.208+0000 7f03df7fe640 1 -- 172.21.15.5:0/1935934174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d4005040 con 0x7f03e00643b0 2024-04-16T14:46:47.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.208+0000 7f03df7fe640 1 --2- 172.21.15.5:0/1935934174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e00643b0 0x7f03e0112ce0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f03d0002a50 tx=0x7f03d0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:47.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.208+0000 7f03c7fff640 1 -- 172.21.15.5:0/1935934174 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03d0007c30 con 0x7f03e00643b0 2024-04-16T14:46:47.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.208+0000 7f03c7fff640 1 -- 172.21.15.5:0/1935934174 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f03d000f040 con 0x7f03e00643b0 2024-04-16T14:46:47.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.208+0000 7f03e5d5d640 1 -- 172.21.15.5:0/1935934174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e010d150 con 0x7f03e00643b0 2024-04-16T14:46:47.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.208+0000 7f03c7fff640 1 -- 172.21.15.5:0/1935934174 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03d000db50 con 0x7f03e00643b0 2024-04-16T14:46:47.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.208+0000 7f03e5d5d640 1 -- 172.21.15.5:0/1935934174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e010d670 con 0x7f03e00643b0 2024-04-16T14:46:47.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.209+0000 7f03e5d5d640 1 -- 172.21.15.5:0/1935934174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e00fd950 con 0x7f03e00643b0 2024-04-16T14:46:47.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.209+0000 7f03c7fff640 1 -- 172.21.15.5:0/1935934174 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f03d001c400 con 0x7f03e00643b0 2024-04-16T14:46:47.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.210+0000 7f03c7fff640 1 --2- 172.21.15.5:0/1935934174 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f03c806e0b0 0x7f03c8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:47.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.210+0000 7f03c7fff640 1 -- 172.21.15.5:0/1935934174 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f03d008d4d0 con 0x7f03e00643b0 2024-04-16T14:46:47.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.210+0000 7f03deffd640 1 --2- 172.21.15.5:0/1935934174 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f03c806e0b0 0x7f03c8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:47.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.210+0000 7f03deffd640 1 --2- 172.21.15.5:0/1935934174 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f03c806e0b0 0x7f03c8070560 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f03d4000c00 tx=0x7f03d4009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:47.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.215+0000 7f03c7fff640 1 -- 172.21.15.5:0/1935934174 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f03d00567a0 con 0x7f03e00643b0 2024-04-16T14:46:47.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:47 smithi115 ceph-mon[83414]: pgmap v319: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:47.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:47 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/1714702490' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-04-16T14:46:47.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:47 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/1593544338' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-04-16T14:46:47.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:47 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/3143365762' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-04-16T14:46:47.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.437+0000 7f03e5d5d640 1 -- 172.21.15.5:0/1935934174 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 39, "format": "json"} v 0) v1 -- 0x7f03e004bcc0 con 0x7f03e00643b0 2024-04-16T14:46:47.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.438+0000 7f03c7fff640 1 -- 172.21.15.5:0/1935934174 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 39, "format": "json"}]=0 dumped fsmap epoch 39 v44) v1 ==== 107+0+4352 (secure 0 0 0) 0x7f03d0059e60 con 0x7f03e00643b0 2024-04-16T14:46:47.437 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:47.437 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34438,"name":"cephfs.smithi005.wofqlz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6829/3592708911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3592708911},{"type":"v1","addr":"172.21.15.5:6829","nonce":3592708911}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44317,"name":"cephfs.smithi115.byfytg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6825/1461659094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1461659094},{"type":"v1","addr":"172.21.15.115:6825","nonce":1461659094}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T14:32:45.270024+0000","modified":"2024-04-16T14:43:28.963681+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34434},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34434":{"gid":34434,"name":"cephfs.smithi005.vzoqdl","rank":0,"incarnation":38,"state":"up:reconnect","state_seq":17,"addr":"172.21.15.5:6827/3940274196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3940274196},{"type":"v1","addr":"172.21.15.5:6827","nonce":3940274196}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-16T14:46:47.437 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 39 2024-04-16T14:46:47.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.441+0000 7f03e5d5d640 1 -- 172.21.15.5:0/1935934174 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f03c806e0b0 msgr2=0x7f03c8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:47.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.441+0000 7f03e5d5d640 1 --2- 172.21.15.5:0/1935934174 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f03c806e0b0 0x7f03c8070560 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f03d4000c00 tx=0x7f03d4009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:47.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.441+0000 7f03e5d5d640 1 -- 172.21.15.5:0/1935934174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e00643b0 msgr2=0x7f03e0112ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:47.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.441+0000 7f03e5d5d640 1 --2- 172.21.15.5:0/1935934174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e00643b0 0x7f03e0112ce0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f03d0002a50 tx=0x7f03d0004600 comp rx=0 tx=0).stop 2024-04-16T14:46:47.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.441+0000 7f03e5d5d640 1 -- 172.21.15.5:0/1935934174 shutdown_connections 2024-04-16T14:46:47.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.441+0000 7f03e5d5d640 1 --2- 172.21.15.5:0/1935934174 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f03c806e0b0 0x7f03c8070560 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:47.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.441+0000 7f03e5d5d640 1 --2- 172.21.15.5:0/1935934174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03e0102250 0x7f03e0113220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:47.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.441+0000 7f03e5d5d640 1 --2- 172.21.15.5:0/1935934174 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e00643b0 0x7f03e0112ce0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:47.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.441+0000 7f03e5d5d640 1 -- 172.21.15.5:0/1935934174 >> 172.21.15.5:0/1935934174 conn(0x7f03e00710c0 msgr2=0x7f03e00f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:47.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.441+0000 7f03e5d5d640 1 -- 172.21.15.5:0/1935934174 shutdown_connections 2024-04-16T14:46:47.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.441+0000 7f03e5d5d640 1 -- 172.21.15.5:0/1935934174 wait complete. 2024-04-16T14:46:47.452 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:47 smithi005 ceph-mon[93420]: pgmap v319: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:47.452 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:47 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/1714702490' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-04-16T14:46:47.452 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:47 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/1593544338' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-04-16T14:46:47.452 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:47 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/3143365762' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-04-16T14:46:47.453 DEBUG:tasks.fs:max_mds reduced in epoch 39 2024-04-16T14:46:47.454 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 40 2024-04-16T14:46:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.557+0000 7f3b8326e640 1 -- 172.21.15.5:0/398403410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b7c101a50 msgr2=0x7f3b7c0fb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.557+0000 7f3b8326e640 1 --2- 172.21.15.5:0/398403410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b7c101a50 0x7f3b7c0fb9e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c0048d0 tx=0x7f3b6c009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.557+0000 7f3b8326e640 1 -- 172.21.15.5:0/398403410 shutdown_connections 2024-04-16T14:46:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.557+0000 7f3b8326e640 1 --2- 172.21.15.5:0/398403410 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b7c101a50 0x7f3b7c0fb9e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.557+0000 7f3b8326e640 1 --2- 172.21.15.5:0/398403410 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b7c101140 0x7f3b7c101510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.557+0000 7f3b8326e640 1 -- 172.21.15.5:0/398403410 >> 172.21.15.5:0/398403410 conn(0x7f3b7c0708f0 msgr2=0x7f3b7c070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.557+0000 7f3b8326e640 1 -- 172.21.15.5:0/398403410 shutdown_connections 2024-04-16T14:46:47.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.557+0000 7f3b8326e640 1 -- 172.21.15.5:0/398403410 wait complete. 2024-04-16T14:46:47.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.558+0000 7f3b8326e640 1 Processor -- start 2024-04-16T14:46:47.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.558+0000 7f3b8326e640 1 -- start start 2024-04-16T14:46:47.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.558+0000 7f3b8326e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b7c101140 0x7f3b7c10df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:47.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.558+0000 7f3b8326e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b7c101a50 0x7f3b7c10e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:47.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.558+0000 7f3b8326e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c0fb870 con 0x7f3b7c101a50 2024-04-16T14:46:47.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.558+0000 7f3b8326e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c10e9d0 con 0x7f3b7c101140 2024-04-16T14:46:47.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.558+0000 7f3b80809640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b7c101a50 0x7f3b7c10e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:47.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.558+0000 7f3b80809640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b7c101a50 0x7f3b7c10e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54036/0 (socket says 172.21.15.5:54036) 2024-04-16T14:46:47.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.558+0000 7f3b80809640 1 -- 172.21.15.5:0/119729349 learned_addr learned my addr 172.21.15.5:0/119729349 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:47.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.558+0000 7f3b8100a640 1 --2- 172.21.15.5:0/119729349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b7c101140 0x7f3b7c10df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:47.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.558+0000 7f3b80809640 1 -- 172.21.15.5:0/119729349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b7c101140 msgr2=0x7f3b7c10df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:47.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.558+0000 7f3b80809640 1 --2- 172.21.15.5:0/119729349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b7c101140 0x7f3b7c10df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:47.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.558+0000 7f3b80809640 1 -- 172.21.15.5:0/119729349 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c005040 con 0x7f3b7c101a50 2024-04-16T14:46:47.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.559+0000 7f3b80809640 1 --2- 172.21.15.5:0/119729349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b7c101a50 0x7f3b7c10e490 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c0306c0 tx=0x7f3b6c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:47.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.559+0000 7f3b71ffb640 1 -- 172.21.15.5:0/119729349 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b6c004290 con 0x7f3b7c101a50 2024-04-16T14:46:47.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.559+0000 7f3b8326e640 1 -- 172.21.15.5:0/119729349 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b7c10ec50 con 0x7f3b7c101a50 2024-04-16T14:46:47.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.559+0000 7f3b8326e640 1 -- 172.21.15.5:0/119729349 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7c117210 con 0x7f3b7c101a50 2024-04-16T14:46:47.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.559+0000 7f3b71ffb640 1 -- 172.21.15.5:0/119729349 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b6c0092e0 con 0x7f3b7c101a50 2024-04-16T14:46:47.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.559+0000 7f3b71ffb640 1 -- 172.21.15.5:0/119729349 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b6c043400 con 0x7f3b7c101a50 2024-04-16T14:46:47.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.560+0000 7f3b8326e640 1 -- 172.21.15.5:0/119729349 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b60005210 con 0x7f3b7c101a50 2024-04-16T14:46:47.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.561+0000 7f3b71ffb640 1 -- 172.21.15.5:0/119729349 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f3b6c03b420 con 0x7f3b7c101a50 2024-04-16T14:46:47.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.561+0000 7f3b71ffb640 1 --2- 172.21.15.5:0/119729349 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3b6806e0b0 0x7f3b68070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:47.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.561+0000 7f3b71ffb640 1 -- 172.21.15.5:0/119729349 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f3b6c0b07b0 con 0x7f3b7c101a50 2024-04-16T14:46:47.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.561+0000 7f3b8100a640 1 --2- 172.21.15.5:0/119729349 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3b6806e0b0 0x7f3b68070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:47.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.562+0000 7f3b8100a640 1 --2- 172.21.15.5:0/119729349 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3b6806e0b0 0x7f3b68070560 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3b78009af0 tx=0x7f3b7800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:47.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.566+0000 7f3b71ffb640 1 -- 172.21.15.5:0/119729349 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f3b6c079bc0 con 0x7f3b7c101a50 2024-04-16T14:46:47.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.792+0000 7f3b8326e640 1 -- 172.21.15.5:0/119729349 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 40, "format": "json"} v 0) v1 -- 0x7f3b600054c0 con 0x7f3b7c101a50 2024-04-16T14:46:47.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.793+0000 7f3b71ffb640 1 -- 172.21.15.5:0/119729349 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 40, "format": "json"}]=0 dumped fsmap epoch 40 v44) v1 ==== 107+0+4349 (secure 0 0 0) 0x7f3b6c082e60 con 0x7f3b7c101a50 2024-04-16T14:46:47.791 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:47.792 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34438,"name":"cephfs.smithi005.wofqlz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6829/3592708911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3592708911},{"type":"v1","addr":"172.21.15.5:6829","nonce":3592708911}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44317,"name":"cephfs.smithi115.byfytg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6825/1461659094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1461659094},{"type":"v1","addr":"172.21.15.115:6825","nonce":1461659094}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T14:32:45.270024+0000","modified":"2024-04-16T14:43:29.348847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34434},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34434":{"gid":34434,"name":"cephfs.smithi005.vzoqdl","rank":0,"incarnation":38,"state":"up:rejoin","state_seq":18,"addr":"172.21.15.5:6827/3940274196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3940274196},{"type":"v1","addr":"172.21.15.5:6827","nonce":3940274196}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-16T14:46:47.792 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 40 2024-04-16T14:46:47.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.795+0000 7f3b8326e640 1 -- 172.21.15.5:0/119729349 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3b6806e0b0 msgr2=0x7f3b68070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:47.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.795+0000 7f3b8326e640 1 --2- 172.21.15.5:0/119729349 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3b6806e0b0 0x7f3b68070560 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3b78009af0 tx=0x7f3b7800b040 comp rx=0 tx=0).stop 2024-04-16T14:46:47.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.795+0000 7f3b8326e640 1 -- 172.21.15.5:0/119729349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b7c101a50 msgr2=0x7f3b7c10e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:47.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.795+0000 7f3b8326e640 1 --2- 172.21.15.5:0/119729349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b7c101a50 0x7f3b7c10e490 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c0306c0 tx=0x7f3b6c009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:47.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.795+0000 7f3b8326e640 1 -- 172.21.15.5:0/119729349 shutdown_connections 2024-04-16T14:46:47.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.795+0000 7f3b8326e640 1 --2- 172.21.15.5:0/119729349 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f3b6806e0b0 0x7f3b68070560 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:47.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.795+0000 7f3b8326e640 1 --2- 172.21.15.5:0/119729349 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b7c101a50 0x7f3b7c10e490 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:47.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.795+0000 7f3b8326e640 1 --2- 172.21.15.5:0/119729349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b7c101140 0x7f3b7c10df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:47.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.795+0000 7f3b8326e640 1 -- 172.21.15.5:0/119729349 >> 172.21.15.5:0/119729349 conn(0x7f3b7c0708f0 msgr2=0x7f3b7c0f8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:47.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.795+0000 7f3b8326e640 1 -- 172.21.15.5:0/119729349 shutdown_connections 2024-04-16T14:46:47.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.795+0000 7f3b8326e640 1 -- 172.21.15.5:0/119729349 wait complete. 2024-04-16T14:46:47.805 DEBUG:tasks.fs:max_mds reduced in epoch 40 2024-04-16T14:46:47.805 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 41 2024-04-16T14:46:47.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.908+0000 7fed64a58640 1 -- 172.21.15.5:0/2487844577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed601012e0 msgr2=0x7fed601016b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:47.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.908+0000 7fed64a58640 1 --2- 172.21.15.5:0/2487844577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed601012e0 0x7fed601016b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fed500048d0 tx=0x7fed50009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:47.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.908+0000 7fed64a58640 1 -- 172.21.15.5:0/2487844577 shutdown_connections 2024-04-16T14:46:47.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.908+0000 7fed64a58640 1 --2- 172.21.15.5:0/2487844577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed60101c80 0x7fed600fb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:47.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.908+0000 7fed64a58640 1 --2- 172.21.15.5:0/2487844577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed601012e0 0x7fed601016b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:47.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.908+0000 7fed64a58640 1 -- 172.21.15.5:0/2487844577 >> 172.21.15.5:0/2487844577 conn(0x7fed600f6eb0 msgr2=0x7fed600f92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:47.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.908+0000 7fed64a58640 1 -- 172.21.15.5:0/2487844577 shutdown_connections 2024-04-16T14:46:47.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.908+0000 7fed64a58640 1 -- 172.21.15.5:0/2487844577 wait complete. 2024-04-16T14:46:47.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.909+0000 7fed64a58640 1 Processor -- start 2024-04-16T14:46:47.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.909+0000 7fed64a58640 1 -- start start 2024-04-16T14:46:47.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.909+0000 7fed64a58640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed601012e0 0x7fed60112f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:47.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.909+0000 7fed64a58640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed60101c80 0x7fed60113460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:47.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.909+0000 7fed64a58640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed60113a60 con 0x7fed60101c80 2024-04-16T14:46:47.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.909+0000 7fed64a58640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6010d0b0 con 0x7fed601012e0 2024-04-16T14:46:47.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.909+0000 7fed57fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed60101c80 0x7fed60113460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:47.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.909+0000 7fed57fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed60101c80 0x7fed60113460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54064/0 (socket says 172.21.15.5:54064) 2024-04-16T14:46:47.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.909+0000 7fed57fff640 1 -- 172.21.15.5:0/1806401663 learned_addr learned my addr 172.21.15.5:0/1806401663 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:47.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.909+0000 7fed5e59c640 1 --2- 172.21.15.5:0/1806401663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed601012e0 0x7fed60112f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:47.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.909+0000 7fed57fff640 1 -- 172.21.15.5:0/1806401663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed601012e0 msgr2=0x7fed60112f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.909+0000 7fed57fff640 1 --2- 172.21.15.5:0/1806401663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed601012e0 0x7fed60112f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.909+0000 7fed57fff640 1 -- 172.21.15.5:0/1806401663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed50005040 con 0x7fed60101c80 2024-04-16T14:46:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.909+0000 7fed57fff640 1 --2- 172.21.15.5:0/1806401663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed60101c80 0x7fed60113460 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fed48002a50 tx=0x7fed48004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.910+0000 7fed56ffd640 1 -- 172.21.15.5:0/1806401663 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed48007c30 con 0x7fed60101c80 2024-04-16T14:46:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.910+0000 7fed56ffd640 1 -- 172.21.15.5:0/1806401663 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed4800f040 con 0x7fed60101c80 2024-04-16T14:46:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.910+0000 7fed64a58640 1 -- 172.21.15.5:0/1806401663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed6010d390 con 0x7fed60101c80 2024-04-16T14:46:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.910+0000 7fed56ffd640 1 -- 172.21.15.5:0/1806401663 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed4800db50 con 0x7fed60101c80 2024-04-16T14:46:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.910+0000 7fed64a58640 1 -- 172.21.15.5:0/1806401663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed6010d8b0 con 0x7fed60101c80 2024-04-16T14:46:47.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.911+0000 7fed64a58640 1 -- 172.21.15.5:0/1806401663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed600fca50 con 0x7fed60101c80 2024-04-16T14:46:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.911+0000 7fed56ffd640 1 -- 172.21.15.5:0/1806401663 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fed4801c400 con 0x7fed60101c80 2024-04-16T14:46:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.912+0000 7fed56ffd640 1 --2- 172.21.15.5:0/1806401663 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fed4c06e0b0 0x7fed4c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.912+0000 7fed56ffd640 1 -- 172.21.15.5:0/1806401663 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fed4808d420 con 0x7fed60101c80 2024-04-16T14:46:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.912+0000 7fed5e59c640 1 --2- 172.21.15.5:0/1806401663 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fed4c06e0b0 0x7fed4c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:47.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.912+0000 7fed5e59c640 1 --2- 172.21.15.5:0/1806401663 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fed4c06e0b0 0x7fed4c070560 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fed50003080 tx=0x7fed50009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:47.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:47.916+0000 7fed56ffd640 1 -- 172.21.15.5:0/1806401663 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fed480567a0 con 0x7fed60101c80 2024-04-16T14:46:48.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.143+0000 7fed64a58640 1 -- 172.21.15.5:0/1806401663 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 41, "format": "json"} v 0) v1 -- 0x7fed60108440 con 0x7fed60101c80 2024-04-16T14:46:48.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.144+0000 7fed56ffd640 1 -- 172.21.15.5:0/1806401663 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 41, "format": "json"}]=0 dumped fsmap epoch 41 v44) v1 ==== 107+0+5208 (secure 0 0 0) 0x7fed48059e60 con 0x7fed60101c80 2024-04-16T14:46:48.142 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:48.143 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34438,"name":"cephfs.smithi005.wofqlz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6829/3592708911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3592708911},{"type":"v1","addr":"172.21.15.5:6829","nonce":3592708911}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44317,"name":"cephfs.smithi115.byfytg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6825/1461659094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1461659094},{"type":"v1","addr":"172.21.15.115:6825","nonce":1461659094}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44341,"name":"cephfs.smithi115.trkaqh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6827/3171302428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":3171302428},{"type":"v1","addr":"172.21.15.115:6827","nonce":3171302428}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T14:32:45.270024+0000","modified":"2024-04-16T14:43:31.348897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34434},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34434":{"gid":34434,"name":"cephfs.smithi005.vzoqdl","rank":0,"incarnation":38,"state":"up:active","state_seq":19,"addr":"172.21.15.5:6827/3940274196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3940274196},{"type":"v1","addr":"172.21.15.5:6827","nonce":3940274196}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34434,"qdb_cluster":[34434]},"id":1}]} 2024-04-16T14:46:48.143 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 41 2024-04-16T14:46:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.146+0000 7fed64a58640 1 -- 172.21.15.5:0/1806401663 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fed4c06e0b0 msgr2=0x7fed4c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.146+0000 7fed64a58640 1 --2- 172.21.15.5:0/1806401663 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fed4c06e0b0 0x7fed4c070560 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fed50003080 tx=0x7fed50009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.146+0000 7fed64a58640 1 -- 172.21.15.5:0/1806401663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed60101c80 msgr2=0x7fed60113460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.146+0000 7fed64a58640 1 --2- 172.21.15.5:0/1806401663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed60101c80 0x7fed60113460 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fed48002a50 tx=0x7fed48004600 comp rx=0 tx=0).stop 2024-04-16T14:46:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.146+0000 7fed64a58640 1 -- 172.21.15.5:0/1806401663 shutdown_connections 2024-04-16T14:46:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.146+0000 7fed64a58640 1 --2- 172.21.15.5:0/1806401663 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fed4c06e0b0 0x7fed4c070560 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:48.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.146+0000 7fed64a58640 1 --2- 172.21.15.5:0/1806401663 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed60101c80 0x7fed60113460 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:48.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.146+0000 7fed64a58640 1 --2- 172.21.15.5:0/1806401663 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fed601012e0 0x7fed60112f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:48.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.146+0000 7fed64a58640 1 -- 172.21.15.5:0/1806401663 >> 172.21.15.5:0/1806401663 conn(0x7fed600f6eb0 msgr2=0x7fed600f7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:48.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.147+0000 7fed64a58640 1 -- 172.21.15.5:0/1806401663 shutdown_connections 2024-04-16T14:46:48.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.147+0000 7fed64a58640 1 -- 172.21.15.5:0/1806401663 wait complete. 2024-04-16T14:46:48.156 DEBUG:tasks.fs:max_mds reduced in epoch 41 2024-04-16T14:46:48.156 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 42 2024-04-16T14:46:48.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.260+0000 7f59e8e58640 1 -- 172.21.15.5:0/533472099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59e41012e0 msgr2=0x7f59e41016b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:48.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.260+0000 7f59e8e58640 1 --2- 172.21.15.5:0/533472099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59e41012e0 0x7f59e41016b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f59d40048d0 tx=0x7f59d4009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.260+0000 7f59e8e58640 1 -- 172.21.15.5:0/533472099 shutdown_connections 2024-04-16T14:46:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.260+0000 7f59e8e58640 1 --2- 172.21.15.5:0/533472099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59e4101c80 0x7f59e40fb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.260+0000 7f59e8e58640 1 --2- 172.21.15.5:0/533472099 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59e41012e0 0x7f59e41016b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.260+0000 7f59e8e58640 1 -- 172.21.15.5:0/533472099 >> 172.21.15.5:0/533472099 conn(0x7f59e40f6eb0 msgr2=0x7f59e40f92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.260+0000 7f59e8e58640 1 -- 172.21.15.5:0/533472099 shutdown_connections 2024-04-16T14:46:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.260+0000 7f59e8e58640 1 -- 172.21.15.5:0/533472099 wait complete. 2024-04-16T14:46:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.261+0000 7f59e8e58640 1 Processor -- start 2024-04-16T14:46:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.261+0000 7f59e8e58640 1 -- start start 2024-04-16T14:46:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.261+0000 7f59e8e58640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59e41012e0 0x7f59e4115120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.261+0000 7f59e8e58640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59e4101c80 0x7f59e4115660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.261+0000 7f59e8e58640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e4115c60 con 0x7f59e4101c80 2024-04-16T14:46:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.261+0000 7f59e8e58640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e410f2b0 con 0x7f59e41012e0 2024-04-16T14:46:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.261+0000 7f59e1d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59e4101c80 0x7f59e4115660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.261+0000 7f59e1d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59e4101c80 0x7f59e4115660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54078/0 (socket says 172.21.15.5:54078) 2024-04-16T14:46:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.261+0000 7f59e1d9b640 1 -- 172.21.15.5:0/481246405 learned_addr learned my addr 172.21.15.5:0/481246405 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.261+0000 7f59e259c640 1 --2- 172.21.15.5:0/481246405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59e41012e0 0x7f59e4115120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.261+0000 7f59e1d9b640 1 -- 172.21.15.5:0/481246405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59e41012e0 msgr2=0x7f59e4115120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.261+0000 7f59e1d9b640 1 --2- 172.21.15.5:0/481246405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59e41012e0 0x7f59e4115120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.261+0000 7f59e1d9b640 1 -- 172.21.15.5:0/481246405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d4005040 con 0x7f59e4101c80 2024-04-16T14:46:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.261+0000 7f59e1d9b640 1 --2- 172.21.15.5:0/481246405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59e4101c80 0x7f59e4115660 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f59cc002a50 tx=0x7f59cc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.261+0000 7f59daffd640 1 -- 172.21.15.5:0/481246405 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59cc007c30 con 0x7f59e4101c80 2024-04-16T14:46:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.262+0000 7f59daffd640 1 -- 172.21.15.5:0/481246405 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f59cc00f040 con 0x7f59e4101c80 2024-04-16T14:46:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.262+0000 7f59e8e58640 1 -- 172.21.15.5:0/481246405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e410f590 con 0x7f59e4101c80 2024-04-16T14:46:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.262+0000 7f59daffd640 1 -- 172.21.15.5:0/481246405 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59cc00db50 con 0x7f59e4101c80 2024-04-16T14:46:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.262+0000 7f59e8e58640 1 -- 172.21.15.5:0/481246405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e410fab0 con 0x7f59e4101c80 2024-04-16T14:46:48.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.262+0000 7f59e8e58640 1 -- 172.21.15.5:0/481246405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e40fca50 con 0x7f59e4101c80 2024-04-16T14:46:48.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.263+0000 7f59daffd640 1 -- 172.21.15.5:0/481246405 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f59cc01c400 con 0x7f59e4101c80 2024-04-16T14:46:48.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.264+0000 7f59daffd640 1 --2- 172.21.15.5:0/481246405 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f59d006e0b0 0x7f59d0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:48.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.264+0000 7f59e259c640 1 --2- 172.21.15.5:0/481246405 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f59d006e0b0 0x7f59d0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:48.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.264+0000 7f59daffd640 1 -- 172.21.15.5:0/481246405 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f59cc08d420 con 0x7f59e4101c80 2024-04-16T14:46:48.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.264+0000 7f59e259c640 1 --2- 172.21.15.5:0/481246405 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f59d006e0b0 0x7f59d0070560 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f59d4003080 tx=0x7f59d4009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:48.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.268+0000 7f59daffd640 1 -- 172.21.15.5:0/481246405 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f59cc0567a0 con 0x7f59e4101c80 2024-04-16T14:46:48.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:48 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/1935934174' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-04-16T14:46:48.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:48 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/119729349' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-04-16T14:46:48.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:48 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/1806401663' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-04-16T14:46:48.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:48 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/1935934174' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-04-16T14:46:48.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:48 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/119729349' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-04-16T14:46:48.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:48 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/1806401663' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-04-16T14:46:48.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.490+0000 7f59e8e58640 1 -- 172.21.15.5:0/481246405 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 42, "format": "json"} v 0) v1 -- 0x7f59e4108440 con 0x7f59e4101c80 2024-04-16T14:46:48.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.490+0000 7f59daffd640 1 -- 172.21.15.5:0/481246405 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 42, "format": "json"}]=0 dumped fsmap epoch 42 v44) v1 ==== 107+0+5208 (secure 0 0 0) 0x7f59cc059e60 con 0x7f59e4101c80 2024-04-16T14:46:48.491 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:48.491 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34438,"name":"cephfs.smithi005.wofqlz","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6829/3592708911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3592708911},{"type":"v1","addr":"172.21.15.5:6829","nonce":3592708911}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":44317,"name":"cephfs.smithi115.byfytg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6825/1461659094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1461659094},{"type":"v1","addr":"172.21.15.115:6825","nonce":1461659094}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44341,"name":"cephfs.smithi115.trkaqh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6827/3171302428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":3171302428},{"type":"v1","addr":"172.21.15.115:6827","nonce":3171302428}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T14:32:45.270024+0000","modified":"2024-04-16T14:43:37.954770+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0],"up":{"mds_0":34434},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34434":{"gid":34434,"name":"cephfs.smithi005.vzoqdl","rank":0,"incarnation":38,"state":"up:active","state_seq":19,"addr":"172.21.15.5:6827/3940274196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3940274196},{"type":"v1","addr":"172.21.15.5:6827","nonce":3940274196}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34434,"qdb_cluster":[34434]},"id":1}]} 2024-04-16T14:46:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 42 2024-04-16T14:46:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.492+0000 7f59e8e58640 1 -- 172.21.15.5:0/481246405 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f59d006e0b0 msgr2=0x7f59d0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.492+0000 7f59e8e58640 1 --2- 172.21.15.5:0/481246405 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f59d006e0b0 0x7f59d0070560 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f59d4003080 tx=0x7f59d4009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.492+0000 7f59e8e58640 1 -- 172.21.15.5:0/481246405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59e4101c80 msgr2=0x7f59e4115660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.492+0000 7f59e8e58640 1 --2- 172.21.15.5:0/481246405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59e4101c80 0x7f59e4115660 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f59cc002a50 tx=0x7f59cc004600 comp rx=0 tx=0).stop 2024-04-16T14:46:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.493+0000 7f59e8e58640 1 -- 172.21.15.5:0/481246405 shutdown_connections 2024-04-16T14:46:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.493+0000 7f59e8e58640 1 --2- 172.21.15.5:0/481246405 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f59d006e0b0 0x7f59d0070560 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.493+0000 7f59e8e58640 1 --2- 172.21.15.5:0/481246405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59e4101c80 0x7f59e4115660 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.493+0000 7f59e8e58640 1 --2- 172.21.15.5:0/481246405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59e41012e0 0x7f59e4115120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.493+0000 7f59e8e58640 1 -- 172.21.15.5:0/481246405 >> 172.21.15.5:0/481246405 conn(0x7f59e40f6eb0 msgr2=0x7f59e40f7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.493+0000 7f59e8e58640 1 -- 172.21.15.5:0/481246405 shutdown_connections 2024-04-16T14:46:48.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.493+0000 7f59e8e58640 1 -- 172.21.15.5:0/481246405 wait complete. 2024-04-16T14:46:48.502 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 43 2024-04-16T14:46:48.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.606+0000 7fc0cb0ae640 1 -- 172.21.15.5:0/3092466809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0c40643b0 msgr2=0x7fc0c4064780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:48.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.606+0000 7fc0cb0ae640 1 --2- 172.21.15.5:0/3092466809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0c40643b0 0x7fc0c4064780 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc0048d0 tx=0x7fc0bc009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:48.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.607+0000 7fc0cb0ae640 1 -- 172.21.15.5:0/3092466809 shutdown_connections 2024-04-16T14:46:48.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.607+0000 7fc0cb0ae640 1 --2- 172.21.15.5:0/3092466809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0c4064cc0 0x7fc0c4108790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:48.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.607+0000 7fc0cb0ae640 1 --2- 172.21.15.5:0/3092466809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0c40643b0 0x7fc0c4064780 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:48.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.607+0000 7fc0cb0ae640 1 -- 172.21.15.5:0/3092466809 >> 172.21.15.5:0/3092466809 conn(0x7fc0c40710c0 msgr2=0x7fc0c40714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:48.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.607+0000 7fc0cb0ae640 1 -- 172.21.15.5:0/3092466809 shutdown_connections 2024-04-16T14:46:48.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.607+0000 7fc0cb0ae640 1 -- 172.21.15.5:0/3092466809 wait complete. 2024-04-16T14:46:48.607 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.607+0000 7fc0cb0ae640 1 Processor -- start 2024-04-16T14:46:48.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.607+0000 7fc0cb0ae640 1 -- start start 2024-04-16T14:46:48.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.607+0000 7fc0cb0ae640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0c40643b0 0x7fc0c4114ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:48.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.608+0000 7fc0cb0ae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0c4064cc0 0x7fc0c41153e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:48.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.608+0000 7fc0cb0ae640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c41159e0 con 0x7fc0c4064cc0 2024-04-16T14:46:48.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.608+0000 7fc0cb0ae640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c410f030 con 0x7fc0c40643b0 2024-04-16T14:46:48.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.608+0000 7fc0c3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0c4064cc0 0x7fc0c41153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:48.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.608+0000 7fc0c3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0c4064cc0 0x7fc0c41153e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54816/0 (socket says 172.21.15.5:54816) 2024-04-16T14:46:48.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.608+0000 7fc0c3fff640 1 -- 172.21.15.5:0/649944579 learned_addr learned my addr 172.21.15.5:0/649944579 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:48.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.608+0000 7fc0c3fff640 1 -- 172.21.15.5:0/649944579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0c40643b0 msgr2=0x7fc0c4114ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:48.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.608+0000 7fc0c3fff640 1 --2- 172.21.15.5:0/649944579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0c40643b0 0x7fc0c4114ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:48.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.608+0000 7fc0c3fff640 1 -- 172.21.15.5:0/649944579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0bc005040 con 0x7fc0c4064cc0 2024-04-16T14:46:48.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.608+0000 7fc0c3fff640 1 --2- 172.21.15.5:0/649944579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0c4064cc0 0x7fc0c41153e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00cb10 tx=0x7fc0ac007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:48.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.608+0000 7fc0c17fa640 1 -- 172.21.15.5:0/649944579 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0ac004200 con 0x7fc0c4064cc0 2024-04-16T14:46:48.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.608+0000 7fc0c17fa640 1 -- 172.21.15.5:0/649944579 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc0ac00acf0 con 0x7fc0c4064cc0 2024-04-16T14:46:48.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.608+0000 7fc0cb0ae640 1 -- 172.21.15.5:0/649944579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c410f310 con 0x7fc0c4064cc0 2024-04-16T14:46:48.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.608+0000 7fc0c17fa640 1 -- 172.21.15.5:0/649944579 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0ac003e80 con 0x7fc0c4064cc0 2024-04-16T14:46:48.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.608+0000 7fc0cb0ae640 1 -- 172.21.15.5:0/649944579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c410f830 con 0x7fc0c4064cc0 2024-04-16T14:46:48.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.609+0000 7fc0cb0ae640 1 -- 172.21.15.5:0/649944579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c40fb740 con 0x7fc0c4064cc0 2024-04-16T14:46:48.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.610+0000 7fc0c17fa640 1 -- 172.21.15.5:0/649944579 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fc0ac003630 con 0x7fc0c4064cc0 2024-04-16T14:46:48.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.610+0000 7fc0c17fa640 1 --2- 172.21.15.5:0/649944579 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc0b006e0b0 0x7fc0b0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:48.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.610+0000 7fc0c17fa640 1 -- 172.21.15.5:0/649944579 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fc0ac08e280 con 0x7fc0c4064cc0 2024-04-16T14:46:48.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.610+0000 7fc0c8e4a640 1 --2- 172.21.15.5:0/649944579 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc0b006e0b0 0x7fc0b0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:48.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.611+0000 7fc0c8e4a640 1 --2- 172.21.15.5:0/649944579 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc0b006e0b0 0x7fc0b0070560 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc0043d0 tx=0x7fc0bc009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:48.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.615+0000 7fc0c17fa640 1 -- 172.21.15.5:0/649944579 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fc0ac057550 con 0x7fc0c4064cc0 2024-04-16T14:46:48.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.842+0000 7fc0cb0ae640 1 -- 172.21.15.5:0/649944579 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 43, "format": "json"} v 0) v1 -- 0x7fc0c410b540 con 0x7fc0c4064cc0 2024-04-16T14:46:48.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.843+0000 7fc0c17fa640 1 -- 172.21.15.5:0/649944579 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 43, "format": "json"}]=0 dumped fsmap epoch 43 v44) v1 ==== 107+0+5225 (secure 0 0 0) 0x7fc0ac079e60 con 0x7fc0c4064cc0 2024-04-16T14:46:48.841 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:48.841 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":43,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44317,"name":"cephfs.smithi115.byfytg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6825/1461659094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":1461659094},{"type":"v1","addr":"172.21.15.115:6825","nonce":1461659094}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44341,"name":"cephfs.smithi115.trkaqh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6827/3171302428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":3171302428},{"type":"v1","addr":"172.21.15.115:6827","nonce":3171302428}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-16T14:32:45.270024+0000","modified":"2024-04-16T14:43:38.955852+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34434,"mds_1":34438},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34434":{"gid":34434,"name":"cephfs.smithi005.vzoqdl","rank":0,"incarnation":38,"state":"up:active","state_seq":19,"addr":"172.21.15.5:6827/3940274196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3940274196},{"type":"v1","addr":"172.21.15.5:6827","nonce":3940274196}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34438":{"gid":34438,"name":"cephfs.smithi005.wofqlz","rank":1,"incarnation":43,"state":"up:starting","state_seq":1,"addr":"172.21.15.5:6829/3592708911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3592708911},{"type":"v1","addr":"172.21.15.5:6829","nonce":3592708911}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34434,"qdb_cluster":[34434]},"id":1}]} 2024-04-16T14:46:48.842 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 43 2024-04-16T14:46:48.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.845+0000 7fc0cb0ae640 1 -- 172.21.15.5:0/649944579 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc0b006e0b0 msgr2=0x7fc0b0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:48.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.845+0000 7fc0cb0ae640 1 --2- 172.21.15.5:0/649944579 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc0b006e0b0 0x7fc0b0070560 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc0043d0 tx=0x7fc0bc009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:48.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.845+0000 7fc0cb0ae640 1 -- 172.21.15.5:0/649944579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0c4064cc0 msgr2=0x7fc0c41153e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:48.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.845+0000 7fc0cb0ae640 1 --2- 172.21.15.5:0/649944579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0c4064cc0 0x7fc0c41153e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00cb10 tx=0x7fc0ac007f00 comp rx=0 tx=0).stop 2024-04-16T14:46:48.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.845+0000 7fc0cb0ae640 1 -- 172.21.15.5:0/649944579 shutdown_connections 2024-04-16T14:46:48.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.845+0000 7fc0cb0ae640 1 --2- 172.21.15.5:0/649944579 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc0b006e0b0 0x7fc0b0070560 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:48.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.845+0000 7fc0cb0ae640 1 --2- 172.21.15.5:0/649944579 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0c4064cc0 0x7fc0c41153e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:48.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.845+0000 7fc0cb0ae640 1 --2- 172.21.15.5:0/649944579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0c40643b0 0x7fc0c4114ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:48.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.845+0000 7fc0cb0ae640 1 -- 172.21.15.5:0/649944579 >> 172.21.15.5:0/649944579 conn(0x7fc0c40710c0 msgr2=0x7fc0c40f9110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:48.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.845+0000 7fc0cb0ae640 1 -- 172.21.15.5:0/649944579 shutdown_connections 2024-04-16T14:46:48.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:48.845+0000 7fc0cb0ae640 1 -- 172.21.15.5:0/649944579 wait complete. 2024-04-16T14:46:48.855 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-16T14:46:48.871 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-16T14:46:48.871 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-16T14:46:48.871 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T14:46:48.889 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-04-16T14:46:48.889 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T14:46:48.946 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T14:46:49.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.088+0000 7f0334e2e640 1 -- 172.21.15.5:0/92911634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03300643b0 msgr2=0x7f03300647e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:49.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.088+0000 7f0334e2e640 1 --2- 172.21.15.5:0/92911634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03300643b0 0x7f03300647e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f03180048d0 tx=0x7f0318009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:49.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.089+0000 7f0334e2e640 1 -- 172.21.15.5:0/92911634 shutdown_connections 2024-04-16T14:46:49.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.089+0000 7f0334e2e640 1 --2- 172.21.15.5:0/92911634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03300643b0 0x7f03300647e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:49.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.089+0000 7f0334e2e640 1 --2- 172.21.15.5:0/92911634 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0330102260 0x7f0330102630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:49.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.089+0000 7f0334e2e640 1 -- 172.21.15.5:0/92911634 >> 172.21.15.5:0/92911634 conn(0x7f0330071190 msgr2=0x7f0330071590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:49.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.089+0000 7f0334e2e640 1 -- 172.21.15.5:0/92911634 shutdown_connections 2024-04-16T14:46:49.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.089+0000 7f0334e2e640 1 -- 172.21.15.5:0/92911634 wait complete. 2024-04-16T14:46:49.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.089+0000 7f0334e2e640 1 Processor -- start 2024-04-16T14:46:49.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.089+0000 7f0334e2e640 1 -- start start 2024-04-16T14:46:49.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.089+0000 7f0334e2e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03300643b0 0x7f03300fb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:49.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.089+0000 7f0334e2e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0330102260 0x7f03300fb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:49.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.089+0000 7f0334e2e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03300fd0e0 con 0x7f0330102260 2024-04-16T14:46:49.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.089+0000 7f0334e2e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03300fbc80 con 0x7f03300643b0 2024-04-16T14:46:49.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.090+0000 7f032dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0330102260 0x7f03300fb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:49.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.090+0000 7f032dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0330102260 0x7f03300fb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54830/0 (socket says 172.21.15.5:54830) 2024-04-16T14:46:49.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.090+0000 7f032dd9b640 1 -- 172.21.15.5:0/2226647073 learned_addr learned my addr 172.21.15.5:0/2226647073 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:49.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.090+0000 7f032e59c640 1 --2- 172.21.15.5:0/2226647073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03300643b0 0x7f03300fb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:49.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.090+0000 7f032dd9b640 1 -- 172.21.15.5:0/2226647073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03300643b0 msgr2=0x7f03300fb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:49.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.090+0000 7f032dd9b640 1 --2- 172.21.15.5:0/2226647073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03300643b0 0x7f03300fb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:49.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.090+0000 7f032dd9b640 1 -- 172.21.15.5:0/2226647073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0318005040 con 0x7f0330102260 2024-04-16T14:46:49.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.090+0000 7f032dd9b640 1 --2- 172.21.15.5:0/2226647073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0330102260 0x7f03300fb740 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0318004930 tx=0x7f0318009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:49.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.090+0000 7f0326ffd640 1 -- 172.21.15.5:0/2226647073 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03180094c0 con 0x7f0330102260 2024-04-16T14:46:49.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.090+0000 7f0326ffd640 1 -- 172.21.15.5:0/2226647073 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0318032e50 con 0x7f0330102260 2024-04-16T14:46:49.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.090+0000 7f0334e2e640 1 -- 172.21.15.5:0/2226647073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03300fbf00 con 0x7f0330102260 2024-04-16T14:46:49.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.090+0000 7f0326ffd640 1 -- 172.21.15.5:0/2226647073 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03180433b0 con 0x7f0330102260 2024-04-16T14:46:49.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.090+0000 7f0334e2e640 1 -- 172.21.15.5:0/2226647073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03301193a0 con 0x7f0330102260 2024-04-16T14:46:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.091+0000 7f0334e2e640 1 -- 172.21.15.5:0/2226647073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03300fd960 con 0x7f0330102260 2024-04-16T14:46:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.092+0000 7f0326ffd640 1 -- 172.21.15.5:0/2226647073 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f031802f070 con 0x7f0330102260 2024-04-16T14:46:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.092+0000 7f0326ffd640 1 --2- 172.21.15.5:0/2226647073 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f031c06e0b0 0x7f031c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.092+0000 7f032e59c640 1 --2- 172.21.15.5:0/2226647073 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f031c06e0b0 0x7f031c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:49.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.092+0000 7f0326ffd640 1 -- 172.21.15.5:0/2226647073 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f03180afb70 con 0x7f0330102260 2024-04-16T14:46:49.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.093+0000 7f032e59c640 1 --2- 172.21.15.5:0/2226647073 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f031c06e0b0 0x7f031c070560 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f03280041d0 tx=0x7f0328004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:49.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.097+0000 7f0326ffd640 1 -- 172.21.15.5:0/2226647073 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f0318078ef0 con 0x7f0330102260 2024-04-16T14:46:49.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.285+0000 7f0334e2e640 1 -- 172.21.15.5:0/2226647073 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0330109370 con 0x7f0330102260 2024-04-16T14:46:49.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.286+0000 7f0326ffd640 1 -- 172.21.15.5:0/2226647073 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16703 (secure 0 0 0) 0x7f031807c5b0 con 0x7f0330102260 2024-04-16T14:46:49.285 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:49.285 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":85,"fsid":"10609bfa-fbfd-11ee-bc90-c7b262605968","created":"2024-04-16T14:25:45.190718+0000","modified":"2024-04-16T14:43:22.064592+0000","last_up_change":"2024-04-16T14:41:44.210800+0000","last_in_change":"2024-04-16T14:31:07.952511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T14:30:12.985367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-16T14:32:44.205257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-16T14:32:44.506945+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa9fa9e4-bdd2-42c5-ba51-8d141fa9c4c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":79,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1335449550},{"type":"v1","addr":"172.21.15.5:6803","nonce":1335449550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1335449550},{"type":"v1","addr":"172.21.15.5:6805","nonce":1335449550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1335449550},{"type":"v1","addr":"172.21.15.5:6809","nonce":1335449550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1335449550},{"type":"v1","addr":"172.21.15.5:6807","nonce":1335449550}]},"public_addr":"172.21.15.5:6803/1335449550","cluster_addr":"172.21.15.5:6805/1335449550","heartbeat_back_addr":"172.21.15.5:6809/1335449550","heartbeat_front_addr":"172.21.15.5:6807/1335449550","state":["exists","up"]},{"osd":1,"uuid":"d4074765-a246-412a-8b68-8da402adc7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":59,"up_thru":79,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2244573810},{"type":"v1","addr":"172.21.15.5:6811","nonce":2244573810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2244573810},{"type":"v1","addr":"172.21.15.5:6813","nonce":2244573810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2244573810},{"type":"v1","addr":"172.21.15.5:6817","nonce":2244573810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2244573810},{"type":"v1","addr":"172.21.15.5:6815","nonce":2244573810}]},"public_addr":"172.21.15.5:6811/2244573810","cluster_addr":"172.21.15.5:6813/2244573810","heartbeat_back_addr":"172.21.15.5:6817/2244573810","heartbeat_front_addr":"172.21.15.5:6815/2244573810","state":["exists","up"]},{"osd":2,"uuid":"1851758c-0015-4f54-b4b8-30c1424394ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":60,"up_from":64,"up_thru":79,"down_at":61,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":643342483},{"type":"v1","addr":"172.21.15.5:6819","nonce":643342483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":643342483},{"type":"v1","addr":"172.21.15.5:6821","nonce":643342483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":643342483},{"type":"v1","addr":"172.21.15.5:6825","nonce":643342483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":643342483},{"type":"v1","addr":"172.21.15.5:6823","nonce":643342483}]},"public_addr":"172.21.15.5:6819/643342483","cluster_addr":"172.21.15.5:6821/643342483","heartbeat_back_addr":"172.21.15.5:6825/643342483","heartbeat_front_addr":"172.21.15.5:6823/643342483","state":["exists","up"]},{"osd":3,"uuid":"ab6404e2-5cef-4a8a-8b93-a24914c67fc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":65,"up_from":69,"up_thru":79,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":4263407632},{"type":"v1","addr":"172.21.15.115:6801","nonce":4263407632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":4263407632},{"type":"v1","addr":"172.21.15.115:6803","nonce":4263407632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":4263407632},{"type":"v1","addr":"172.21.15.115:6807","nonce":4263407632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":4263407632},{"type":"v1","addr":"172.21.15.115:6805","nonce":4263407632}]},"public_addr":"172.21.15.115:6801/4263407632","cluster_addr":"172.21.15.115:6803/4263407632","heartbeat_back_addr":"172.21.15.115:6807/4263407632","heartbeat_front_addr":"172.21.15.115:6805/4263407632","state":["exists","up"]},{"osd":4,"uuid":"4252814c-6811-4b53-a8be-cd65d7aa39a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":70,"up_from":74,"up_thru":79,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":139500214},{"type":"v1","addr":"172.21.15.115:6809","nonce":139500214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":139500214},{"type":"v1","addr":"172.21.15.115:6811","nonce":139500214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":139500214},{"type":"v1","addr":"172.21.15.115:6815","nonce":139500214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":139500214},{"type":"v1","addr":"172.21.15.115:6813","nonce":139500214}]},"public_addr":"172.21.15.115:6809/139500214","cluster_addr":"172.21.15.115:6811/139500214","heartbeat_back_addr":"172.21.15.115:6815/139500214","heartbeat_front_addr":"172.21.15.115:6813/139500214","state":["exists","up"]},{"osd":5,"uuid":"124732a1-f6a0-462e-bd5e-2bcd743ab2a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":75,"up_from":79,"up_thru":79,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":1604069545},{"type":"v1","addr":"172.21.15.115:6817","nonce":1604069545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":1604069545},{"type":"v1","addr":"172.21.15.115:6819","nonce":1604069545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":1604069545},{"type":"v1","addr":"172.21.15.115:6823","nonce":1604069545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":1604069545},{"type":"v1","addr":"172.21.15.115:6821","nonce":1604069545}]},"public_addr":"172.21.15.115:6817/1604069545","cluster_addr":"172.21.15.115:6819/1604069545","heartbeat_back_addr":"172.21.15.115:6823/1604069545","heartbeat_front_addr":"172.21.15.115:6821/1604069545","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:29:14.299546+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:29:41.658611+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:30:10.127883+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:30:33.310873+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:30:59.158923+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:31:24.898158+0000","dead_epoch":75}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:6827/2476249308":"2024-04-17T14:43:22.064543+0000","172.21.15.115:6826/2476249308":"2024-04-17T14:43:22.064543+0000","172.21.15.5:6829/402035291":"2024-04-17T14:42:40.192043+0000","172.21.15.5:6828/402035291":"2024-04-17T14:42:40.192043+0000","172.21.15.5:6800/4176454319":"2024-04-17T14:28:02.662455+0000","172.21.15.5:0/2384405072":"2024-04-17T14:26:17.425567+0000","172.21.15.5:6801/1956301653":"2024-04-17T14:37:23.186462+0000","172.21.15.5:0/801827499":"2024-04-17T14:26:48.930147+0000","172.21.15.5:0/2010393498":"2024-04-17T14:34:55.944821+0000","172.21.15.5:6800/3841652776":"2024-04-17T14:34:55.944821+0000","172.21.15.115:6828/460631486":"2024-04-17T14:36:31.676822+0000","172.21.15.5:0/1109429271":"2024-04-17T14:37:23.186462+0000","172.21.15.5:0/4125351321":"2024-04-17T14:34:55.944821+0000","172.21.15.5:6800/1086445367":"2024-04-17T14:26:17.425567+0000","172.21.15.115:0/1842350799":"2024-04-17T14:36:31.676822+0000","172.21.15.5:0/2653432440":"2024-04-17T14:28:02.662455+0000","172.21.15.5:0/861562298":"2024-04-17T14:37:23.186462+0000","172.21.15.5:0/3710869010":"2024-04-17T14:26:17.425567+0000","172.21.15.5:6801/3841652776":"2024-04-17T14:34:55.944821+0000","172.21.15.5:0/3602505234":"2024-04-17T14:34:55.944821+0000","172.21.15.5:0/2013882368":"2024-04-17T14:26:48.930147+0000","172.21.15.5:0/1548281910":"2024-04-17T14:28:02.662455+0000","172.21.15.5:6801/1086445367":"2024-04-17T14:26:17.425567+0000","172.21.15.115:0/861197783":"2024-04-17T14:36:31.676822+0000","172.21.15.5:0/3891215761":"2024-04-17T14:37:23.186462+0000","172.21.15.5:6827/3000067296":"2024-04-17T14:33:00.804392+0000","172.21.15.5:0/3767913866":"2024-04-17T14:28:02.662455+0000","172.21.15.5:0/3063530168":"2024-04-17T14:34:55.944821+0000","172.21.15.115:0/3056216034":"2024-04-17T14:36:31.676822+0000","172.21.15.115:6829/460631486":"2024-04-17T14:36:31.676822+0000","172.21.15.5:0/3364969045":"2024-04-17T14:26:48.930147+0000","172.21.15.5:6800/4088193218":"2024-04-17T14:26:48.930147+0000","172.21.15.5:6801/4088193218":"2024-04-17T14:26:48.930147+0000","172.21.15.5:0/726821609":"2024-04-17T14:37:23.186462+0000","172.21.15.5:6826/3000067296":"2024-04-17T14:33:00.804392+0000","172.21.15.5:6800/1956301653":"2024-04-17T14:37:23.186462+0000","172.21.15.5:0/3196662527":"2024-04-17T14:37:23.186462+0000","172.21.15.5:6801/4176454319":"2024-04-17T14:28:02.662455+0000","172.21.15.5:0/2015079913":"2024-04-17T14:26:17.425567+0000","172.21.15.115:0/1736155115":"2024-04-17T14:36:31.676822+0000","172.21.15.5:0/2335924356":"2024-04-17T14:37:23.186462+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T14:46:49.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.288+0000 7f0334e2e640 1 -- 172.21.15.5:0/2226647073 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f031c06e0b0 msgr2=0x7f031c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:49.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.288+0000 7f0334e2e640 1 --2- 172.21.15.5:0/2226647073 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f031c06e0b0 0x7f031c070560 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f03280041d0 tx=0x7f0328004330 comp rx=0 tx=0).stop 2024-04-16T14:46:49.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.288+0000 7f0334e2e640 1 -- 172.21.15.5:0/2226647073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0330102260 msgr2=0x7f03300fb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:49.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.288+0000 7f0334e2e640 1 --2- 172.21.15.5:0/2226647073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0330102260 0x7f03300fb740 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0318004930 tx=0x7f0318009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:49.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.288+0000 7f0334e2e640 1 -- 172.21.15.5:0/2226647073 shutdown_connections 2024-04-16T14:46:49.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.288+0000 7f0334e2e640 1 --2- 172.21.15.5:0/2226647073 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f031c06e0b0 0x7f031c070560 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:49.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.288+0000 7f0334e2e640 1 --2- 172.21.15.5:0/2226647073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0330102260 0x7f03300fb740 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:49.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.288+0000 7f0334e2e640 1 --2- 172.21.15.5:0/2226647073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03300643b0 0x7f03300fb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:49.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.288+0000 7f0334e2e640 1 -- 172.21.15.5:0/2226647073 >> 172.21.15.5:0/2226647073 conn(0x7f0330071190 msgr2=0x7f03300f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:49.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.288+0000 7f0334e2e640 1 -- 172.21.15.5:0/2226647073 shutdown_connections 2024-04-16T14:46:49.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.288+0000 7f0334e2e640 1 -- 172.21.15.5:0/2226647073 wait complete. 2024-04-16T14:46:49.298 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T14:30:12.985367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-16T14:32:44.205257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-16T14:32:44.506945+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T14:46:49.298 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T14:46:49.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.404+0000 7fa111d9d640 1 -- 172.21.15.5:0/1521158177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa10c1012f0 msgr2=0x7fa10c1016c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:49.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.404+0000 7fa111d9d640 1 --2- 172.21.15.5:0/1521158177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa10c1012f0 0x7fa10c1016c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc0048d0 tx=0x7fa0fc009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:49.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.404+0000 7fa111d9d640 1 -- 172.21.15.5:0/1521158177 shutdown_connections 2024-04-16T14:46:49.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.404+0000 7fa111d9d640 1 --2- 172.21.15.5:0/1521158177 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa10c101c90 0x7fa10c0fb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:49.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.404+0000 7fa111d9d640 1 --2- 172.21.15.5:0/1521158177 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa10c1012f0 0x7fa10c1016c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:49.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.404+0000 7fa111d9d640 1 -- 172.21.15.5:0/1521158177 >> 172.21.15.5:0/1521158177 conn(0x7fa10c0f6e80 msgr2=0x7fa10c0f9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:49.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.404+0000 7fa111d9d640 1 -- 172.21.15.5:0/1521158177 shutdown_connections 2024-04-16T14:46:49.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.404+0000 7fa111d9d640 1 -- 172.21.15.5:0/1521158177 wait complete. 2024-04-16T14:46:49.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.405+0000 7fa111d9d640 1 Processor -- start 2024-04-16T14:46:49.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.405+0000 7fa111d9d640 1 -- start start 2024-04-16T14:46:49.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.405+0000 7fa111d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa10c1012f0 0x7fa10c115100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:49.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.405+0000 7fa111d9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa10c101c90 0x7fa10c115640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:49.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.405+0000 7fa111d9d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c115c40 con 0x7fa10c1012f0 2024-04-16T14:46:49.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.405+0000 7fa111d9d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c10f290 con 0x7fa10c101c90 2024-04-16T14:46:49.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.405+0000 7fa10b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa10c1012f0 0x7fa10c115100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:49.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.405+0000 7fa10b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa10c1012f0 0x7fa10c115100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54848/0 (socket says 172.21.15.5:54848) 2024-04-16T14:46:49.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.405+0000 7fa10b7fe640 1 -- 172.21.15.5:0/327399188 learned_addr learned my addr 172.21.15.5:0/327399188 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:49.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.405+0000 7fa103fff640 1 --2- 172.21.15.5:0/327399188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa10c101c90 0x7fa10c115640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:49.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.405+0000 7fa10b7fe640 1 -- 172.21.15.5:0/327399188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa10c101c90 msgr2=0x7fa10c115640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:49.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.405+0000 7fa10b7fe640 1 --2- 172.21.15.5:0/327399188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa10c101c90 0x7fa10c115640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:49.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.405+0000 7fa10b7fe640 1 -- 172.21.15.5:0/327399188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0fc005040 con 0x7fa10c1012f0 2024-04-16T14:46:49.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.405+0000 7fa103fff640 1 --2- 172.21.15.5:0/327399188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa10c101c90 0x7fa10c115640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:46:49.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.406+0000 7fa10b7fe640 1 --2- 172.21.15.5:0/327399188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa10c1012f0 0x7fa10c115100 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc0047f0 tx=0x7fa0fc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:49.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.406+0000 7fa108ff9640 1 -- 172.21.15.5:0/327399188 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0fc0094c0 con 0x7fa10c1012f0 2024-04-16T14:46:49.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.406+0000 7fa108ff9640 1 -- 172.21.15.5:0/327399188 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa0fc032e50 con 0x7fa10c1012f0 2024-04-16T14:46:49.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.406+0000 7fa111d9d640 1 -- 172.21.15.5:0/327399188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa10c10f510 con 0x7fa10c1012f0 2024-04-16T14:46:49.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.406+0000 7fa108ff9640 1 -- 172.21.15.5:0/327399188 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0fc0435f0 con 0x7fa10c1012f0 2024-04-16T14:46:49.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.406+0000 7fa111d9d640 1 -- 172.21.15.5:0/327399188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa10c10f9d0 con 0x7fa10c1012f0 2024-04-16T14:46:49.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.407+0000 7fa111d9d640 1 -- 172.21.15.5:0/327399188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa10c0fca60 con 0x7fa10c1012f0 2024-04-16T14:46:49.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.407+0000 7fa108ff9640 1 -- 172.21.15.5:0/327399188 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fa0fc02f070 con 0x7fa10c1012f0 2024-04-16T14:46:49.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.408+0000 7fa108ff9640 1 --2- 172.21.15.5:0/327399188 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa0f806e0c0 0x7fa0f8070570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:49.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.408+0000 7fa108ff9640 1 -- 172.21.15.5:0/327399188 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa0fc0afc10 con 0x7fa10c1012f0 2024-04-16T14:46:49.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.408+0000 7fa103fff640 1 --2- 172.21.15.5:0/327399188 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa0f806e0c0 0x7fa0f8070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:49.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.408+0000 7fa103fff640 1 --2- 172.21.15.5:0/327399188 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa0f806e0c0 0x7fa0f8070570 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa10c1109c0 tx=0x7fa0f4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:49.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.412+0000 7fa108ff9640 1 -- 172.21.15.5:0/327399188 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fa0fc078e40 con 0x7fa10c1012f0 2024-04-16T14:46:49.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:49 smithi115 ceph-mon[83414]: pgmap v320: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:49.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:49 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/481246405' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-04-16T14:46:49.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:49 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/649944579' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 43, "format": "json"}]: dispatch 2024-04-16T14:46:49.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:49 smithi005 ceph-mon[93420]: pgmap v320: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:49.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:49 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/481246405' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-04-16T14:46:49.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:49 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/649944579' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 43, "format": "json"}]: dispatch 2024-04-16T14:46:49.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.597+0000 7fa111d9d640 1 -- 172.21.15.5:0/327399188 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa10c0638d0 con 0x7fa10c1012f0 2024-04-16T14:46:49.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.597+0000 7fa108ff9640 1 -- 172.21.15.5:0/327399188 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa0fc07c500 con 0x7fa10c1012f0 2024-04-16T14:46:49.595 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-16T14:46:49.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.599+0000 7fa111d9d640 1 -- 172.21.15.5:0/327399188 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa0f806e0c0 msgr2=0x7fa0f8070570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:49.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.599+0000 7fa111d9d640 1 --2- 172.21.15.5:0/327399188 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa0f806e0c0 0x7fa0f8070570 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa10c1109c0 tx=0x7fa0f4009040 comp rx=0 tx=0).stop 2024-04-16T14:46:49.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.599+0000 7fa111d9d640 1 -- 172.21.15.5:0/327399188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa10c1012f0 msgr2=0x7fa10c115100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:49.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.599+0000 7fa111d9d640 1 --2- 172.21.15.5:0/327399188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa10c1012f0 0x7fa10c115100 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc0047f0 tx=0x7fa0fc009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:49.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.599+0000 7fa111d9d640 1 -- 172.21.15.5:0/327399188 shutdown_connections 2024-04-16T14:46:49.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.599+0000 7fa111d9d640 1 --2- 172.21.15.5:0/327399188 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fa0f806e0c0 0x7fa0f8070570 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:49.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.599+0000 7fa111d9d640 1 --2- 172.21.15.5:0/327399188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa10c101c90 0x7fa10c115640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:49.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.599+0000 7fa111d9d640 1 --2- 172.21.15.5:0/327399188 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa10c1012f0 0x7fa10c115100 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:49.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.599+0000 7fa111d9d640 1 -- 172.21.15.5:0/327399188 >> 172.21.15.5:0/327399188 conn(0x7fa10c0f6e80 msgr2=0x7fa10c0f84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:49.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.599+0000 7fa111d9d640 1 -- 172.21.15.5:0/327399188 shutdown_connections 2024-04-16T14:46:49.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.599+0000 7fa111d9d640 1 -- 172.21.15.5:0/327399188 wait complete. 2024-04-16T14:46:49.608 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-16T14:46:49.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.714+0000 7fc2fcd5d640 1 -- 172.21.15.5:0/1243689319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f8101150 msgr2=0x7fc2f8101520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:49.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.714+0000 7fc2fcd5d640 1 --2- 172.21.15.5:0/1243689319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f8101150 0x7fc2f8101520 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80048d0 tx=0x7fc2e8009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:49.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.714+0000 7fc2fcd5d640 1 -- 172.21.15.5:0/1243689319 shutdown_connections 2024-04-16T14:46:49.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.714+0000 7fc2fcd5d640 1 --2- 172.21.15.5:0/1243689319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2f80fb120 0x7fc2f80fb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:49.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.714+0000 7fc2fcd5d640 1 --2- 172.21.15.5:0/1243689319 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f8101150 0x7fc2f8101520 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:49.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.714+0000 7fc2fcd5d640 1 -- 172.21.15.5:0/1243689319 >> 172.21.15.5:0/1243689319 conn(0x7fc2f80710c0 msgr2=0x7fc2f80714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:49.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.714+0000 7fc2fcd5d640 1 -- 172.21.15.5:0/1243689319 shutdown_connections 2024-04-16T14:46:49.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.714+0000 7fc2fcd5d640 1 -- 172.21.15.5:0/1243689319 wait complete. 2024-04-16T14:46:49.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.714+0000 7fc2fcd5d640 1 Processor -- start 2024-04-16T14:46:49.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.714+0000 7fc2fcd5d640 1 -- start start 2024-04-16T14:46:49.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.714+0000 7fc2fcd5d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f80fb120 0x7fc2f8111c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:49.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.714+0000 7fc2fcd5d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2f8101150 0x7fc2f8112160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:49.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.714+0000 7fc2fcd5d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f81127f0 con 0x7fc2f80fb120 2024-04-16T14:46:49.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.714+0000 7fc2fcd5d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f810bdb0 con 0x7fc2f8101150 2024-04-16T14:46:49.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.715+0000 7fc2f659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f80fb120 0x7fc2f8111c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:49.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.715+0000 7fc2f659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f80fb120 0x7fc2f8111c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54866/0 (socket says 172.21.15.5:54866) 2024-04-16T14:46:49.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.715+0000 7fc2f659c640 1 -- 172.21.15.5:0/701583979 learned_addr learned my addr 172.21.15.5:0/701583979 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:49.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.715+0000 7fc2f5d9b640 1 --2- 172.21.15.5:0/701583979 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2f8101150 0x7fc2f8112160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:49.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.715+0000 7fc2f659c640 1 -- 172.21.15.5:0/701583979 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2f8101150 msgr2=0x7fc2f8112160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:49.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.715+0000 7fc2f659c640 1 --2- 172.21.15.5:0/701583979 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2f8101150 0x7fc2f8112160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:49.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.715+0000 7fc2f659c640 1 -- 172.21.15.5:0/701583979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e8005040 con 0x7fc2f80fb120 2024-04-16T14:46:49.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.715+0000 7fc2f5d9b640 1 --2- 172.21.15.5:0/701583979 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2f8101150 0x7fc2f8112160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-16T14:46:49.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.715+0000 7fc2f659c640 1 --2- 172.21.15.5:0/701583979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f80fb120 0x7fc2f8111c20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80041d0 tx=0x7fc2e8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:49.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.715+0000 7fc2e6ffd640 1 -- 172.21.15.5:0/701583979 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2e80092e0 con 0x7fc2f80fb120 2024-04-16T14:46:49.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.715+0000 7fc2fcd5d640 1 -- 172.21.15.5:0/701583979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f810c030 con 0x7fc2f80fb120 2024-04-16T14:46:49.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.715+0000 7fc2e6ffd640 1 -- 172.21.15.5:0/701583979 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc2e8009440 con 0x7fc2f80fb120 2024-04-16T14:46:49.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.715+0000 7fc2e6ffd640 1 -- 172.21.15.5:0/701583979 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2e8043640 con 0x7fc2f80fb120 2024-04-16T14:46:49.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.715+0000 7fc2fcd5d640 1 -- 172.21.15.5:0/701583979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f810c550 con 0x7fc2f80fb120 2024-04-16T14:46:49.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.716+0000 7fc2fcd5d640 1 -- 172.21.15.5:0/701583979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f80fc810 con 0x7fc2f80fb120 2024-04-16T14:46:49.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.717+0000 7fc2e6ffd640 1 -- 172.21.15.5:0/701583979 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fc2e803b9f0 con 0x7fc2f80fb120 2024-04-16T14:46:49.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.717+0000 7fc2e6ffd640 1 --2- 172.21.15.5:0/701583979 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc2e006e0b0 0x7fc2e0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:49.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.717+0000 7fc2e6ffd640 1 -- 172.21.15.5:0/701583979 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fc2e80b0970 con 0x7fc2f80fb120 2024-04-16T14:46:49.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.717+0000 7fc2f5d9b640 1 --2- 172.21.15.5:0/701583979 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc2e006e0b0 0x7fc2e0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:49.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.718+0000 7fc2f5d9b640 1 --2- 172.21.15.5:0/701583979 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc2e006e0b0 0x7fc2e0070560 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec006fd0 tx=0x7fc2ec008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:49.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.722+0000 7fc2e6ffd640 1 -- 172.21.15.5:0/701583979 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fc2e8079d80 con 0x7fc2f80fb120 2024-04-16T14:46:49.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.906+0000 7fc2fcd5d640 1 -- 172.21.15.5:0/701583979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fc2f810c1c0 con 0x7fc2f80fb120 2024-04-16T14:46:49.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.906+0000 7fc2e6ffd640 1 -- 172.21.15.5:0/701583979 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7fc2f810c1c0 con 0x7fc2f80fb120 2024-04-16T14:46:49.905 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-16T14:46:49.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.908+0000 7fc2fcd5d640 1 -- 172.21.15.5:0/701583979 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc2e006e0b0 msgr2=0x7fc2e0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:49.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.908+0000 7fc2fcd5d640 1 --2- 172.21.15.5:0/701583979 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc2e006e0b0 0x7fc2e0070560 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec006fd0 tx=0x7fc2ec008040 comp rx=0 tx=0).stop 2024-04-16T14:46:49.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.908+0000 7fc2fcd5d640 1 -- 172.21.15.5:0/701583979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f80fb120 msgr2=0x7fc2f8111c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:49.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.908+0000 7fc2fcd5d640 1 --2- 172.21.15.5:0/701583979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f80fb120 0x7fc2f8111c20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80041d0 tx=0x7fc2e8009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:49.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.908+0000 7fc2fcd5d640 1 -- 172.21.15.5:0/701583979 shutdown_connections 2024-04-16T14:46:49.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.908+0000 7fc2fcd5d640 1 --2- 172.21.15.5:0/701583979 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fc2e006e0b0 0x7fc2e0070560 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:49.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.908+0000 7fc2fcd5d640 1 --2- 172.21.15.5:0/701583979 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2f8101150 0x7fc2f8112160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:49.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.908+0000 7fc2fcd5d640 1 --2- 172.21.15.5:0/701583979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2f80fb120 0x7fc2f8111c20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:49.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.908+0000 7fc2fcd5d640 1 -- 172.21.15.5:0/701583979 >> 172.21.15.5:0/701583979 conn(0x7fc2f80710c0 msgr2=0x7fc2f80f9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:49.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.908+0000 7fc2fcd5d640 1 -- 172.21.15.5:0/701583979 shutdown_connections 2024-04-16T14:46:49.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:49.908+0000 7fc2fcd5d640 1 -- 172.21.15.5:0/701583979 wait complete. 2024-04-16T14:46:49.918 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-16T14:46:50.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.023+0000 7ff2d706e640 1 -- 172.21.15.5:0/946289532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2d0102400 msgr2=0x7ff2d01027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:50.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.023+0000 7ff2d706e640 1 --2- 172.21.15.5:0/946289532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2d0102400 0x7ff2d01027d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00048d0 tx=0x7ff2c0009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:50.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.023+0000 7ff2d706e640 1 -- 172.21.15.5:0/946289532 shutdown_connections 2024-04-16T14:46:50.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.023+0000 7ff2d706e640 1 --2- 172.21.15.5:0/946289532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2d0102da0 0x7ff2d00fc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:50.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.023+0000 7ff2d706e640 1 --2- 172.21.15.5:0/946289532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2d0102400 0x7ff2d01027d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:50.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.023+0000 7ff2d706e640 1 -- 172.21.15.5:0/946289532 >> 172.21.15.5:0/946289532 conn(0x7ff2d00f7fb0 msgr2=0x7ff2d00fa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:50.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.023+0000 7ff2d706e640 1 -- 172.21.15.5:0/946289532 shutdown_connections 2024-04-16T14:46:50.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.024+0000 7ff2d706e640 1 -- 172.21.15.5:0/946289532 wait complete. 2024-04-16T14:46:50.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.024+0000 7ff2d706e640 1 Processor -- start 2024-04-16T14:46:50.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.024+0000 7ff2d706e640 1 -- start start 2024-04-16T14:46:50.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.024+0000 7ff2d706e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2d0102400 0x7ff2d006f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:50.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.024+0000 7ff2d706e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2d0102da0 0x7ff2d006fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:50.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.024+0000 7ff2d706e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d00716b0 con 0x7ff2d0102400 2024-04-16T14:46:50.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.024+0000 7ff2d706e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d0070250 con 0x7ff2d0102da0 2024-04-16T14:46:50.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.024+0000 7ff2d4e0a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2d0102400 0x7ff2d006f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:50.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.024+0000 7ff2d4e0a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2d0102400 0x7ff2d006f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54874/0 (socket says 172.21.15.5:54874) 2024-04-16T14:46:50.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.024+0000 7ff2d4e0a640 1 -- 172.21.15.5:0/344872955 learned_addr learned my addr 172.21.15.5:0/344872955 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:50.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.025+0000 7ff2cffff640 1 --2- 172.21.15.5:0/344872955 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2d0102da0 0x7ff2d006fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:50.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.025+0000 7ff2d4e0a640 1 -- 172.21.15.5:0/344872955 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2d0102da0 msgr2=0x7ff2d006fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:50.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.025+0000 7ff2d4e0a640 1 --2- 172.21.15.5:0/344872955 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2d0102da0 0x7ff2d006fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:50.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.025+0000 7ff2d4e0a640 1 -- 172.21.15.5:0/344872955 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c0005040 con 0x7ff2d0102400 2024-04-16T14:46:50.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.025+0000 7ff2d4e0a640 1 --2- 172.21.15.5:0/344872955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2d0102400 0x7ff2d006f7d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0004930 tx=0x7ff2c0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:50.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.025+0000 7ff2cd7fa640 1 -- 172.21.15.5:0/344872955 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2c00094c0 con 0x7ff2d0102400 2024-04-16T14:46:50.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.025+0000 7ff2d706e640 1 -- 172.21.15.5:0/344872955 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d00704d0 con 0x7ff2d0102400 2024-04-16T14:46:50.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.025+0000 7ff2cd7fa640 1 -- 172.21.15.5:0/344872955 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff2c0032e50 con 0x7ff2d0102400 2024-04-16T14:46:50.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.025+0000 7ff2cd7fa640 1 -- 172.21.15.5:0/344872955 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2c00433b0 con 0x7ff2d0102400 2024-04-16T14:46:50.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.025+0000 7ff2d706e640 1 -- 172.21.15.5:0/344872955 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d01195c0 con 0x7ff2d0102400 2024-04-16T14:46:50.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.026+0000 7ff2d706e640 1 -- 172.21.15.5:0/344872955 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d00fdb70 con 0x7ff2d0102400 2024-04-16T14:46:50.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.027+0000 7ff2cd7fa640 1 -- 172.21.15.5:0/344872955 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7ff2c002f070 con 0x7ff2d0102400 2024-04-16T14:46:50.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.027+0000 7ff2cd7fa640 1 --2- 172.21.15.5:0/344872955 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff2bc06e0b0 0x7ff2bc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:50.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.027+0000 7ff2cffff640 1 --2- 172.21.15.5:0/344872955 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff2bc06e0b0 0x7ff2bc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:50.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.027+0000 7ff2cd7fa640 1 -- 172.21.15.5:0/344872955 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7ff2c00af980 con 0x7ff2d0102400 2024-04-16T14:46:50.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.028+0000 7ff2cffff640 1 --2- 172.21.15.5:0/344872955 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff2bc06e0b0 0x7ff2bc070560 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0070f00 tx=0x7ff2b800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:50.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.032+0000 7ff2cd7fa640 1 -- 172.21.15.5:0/344872955 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7ff2c0078d00 con 0x7ff2d0102400 2024-04-16T14:46:50.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.221+0000 7ff2d706e640 1 -- 172.21.15.5:0/344872955 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7ff2d004bcc0 con 0x7ff2d0102400 2024-04-16T14:46:50.219 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.221+0000 7ff2cd7fa640 1 -- 172.21.15.5:0/344872955 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7ff2c007c3c0 con 0x7ff2d0102400 2024-04-16T14:46:50.220 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-16T14:46:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.223+0000 7ff2d706e640 1 -- 172.21.15.5:0/344872955 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff2bc06e0b0 msgr2=0x7ff2bc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.223+0000 7ff2d706e640 1 --2- 172.21.15.5:0/344872955 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff2bc06e0b0 0x7ff2bc070560 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0070f00 tx=0x7ff2b800b040 comp rx=0 tx=0).stop 2024-04-16T14:46:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.223+0000 7ff2d706e640 1 -- 172.21.15.5:0/344872955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2d0102400 msgr2=0x7ff2d006f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.223+0000 7ff2d706e640 1 --2- 172.21.15.5:0/344872955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2d0102400 0x7ff2d006f7d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0004930 tx=0x7ff2c0009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.223+0000 7ff2d706e640 1 -- 172.21.15.5:0/344872955 shutdown_connections 2024-04-16T14:46:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.223+0000 7ff2d706e640 1 --2- 172.21.15.5:0/344872955 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7ff2bc06e0b0 0x7ff2bc070560 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:50.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.223+0000 7ff2d706e640 1 --2- 172.21.15.5:0/344872955 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff2d0102da0 0x7ff2d006fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:50.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.223+0000 7ff2d706e640 1 --2- 172.21.15.5:0/344872955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff2d0102400 0x7ff2d006f7d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:50.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.223+0000 7ff2d706e640 1 -- 172.21.15.5:0/344872955 >> 172.21.15.5:0/344872955 conn(0x7ff2d00f7fb0 msgr2=0x7ff2d00f8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:50.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.224+0000 7ff2d706e640 1 -- 172.21.15.5:0/344872955 shutdown_connections 2024-04-16T14:46:50.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.224+0000 7ff2d706e640 1 -- 172.21.15.5:0/344872955 wait complete. 2024-04-16T14:46:50.233 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T14:46:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.336+0000 7f5253f1d640 1 -- 172.21.15.5:0/2220419439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f524c0fa8d0 msgr2=0x7f524c0fad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.336+0000 7f5253f1d640 1 --2- 172.21.15.5:0/2220419439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f524c0fa8d0 0x7f524c0fad40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f523c0048d0 tx=0x7f523c009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.336+0000 7f5253f1d640 1 -- 172.21.15.5:0/2220419439 shutdown_connections 2024-04-16T14:46:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.336+0000 7f5253f1d640 1 --2- 172.21.15.5:0/2220419439 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f524c0fa8d0 0x7f524c0fad40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.336+0000 7f5253f1d640 1 --2- 172.21.15.5:0/2220419439 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f524c102260 0x7f524c102630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.336+0000 7f5253f1d640 1 -- 172.21.15.5:0/2220419439 >> 172.21.15.5:0/2220419439 conn(0x7f524c0708f0 msgr2=0x7f524c070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.336+0000 7f5253f1d640 1 -- 172.21.15.5:0/2220419439 shutdown_connections 2024-04-16T14:46:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.336+0000 7f5253f1d640 1 -- 172.21.15.5:0/2220419439 wait complete. 2024-04-16T14:46:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.337+0000 7f5253f1d640 1 Processor -- start 2024-04-16T14:46:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.337+0000 7f5253f1d640 1 -- start start 2024-04-16T14:46:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.337+0000 7f5253f1d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f524c0fa8d0 0x7f524c112d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:50.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.337+0000 7f5253f1d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f524c102260 0x7f524c113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.337+0000 7f5253f1d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c113850 con 0x7f524c0fa8d0 2024-04-16T14:46:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.337+0000 7f5253f1d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c10cea0 con 0x7f524c102260 2024-04-16T14:46:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.337+0000 7f5251cb9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f524c0fa8d0 0x7f524c112d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.337+0000 7f5251cb9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f524c0fa8d0 0x7f524c112d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54878/0 (socket says 172.21.15.5:54878) 2024-04-16T14:46:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.337+0000 7f5251cb9640 1 -- 172.21.15.5:0/2367599191 learned_addr learned my addr 172.21.15.5:0/2367599191 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.337+0000 7f52514b8640 1 --2- 172.21.15.5:0/2367599191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f524c102260 0x7f524c113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.337+0000 7f5251cb9640 1 -- 172.21.15.5:0/2367599191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f524c102260 msgr2=0x7f524c113250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.337+0000 7f5251cb9640 1 --2- 172.21.15.5:0/2367599191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f524c102260 0x7f524c113250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.337+0000 7f5251cb9640 1 -- 172.21.15.5:0/2367599191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c005040 con 0x7f524c0fa8d0 2024-04-16T14:46:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.338+0000 7f5251cb9640 1 --2- 172.21.15.5:0/2367599191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f524c0fa8d0 0x7f524c112d10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f524800eb70 tx=0x7f524800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.338+0000 7f52427fc640 1 -- 172.21.15.5:0/2367599191 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5248007c30 con 0x7f524c0fa8d0 2024-04-16T14:46:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.338+0000 7f52427fc640 1 -- 172.21.15.5:0/2367599191 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f524800f040 con 0x7f524c0fa8d0 2024-04-16T14:46:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.338+0000 7f5253f1d640 1 -- 172.21.15.5:0/2367599191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f524c10d120 con 0x7f524c0fa8d0 2024-04-16T14:46:50.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.338+0000 7f52427fc640 1 -- 172.21.15.5:0/2367599191 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52480095b0 con 0x7f524c0fa8d0 2024-04-16T14:46:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.338+0000 7f5253f1d640 1 -- 172.21.15.5:0/2367599191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524c10d610 con 0x7f524c0fa8d0 2024-04-16T14:46:50.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.339+0000 7f5253f1d640 1 -- 172.21.15.5:0/2367599191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f524c0652e0 con 0x7f524c0fa8d0 2024-04-16T14:46:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.339+0000 7f52427fc640 1 -- 172.21.15.5:0/2367599191 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f5248009730 con 0x7f524c0fa8d0 2024-04-16T14:46:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.340+0000 7f52427fc640 1 --2- 172.21.15.5:0/2367599191 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f523806e0b0 0x7f5238070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.340+0000 7f52427fc640 1 -- 172.21.15.5:0/2367599191 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f524808d970 con 0x7f524c0fa8d0 2024-04-16T14:46:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.340+0000 7f52514b8640 1 --2- 172.21.15.5:0/2367599191 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f523806e0b0 0x7f5238070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.340+0000 7f52514b8640 1 --2- 172.21.15.5:0/2367599191 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f523806e0b0 0x7f5238070560 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f524c106a00 tx=0x7f523c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:50.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.344+0000 7f52427fc640 1 -- 172.21.15.5:0/2367599191 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f5248056c40 con 0x7f524c0fa8d0 2024-04-16T14:46:50.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:50 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/2226647073' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-16T14:46:50.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:50 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/327399188' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-16T14:46:50.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:50 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/701583979' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-16T14:46:50.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:50 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/2226647073' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-16T14:46:50.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:50 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/327399188' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-16T14:46:50.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:50 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/701583979' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-16T14:46:50.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.544+0000 7f5253f1d640 1 -- 172.21.15.5:0/2367599191 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f524c1093d0 con 0x7f524c0fa8d0 2024-04-16T14:46:50.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.544+0000 7f52427fc640 1 -- 172.21.15.5:0/2367599191 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v85) v1 ==== 81+0+2399 (secure 0 0 0) 0x7f524805a300 con 0x7f524c0fa8d0 2024-04-16T14:46:50.543 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.115:6827/2476249308 2024-04-17T14:43:22.064543+0000 2024-04-16T14:46:50.543 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.115:6826/2476249308 2024-04-17T14:43:22.064543+0000 2024-04-16T14:46:50.543 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6829/402035291 2024-04-17T14:42:40.192043+0000 2024-04-16T14:46:50.543 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6828/402035291 2024-04-17T14:42:40.192043+0000 2024-04-16T14:46:50.543 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/4176454319 2024-04-17T14:28:02.662455+0000 2024-04-16T14:46:50.543 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2384405072 2024-04-17T14:26:17.425567+0000 2024-04-16T14:46:50.543 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/1956301653 2024-04-17T14:37:23.186462+0000 2024-04-16T14:46:50.543 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/801827499 2024-04-17T14:26:48.930147+0000 2024-04-16T14:46:50.543 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2010393498 2024-04-17T14:34:55.944821+0000 2024-04-16T14:46:50.543 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/3841652776 2024-04-17T14:34:55.944821+0000 2024-04-16T14:46:50.544 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.115:6828/460631486 2024-04-17T14:36:31.676822+0000 2024-04-16T14:46:50.544 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/1109429271 2024-04-17T14:37:23.186462+0000 2024-04-16T14:46:50.544 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/4125351321 2024-04-17T14:34:55.944821+0000 2024-04-16T14:46:50.544 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/1086445367 2024-04-17T14:26:17.425567+0000 2024-04-16T14:46:50.544 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.115:0/1842350799 2024-04-17T14:36:31.676822+0000 2024-04-16T14:46:50.544 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2653432440 2024-04-17T14:28:02.662455+0000 2024-04-16T14:46:50.544 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/861562298 2024-04-17T14:37:23.186462+0000 2024-04-16T14:46:50.544 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3710869010 2024-04-17T14:26:17.425567+0000 2024-04-16T14:46:50.544 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/3841652776 2024-04-17T14:34:55.944821+0000 2024-04-16T14:46:50.544 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3602505234 2024-04-17T14:34:55.944821+0000 2024-04-16T14:46:50.544 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2013882368 2024-04-17T14:26:48.930147+0000 2024-04-16T14:46:50.544 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/1548281910 2024-04-17T14:28:02.662455+0000 2024-04-16T14:46:50.544 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/1086445367 2024-04-17T14:26:17.425567+0000 2024-04-16T14:46:50.544 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.115:0/861197783 2024-04-17T14:36:31.676822+0000 2024-04-16T14:46:50.545 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3891215761 2024-04-17T14:37:23.186462+0000 2024-04-16T14:46:50.545 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6827/3000067296 2024-04-17T14:33:00.804392+0000 2024-04-16T14:46:50.545 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3767913866 2024-04-17T14:28:02.662455+0000 2024-04-16T14:46:50.545 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3063530168 2024-04-17T14:34:55.944821+0000 2024-04-16T14:46:50.545 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.115:0/3056216034 2024-04-17T14:36:31.676822+0000 2024-04-16T14:46:50.545 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.115:6829/460631486 2024-04-17T14:36:31.676822+0000 2024-04-16T14:46:50.545 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3364969045 2024-04-17T14:26:48.930147+0000 2024-04-16T14:46:50.545 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/4088193218 2024-04-17T14:26:48.930147+0000 2024-04-16T14:46:50.545 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/4088193218 2024-04-17T14:26:48.930147+0000 2024-04-16T14:46:50.545 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/726821609 2024-04-17T14:37:23.186462+0000 2024-04-16T14:46:50.545 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6826/3000067296 2024-04-17T14:33:00.804392+0000 2024-04-16T14:46:50.545 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/1956301653 2024-04-17T14:37:23.186462+0000 2024-04-16T14:46:50.545 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3196662527 2024-04-17T14:37:23.186462+0000 2024-04-16T14:46:50.546 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/4176454319 2024-04-17T14:28:02.662455+0000 2024-04-16T14:46:50.546 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2015079913 2024-04-17T14:26:17.425567+0000 2024-04-16T14:46:50.546 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.115:0/1736155115 2024-04-17T14:36:31.676822+0000 2024-04-16T14:46:50.546 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2335924356 2024-04-17T14:37:23.186462+0000 2024-04-16T14:46:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:listed 41 entries 2024-04-16T14:46:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.546+0000 7f5253f1d640 1 -- 172.21.15.5:0/2367599191 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f523806e0b0 msgr2=0x7f5238070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.546+0000 7f5253f1d640 1 --2- 172.21.15.5:0/2367599191 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f523806e0b0 0x7f5238070560 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f524c106a00 tx=0x7f523c009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.546+0000 7f5253f1d640 1 -- 172.21.15.5:0/2367599191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f524c0fa8d0 msgr2=0x7f524c112d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.546+0000 7f5253f1d640 1 --2- 172.21.15.5:0/2367599191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f524c0fa8d0 0x7f524c112d10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f524800eb70 tx=0x7f524800b040 comp rx=0 tx=0).stop 2024-04-16T14:46:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.546+0000 7f5253f1d640 1 -- 172.21.15.5:0/2367599191 shutdown_connections 2024-04-16T14:46:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.546+0000 7f5253f1d640 1 --2- 172.21.15.5:0/2367599191 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f523806e0b0 0x7f5238070560 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.546+0000 7f5253f1d640 1 --2- 172.21.15.5:0/2367599191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f524c102260 0x7f524c113250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.546+0000 7f5253f1d640 1 --2- 172.21.15.5:0/2367599191 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f524c0fa8d0 0x7f524c112d10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.546+0000 7f5253f1d640 1 -- 172.21.15.5:0/2367599191 >> 172.21.15.5:0/2367599191 conn(0x7f524c0708f0 msgr2=0x7f524c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.546+0000 7f5253f1d640 1 -- 172.21.15.5:0/2367599191 shutdown_connections 2024-04-16T14:46:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.546+0000 7f5253f1d640 1 -- 172.21.15.5:0/2367599191 wait complete. 2024-04-16T14:46:50.556 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-16T14:46:50.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:46:50.556 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-16T14:46:50.585 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-04-16T14:46:50.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:46:50.585 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-16T14:46:50.655 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-16T14:46:50.655 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T14:46:50.676 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-04-16T14:46:50.676 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-16T14:46:50.736 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-16T14:46:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.840+0000 7faaab6ae640 1 -- 172.21.15.5:0/3609718305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa41021b0 msgr2=0x7faaa4102580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.840+0000 7faaab6ae640 1 --2- 172.21.15.5:0/3609718305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa41021b0 0x7faaa4102580 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7faa94009c50 tx=0x7faa94004d10 comp rx=0 tx=0).stop 2024-04-16T14:46:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.840+0000 7faaab6ae640 1 -- 172.21.15.5:0/3609718305 shutdown_connections 2024-04-16T14:46:50.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.840+0000 7faaab6ae640 1 --2- 172.21.15.5:0/3609718305 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faaa4102b50 0x7faaa40fc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.840+0000 7faaab6ae640 1 --2- 172.21.15.5:0/3609718305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa41021b0 0x7faaa4102580 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.840+0000 7faaab6ae640 1 -- 172.21.15.5:0/3609718305 >> 172.21.15.5:0/3609718305 conn(0x7faaa40f7d40 msgr2=0x7faaa40fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.840+0000 7faaab6ae640 1 -- 172.21.15.5:0/3609718305 shutdown_connections 2024-04-16T14:46:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.840+0000 7faaab6ae640 1 -- 172.21.15.5:0/3609718305 wait complete. 2024-04-16T14:46:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.840+0000 7faaab6ae640 1 Processor -- start 2024-04-16T14:46:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.841+0000 7faaab6ae640 1 -- start start 2024-04-16T14:46:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.841+0000 7faaab6ae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa41021b0 0x7faaa4112d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.841+0000 7faaab6ae640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faaa4102b50 0x7faaa4113290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.841+0000 7faaab6ae640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa4113920 con 0x7faaa41021b0 2024-04-16T14:46:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.841+0000 7faaab6ae640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa410cee0 con 0x7faaa4102b50 2024-04-16T14:46:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.841+0000 7faaa944a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa41021b0 0x7faaa4112d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.841+0000 7faaa944a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa41021b0 0x7faaa4112d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54908/0 (socket says 172.21.15.5:54908) 2024-04-16T14:46:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.841+0000 7faaa944a640 1 -- 172.21.15.5:0/3470372783 learned_addr learned my addr 172.21.15.5:0/3470372783 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:50.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.841+0000 7faaa944a640 1 -- 172.21.15.5:0/3470372783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faaa4102b50 msgr2=0x7faaa4113290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.841+0000 7faaa944a640 1 --2- 172.21.15.5:0/3470372783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faaa4102b50 0x7faaa4113290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.841+0000 7faaa944a640 1 -- 172.21.15.5:0/3470372783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa940098b0 con 0x7faaa41021b0 2024-04-16T14:46:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.841+0000 7faaa944a640 1 --2- 172.21.15.5:0/3470372783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa41021b0 0x7faaa4112d50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7faa94004a30 tx=0x7faa94004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.841+0000 7faaa1ffb640 1 -- 172.21.15.5:0/3470372783 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa9403a070 con 0x7faaa41021b0 2024-04-16T14:46:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.841+0000 7faaa1ffb640 1 -- 172.21.15.5:0/3470372783 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faa94035b20 con 0x7faaa41021b0 2024-04-16T14:46:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.841+0000 7faaab6ae640 1 -- 172.21.15.5:0/3470372783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa410d160 con 0x7faaa41021b0 2024-04-16T14:46:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.841+0000 7faaa1ffb640 1 -- 172.21.15.5:0/3470372783 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa9403eaa0 con 0x7faaa41021b0 2024-04-16T14:46:50.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.842+0000 7faaab6ae640 1 -- 172.21.15.5:0/3470372783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa410d680 con 0x7faaa41021b0 2024-04-16T14:46:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.843+0000 7faaab6ae640 1 -- 172.21.15.5:0/3470372783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa40fd920 con 0x7faaa41021b0 2024-04-16T14:46:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.843+0000 7faaa1ffb640 1 -- 172.21.15.5:0/3470372783 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7faa94032070 con 0x7faaa41021b0 2024-04-16T14:46:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.844+0000 7faaa1ffb640 1 --2- 172.21.15.5:0/3470372783 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7faa8c06e0b0 0x7faa8c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.844+0000 7faaa1ffb640 1 -- 172.21.15.5:0/3470372783 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7faa940b0430 con 0x7faaa41021b0 2024-04-16T14:46:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.844+0000 7faaa8c49640 1 --2- 172.21.15.5:0/3470372783 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7faa8c06e0b0 0x7faa8c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:50.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.844+0000 7faaa8c49640 1 --2- 172.21.15.5:0/3470372783 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7faa8c06e0b0 0x7faa8c070560 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faaa410e610 tx=0x7faa98006d20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:50.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:50.848+0000 7faaa1ffb640 1 -- 172.21.15.5:0/3470372783 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7faa94079700 con 0x7faaa41021b0 2024-04-16T14:46:51.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.033+0000 7faaab6ae640 1 -- 172.21.15.5:0/3470372783 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faaa4109370 con 0x7faaa41021b0 2024-04-16T14:46:51.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.035+0000 7faaa1ffb640 1 -- 172.21.15.5:0/3470372783 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16703 (secure 0 0 0) 0x7faa9407cdc0 con 0x7faaa41021b0 2024-04-16T14:46:51.033 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-04-16T14:46:51.033 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":85,"fsid":"10609bfa-fbfd-11ee-bc90-c7b262605968","created":"2024-04-16T14:25:45.190718+0000","modified":"2024-04-16T14:43:22.064592+0000","last_up_change":"2024-04-16T14:41:44.210800+0000","last_in_change":"2024-04-16T14:31:07.952511+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T14:30:12.985367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-16T14:32:44.205257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-16T14:32:44.506945+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa9fa9e4-bdd2-42c5-ba51-8d141fa9c4c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":50,"up_from":54,"up_thru":79,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1335449550},{"type":"v1","addr":"172.21.15.5:6803","nonce":1335449550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1335449550},{"type":"v1","addr":"172.21.15.5:6805","nonce":1335449550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1335449550},{"type":"v1","addr":"172.21.15.5:6809","nonce":1335449550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1335449550},{"type":"v1","addr":"172.21.15.5:6807","nonce":1335449550}]},"public_addr":"172.21.15.5:6803/1335449550","cluster_addr":"172.21.15.5:6805/1335449550","heartbeat_back_addr":"172.21.15.5:6809/1335449550","heartbeat_front_addr":"172.21.15.5:6807/1335449550","state":["exists","up"]},{"osd":1,"uuid":"d4074765-a246-412a-8b68-8da402adc7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":55,"up_from":59,"up_thru":79,"down_at":56,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2244573810},{"type":"v1","addr":"172.21.15.5:6811","nonce":2244573810}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2244573810},{"type":"v1","addr":"172.21.15.5:6813","nonce":2244573810}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2244573810},{"type":"v1","addr":"172.21.15.5:6817","nonce":2244573810}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2244573810},{"type":"v1","addr":"172.21.15.5:6815","nonce":2244573810}]},"public_addr":"172.21.15.5:6811/2244573810","cluster_addr":"172.21.15.5:6813/2244573810","heartbeat_back_addr":"172.21.15.5:6817/2244573810","heartbeat_front_addr":"172.21.15.5:6815/2244573810","state":["exists","up"]},{"osd":2,"uuid":"1851758c-0015-4f54-b4b8-30c1424394ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":60,"up_from":64,"up_thru":79,"down_at":61,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":643342483},{"type":"v1","addr":"172.21.15.5:6819","nonce":643342483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":643342483},{"type":"v1","addr":"172.21.15.5:6821","nonce":643342483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":643342483},{"type":"v1","addr":"172.21.15.5:6825","nonce":643342483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":643342483},{"type":"v1","addr":"172.21.15.5:6823","nonce":643342483}]},"public_addr":"172.21.15.5:6819/643342483","cluster_addr":"172.21.15.5:6821/643342483","heartbeat_back_addr":"172.21.15.5:6825/643342483","heartbeat_front_addr":"172.21.15.5:6823/643342483","state":["exists","up"]},{"osd":3,"uuid":"ab6404e2-5cef-4a8a-8b93-a24914c67fc2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":65,"up_from":69,"up_thru":79,"down_at":66,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":4263407632},{"type":"v1","addr":"172.21.15.115:6801","nonce":4263407632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":4263407632},{"type":"v1","addr":"172.21.15.115:6803","nonce":4263407632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":4263407632},{"type":"v1","addr":"172.21.15.115:6807","nonce":4263407632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":4263407632},{"type":"v1","addr":"172.21.15.115:6805","nonce":4263407632}]},"public_addr":"172.21.15.115:6801/4263407632","cluster_addr":"172.21.15.115:6803/4263407632","heartbeat_back_addr":"172.21.15.115:6807/4263407632","heartbeat_front_addr":"172.21.15.115:6805/4263407632","state":["exists","up"]},{"osd":4,"uuid":"4252814c-6811-4b53-a8be-cd65d7aa39a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":70,"up_from":74,"up_thru":79,"down_at":71,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":139500214},{"type":"v1","addr":"172.21.15.115:6809","nonce":139500214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":139500214},{"type":"v1","addr":"172.21.15.115:6811","nonce":139500214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":139500214},{"type":"v1","addr":"172.21.15.115:6815","nonce":139500214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":139500214},{"type":"v1","addr":"172.21.15.115:6813","nonce":139500214}]},"public_addr":"172.21.15.115:6809/139500214","cluster_addr":"172.21.15.115:6811/139500214","heartbeat_back_addr":"172.21.15.115:6815/139500214","heartbeat_front_addr":"172.21.15.115:6813/139500214","state":["exists","up"]},{"osd":5,"uuid":"124732a1-f6a0-462e-bd5e-2bcd743ab2a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":75,"up_from":79,"up_thru":79,"down_at":76,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":1604069545},{"type":"v1","addr":"172.21.15.115:6817","nonce":1604069545}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":1604069545},{"type":"v1","addr":"172.21.15.115:6819","nonce":1604069545}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":1604069545},{"type":"v1","addr":"172.21.15.115:6823","nonce":1604069545}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":1604069545},{"type":"v1","addr":"172.21.15.115:6821","nonce":1604069545}]},"public_addr":"172.21.15.115:6817/1604069545","cluster_addr":"172.21.15.115:6819/1604069545","heartbeat_back_addr":"172.21.15.115:6823/1604069545","heartbeat_front_addr":"172.21.15.115:6821/1604069545","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:29:14.299546+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:29:41.658611+0000","dead_epoch":55},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:30:10.127883+0000","dead_epoch":60},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:30:33.310873+0000","dead_epoch":65},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:30:59.158923+0000","dead_epoch":70},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T14:31:24.898158+0000","dead_epoch":75}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:6827/2476249308":"2024-04-17T14:43:22.064543+0000","172.21.15.115:6826/2476249308":"2024-04-17T14:43:22.064543+0000","172.21.15.5:6829/402035291":"2024-04-17T14:42:40.192043+0000","172.21.15.5:6828/402035291":"2024-04-17T14:42:40.192043+0000","172.21.15.5:6800/4176454319":"2024-04-17T14:28:02.662455+0000","172.21.15.5:0/2384405072":"2024-04-17T14:26:17.425567+0000","172.21.15.5:6801/1956301653":"2024-04-17T14:37:23.186462+0000","172.21.15.5:0/801827499":"2024-04-17T14:26:48.930147+0000","172.21.15.5:0/2010393498":"2024-04-17T14:34:55.944821+0000","172.21.15.5:6800/3841652776":"2024-04-17T14:34:55.944821+0000","172.21.15.115:6828/460631486":"2024-04-17T14:36:31.676822+0000","172.21.15.5:0/1109429271":"2024-04-17T14:37:23.186462+0000","172.21.15.5:0/4125351321":"2024-04-17T14:34:55.944821+0000","172.21.15.5:6800/1086445367":"2024-04-17T14:26:17.425567+0000","172.21.15.115:0/1842350799":"2024-04-17T14:36:31.676822+0000","172.21.15.5:0/2653432440":"2024-04-17T14:28:02.662455+0000","172.21.15.5:0/861562298":"2024-04-17T14:37:23.186462+0000","172.21.15.5:0/3710869010":"2024-04-17T14:26:17.425567+0000","172.21.15.5:6801/3841652776":"2024-04-17T14:34:55.944821+0000","172.21.15.5:0/3602505234":"2024-04-17T14:34:55.944821+0000","172.21.15.5:0/2013882368":"2024-04-17T14:26:48.930147+0000","172.21.15.5:0/1548281910":"2024-04-17T14:28:02.662455+0000","172.21.15.5:6801/1086445367":"2024-04-17T14:26:17.425567+0000","172.21.15.115:0/861197783":"2024-04-17T14:36:31.676822+0000","172.21.15.5:0/3891215761":"2024-04-17T14:37:23.186462+0000","172.21.15.5:6827/3000067296":"2024-04-17T14:33:00.804392+0000","172.21.15.5:0/3767913866":"2024-04-17T14:28:02.662455+0000","172.21.15.5:0/3063530168":"2024-04-17T14:34:55.944821+0000","172.21.15.115:0/3056216034":"2024-04-17T14:36:31.676822+0000","172.21.15.115:6829/460631486":"2024-04-17T14:36:31.676822+0000","172.21.15.5:0/3364969045":"2024-04-17T14:26:48.930147+0000","172.21.15.5:6800/4088193218":"2024-04-17T14:26:48.930147+0000","172.21.15.5:6801/4088193218":"2024-04-17T14:26:48.930147+0000","172.21.15.5:0/726821609":"2024-04-17T14:37:23.186462+0000","172.21.15.5:6826/3000067296":"2024-04-17T14:33:00.804392+0000","172.21.15.5:6800/1956301653":"2024-04-17T14:37:23.186462+0000","172.21.15.5:0/3196662527":"2024-04-17T14:37:23.186462+0000","172.21.15.5:6801/4176454319":"2024-04-17T14:28:02.662455+0000","172.21.15.5:0/2015079913":"2024-04-17T14:26:17.425567+0000","172.21.15.115:0/1736155115":"2024-04-17T14:36:31.676822+0000","172.21.15.5:0/2335924356":"2024-04-17T14:37:23.186462+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T14:46:51.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.037+0000 7faaab6ae640 1 -- 172.21.15.5:0/3470372783 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7faa8c06e0b0 msgr2=0x7faa8c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:51.035 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.037+0000 7faaab6ae640 1 --2- 172.21.15.5:0/3470372783 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7faa8c06e0b0 0x7faa8c070560 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faaa410e610 tx=0x7faa98006d20 comp rx=0 tx=0).stop 2024-04-16T14:46:51.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.037+0000 7faaab6ae640 1 -- 172.21.15.5:0/3470372783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa41021b0 msgr2=0x7faaa4112d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:51.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.037+0000 7faaab6ae640 1 --2- 172.21.15.5:0/3470372783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa41021b0 0x7faaa4112d50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7faa94004a30 tx=0x7faa94004d10 comp rx=0 tx=0).stop 2024-04-16T14:46:51.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.037+0000 7faaab6ae640 1 -- 172.21.15.5:0/3470372783 shutdown_connections 2024-04-16T14:46:51.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.037+0000 7faaab6ae640 1 --2- 172.21.15.5:0/3470372783 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7faa8c06e0b0 0x7faa8c070560 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.037+0000 7faaab6ae640 1 --2- 172.21.15.5:0/3470372783 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faaa4102b50 0x7faaa4113290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.037+0000 7faaab6ae640 1 --2- 172.21.15.5:0/3470372783 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faaa41021b0 0x7faaa4112d50 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.037+0000 7faaab6ae640 1 -- 172.21.15.5:0/3470372783 >> 172.21.15.5:0/3470372783 conn(0x7faaa40f7d40 msgr2=0x7faaa40f8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:51.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.037+0000 7faaab6ae640 1 -- 172.21.15.5:0/3470372783 shutdown_connections 2024-04-16T14:46:51.036 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.037+0000 7faaab6ae640 1 -- 172.21.15.5:0/3470372783 wait complete. 2024-04-16T14:46:51.047 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-16T14:30:12.985367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-16T14:32:44.205257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-16T14:32:44.506945+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-16T14:46:51.047 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-16T14:46:51.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.152+0000 7fcd746ae640 1 -- 172.21.15.5:0/304081489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd6c101c80 msgr2=0x7fcd6c0fb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:51.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.152+0000 7fcd746ae640 1 --2- 172.21.15.5:0/304081489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd6c101c80 0x7fcd6c0fb310 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c0048d0 tx=0x7fcd5c009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.152+0000 7fcd746ae640 1 -- 172.21.15.5:0/304081489 shutdown_connections 2024-04-16T14:46:51.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.152+0000 7fcd746ae640 1 --2- 172.21.15.5:0/304081489 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd6c101c80 0x7fcd6c0fb310 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.152+0000 7fcd746ae640 1 --2- 172.21.15.5:0/304081489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd6c1012e0 0x7fcd6c1016b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.152+0000 7fcd746ae640 1 -- 172.21.15.5:0/304081489 >> 172.21.15.5:0/304081489 conn(0x7fcd6c0f6eb0 msgr2=0x7fcd6c0f92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:51.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.152+0000 7fcd746ae640 1 -- 172.21.15.5:0/304081489 shutdown_connections 2024-04-16T14:46:51.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.152+0000 7fcd746ae640 1 -- 172.21.15.5:0/304081489 wait complete. 2024-04-16T14:46:51.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.153+0000 7fcd746ae640 1 Processor -- start 2024-04-16T14:46:51.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.153+0000 7fcd746ae640 1 -- start start 2024-04-16T14:46:51.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.153+0000 7fcd746ae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd6c1012e0 0x7fcd6c10e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:51.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.153+0000 7fcd746ae640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd6c101c80 0x7fcd6c10e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:51.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.153+0000 7fcd746ae640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6c066520 con 0x7fcd6c1012e0 2024-04-16T14:46:51.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.153+0000 7fcd746ae640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6c10eb50 con 0x7fcd6c101c80 2024-04-16T14:46:51.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.153+0000 7fcd7244a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd6c1012e0 0x7fcd6c10e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:51.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.153+0000 7fcd7244a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd6c1012e0 0x7fcd6c10e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54928/0 (socket says 172.21.15.5:54928) 2024-04-16T14:46:51.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.153+0000 7fcd7244a640 1 -- 172.21.15.5:0/4205159131 learned_addr learned my addr 172.21.15.5:0/4205159131 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:51.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.153+0000 7fcd71c49640 1 --2- 172.21.15.5:0/4205159131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd6c101c80 0x7fcd6c10e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:51.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.153+0000 7fcd7244a640 1 -- 172.21.15.5:0/4205159131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd6c101c80 msgr2=0x7fcd6c10e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.153+0000 7fcd7244a640 1 --2- 172.21.15.5:0/4205159131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd6c101c80 0x7fcd6c10e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.153+0000 7fcd7244a640 1 -- 172.21.15.5:0/4205159131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5c005040 con 0x7fcd6c1012e0 2024-04-16T14:46:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.154+0000 7fcd7244a640 1 --2- 172.21.15.5:0/4205159131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd6c1012e0 0x7fcd6c10e0d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcd6800eb70 tx=0x7fcd6800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.154+0000 7fcd62ffd640 1 -- 172.21.15.5:0/4205159131 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd68007c30 con 0x7fcd6c1012e0 2024-04-16T14:46:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.154+0000 7fcd62ffd640 1 -- 172.21.15.5:0/4205159131 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd6800f040 con 0x7fcd6c1012e0 2024-04-16T14:46:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.154+0000 7fcd746ae640 1 -- 172.21.15.5:0/4205159131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd6c10edd0 con 0x7fcd6c1012e0 2024-04-16T14:46:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.154+0000 7fcd62ffd640 1 -- 172.21.15.5:0/4205159131 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd680095b0 con 0x7fcd6c1012e0 2024-04-16T14:46:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.154+0000 7fcd746ae640 1 -- 172.21.15.5:0/4205159131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd6c117390 con 0x7fcd6c1012e0 2024-04-16T14:46:51.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.155+0000 7fcd746ae640 1 -- 172.21.15.5:0/4205159131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd6c0fca50 con 0x7fcd6c1012e0 2024-04-16T14:46:51.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.155+0000 7fcd62ffd640 1 -- 172.21.15.5:0/4205159131 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7fcd68009710 con 0x7fcd6c1012e0 2024-04-16T14:46:51.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.156+0000 7fcd62ffd640 1 --2- 172.21.15.5:0/4205159131 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fcd5806e0b0 0x7fcd58070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:51.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.156+0000 7fcd62ffd640 1 -- 172.21.15.5:0/4205159131 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fcd6808d7d0 con 0x7fcd6c1012e0 2024-04-16T14:46:51.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.156+0000 7fcd71c49640 1 --2- 172.21.15.5:0/4205159131 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fcd5806e0b0 0x7fcd58070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:51.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.156+0000 7fcd71c49640 1 --2- 172.21.15.5:0/4205159131 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fcd5806e0b0 0x7fcd58070560 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c065d70 tx=0x7fcd5c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:51.158 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.160+0000 7fcd62ffd640 1 -- 172.21.15.5:0/4205159131 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7fcd68056bd0 con 0x7fcd6c1012e0 2024-04-16T14:46:51.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.344+0000 7fcd746ae640 1 -- 172.21.15.5:0/4205159131 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd6c065b20 con 0x7fcd6c1012e0 2024-04-16T14:46:51.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.345+0000 7fcd62ffd640 1 -- 172.21.15.5:0/4205159131 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd6805a290 con 0x7fcd6c1012e0 2024-04-16T14:46:51.343 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-04-16T14:46:51.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.347+0000 7fcd746ae640 1 -- 172.21.15.5:0/4205159131 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fcd5806e0b0 msgr2=0x7fcd58070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:51.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.347+0000 7fcd746ae640 1 --2- 172.21.15.5:0/4205159131 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fcd5806e0b0 0x7fcd58070560 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c065d70 tx=0x7fcd5c009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.347+0000 7fcd746ae640 1 -- 172.21.15.5:0/4205159131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd6c1012e0 msgr2=0x7fcd6c10e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:51.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.347+0000 7fcd746ae640 1 --2- 172.21.15.5:0/4205159131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd6c1012e0 0x7fcd6c10e0d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcd6800eb70 tx=0x7fcd6800b040 comp rx=0 tx=0).stop 2024-04-16T14:46:51.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.347+0000 7fcd746ae640 1 -- 172.21.15.5:0/4205159131 shutdown_connections 2024-04-16T14:46:51.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.347+0000 7fcd746ae640 1 --2- 172.21.15.5:0/4205159131 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7fcd5806e0b0 0x7fcd58070560 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.347+0000 7fcd746ae640 1 --2- 172.21.15.5:0/4205159131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd6c101c80 0x7fcd6c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.347+0000 7fcd746ae640 1 --2- 172.21.15.5:0/4205159131 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcd6c1012e0 0x7fcd6c10e0d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.347+0000 7fcd746ae640 1 -- 172.21.15.5:0/4205159131 >> 172.21.15.5:0/4205159131 conn(0x7fcd6c0f6eb0 msgr2=0x7fcd6c0f7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:51.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.347+0000 7fcd746ae640 1 -- 172.21.15.5:0/4205159131 shutdown_connections 2024-04-16T14:46:51.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.347+0000 7fcd746ae640 1 -- 172.21.15.5:0/4205159131 wait complete. 2024-04-16T14:46:51.355 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:51 smithi005 ceph-mon[93420]: pgmap v321: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:51.355 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:51 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/344872955' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-16T14:46:51.355 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:51 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/2367599191' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-16T14:46:51.355 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:51 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/3470372783' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-16T14:46:51.356 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-16T14:46:51.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:51 smithi115 ceph-mon[83414]: pgmap v321: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:51.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:51 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/344872955' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-16T14:46:51.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:51 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/2367599191' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-16T14:46:51.432 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:51 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/3470372783' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-16T14:46:51.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.462+0000 7f30622ae640 1 -- 172.21.15.5:0/1137768808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f305c102400 msgr2=0x7f305c1027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:51.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.462+0000 7f30622ae640 1 --2- 172.21.15.5:0/1137768808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f305c102400 0x7f305c1027d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f304c0048d0 tx=0x7f304c009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.462+0000 7f30622ae640 1 -- 172.21.15.5:0/1137768808 shutdown_connections 2024-04-16T14:46:51.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.462+0000 7f30622ae640 1 --2- 172.21.15.5:0/1137768808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f305c102da0 0x7f305c0fc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.462+0000 7f30622ae640 1 --2- 172.21.15.5:0/1137768808 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f305c102400 0x7f305c1027d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.462+0000 7f30622ae640 1 -- 172.21.15.5:0/1137768808 >> 172.21.15.5:0/1137768808 conn(0x7f305c0f7fb0 msgr2=0x7f305c0fa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:51.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.462+0000 7f30622ae640 1 -- 172.21.15.5:0/1137768808 shutdown_connections 2024-04-16T14:46:51.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.462+0000 7f30622ae640 1 -- 172.21.15.5:0/1137768808 wait complete. 2024-04-16T14:46:51.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.462+0000 7f30622ae640 1 Processor -- start 2024-04-16T14:46:51.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.462+0000 7f30622ae640 1 -- start start 2024-04-16T14:46:51.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.462+0000 7f30622ae640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f305c102400 0x7f305c112f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:51.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.462+0000 7f30622ae640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f305c102da0 0x7f305c113490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:51.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.462+0000 7f30622ae640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c113a90 con 0x7f305c102da0 2024-04-16T14:46:51.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.462+0000 7f30622ae640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c10d0e0 con 0x7f305c102400 2024-04-16T14:46:51.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.463+0000 7f3053fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f305c102da0 0x7f305c113490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:51.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.463+0000 7f3053fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f305c102da0 0x7f305c113490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54942/0 (socket says 172.21.15.5:54942) 2024-04-16T14:46:51.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.463+0000 7f3053fff640 1 -- 172.21.15.5:0/3045602254 learned_addr learned my addr 172.21.15.5:0/3045602254 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:51.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.463+0000 7f305bfff640 1 --2- 172.21.15.5:0/3045602254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f305c102400 0x7f305c112f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:51.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.463+0000 7f3053fff640 1 -- 172.21.15.5:0/3045602254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f305c102400 msgr2=0x7f305c112f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:51.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.463+0000 7f3053fff640 1 --2- 172.21.15.5:0/3045602254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f305c102400 0x7f305c112f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.463+0000 7f3053fff640 1 -- 172.21.15.5:0/3045602254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c005040 con 0x7f305c102da0 2024-04-16T14:46:51.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.463+0000 7f3053fff640 1 --2- 172.21.15.5:0/3045602254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f305c102da0 0x7f305c113490 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f304400c790 tx=0x7f30440043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:51.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.463+0000 7f30597fa640 1 -- 172.21.15.5:0/3045602254 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f304400a820 con 0x7f305c102da0 2024-04-16T14:46:51.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.463+0000 7f30597fa640 1 -- 172.21.15.5:0/3045602254 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f304400ae50 con 0x7f305c102da0 2024-04-16T14:46:51.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.463+0000 7f30622ae640 1 -- 172.21.15.5:0/3045602254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f305c10d3c0 con 0x7f305c102da0 2024-04-16T14:46:51.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.463+0000 7f30597fa640 1 -- 172.21.15.5:0/3045602254 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30440115e0 con 0x7f305c102da0 2024-04-16T14:46:51.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.463+0000 7f30622ae640 1 -- 172.21.15.5:0/3045602254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f305c10d8e0 con 0x7f305c102da0 2024-04-16T14:46:51.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.464+0000 7f30622ae640 1 -- 172.21.15.5:0/3045602254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f305c0fdb70 con 0x7f305c102da0 2024-04-16T14:46:51.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.465+0000 7f30597fa640 1 -- 172.21.15.5:0/3045602254 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f3044012400 con 0x7f305c102da0 2024-04-16T14:46:51.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.465+0000 7f30597fa640 1 --2- 172.21.15.5:0/3045602254 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f304806e0b0 0x7f3048070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:51.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.465+0000 7f30597fa640 1 -- 172.21.15.5:0/3045602254 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f304408dd90 con 0x7f305c102da0 2024-04-16T14:46:51.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.465+0000 7f305bfff640 1 --2- 172.21.15.5:0/3045602254 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f304806e0b0 0x7f3048070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:51.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.466+0000 7f305bfff640 1 --2- 172.21.15.5:0/3045602254 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f304806e0b0 0x7f3048070560 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f304c000c00 tx=0x7f304c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:51.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.470+0000 7f30597fa640 1 -- 172.21.15.5:0/3045602254 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f30440570e0 con 0x7f305c102da0 2024-04-16T14:46:51.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.653+0000 7f30622ae640 1 -- 172.21.15.5:0/3045602254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f305c109560 con 0x7f305c102da0 2024-04-16T14:46:51.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.653+0000 7f30597fa640 1 -- 172.21.15.5:0/3045602254 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f304405a7a0 con 0x7f305c102da0 2024-04-16T14:46:51.652 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-16T14:46:51.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.655+0000 7f30622ae640 1 -- 172.21.15.5:0/3045602254 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f304806e0b0 msgr2=0x7f3048070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:51.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.655+0000 7f30622ae640 1 --2- 172.21.15.5:0/3045602254 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f304806e0b0 0x7f3048070560 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f304c000c00 tx=0x7f304c009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.655+0000 7f30622ae640 1 -- 172.21.15.5:0/3045602254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f305c102da0 msgr2=0x7f305c113490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:51.654 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.655+0000 7f30622ae640 1 --2- 172.21.15.5:0/3045602254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f305c102da0 0x7f305c113490 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f304400c790 tx=0x7f30440043c0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.655+0000 7f30622ae640 1 -- 172.21.15.5:0/3045602254 shutdown_connections 2024-04-16T14:46:51.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.655+0000 7f30622ae640 1 --2- 172.21.15.5:0/3045602254 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f304806e0b0 0x7f3048070560 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.655+0000 7f30622ae640 1 --2- 172.21.15.5:0/3045602254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f305c102da0 0x7f305c113490 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.655+0000 7f30622ae640 1 --2- 172.21.15.5:0/3045602254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f305c102400 0x7f305c112f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.655+0000 7f30622ae640 1 -- 172.21.15.5:0/3045602254 >> 172.21.15.5:0/3045602254 conn(0x7f305c0f7fb0 msgr2=0x7f305c0f8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:51.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.656+0000 7f30622ae640 1 -- 172.21.15.5:0/3045602254 shutdown_connections 2024-04-16T14:46:51.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.656+0000 7f30622ae640 1 -- 172.21.15.5:0/3045602254 wait complete. 2024-04-16T14:46:51.665 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-16T14:46:51.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.770+0000 7f94c082e640 1 -- 172.21.15.5:0/3042628317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94bc102280 msgr2=0x7f94bc102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:51.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.770+0000 7f94c082e640 1 --2- 172.21.15.5:0/3042628317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94bc102280 0x7f94bc102650 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0048d0 tx=0x7f94ac009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.770+0000 7f94c082e640 1 -- 172.21.15.5:0/3042628317 shutdown_connections 2024-04-16T14:46:51.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.770+0000 7f94c082e640 1 --2- 172.21.15.5:0/3042628317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94bc102b90 0x7f94bc0fa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.770+0000 7f94c082e640 1 --2- 172.21.15.5:0/3042628317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94bc102280 0x7f94bc102650 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.770+0000 7f94c082e640 1 -- 172.21.15.5:0/3042628317 >> 172.21.15.5:0/3042628317 conn(0x7f94bc0708f0 msgr2=0x7f94bc070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:51.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.770+0000 7f94c082e640 1 -- 172.21.15.5:0/3042628317 shutdown_connections 2024-04-16T14:46:51.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.770+0000 7f94c082e640 1 -- 172.21.15.5:0/3042628317 wait complete. 2024-04-16T14:46:51.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.770+0000 7f94c082e640 1 Processor -- start 2024-04-16T14:46:51.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.770+0000 7f94c082e640 1 -- start start 2024-04-16T14:46:51.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.771+0000 7f94c082e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94bc102280 0x7f94bc114f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:51.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.771+0000 7f94c082e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94bc102b90 0x7f94bc115450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:51.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.771+0000 7f94c082e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc115a50 con 0x7f94bc102280 2024-04-16T14:46:51.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.771+0000 7f94c082e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc115bc0 con 0x7f94bc102b90 2024-04-16T14:46:51.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.771+0000 7f94ba59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94bc102280 0x7f94bc114f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:51.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.771+0000 7f94ba59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94bc102280 0x7f94bc114f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54950/0 (socket says 172.21.15.5:54950) 2024-04-16T14:46:51.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.771+0000 7f94ba59c640 1 -- 172.21.15.5:0/1067899468 learned_addr learned my addr 172.21.15.5:0/1067899468 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:51.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.771+0000 7f94b3fff640 1 --2- 172.21.15.5:0/1067899468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94bc102b90 0x7f94bc115450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:51.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.771+0000 7f94ba59c640 1 -- 172.21.15.5:0/1067899468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94bc102b90 msgr2=0x7f94bc115450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:51.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.771+0000 7f94ba59c640 1 --2- 172.21.15.5:0/1067899468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94bc102b90 0x7f94bc115450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.771+0000 7f94ba59c640 1 -- 172.21.15.5:0/1067899468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ac005040 con 0x7f94bc102280 2024-04-16T14:46:51.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.771+0000 7f94ba59c640 1 --2- 172.21.15.5:0/1067899468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94bc102280 0x7f94bc114f10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0041d0 tx=0x7f94ac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:51.772 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.771+0000 7f94b2ffd640 1 -- 172.21.15.5:0/1067899468 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94ac030870 con 0x7f94bc102280 2024-04-16T14:46:51.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.771+0000 7f94b2ffd640 1 -- 172.21.15.5:0/1067899468 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f94ac0092e0 con 0x7f94bc102280 2024-04-16T14:46:51.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.771+0000 7f94c082e640 1 -- 172.21.15.5:0/1067899468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94bc10f1f0 con 0x7f94bc102280 2024-04-16T14:46:51.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.771+0000 7f94b2ffd640 1 -- 172.21.15.5:0/1067899468 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94ac043400 con 0x7f94bc102280 2024-04-16T14:46:51.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.771+0000 7f94c082e640 1 -- 172.21.15.5:0/1067899468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94bc10f710 con 0x7f94bc102280 2024-04-16T14:46:51.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.772+0000 7f94c082e640 1 -- 172.21.15.5:0/1067899468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94bc065330 con 0x7f94bc102280 2024-04-16T14:46:51.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.773+0000 7f94b2ffd640 1 -- 172.21.15.5:0/1067899468 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f94ac03b420 con 0x7f94bc102280 2024-04-16T14:46:51.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.773+0000 7f94b2ffd640 1 --2- 172.21.15.5:0/1067899468 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f94a806e0b0 0x7f94a8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:51.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.774+0000 7f94b2ffd640 1 -- 172.21.15.5:0/1067899468 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f94ac0b0a40 con 0x7f94bc102280 2024-04-16T14:46:51.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.774+0000 7f94b3fff640 1 --2- 172.21.15.5:0/1067899468 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f94a806e0b0 0x7f94a8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:51.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.774+0000 7f94b3fff640 1 --2- 172.21.15.5:0/1067899468 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f94a806e0b0 0x7f94a8070560 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f94bc110810 tx=0x7f94a400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:51.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.778+0000 7f94b2ffd640 1 -- 172.21.15.5:0/1067899468 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f94ac079db0 con 0x7f94bc102280 2024-04-16T14:46:51.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.963+0000 7f94c082e640 1 -- 172.21.15.5:0/1067899468 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f94bc1105f0 con 0x7f94bc102280 2024-04-16T14:46:51.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.963+0000 7f94b2ffd640 1 -- 172.21.15.5:0/1067899468 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f94ac07d470 con 0x7f94bc102280 2024-04-16T14:46:51.962 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-04-16T14:46:51.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.965+0000 7f94c082e640 1 -- 172.21.15.5:0/1067899468 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f94a806e0b0 msgr2=0x7f94a8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:51.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.965+0000 7f94c082e640 1 --2- 172.21.15.5:0/1067899468 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f94a806e0b0 0x7f94a8070560 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f94bc110810 tx=0x7f94a400b040 comp rx=0 tx=0).stop 2024-04-16T14:46:51.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.965+0000 7f94c082e640 1 -- 172.21.15.5:0/1067899468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94bc102280 msgr2=0x7f94bc114f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:51.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.965+0000 7f94c082e640 1 --2- 172.21.15.5:0/1067899468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94bc102280 0x7f94bc114f10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0041d0 tx=0x7f94ac009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.965+0000 7f94c082e640 1 -- 172.21.15.5:0/1067899468 shutdown_connections 2024-04-16T14:46:51.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.966+0000 7f94c082e640 1 --2- 172.21.15.5:0/1067899468 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f94a806e0b0 0x7f94a8070560 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.966+0000 7f94c082e640 1 --2- 172.21.15.5:0/1067899468 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94bc102b90 0x7f94bc115450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.966+0000 7f94c082e640 1 --2- 172.21.15.5:0/1067899468 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f94bc102280 0x7f94bc114f10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:51.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.966+0000 7f94c082e640 1 -- 172.21.15.5:0/1067899468 >> 172.21.15.5:0/1067899468 conn(0x7f94bc0708f0 msgr2=0x7f94bc0f9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:51.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.966+0000 7f94c082e640 1 -- 172.21.15.5:0/1067899468 shutdown_connections 2024-04-16T14:46:51.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:51.966+0000 7f94c082e640 1 -- 172.21.15.5:0/1067899468 wait complete. 2024-04-16T14:46:51.975 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-16T14:46:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.078+0000 7f3526b5d640 1 -- 172.21.15.5:0/3437601211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3520101c80 msgr2=0x7f35200fb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.078+0000 7f3526b5d640 1 --2- 172.21.15.5:0/3437601211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3520101c80 0x7f35200fb310 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f35080048d0 tx=0x7f3508009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.078+0000 7f3526b5d640 1 -- 172.21.15.5:0/3437601211 shutdown_connections 2024-04-16T14:46:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.078+0000 7f3526b5d640 1 --2- 172.21.15.5:0/3437601211 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3520101c80 0x7f35200fb310 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.078+0000 7f3526b5d640 1 --2- 172.21.15.5:0/3437601211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35201012e0 0x7f35201016b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.078+0000 7f3526b5d640 1 -- 172.21.15.5:0/3437601211 >> 172.21.15.5:0/3437601211 conn(0x7f35200f6eb0 msgr2=0x7f35200f92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.078+0000 7f3526b5d640 1 -- 172.21.15.5:0/3437601211 shutdown_connections 2024-04-16T14:46:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.079+0000 7f3526b5d640 1 -- 172.21.15.5:0/3437601211 wait complete. 2024-04-16T14:46:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.079+0000 7f3526b5d640 1 Processor -- start 2024-04-16T14:46:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.079+0000 7f3526b5d640 1 -- start start 2024-04-16T14:46:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.079+0000 7f3526b5d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35201012e0 0x7f352010e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:52.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.079+0000 7f3526b5d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3520101c80 0x7f352010e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.079+0000 7f3526b5d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3520066540 con 0x7f35201012e0 2024-04-16T14:46:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.079+0000 7f3526b5d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352010eb60 con 0x7f3520101c80 2024-04-16T14:46:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.079+0000 7f35248f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35201012e0 0x7f352010e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.079+0000 7f35248f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35201012e0 0x7f352010e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54962/0 (socket says 172.21.15.5:54962) 2024-04-16T14:46:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.079+0000 7f35248f9640 1 -- 172.21.15.5:0/3325222823 learned_addr learned my addr 172.21.15.5:0/3325222823 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-04-16T14:46:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.080+0000 7f35248f9640 1 -- 172.21.15.5:0/3325222823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3520101c80 msgr2=0x7f352010e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.080+0000 7f35248f9640 1 --2- 172.21.15.5:0/3325222823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3520101c80 0x7f352010e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.080+0000 7f35248f9640 1 -- 172.21.15.5:0/3325222823 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3508005040 con 0x7f35201012e0 2024-04-16T14:46:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.080+0000 7f35248f9640 1 --2- 172.21.15.5:0/3325222823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35201012e0 0x7f352010e0b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f351800db00 tx=0x7f3518004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.080+0000 7f351d7fa640 1 -- 172.21.15.5:0/3325222823 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3518017070 con 0x7f35201012e0 2024-04-16T14:46:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.080+0000 7f3526b5d640 1 -- 172.21.15.5:0/3325222823 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f352010ee40 con 0x7f35201012e0 2024-04-16T14:46:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.080+0000 7f351d7fa640 1 -- 172.21.15.5:0/3325222823 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f351800f040 con 0x7f35201012e0 2024-04-16T14:46:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.080+0000 7f351d7fa640 1 -- 172.21.15.5:0/3325222823 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3518003ae0 con 0x7f35201012e0 2024-04-16T14:46:52.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.080+0000 7f3526b5d640 1 -- 172.21.15.5:0/3325222823 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35201173d0 con 0x7f35201012e0 2024-04-16T14:46:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.081+0000 7f3526b5d640 1 -- 172.21.15.5:0/3325222823 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35200fca50 con 0x7f35201012e0 2024-04-16T14:46:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.082+0000 7f351d7fa640 1 -- 172.21.15.5:0/3325222823 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 38) v1 ==== 92201+0+0 (secure 0 0 0) 0x7f3518003c40 con 0x7f35201012e0 2024-04-16T14:46:52.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.082+0000 7f351d7fa640 1 --2- 172.21.15.5:0/3325222823 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f350c06e0b0 0x7f350c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-16T14:46:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.082+0000 7f351d7fa640 1 -- 172.21.15.5:0/3325222823 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f351808dd30 con 0x7f35201012e0 2024-04-16T14:46:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.082+0000 7f351ffff640 1 --2- 172.21.15.5:0/3325222823 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f350c06e0b0 0x7f350c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-16T14:46:52.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.083+0000 7f351ffff640 1 --2- 172.21.15.5:0/3325222823 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f350c06e0b0 0x7f350c070560 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f35080043d0 tx=0x7f3508009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-16T14:46:52.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.087+0000 7f351d7fa640 1 -- 172.21.15.5:0/3325222823 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186147 (secure 0 0 0) 0x7f3518057000 con 0x7f35201012e0 2024-04-16T14:46:52.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:52 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/4205159131' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-16T14:46:52.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:52 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/3045602254' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-16T14:46:52.224 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:52 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/1067899468' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-16T14:46:52.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.291+0000 7f3526b5d640 1 -- 172.21.15.5:0/3325222823 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f35200638d0 con 0x7f35201012e0 2024-04-16T14:46:52.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.291+0000 7f351d7fa640 1 -- 172.21.15.5:0/3325222823 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v85) v1 ==== 81+0+2399 (secure 0 0 0) 0x7f351805a6c0 con 0x7f35201012e0 2024-04-16T14:46:52.290 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.115:6827/2476249308 2024-04-17T14:43:22.064543+0000 2024-04-16T14:46:52.290 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.115:6826/2476249308 2024-04-17T14:43:22.064543+0000 2024-04-16T14:46:52.290 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6829/402035291 2024-04-17T14:42:40.192043+0000 2024-04-16T14:46:52.290 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6828/402035291 2024-04-17T14:42:40.192043+0000 2024-04-16T14:46:52.290 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/4176454319 2024-04-17T14:28:02.662455+0000 2024-04-16T14:46:52.291 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2384405072 2024-04-17T14:26:17.425567+0000 2024-04-16T14:46:52.291 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/1956301653 2024-04-17T14:37:23.186462+0000 2024-04-16T14:46:52.291 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/801827499 2024-04-17T14:26:48.930147+0000 2024-04-16T14:46:52.291 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2010393498 2024-04-17T14:34:55.944821+0000 2024-04-16T14:46:52.291 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/3841652776 2024-04-17T14:34:55.944821+0000 2024-04-16T14:46:52.291 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.115:6828/460631486 2024-04-17T14:36:31.676822+0000 2024-04-16T14:46:52.291 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/1109429271 2024-04-17T14:37:23.186462+0000 2024-04-16T14:46:52.291 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/4125351321 2024-04-17T14:34:55.944821+0000 2024-04-16T14:46:52.291 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/1086445367 2024-04-17T14:26:17.425567+0000 2024-04-16T14:46:52.291 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.115:0/1842350799 2024-04-17T14:36:31.676822+0000 2024-04-16T14:46:52.291 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2653432440 2024-04-17T14:28:02.662455+0000 2024-04-16T14:46:52.291 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/861562298 2024-04-17T14:37:23.186462+0000 2024-04-16T14:46:52.291 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3710869010 2024-04-17T14:26:17.425567+0000 2024-04-16T14:46:52.292 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/3841652776 2024-04-17T14:34:55.944821+0000 2024-04-16T14:46:52.292 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3602505234 2024-04-17T14:34:55.944821+0000 2024-04-16T14:46:52.292 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2013882368 2024-04-17T14:26:48.930147+0000 2024-04-16T14:46:52.292 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/1548281910 2024-04-17T14:28:02.662455+0000 2024-04-16T14:46:52.292 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/1086445367 2024-04-17T14:26:17.425567+0000 2024-04-16T14:46:52.292 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.115:0/861197783 2024-04-17T14:36:31.676822+0000 2024-04-16T14:46:52.292 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3891215761 2024-04-17T14:37:23.186462+0000 2024-04-16T14:46:52.292 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6827/3000067296 2024-04-17T14:33:00.804392+0000 2024-04-16T14:46:52.292 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3767913866 2024-04-17T14:28:02.662455+0000 2024-04-16T14:46:52.292 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3063530168 2024-04-17T14:34:55.944821+0000 2024-04-16T14:46:52.292 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.115:0/3056216034 2024-04-17T14:36:31.676822+0000 2024-04-16T14:46:52.292 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.115:6829/460631486 2024-04-17T14:36:31.676822+0000 2024-04-16T14:46:52.292 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3364969045 2024-04-17T14:26:48.930147+0000 2024-04-16T14:46:52.293 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/4088193218 2024-04-17T14:26:48.930147+0000 2024-04-16T14:46:52.293 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/4088193218 2024-04-17T14:26:48.930147+0000 2024-04-16T14:46:52.293 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/726821609 2024-04-17T14:37:23.186462+0000 2024-04-16T14:46:52.293 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6826/3000067296 2024-04-17T14:33:00.804392+0000 2024-04-16T14:46:52.293 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/1956301653 2024-04-17T14:37:23.186462+0000 2024-04-16T14:46:52.293 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3196662527 2024-04-17T14:37:23.186462+0000 2024-04-16T14:46:52.293 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/4176454319 2024-04-17T14:28:02.662455+0000 2024-04-16T14:46:52.293 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2015079913 2024-04-17T14:26:17.425567+0000 2024-04-16T14:46:52.293 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.115:0/1736155115 2024-04-17T14:36:31.676822+0000 2024-04-16T14:46:52.293 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2335924356 2024-04-17T14:37:23.186462+0000 2024-04-16T14:46:52.294 INFO:teuthology.orchestra.run.smithi005.stderr:listed 41 entries 2024-04-16T14:46:52.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.294+0000 7f3526b5d640 1 -- 172.21.15.5:0/3325222823 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f350c06e0b0 msgr2=0x7f350c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:52.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.294+0000 7f3526b5d640 1 --2- 172.21.15.5:0/3325222823 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f350c06e0b0 0x7f350c070560 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f35080043d0 tx=0x7f3508009da0 comp rx=0 tx=0).stop 2024-04-16T14:46:52.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.294+0000 7f3526b5d640 1 -- 172.21.15.5:0/3325222823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35201012e0 msgr2=0x7f352010e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-16T14:46:52.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.294+0000 7f3526b5d640 1 --2- 172.21.15.5:0/3325222823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35201012e0 0x7f352010e0b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f351800db00 tx=0x7f3518004e60 comp rx=0 tx=0).stop 2024-04-16T14:46:52.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.294+0000 7f3526b5d640 1 -- 172.21.15.5:0/3325222823 shutdown_connections 2024-04-16T14:46:52.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.294+0000 7f3526b5d640 1 --2- 172.21.15.5:0/3325222823 >> [v2:172.21.15.5:6800/1193938793,v1:172.21.15.5:6801/1193938793] conn(0x7f350c06e0b0 0x7f350c070560 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:52.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.294+0000 7f3526b5d640 1 --2- 172.21.15.5:0/3325222823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3520101c80 0x7f352010e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:52.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.294+0000 7f3526b5d640 1 --2- 172.21.15.5:0/3325222823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35201012e0 0x7f352010e0b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-16T14:46:52.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.294+0000 7f3526b5d640 1 -- 172.21.15.5:0/3325222823 >> 172.21.15.5:0/3325222823 conn(0x7f35200f6eb0 msgr2=0x7f35200f7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-16T14:46:52.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.294+0000 7f3526b5d640 1 -- 172.21.15.5:0/3325222823 shutdown_connections 2024-04-16T14:46:52.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-04-16T14:46:52.294+0000 7f3526b5d640 1 -- 172.21.15.5:0/3325222823 wait complete. 2024-04-16T14:46:52.303 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-16T14:46:52.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:46:52.304 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-04-16T14:46:52.342 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2024-04-16T14:46:52.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:46:52.343 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-16T14:46:52.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:46:52.414 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-04-16T14:46:52.430 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-16T14:46:52.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:46:52.431 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-16T14:46:52.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:46:52.501 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-04-16T14:46:52.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:46:52.601 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2024-04-16T14:46:52.621 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-16T14:46:52.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:46:52.622 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-16T14:46:52.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:52 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/4205159131' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-16T14:46:52.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:52 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/3045602254' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-16T14:46:52.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:52 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/1067899468' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-16T14:46:52.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-16T14:46:52.697 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link delete ceph-brx 2024-04-16T14:46:52.795 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-16T14:46:52.806 INFO:tasks.cephadm:Teardown begin 2024-04-16T14:46:52.807 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-16T14:46:52.837 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-16T14:46:52.867 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-16T14:46:52.867 DEBUG:teuthology.orchestra.run.smithi005:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-16T14:46:52.892 DEBUG:teuthology.orchestra.run.smithi115:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-16T14:46:52.923 INFO:tasks.cephadm:Stopping all daemons... 2024-04-16T14:46:52.924 INFO:tasks.cephadm.mon.smithi005:Stopping mon.smithi005... 2024-04-16T14:46:52.924 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@mon.smithi005 2024-04-16T14:46:53.188 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:52 smithi005 systemd[1]: Stopping Ceph mon.smithi005 for 10609bfa-fbfd-11ee-bc90-c7b262605968... 2024-04-16T14:46:53.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:53 smithi005 ceph-mon[93420]: pgmap v322: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:53.474 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:53 smithi005 ceph-mon[93420]: from='client.? 172.21.15.5:0/3325222823' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-16T14:46:53.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:53 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi005[93411]: 2024-04-16T14:46:53.234+0000 7ff48b850700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi005 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-16T14:46:53.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:53 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi005[93411]: 2024-04-16T14:46:53.234+0000 7ff48b850700 -1 mon.smithi005@0(leader) e3 *** Got Signal Terminated *** 2024-04-16T14:46:53.475 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:53 smithi005 podman[149184]: 2024-04-16 14:46:53.337575699 +0000 UTC m=+0.211801933 container died 3d0c00924867f33f21442f5ca1540af3327627aa97a05c24e2bef0e4422a1da5 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi005, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5) 2024-04-16T14:46:53.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:53 smithi115 ceph-mon[83414]: pgmap v322: 65 pgs: 65 active+clean; 169 MiB data, 724 MiB used, 536 GiB / 536 GiB avail 2024-04-16T14:46:53.681 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:53 smithi115 ceph-mon[83414]: from='client.? 172.21.15.5:0/3325222823' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-16T14:46:53.913 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:53 smithi005 podman[149184]: 2024-04-16 14:46:53.717755716 +0000 UTC m=+0.591981936 container cleanup 3d0c00924867f33f21442f5ca1540af3327627aa97a05c24e2bef0e4422a1da5 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi005, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-04-16T14:46:53.913 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:53 smithi005 bash[149184]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi005 2024-04-16T14:46:54.157 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@mon.smithi005.service' 2024-04-16T14:46:54.183 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:53 smithi005 podman[149259]: 2024-04-16 14:46:53.915781814 +0000 UTC m=+0.573471331 container remove 3d0c00924867f33f21442f5ca1540af3327627aa97a05c24e2bef0e4422a1da5 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi005, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-16T14:46:54.183 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:54 smithi005 systemd[1]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@mon.smithi005.service: Deactivated successfully. 2024-04-16T14:46:54.183 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:54 smithi005 systemd[1]: Stopped Ceph mon.smithi005 for 10609bfa-fbfd-11ee-bc90-c7b262605968. 2024-04-16T14:46:54.183 INFO:journalctl@ceph.mon.smithi005.smithi005.stdout:Apr 16 14:46:54 smithi005 systemd[1]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@mon.smithi005.service: Consumed 9.457s CPU time. 2024-04-16T14:46:54.211 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-16T14:46:54.211 INFO:tasks.cephadm.mon.smithi005:Stopped mon.smithi005 2024-04-16T14:46:54.211 INFO:tasks.cephadm.mon.smithi115:Stopping mon.smithi115... 2024-04-16T14:46:54.212 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@mon.smithi115 2024-04-16T14:46:54.540 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:54 smithi115 systemd[1]: Stopping Ceph mon.smithi115 for 10609bfa-fbfd-11ee-bc90-c7b262605968... 2024-04-16T14:46:54.931 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:54 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi115[83410]: 2024-04-16T14:46:54.541+0000 7f8bfff02700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi115 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-16T14:46:54.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:54 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi115[83410]: 2024-04-16T14:46:54.541+0000 7f8bfff02700 -1 mon.smithi115@1(peon) e3 *** Got Signal Terminated *** 2024-04-16T14:46:54.932 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:54 smithi115 podman[120517]: 2024-04-16 14:46:54.704931855 +0000 UTC m=+0.288821696 container died 3b916a4928b2e0a27b8e412b3bd7dd493ca6613432be452f1d6d66b2f804fdd5 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi115, ceph=True, org.label-schema.build-date=20240409, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-16T14:46:55.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:55 smithi115 podman[120517]: 2024-04-16 14:46:55.191584436 +0000 UTC m=+0.775474271 container cleanup 3b916a4928b2e0a27b8e412b3bd7dd493ca6613432be452f1d6d66b2f804fdd5 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi115, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-16T14:46:55.431 INFO:journalctl@ceph.mon.smithi115.smithi115.stdout:Apr 16 14:46:55 smithi115 bash[120517]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-mon-smithi115 2024-04-16T14:46:55.558 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@mon.smithi115.service' 2024-04-16T14:46:55.608 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-16T14:46:55.608 INFO:tasks.cephadm.mon.smithi115:Stopped mon.smithi115 2024-04-16T14:46:55.608 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-16T14:46:55.608 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.0 2024-04-16T14:46:55.912 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:46:55 smithi005 systemd[1]: Stopping Ceph osd.0 for 10609bfa-fbfd-11ee-bc90-c7b262605968... 2024-04-16T14:46:56.224 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:46:55 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0[102314]: 2024-04-16T14:46:55.913+0000 7fb00b9ff700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-16T14:46:56.224 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:46:55 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0[102314]: 2024-04-16T14:46:55.913+0000 7fb00b9ff700 -1 osd.0 85 *** Got signal Terminated *** 2024-04-16T14:46:56.224 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:46:55 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0[102314]: 2024-04-16T14:46:55.913+0000 7fb00b9ff700 -1 osd.0 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-16T14:47:01.546 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:47:01 smithi005 podman[149402]: 2024-04-16 14:47:01.293408365 +0000 UTC m=+5.481526328 container died 91d9246d45e04ff08ea6d186909efb62cb74a23846313dee936448cbcfbe0e2c (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-04-16T14:47:01.938 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:47:01 smithi005 podman[149402]: 2024-04-16 14:47:01.647662989 +0000 UTC m=+5.835780956 container cleanup 91d9246d45e04ff08ea6d186909efb62cb74a23846313dee936448cbcfbe0e2c (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-16T14:47:01.938 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:47:01 smithi005 bash[149402]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0 2024-04-16T14:47:02.224 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:47:01 smithi005 podman[149419]: 2024-04-16 14:47:01.940440546 +0000 UTC m=+0.649155752 container remove 91d9246d45e04ff08ea6d186909efb62cb74a23846313dee936448cbcfbe0e2c (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240409, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5) 2024-04-16T14:47:02.542 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:47:02 smithi005 podman[149514]: 2024-04-16 14:47:02.174904309 +0000 UTC m=+0.017946168 image pull b1a78730e0db57f46162ae12211512856024b361a698c3ed431f6fbc73b484c3 quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 2024-04-16T14:47:02.543 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:47:02 smithi005 podman[149514]: 2024-04-16 14:47:02.291611808 +0000 UTC m=+0.134653706 container create 6ca85fee3acf5e60b2a76f15cb53f44eedbc017a535f517950a0f9830603d112 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5) 2024-04-16T14:47:02.543 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:47:02 smithi005 podman[149514]: 2024-04-16 14:47:02.545105592 +0000 UTC m=+0.388147481 container init 6ca85fee3acf5e60b2a76f15cb53f44eedbc017a535f517950a0f9830603d112 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-16T14:47:02.848 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:47:02 smithi005 podman[149514]: 2024-04-16 14:47:02.549054159 +0000 UTC m=+0.392096016 container start 6ca85fee3acf5e60b2a76f15cb53f44eedbc017a535f517950a0f9830603d112 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409) 2024-04-16T14:47:02.848 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:47:02 smithi005 podman[149514]: 2024-04-16 14:47:02.628072936 +0000 UTC m=+0.471114797 container attach 6ca85fee3acf5e60b2a76f15cb53f44eedbc017a535f517950a0f9830603d112 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-16T14:47:03.171 INFO:journalctl@ceph.osd.0.smithi005.stdout:Apr 16 14:47:02 smithi005 podman[149514]: 2024-04-16 14:47:02.850883289 +0000 UTC m=+0.693925151 container died 6ca85fee3acf5e60b2a76f15cb53f44eedbc017a535f517950a0f9830603d112 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-04-16T14:47:03.497 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.0.service' 2024-04-16T14:47:03.549 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-16T14:47:03.549 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-16T14:47:03.549 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-16T14:47:03.549 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.1 2024-04-16T14:47:03.724 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:47:03 smithi005 systemd[1]: Stopping Ceph osd.1 for 10609bfa-fbfd-11ee-bc90-c7b262605968... 2024-04-16T14:47:04.224 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:47:03 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1[107981]: 2024-04-16T14:47:03.851+0000 7f388caec700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-16T14:47:04.224 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:47:03 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1[107981]: 2024-04-16T14:47:03.851+0000 7f388caec700 -1 osd.1 85 *** Got signal Terminated *** 2024-04-16T14:47:04.224 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:47:03 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1[107981]: 2024-04-16T14:47:03.851+0000 7f388caec700 -1 osd.1 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-16T14:47:09.562 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:47:09 smithi005 podman[149619]: 2024-04-16 14:47:09.304370996 +0000 UTC m=+5.554576694 container died d930ce515e3e68377b8a91e504dafb5c5c2829fd9c670a151cbff324d85489e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5) 2024-04-16T14:47:09.876 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:47:09 smithi005 podman[149619]: 2024-04-16 14:47:09.643602718 +0000 UTC m=+5.893808413 container cleanup d930ce515e3e68377b8a91e504dafb5c5c2829fd9c670a151cbff324d85489e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, io.buildah.version=1.33.5) 2024-04-16T14:47:09.876 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:47:09 smithi005 bash[149619]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1 2024-04-16T14:47:10.224 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:47:09 smithi005 podman[149647]: 2024-04-16 14:47:09.878380547 +0000 UTC m=+0.570667551 container remove d930ce515e3e68377b8a91e504dafb5c5c2829fd9c670a151cbff324d85489e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, ceph=True, org.label-schema.build-date=20240409, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-16T14:47:10.563 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:47:10 smithi005 podman[149738]: 2024-04-16 14:47:10.217785345 +0000 UTC m=+0.017850773 image pull b1a78730e0db57f46162ae12211512856024b361a698c3ed431f6fbc73b484c3 quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 2024-04-16T14:47:10.563 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:47:10 smithi005 podman[149738]: 2024-04-16 14:47:10.337935675 +0000 UTC m=+0.138001081 container create 3c3189d3931743a7bcf502e2adbdeca544c52af744c35210d6ed5aaec7510dae (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-16T14:47:10.563 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:47:10 smithi005 podman[149738]: 2024-04-16 14:47:10.565726287 +0000 UTC m=+0.365791693 container init 3c3189d3931743a7bcf502e2adbdeca544c52af744c35210d6ed5aaec7510dae (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240409, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5) 2024-04-16T14:47:10.871 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:47:10 smithi005 podman[149738]: 2024-04-16 14:47:10.569506003 +0000 UTC m=+0.369571412 container start 3c3189d3931743a7bcf502e2adbdeca544c52af744c35210d6ed5aaec7510dae (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-04-16T14:47:10.872 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:47:10 smithi005 podman[149738]: 2024-04-16 14:47:10.648844467 +0000 UTC m=+0.448909882 container attach 3c3189d3931743a7bcf502e2adbdeca544c52af744c35210d6ed5aaec7510dae (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1-deactivate, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.build-date=20240409) 2024-04-16T14:47:11.216 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:47:10 smithi005 podman[149738]: 2024-04-16 14:47:10.874461946 +0000 UTC m=+0.674527355 container died 3c3189d3931743a7bcf502e2adbdeca544c52af744c35210d6ed5aaec7510dae (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.build-date=20240409, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-04-16T14:47:11.461 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.1.service' 2024-04-16T14:47:11.474 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:47:11 smithi005 podman[149764]: 2024-04-16 14:47:11.444668539 +0000 UTC m=+0.565407236 container remove 3c3189d3931743a7bcf502e2adbdeca544c52af744c35210d6ed5aaec7510dae (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=) 2024-04-16T14:47:11.474 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:47:11 smithi005 systemd[1]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.1.service: Deactivated successfully. 2024-04-16T14:47:11.474 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:47:11 smithi005 systemd[1]: Stopped Ceph osd.1 for 10609bfa-fbfd-11ee-bc90-c7b262605968. 2024-04-16T14:47:11.474 INFO:journalctl@ceph.osd.1.smithi005.stdout:Apr 16 14:47:11 smithi005 systemd[1]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.1.service: Consumed 9.430s CPU time. 2024-04-16T14:47:11.506 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-16T14:47:11.507 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-16T14:47:11.507 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-16T14:47:11.507 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.2 2024-04-16T14:47:11.847 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:47:11 smithi005 systemd[1]: Stopping Ceph osd.2 for 10609bfa-fbfd-11ee-bc90-c7b262605968... 2024-04-16T14:47:12.224 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:47:11 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2[113341]: 2024-04-16T14:47:11.848+0000 7f4a06407700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-16T14:47:12.224 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:47:11 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2[113341]: 2024-04-16T14:47:11.848+0000 7f4a06407700 -1 osd.2 85 *** Got signal Terminated *** 2024-04-16T14:47:12.224 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:47:11 smithi005 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2[113341]: 2024-04-16T14:47:11.848+0000 7f4a06407700 -1 osd.2 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-16T14:47:17.563 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:47:17 smithi005 podman[149843]: 2024-04-16 14:47:17.298123429 +0000 UTC m=+5.562241609 container died fdc5fe68ac57e8a855fe530198bee63b2c56818f7c91819cfaed48f26b77eda6 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-04-16T14:47:17.930 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:47:17 smithi005 podman[149843]: 2024-04-16 14:47:17.664609646 +0000 UTC m=+5.928727876 container cleanup fdc5fe68ac57e8a855fe530198bee63b2c56818f7c91819cfaed48f26b77eda6 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-16T14:47:17.930 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:47:17 smithi005 bash[149843]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2 2024-04-16T14:47:18.224 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:47:17 smithi005 podman[149862]: 2024-04-16 14:47:17.932537553 +0000 UTC m=+0.630998205 container remove fdc5fe68ac57e8a855fe530198bee63b2c56818f7c91819cfaed48f26b77eda6 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5) 2024-04-16T14:47:18.567 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:47:18 smithi005 podman[149956]: 2024-04-16 14:47:18.198516538 +0000 UTC m=+0.017949438 image pull b1a78730e0db57f46162ae12211512856024b361a698c3ed431f6fbc73b484c3 quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 2024-04-16T14:47:18.567 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:47:18 smithi005 podman[149956]: 2024-04-16 14:47:18.316859477 +0000 UTC m=+0.136292436 container create 49e52003781a19f2f0e23e7c53827ddca9527b2823e68affaa143e5a2ddcab56 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-16T14:47:18.567 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:47:18 smithi005 podman[149956]: 2024-04-16 14:47:18.569628197 +0000 UTC m=+0.389061095 container init 49e52003781a19f2f0e23e7c53827ddca9527b2823e68affaa143e5a2ddcab56 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.build-date=20240409, ceph=True, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-04-16T14:47:18.873 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:47:18 smithi005 podman[149956]: 2024-04-16 14:47:18.573216045 +0000 UTC m=+0.392648946 container start 49e52003781a19f2f0e23e7c53827ddca9527b2823e68affaa143e5a2ddcab56 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5) 2024-04-16T14:47:18.873 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:47:18 smithi005 podman[149956]: 2024-04-16 14:47:18.644697449 +0000 UTC m=+0.464130360 container attach 49e52003781a19f2f0e23e7c53827ddca9527b2823e68affaa143e5a2ddcab56 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-16T14:47:19.153 INFO:journalctl@ceph.osd.2.smithi005.stdout:Apr 16 14:47:18 smithi005 podman[149956]: 2024-04-16 14:47:18.875473725 +0000 UTC m=+0.694906622 container died 49e52003781a19f2f0e23e7c53827ddca9527b2823e68affaa143e5a2ddcab56 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240409, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5) 2024-04-16T14:47:19.451 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.2.service' 2024-04-16T14:47:19.496 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-16T14:47:19.496 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-16T14:47:19.496 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-16T14:47:19.496 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.3 2024-04-16T14:47:19.890 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:47:19 smithi115 systemd[1]: Stopping Ceph osd.3 for 10609bfa-fbfd-11ee-bc90-c7b262605968... 2024-04-16T14:47:20.148 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:47:19 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3[93153]: 2024-04-16T14:47:19.891+0000 7f6f6a321700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-16T14:47:20.148 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:47:19 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3[93153]: 2024-04-16T14:47:19.891+0000 7f6f6a321700 -1 osd.3 85 *** Got signal Terminated *** 2024-04-16T14:47:20.149 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:47:19 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3[93153]: 2024-04-16T14:47:19.891+0000 7f6f6a321700 -1 osd.3 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-16T14:47:22.932 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:47:22 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3[93153]: 2024-04-16T14:47:22.448+0000 7f6f6310e700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:47:00.282554+0000 front 2024-04-16T14:47:00.282522+0000 (oldest deadline 2024-04-16T14:47:21.982389+0000) 2024-04-16T14:47:23.931 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:47:23 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3[93153]: 2024-04-16T14:47:23.488+0000 7f6f6310e700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:47:00.282554+0000 front 2024-04-16T14:47:00.282522+0000 (oldest deadline 2024-04-16T14:47:21.982389+0000) 2024-04-16T14:47:23.931 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:23 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4[98489]: 2024-04-16T14:47:23.732+0000 7f6aeaafd700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:46:55.777351+0000 front 2024-04-16T14:46:55.777366+0000 (oldest deadline 2024-04-16T14:47:23.377771+0000) 2024-04-16T14:47:24.754 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:47:24 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3[93153]: 2024-04-16T14:47:24.463+0000 7f6f6310e700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:47:00.282554+0000 front 2024-04-16T14:47:00.282522+0000 (oldest deadline 2024-04-16T14:47:21.982389+0000) 2024-04-16T14:47:24.754 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:24 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:24.501+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:47:00.881432+0000 front 2024-04-16T14:47:00.881417+0000 (oldest deadline 2024-04-16T14:47:24.381341+0000) 2024-04-16T14:47:25.181 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:24 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4[98489]: 2024-04-16T14:47:24.756+0000 7f6aeaafd700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:46:55.777351+0000 front 2024-04-16T14:46:55.777366+0000 (oldest deadline 2024-04-16T14:47:23.377771+0000) 2024-04-16T14:47:25.599 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:47:25 smithi115 podman[120639]: 2024-04-16 14:47:25.263817201 +0000 UTC m=+5.566398453 container died 808ebb96c862028b9ec6f48ab2711348ea69cf650838fafb1da4b63a0f0b78eb (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-16T14:47:25.599 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:25 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:25.488+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:47:00.881432+0000 front 2024-04-16T14:47:00.881417+0000 (oldest deadline 2024-04-16T14:47:24.381341+0000) 2024-04-16T14:47:25.931 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:25 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4[98489]: 2024-04-16T14:47:25.752+0000 7f6aeaafd700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:46:55.777351+0000 front 2024-04-16T14:46:55.777366+0000 (oldest deadline 2024-04-16T14:47:23.377771+0000) 2024-04-16T14:47:25.932 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:47:25 smithi115 podman[120639]: 2024-04-16 14:47:25.708800245 +0000 UTC m=+6.011381531 container cleanup 808ebb96c862028b9ec6f48ab2711348ea69cf650838fafb1da4b63a0f0b78eb (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-04-16T14:47:25.932 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:47:25 smithi115 bash[120639]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3 2024-04-16T14:47:26.376 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:47:25 smithi115 podman[120668]: 2024-04-16 14:47:25.960031375 +0000 UTC m=+0.690520554 container remove 808ebb96c862028b9ec6f48ab2711348ea69cf650838fafb1da4b63a0f0b78eb (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-16T14:47:26.681 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:26 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:26.499+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:47:00.881432+0000 front 2024-04-16T14:47:00.881417+0000 (oldest deadline 2024-04-16T14:47:24.381341+0000) 2024-04-16T14:47:26.682 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:47:26 smithi115 podman[120763]: 2024-04-16 14:47:26.280776216 +0000 UTC m=+0.017377922 image pull b1a78730e0db57f46162ae12211512856024b361a698c3ed431f6fbc73b484c3 quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 2024-04-16T14:47:26.682 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:47:26 smithi115 podman[120763]: 2024-04-16 14:47:26.385813828 +0000 UTC m=+0.122415575 container create 0877ad4ac0cc4a957e80a6a6f532ad98236918d1c5049ca2985d1568de820453 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-16T14:47:26.682 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:47:26 smithi115 podman[120763]: 2024-04-16 14:47:26.622101249 +0000 UTC m=+0.358702955 container init 0877ad4ac0cc4a957e80a6a6f532ad98236918d1c5049ca2985d1568de820453 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-16T14:47:26.682 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:47:26 smithi115 podman[120763]: 2024-04-16 14:47:26.625562198 +0000 UTC m=+0.362163911 container start 0877ad4ac0cc4a957e80a6a6f532ad98236918d1c5049ca2985d1568de820453 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5) 2024-04-16T14:47:27.181 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:26 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4[98489]: 2024-04-16T14:47:26.705+0000 7f6aeaafd700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:46:55.777351+0000 front 2024-04-16T14:46:55.777366+0000 (oldest deadline 2024-04-16T14:47:23.377771+0000) 2024-04-16T14:47:27.182 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:47:26 smithi115 podman[120763]: 2024-04-16 14:47:26.700084051 +0000 UTC m=+0.436685761 container attach 0877ad4ac0cc4a957e80a6a6f532ad98236918d1c5049ca2985d1568de820453 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-16T14:47:27.182 INFO:journalctl@ceph.osd.3.smithi115.stdout:Apr 16 14:47:26 smithi115 podman[120763]: 2024-04-16 14:47:26.918221964 +0000 UTC m=+0.654823675 container died 0877ad4ac0cc4a957e80a6a6f532ad98236918d1c5049ca2985d1568de820453 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409) 2024-04-16T14:47:27.524 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.3.service' 2024-04-16T14:47:27.569 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-16T14:47:27.569 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-16T14:47:27.569 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-16T14:47:27.569 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.4 2024-04-16T14:47:27.918 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:27 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:27.507+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:47:00.881432+0000 front 2024-04-16T14:47:00.881417+0000 (oldest deadline 2024-04-16T14:47:24.381341+0000) 2024-04-16T14:47:27.919 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:27 smithi115 systemd[1]: Stopping Ceph osd.4 for 10609bfa-fbfd-11ee-bc90-c7b262605968... 2024-04-16T14:47:27.919 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:27 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4[98489]: 2024-04-16T14:47:27.726+0000 7f6aeaafd700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:46:55.777351+0000 front 2024-04-16T14:46:55.777366+0000 (oldest deadline 2024-04-16T14:47:23.377771+0000) 2024-04-16T14:47:27.919 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:27 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4[98489]: 2024-04-16T14:47:27.919+0000 7f6aedd08700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-16T14:47:27.919 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:27 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4[98489]: 2024-04-16T14:47:27.919+0000 7f6aedd08700 -1 osd.4 85 *** Got signal Terminated *** 2024-04-16T14:47:27.919 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:27 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4[98489]: 2024-04-16T14:47:27.919+0000 7f6aedd08700 -1 osd.4 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-16T14:47:28.755 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:28 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:28.503+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:47:00.881432+0000 front 2024-04-16T14:47:00.881417+0000 (oldest deadline 2024-04-16T14:47:24.381341+0000) 2024-04-16T14:47:29.181 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:28 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4[98489]: 2024-04-16T14:47:28.756+0000 7f6aeaafd700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:46:55.777351+0000 front 2024-04-16T14:46:55.777366+0000 (oldest deadline 2024-04-16T14:47:23.377771+0000) 2024-04-16T14:47:29.931 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:29 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4[98489]: 2024-04-16T14:47:29.746+0000 7f6aeaafd700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:46:55.777351+0000 front 2024-04-16T14:46:55.777366+0000 (oldest deadline 2024-04-16T14:47:23.377771+0000) 2024-04-16T14:47:29.932 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:29 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:29.498+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:47:00.881432+0000 front 2024-04-16T14:47:00.881417+0000 (oldest deadline 2024-04-16T14:47:24.381341+0000) 2024-04-16T14:47:30.761 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:30 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:30.483+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:47:00.881432+0000 front 2024-04-16T14:47:00.881417+0000 (oldest deadline 2024-04-16T14:47:24.381341+0000) 2024-04-16T14:47:30.761 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:30 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:30.483+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-04-16T14:47:04.381906+0000 front 2024-04-16T14:47:04.381775+0000 (oldest deadline 2024-04-16T14:47:29.681791+0000) 2024-04-16T14:47:31.181 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:30 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4[98489]: 2024-04-16T14:47:30.762+0000 7f6aeaafd700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:46:55.777351+0000 front 2024-04-16T14:46:55.777366+0000 (oldest deadline 2024-04-16T14:47:23.377771+0000) 2024-04-16T14:47:31.182 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:30 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4[98489]: 2024-04-16T14:47:30.762+0000 7f6aeaafd700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-04-16T14:47:06.178895+0000 front 2024-04-16T14:47:06.178922+0000 (oldest deadline 2024-04-16T14:47:30.278857+0000) 2024-04-16T14:47:31.787 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:31 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:31.440+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:47:00.881432+0000 front 2024-04-16T14:47:00.881417+0000 (oldest deadline 2024-04-16T14:47:24.381341+0000) 2024-04-16T14:47:31.788 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:31 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:31.440+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-04-16T14:47:04.381906+0000 front 2024-04-16T14:47:04.381775+0000 (oldest deadline 2024-04-16T14:47:29.681791+0000) 2024-04-16T14:47:32.181 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:31 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4[98489]: 2024-04-16T14:47:31.789+0000 7f6aeaafd700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:46:55.777351+0000 front 2024-04-16T14:46:55.777366+0000 (oldest deadline 2024-04-16T14:47:23.377771+0000) 2024-04-16T14:47:32.181 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:31 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4[98489]: 2024-04-16T14:47:31.789+0000 7f6aeaafd700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-04-16T14:47:06.178895+0000 front 2024-04-16T14:47:06.178922+0000 (oldest deadline 2024-04-16T14:47:30.278857+0000) 2024-04-16T14:47:32.811 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:32 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:32.479+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:47:00.881432+0000 front 2024-04-16T14:47:00.881417+0000 (oldest deadline 2024-04-16T14:47:24.381341+0000) 2024-04-16T14:47:32.811 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:32 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:32.479+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-04-16T14:47:04.381906+0000 front 2024-04-16T14:47:04.381775+0000 (oldest deadline 2024-04-16T14:47:29.681791+0000) 2024-04-16T14:47:33.181 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:32 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4[98489]: 2024-04-16T14:47:32.812+0000 7f6aeaafd700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:46:55.777351+0000 front 2024-04-16T14:46:55.777366+0000 (oldest deadline 2024-04-16T14:47:23.377771+0000) 2024-04-16T14:47:33.181 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:32 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4[98489]: 2024-04-16T14:47:32.812+0000 7f6aeaafd700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-04-16T14:47:06.178895+0000 front 2024-04-16T14:47:06.178922+0000 (oldest deadline 2024-04-16T14:47:30.278857+0000) 2024-04-16T14:47:33.681 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:33 smithi115 podman[120869]: 2024-04-16 14:47:33.381723482 +0000 UTC m=+5.576955351 container died 74d7d2ac5a6a60409d1fa6711cac488496796a46204bddfda431e9a1fd7c4fe3 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-04-16T14:47:33.681 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:33 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:33.501+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:47:00.881432+0000 front 2024-04-16T14:47:00.881417+0000 (oldest deadline 2024-04-16T14:47:24.381341+0000) 2024-04-16T14:47:33.682 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:33 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:33.501+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-04-16T14:47:04.381906+0000 front 2024-04-16T14:47:04.381775+0000 (oldest deadline 2024-04-16T14:47:29.681791+0000) 2024-04-16T14:47:34.026 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:33 smithi115 podman[120869]: 2024-04-16 14:47:33.794674798 +0000 UTC m=+5.989906662 container cleanup 74d7d2ac5a6a60409d1fa6711cac488496796a46204bddfda431e9a1fd7c4fe3 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-16T14:47:34.027 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:33 smithi115 bash[120869]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4 2024-04-16T14:47:34.318 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:34 smithi115 podman[120887]: 2024-04-16 14:47:34.029220781 +0000 UTC m=+0.637828499 container remove 74d7d2ac5a6a60409d1fa6711cac488496796a46204bddfda431e9a1fd7c4fe3 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux ) 2024-04-16T14:47:34.613 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:34 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:34.514+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:47:00.881432+0000 front 2024-04-16T14:47:00.881417+0000 (oldest deadline 2024-04-16T14:47:24.381341+0000) 2024-04-16T14:47:34.614 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:34 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:34.514+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-04-16T14:47:04.381906+0000 front 2024-04-16T14:47:04.381775+0000 (oldest deadline 2024-04-16T14:47:29.681791+0000) 2024-04-16T14:47:34.614 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:34 smithi115 podman[120979]: 2024-04-16 14:47:34.222769958 +0000 UTC m=+0.018055937 image pull b1a78730e0db57f46162ae12211512856024b361a698c3ed431f6fbc73b484c3 quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 2024-04-16T14:47:34.614 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:34 smithi115 podman[120979]: 2024-04-16 14:47:34.321738373 +0000 UTC m=+0.117024378 container create 532b0a4988004cfb18255b06e1b83ceec2cdf137dfe040418ac4b19904cbe94e (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-16T14:47:34.614 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:34 smithi115 podman[120979]: 2024-04-16 14:47:34.532799147 +0000 UTC m=+0.328085107 container init 532b0a4988004cfb18255b06e1b83ceec2cdf137dfe040418ac4b19904cbe94e (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4-deactivate, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5) 2024-04-16T14:47:34.614 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:34 smithi115 podman[120979]: 2024-04-16 14:47:34.536044693 +0000 UTC m=+0.331330670 container start 532b0a4988004cfb18255b06e1b83ceec2cdf137dfe040418ac4b19904cbe94e (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.vendor=CentOS) 2024-04-16T14:47:34.615 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:34 smithi115 podman[120979]: 2024-04-16 14:47:34.615895966 +0000 UTC m=+0.411181959 container attach 532b0a4988004cfb18255b06e1b83ceec2cdf137dfe040418ac4b19904cbe94e (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-16T14:47:34.931 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:34 smithi115 podman[120979]: 2024-04-16 14:47:34.828879519 +0000 UTC m=+0.624165491 container died 532b0a4988004cfb18255b06e1b83ceec2cdf137dfe040418ac4b19904cbe94e (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240409, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-04-16T14:47:35.359 INFO:journalctl@ceph.osd.4.smithi115.stdout:Apr 16 14:47:35 smithi115 podman[121005]: 2024-04-16 14:47:35.352646071 +0000 UTC m=+0.518384116 container remove 532b0a4988004cfb18255b06e1b83ceec2cdf137dfe040418ac4b19904cbe94e (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-16T14:47:35.364 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.4.service' 2024-04-16T14:47:35.407 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-16T14:47:35.407 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-16T14:47:35.407 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-16T14:47:35.407 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.5 2024-04-16T14:47:35.681 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:35 smithi115 systemd[1]: Stopping Ceph osd.5 for 10609bfa-fbfd-11ee-bc90-c7b262605968... 2024-04-16T14:47:35.681 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:35 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:35.544+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:47:00.881432+0000 front 2024-04-16T14:47:00.881417+0000 (oldest deadline 2024-04-16T14:47:24.381341+0000) 2024-04-16T14:47:35.682 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:35 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:35.544+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-04-16T14:47:04.381906+0000 front 2024-04-16T14:47:04.381775+0000 (oldest deadline 2024-04-16T14:47:29.681791+0000) 2024-04-16T14:47:36.181 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:35 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:35.739+0000 7f032b4c1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-16T14:47:36.182 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:35 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:35.739+0000 7f032b4c1700 -1 osd.5 85 *** Got signal Terminated *** 2024-04-16T14:47:36.182 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:35 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:35.739+0000 7f032b4c1700 -1 osd.5 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-16T14:47:36.931 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:36 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:36.511+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:47:00.881432+0000 front 2024-04-16T14:47:00.881417+0000 (oldest deadline 2024-04-16T14:47:24.381341+0000) 2024-04-16T14:47:36.931 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:36 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:36.511+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-04-16T14:47:04.381906+0000 front 2024-04-16T14:47:04.381775+0000 (oldest deadline 2024-04-16T14:47:29.681791+0000) 2024-04-16T14:47:37.931 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:37 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:37.513+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:47:00.881432+0000 front 2024-04-16T14:47:00.881417+0000 (oldest deadline 2024-04-16T14:47:24.381341+0000) 2024-04-16T14:47:37.931 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:37 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:37.513+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-04-16T14:47:04.381906+0000 front 2024-04-16T14:47:04.381775+0000 (oldest deadline 2024-04-16T14:47:29.681791+0000) 2024-04-16T14:47:38.931 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:38 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:38.551+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:47:00.881432+0000 front 2024-04-16T14:47:00.881417+0000 (oldest deadline 2024-04-16T14:47:24.381341+0000) 2024-04-16T14:47:38.931 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:38 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:38.551+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-04-16T14:47:04.381906+0000 front 2024-04-16T14:47:04.381775+0000 (oldest deadline 2024-04-16T14:47:29.681791+0000) 2024-04-16T14:47:38.931 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:38 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:38.551+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6822 osd.2 since back 2024-04-16T14:47:13.683046+0000 front 2024-04-16T14:47:13.683213+0000 (oldest deadline 2024-04-16T14:47:38.382905+0000) 2024-04-16T14:47:39.931 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:39 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:39.503+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:47:00.881432+0000 front 2024-04-16T14:47:00.881417+0000 (oldest deadline 2024-04-16T14:47:24.381341+0000) 2024-04-16T14:47:39.931 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:39 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:39.503+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-04-16T14:47:04.381906+0000 front 2024-04-16T14:47:04.381775+0000 (oldest deadline 2024-04-16T14:47:29.681791+0000) 2024-04-16T14:47:39.931 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:39 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:39.503+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6822 osd.2 since back 2024-04-16T14:47:13.683046+0000 front 2024-04-16T14:47:13.683213+0000 (oldest deadline 2024-04-16T14:47:38.382905+0000) 2024-04-16T14:47:40.931 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:40 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:40.516+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-04-16T14:47:00.881432+0000 front 2024-04-16T14:47:00.881417+0000 (oldest deadline 2024-04-16T14:47:24.381341+0000) 2024-04-16T14:47:40.932 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:40 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:40.516+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-04-16T14:47:04.381906+0000 front 2024-04-16T14:47:04.381775+0000 (oldest deadline 2024-04-16T14:47:29.681791+0000) 2024-04-16T14:47:40.932 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:40 smithi115 ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5[103361]: 2024-04-16T14:47:40.516+0000 7f03282b6700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.5:6822 osd.2 since back 2024-04-16T14:47:13.683046+0000 front 2024-04-16T14:47:13.683213+0000 (oldest deadline 2024-04-16T14:47:38.382905+0000) 2024-04-16T14:47:41.412 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:41 smithi115 podman[121084]: 2024-04-16 14:47:41.140674226 +0000 UTC m=+5.511367765 container died 484bc7617d801a3f0bd3b758fdd80097f185add9c97ed384d9d6240713b4eaf0 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-04-16T14:47:41.681 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:41 smithi115 podman[121084]: 2024-04-16 14:47:41.521984711 +0000 UTC m=+5.892678248 container cleanup 484bc7617d801a3f0bd3b758fdd80097f185add9c97ed384d9d6240713b4eaf0 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, org.label-schema.schema-version=1.0, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-04-16T14:47:41.681 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:41 smithi115 bash[121084]: ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5 2024-04-16T14:47:42.071 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:41 smithi115 podman[121103]: 2024-04-16 14:47:41.772995364 +0000 UTC m=+0.630086692 container remove 484bc7617d801a3f0bd3b758fdd80097f185add9c97ed384d9d6240713b4eaf0 (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5) 2024-04-16T14:47:42.373 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:42 smithi115 podman[121194]: 2024-04-16 14:47:42.073848521 +0000 UTC m=+0.101326486 container create a7de1bcdda7ed826ca12348c7b73149f3bbc191d98236d7b63fa1042355d9c7e (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5-deactivate, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-04-16T14:47:42.374 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:42 smithi115 podman[121194]: 2024-04-16 14:47:41.989948066 +0000 UTC m=+0.017425996 image pull b1a78730e0db57f46162ae12211512856024b361a698c3ed431f6fbc73b484c3 quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91 2024-04-16T14:47:42.374 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:42 smithi115 podman[121194]: 2024-04-16 14:47:42.276955847 +0000 UTC m=+0.304433771 container init a7de1bcdda7ed826ca12348c7b73149f3bbc191d98236d7b63fa1042355d9c7e (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240409, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-04-16T14:47:42.374 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:42 smithi115 podman[121194]: 2024-04-16 14:47:42.280363312 +0000 UTC m=+0.307841236 container start a7de1bcdda7ed826ca12348c7b73149f3bbc191d98236d7b63fa1042355d9c7e (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5-deactivate, io.buildah.version=1.33.5, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True) 2024-04-16T14:47:42.374 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:42 smithi115 podman[121194]: 2024-04-16 14:47:42.376138482 +0000 UTC m=+0.403616421 container attach a7de1bcdda7ed826ca12348c7b73149f3bbc191d98236d7b63fa1042355d9c7e (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240409, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-04-16T14:47:42.681 INFO:journalctl@ceph.osd.5.smithi115.stdout:Apr 16 14:47:42 smithi115 podman[121194]: 2024-04-16 14:47:42.569749953 +0000 UTC m=+0.597227870 container died a7de1bcdda7ed826ca12348c7b73149f3bbc191d98236d7b63fa1042355d9c7e (image=quay.ceph.io/ceph-ci/ceph@sha256:083e2328e58801f8dee4b74a19fe767bb5102759626fea5e94edb1c64adeae91, name=ceph-10609bfa-fbfd-11ee-bc90-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240409, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-adk2-testing-2024-04-15-1136-squid-36befe5) 2024-04-16T14:47:43.172 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10609bfa-fbfd-11ee-bc90-c7b262605968@osd.5.service' 2024-04-16T14:47:43.216 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-16T14:47:43.216 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-16T14:47:43.216 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 --force --keep-logs 2024-04-16T14:48:01.641 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 --force --keep-logs 2024-04-16T14:48:16.276 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-16T14:48:16.313 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-16T14:48:16.344 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-16T14:48:16.346 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/crash to /home/teuthworker/archive/adking-2024-04-16_12:53:12-orch:cephadm-wip-adk2-testing-2024-04-15-1136-squid-distro-default-smithi/7658280/remote/smithi005/crash 2024-04-16T14:48:16.346 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/crash -- . 2024-04-16T14:48:16.383 INFO:teuthology.orchestra.run.smithi005.stderr:tar: /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/crash: Cannot open: No such file or directory 2024-04-16T14:48:16.383 INFO:teuthology.orchestra.run.smithi005.stderr:tar: Error is not recoverable: exiting now 2024-04-16T14:48:16.385 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/crash to /home/teuthworker/archive/adking-2024-04-16_12:53:12-orch:cephadm-wip-adk2-testing-2024-04-15-1136-squid-distro-default-smithi/7658280/remote/smithi115/crash 2024-04-16T14:48:16.386 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/crash -- . 2024-04-16T14:48:16.413 INFO:teuthology.orchestra.run.smithi115.stderr:tar: /var/lib/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/crash: Cannot open: No such file or directory 2024-04-16T14:48:16.414 INFO:teuthology.orchestra.run.smithi115.stderr:tar: Error is not recoverable: exiting now 2024-04-16T14:48:16.415 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-16T14:48:16.415 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | head -n 1 2024-04-16T14:48:16.460 INFO:teuthology.orchestra.run.smithi005.stdout:2024-04-16T14:40:00.000172+0000 mon.smithi005 (mon.0) 357 : cluster 3 [WRN] PG_DEGRADED: Degraded data redundancy: 43/354 objects degraded (12.147%), 12 pgs degraded 2024-04-16T14:48:16.460 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-04-16T14:48:16.461 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[SEC\]' /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | head -n 1 2024-04-16T14:48:16.536 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]' /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | head -n 1 2024-04-16T14:48:16.615 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[WRN\]' /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | head -n 1 2024-04-16T14:48:16.692 INFO:teuthology.orchestra.run.smithi005.stdout:2024-04-16T14:40:00.000172+0000 mon.smithi005 (mon.0) 357 : cluster 3 [WRN] PG_DEGRADED: Degraded data redundancy: 43/354 objects degraded (12.147%), 12 pgs degraded 2024-04-16T14:48:16.692 INFO:tasks.cephadm:Compressing logs... 2024-04-16T14:48:16.692 DEBUG:teuthology.orchestra.run.smithi005:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-16T14:48:16.734 DEBUG:teuthology.orchestra.run.smithi115:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-16T14:48:16.759 INFO:teuthology.orchestra.run.smithi005.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose --: No such file or directory /var/log/ceph/cephadm.log 2024-04-16T14:48:16.760 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-16T14:48:16.760 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph.audit.log 2024-04-16T14:48:16.760 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-mon.smithi005.log 2024-04-16T14:48:16.761 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-osd.1.log 2024-04-16T14:48:16.761 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph.audit.log: /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-mon.smithi005.log: gzip -5 --verbose -- /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-osd.0.log 2024-04-16T14:48:16.761 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph.cephadm.log 2024-04-16T14:48:16.761 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph.log 2024-04-16T14:48:16.762 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-osd.2.log 2024-04-16T14:48:16.762 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph.log: 85.3% -- replaced with /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph.cephadm.log.gz 2024-04-16T14:48:16.763 INFO:teuthology.orchestra.run.smithi115.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-16T14:48:16.764 INFO:teuthology.orchestra.run.smithi115.stderr:: No such file or directory 2024-04-16T14:48:16.764 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-mds.cephfs.smithi115.trkaqh.log 2024-04-16T14:48:16.764 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph.audit.log 2024-04-16T14:48:16.764 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-mds.cephfs.smithi115.trkaqh.log: gzip -5 --verbose -- /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-mon.smithi115.log 2024-04-16T14:48:16.764 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-osd.4.log 2024-04-16T14:48:16.765 INFO:teuthology.orchestra.run.smithi005.stderr: 91.0% -- replaced with /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph.audit.log.gz 2024-04-16T14:48:16.765 INFO:teuthology.orchestra.run.smithi005.stderr: 87.3% -- replaced with /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph.log.gz 2024-04-16T14:48:16.765 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-volume.log 2024-04-16T14:48:16.768 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-osd.5.log 2024-04-16T14:48:16.768 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-mon.smithi115.log: /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-osd.3.log 2024-04-16T14:48:16.768 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-mds.cephfs.smithi115.byfytg.log 2024-04-16T14:48:16.768 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-osd.3.log: 92.5% -- replaced with /var/log/ceph/cephadm.log.gzgzip -5 --verbose -- /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-mgr.smithi115.brjkpo.log 2024-04-16T14:48:16.768 INFO:teuthology.orchestra.run.smithi115.stderr: 2024-04-16T14:48:16.768 INFO:teuthology.orchestra.run.smithi115.stderr:gzip/var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-mds.cephfs.smithi115.byfytg.log: -5 --verbose -- /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph.cephadm.log 2024-04-16T14:48:16.768 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-mgr.smithi115.brjkpo.log: 91.2% -- replaced with /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph.audit.log.gz 2024-04-16T14:48:16.770 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-mds.cephfs.smithi005.vzoqdl.log 2024-04-16T14:48:16.770 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-mds.cephfs.smithi005.wofqlz.log 2024-04-16T14:48:16.784 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph.log 2024-04-16T14:48:16.785 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph.cephadm.log: 85.3% -- replaced with /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph.cephadm.log.gz 2024-04-16T14:48:16.786 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-mds.cephfs.smithi005.vzoqdl.log: gzip -5 --verbose -- /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-mgr.smithi005.ipwdkc.log 2024-04-16T14:48:16.789 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-mds.cephfs.smithi005.wofqlz.log: 91.1% -- replaced with /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-volume.log.gz 2024-04-16T14:48:16.792 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-mgr.smithi005.ipwdkc.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-16T14:48:16.797 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-volume.log 2024-04-16T14:48:16.800 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph.log: 87.3% -- replaced with /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph.log.gz 2024-04-16T14:48:16.823 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-volume.log: 91.0% -- replaced with /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-volume.log.gz 2024-04-16T14:48:16.833 INFO:teuthology.orchestra.run.smithi115.stderr: 89.7% -- replaced with /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-mgr.smithi115.brjkpo.log.gz 2024-04-16T14:48:17.017 INFO:teuthology.orchestra.run.smithi115.stderr: 92.6% -- replaced with /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-mon.smithi115.log.gz 2024-04-16T14:48:17.159 INFO:teuthology.orchestra.run.smithi005.stderr: 88.4% -- replaced with /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-mgr.smithi005.ipwdkc.log.gz 2024-04-16T14:48:17.833 INFO:teuthology.orchestra.run.smithi005.stderr: 90.6% -- replaced with /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-mon.smithi005.log.gz 2024-04-16T14:48:20.765 INFO:teuthology.orchestra.run.smithi005.stderr: 93.3% -- replaced with /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-osd.2.log.gz 2024-04-16T14:48:21.323 INFO:teuthology.orchestra.run.smithi115.stderr: 95.0% -- replaced with /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-mds.cephfs.smithi115.trkaqh.log.gz 2024-04-16T14:48:21.693 INFO:teuthology.orchestra.run.smithi005.stderr: 93.3% -- replaced with /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-osd.0.log.gz 2024-04-16T14:48:21.787 INFO:teuthology.orchestra.run.smithi115.stderr: 93.4% -- replaced with /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-osd.5.log.gz 2024-04-16T14:48:21.789 INFO:teuthology.orchestra.run.smithi005.stderr: 95.0% -- replaced with /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-mds.cephfs.smithi005.vzoqdl.log.gz 2024-04-16T14:48:22.404 INFO:teuthology.orchestra.run.smithi115.stderr: 93.3% -- replaced with /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-osd.4.log.gz 2024-04-16T14:48:23.149 INFO:teuthology.orchestra.run.smithi005.stderr: 93.4% -- replaced with /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-osd.1.log.gz 2024-04-16T14:48:23.993 INFO:teuthology.orchestra.run.smithi115.stderr: 93.4% -- replaced with /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-osd.3.log.gz 2024-04-16T14:48:58.423 INFO:teuthology.orchestra.run.smithi115.stderr: 93.3% -- replaced with /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-mds.cephfs.smithi115.byfytg.log.gz 2024-04-16T14:48:58.425 INFO:teuthology.orchestra.run.smithi115.stderr: 2024-04-16T14:48:58.425 INFO:teuthology.orchestra.run.smithi115.stderr:real 0m41.675s 2024-04-16T14:48:58.425 INFO:teuthology.orchestra.run.smithi115.stderr:user 1m2.286s 2024-04-16T14:48:58.425 INFO:teuthology.orchestra.run.smithi115.stderr:sys 0m2.087s 2024-04-16T14:49:10.213 INFO:teuthology.orchestra.run.smithi005.stderr: 92.8% -- replaced with /var/log/ceph/10609bfa-fbfd-11ee-bc90-c7b262605968/ceph-mds.cephfs.smithi005.wofqlz.log.gz 2024-04-16T14:49:10.214 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-04-16T14:49:10.214 INFO:teuthology.orchestra.run.smithi005.stderr:real 0m53.468s 2024-04-16T14:49:10.215 INFO:teuthology.orchestra.run.smithi005.stderr:user 1m13.019s 2024-04-16T14:49:10.215 INFO:teuthology.orchestra.run.smithi005.stderr:sys 0m2.127s 2024-04-16T14:49:10.215 INFO:tasks.cephadm:Archiving logs... 2024-04-16T14:49:10.215 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/log/ceph to /home/teuthworker/archive/adking-2024-04-16_12:53:12-orch:cephadm-wip-adk2-testing-2024-04-15-1136-squid-distro-default-smithi/7658280/remote/smithi005/log 2024-04-16T14:49:10.217 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-16T14:49:20.884 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/log/ceph to /home/teuthworker/archive/adking-2024-04-16_12:53:12-orch:cephadm-wip-adk2-testing-2024-04-15-1136-squid-distro-default-smithi/7658280/remote/smithi115/log 2024-04-16T14:49:20.885 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-16T14:49:30.117 INFO:tasks.cephadm:Removing cluster... 2024-04-16T14:49:30.117 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 --force 2024-04-16T14:49:30.703 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 10609bfa-fbfd-11ee-bc90-c7b262605968 --force 2024-04-16T14:49:31.252 INFO:tasks.cephadm:Removing cephadm ... 2024-04-16T14:49:31.253 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-16T14:49:31.271 DEBUG:teuthology.orchestra.run.smithi115:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-16T14:49:31.287 INFO:tasks.cephadm:Teardown complete 2024-04-16T14:49:31.287 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-16T14:49:31.358 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-16T14:49:31.358 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-16T14:49:31.361 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-16T14:49:31.442 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-16T14:49:31.454 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-16T14:49:31.454 DEBUG:teuthology.orchestra.run.smithi005:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T14:49:31.458 DEBUG:teuthology.orchestra.run.smithi115:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T14:49:31.471 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: ntpq: command not found 2024-04-16T14:49:31.472 INFO:teuthology.orchestra.run.smithi115.stderr:bash: line 1: ntpq: command not found 2024-04-16T14:49:31.475 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T14:49:31.475 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-04-16T14:49:31.475 INFO:teuthology.orchestra.run.smithi005.stdout:^* hv01.front.sepia.ceph.com 3 6 377 3 +816us[ +885us] +/- 40ms 2024-04-16T14:49:31.475 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 3 -596us[ -596us] +/- 51ms 2024-04-16T14:49:31.475 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 -557us[ -557us] +/- 77ms 2024-04-16T14:49:31.475 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T14:49:31.477 INFO:teuthology.orchestra.run.smithi115.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T14:49:31.477 INFO:teuthology.orchestra.run.smithi115.stdout:=============================================================================== 2024-04-16T14:49:31.477 INFO:teuthology.orchestra.run.smithi115.stdout:^* hv01.front.sepia.ceph.com 3 6 377 9 +817us[ +889us] +/- 40ms 2024-04-16T14:49:31.477 INFO:teuthology.orchestra.run.smithi115.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 5 -598us[ -598us] +/- 51ms 2024-04-16T14:49:31.477 INFO:teuthology.orchestra.run.smithi115.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 1 -549us[ -549us] +/- 77ms 2024-04-16T14:49:31.477 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T14:49:31.478 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-16T14:49:31.489 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-16T14:49:31.490 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-16T14:49:31.501 DEBUG:teuthology.orchestra.run.smithi005:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-16T14:49:31.606 DEBUG:teuthology.orchestra.run.smithi115:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-16T14:49:31.687 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T14:49:31.719 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T14:49:31.719 DEBUG:teuthology.orchestra.run.smithi115:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T14:49:31.751 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T14:49:31.753 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-16T14:49:31.767 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-16T14:49:31.779 INFO:teuthology.task.internal:Duration was 1888.759571 seconds 2024-04-16T14:49:31.779 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-16T14:49:31.790 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-16T14:49:31.790 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-16T14:49:31.793 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-16T14:49:31.835 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T14:49:31.839 INFO:teuthology.orchestra.run.smithi115.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T14:49:32.018 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-16T14:49:32.018 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi005.front.sepia.ceph.com 2024-04-16T14:49:32.019 DEBUG:teuthology.orchestra.run.smithi005:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-16T14:49:32.040 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi115.front.sepia.ceph.com 2024-04-16T14:49:32.040 DEBUG:teuthology.orchestra.run.smithi115:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-16T14:49:32.061 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-16T14:49:32.061 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-16T14:49:32.083 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-16T14:49:32.132 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-16T14:49:32.132 DEBUG:teuthology.orchestra.run.smithi005:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T14:49:32.157 DEBUG:teuthology.orchestra.run.smithi115:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T14:49:32.793 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-16T14:49:32.809 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-16T14:49:32.810 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-16T14:49:32.839 DEBUG:teuthology.orchestra.run.smithi115:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-16T14:49:32.869 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-16T14:49:32.882 DEBUG:teuthology.orchestra.run.smithi005:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-16T14:49:32.885 DEBUG:teuthology.orchestra.run.smithi115:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-16T14:49:32.909 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = core 2024-04-16T14:49:32.937 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = core 2024-04-16T14:49:32.953 DEBUG:teuthology.orchestra.run.smithi005:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-16T14:49:32.980 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T14:49:32.981 DEBUG:teuthology.orchestra.run.smithi115:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-16T14:49:33.010 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T14:49:33.010 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-16T14:49:33.023 INFO:teuthology.task.internal:Transferring archived files... 2024-04-16T14:49:33.025 DEBUG:teuthology.misc:Transferring archived files from smithi005:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/adking-2024-04-16_12:53:12-orch:cephadm-wip-adk2-testing-2024-04-15-1136-squid-distro-default-smithi/7658280/remote/smithi005 2024-04-16T14:49:33.026 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-16T14:49:33.083 DEBUG:teuthology.misc:Transferring archived files from smithi115:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/adking-2024-04-16_12:53:12-orch:cephadm-wip-adk2-testing-2024-04-15-1136-squid-distro-default-smithi/7658280/remote/smithi115 2024-04-16T14:49:33.083 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-16T14:49:33.128 INFO:teuthology.task.internal:Removing archive directory... 2024-04-16T14:49:33.128 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-16T14:49:33.131 DEBUG:teuthology.orchestra.run.smithi115:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-16T14:49:33.177 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-16T14:49:33.191 INFO:teuthology.task.internal:Not uploading archives. 2024-04-16T14:49:33.191 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-16T14:49:33.240 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-16T14:49:33.240 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-16T14:49:33.242 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-16T14:49:33.257 INFO:teuthology.orchestra.run.smithi005.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 14:49 /home/ubuntu/cephtest 2024-04-16T14:49:33.258 INFO:teuthology.orchestra.run.smithi115.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 14:49 /home/ubuntu/cephtest 2024-04-16T14:49:33.259 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-16T14:49:33.273 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-16T14:49:33.303 INFO:teuthology.nuke:Checking targets against current locks 2024-04-16T14:49:33.330 DEBUG:teuthology.nuke:shortname: smithi005 2024-04-16T14:49:33.331 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-16T14:49:33.357 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2024-04-16_12:53:12-orch:cephadm-wip-adk2-testing-2024-04-15-1136-squid-distro-default-smithi/7658280', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 14:09:01.774331', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ7lLiE9bClcAqjQWWvUy8YU4ywbi++5z6wfZJWbqZZkhZDGv7ufEm9QbzBTrNEQUBQPrGx4dqCYGkbyI4Hlg2w='} 2024-04-16T14:49:33.361 DEBUG:teuthology.nuke:shortname: smithi115 2024-04-16T14:49:33.361 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-16T14:49:33.381 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2024-04-16_12:53:12-orch:cephadm-wip-adk2-testing-2024-04-15-1136-squid-distro-default-smithi/7658280', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 14:09:01.772546', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO3S1HLQOcLTWViFwwJgSIXL5mlYnz+idfUF2zvoAMcGAKsm0UqrUk8dLQR1b2VTzGM2d2Ep49crs3gu1rhnpBw='} 2024-04-16T14:49:33.415 INFO:teuthology.orchestra.console.smithi005:Power off 2024-04-16T14:49:33.416 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-16T14:49:33.443 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off 2024-04-16T14:49:33.443 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T14:49:33.459 INFO:teuthology.orchestra.console.smithi115:Power off 2024-04-16T14:49:33.459 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-16T14:49:33.469 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2024-04-16T14:49:33.483 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2024-04-16T14:49:33.484 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T14:49:33.508 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2024-04-16T14:49:37.470 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T14:49:37.509 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T14:49:37.587 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2024-04-16T14:49:37.622 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2024-04-16T14:49:41.592 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T14:49:41.623 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T14:49:41.702 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-04-16T14:49:41.734 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2024-04-16T14:49:41.804 INFO:teuthology.orchestra.console.smithi005:Power off completed 2024-04-16T14:49:45.738 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T14:49:45.848 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-04-16T14:49:45.949 INFO:teuthology.orchestra.console.smithi115:Power off completed 2024-04-16T14:49:46.054 INFO:teuthology.run:Summary data: description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1888.7595710754395 failure_reason: '"2024-04-16T14:40:00.000172+0000 mon.smithi005 (mon.0) 357 : cluster 3 [WRN] PG_DEGRADED: Degraded data redundancy: 43/354 objects degraded (12.147%), 12 pgs degraded" in cluster log' flavor: default owner: scheduled_adking@teuthology success: false 2024-04-16T14:49:46.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T14:49:46.147 INFO:teuthology.run:FAIL